2024-09-19T03:56:16.962 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T03:56:16.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T03:56:17.080 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911625 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/blogbench}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911625' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.dir_split install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi007.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHi77Zqp4vHvsrjHVx+A+diQMM8gCiipj/vpdKLcJwRB0Y/gW7cG9Cmk/wk4xfaYSqS8Wt6hZ7eWLG0QvqnDLAY= smithi092.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBABaoCF02Y1SF71JAF5Xww62jX8p7RbpkHYCnDW6LcqYqPb7uIPTMW2VwuR7Z1oy6R5YC0uzDI77dDDmalcbuJU= smithi102.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO4qcpvgrrxRg3n1AAowAwdNPSVOaTfVZKhv9JXK7TjMizYppWMhqDbmmIcM6EntwCAui/X7u/xtZ99HuwIRaKE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - suites/blogbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T03:56:17.081 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T03:56:17.081 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T03:56:17.081 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T03:56:17.083 INFO:teuthology.task.internal:Checking packages... 2024-09-19T03:56:17.105 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T03:56:17.105 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T03:56:17.105 INFO:teuthology.packaging:ref: None 2024-09-19T03:56:17.105 INFO:teuthology.packaging:tag: None 2024-09-19T03:56:17.105 INFO:teuthology.packaging:branch: squid 2024-09-19T03:56:17.105 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T03:56:17.105 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T03:56:17.334 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T03:56:17.336 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T03:56:17.343 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T03:56:17.344 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T03:56:17.352 INFO:teuthology.task.internal:Saving configuration 2024-09-19T03:56:17.371 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T03:56:17.380 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T03:56:17.403 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911625', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 03:51:12.093700', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHi77Zqp4vHvsrjHVx+A+diQMM8gCiipj/vpdKLcJwRB0Y/gW7cG9Cmk/wk4xfaYSqS8Wt6hZ7eWLG0QvqnDLAY='} 2024-09-19T03:56:17.425 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911625', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 03:51:12.092459', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBABaoCF02Y1SF71JAF5Xww62jX8p7RbpkHYCnDW6LcqYqPb7uIPTMW2VwuR7Z1oy6R5YC0uzDI77dDDmalcbuJU='} 2024-09-19T03:56:17.449 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911625', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 03:51:12.090270', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO4qcpvgrrxRg3n1AAowAwdNPSVOaTfVZKhv9JXK7TjMizYppWMhqDbmmIcM6EntwCAui/X7u/xtZ99HuwIRaKE='} 2024-09-19T03:56:17.449 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T03:56:17.456 INFO:teuthology.task.internal:roles: ubuntu@smithi007.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-19T03:56:17.456 INFO:teuthology.task.internal:roles: ubuntu@smithi092.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-19T03:56:17.457 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-19T03:56:17.457 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T03:56:17.545 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3901797be0>, signals=[15]) 2024-09-19T03:56:17.545 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T03:56:17.552 INFO:teuthology.task.internal:Opening connections... 2024-09-19T03:56:17.552 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi007.front.sepia.ceph.com 2024-09-19T03:56:17.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T03:56:17.631 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi092.front.sepia.ceph.com 2024-09-19T03:56:17.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T03:56:17.702 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi102.front.sepia.ceph.com 2024-09-19T03:56:17.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T03:56:17.775 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T03:56:17.783 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2024-09-19T03:56:17.801 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2024-09-19T03:56:17.801 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2024-09-19T03:56:17.858 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Stream" 2024-09-19T03:56:17.858 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="9" 2024-09-19T03:56:17.859 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos" 2024-09-19T03:56:17.859 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora" 2024-09-19T03:56:17.859 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="9" 2024-09-19T03:56:17.859 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el9" 2024-09-19T03:56:17.859 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T03:56:17.859 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2024-09-19T03:56:17.859 INFO:teuthology.orchestra.run.smithi007.stdout:LOGO="fedora-logo-icon" 2024-09-19T03:56:17.859 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T03:56:17.859 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/" 2024-09-19T03:56:17.859 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T03:56:17.859 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T03:56:17.860 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T03:56:17.860 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2024-09-19T03:56:17.883 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2024-09-19T03:56:17.901 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2024-09-19T03:56:17.901 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2024-09-19T03:56:17.959 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream" 2024-09-19T03:56:17.959 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="9" 2024-09-19T03:56:17.959 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos" 2024-09-19T03:56:17.960 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora" 2024-09-19T03:56:17.960 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="9" 2024-09-19T03:56:17.960 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el9" 2024-09-19T03:56:17.960 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T03:56:17.960 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2024-09-19T03:56:17.960 INFO:teuthology.orchestra.run.smithi092.stdout:LOGO="fedora-logo-icon" 2024-09-19T03:56:17.960 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T03:56:17.960 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/" 2024-09-19T03:56:17.960 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T03:56:17.960 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T03:56:17.960 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T03:56:17.961 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2024-09-19T03:56:17.983 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2024-09-19T03:56:18.001 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2024-09-19T03:56:18.001 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2024-09-19T03:56:18.059 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream" 2024-09-19T03:56:18.059 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9" 2024-09-19T03:56:18.059 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos" 2024-09-19T03:56:18.059 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora" 2024-09-19T03:56:18.059 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9" 2024-09-19T03:56:18.059 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9" 2024-09-19T03:56:18.060 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T03:56:18.060 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2024-09-19T03:56:18.060 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon" 2024-09-19T03:56:18.060 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T03:56:18.060 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/" 2024-09-19T03:56:18.060 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T03:56:18.060 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T03:56:18.060 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T03:56:18.060 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2024-09-19T03:56:18.083 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T03:56:18.093 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T03:56:18.102 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T03:56:18.102 DEBUG:teuthology.orchestra.run.smithi007:> test '!' -e /home/ubuntu/cephtest 2024-09-19T03:56:18.104 DEBUG:teuthology.orchestra.run.smithi092:> test '!' -e /home/ubuntu/cephtest 2024-09-19T03:56:18.106 DEBUG:teuthology.orchestra.run.smithi102:> test '!' -e /home/ubuntu/cephtest 2024-09-19T03:56:18.123 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T03:56:18.131 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T03:56:18.132 DEBUG:teuthology.orchestra.run.smithi007:> test -z $(ls -A /var/lib/ceph) 2024-09-19T03:56:18.162 DEBUG:teuthology.orchestra.run.smithi092:> test -z $(ls -A /var/lib/ceph) 2024-09-19T03:56:18.164 DEBUG:teuthology.orchestra.run.smithi102:> test -z $(ls -A /var/lib/ceph) 2024-09-19T03:56:18.294 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T03:56:18.369 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T03:56:18.384 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-19T03:56:18.384 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-19T03:56:18.385 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-19T03:56:18.385 DEBUG:teuthology.orchestra.run.smithi007:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T03:56:18.401 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T03:56:18.402 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2024-09-19T03:56:18.460 INFO:teuthology.orchestra.run.smithi007.stdout:5.14.0-503.el9.x86_64 2024-09-19T03:56:18.460 INFO:teuthology.task.kernel:Running kernel on smithi007: 5.14.0-503.el9.x86_64 2024-09-19T03:56:18.460 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum install -y kernel 2024-09-19T03:56:21.985 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.3 MB 00:01 2024-09-19T03:56:25.536 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - AppStream 8.3 MB/s | 20 MB 00:02 2024-09-19T03:56:30.911 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.5 MB 00:01 2024-09-19T03:56:32.371 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - Extras packages 95 kB/s | 19 kB 00:00 2024-09-19T03:56:36.321 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 5.9 MB/s | 23 MB 00:03 2024-09-19T03:56:41.915 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-19T03:56:43.888 INFO:teuthology.orchestra.run.smithi007.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T03:56:43.888 INFO:teuthology.orchestra.run.smithi007.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T03:56:43.978 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2024-09-19T03:56:43.992 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2024-09-19T03:56:43.992 INFO:teuthology.orchestra.run.smithi007.stdout: Package Architecture Version Repository Size 2024-09-19T03:56:43.992 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2024-09-19T03:56:43.993 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2024-09-19T03:56:43.993 INFO:teuthology.orchestra.run.smithi007.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T03:56:43.993 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2024-09-19T03:56:43.993 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T03:56:43.993 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T03:56:43.993 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T03:56:43.993 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T03:56:43.993 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2024-09-19T03:56:43.993 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2024-09-19T03:56:43.993 INFO:teuthology.orchestra.run.smithi007.stdout:Install 4 Packages 2024-09-19T03:56:43.993 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T03:56:43.994 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 79 M 2024-09-19T03:56:43.994 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 126 M 2024-09-19T03:56:43.994 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2024-09-19T03:56:44.369 INFO:teuthology.orchestra.run.smithi007.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 280 kB/s | 36 kB 00:00 2024-09-19T03:56:45.177 INFO:teuthology.orchestra.run.smithi007.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-09-19T03:56:45.669 INFO:teuthology.orchestra.run.smithi007.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 22 MB/s | 29 MB 00:01 2024-09-19T03:56:46.036 INFO:teuthology.orchestra.run.smithi007.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 19 MB/s | 35 MB 00:01 2024-09-19T03:56:46.036 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2024-09-19T03:56:46.036 INFO:teuthology.orchestra.run.smithi007.stdout:Total 39 MB/s | 79 MB 00:02 2024-09-19T03:56:46.744 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2024-09-19T03:56:47.113 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2024-09-19T03:56:47.114 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2024-09-19T03:56:48.109 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2024-09-19T03:56:48.109 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2024-09-19T03:56:50.672 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2024-09-19T03:56:51.321 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T03:56:51.402 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T03:56:54.159 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T03:56:54.287 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T03:56:59.438 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T03:56:59.479 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T03:57:04.620 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T03:57:43.618 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T03:57:43.660 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T03:57:44.051 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T03:57:44.051 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T03:57:44.051 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T03:57:44.051 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T03:57:45.042 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T03:57:45.042 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T03:57:45.042 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2024-09-19T03:57:45.042 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T03:57:45.042 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T03:57:45.042 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T03:57:45.042 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T03:57:45.042 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T03:57:45.042 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2024-09-19T03:57:45.399 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T03:57:45.490 INFO:teuthology.orchestra.run.smithi007.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T03:57:45.490 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T03:57:45.491 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T03:57:45.491 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T03:57:45.491 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T03:57:45.491 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-19T03:57:45.491 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi007.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T03:57:45.491 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T03:57:45.550 INFO:teuthology.orchestra.run.smithi007.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T03:57:45.550 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T03:57:45.550 DEBUG:teuthology.orchestra.run.smithi007:> sudo rpm -qi grub2-tools 2024-09-19T03:57:45.581 INFO:teuthology.orchestra.run.smithi007.stdout:Name : grub2-tools 2024-09-19T03:57:45.581 INFO:teuthology.orchestra.run.smithi007.stdout:Epoch : 1 2024-09-19T03:57:45.581 INFO:teuthology.orchestra.run.smithi007.stdout:Version : 2.06 2024-09-19T03:57:45.581 INFO:teuthology.orchestra.run.smithi007.stdout:Release : 82.el9 2024-09-19T03:57:45.581 INFO:teuthology.orchestra.run.smithi007.stdout:Architecture: x86_64 2024-09-19T03:57:45.582 INFO:teuthology.orchestra.run.smithi007.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T03:57:45.582 INFO:teuthology.orchestra.run.smithi007.stdout:Group : Unspecified 2024-09-19T03:57:45.582 INFO:teuthology.orchestra.run.smithi007.stdout:Size : 8274670 2024-09-19T03:57:45.582 INFO:teuthology.orchestra.run.smithi007.stdout:License : GPLv3+ 2024-09-19T03:57:45.582 INFO:teuthology.orchestra.run.smithi007.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T03:57:45.582 INFO:teuthology.orchestra.run.smithi007.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T03:57:45.582 INFO:teuthology.orchestra.run.smithi007.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T03:57:45.582 INFO:teuthology.orchestra.run.smithi007.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T03:57:45.582 INFO:teuthology.orchestra.run.smithi007.stdout:Packager : builder@centos.org 2024-09-19T03:57:45.582 INFO:teuthology.orchestra.run.smithi007.stdout:Vendor : CentOS 2024-09-19T03:57:45.582 INFO:teuthology.orchestra.run.smithi007.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T03:57:45.583 INFO:teuthology.orchestra.run.smithi007.stdout:Summary : Support tools for GRUB. 2024-09-19T03:57:45.583 INFO:teuthology.orchestra.run.smithi007.stdout:Description : 2024-09-19T03:57:45.583 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T03:57:45.583 INFO:teuthology.orchestra.run.smithi007.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T03:57:45.583 INFO:teuthology.orchestra.run.smithi007.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T03:57:45.583 INFO:teuthology.orchestra.run.smithi007.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T03:57:45.583 INFO:teuthology.orchestra.run.smithi007.stdout:hardware devices. 2024-09-19T03:57:45.583 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T03:57:45.583 INFO:teuthology.orchestra.run.smithi007.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T03:57:45.584 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T03:57:45.584 INFO:teuthology.task.kernel:Updating grub on smithi007 to boot 5.14.0-508.el9.x86_64 2024-09-19T03:57:45.584 DEBUG:teuthology.orchestra.run.smithi007:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T03:57:46.208 INFO:teuthology.orchestra.run.smithi007.stderr:Generating grub configuration file ... 2024-09-19T03:57:47.511 INFO:teuthology.orchestra.run.smithi007.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T03:57:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:done 2024-09-19T03:57:47.547 DEBUG:teuthology.orchestra.run.smithi007:> mktemp 2024-09-19T03:57:47.563 INFO:teuthology.orchestra.run.smithi007.stdout:/tmp/tmp.3vkaRf4Hcu 2024-09-19T03:57:47.563 DEBUG:teuthology.orchestra.run.smithi007:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.3vkaRf4Hcu 2024-09-19T03:57:47.641 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0666 /tmp/tmp.3vkaRf4Hcu 2024-09-19T03:57:47.781 DEBUG:teuthology.orchestra.remote:smithi007:/tmp/tmp.3vkaRf4Hcu is 6KB 2024-09-19T03:57:47.830 DEBUG:teuthology.orchestra.run.smithi007:> rm -fr /tmp/tmp.3vkaRf4Hcu 2024-09-19T03:57:47.845 DEBUG:teuthology.orchestra.run.smithi007:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T03:57:47.915 INFO:teuthology.orchestra.run.smithi007.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T03:57:47.915 INFO:teuthology.orchestra.run.smithi007.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T03:57:47.915 INFO:teuthology.orchestra.run.smithi007.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T03:57:47.916 INFO:teuthology.orchestra.run.smithi007.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T03:57:47.917 DEBUG:teuthology.orchestra.run.smithi007:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T03:57:48.062 DEBUG:teuthology.orchestra.run.smithi007:> sudo shutdown -r now 2024-09-19T03:58:18.065 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-19T03:58:18.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-19T03:58:18.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T03:58:36.605 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-09-19T03:58:45.605 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-19T03:58:45.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T03:59:45.609 DEBUG:teuthology.orchestra.remote:timed out 2024-09-19T03:59:57.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-19T03:59:57.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T03:59:57.885 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-09-19T03:59:58.257 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-19T03:59:58.257 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-19T03:59:58.258 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2024-09-19T03:59:58.275 INFO:teuthology.orchestra.run.smithi007.stdout:5.14.0-508.el9.x86_64 2024-09-19T03:59:58.275 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T03:59:58.276 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T03:59:58.276 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T03:59:59.276 DEBUG:teuthology.parallel:result is None 2024-09-19T03:59:59.277 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T03:59:59.284 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T03:59:59.284 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T03:59:59.287 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T03:59:59.289 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T03:59:59.308 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T03:59:59.374 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T03:59:59.381 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T03:59:59.381 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T03:59:59.383 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T03:59:59.386 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T03:59:59.514 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T03:59:59.521 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T03:59:59.521 DEBUG:teuthology.orchestra.run.smithi092:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T03:59:59.537 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T03:59:59.538 DEBUG:teuthology.orchestra.run.smithi102:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T03:59:59.554 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T03:59:59.555 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T03:59:59.557 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T03:59:59.580 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T03:59:59.642 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T03:59:59.649 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T03:59:59.652 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T03:59:59.664 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T03:59:59.665 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T03:59:59.668 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T03:59:59.670 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T03:59:59.680 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T03:59:59.680 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T03:59:59.682 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T03:59:59.684 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T03:59:59.711 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T03:59:59.719 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T03:59:59.719 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T03:59:59.752 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T03:59:59.755 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T03:59:59.771 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T03:59:59.852 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T03:59:59.907 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T03:59:59.989 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T04:00:00.034 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T04:00:00.034 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T04:00:00.101 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T04:00:00.138 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T04:00:00.215 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T04:00:00.260 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T04:00:00.300 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-19T04:00:00.300 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T04:00:00.366 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T04:00:00.413 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T04:00:00.470 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T04:00:00.552 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T04:00:00.596 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T04:00:00.596 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T04:00:00.662 DEBUG:teuthology.orchestra.run.smithi007:> sudo service rsyslog restart 2024-09-19T04:00:00.665 DEBUG:teuthology.orchestra.run.smithi092:> sudo service rsyslog restart 2024-09-19T04:00:00.667 DEBUG:teuthology.orchestra.run.smithi102:> sudo service rsyslog restart 2024-09-19T04:00:00.700 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T04:00:00.709 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T04:00:00.739 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T04:00:01.194 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T04:00:01.202 INFO:teuthology.task.internal:Starting timer... 2024-09-19T04:00:01.202 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T04:00:01.211 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T04:00:01.219 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T04:00:01.219 DEBUG:teuthology.orchestra.run.smithi007:> sudo service auditd rotate 2024-09-19T04:00:01.291 INFO:teuthology.orchestra.run.smithi007.stdout:Rotating logs: 2024-09-19T04:00:01.293 DEBUG:teuthology.orchestra.run.smithi092:> sudo service auditd rotate 2024-09-19T04:00:01.365 INFO:teuthology.orchestra.run.smithi092.stdout:Rotating logs: 2024-09-19T04:00:01.367 DEBUG:teuthology.orchestra.run.smithi102:> sudo service auditd rotate 2024-09-19T04:00:01.428 INFO:teuthology.orchestra.run.smithi102.stdout:Rotating logs: 2024-09-19T04:00:01.430 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T04:00:01.430 DEBUG:teuthology.orchestra.run.smithi007:> /usr/sbin/getenforce 2024-09-19T04:00:01.457 INFO:teuthology.orchestra.run.smithi007.stdout:Permissive 2024-09-19T04:00:01.457 DEBUG:teuthology.orchestra.run.smithi092:> /usr/sbin/getenforce 2024-09-19T04:00:01.492 INFO:teuthology.orchestra.run.smithi092.stdout:Permissive 2024-09-19T04:00:01.492 DEBUG:teuthology.orchestra.run.smithi102:> /usr/sbin/getenforce 2024-09-19T04:00:01.513 INFO:teuthology.orchestra.run.smithi102.stdout:Permissive 2024-09-19T04:00:01.514 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi007.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi092.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi102.front.sepia.ceph.com': 'permissive'} 2024-09-19T04:00:01.514 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T04:00:01.544 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T04:00:01.544 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T04:00:01.572 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T04:00:01.572 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T04:00:01.599 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T04:00:01.600 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T04:00:01.600 DEBUG:teuthology.orchestra.run.smithi007:> sudo /usr/sbin/setenforce permissive 2024-09-19T04:00:01.637 DEBUG:teuthology.orchestra.run.smithi092:> sudo /usr/sbin/setenforce permissive 2024-09-19T04:00:01.671 DEBUG:teuthology.orchestra.run.smithi102:> sudo /usr/sbin/setenforce permissive 2024-09-19T04:00:01.704 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T04:00:01.713 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-19T04:00:01.716 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-19T04:00:01.819 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T04:00:01.829 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T04:00:01.830 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi007.front.sepia.ceph.com,smithi092.front.sepia.ceph.com,smithi102.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T04:04:04.231 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi007.front.sepia.ceph.com'), Remote(name='ubuntu@smithi092.front.sepia.ceph.com'), Remote(name='ubuntu@smithi102.front.sepia.ceph.com')] 2024-09-19T04:04:04.232 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-19T04:04:04.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:04:04.310 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-09-19T04:04:04.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-19T04:04:04.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-19T04:04:04.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:04:04.472 DEBUG:teuthology.orchestra.run.smithi092:> true 2024-09-19T04:04:04.556 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-09-19T04:04:04.557 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-19T04:04:04.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:04:04.634 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-09-19T04:04:04.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-19T04:04:04.715 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T04:04:04.726 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T04:04:04.726 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T04:04:04.726 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T04:04:04.729 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T04:04:04.729 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T04:04:04.731 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T04:04:04.731 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T04:04:04.757 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T04:04:04.759 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T04:04:04.773 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T04:04:04.773 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T04:04:04.785 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T04:04:04.797 INFO:teuthology.orchestra.run.smithi092.stderr:sudo: ntpd: command not found 2024-09-19T04:04:04.798 INFO:teuthology.orchestra.run.smithi007.stderr:sudo: ntpd: command not found 2024-09-19T04:04:04.800 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T04:04:04.808 INFO:teuthology.orchestra.run.smithi092.stdout:506 Cannot talk to daemon 2024-09-19T04:04:04.809 INFO:teuthology.orchestra.run.smithi007.stdout:506 Cannot talk to daemon 2024-09-19T04:04:04.822 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T04:04:04.823 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T04:04:04.826 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: ntpd: command not found 2024-09-19T04:04:04.836 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T04:04:04.837 INFO:teuthology.orchestra.run.smithi102.stdout:506 Cannot talk to daemon 2024-09-19T04:04:04.838 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T04:04:04.852 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T04:04:04.866 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T04:04:04.894 INFO:teuthology.orchestra.run.smithi092.stderr:bash: line 1: ntpq: command not found 2024-09-19T04:04:04.896 INFO:teuthology.orchestra.run.smithi007.stderr:bash: line 1: ntpq: command not found 2024-09-19T04:04:04.897 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T04:04:04.897 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2024-09-19T04:04:04.897 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:04:04.897 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:04:04.897 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:04:04.897 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:04:04.900 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T04:04:04.900 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2024-09-19T04:04:04.900 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:04:04.900 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:04:04.900 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:04:04.900 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:04:04.927 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2024-09-19T04:04:04.930 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T04:04:04.930 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2024-09-19T04:04:04.931 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:04:04.931 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:04:04.931 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:04:04.931 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:04:04.932 INFO:teuthology.run_tasks:Running task install... 2024-09-19T04:04:04.940 DEBUG:teuthology.task.install:project ceph 2024-09-19T04:04:04.940 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T04:04:04.940 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T04:04:04.940 INFO:teuthology.task.install:Using flavor: default 2024-09-19T04:04:04.946 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T04:04:04.946 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T04:04:04.946 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T04:04:04.947 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:04:04.948 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T04:04:04.948 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:04:04.949 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T04:04:04.950 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:04:05.094 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T04:04:05.094 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T04:04:05.097 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T04:04:05.097 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T04:04:05.105 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T04:04:05.105 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T04:04:05.204 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T04:04:05.205 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T04:04:05.205 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T04:04:05.210 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T04:04:05.210 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T04:04:05.210 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T04:04:05.217 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T04:04:05.217 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-19T04:04:05.217 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T04:04:05.232 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T04:04:05.232 DEBUG:teuthology.orchestra.run.smithi007:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T04:04:05.236 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T04:04:05.236 DEBUG:teuthology.orchestra.run.smithi102:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T04:04:05.242 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T04:04:05.242 DEBUG:teuthology.orchestra.run.smithi092:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T04:04:05.299 DEBUG:teuthology.orchestra.run.smithi007:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T04:04:05.301 DEBUG:teuthology.orchestra.run.smithi102:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T04:04:05.307 DEBUG:teuthology.orchestra.run.smithi092:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T04:04:05.376 DEBUG:teuthology.orchestra.run.smithi007:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T04:04:05.377 DEBUG:teuthology.orchestra.run.smithi102:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T04:04:05.382 DEBUG:teuthology.orchestra.run.smithi092:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T04:04:05.441 INFO:teuthology.orchestra.run.smithi102.stdout:check_obsoletes = 1 2024-09-19T04:04:05.441 INFO:teuthology.orchestra.run.smithi007.stdout:check_obsoletes = 1 2024-09-19T04:04:05.443 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum clean all 2024-09-19T04:04:05.444 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum clean all 2024-09-19T04:04:05.447 INFO:teuthology.orchestra.run.smithi092.stdout:check_obsoletes = 1 2024-09-19T04:04:05.449 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum clean all 2024-09-19T04:04:05.668 INFO:teuthology.orchestra.run.smithi102.stdout:45 files removed 2024-09-19T04:04:05.673 INFO:teuthology.orchestra.run.smithi092.stdout:45 files removed 2024-09-19T04:04:05.676 INFO:teuthology.orchestra.run.smithi007.stdout:45 files removed 2024-09-19T04:04:05.695 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T04:04:05.700 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T04:04:05.702 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T04:04:06.248 INFO:teuthology.orchestra.run.smithi092.stdout:ceph packages for x86_64 309 kB/s | 84 kB 00:00 2024-09-19T04:04:06.248 INFO:teuthology.orchestra.run.smithi102.stdout:ceph packages for x86_64 302 kB/s | 84 kB 00:00 2024-09-19T04:04:06.279 INFO:teuthology.orchestra.run.smithi007.stdout:ceph packages for x86_64 303 kB/s | 84 kB 00:00 2024-09-19T04:04:06.540 INFO:teuthology.orchestra.run.smithi102.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-19T04:04:06.571 INFO:teuthology.orchestra.run.smithi007.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-19T04:04:06.607 INFO:teuthology.orchestra.run.smithi092.stdout:ceph noarch packages 37 kB/s | 12 kB 00:00 2024-09-19T04:04:06.816 INFO:teuthology.orchestra.run.smithi102.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-19T04:04:06.838 INFO:teuthology.orchestra.run.smithi007.stdout:ceph source packages 8.3 kB/s | 1.9 kB 00:00 2024-09-19T04:04:06.874 INFO:teuthology.orchestra.run.smithi092.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-19T04:04:07.381 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.3 MB 00:00 2024-09-19T04:04:07.583 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-19T04:04:08.707 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.3 MB 00:01 2024-09-19T04:04:09.432 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-19T04:04:10.434 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-19T04:04:11.017 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 8.6 MB/s | 20 MB 00:02 2024-09-19T04:04:13.716 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - CRB 19 MB/s | 6.5 MB 00:00 2024-09-19T04:04:14.759 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-19T04:04:15.292 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 19 kB 00:00 2024-09-19T04:04:15.335 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-19T04:04:16.918 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 19 kB 00:00 2024-09-19T04:04:16.977 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 19 kB 00:00 2024-09-19T04:04:17.716 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 9.9 MB/s | 23 MB 00:02 2024-09-19T04:04:19.934 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 8.0 MB/s | 23 MB 00:02 2024-09-19T04:04:20.608 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 6.3 MB/s | 23 MB 00:03 2024-09-19T04:04:23.361 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-19T04:04:25.339 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-09-19T04:04:25.650 INFO:teuthology.orchestra.run.smithi007.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T04:04:25.651 INFO:teuthology.orchestra.run.smithi007.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T04:04:25.665 INFO:teuthology.orchestra.run.smithi007.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T04:04:25.666 INFO:teuthology.orchestra.run.smithi007.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T04:04:25.667 INFO:teuthology.orchestra.run.smithi007.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T04:04:25.668 INFO:teuthology.orchestra.run.smithi007.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T04:04:25.670 INFO:teuthology.orchestra.run.smithi007.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T04:04:25.673 INFO:teuthology.orchestra.run.smithi007.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T04:04:25.674 INFO:teuthology.orchestra.run.smithi007.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T04:04:25.742 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2024-09-19T04:04:25.760 INFO:teuthology.orchestra.run.smithi007.stdout:====================================================================================== 2024-09-19T04:04:25.760 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2024-09-19T04:04:25.760 INFO:teuthology.orchestra.run.smithi007.stdout:====================================================================================== 2024-09-19T04:04:25.760 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2024-09-19T04:04:25.760 INFO:teuthology.orchestra.run.smithi007.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T04:04:25.760 INFO:teuthology.orchestra.run.smithi007.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T04:04:25.760 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T04:04:25.760 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T04:04:25.760 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T04:04:25.760 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T04:04:25.760 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T04:04:25.761 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T04:04:25.761 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T04:04:25.761 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T04:04:25.761 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T04:04:25.761 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T04:04:25.761 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T04:04:25.761 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T04:04:25.761 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T04:04:25.761 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T04:04:25.761 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T04:04:25.761 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T04:04:25.762 INFO:teuthology.orchestra.run.smithi007.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T04:04:25.762 INFO:teuthology.orchestra.run.smithi007.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T04:04:25.762 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T04:04:25.762 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T04:04:25.762 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T04:04:25.762 INFO:teuthology.orchestra.run.smithi007.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T04:04:25.762 INFO:teuthology.orchestra.run.smithi007.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T04:04:25.762 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T04:04:25.762 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T04:04:25.762 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T04:04:25.762 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T04:04:25.762 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T04:04:25.762 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T04:04:25.762 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T04:04:25.763 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T04:04:25.763 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T04:04:25.763 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T04:04:25.763 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T04:04:25.763 INFO:teuthology.orchestra.run.smithi007.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T04:04:25.763 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrading: 2024-09-19T04:04:25.763 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T04:04:25.763 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T04:04:25.763 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T04:04:25.763 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T04:04:25.763 INFO:teuthology.orchestra.run.smithi007.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T04:04:25.763 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T04:04:25.763 INFO:teuthology.orchestra.run.smithi007.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T04:04:25.763 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T04:04:25.764 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2024-09-19T04:04:25.764 INFO:teuthology.orchestra.run.smithi007.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T04:04:25.764 INFO:teuthology.orchestra.run.smithi007.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T04:04:25.764 INFO:teuthology.orchestra.run.smithi007.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T04:04:25.764 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T04:04:25.764 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T04:04:25.764 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T04:04:25.764 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T04:04:25.764 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T04:04:25.764 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T04:04:25.764 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T04:04:25.764 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T04:04:25.764 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T04:04:25.765 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T04:04:25.765 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T04:04:25.765 INFO:teuthology.orchestra.run.smithi007.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T04:04:25.765 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T04:04:25.765 INFO:teuthology.orchestra.run.smithi007.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T04:04:25.765 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T04:04:25.765 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T04:04:25.765 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T04:04:25.765 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T04:04:25.765 INFO:teuthology.orchestra.run.smithi007.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T04:04:25.765 INFO:teuthology.orchestra.run.smithi007.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T04:04:25.765 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T04:04:25.765 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T04:04:25.766 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T04:04:25.766 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T04:04:25.766 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T04:04:25.766 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T04:04:25.766 INFO:teuthology.orchestra.run.smithi007.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T04:04:25.766 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T04:04:25.766 INFO:teuthology.orchestra.run.smithi007.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T04:04:25.766 INFO:teuthology.orchestra.run.smithi007.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T04:04:25.766 INFO:teuthology.orchestra.run.smithi007.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T04:04:25.766 INFO:teuthology.orchestra.run.smithi007.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T04:04:25.767 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T04:04:25.767 INFO:teuthology.orchestra.run.smithi007.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T04:04:25.767 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T04:04:25.767 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T04:04:25.767 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T04:04:25.767 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T04:04:25.767 INFO:teuthology.orchestra.run.smithi007.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T04:04:25.767 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T04:04:25.767 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T04:04:25.767 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T04:04:25.767 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T04:04:25.767 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T04:04:25.767 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T04:04:25.768 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T04:04:25.768 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T04:04:25.768 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T04:04:25.768 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T04:04:25.768 INFO:teuthology.orchestra.run.smithi007.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T04:04:25.768 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T04:04:25.768 INFO:teuthology.orchestra.run.smithi007.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T04:04:25.768 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T04:04:25.768 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T04:04:25.768 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T04:04:25.768 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T04:04:25.768 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T04:04:25.769 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T04:04:25.769 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T04:04:25.769 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T04:04:25.769 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T04:04:25.769 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T04:04:25.769 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T04:04:25.769 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T04:04:25.769 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T04:04:25.769 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T04:04:25.769 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T04:04:25.769 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T04:04:25.769 INFO:teuthology.orchestra.run.smithi007.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T04:04:25.769 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T04:04:25.770 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T04:04:25.770 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T04:04:25.770 INFO:teuthology.orchestra.run.smithi007.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T04:04:25.770 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T04:04:25.770 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T04:04:25.770 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T04:04:25.770 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T04:04:25.770 INFO:teuthology.orchestra.run.smithi007.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T04:04:25.770 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T04:04:25.770 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T04:04:25.770 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T04:04:25.770 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T04:04:25.771 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T04:04:25.771 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T04:04:25.771 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T04:04:25.771 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T04:04:25.771 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T04:04:25.771 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T04:04:25.771 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T04:04:25.771 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T04:04:25.771 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T04:04:25.771 INFO:teuthology.orchestra.run.smithi007.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T04:04:25.771 INFO:teuthology.orchestra.run.smithi007.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T04:04:25.771 INFO:teuthology.orchestra.run.smithi007.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T04:04:25.771 INFO:teuthology.orchestra.run.smithi007.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T04:04:25.772 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T04:04:25.772 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T04:04:25.772 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T04:04:25.772 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T04:04:25.772 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T04:04:25.772 INFO:teuthology.orchestra.run.smithi007.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T04:04:25.772 INFO:teuthology.orchestra.run.smithi007.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T04:04:25.772 INFO:teuthology.orchestra.run.smithi007.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T04:04:25.772 INFO:teuthology.orchestra.run.smithi007.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T04:04:25.772 INFO:teuthology.orchestra.run.smithi007.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T04:04:25.772 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T04:04:25.772 INFO:teuthology.orchestra.run.smithi007.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T04:04:25.772 INFO:teuthology.orchestra.run.smithi007.stdout:Installing weak dependencies: 2024-09-19T04:04:25.772 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T04:04:25.773 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:04:25.773 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2024-09-19T04:04:25.773 INFO:teuthology.orchestra.run.smithi007.stdout:====================================================================================== 2024-09-19T04:04:25.773 INFO:teuthology.orchestra.run.smithi007.stdout:Install 148 Packages 2024-09-19T04:04:25.773 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrade 8 Packages 2024-09-19T04:04:25.773 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:04:25.773 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 226 M 2024-09-19T04:04:25.774 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2024-09-19T04:04:26.037 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 49 kB/s | 1.7 kB 00:00 2024-09-19T04:04:26.563 INFO:teuthology.orchestra.run.smithi007.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 54 kB/s | 6.6 kB 00:00 2024-09-19T04:04:26.746 INFO:teuthology.orchestra.run.smithi007.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 4.8 MB/s | 896 kB 00:00 2024-09-19T04:04:26.821 INFO:teuthology.orchestra.run.smithi007.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.9 MB/s | 145 kB 00:00 2024-09-19T04:04:26.905 INFO:teuthology.orchestra.run.smithi007.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 12 MB/s | 5.4 MB 00:00 2024-09-19T04:04:27.014 INFO:teuthology.orchestra.run.smithi007.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 12 MB/s | 2.4 MB 00:00 2024-09-19T04:04:27.047 INFO:teuthology.orchestra.run.smithi007.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 11 MB/s | 1.5 MB 00:00 2024-09-19T04:04:27.381 INFO:teuthology.orchestra.run.smithi007.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 13 MB/s | 4.7 MB 00:00 2024-09-19T04:04:27.491 INFO:teuthology.orchestra.run.smithi102.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T04:04:27.492 INFO:teuthology.orchestra.run.smithi102.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T04:04:27.503 INFO:teuthology.orchestra.run.smithi102.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T04:04:27.504 INFO:teuthology.orchestra.run.smithi102.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T04:04:27.505 INFO:teuthology.orchestra.run.smithi102.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T04:04:27.506 INFO:teuthology.orchestra.run.smithi102.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T04:04:27.508 INFO:teuthology.orchestra.run.smithi102.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T04:04:27.510 INFO:teuthology.orchestra.run.smithi102.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T04:04:27.511 INFO:teuthology.orchestra.run.smithi102.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T04:04:27.574 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T04:04:27.594 INFO:teuthology.orchestra.run.smithi102.stdout:====================================================================================== 2024-09-19T04:04:27.594 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-19T04:04:27.594 INFO:teuthology.orchestra.run.smithi102.stdout:====================================================================================== 2024-09-19T04:04:27.594 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T04:04:27.594 INFO:teuthology.orchestra.run.smithi102.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T04:04:27.594 INFO:teuthology.orchestra.run.smithi102.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T04:04:27.594 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T04:04:27.594 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T04:04:27.594 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T04:04:27.594 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T04:04:27.594 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T04:04:27.594 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T04:04:27.595 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T04:04:27.595 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T04:04:27.595 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T04:04:27.595 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T04:04:27.595 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T04:04:27.595 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T04:04:27.595 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T04:04:27.595 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T04:04:27.595 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T04:04:27.595 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T04:04:27.595 INFO:teuthology.orchestra.run.smithi102.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T04:04:27.595 INFO:teuthology.orchestra.run.smithi102.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T04:04:27.596 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T04:04:27.596 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T04:04:27.596 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T04:04:27.596 INFO:teuthology.orchestra.run.smithi102.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T04:04:27.596 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T04:04:27.596 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T04:04:27.596 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T04:04:27.596 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T04:04:27.596 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T04:04:27.596 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T04:04:27.596 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T04:04:27.596 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T04:04:27.596 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T04:04:27.597 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T04:04:27.597 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T04:04:27.597 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T04:04:27.597 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T04:04:27.597 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrading: 2024-09-19T04:04:27.597 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T04:04:27.597 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T04:04:27.597 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T04:04:27.597 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T04:04:27.597 INFO:teuthology.orchestra.run.smithi102.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T04:04:27.597 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T04:04:27.597 INFO:teuthology.orchestra.run.smithi102.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T04:04:27.598 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T04:04:27.598 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-19T04:04:27.598 INFO:teuthology.orchestra.run.smithi102.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T04:04:27.598 INFO:teuthology.orchestra.run.smithi102.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T04:04:27.598 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T04:04:27.598 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T04:04:27.598 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T04:04:27.598 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T04:04:27.598 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T04:04:27.598 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T04:04:27.598 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T04:04:27.598 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T04:04:27.598 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T04:04:27.598 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T04:04:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T04:04:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T04:04:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T04:04:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T04:04:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T04:04:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T04:04:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T04:04:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T04:04:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T04:04:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T04:04:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T04:04:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T04:04:27.599 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T04:04:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T04:04:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T04:04:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T04:04:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T04:04:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T04:04:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T04:04:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T04:04:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T04:04:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T04:04:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T04:04:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T04:04:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T04:04:27.600 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T04:04:27.601 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T04:04:27.601 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T04:04:27.601 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T04:04:27.601 INFO:teuthology.orchestra.run.smithi102.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T04:04:27.601 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T04:04:27.601 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T04:04:27.601 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T04:04:27.601 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T04:04:27.601 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T04:04:27.601 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T04:04:27.601 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T04:04:27.601 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T04:04:27.601 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T04:04:27.602 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T04:04:27.602 INFO:teuthology.orchestra.run.smithi102.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T04:04:27.602 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T04:04:27.602 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T04:04:27.602 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T04:04:27.602 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T04:04:27.602 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T04:04:27.602 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T04:04:27.602 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T04:04:27.602 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T04:04:27.602 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T04:04:27.602 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T04:04:27.602 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T04:04:27.603 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T04:04:27.603 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T04:04:27.603 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T04:04:27.603 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T04:04:27.603 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T04:04:27.603 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T04:04:27.603 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T04:04:27.603 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T04:04:27.603 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T04:04:27.603 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T04:04:27.603 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T04:04:27.603 INFO:teuthology.orchestra.run.smithi102.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T04:04:27.603 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T04:04:27.604 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T04:04:27.604 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T04:04:27.604 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T04:04:27.604 INFO:teuthology.orchestra.run.smithi102.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T04:04:27.604 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T04:04:27.604 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T04:04:27.604 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T04:04:27.604 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T04:04:27.604 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T04:04:27.604 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T04:04:27.604 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T04:04:27.604 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T04:04:27.604 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T04:04:27.605 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T04:04:27.605 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T04:04:27.605 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T04:04:27.605 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T04:04:27.605 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T04:04:27.605 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T04:04:27.605 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T04:04:27.605 INFO:teuthology.orchestra.run.smithi102.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T04:04:27.605 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T04:04:27.605 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T04:04:27.605 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T04:04:27.605 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T04:04:27.605 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T04:04:27.605 INFO:teuthology.orchestra.run.smithi102.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T04:04:27.606 INFO:teuthology.orchestra.run.smithi102.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T04:04:27.606 INFO:teuthology.orchestra.run.smithi102.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T04:04:27.606 INFO:teuthology.orchestra.run.smithi102.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T04:04:27.606 INFO:teuthology.orchestra.run.smithi102.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T04:04:27.606 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T04:04:27.606 INFO:teuthology.orchestra.run.smithi102.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T04:04:27.606 INFO:teuthology.orchestra.run.smithi102.stdout:Installing weak dependencies: 2024-09-19T04:04:27.606 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T04:04:27.606 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T04:04:27.606 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T04:04:27.606 INFO:teuthology.orchestra.run.smithi102.stdout:====================================================================================== 2024-09-19T04:04:27.606 INFO:teuthology.orchestra.run.smithi102.stdout:Install 148 Packages 2024-09-19T04:04:27.606 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrade 8 Packages 2024-09-19T04:04:27.607 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T04:04:27.607 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 226 M 2024-09-19T04:04:27.607 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T04:04:27.906 INFO:teuthology.orchestra.run.smithi007.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 14 MB/s | 21 MB 00:01 2024-09-19T04:04:28.081 INFO:teuthology.orchestra.run.smithi007.stdout:(9/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86_ 16 MB/s | 17 MB 00:01 2024-09-19T04:04:28.107 INFO:teuthology.orchestra.run.smithi007.stdout:(10/156): ceph-selinux-19.1.1-361.g2f599a46.el9 126 kB/s | 25 kB 00:00 2024-09-19T04:04:28.157 INFO:teuthology.orchestra.run.smithi007.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 4.5 MB/s | 228 kB 00:00 2024-09-19T04:04:28.164 INFO:teuthology.orchestra.run.smithi092.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T04:04:28.165 INFO:teuthology.orchestra.run.smithi092.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T04:04:28.176 INFO:teuthology.orchestra.run.smithi092.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T04:04:28.177 INFO:teuthology.orchestra.run.smithi092.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T04:04:28.178 INFO:teuthology.orchestra.run.smithi092.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T04:04:28.178 INFO:teuthology.orchestra.run.smithi092.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T04:04:28.180 INFO:teuthology.orchestra.run.smithi092.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T04:04:28.182 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T04:04:28.183 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T04:04:28.245 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-09-19T04:04:28.255 INFO:teuthology.orchestra.run.smithi092.stdout:====================================================================================== 2024-09-19T04:04:28.255 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-09-19T04:04:28.255 INFO:teuthology.orchestra.run.smithi092.stdout:====================================================================================== 2024-09-19T04:04:28.255 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-09-19T04:04:28.255 INFO:teuthology.orchestra.run.smithi092.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T04:04:28.255 INFO:teuthology.orchestra.run.smithi092.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T04:04:28.255 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T04:04:28.255 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T04:04:28.256 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T04:04:28.256 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T04:04:28.256 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T04:04:28.256 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T04:04:28.256 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T04:04:28.256 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T04:04:28.256 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T04:04:28.256 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T04:04:28.256 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T04:04:28.256 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T04:04:28.256 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T04:04:28.256 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T04:04:28.256 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T04:04:28.257 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T04:04:28.257 INFO:teuthology.orchestra.run.smithi092.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T04:04:28.257 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T04:04:28.257 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T04:04:28.257 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T04:04:28.257 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T04:04:28.257 INFO:teuthology.orchestra.run.smithi092.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T04:04:28.257 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T04:04:28.257 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T04:04:28.257 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T04:04:28.257 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T04:04:28.257 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T04:04:28.258 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T04:04:28.258 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T04:04:28.258 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T04:04:28.258 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T04:04:28.258 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T04:04:28.258 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T04:04:28.258 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T04:04:28.258 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T04:04:28.258 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrading: 2024-09-19T04:04:28.258 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T04:04:28.258 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T04:04:28.258 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T04:04:28.259 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T04:04:28.259 INFO:teuthology.orchestra.run.smithi092.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T04:04:28.259 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T04:04:28.259 INFO:teuthology.orchestra.run.smithi092.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T04:04:28.259 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T04:04:28.259 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-09-19T04:04:28.259 INFO:teuthology.orchestra.run.smithi092.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T04:04:28.259 INFO:teuthology.orchestra.run.smithi092.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T04:04:28.259 INFO:teuthology.orchestra.run.smithi092.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T04:04:28.259 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T04:04:28.259 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T04:04:28.259 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T04:04:28.259 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T04:04:28.260 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T04:04:28.260 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T04:04:28.260 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T04:04:28.260 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T04:04:28.260 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T04:04:28.260 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T04:04:28.260 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T04:04:28.260 INFO:teuthology.orchestra.run.smithi092.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T04:04:28.260 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T04:04:28.260 INFO:teuthology.orchestra.run.smithi092.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T04:04:28.260 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T04:04:28.260 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T04:04:28.261 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T04:04:28.261 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T04:04:28.261 INFO:teuthology.orchestra.run.smithi092.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T04:04:28.261 INFO:teuthology.orchestra.run.smithi092.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T04:04:28.261 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T04:04:28.261 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T04:04:28.261 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T04:04:28.261 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T04:04:28.261 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T04:04:28.261 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T04:04:28.261 INFO:teuthology.orchestra.run.smithi092.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T04:04:28.261 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T04:04:28.261 INFO:teuthology.orchestra.run.smithi092.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T04:04:28.262 INFO:teuthology.orchestra.run.smithi092.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T04:04:28.262 INFO:teuthology.orchestra.run.smithi092.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T04:04:28.262 INFO:teuthology.orchestra.run.smithi092.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T04:04:28.262 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T04:04:28.262 INFO:teuthology.orchestra.run.smithi092.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T04:04:28.262 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T04:04:28.262 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T04:04:28.262 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T04:04:28.262 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T04:04:28.262 INFO:teuthology.orchestra.run.smithi092.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T04:04:28.262 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T04:04:28.262 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T04:04:28.263 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T04:04:28.263 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T04:04:28.263 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T04:04:28.263 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T04:04:28.263 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T04:04:28.263 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T04:04:28.263 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T04:04:28.263 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T04:04:28.263 INFO:teuthology.orchestra.run.smithi092.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T04:04:28.263 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T04:04:28.263 INFO:teuthology.orchestra.run.smithi092.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T04:04:28.264 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T04:04:28.264 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T04:04:28.264 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T04:04:28.264 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T04:04:28.264 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T04:04:28.264 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T04:04:28.264 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T04:04:28.264 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T04:04:28.264 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T04:04:28.264 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T04:04:28.264 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T04:04:28.264 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T04:04:28.264 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T04:04:28.265 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T04:04:28.265 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T04:04:28.265 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T04:04:28.265 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T04:04:28.265 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T04:04:28.265 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T04:04:28.265 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T04:04:28.265 INFO:teuthology.orchestra.run.smithi092.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T04:04:28.265 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T04:04:28.265 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T04:04:28.265 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T04:04:28.265 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T04:04:28.265 INFO:teuthology.orchestra.run.smithi092.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T04:04:28.266 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T04:04:28.266 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T04:04:28.266 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T04:04:28.266 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T04:04:28.266 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T04:04:28.266 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T04:04:28.266 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T04:04:28.266 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T04:04:28.266 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T04:04:28.266 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T04:04:28.266 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T04:04:28.266 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T04:04:28.266 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T04:04:28.267 INFO:teuthology.orchestra.run.smithi092.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T04:04:28.267 INFO:teuthology.orchestra.run.smithi092.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T04:04:28.267 INFO:teuthology.orchestra.run.smithi092.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T04:04:28.267 INFO:teuthology.orchestra.run.smithi092.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T04:04:28.267 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T04:04:28.267 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T04:04:28.267 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T04:04:28.267 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T04:04:28.267 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T04:04:28.267 INFO:teuthology.orchestra.run.smithi092.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T04:04:28.267 INFO:teuthology.orchestra.run.smithi092.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T04:04:28.267 INFO:teuthology.orchestra.run.smithi092.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T04:04:28.267 INFO:teuthology.orchestra.run.smithi092.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T04:04:28.267 INFO:teuthology.orchestra.run.smithi092.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T04:04:28.268 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T04:04:28.268 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T04:04:28.268 INFO:teuthology.orchestra.run.smithi092.stdout:Installing weak dependencies: 2024-09-19T04:04:28.268 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T04:04:28.268 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T04:04:28.268 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-09-19T04:04:28.268 INFO:teuthology.orchestra.run.smithi092.stdout:====================================================================================== 2024-09-19T04:04:28.268 INFO:teuthology.orchestra.run.smithi092.stdout:Install 148 Packages 2024-09-19T04:04:28.268 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrade 8 Packages 2024-09-19T04:04:28.268 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T04:04:28.269 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 226 M 2024-09-19T04:04:28.269 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-09-19T04:04:28.290 INFO:teuthology.orchestra.run.smithi007.stdout:(12/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 12 MB/s | 11 MB 00:00 2024-09-19T04:04:28.316 INFO:teuthology.orchestra.run.smithi007.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 170 kB/s | 27 kB 00:00 2024-09-19T04:04:28.341 INFO:teuthology.orchestra.run.smithi007.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 634 kB/s | 32 kB 00:00 2024-09-19T04:04:28.391 INFO:teuthology.orchestra.run.smithi007.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 9.8 MB/s | 751 kB 00:00 2024-09-19T04:04:28.416 INFO:teuthology.orchestra.run.smithi007.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.1 MB/s | 163 kB 00:00 2024-09-19T04:04:28.440 INFO:teuthology.orchestra.run.smithi102.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 46 kB/s | 6.6 kB 00:00 2024-09-19T04:04:28.442 INFO:teuthology.orchestra.run.smithi007.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.5 MB/s | 127 kB 00:00 2024-09-19T04:04:28.475 INFO:teuthology.orchestra.run.smithi007.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 8.4 MB/s | 506 kB 00:00 2024-09-19T04:04:28.534 INFO:teuthology.orchestra.run.smithi007.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 774 kB/s | 45 kB 00:00 2024-09-19T04:04:28.601 INFO:teuthology.orchestra.run.smithi007.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.0 MB/s | 136 kB 00:00 2024-09-19T04:04:28.668 INFO:teuthology.orchestra.run.smithi007.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.4 MB/s | 161 kB 00:00 2024-09-19T04:04:28.743 INFO:teuthology.orchestra.run.smithi007.stdout:(22/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 18 MB/s | 5.3 MB 00:00 2024-09-19T04:04:28.785 INFO:teuthology.orchestra.run.smithi007.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 2.7 MB/s | 320 kB 00:00 2024-09-19T04:04:28.807 INFO:teuthology.orchestra.run.smithi102.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 2.4 MB/s | 896 kB 00:00 2024-09-19T04:04:28.811 INFO:teuthology.orchestra.run.smithi007.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 4.4 MB/s | 300 kB 00:00 2024-09-19T04:04:28.836 INFO:teuthology.orchestra.run.smithi007.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T04:04:28.847 INFO:teuthology.orchestra.run.smithi092.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 49 kB/s | 6.6 kB 00:00 2024-09-19T04:04:28.861 INFO:teuthology.orchestra.run.smithi007.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T04:04:28.874 INFO:teuthology.orchestra.run.smithi102.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 2.1 MB/s | 145 kB 00:00 2024-09-19T04:04:28.912 INFO:teuthology.orchestra.run.smithi007.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-19T04:04:28.979 INFO:teuthology.orchestra.run.smithi007.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 480 kB/s | 32 kB 00:00 2024-09-19T04:04:29.029 INFO:teuthology.orchestra.run.smithi007.stdout:(29/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 16 MB/s | 3.1 MB 00:00 2024-09-19T04:04:29.046 INFO:teuthology.orchestra.run.smithi007.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.1 MB/s | 146 kB 00:00 2024-09-19T04:04:29.404 INFO:teuthology.orchestra.run.smithi007.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 9.5 MB/s | 3.6 MB 00:00 2024-09-19T04:04:29.489 INFO:teuthology.orchestra.run.smithi092.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 1.4 MB/s | 896 kB 00:00 2024-09-19T04:04:29.505 INFO:teuthology.orchestra.run.smithi007.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.4 MB/s | 249 kB 00:00 2024-09-19T04:04:29.589 INFO:teuthology.orchestra.run.smithi092.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.4 MB/s | 145 kB 00:00 2024-09-19T04:04:29.605 INFO:teuthology.orchestra.run.smithi007.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 13 MB/s | 7.4 MB 00:00 2024-09-19T04:04:29.630 INFO:teuthology.orchestra.run.smithi007.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 394 kB/s | 49 kB 00:00 2024-09-19T04:04:29.658 INFO:teuthology.orchestra.run.smithi102.stdout:(4/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 3.0 MB/s | 2.4 MB 00:00 2024-09-19T04:04:29.664 INFO:teuthology.orchestra.run.smithi007.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 281 kB/s | 16 kB 00:00 2024-09-19T04:04:29.706 INFO:teuthology.orchestra.run.smithi007.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 3.7 MB/s | 285 kB 00:00 2024-09-19T04:04:29.756 INFO:teuthology.orchestra.run.smithi007.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 8.1 MB/s | 765 kB 00:00 2024-09-19T04:04:29.766 INFO:teuthology.orchestra.run.smithi102.stdout:(5/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 3.7 MB/s | 5.4 MB 00:01 2024-09-19T04:04:29.804 INFO:teuthology.orchestra.run.smithi007.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 187 kB/s | 18 kB 00:00 2024-09-19T04:04:30.034 INFO:teuthology.orchestra.run.smithi102.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 4.1 MB/s | 1.5 MB 00:00 2024-09-19T04:04:30.306 INFO:teuthology.orchestra.run.smithi092.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 3.4 MB/s | 5.4 MB 00:01 2024-09-19T04:04:30.464 INFO:teuthology.orchestra.run.smithi092.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 2.7 MB/s | 2.4 MB 00:00 2024-09-19T04:04:30.467 INFO:teuthology.orchestra.run.smithi102.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 6.7 MB/s | 4.7 MB 00:00 2024-09-19T04:04:30.565 INFO:teuthology.orchestra.run.smithi092.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 5.9 MB/s | 1.5 MB 00:00 2024-09-19T04:04:30.798 INFO:teuthology.orchestra.run.smithi007.stdout:(39/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 18 MB/s | 49 MB 00:02 2024-09-19T04:04:30.823 INFO:teuthology.orchestra.run.smithi007.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 75 kB/s | 80 kB 00:01 2024-09-19T04:04:30.842 INFO:teuthology.orchestra.run.smithi102.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 8.3 MB/s | 21 MB 00:02 2024-09-19T04:04:30.918 INFO:teuthology.orchestra.run.smithi102.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 336 kB/s | 25 kB 00:00 2024-09-19T04:04:31.249 INFO:teuthology.orchestra.run.smithi007.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 555 kB/s | 801 kB 00:01 2024-09-19T04:04:31.332 INFO:teuthology.orchestra.run.smithi092.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 5.4 MB/s | 4.7 MB 00:00 2024-09-19T04:04:31.532 INFO:teuthology.orchestra.run.smithi007.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 260 kB/s | 191 kB 00:00 2024-09-19T04:04:31.534 INFO:teuthology.orchestra.run.smithi102.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 9.9 MB/s | 11 MB 00:01 2024-09-19T04:04:31.618 INFO:teuthology.orchestra.run.smithi102.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 2.7 MB/s | 228 kB 00:00 2024-09-19T04:04:31.657 INFO:teuthology.orchestra.run.smithi007.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 304 kB/s | 253 kB 00:00 2024-09-19T04:04:31.676 INFO:teuthology.orchestra.run.smithi102.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 463 kB/s | 27 kB 00:00 2024-09-19T04:04:31.727 INFO:teuthology.orchestra.run.smithi102.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 633 kB/s | 32 kB 00:00 2024-09-19T04:04:31.748 INFO:teuthology.orchestra.run.smithi092.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 7.0 MB/s | 21 MB 00:03 2024-09-19T04:04:31.824 INFO:teuthology.orchestra.run.smithi092.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 335 kB/s | 25 kB 00:00 2024-09-19T04:04:31.852 INFO:teuthology.orchestra.run.smithi102.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 5.9 MB/s | 751 kB 00:00 2024-09-19T04:04:31.936 INFO:teuthology.orchestra.run.smithi102.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 1.9 MB/s | 163 kB 00:00 2024-09-19T04:04:32.183 INFO:teuthology.orchestra.run.smithi007.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 1.3 MB/s | 1.2 MB 00:00 2024-09-19T04:04:32.194 INFO:teuthology.orchestra.run.smithi102.stdout:(16/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 7.8 MB/s | 17 MB 00:02 2024-09-19T04:04:32.208 INFO:teuthology.orchestra.run.smithi007.stdout:(45/156): python3-ply-3.11-14.el9.noarch.rpm 158 kB/s | 106 kB 00:00 2024-09-19T04:04:32.219 INFO:teuthology.orchestra.run.smithi102.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 447 kB/s | 127 kB 00:00 2024-09-19T04:04:32.270 INFO:teuthology.orchestra.run.smithi102.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 6.6 MB/s | 506 kB 00:00 2024-09-19T04:04:32.332 INFO:teuthology.orchestra.run.smithi092.stdout:(10/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 9.5 MB/s | 17 MB 00:01 2024-09-19T04:04:32.337 INFO:teuthology.orchestra.run.smithi102.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 676 kB/s | 45 kB 00:00 2024-09-19T04:04:32.390 INFO:teuthology.orchestra.run.smithi092.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.8 MB/s | 228 kB 00:00 2024-09-19T04:04:32.408 INFO:teuthology.orchestra.run.smithi007.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 180 kB/s | 135 kB 00:00 2024-09-19T04:04:32.421 INFO:teuthology.orchestra.run.smithi102.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.6 MB/s | 136 kB 00:00 2024-09-19T04:04:32.466 INFO:teuthology.orchestra.run.smithi092.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 360 kB/s | 27 kB 00:00 2024-09-19T04:04:32.496 INFO:teuthology.orchestra.run.smithi102.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.1 MB/s | 161 kB 00:00 2024-09-19T04:04:32.558 INFO:teuthology.orchestra.run.smithi092.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 346 kB/s | 32 kB 00:00 2024-09-19T04:04:32.588 INFO:teuthology.orchestra.run.smithi102.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 3.4 MB/s | 320 kB 00:00 2024-09-19T04:04:32.691 INFO:teuthology.orchestra.run.smithi092.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 5.5 MB/s | 751 kB 00:00 2024-09-19T04:04:32.722 INFO:teuthology.orchestra.run.smithi102.stdout:(23/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 11 MB/s | 5.3 MB 00:00 2024-09-19T04:04:32.750 INFO:teuthology.orchestra.run.smithi092.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.7 MB/s | 163 kB 00:00 2024-09-19T04:04:32.757 INFO:teuthology.orchestra.run.smithi102.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 1.7 MB/s | 300 kB 00:00 2024-09-19T04:04:32.782 INFO:teuthology.orchestra.run.smithi102.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.6 MB/s | 99 kB 00:00 2024-09-19T04:04:32.800 INFO:teuthology.orchestra.run.smithi092.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 2.5 MB/s | 127 kB 00:00 2024-09-19T04:04:32.824 INFO:teuthology.orchestra.run.smithi102.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.2 MB/s | 85 kB 00:00 2024-09-19T04:04:32.884 INFO:teuthology.orchestra.run.smithi007.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 178 kB/s | 125 kB 00:00 2024-09-19T04:04:32.892 INFO:teuthology.orchestra.run.smithi092.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 5.4 MB/s | 506 kB 00:00 2024-09-19T04:04:32.908 INFO:teuthology.orchestra.run.smithi102.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.0 MB/s | 171 kB 00:00 2024-09-19T04:04:32.942 INFO:teuthology.orchestra.run.smithi007.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 293 kB/s | 215 kB 00:00 2024-09-19T04:04:32.975 INFO:teuthology.orchestra.run.smithi102.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 478 kB/s | 32 kB 00:00 2024-09-19T04:04:33.009 INFO:teuthology.orchestra.run.smithi092.stdout:(18/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 6.3 MB/s | 11 MB 00:01 2024-09-19T04:04:33.075 INFO:teuthology.orchestra.run.smithi102.stdout:(29/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 11 MB/s | 3.1 MB 00:00 2024-09-19T04:04:33.084 INFO:teuthology.orchestra.run.smithi092.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 602 kB/s | 45 kB 00:00 2024-09-19T04:04:33.100 INFO:teuthology.orchestra.run.smithi102.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.1 MB/s | 146 kB 00:00 2024-09-19T04:04:33.168 INFO:teuthology.orchestra.run.smithi092.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.6 MB/s | 136 kB 00:00 2024-09-19T04:04:33.260 INFO:teuthology.orchestra.run.smithi092.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.7 MB/s | 161 kB 00:00 2024-09-19T04:04:33.284 INFO:teuthology.orchestra.run.smithi007.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 795 kB/s | 689 kB 00:00 2024-09-19T04:04:33.360 INFO:teuthology.orchestra.run.smithi092.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 3.1 MB/s | 320 kB 00:00 2024-09-19T04:04:33.451 INFO:teuthology.orchestra.run.smithi102.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 9.5 MB/s | 3.6 MB 00:00 2024-09-19T04:04:33.493 INFO:teuthology.orchestra.run.smithi092.stdout:(23/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 8.9 MB/s | 5.3 MB 00:00 2024-09-19T04:04:33.519 INFO:teuthology.orchestra.run.smithi092.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 300 kB 00:00 2024-09-19T04:04:33.560 INFO:teuthology.orchestra.run.smithi092.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.5 MB/s | 99 kB 00:00 2024-09-19T04:04:33.586 INFO:teuthology.orchestra.run.smithi092.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.2 MB/s | 85 kB 00:00 2024-09-19T04:04:33.636 INFO:teuthology.orchestra.run.smithi092.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-19T04:04:33.643 INFO:teuthology.orchestra.run.smithi007.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 153 kB/s | 107 kB 00:00 2024-09-19T04:04:33.695 INFO:teuthology.orchestra.run.smithi092.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 546 kB/s | 32 kB 00:00 2024-09-19T04:04:33.754 INFO:teuthology.orchestra.run.smithi092.stdout:(29/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.4 MB/s | 146 kB 00:00 2024-09-19T04:04:33.793 INFO:teuthology.orchestra.run.smithi007.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-09-19T04:04:33.812 INFO:teuthology.orchestra.run.smithi092.stdout:(30/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 12 MB/s | 3.1 MB 00:00 2024-09-19T04:04:33.876 INFO:teuthology.orchestra.run.smithi102.stdout:(32/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 16 MB/s | 49 MB 00:02 2024-09-19T04:04:33.910 INFO:teuthology.orchestra.run.smithi102.stdout:(33/156): ceph-mgr-modules-core-19.1.1-361.g2f5 544 kB/s | 249 kB 00:00 2024-09-19T04:04:33.910 INFO:teuthology.orchestra.run.smithi007.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 35 kB/s | 22 kB 00:00 2024-09-19T04:04:33.935 INFO:teuthology.orchestra.run.smithi102.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 848 kB/s | 49 kB 00:00 2024-09-19T04:04:33.985 INFO:teuthology.orchestra.run.smithi102.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 219 kB/s | 16 kB 00:00 2024-09-19T04:04:34.010 INFO:teuthology.orchestra.run.smithi102.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 3.7 MB/s | 285 kB 00:00 2024-09-19T04:04:34.111 INFO:teuthology.orchestra.run.smithi102.stdout:(37/156): ceph-mgr-diskprediction-local-19.1.1- 7.3 MB/s | 7.4 MB 00:01 2024-09-19T04:04:34.136 INFO:teuthology.orchestra.run.smithi102.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 146 kB/s | 18 kB 00:00 2024-09-19T04:04:34.171 INFO:teuthology.orchestra.run.smithi092.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 8.6 MB/s | 3.6 MB 00:00 2024-09-19T04:04:34.178 INFO:teuthology.orchestra.run.smithi102.stdout:(39/156): cephadm-19.1.1-361.g2f599a46.el9.noar 3.9 MB/s | 765 kB 00:00 2024-09-19T04:04:34.229 INFO:teuthology.orchestra.run.smithi092.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 4.2 MB/s | 249 kB 00:00 2024-09-19T04:04:34.287 INFO:teuthology.orchestra.run.smithi102.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 455 kB/s | 80 kB 00:00 2024-09-19T04:04:34.330 INFO:teuthology.orchestra.run.smithi092.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 14 MB/s | 7.4 MB 00:00 2024-09-19T04:04:34.355 INFO:teuthology.orchestra.run.smithi092.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 394 kB/s | 49 kB 00:00 2024-09-19T04:04:34.380 INFO:teuthology.orchestra.run.smithi092.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 328 kB/s | 16 kB 00:00 2024-09-19T04:04:34.387 INFO:teuthology.orchestra.run.smithi102.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 916 kB/s | 191 kB 00:00 2024-09-19T04:04:34.405 INFO:teuthology.orchestra.run.smithi092.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.5 MB/s | 285 kB 00:00 2024-09-19T04:04:34.412 INFO:teuthology.orchestra.run.smithi102.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-09-19T04:04:34.414 INFO:teuthology.orchestra.run.smithi007.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 53 kB/s | 33 kB 00:00 2024-09-19T04:04:34.444 INFO:teuthology.orchestra.run.smithi007.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 392 kB/s | 313 kB 00:00 2024-09-19T04:04:34.456 INFO:teuthology.orchestra.run.smithi092.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 362 kB/s | 18 kB 00:00 2024-09-19T04:04:34.462 INFO:teuthology.orchestra.run.smithi102.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-19T04:04:34.481 INFO:teuthology.orchestra.run.smithi092.stdout:(38/156): cephadm-19.1.1-361.g2f599a46.el9.noar 7.4 MB/s | 765 kB 00:00 2024-09-19T04:04:34.521 INFO:teuthology.orchestra.run.smithi102.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-19T04:04:34.546 INFO:teuthology.orchestra.run.smithi102.stdout:(45/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.9 MB/s | 801 kB 00:00 2024-09-19T04:04:34.572 INFO:teuthology.orchestra.run.smithi102.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-19T04:04:34.590 INFO:teuthology.orchestra.run.smithi092.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 597 kB/s | 80 kB 00:00 2024-09-19T04:04:34.655 INFO:teuthology.orchestra.run.smithi102.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-09-19T04:04:34.714 INFO:teuthology.orchestra.run.smithi102.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 3.8 MB/s | 1.2 MB 00:00 2024-09-19T04:04:34.765 INFO:teuthology.orchestra.run.smithi102.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 689 kB 00:00 2024-09-19T04:04:34.806 INFO:teuthology.orchestra.run.smithi102.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 521 kB/s | 22 kB 00:00 2024-09-19T04:04:34.840 INFO:teuthology.orchestra.run.smithi102.stdout:(51/156): boost-program-options-1.75.0-8.el9.x8 852 kB/s | 107 kB 00:00 2024-09-19T04:04:34.873 INFO:teuthology.orchestra.run.smithi102.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 4.2 MB/s | 943 kB 00:00 2024-09-19T04:04:34.899 INFO:teuthology.orchestra.run.smithi102.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-09-19T04:04:34.912 INFO:teuthology.orchestra.run.smithi007.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 24 kB/s | 11 kB 00:00 2024-09-19T04:04:34.916 INFO:teuthology.orchestra.run.smithi102.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 434 kB/s | 33 kB 00:00 2024-09-19T04:04:34.932 INFO:teuthology.orchestra.run.smithi102.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 547 kB/s | 18 kB 00:00 2024-09-19T04:04:34.936 INFO:teuthology.orchestra.run.smithi007.stdout:(56/156): flexiblas-openblas-openmp-3.0.4-8.el9 35 kB/s | 18 kB 00:00 2024-09-19T04:04:34.950 INFO:teuthology.orchestra.run.smithi102.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 333 kB/s | 11 kB 00:00 2024-09-19T04:04:34.975 INFO:teuthology.orchestra.run.smithi102.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 160 kB 00:00 2024-09-19T04:04:34.992 INFO:teuthology.orchestra.run.smithi102.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-19T04:04:34.995 INFO:teuthology.orchestra.run.smithi007.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2024-09-19T04:04:35.032 INFO:teuthology.orchestra.run.smithi092.stdout:(40/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 15 MB/s | 49 MB 00:03 2024-09-19T04:04:35.051 INFO:teuthology.orchestra.run.smithi102.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 20 MB/s | 3.0 MB 00:00 2024-09-19T04:04:35.057 INFO:teuthology.orchestra.run.smithi092.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 409 kB/s | 191 kB 00:00 2024-09-19T04:04:35.076 INFO:teuthology.orchestra.run.smithi102.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 6.4 MB/s | 662 kB 00:00 2024-09-19T04:04:35.101 INFO:teuthology.orchestra.run.smithi102.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 489 kB/s | 24 kB 00:00 2024-09-19T04:04:35.126 INFO:teuthology.orchestra.run.smithi102.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 949 kB/s | 47 kB 00:00 2024-09-19T04:04:35.141 INFO:teuthology.orchestra.run.smithi092.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 801 kB 00:00 2024-09-19T04:04:35.151 INFO:teuthology.orchestra.run.smithi102.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-19T04:04:35.183 INFO:teuthology.orchestra.run.smithi092.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-09-19T04:04:35.185 INFO:teuthology.orchestra.run.smithi102.stdout:(64/156): libtool-2.4.6-46.el9.x86_64.rpm 2.9 MB/s | 581 kB 00:00 2024-09-19T04:04:35.216 INFO:teuthology.orchestra.run.smithi092.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-19T04:04:35.219 INFO:teuthology.orchestra.run.smithi102.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-09-19T04:04:35.242 INFO:teuthology.orchestra.run.smithi092.stdout:(45/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-19T04:04:35.244 INFO:teuthology.orchestra.run.smithi102.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 417 kB/s | 38 kB 00:00 2024-09-19T04:04:35.267 INFO:teuthology.orchestra.run.smithi092.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-19T04:04:35.292 INFO:teuthology.orchestra.run.smithi092.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-19T04:04:35.311 INFO:teuthology.orchestra.run.smithi102.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-09-19T04:04:35.326 INFO:teuthology.orchestra.run.smithi092.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-19T04:04:35.378 INFO:teuthology.orchestra.run.smithi102.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 26 MB/s | 4.9 MB 00:00 2024-09-19T04:04:35.420 INFO:teuthology.orchestra.run.smithi102.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 8.2 MB/s | 910 kB 00:00 2024-09-19T04:04:35.445 INFO:teuthology.orchestra.run.smithi102.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-19T04:04:35.511 INFO:teuthology.orchestra.run.smithi007.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 79 kB/s | 45 kB 00:00 2024-09-19T04:04:35.512 INFO:teuthology.orchestra.run.smithi102.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-19T04:04:35.546 INFO:teuthology.orchestra.run.smithi102.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-09-19T04:04:35.571 INFO:teuthology.orchestra.run.smithi102.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-19T04:04:35.637 INFO:teuthology.orchestra.run.smithi007.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 221 kB/s | 160 kB 00:00 2024-09-19T04:04:35.655 INFO:teuthology.orchestra.run.smithi102.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 25 MB/s | 5.8 MB 00:00 2024-09-19T04:04:35.680 INFO:teuthology.orchestra.run.smithi102.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 562 kB/s | 61 kB 00:00 2024-09-19T04:04:35.764 INFO:teuthology.orchestra.run.smithi102.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 27 MB/s | 6.0 MB 00:00 2024-09-19T04:04:35.789 INFO:teuthology.orchestra.run.smithi102.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.8 MB/s | 245 kB 00:00 2024-09-19T04:04:35.814 INFO:teuthology.orchestra.run.smithi102.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-19T04:04:35.839 INFO:teuthology.orchestra.run.smithi102.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-19T04:04:35.859 INFO:teuthology.orchestra.run.smithi092.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 200 kB/s | 107 kB 00:00 2024-09-19T04:04:35.870 INFO:teuthology.orchestra.run.smithi007.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 757 kB/s | 662 kB 00:00 2024-09-19T04:04:35.873 INFO:teuthology.orchestra.run.smithi102.stdout:(80/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.3 MB/s | 248 kB 00:00 2024-09-19T04:04:35.899 INFO:teuthology.orchestra.run.smithi102.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 592 kB/s | 35 kB 00:00 2024-09-19T04:04:35.924 INFO:teuthology.orchestra.run.smithi102.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-19T04:04:35.949 INFO:teuthology.orchestra.run.smithi102.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-19T04:04:35.974 INFO:teuthology.orchestra.run.smithi102.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-19T04:04:35.976 INFO:teuthology.orchestra.run.smithi092.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 1.3 MB/s | 943 kB 00:00 2024-09-19T04:04:35.999 INFO:teuthology.orchestra.run.smithi102.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-19T04:04:36.010 INFO:teuthology.orchestra.run.smithi092.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 928 kB/s | 689 kB 00:00 2024-09-19T04:04:36.025 INFO:teuthology.orchestra.run.smithi102.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 839 kB/s | 42 kB 00:00 2024-09-19T04:04:36.058 INFO:teuthology.orchestra.run.smithi102.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-19T04:04:36.084 INFO:teuthology.orchestra.run.smithi102.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-19T04:04:36.109 INFO:teuthology.orchestra.run.smithi102.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-19T04:04:36.126 INFO:teuthology.orchestra.run.smithi102.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-19T04:04:36.143 INFO:teuthology.orchestra.run.smithi102.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-09-19T04:04:36.177 INFO:teuthology.orchestra.run.smithi092.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 68 kB/s | 22 kB 00:00 2024-09-19T04:04:36.177 INFO:teuthology.orchestra.run.smithi102.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2024-09-19T04:04:36.204 INFO:teuthology.orchestra.run.smithi007.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 43 kB/s | 24 kB 00:00 2024-09-19T04:04:36.244 INFO:teuthology.orchestra.run.smithi102.stdout:(93/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-09-19T04:04:36.261 INFO:teuthology.orchestra.run.smithi102.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 530 kB/s | 44 kB 00:00 2024-09-19T04:04:36.269 INFO:teuthology.orchestra.run.smithi092.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 126 kB/s | 33 kB 00:00 2024-09-19T04:04:36.286 INFO:teuthology.orchestra.run.smithi102.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-09-19T04:04:36.303 INFO:teuthology.orchestra.run.smithi102.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 856 kB/s | 36 kB 00:00 2024-09-19T04:04:36.319 INFO:teuthology.orchestra.run.smithi102.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-19T04:04:36.345 INFO:teuthology.orchestra.run.smithi102.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 7.1 MB/s | 304 kB 00:00 2024-09-19T04:04:36.370 INFO:teuthology.orchestra.run.smithi102.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-19T04:04:36.379 INFO:teuthology.orchestra.run.smithi007.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 670 kB/s | 581 kB 00:00 2024-09-19T04:04:36.395 INFO:teuthology.orchestra.run.smithi102.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-19T04:04:36.421 INFO:teuthology.orchestra.run.smithi102.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T04:04:36.446 INFO:teuthology.orchestra.run.smithi102.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-09-19T04:04:36.488 INFO:teuthology.orchestra.run.smithi007.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 78 kB/s | 47 kB 00:00 2024-09-19T04:04:36.494 INFO:teuthology.orchestra.run.smithi092.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 606 kB/s | 313 kB 00:00 2024-09-19T04:04:36.536 INFO:teuthology.orchestra.run.smithi092.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 68 kB/s | 18 kB 00:00 2024-09-19T04:04:36.663 INFO:teuthology.orchestra.run.smithi102.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-09-19T04:04:36.689 INFO:teuthology.orchestra.run.smithi102.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 83 kB/s | 22 kB 00:00 2024-09-19T04:04:36.736 INFO:teuthology.orchestra.run.smithi092.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 46 kB/s | 11 kB 00:00 2024-09-19T04:04:36.885 INFO:teuthology.orchestra.run.smithi102.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 2.4 MB/s | 548 kB 00:00 2024-09-19T04:04:36.914 INFO:teuthology.orchestra.run.smithi102.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 671 kB/s | 19 kB 00:00 2024-09-19T04:04:36.939 INFO:teuthology.orchestra.run.smithi102.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 1.2 MB/s | 308 kB 00:00 2024-09-19T04:04:36.953 INFO:teuthology.orchestra.run.smithi092.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 384 kB/s | 160 kB 00:00 2024-09-19T04:04:36.971 INFO:teuthology.orchestra.run.smithi007.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 382 kB/s | 292 kB 00:00 2024-09-19T04:04:36.981 INFO:teuthology.orchestra.run.smithi102.stdout:(108/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.6 MB/s | 863 kB 00:00 2024-09-19T04:04:37.032 INFO:teuthology.orchestra.run.smithi102.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 971 kB/s | 49 kB 00:00 2024-09-19T04:04:37.046 INFO:teuthology.orchestra.run.smithi007.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 69 kB/s | 38 kB 00:00 2024-09-19T04:04:37.065 INFO:teuthology.orchestra.run.smithi102.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-19T04:04:37.070 INFO:teuthology.orchestra.run.smithi092.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 136 kB/s | 45 kB 00:00 2024-09-19T04:04:37.107 INFO:teuthology.orchestra.run.smithi102.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-19T04:04:37.132 INFO:teuthology.orchestra.run.smithi102.stdout:(112/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 135 kB/s | 26 kB 00:00 2024-09-19T04:04:37.170 INFO:teuthology.orchestra.run.smithi092.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.0 MB/s | 3.0 MB 00:00 2024-09-19T04:04:37.172 INFO:teuthology.orchestra.run.smithi007.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 238 kB/s | 188 kB 00:00 2024-09-19T04:04:37.199 INFO:teuthology.orchestra.run.smithi102.stdout:(113/156): libarrow-9.0.0-11.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-19T04:04:37.241 INFO:teuthology.orchestra.run.smithi102.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-09-19T04:04:37.258 INFO:teuthology.orchestra.run.smithi102.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-19T04:04:37.275 INFO:teuthology.orchestra.run.smithi102.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 844 kB/s | 14 kB 00:00 2024-09-19T04:04:37.309 INFO:teuthology.orchestra.run.smithi102.stdout:(117/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.1 MB/s | 839 kB 00:00 2024-09-19T04:04:37.334 INFO:teuthology.orchestra.run.smithi102.stdout:(118/156): python3-asyncssh-2.13.2-5.el9.noarch 2.7 MB/s | 548 kB 00:00 2024-09-19T04:04:37.359 INFO:teuthology.orchestra.run.smithi102.stdout:(119/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-09-19T04:04:37.385 INFO:teuthology.orchestra.run.smithi102.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-09-19T04:04:37.418 INFO:teuthology.orchestra.run.smithi102.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.5 MB/s | 303 kB 00:00 2024-09-19T04:04:37.437 INFO:teuthology.orchestra.run.smithi092.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 92 kB/s | 24 kB 00:00 2024-09-19T04:04:37.444 INFO:teuthology.orchestra.run.smithi102.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-19T04:04:37.469 INFO:teuthology.orchestra.run.smithi102.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-19T04:04:37.494 INFO:teuthology.orchestra.run.smithi102.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-09-19T04:04:37.520 INFO:teuthology.orchestra.run.smithi102.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-09-19T04:04:37.545 INFO:teuthology.orchestra.run.smithi102.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-19T04:04:37.570 INFO:teuthology.orchestra.run.smithi102.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-19T04:04:37.605 INFO:teuthology.orchestra.run.smithi102.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-19T04:04:37.621 INFO:teuthology.orchestra.run.smithi102.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T04:04:37.637 INFO:teuthology.orchestra.run.smithi092.stdout:(61/156): librdkafka-1.6.1-102.el9.x86_64.rpm 969 kB/s | 662 kB 00:00 2024-09-19T04:04:37.654 INFO:teuthology.orchestra.run.smithi102.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-19T04:04:37.680 INFO:teuthology.orchestra.run.smithi102.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T04:04:37.687 INFO:teuthology.orchestra.run.smithi092.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 941 kB/s | 581 kB 00:00 2024-09-19T04:04:37.722 INFO:teuthology.orchestra.run.smithi102.stdout:(132/156): python3-grpcio-1.46.7-10.el9.x86_64. 6.1 MB/s | 2.0 MB 00:00 2024-09-19T04:04:37.747 INFO:teuthology.orchestra.run.smithi102.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 652 kB/s | 16 kB 00:00 2024-09-19T04:04:37.772 INFO:teuthology.orchestra.run.smithi102.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-19T04:04:37.787 INFO:teuthology.orchestra.run.smithi092.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 135 kB/s | 47 kB 00:00 2024-09-19T04:04:37.798 INFO:teuthology.orchestra.run.smithi102.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-09-19T04:04:37.823 INFO:teuthology.orchestra.run.smithi102.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-09-19T04:04:37.848 INFO:teuthology.orchestra.run.smithi102.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-19T04:04:37.882 INFO:teuthology.orchestra.run.smithi102.stdout:(138/156): python3-kubernetes-26.1.0-2.el9.noar 3.3 MB/s | 1.0 MB 00:00 2024-09-19T04:04:37.908 INFO:teuthology.orchestra.run.smithi102.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-19T04:04:37.932 INFO:teuthology.orchestra.run.smithi102.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-19T04:04:37.958 INFO:teuthology.orchestra.run.smithi102.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-19T04:04:37.983 INFO:teuthology.orchestra.run.smithi102.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 985 kB/s | 74 kB 00:00 2024-09-19T04:04:38.016 INFO:teuthology.orchestra.run.smithi102.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-19T04:04:38.042 INFO:teuthology.orchestra.run.smithi102.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-19T04:04:38.055 INFO:teuthology.orchestra.run.smithi092.stdout:(64/156): openblas-0.3.26-2.el9.x86_64.rpm 144 kB/s | 38 kB 00:00 2024-09-19T04:04:38.067 INFO:teuthology.orchestra.run.smithi102.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-19T04:04:38.080 INFO:teuthology.orchestra.run.smithi007.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.5 MB/s | 4.9 MB 00:01 2024-09-19T04:04:38.101 INFO:teuthology.orchestra.run.smithi102.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-09-19T04:04:38.126 INFO:teuthology.orchestra.run.smithi102.stdout:(147/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-19T04:04:38.138 INFO:teuthology.orchestra.run.smithi092.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 418 kB/s | 188 kB 00:00 2024-09-19T04:04:38.164 INFO:teuthology.orchestra.run.smithi007.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.0 MB/s | 4.4 MB 00:01 2024-09-19T04:04:38.193 INFO:teuthology.orchestra.run.smithi102.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-19T04:04:38.206 INFO:teuthology.orchestra.run.smithi007.stdout:(69/156): postgresql-13.16-1.el9.x86_64.rpm 1.5 MB/s | 1.6 MB 00:01 2024-09-19T04:04:38.213 INFO:teuthology.orchestra.run.smithi092.stdout:(66/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 507 kB/s | 292 kB 00:00 2024-09-19T04:04:38.377 INFO:teuthology.orchestra.run.smithi102.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-19T04:04:38.493 INFO:teuthology.orchestra.run.smithi102.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 8.6 MB/s | 3.2 MB 00:00 2024-09-19T04:04:38.602 INFO:teuthology.orchestra.run.smithi102.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 378 kB/s | 41 kB 00:00 2024-09-19T04:04:38.711 INFO:teuthology.orchestra.run.smithi102.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 2.2 MB/s | 249 kB 00:00 2024-09-19T04:04:38.836 INFO:teuthology.orchestra.run.smithi102.stdout:(153/156): NetworkManager-libnm-1.51.0-1.el9.x8 3.9 MB/s | 1.8 MB 00:00 2024-09-19T04:04:38.864 INFO:teuthology.orchestra.run.smithi007.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 196 kB/s | 137 kB 00:00 2024-09-19T04:04:38.878 INFO:teuthology.orchestra.run.smithi102.stdout:(154/156): NetworkManager-1.51.0-1.el9.x86_64.r 3.4 MB/s | 2.3 MB 00:00 2024-09-19T04:04:38.955 INFO:teuthology.orchestra.run.smithi092.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 2.1 MB/s | 1.6 MB 00:00 2024-09-19T04:04:38.981 INFO:teuthology.orchestra.run.smithi007.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 1.0 MB/s | 910 kB 00:00 2024-09-19T04:04:39.031 INFO:teuthology.orchestra.run.smithi092.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 5.1 MB/s | 4.9 MB 00:00 2024-09-19T04:04:39.045 INFO:teuthology.orchestra.run.smithi102.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 4.1 MB/s | 1.4 MB 00:00 2024-09-19T04:04:39.181 INFO:teuthology.orchestra.run.smithi092.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.2 MB/s | 4.4 MB 00:01 2024-09-19T04:04:39.295 INFO:teuthology.orchestra.run.smithi102.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 5.2 MB/s | 2.4 MB 00:00 2024-09-19T04:04:39.302 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T04:04:39.302 INFO:teuthology.orchestra.run.smithi102.stdout:Total 19 MB/s | 226 MB 00:11 2024-09-19T04:04:39.440 INFO:teuthology.orchestra.run.smithi007.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 4.7 MB/s | 5.8 MB 00:01 2024-09-19T04:04:39.464 INFO:teuthology.orchestra.run.smithi092.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 317 kB/s | 137 kB 00:00 2024-09-19T04:04:39.632 INFO:teuthology.orchestra.run.smithi007.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 134 kB/s | 87 kB 00:00 2024-09-19T04:04:39.656 INFO:teuthology.orchestra.run.smithi092.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 1.3 MB/s | 910 kB 00:00 2024-09-19T04:04:39.807 INFO:teuthology.orchestra.run.smithi007.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2024-09-19T04:04:40.090 INFO:teuthology.orchestra.run.smithi092.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 202 kB/s | 87 kB 00:00 2024-09-19T04:04:40.165 INFO:teuthology.orchestra.run.smithi092.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.4 MB/s | 1.0 MB 00:00 2024-09-19T04:04:40.282 INFO:teuthology.orchestra.run.smithi007.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 94 kB/s | 61 kB 00:00 2024-09-19T04:04:40.515 INFO:teuthology.orchestra.run.smithi092.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 175 kB/s | 61 kB 00:00 2024-09-19T04:04:40.534 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T04:04:40.574 INFO:teuthology.orchestra.run.smithi007.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 5.3 MB/s | 6.0 MB 00:01 2024-09-19T04:04:40.608 INFO:teuthology.orchestra.run.smithi007.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 306 kB/s | 245 kB 00:00 2024-09-19T04:04:40.685 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T04:04:40.685 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T04:04:41.041 INFO:teuthology.orchestra.run.smithi092.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 6.3 MB/s | 6.0 MB 00:00 2024-09-19T04:04:41.099 INFO:teuthology.orchestra.run.smithi092.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 419 kB/s | 245 kB 00:00 2024-09-19T04:04:41.133 INFO:teuthology.orchestra.run.smithi007.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 36 kB/s | 19 kB 00:00 2024-09-19T04:04:41.158 INFO:teuthology.orchestra.run.smithi007.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 45 kB/s | 26 kB 00:00 2024-09-19T04:04:41.166 INFO:teuthology.orchestra.run.smithi092.stdout:(77/156): postgresql-server-13.16-1.el9.x86_64. 2.9 MB/s | 5.8 MB 00:01 2024-09-19T04:04:41.192 INFO:teuthology.orchestra.run.smithi007.stdout:(80/156): python3-jinja2-2.11.3-6.el9.noarch.rp 273 kB/s | 248 kB 00:00 2024-09-19T04:04:41.400 INFO:teuthology.orchestra.run.smithi092.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 85 kB/s | 26 kB 00:00 2024-09-19T04:04:41.442 INFO:teuthology.orchestra.run.smithi092.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 70 kB/s | 19 kB 00:00 2024-09-19T04:04:41.592 INFO:teuthology.orchestra.run.smithi092.stdout:(80/156): python3-jinja2-2.11.3-6.el9.noarch.rp 451 kB/s | 248 kB 00:00 2024-09-19T04:04:41.725 INFO:teuthology.orchestra.run.smithi092.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 122 kB/s | 35 kB 00:00 2024-09-19T04:04:41.726 INFO:teuthology.orchestra.run.smithi007.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 61 kB/s | 35 kB 00:00 2024-09-19T04:04:41.909 INFO:teuthology.orchestra.run.smithi092.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 338 kB/s | 172 kB 00:00 2024-09-19T04:04:41.926 INFO:teuthology.orchestra.run.smithi007.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 218 kB/s | 172 kB 00:00 2024-09-19T04:04:42.234 INFO:teuthology.orchestra.run.smithi092.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 493 kB/s | 250 kB 00:00 2024-09-19T04:04:42.318 INFO:teuthology.orchestra.run.smithi007.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.5 MB/s | 5.1 MB 00:01 2024-09-19T04:04:42.409 INFO:teuthology.orchestra.run.smithi092.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 444 kB/s | 222 kB 00:00 2024-09-19T04:04:42.485 INFO:teuthology.orchestra.run.smithi092.stdout:(85/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.7 MB/s | 5.1 MB 00:00 2024-09-19T04:04:42.524 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T04:04:42.525 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T04:04:42.526 INFO:teuthology.orchestra.run.smithi007.stdout:(84/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 313 kB/s | 250 kB 00:00 2024-09-19T04:04:42.677 INFO:teuthology.orchestra.run.smithi092.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 174 kB/s | 77 kB 00:00 2024-09-19T04:04:42.702 INFO:teuthology.orchestra.run.smithi007.stdout:(85/156): python3-oauthlib-3.1.1-5.el9.noarch.r 287 kB/s | 222 kB 00:00 2024-09-19T04:04:42.752 INFO:teuthology.orchestra.run.smithi092.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 123 kB/s | 42 kB 00:00 2024-09-19T04:04:42.977 INFO:teuthology.orchestra.run.smithi007.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 117 kB/s | 77 kB 00:00 2024-09-19T04:04:43.077 INFO:teuthology.orchestra.run.smithi092.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 455 kB/s | 269 kB 00:00 2024-09-19T04:04:43.094 INFO:teuthology.orchestra.run.smithi007.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 74 kB/s | 42 kB 00:00 2024-09-19T04:04:43.102 INFO:teuthology.orchestra.run.smithi092.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 373 kB/s | 159 kB 00:00 2024-09-19T04:04:43.261 INFO:teuthology.orchestra.run.smithi092.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 548 kB/s | 279 kB 00:00 2024-09-19T04:04:43.436 INFO:teuthology.orchestra.run.smithi092.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 142 kB/s | 51 kB 00:00 2024-09-19T04:04:43.461 INFO:teuthology.orchestra.run.smithi092.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 149 kB/s | 54 kB 00:00 2024-09-19T04:04:43.544 INFO:teuthology.orchestra.run.smithi007.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 320 kB/s | 269 kB 00:00 2024-09-19T04:04:43.703 INFO:teuthology.orchestra.run.smithi007.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 219 kB/s | 159 kB 00:00 2024-09-19T04:04:43.712 INFO:teuthology.orchestra.run.smithi092.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 151 kB/s | 42 kB 00:00 2024-09-19T04:04:43.820 INFO:teuthology.orchestra.run.smithi092.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 123 kB/s | 44 kB 00:00 2024-09-19T04:04:43.878 INFO:teuthology.orchestra.run.smithi007.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 356 kB/s | 279 kB 00:00 2024-09-19T04:04:44.095 INFO:teuthology.orchestra.run.smithi092.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 130 kB/s | 36 kB 00:00 2024-09-19T04:04:44.178 INFO:teuthology.orchestra.run.smithi007.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 80 kB/s | 51 kB 00:00 2024-09-19T04:04:44.229 INFO:teuthology.orchestra.run.smithi092.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 427 kB/s | 221 kB 00:00 2024-09-19T04:04:44.387 INFO:teuthology.orchestra.run.smithi007.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 78 kB/s | 54 kB 00:00 2024-09-19T04:04:44.446 INFO:teuthology.orchestra.run.smithi092.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 135 kB/s | 47 kB 00:00 2024-09-19T04:04:44.647 INFO:teuthology.orchestra.run.smithi092.stdout:(98/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 12 MB/s | 16 MB 00:01 2024-09-19T04:04:44.745 INFO:teuthology.orchestra.run.smithi007.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 74 kB/s | 42 kB 00:00 2024-09-19T04:04:44.897 INFO:teuthology.orchestra.run.smithi092.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 456 kB/s | 304 kB 00:00 2024-09-19T04:04:44.922 INFO:teuthology.orchestra.run.smithi092.stdout:(100/156): uuid-1.6.2-55.el9.x86_64.rpm 122 kB/s | 58 kB 00:00 2024-09-19T04:04:44.962 INFO:teuthology.orchestra.run.smithi007.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 77 kB/s | 44 kB 00:00 2024-09-19T04:04:45.080 INFO:teuthology.orchestra.run.smithi092.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 221 kB/s | 96 kB 00:00 2024-09-19T04:04:45.147 INFO:teuthology.orchestra.run.smithi092.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 335 kB/s | 22 kB 00:00 2024-09-19T04:04:45.256 INFO:teuthology.orchestra.run.smithi092.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 7.8 MB/s | 863 kB 00:00 2024-09-19T04:04:45.281 INFO:teuthology.orchestra.run.smithi092.stdout:(104/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 125 kB/s | 45 kB 00:00 2024-09-19T04:04:45.296 INFO:teuthology.orchestra.run.smithi007.stdout:(95/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-19T04:04:45.307 INFO:teuthology.orchestra.run.smithi092.stdout:(105/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 155 kB/s | 64 kB 00:00 2024-09-19T04:04:45.382 INFO:teuthology.orchestra.run.smithi092.stdout:(106/156): abseil-cpp-20211102.0-3.el9.x86_64.r 4.3 MB/s | 548 kB 00:00 2024-09-19T04:04:45.407 INFO:teuthology.orchestra.run.smithi092.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 226 kB/s | 19 kB 00:00 2024-09-19T04:04:45.432 INFO:teuthology.orchestra.run.smithi092.stdout:(108/156): gperftools-libs-2.9.1-3.el9.x86_64.r 2.0 MB/s | 308 kB 00:00 2024-09-19T04:04:45.457 INFO:teuthology.orchestra.run.smithi092.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 519 kB/s | 26 kB 00:00 2024-09-19T04:04:45.483 INFO:teuthology.orchestra.run.smithi092.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 967 kB/s | 49 kB 00:00 2024-09-19T04:04:45.508 INFO:teuthology.orchestra.run.smithi092.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-19T04:04:45.533 INFO:teuthology.orchestra.run.smithi092.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-19T04:04:45.571 INFO:teuthology.orchestra.run.smithi007.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 267 kB/s | 221 kB 00:00 2024-09-19T04:04:45.592 INFO:teuthology.orchestra.run.smithi092.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 9.2 MB/s | 548 kB 00:00 2024-09-19T04:04:45.634 INFO:teuthology.orchestra.run.smithi092.stdout:(114/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-09-19T04:04:45.659 INFO:teuthology.orchestra.run.smithi092.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 650 kB/s | 43 kB 00:00 2024-09-19T04:04:45.663 INFO:teuthology.orchestra.run.smithi007.stdout:(97/156): qatlib-service-24.02.0-1.el9.x86_64.r 51 kB/s | 36 kB 00:00 2024-09-19T04:04:45.684 INFO:teuthology.orchestra.run.smithi092.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 643 kB/s | 32 kB 00:00 2024-09-19T04:04:45.710 INFO:teuthology.orchestra.run.smithi092.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-19T04:04:45.735 INFO:teuthology.orchestra.run.smithi092.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T04:04:45.760 INFO:teuthology.orchestra.run.smithi092.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-19T04:04:45.785 INFO:teuthology.orchestra.run.smithi092.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-19T04:04:45.811 INFO:teuthology.orchestra.run.smithi092.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T04:04:45.878 INFO:teuthology.orchestra.run.smithi092.stdout:(122/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 4.4 MB 00:00 2024-09-19T04:04:45.888 INFO:teuthology.orchestra.run.smithi007.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 81 kB/s | 47 kB 00:00 2024-09-19T04:04:45.911 INFO:teuthology.orchestra.run.smithi092.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 1.4 MB/s | 144 kB 00:00 2024-09-19T04:04:45.928 INFO:teuthology.orchestra.run.smithi092.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-19T04:04:45.953 INFO:teuthology.orchestra.run.smithi092.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 423 kB/s | 18 kB 00:00 2024-09-19T04:04:45.979 INFO:teuthology.orchestra.run.smithi092.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-19T04:04:46.004 INFO:teuthology.orchestra.run.smithi092.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-19T04:04:46.021 INFO:teuthology.orchestra.run.smithi092.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 467 kB/s | 20 kB 00:00 2024-09-19T04:04:46.046 INFO:teuthology.orchestra.run.smithi092.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T04:04:46.080 INFO:teuthology.orchestra.run.smithi092.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-19T04:04:46.105 INFO:teuthology.orchestra.run.smithi092.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T04:04:46.147 INFO:teuthology.orchestra.run.smithi092.stdout:(132/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.6 MB/s | 2.0 MB 00:00 2024-09-19T04:04:46.181 INFO:teuthology.orchestra.run.smithi092.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-09-19T04:04:46.206 INFO:teuthology.orchestra.run.smithi092.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 281 kB/s | 16 kB 00:00 2024-09-19T04:04:46.240 INFO:teuthology.orchestra.run.smithi092.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-09-19T04:04:46.265 INFO:teuthology.orchestra.run.smithi092.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 483 kB/s | 28 kB 00:00 2024-09-19T04:04:46.290 INFO:teuthology.orchestra.run.smithi092.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-19T04:04:46.315 INFO:teuthology.orchestra.run.smithi092.stdout:(138/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 825 kB/s | 90 kB 00:00 2024-09-19T04:04:46.338 INFO:teuthology.orchestra.run.smithi007.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 86 kB/s | 58 kB 00:00 2024-09-19T04:04:46.341 INFO:teuthology.orchestra.run.smithi092.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-19T04:04:46.366 INFO:teuthology.orchestra.run.smithi092.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-19T04:04:46.372 INFO:teuthology.orchestra.run.smithi007.stdout:(100/156): socat-1.7.4.1-6.el9.x86_64.rpm 380 kB/s | 304 kB 00:00 2024-09-19T04:04:46.399 INFO:teuthology.orchestra.run.smithi092.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-19T04:04:46.615 INFO:teuthology.orchestra.run.smithi092.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 272 kB/s | 74 kB 00:00 2024-09-19T04:04:46.642 INFO:teuthology.orchestra.run.smithi092.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 3.4 MB/s | 90 kB 00:00 2024-09-19T04:04:46.647 INFO:teuthology.orchestra.run.smithi007.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 128 kB/s | 96 kB 00:00 2024-09-19T04:04:46.667 INFO:teuthology.orchestra.run.smithi092.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 767 kB/s | 230 kB 00:00 2024-09-19T04:04:46.684 INFO:teuthology.orchestra.run.smithi092.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 479 kB/s | 20 kB 00:00 2024-09-19T04:04:46.709 INFO:teuthology.orchestra.run.smithi092.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-19T04:04:46.734 INFO:teuthology.orchestra.run.smithi092.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-19T04:04:46.739 INFO:teuthology.orchestra.run.smithi007.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 246 kB/s | 22 kB 00:00 2024-09-19T04:04:46.785 INFO:teuthology.orchestra.run.smithi092.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-19T04:04:46.856 INFO:teuthology.orchestra.run.smithi007.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 7.2 MB/s | 863 kB 00:00 2024-09-19T04:04:46.915 INFO:teuthology.orchestra.run.smithi007.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-19T04:04:46.948 INFO:teuthology.orchestra.run.smithi007.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-19T04:04:46.974 INFO:teuthology.orchestra.run.smithi007.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 776 kB/s | 19 kB 00:00 2024-09-19T04:04:46.999 INFO:teuthology.orchestra.run.smithi007.stdout:(107/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 96 kB/s | 64 kB 00:00 2024-09-19T04:04:47.024 INFO:teuthology.orchestra.run.smithi007.stdout:(108/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 69 kB/s | 45 kB 00:00 2024-09-19T04:04:47.035 INFO:teuthology.orchestra.run.smithi092.stdout:(149/156): librbd1-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 3.2 MB 00:00 2024-09-19T04:04:47.075 INFO:teuthology.orchestra.run.smithi007.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 349 kB/s | 26 kB 00:00 2024-09-19T04:04:47.085 INFO:teuthology.orchestra.run.smithi092.stdout:(150/156): NetworkManager-1.51.0-1.el9.x86_64.r 7.7 MB/s | 2.3 MB 00:00 2024-09-19T04:04:47.100 INFO:teuthology.orchestra.run.smithi007.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.9 MB/s | 67 kB 00:00 2024-09-19T04:04:47.125 INFO:teuthology.orchestra.run.smithi007.stdout:(111/156): liboath-2.6.7-2.el9.x86_64.rpm 531 kB/s | 49 kB 00:00 2024-09-19T04:04:47.144 INFO:teuthology.orchestra.run.smithi092.stdout:(151/156): librados2-19.1.1-361.g2f599a46.el9.x 7.9 MB/s | 3.4 MB 00:00 2024-09-19T04:04:47.151 INFO:teuthology.orchestra.run.smithi007.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-19T04:04:47.169 INFO:teuthology.orchestra.run.smithi092.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 489 kB/s | 41 kB 00:00 2024-09-19T04:04:47.201 INFO:teuthology.orchestra.run.smithi007.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-19T04:04:47.226 INFO:teuthology.orchestra.run.smithi007.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T04:04:47.244 INFO:teuthology.orchestra.run.smithi092.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 18 MB/s | 1.4 MB 00:00 2024-09-19T04:04:47.251 INFO:teuthology.orchestra.run.smithi007.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T04:04:47.285 INFO:teuthology.orchestra.run.smithi007.stdout:(116/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.1 MB/s | 839 kB 00:00 2024-09-19T04:04:47.310 INFO:teuthology.orchestra.run.smithi007.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 240 kB/s | 14 kB 00:00 2024-09-19T04:04:47.328 INFO:teuthology.orchestra.run.smithi092.stdout:(154/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 29 MB/s | 2.4 MB 00:00 2024-09-19T04:04:47.335 INFO:teuthology.orchestra.run.smithi007.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T04:04:47.353 INFO:teuthology.orchestra.run.smithi092.stdout:(155/156): NetworkManager-tui-1.51.0-1.el9.x86_ 1.2 MB/s | 249 kB 00:00 2024-09-19T04:04:47.361 INFO:teuthology.orchestra.run.smithi007.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-19T04:04:47.386 INFO:teuthology.orchestra.run.smithi007.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-19T04:04:47.395 INFO:teuthology.orchestra.run.smithi092.stdout:(156/156): NetworkManager-libnm-1.51.0-1.el9.x8 5.0 MB/s | 1.8 MB 00:00 2024-09-19T04:04:47.401 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-09-19T04:04:47.401 INFO:teuthology.orchestra.run.smithi092.stdout:Total 12 MB/s | 226 MB 00:19 2024-09-19T04:04:47.453 INFO:teuthology.orchestra.run.smithi007.stdout:(121/156): libarrow-9.0.0-11.el9.x86_64.rpm 9.2 MB/s | 4.4 MB 00:00 2024-09-19T04:04:47.478 INFO:teuthology.orchestra.run.smithi007.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 1.8 MB/s | 220 kB 00:00 2024-09-19T04:04:47.504 INFO:teuthology.orchestra.run.smithi007.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-19T04:04:47.529 INFO:teuthology.orchestra.run.smithi007.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-09-19T04:04:47.546 INFO:teuthology.orchestra.run.smithi007.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 422 kB/s | 18 kB 00:00 2024-09-19T04:04:47.563 INFO:teuthology.orchestra.run.smithi007.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 690 kB/s | 23 kB 00:00 2024-09-19T04:04:47.580 INFO:teuthology.orchestra.run.smithi007.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 580 kB/s | 19 kB 00:00 2024-09-19T04:04:47.597 INFO:teuthology.orchestra.run.smithi007.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 588 kB/s | 20 kB 00:00 2024-09-19T04:04:47.622 INFO:teuthology.orchestra.run.smithi007.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T04:04:47.655 INFO:teuthology.orchestra.run.smithi007.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-19T04:04:47.681 INFO:teuthology.orchestra.run.smithi007.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T04:04:47.715 INFO:teuthology.orchestra.run.smithi007.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-09-19T04:04:47.740 INFO:teuthology.orchestra.run.smithi007.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 663 kB/s | 16 kB 00:00 2024-09-19T04:04:47.765 INFO:teuthology.orchestra.run.smithi007.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-19T04:04:47.790 INFO:teuthology.orchestra.run.smithi007.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-09-19T04:04:47.824 INFO:teuthology.orchestra.run.smithi007.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 482 kB/s | 28 kB 00:00 2024-09-19T04:04:47.849 INFO:teuthology.orchestra.run.smithi007.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 525 kB/s | 31 kB 00:00 2024-09-19T04:04:47.899 INFO:teuthology.orchestra.run.smithi007.stdout:(138/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.0 MB/s | 2.0 MB 00:00 2024-09-19T04:04:47.933 INFO:teuthology.orchestra.run.smithi007.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 704 kB/s | 59 kB 00:00 2024-09-19T04:04:47.959 INFO:teuthology.orchestra.run.smithi007.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 607 kB/s | 36 kB 00:00 2024-09-19T04:04:47.984 INFO:teuthology.orchestra.run.smithi007.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-19T04:04:48.009 INFO:teuthology.orchestra.run.smithi007.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 987 kB/s | 74 kB 00:00 2024-09-19T04:04:48.034 INFO:teuthology.orchestra.run.smithi007.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-19T04:04:48.060 INFO:teuthology.orchestra.run.smithi007.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 798 kB/s | 20 kB 00:00 2024-09-19T04:04:48.085 INFO:teuthology.orchestra.run.smithi007.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-19T04:04:48.110 INFO:teuthology.orchestra.run.smithi007.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T04:04:48.135 INFO:teuthology.orchestra.run.smithi007.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-19T04:04:48.186 INFO:teuthology.orchestra.run.smithi007.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-19T04:04:48.403 INFO:teuthology.orchestra.run.smithi007.stdout:(149/156): librbd1-19.1.1-361.g2f599a46.el9.x86 12 MB/s | 3.2 MB 00:00 2024-09-19T04:04:48.462 INFO:teuthology.orchestra.run.smithi007.stdout:(150/156): librados2-19.1.1-361.g2f599a46.el9.x 9.8 MB/s | 3.4 MB 00:00 2024-09-19T04:04:48.591 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-09-19T04:04:48.742 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-09-19T04:04:48.742 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-09-19T04:04:48.801 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T04:04:48.907 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T04:04:49.034 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T04:04:49.037 INFO:teuthology.orchestra.run.smithi007.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 71 kB/s | 41 kB 00:00 2024-09-19T04:04:49.175 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T04:04:49.217 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T04:04:49.250 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T04:04:49.270 INFO:teuthology.orchestra.run.smithi007.stdout:(152/156): NetworkManager-1.51.0-1.el9.x86_64.r 2.1 MB/s | 2.3 MB 00:01 2024-09-19T04:04:49.302 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T04:04:49.396 INFO:teuthology.orchestra.run.smithi007.stdout:(153/156): NetworkManager-libnm-1.51.0-1.el9.x8 1.8 MB/s | 1.8 MB 00:00 2024-09-19T04:04:49.633 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T04:04:49.751 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T04:04:49.821 INFO:teuthology.orchestra.run.smithi007.stdout:(154/156): NetworkManager-tui-1.51.0-1.el9.x86_ 318 kB/s | 249 kB 00:00 2024-09-19T04:04:49.865 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T04:04:49.894 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T04:04:49.985 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T04:04:50.015 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T04:04:50.161 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T04:04:50.220 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T04:04:50.221 INFO:teuthology.orchestra.run.smithi007.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 1.4 MB/s | 1.4 MB 00:00 2024-09-19T04:04:50.248 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T04:04:50.352 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T04:04:50.374 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T04:04:50.437 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T04:04:50.467 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T04:04:50.489 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T04:04:50.504 INFO:teuthology.orchestra.run.smithi007.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.2 MB/s | 2.4 MB 00:01 2024-09-19T04:04:50.513 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2024-09-19T04:04:50.513 INFO:teuthology.orchestra.run.smithi007.stdout:Total 9.1 MB/s | 226 MB 00:24 2024-09-19T04:04:50.537 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-09-19T04:04:50.537 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-09-19T04:04:50.685 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T04:04:50.815 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T04:04:50.944 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T04:04:51.053 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T04:04:51.142 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T04:04:51.359 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T04:04:51.477 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T04:04:51.580 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T04:04:51.609 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T04:04:51.644 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T04:04:51.717 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T04:04:51.753 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2024-09-19T04:04:51.761 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T04:04:51.793 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T04:04:51.845 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T04:04:51.886 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T04:04:51.914 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T04:04:51.922 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2024-09-19T04:04:51.922 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2024-09-19T04:04:51.982 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T04:04:52.037 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T04:04:52.067 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T04:04:52.111 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T04:04:52.187 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T04:04:52.222 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T04:04:52.265 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T04:04:52.302 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T04:04:52.373 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T04:04:52.442 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T04:04:52.517 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T04:04:52.651 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T04:04:52.703 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T04:04:53.231 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T04:04:53.315 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T04:04:53.346 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T04:04:53.389 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T04:04:53.427 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T04:04:53.468 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T04:04:53.617 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T04:04:53.680 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T04:04:53.743 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T04:04:53.817 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T04:04:53.848 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T04:04:53.884 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T04:04:53.931 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T04:04:53.967 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T04:04:54.010 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T04:04:54.061 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T04:04:54.196 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T04:04:54.253 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2024-09-19T04:04:54.253 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2024-09-19T04:04:54.296 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T04:04:54.337 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T04:04:54.440 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T04:04:54.479 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T04:04:54.519 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T04:04:54.545 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T04:04:54.569 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T04:04:54.652 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T04:04:54.797 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T04:04:54.835 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T04:04:54.872 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T04:04:54.906 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T04:04:54.945 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T04:04:54.976 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T04:04:55.015 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T04:04:55.058 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T04:04:55.091 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T04:04:55.132 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T04:04:55.167 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T04:04:55.254 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T04:04:55.297 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T04:04:55.329 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T04:04:55.440 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T04:04:55.497 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T04:04:56.221 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T04:04:56.268 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T04:04:56.302 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T04:04:56.400 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T04:04:56.457 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T04:04:56.502 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T04:04:56.601 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T04:04:56.657 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T04:04:56.832 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-09-19T04:04:56.842 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T04:04:56.871 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T04:04:56.951 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T04:04:56.973 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T04:04:57.019 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T04:04:57.073 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T04:04:57.107 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T04:04:57.132 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T04:04:57.175 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T04:04:57.496 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T04:04:57.595 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T04:04:57.608 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T04:04:57.713 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T04:04:57.719 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T04:04:57.743 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T04:04:57.817 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T04:04:57.847 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T04:04:58.001 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T04:04:58.060 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T04:04:58.097 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T04:04:58.199 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T04:04:58.231 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T04:04:58.294 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T04:04:58.315 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T04:04:58.338 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T04:04:58.483 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T04:04:58.644 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T04:04:58.780 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T04:04:58.884 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T04:04:58.937 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T04:04:58.948 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T04:04:59.025 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T04:04:59.053 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T04:04:59.086 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T04:04:59.175 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T04:04:59.280 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T04:04:59.368 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T04:04:59.405 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T04:04:59.406 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T04:04:59.441 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T04:04:59.449 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T04:04:59.505 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T04:04:59.550 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T04:04:59.557 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T04:04:59.582 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T04:04:59.588 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T04:04:59.623 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T04:04:59.625 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T04:04:59.657 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T04:04:59.686 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T04:04:59.762 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T04:04:59.824 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T04:04:59.855 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T04:04:59.890 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T04:04:59.967 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T04:05:00.002 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T04:05:00.044 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T04:05:00.074 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T04:05:00.109 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T04:05:00.144 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T04:05:00.145 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T04:05:00.196 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T04:05:00.215 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T04:05:00.246 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T04:05:00.272 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T04:05:00.410 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T04:05:00.466 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T04:05:00.903 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2024-09-19T04:05:00.985 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T04:05:00.992 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T04:05:01.037 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T04:05:01.068 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T04:05:01.094 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T04:05:01.098 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T04:05:01.135 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T04:05:01.141 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T04:05:01.160 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T04:05:01.187 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T04:05:01.221 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T04:05:01.229 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T04:05:01.383 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T04:05:01.440 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T04:05:01.495 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T04:05:01.565 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T04:05:01.568 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T04:05:01.599 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T04:05:01.635 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T04:05:01.680 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T04:05:01.683 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T04:05:01.718 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T04:05:01.761 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T04:05:01.805 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T04:05:01.820 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T04:05:01.839 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T04:05:01.932 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T04:05:01.961 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T04:05:01.964 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T04:05:02.013 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T04:05:02.054 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T04:05:02.151 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T04:05:02.156 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T04:05:02.188 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T04:05:02.209 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T04:05:02.236 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T04:05:02.256 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T04:05:02.287 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T04:05:02.311 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T04:05:02.342 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T04:05:02.370 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T04:05:02.385 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T04:05:02.433 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T04:05:02.454 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T04:05:02.477 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T04:05:02.512 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T04:05:02.552 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T04:05:02.561 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T04:05:02.597 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T04:05:02.601 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T04:05:02.631 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T04:05:02.641 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T04:05:02.670 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T04:05:02.702 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T04:05:02.731 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T04:05:02.766 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T04:05:02.789 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T04:05:02.874 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T04:05:02.921 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T04:05:03.046 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T04:05:03.067 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T04:05:03.109 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T04:05:03.113 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T04:05:03.150 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T04:05:03.188 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T04:05:03.199 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T04:05:03.248 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T04:05:03.278 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T04:05:03.282 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T04:05:03.282 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T04:05:03.282 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T04:05:03.282 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T04:05:03.314 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T04:05:03.336 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T04:05:03.391 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T04:05:03.448 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T04:05:03.454 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T04:05:03.545 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T04:05:03.577 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T04:05:03.612 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T04:05:03.688 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T04:05:03.739 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T04:05:03.779 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T04:05:03.822 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T04:05:03.855 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T04:05:03.883 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T04:05:03.946 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T04:05:03.998 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T04:05:04.027 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T04:05:04.071 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T04:05:04.150 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T04:05:04.170 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T04:05:04.181 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T04:05:04.217 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T04:05:04.225 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T04:05:04.251 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T04:05:04.253 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T04:05:04.329 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T04:05:04.351 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T04:05:04.377 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T04:05:04.400 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T04:05:04.444 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T04:05:04.456 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T04:05:04.523 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T04:05:04.564 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T04:05:04.602 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T04:05:04.665 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T04:05:04.746 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T04:05:04.778 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T04:05:04.855 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T04:05:05.228 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T04:05:05.320 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T04:05:05.354 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T04:05:05.398 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T04:05:05.435 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T04:05:05.480 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T04:05:05.493 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T04:05:05.609 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T04:05:05.648 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T04:05:05.722 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T04:05:05.779 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T04:05:05.853 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T04:05:05.889 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T04:05:05.926 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T04:05:05.982 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T04:05:06.017 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T04:05:06.061 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T04:05:06.103 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T04:05:06.247 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T04:05:06.287 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T04:05:06.329 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T04:05:06.445 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T04:05:06.479 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T04:05:06.520 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T04:05:06.553 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T04:05:06.578 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T04:05:06.681 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T04:05:06.819 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T04:05:06.819 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T04:05:06.860 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T04:05:06.889 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T04:05:06.906 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T04:05:06.922 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T04:05:06.935 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T04:05:06.962 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T04:05:06.967 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T04:05:07.002 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T04:05:07.032 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T04:05:07.066 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T04:05:07.100 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T04:05:07.137 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T04:05:07.179 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T04:05:07.262 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T04:05:07.276 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T04:05:07.310 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T04:05:07.330 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T04:05:07.341 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T04:05:07.413 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T04:05:07.444 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T04:05:07.450 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T04:05:07.479 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T04:05:07.502 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T04:05:07.967 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T04:05:07.992 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T04:05:08.063 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T04:05:08.094 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T04:05:08.279 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T04:05:08.323 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T04:05:08.356 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T04:05:08.463 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T04:05:08.522 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T04:05:08.566 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T04:05:08.658 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T04:05:08.701 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T04:05:08.893 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T04:05:08.932 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T04:05:09.021 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T04:05:09.724 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T04:05:09.848 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T04:05:10.358 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T04:05:10.398 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T04:05:10.936 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T04:05:10.976 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T04:05:11.067 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T04:05:11.068 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T04:05:11.068 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T04:05:11.068 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T04:05:11.102 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T04:05:11.183 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T04:05:11.277 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T04:05:11.312 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T04:05:11.345 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T04:05:11.673 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T04:05:11.724 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T04:05:11.824 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T04:05:11.854 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T04:05:11.894 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T04:05:12.403 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T04:05:12.452 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T04:05:12.524 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T04:05:12.562 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T04:05:14.996 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T04:05:15.033 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T04:05:15.347 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T04:05:15.348 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /sys 2024-09-19T04:05:15.348 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /proc 2024-09-19T04:05:15.348 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /mnt 2024-09-19T04:05:15.348 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /var/tmp 2024-09-19T04:05:15.348 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /home 2024-09-19T04:05:15.348 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /root 2024-09-19T04:05:15.348 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /tmp 2024-09-19T04:05:15.348 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T04:05:15.525 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T04:05:15.541 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T04:05:15.541 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:05:15.541 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T04:05:15.541 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T04:05:15.618 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T04:05:15.654 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T04:05:15.755 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T04:05:15.755 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T04:05:15.755 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T04:05:15.755 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:05:15.797 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T04:05:17.054 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T04:05:17.081 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T04:05:17.081 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:05:17.082 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T04:05:17.082 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T04:05:17.082 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T04:05:17.082 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T04:05:17.322 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T04:05:17.345 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T04:05:17.345 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:05:17.346 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T04:05:17.346 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T04:05:17.346 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T04:05:17.346 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T04:05:17.781 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T04:05:17.805 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T04:05:17.805 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:05:17.805 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T04:05:17.805 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T04:05:17.805 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T04:05:17.805 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T04:05:17.944 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T04:05:18.000 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T04:05:18.056 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T04:05:18.241 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T04:05:18.298 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T04:05:18.376 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T04:05:18.465 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T04:05:18.603 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T04:05:18.648 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T04:05:18.689 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T04:05:18.717 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T04:05:19.129 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T04:05:19.157 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T04:05:19.188 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T04:05:19.250 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T04:05:19.280 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T04:05:20.333 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T04:05:20.365 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T04:05:21.331 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T04:05:21.357 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T04:05:21.460 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T04:05:21.628 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T04:05:21.659 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T04:05:21.683 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T04:05:21.683 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:05:21.684 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T04:05:21.684 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T04:05:21.684 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T04:05:21.684 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T04:05:21.735 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T04:05:21.747 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T04:05:21.844 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T04:05:21.902 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T04:05:22.676 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T04:05:22.676 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /sys 2024-09-19T04:05:22.676 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /proc 2024-09-19T04:05:22.676 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /mnt 2024-09-19T04:05:22.676 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /var/tmp 2024-09-19T04:05:22.676 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /home 2024-09-19T04:05:22.677 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /root 2024-09-19T04:05:22.677 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /tmp 2024-09-19T04:05:22.677 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T04:05:22.822 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T04:05:22.855 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T04:05:22.878 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T04:05:22.878 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:05:22.878 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T04:05:22.878 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T04:05:22.878 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T04:05:22.878 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T04:05:22.903 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T04:05:22.919 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T04:05:22.919 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:05:22.919 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T04:05:22.919 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T04:05:22.921 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T04:05:22.944 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T04:05:22.945 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:05:22.945 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T04:05:22.945 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T04:05:22.989 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T04:05:23.012 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T04:05:23.012 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:05:23.012 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T04:05:23.012 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T04:05:23.012 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T04:05:23.013 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T04:05:23.331 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T04:05:23.354 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T04:05:23.355 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:05:23.355 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T04:05:23.355 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T04:05:23.355 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T04:05:23.355 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T04:05:24.389 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T04:05:24.415 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T04:05:24.415 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:05:24.416 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T04:05:24.416 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T04:05:24.416 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T04:05:24.416 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T04:05:24.640 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T04:05:24.663 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T04:05:24.664 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:05:24.664 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T04:05:24.664 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T04:05:24.664 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T04:05:24.664 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T04:05:25.099 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T04:05:25.122 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T04:05:25.123 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:05:25.123 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T04:05:25.123 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T04:05:25.123 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T04:05:25.123 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T04:05:25.229 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T04:05:25.286 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T04:05:25.341 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T04:05:25.526 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T04:05:25.574 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T04:05:25.652 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T04:05:25.741 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T04:05:25.873 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T04:05:25.925 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T04:05:25.957 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T04:05:25.984 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T04:05:26.430 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T04:05:26.467 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T04:05:26.498 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T04:05:26.559 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T04:05:26.589 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T04:05:27.626 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T04:05:27.666 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T04:05:27.902 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T04:05:27.943 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T04:05:27.983 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T04:05:28.016 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T04:05:28.043 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T04:05:28.074 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T04:05:28.074 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /sys 2024-09-19T04:05:28.074 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /proc 2024-09-19T04:05:28.074 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /mnt 2024-09-19T04:05:28.074 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /var/tmp 2024-09-19T04:05:28.074 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /home 2024-09-19T04:05:28.074 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /root 2024-09-19T04:05:28.074 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /tmp 2024-09-19T04:05:28.074 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:05:28.221 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T04:05:28.252 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T04:05:28.265 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T04:05:28.268 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T04:05:28.268 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:05:28.269 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T04:05:28.269 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:05:28.295 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T04:05:28.325 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T04:05:28.371 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T04:05:28.620 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T04:05:28.650 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T04:05:28.751 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T04:05:28.883 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T04:05:28.911 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T04:05:28.919 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T04:05:28.940 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T04:05:28.943 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T04:05:28.967 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T04:05:28.967 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:05:28.967 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T04:05:28.968 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T04:05:28.968 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T04:05:28.968 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T04:05:29.027 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T04:05:29.039 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T04:05:29.136 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T04:05:29.192 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T04:05:29.770 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T04:05:29.814 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T04:05:29.842 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T04:05:29.842 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:05:29.842 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T04:05:29.842 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T04:05:29.842 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T04:05:29.842 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:05:29.857 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T04:05:29.890 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T04:05:29.979 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T04:05:30.027 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T04:05:30.052 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T04:05:30.073 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T04:05:30.078 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T04:05:30.079 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T04:05:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T04:05:30.098 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:05:30.098 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T04:05:30.098 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T04:05:30.098 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T04:05:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:05:30.119 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T04:05:30.147 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T04:05:30.162 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T04:05:30.162 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T04:05:30.170 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T04:05:30.170 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:05:30.170 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T04:05:30.170 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T04:05:30.170 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T04:05:30.171 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T04:05:30.216 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T04:05:30.236 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T04:05:30.237 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:05:30.237 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T04:05:30.237 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T04:05:30.246 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T04:05:30.271 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T04:05:30.277 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T04:05:30.277 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T04:05:30.281 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T04:05:30.304 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T04:05:30.304 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:05:30.304 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T04:05:30.304 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T04:05:30.304 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T04:05:30.304 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T04:05:30.457 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T04:05:30.457 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T04:05:30.532 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T04:05:30.565 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T04:05:30.590 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T04:05:30.590 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:05:30.590 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T04:05:30.590 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T04:05:30.590 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T04:05:30.590 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:05:30.595 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T04:05:30.607 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T04:05:30.630 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T04:05:30.630 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:05:30.630 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T04:05:30.630 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T04:05:30.630 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T04:05:30.630 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T04:05:30.704 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T04:05:30.763 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T04:05:30.828 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T04:05:31.024 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T04:05:31.075 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T04:05:31.156 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T04:05:31.254 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T04:05:31.400 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T04:05:31.458 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T04:05:31.490 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T04:05:31.517 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T04:05:31.964 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T04:05:31.991 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T04:05:32.023 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T04:05:32.089 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T04:05:32.114 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T04:05:33.234 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T04:05:33.275 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T04:05:34.293 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T04:05:34.333 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T04:05:34.446 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T04:05:34.620 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T04:05:34.652 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T04:05:34.677 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T04:05:34.677 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:05:34.677 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T04:05:34.677 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T04:05:34.677 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T04:05:34.677 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:05:34.728 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T04:05:34.740 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T04:05:34.842 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T04:05:34.899 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T04:05:35.152 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T04:05:35.209 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T04:05:35.250 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T04:05:35.283 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T04:05:35.310 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T04:05:35.491 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T04:05:35.531 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T04:05:35.561 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T04:05:35.591 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T04:05:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T04:05:35.883 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T04:05:35.913 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T04:05:35.938 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T04:05:35.938 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:05:35.939 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T04:05:35.939 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T04:05:35.939 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T04:05:35.939 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:05:35.981 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T04:05:36.005 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T04:05:36.005 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:05:36.005 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T04:05:36.005 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:05:36.056 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T04:05:36.081 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T04:05:36.081 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:05:36.082 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T04:05:36.082 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T04:05:36.082 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T04:05:36.082 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:05:36.256 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T04:05:36.293 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T04:05:36.313 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T04:05:36.398 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T04:05:36.412 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T04:05:36.412 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T04:05:36.412 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T04:05:36.412 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T04:05:36.412 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T04:05:36.412 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T04:05:36.412 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T04:05:36.412 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T04:05:36.412 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T04:05:36.413 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T04:05:36.413 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T04:05:36.413 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T04:05:36.413 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T04:05:36.413 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T04:05:36.413 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T04:05:36.413 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T04:05:36.413 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T04:05:36.413 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T04:05:36.413 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T04:05:36.413 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T04:05:36.413 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T04:05:36.413 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T04:05:36.414 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T04:05:36.414 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T04:05:36.414 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T04:05:36.414 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T04:05:36.414 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T04:05:36.414 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T04:05:36.414 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T04:05:36.414 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T04:05:36.414 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T04:05:36.425 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T04:05:36.425 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T04:05:36.425 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T04:05:36.425 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T04:05:36.425 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T04:05:36.426 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T04:05:36.426 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T04:05:36.426 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T04:05:36.426 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T04:05:36.426 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T04:05:36.426 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T04:05:36.426 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T04:05:36.426 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T04:05:36.426 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T04:05:36.426 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T04:05:36.426 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T04:05:36.426 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T04:05:36.426 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T04:05:36.427 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T04:05:36.427 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T04:05:36.427 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T04:05:36.427 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T04:05:36.427 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T04:05:36.427 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T04:05:36.427 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T04:05:36.427 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T04:05:36.427 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T04:05:36.427 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T04:05:36.427 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T04:05:36.427 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T04:05:36.428 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T04:05:36.428 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T04:05:36.428 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T04:05:36.428 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T04:05:36.428 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T04:05:36.428 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T04:05:36.428 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T04:05:36.428 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T04:05:36.428 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T04:05:36.428 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T04:05:36.428 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T04:05:36.428 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T04:05:36.428 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T04:05:36.429 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T04:05:36.429 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T04:05:36.429 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T04:05:36.429 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T04:05:36.429 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T04:05:36.429 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T04:05:36.429 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T04:05:36.429 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T04:05:36.429 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T04:05:36.429 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T04:05:36.429 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T04:05:36.429 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T04:05:36.429 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T04:05:36.430 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T04:05:36.430 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T04:05:36.430 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T04:05:36.430 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T04:05:36.430 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T04:05:36.430 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T04:05:36.430 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T04:05:36.430 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T04:05:36.430 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T04:05:36.430 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T04:05:36.430 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T04:05:36.430 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T04:05:36.430 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T04:05:36.430 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T04:05:36.430 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T04:05:36.431 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T04:05:36.431 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T04:05:36.431 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T04:05:36.431 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T04:05:36.431 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T04:05:36.431 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T04:05:36.431 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T04:05:36.431 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T04:05:36.431 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T04:05:36.431 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T04:05:36.431 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T04:05:36.431 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T04:05:36.431 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T04:05:36.431 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T04:05:36.431 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T04:05:36.432 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T04:05:36.432 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T04:05:36.432 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T04:05:36.432 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T04:05:36.432 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T04:05:36.432 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T04:05:36.432 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T04:05:36.432 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T04:05:36.432 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T04:05:36.432 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T04:05:36.432 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T04:05:36.432 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T04:05:36.432 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T04:05:36.432 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T04:05:36.433 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T04:05:36.433 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T04:05:36.433 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T04:05:36.433 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T04:05:36.433 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T04:05:36.433 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T04:05:36.433 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T04:05:36.433 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T04:05:36.433 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T04:05:36.433 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T04:05:36.433 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T04:05:36.433 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T04:05:36.434 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T04:05:36.434 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T04:05:36.434 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T04:05:36.434 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T04:05:36.434 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T04:05:36.434 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T04:05:36.434 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T04:05:36.434 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T04:05:36.434 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T04:05:36.434 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T04:05:36.434 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T04:05:36.434 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T04:05:36.434 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T04:05:36.435 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T04:05:36.435 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T04:05:36.435 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T04:05:36.435 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T04:05:36.435 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T04:05:36.435 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T04:05:36.435 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T04:05:36.435 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T04:05:36.435 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T04:05:36.435 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:05:36.436 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T04:05:36.436 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T04:05:36.436 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T04:05:36.436 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:05:37.140 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T04:05:37.231 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T04:05:37.272 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T04:05:37.354 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T04:05:37.384 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T04:05:37.409 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T04:05:37.435 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T04:05:37.435 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T04:05:37.503 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T04:05:37.503 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T04:05:37.587 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T04:05:37.612 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T04:05:37.617 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T04:05:37.617 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T04:05:37.789 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T04:05:37.789 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T04:05:37.889 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T04:05:37.961 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T04:05:39.038 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T04:05:39.064 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T04:05:39.065 INFO:teuthology.orchestra.run.smithi102.stdout:Upgraded: 2024-09-19T04:05:39.065 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T04:05:39.065 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T04:05:39.065 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T04:05:39.065 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T04:05:39.065 INFO:teuthology.orchestra.run.smithi102.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.065 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.065 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T04:05:39.065 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T04:05:39.065 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T04:05:39.065 INFO:teuthology.orchestra.run.smithi102.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T04:05:39.065 INFO:teuthology.orchestra.run.smithi102.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T04:05:39.065 INFO:teuthology.orchestra.run.smithi102.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T04:05:39.066 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T04:05:39.066 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.066 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.066 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.066 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.066 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:39.066 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.066 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.066 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.066 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:39.066 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:39.066 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:39.066 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:39.066 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:39.067 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.067 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.067 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:39.067 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.067 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.067 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.067 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:39.067 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:39.067 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.067 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.067 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:39.067 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T04:05:39.068 INFO:teuthology.orchestra.run.smithi102.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T04:05:39.068 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T04:05:39.068 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T04:05:39.068 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T04:05:39.068 INFO:teuthology.orchestra.run.smithi102.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T04:05:39.068 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T04:05:39.068 INFO:teuthology.orchestra.run.smithi102.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T04:05:39.068 INFO:teuthology.orchestra.run.smithi102.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T04:05:39.068 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T04:05:39.068 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T04:05:39.068 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.068 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.068 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.069 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T04:05:39.069 INFO:teuthology.orchestra.run.smithi102.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T04:05:39.069 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T04:05:39.069 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T04:05:39.069 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T04:05:39.069 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.069 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.069 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T04:05:39.069 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.070 INFO:teuthology.orchestra.run.smithi102.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T04:05:39.070 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T04:05:39.070 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T04:05:39.070 INFO:teuthology.orchestra.run.smithi102.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T04:05:39.070 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T04:05:39.070 INFO:teuthology.orchestra.run.smithi102.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T04:05:39.070 INFO:teuthology.orchestra.run.smithi102.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T04:05:39.070 INFO:teuthology.orchestra.run.smithi102.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T04:05:39.070 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T04:05:39.070 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T04:05:39.070 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T04:05:39.070 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T04:05:39.071 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T04:05:39.071 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T04:05:39.071 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T04:05:39.071 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T04:05:39.071 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T04:05:39.071 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T04:05:39.071 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T04:05:39.071 INFO:teuthology.orchestra.run.smithi102.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T04:05:39.071 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T04:05:39.071 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T04:05:39.071 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T04:05:39.071 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.071 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.071 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.072 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T04:05:39.072 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T04:05:39.072 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T04:05:39.072 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T04:05:39.072 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T04:05:39.072 INFO:teuthology.orchestra.run.smithi102.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T04:05:39.072 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T04:05:39.072 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T04:05:39.072 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T04:05:39.072 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T04:05:39.072 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T04:05:39.072 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T04:05:39.072 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T04:05:39.072 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T04:05:39.073 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T04:05:39.073 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T04:05:39.073 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T04:05:39.073 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T04:05:39.073 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T04:05:39.073 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T04:05:39.073 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T04:05:39.073 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T04:05:39.073 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T04:05:39.073 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T04:05:39.073 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T04:05:39.073 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T04:05:39.073 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T04:05:39.074 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T04:05:39.074 INFO:teuthology.orchestra.run.smithi102.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T04:05:39.074 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T04:05:39.074 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T04:05:39.074 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T04:05:39.074 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T04:05:39.074 INFO:teuthology.orchestra.run.smithi102.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T04:05:39.074 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T04:05:39.074 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T04:05:39.074 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T04:05:39.074 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T04:05:39.074 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T04:05:39.074 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T04:05:39.075 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.075 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.075 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T04:05:39.075 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T04:05:39.075 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T04:05:39.075 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.075 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T04:05:39.075 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T04:05:39.075 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T04:05:39.075 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T04:05:39.075 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T04:05:39.075 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T04:05:39.075 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T04:05:39.075 INFO:teuthology.orchestra.run.smithi102.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T04:05:39.076 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T04:05:39.076 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T04:05:39.076 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T04:05:39.076 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T04:05:39.076 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T04:05:39.076 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T04:05:39.076 INFO:teuthology.orchestra.run.smithi102.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T04:05:39.076 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.076 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.076 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:39.076 INFO:teuthology.orchestra.run.smithi102.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T04:05:39.076 INFO:teuthology.orchestra.run.smithi102.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T04:05:39.076 INFO:teuthology.orchestra.run.smithi102.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T04:05:39.076 INFO:teuthology.orchestra.run.smithi102.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T04:05:39.077 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T04:05:39.077 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T04:05:39.077 INFO:teuthology.orchestra.run.smithi102.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T04:05:39.077 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T04:05:39.077 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T04:05:39.495 DEBUG:teuthology.parallel:result is None 2024-09-19T04:05:41.270 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T04:05:41.311 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T04:05:41.353 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T04:05:41.384 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T04:05:41.411 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T04:05:41.632 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T04:05:41.675 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T04:05:41.705 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T04:05:41.740 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T04:05:41.781 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T04:05:42.445 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T04:05:42.479 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T04:05:42.500 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T04:05:43.422 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T04:05:43.541 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T04:05:43.591 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T04:05:43.684 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T04:05:43.721 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T04:05:43.721 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T04:05:43.722 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T04:05:43.722 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T04:05:43.722 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T04:05:43.722 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T04:05:43.722 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T04:05:43.722 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T04:05:43.722 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T04:05:43.722 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T04:05:43.722 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T04:05:43.722 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T04:05:43.722 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T04:05:43.722 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T04:05:43.723 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T04:05:43.723 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T04:05:43.723 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T04:05:43.723 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T04:05:43.723 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T04:05:43.723 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T04:05:43.723 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T04:05:43.723 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T04:05:43.723 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T04:05:43.723 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T04:05:43.723 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T04:05:43.723 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T04:05:43.723 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T04:05:43.724 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T04:05:43.724 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T04:05:43.724 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T04:05:43.724 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T04:05:43.724 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T04:05:43.735 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T04:05:43.735 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T04:05:43.735 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T04:05:43.735 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T04:05:43.735 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T04:05:43.736 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T04:05:43.736 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T04:05:43.736 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T04:05:43.736 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T04:05:43.736 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T04:05:43.736 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T04:05:43.736 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T04:05:43.736 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T04:05:43.736 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T04:05:43.736 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T04:05:43.736 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T04:05:43.736 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T04:05:43.736 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T04:05:43.737 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T04:05:43.737 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T04:05:43.737 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T04:05:43.737 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T04:05:43.737 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T04:05:43.737 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T04:05:43.737 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T04:05:43.737 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T04:05:43.737 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T04:05:43.737 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T04:05:43.737 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T04:05:43.737 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T04:05:43.737 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T04:05:43.738 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T04:05:43.738 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T04:05:43.738 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T04:05:43.738 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T04:05:43.738 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T04:05:43.738 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T04:05:43.738 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T04:05:43.738 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T04:05:43.738 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T04:05:43.738 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T04:05:43.738 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T04:05:43.738 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T04:05:43.738 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T04:05:43.738 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T04:05:43.739 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T04:05:43.739 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T04:05:43.739 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T04:05:43.739 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T04:05:43.739 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T04:05:43.739 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T04:05:43.739 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T04:05:43.739 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T04:05:43.739 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T04:05:43.739 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T04:05:43.739 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T04:05:43.739 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T04:05:43.739 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T04:05:43.739 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T04:05:43.740 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T04:05:43.740 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T04:05:43.740 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T04:05:43.740 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T04:05:43.740 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T04:05:43.740 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T04:05:43.740 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T04:05:43.740 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T04:05:43.740 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T04:05:43.740 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T04:05:43.740 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T04:05:43.740 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T04:05:43.740 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T04:05:43.741 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T04:05:43.741 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T04:05:43.741 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T04:05:43.741 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T04:05:43.741 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T04:05:43.741 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T04:05:43.741 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T04:05:43.741 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T04:05:43.741 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T04:05:43.741 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T04:05:43.741 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T04:05:43.741 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T04:05:43.741 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T04:05:43.741 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T04:05:43.742 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T04:05:43.742 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T04:05:43.742 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T04:05:43.742 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T04:05:43.742 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T04:05:43.742 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T04:05:43.742 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T04:05:43.742 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T04:05:43.742 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T04:05:43.742 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T04:05:43.742 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T04:05:43.742 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T04:05:43.742 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T04:05:43.742 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T04:05:43.743 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T04:05:43.743 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T04:05:43.743 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T04:05:43.743 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T04:05:43.743 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T04:05:43.743 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T04:05:43.743 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T04:05:43.743 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T04:05:43.743 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T04:05:43.743 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T04:05:43.743 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T04:05:43.743 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T04:05:43.743 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T04:05:43.744 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T04:05:43.744 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T04:05:43.744 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T04:05:43.744 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T04:05:43.744 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T04:05:43.744 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T04:05:43.744 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T04:05:43.744 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T04:05:43.744 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T04:05:43.744 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T04:05:43.744 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T04:05:43.744 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T04:05:43.744 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T04:05:43.745 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T04:05:43.745 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T04:05:43.745 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T04:05:43.745 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T04:05:43.745 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T04:05:43.745 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T04:05:43.745 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T04:05:43.746 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T04:05:43.773 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T04:05:43.773 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T04:05:43.857 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T04:05:43.857 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T04:05:43.941 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T04:05:43.965 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T04:05:43.971 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T04:05:43.971 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T04:05:44.151 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T04:05:44.151 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T04:05:44.235 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T04:05:44.311 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T04:05:46.317 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T04:05:46.317 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T04:05:46.317 INFO:teuthology.orchestra.run.smithi092.stdout:Upgraded: 2024-09-19T04:05:46.317 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T04:05:46.317 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T04:05:46.317 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T04:05:46.317 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T04:05:46.317 INFO:teuthology.orchestra.run.smithi092.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.317 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.318 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T04:05:46.318 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T04:05:46.318 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-09-19T04:05:46.318 INFO:teuthology.orchestra.run.smithi092.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T04:05:46.318 INFO:teuthology.orchestra.run.smithi092.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T04:05:46.318 INFO:teuthology.orchestra.run.smithi092.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T04:05:46.318 INFO:teuthology.orchestra.run.smithi092.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T04:05:46.318 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.318 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.318 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.318 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.318 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:46.318 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.319 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.319 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.319 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:46.319 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:46.319 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:46.319 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:46.319 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:46.319 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.319 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.319 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:46.319 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.319 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.320 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.320 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:46.320 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:46.320 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.320 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.320 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:46.320 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T04:05:46.320 INFO:teuthology.orchestra.run.smithi092.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T04:05:46.320 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T04:05:46.320 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T04:05:46.320 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T04:05:46.321 INFO:teuthology.orchestra.run.smithi092.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T04:05:46.321 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T04:05:46.321 INFO:teuthology.orchestra.run.smithi092.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T04:05:46.321 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T04:05:46.321 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T04:05:46.321 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T04:05:46.321 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.321 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.321 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.321 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T04:05:46.321 INFO:teuthology.orchestra.run.smithi092.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T04:05:46.322 INFO:teuthology.orchestra.run.smithi092.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T04:05:46.322 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T04:05:46.322 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T04:05:46.322 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.322 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.322 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T04:05:46.322 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.322 INFO:teuthology.orchestra.run.smithi092.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T04:05:46.322 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T04:05:46.322 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T04:05:46.322 INFO:teuthology.orchestra.run.smithi092.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T04:05:46.322 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T04:05:46.322 INFO:teuthology.orchestra.run.smithi092.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T04:05:46.322 INFO:teuthology.orchestra.run.smithi092.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T04:05:46.322 INFO:teuthology.orchestra.run.smithi092.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T04:05:46.323 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T04:05:46.323 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T04:05:46.323 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T04:05:46.323 INFO:teuthology.orchestra.run.smithi092.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T04:05:46.323 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T04:05:46.323 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T04:05:46.323 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T04:05:46.323 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T04:05:46.323 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T04:05:46.323 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T04:05:46.323 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T04:05:46.323 INFO:teuthology.orchestra.run.smithi092.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T04:05:46.323 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T04:05:46.323 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T04:05:46.324 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T04:05:46.324 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.324 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.324 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.324 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T04:05:46.324 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T04:05:46.324 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T04:05:46.324 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T04:05:46.324 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T04:05:46.324 INFO:teuthology.orchestra.run.smithi092.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T04:05:46.324 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T04:05:46.324 INFO:teuthology.orchestra.run.smithi092.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T04:05:46.324 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T04:05:46.325 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T04:05:46.325 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T04:05:46.325 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T04:05:46.325 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T04:05:46.325 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T04:05:46.325 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T04:05:46.325 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T04:05:46.325 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T04:05:46.325 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T04:05:46.325 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T04:05:46.325 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T04:05:46.325 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T04:05:46.325 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T04:05:46.325 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T04:05:46.326 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T04:05:46.326 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T04:05:46.326 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T04:05:46.326 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T04:05:46.326 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T04:05:46.326 INFO:teuthology.orchestra.run.smithi092.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T04:05:46.326 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T04:05:46.326 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T04:05:46.326 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T04:05:46.326 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T04:05:46.326 INFO:teuthology.orchestra.run.smithi092.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T04:05:46.326 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T04:05:46.326 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T04:05:46.327 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T04:05:46.327 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T04:05:46.327 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T04:05:46.327 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T04:05:46.327 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.327 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.327 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T04:05:46.327 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T04:05:46.327 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T04:05:46.327 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.327 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T04:05:46.327 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T04:05:46.327 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T04:05:46.327 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T04:05:46.327 INFO:teuthology.orchestra.run.smithi092.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T04:05:46.328 INFO:teuthology.orchestra.run.smithi092.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T04:05:46.328 INFO:teuthology.orchestra.run.smithi092.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T04:05:46.328 INFO:teuthology.orchestra.run.smithi092.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T04:05:46.328 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T04:05:46.328 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T04:05:46.328 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T04:05:46.328 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T04:05:46.328 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T04:05:46.328 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T04:05:46.328 INFO:teuthology.orchestra.run.smithi092.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T04:05:46.328 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.328 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.328 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:46.328 INFO:teuthology.orchestra.run.smithi092.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T04:05:46.329 INFO:teuthology.orchestra.run.smithi092.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T04:05:46.329 INFO:teuthology.orchestra.run.smithi092.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T04:05:46.329 INFO:teuthology.orchestra.run.smithi092.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T04:05:46.329 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T04:05:46.329 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T04:05:46.329 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T04:05:46.329 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T04:05:46.329 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-09-19T04:05:46.739 DEBUG:teuthology.parallel:result is None 2024-09-19T04:05:50.263 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T04:05:50.263 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T04:05:50.263 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T04:05:50.264 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T04:05:50.264 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T04:05:50.264 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T04:05:50.264 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T04:05:50.264 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T04:05:50.264 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T04:05:50.264 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T04:05:50.264 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T04:05:50.264 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T04:05:50.264 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T04:05:50.264 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T04:05:50.264 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T04:05:50.265 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T04:05:50.265 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T04:05:50.265 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T04:05:50.265 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T04:05:50.265 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T04:05:50.265 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T04:05:50.265 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T04:05:50.265 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T04:05:50.265 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T04:05:50.265 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T04:05:50.265 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T04:05:50.265 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T04:05:50.265 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T04:05:50.277 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T04:05:50.277 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T04:05:50.277 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T04:05:50.278 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T04:05:50.278 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T04:05:50.278 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T04:05:50.278 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T04:05:50.278 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T04:05:50.278 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T04:05:50.278 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T04:05:50.278 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T04:05:50.278 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T04:05:50.278 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T04:05:50.278 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T04:05:50.278 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T04:05:50.278 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T04:05:50.278 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T04:05:50.279 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T04:05:50.279 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T04:05:50.279 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T04:05:50.279 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T04:05:50.279 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T04:05:50.279 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T04:05:50.279 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T04:05:50.279 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T04:05:50.279 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T04:05:50.279 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T04:05:50.279 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T04:05:50.279 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T04:05:50.279 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T04:05:50.280 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T04:05:50.280 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T04:05:50.280 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T04:05:50.280 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T04:05:50.280 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T04:05:50.280 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T04:05:50.280 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T04:05:50.280 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T04:05:50.280 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T04:05:50.280 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T04:05:50.280 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T04:05:50.280 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T04:05:50.281 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T04:05:50.281 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T04:05:50.281 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T04:05:50.281 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T04:05:50.281 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T04:05:50.281 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T04:05:50.281 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T04:05:50.281 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T04:05:50.281 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T04:05:50.281 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T04:05:50.281 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T04:05:50.281 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T04:05:50.281 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T04:05:50.281 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T04:05:50.282 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T04:05:50.282 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T04:05:50.282 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T04:05:50.282 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T04:05:50.282 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T04:05:50.282 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T04:05:50.282 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T04:05:50.282 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T04:05:50.282 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T04:05:50.282 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T04:05:50.282 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T04:05:50.282 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T04:05:50.282 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T04:05:50.282 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T04:05:50.283 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T04:05:50.283 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T04:05:50.283 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T04:05:50.283 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T04:05:50.283 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T04:05:50.283 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T04:05:50.283 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T04:05:50.283 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T04:05:50.283 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T04:05:50.283 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T04:05:50.283 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T04:05:50.283 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T04:05:50.283 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T04:05:50.283 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T04:05:50.284 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T04:05:50.284 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T04:05:50.284 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T04:05:50.284 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T04:05:50.284 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T04:05:50.284 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T04:05:50.284 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T04:05:50.284 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T04:05:50.284 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T04:05:50.284 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T04:05:50.285 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T04:05:50.285 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T04:05:50.285 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T04:05:50.285 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T04:05:50.285 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T04:05:50.285 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T04:05:50.285 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T04:05:50.285 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T04:05:50.285 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T04:05:50.285 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T04:05:50.285 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T04:05:50.285 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T04:05:50.286 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T04:05:50.286 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T04:05:50.286 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T04:05:50.286 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T04:05:50.286 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T04:05:50.286 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T04:05:50.286 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T04:05:50.286 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T04:05:50.286 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T04:05:50.286 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T04:05:50.286 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T04:05:50.286 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T04:05:50.286 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T04:05:50.287 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T04:05:50.287 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T04:05:50.287 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T04:05:50.287 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T04:05:50.287 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T04:05:50.287 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T04:05:50.287 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T04:05:50.287 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T04:05:50.287 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T04:05:50.287 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T04:05:50.287 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T04:05:50.287 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T04:05:50.287 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T04:05:50.288 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T04:05:50.288 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T04:05:50.288 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T04:05:50.288 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T04:05:52.682 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T04:05:52.682 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:05:52.682 INFO:teuthology.orchestra.run.smithi007.stdout:Upgraded: 2024-09-19T04:05:52.682 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T04:05:52.682 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T04:05:52.682 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T04:05:52.683 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T04:05:52.683 INFO:teuthology.orchestra.run.smithi007.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.683 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.683 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T04:05:52.683 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T04:05:52.683 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2024-09-19T04:05:52.683 INFO:teuthology.orchestra.run.smithi007.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T04:05:52.683 INFO:teuthology.orchestra.run.smithi007.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T04:05:52.684 INFO:teuthology.orchestra.run.smithi007.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T04:05:52.684 INFO:teuthology.orchestra.run.smithi007.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T04:05:52.684 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.684 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.684 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.684 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.684 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:52.684 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.684 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.684 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.684 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:52.685 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:52.685 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:52.685 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:52.685 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:52.685 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.685 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.685 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:52.685 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.685 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.685 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.685 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:52.686 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:52.686 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.686 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.686 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:05:52.686 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T04:05:52.686 INFO:teuthology.orchestra.run.smithi007.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T04:05:52.686 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T04:05:52.686 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T04:05:52.686 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T04:05:52.686 INFO:teuthology.orchestra.run.smithi007.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T04:05:52.686 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T04:05:52.686 INFO:teuthology.orchestra.run.smithi007.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T04:05:52.687 INFO:teuthology.orchestra.run.smithi007.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T04:05:52.687 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T04:05:52.687 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T04:05:52.687 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.687 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.687 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.687 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T04:05:52.687 INFO:teuthology.orchestra.run.smithi007.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T04:05:52.687 INFO:teuthology.orchestra.run.smithi007.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T04:05:52.687 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T04:05:52.688 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T04:05:52.688 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.688 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.688 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T04:05:52.688 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.688 INFO:teuthology.orchestra.run.smithi007.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T04:05:52.688 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T04:05:52.688 INFO:teuthology.orchestra.run.smithi007.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T04:05:52.688 INFO:teuthology.orchestra.run.smithi007.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T04:05:52.688 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T04:05:52.688 INFO:teuthology.orchestra.run.smithi007.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T04:05:52.688 INFO:teuthology.orchestra.run.smithi007.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T04:05:52.689 INFO:teuthology.orchestra.run.smithi007.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T04:05:52.689 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T04:05:52.689 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T04:05:52.689 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T04:05:52.689 INFO:teuthology.orchestra.run.smithi007.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T04:05:52.689 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T04:05:52.689 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T04:05:52.689 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T04:05:52.689 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T04:05:52.689 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T04:05:52.689 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T04:05:52.689 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T04:05:52.690 INFO:teuthology.orchestra.run.smithi007.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T04:05:52.690 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T04:05:52.690 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T04:05:52.690 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T04:05:52.690 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.690 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.690 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.690 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T04:05:52.690 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T04:05:52.690 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T04:05:52.690 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T04:05:52.690 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T04:05:52.690 INFO:teuthology.orchestra.run.smithi007.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T04:05:52.691 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T04:05:52.691 INFO:teuthology.orchestra.run.smithi007.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T04:05:52.691 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T04:05:52.691 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T04:05:52.691 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T04:05:52.691 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T04:05:52.691 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T04:05:52.691 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T04:05:52.691 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T04:05:52.691 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T04:05:52.691 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T04:05:52.691 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T04:05:52.691 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T04:05:52.692 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T04:05:52.692 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T04:05:52.692 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T04:05:52.692 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T04:05:52.692 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T04:05:52.692 INFO:teuthology.orchestra.run.smithi007.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T04:05:52.692 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T04:05:52.692 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T04:05:52.692 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T04:05:52.692 INFO:teuthology.orchestra.run.smithi007.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T04:05:52.692 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T04:05:52.692 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T04:05:52.693 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T04:05:52.693 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T04:05:52.693 INFO:teuthology.orchestra.run.smithi007.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T04:05:52.693 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T04:05:52.693 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T04:05:52.693 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T04:05:52.693 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T04:05:52.693 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T04:05:52.693 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T04:05:52.693 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.693 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.693 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T04:05:52.694 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T04:05:52.694 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T04:05:52.694 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.694 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T04:05:52.694 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T04:05:52.694 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T04:05:52.694 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T04:05:52.694 INFO:teuthology.orchestra.run.smithi007.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T04:05:52.694 INFO:teuthology.orchestra.run.smithi007.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T04:05:52.694 INFO:teuthology.orchestra.run.smithi007.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T04:05:52.694 INFO:teuthology.orchestra.run.smithi007.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T04:05:52.694 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T04:05:52.694 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T04:05:52.695 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T04:05:52.695 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T04:05:52.695 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T04:05:52.695 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T04:05:52.695 INFO:teuthology.orchestra.run.smithi007.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T04:05:52.695 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.695 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.695 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:05:52.695 INFO:teuthology.orchestra.run.smithi007.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T04:05:52.695 INFO:teuthology.orchestra.run.smithi007.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T04:05:52.695 INFO:teuthology.orchestra.run.smithi007.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T04:05:52.695 INFO:teuthology.orchestra.run.smithi007.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T04:05:52.695 INFO:teuthology.orchestra.run.smithi007.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T04:05:52.696 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T04:05:52.696 INFO:teuthology.orchestra.run.smithi007.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T04:05:52.696 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:05:52.696 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2024-09-19T04:05:53.234 DEBUG:teuthology.parallel:result is None 2024-09-19T04:05:53.235 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:05:53.391 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T04:05:53.416 INFO:teuthology.orchestra.run.smithi007.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T04:05:53.417 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T04:05:53.417 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T04:05:53.419 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:05:53.562 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T04:05:53.588 INFO:teuthology.orchestra.run.smithi092.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T04:05:53.588 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T04:05:53.588 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T04:05:53.590 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:05:53.734 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T04:05:53.760 INFO:teuthology.orchestra.run.smithi102.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T04:05:53.760 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T04:05:53.760 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T04:05:53.761 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T04:05:53.762 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T04:05:53.762 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T04:05:53.795 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-19T04:05:53.795 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T04:05:53.827 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T04:05:53.827 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T04:05:53.857 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T04:05:53.857 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T04:05:53.857 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T04:05:53.888 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T04:05:53.959 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-19T04:05:53.959 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T04:05:53.986 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T04:05:54.053 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T04:05:54.054 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T04:05:54.082 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T04:05:54.150 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T04:05:54.151 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T04:05:54.151 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T04:05:54.182 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T04:05:54.252 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-19T04:05:54.252 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T04:05:54.280 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T04:05:54.347 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T04:05:54.347 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T04:05:54.373 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T04:05:54.438 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T04:05:54.438 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T04:05:54.438 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T04:05:54.469 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T04:05:54.540 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-19T04:05:54.540 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T04:05:54.567 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T04:05:54.633 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T04:05:54.633 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T04:05:54.658 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T04:05:54.723 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T04:05:54.816 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-19T04:05:54.817 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:05:54.817 INFO:tasks.cephadm:Cluster fsid is 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:05:54.817 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T04:05:54.817 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.7', 'mon.b': '172.21.15.92', 'mon.c': '172.21.15.102'} 2024-09-19T04:05:54.818 INFO:tasks.cephadm:First mon is mon.a on smithi007 2024-09-19T04:05:54.818 INFO:tasks.cephadm:First mgr is x 2024-09-19T04:05:54.818 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T04:05:54.818 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname $(hostname -s) 2024-09-19T04:05:54.849 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname $(hostname -s) 2024-09-19T04:05:54.875 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname $(hostname -s) 2024-09-19T04:05:54.899 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-19T04:05:54.900 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:05:55.043 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56106/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-361-g2f599a46', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-361.g2f599a46'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-18 17:52:24.287651', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-19T04:05:55.180 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 2f599a46ad10e37c929e5c43da2f6907ddcd1961 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:05:55.181 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T04:05:55.181 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T04:05:55.181 DEBUG:teuthology.orchestra.run.smithi007:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T04:05:55.570 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 04:05 /home/ubuntu/cephtest/cephadm 2024-09-19T04:05:55.571 DEBUG:teuthology.orchestra.run.smithi092:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T04:05:55.948 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 04:05 /home/ubuntu/cephtest/cephadm 2024-09-19T04:05:55.949 DEBUG:teuthology.orchestra.run.smithi102:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T04:05:56.312 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 04:05 /home/ubuntu/cephtest/cephadm 2024-09-19T04:05:56.312 DEBUG:teuthology.orchestra.run.smithi007:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T04:05:56.333 DEBUG:teuthology.orchestra.run.smithi092:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T04:05:56.351 DEBUG:teuthology.orchestra.run.smithi102:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T04:05:56.386 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 on all hosts... 2024-09-19T04:05:56.386 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T04:05:56.389 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T04:05:56.394 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T04:05:57.963 INFO:teuthology.orchestra.run.smithi102.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T04:05:57.967 INFO:teuthology.orchestra.run.smithi092.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T04:05:58.050 INFO:teuthology.orchestra.run.smithi007.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T04:06:29.958 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:06:29.958 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T04:06:29.958 INFO:teuthology.orchestra.run.smithi007.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T04:06:29.958 INFO:teuthology.orchestra.run.smithi007.stdout: "repo_digests": [ 2024-09-19T04:06:29.958 INFO:teuthology.orchestra.run.smithi007.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T04:06:29.958 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-19T04:06:29.959 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:06:31.879 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T04:06:31.879 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T04:06:31.879 INFO:teuthology.orchestra.run.smithi092.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T04:06:31.879 INFO:teuthology.orchestra.run.smithi092.stdout: "repo_digests": [ 2024-09-19T04:06:31.879 INFO:teuthology.orchestra.run.smithi092.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T04:06:31.879 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-09-19T04:06:31.879 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T04:06:49.139 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-19T04:06:49.139 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T04:06:49.139 INFO:teuthology.orchestra.run.smithi102.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T04:06:49.139 INFO:teuthology.orchestra.run.smithi102.stdout: "repo_digests": [ 2024-09-19T04:06:49.139 INFO:teuthology.orchestra.run.smithi102.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T04:06:49.139 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-19T04:06:49.140 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-19T04:06:49.163 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /etc/ceph 2024-09-19T04:06:49.199 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /etc/ceph 2024-09-19T04:06:49.232 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph 2024-09-19T04:06:49.259 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 777 /etc/ceph 2024-09-19T04:06:49.289 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 777 /etc/ceph 2024-09-19T04:06:49.319 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 777 /etc/ceph 2024-09-19T04:06:49.344 INFO:tasks.cephadm:Writing seed config... 2024-09-19T04:06:49.345 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T04:06:49.345 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T04:06:49.345 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T04:06:49.345 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T04:06:49.345 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T04:06:49.345 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-19T04:06:49.345 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T04:06:49.346 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T04:06:49.346 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T04:06:49.346 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-19T04:06:49.346 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-19T04:06:49.346 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-19T04:06:49.346 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-19T04:06:49.346 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T04:06:49.346 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T04:06:49.346 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T04:06:49.346 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T04:06:49.346 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-19T04:06:49.346 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T04:06:49.346 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T04:06:49.347 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T04:06:49.347 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-19T04:06:49.347 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T04:06:49.347 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T04:06:49.347 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T04:06:49.347 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T04:06:49.347 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T04:06:49.347 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T04:06:49.347 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T04:06:49.347 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T04:06:49.347 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T04:06:49.347 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T04:06:49.347 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-19T04:06:49.348 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T04:06:49.348 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-19T04:06:49.348 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-19T04:06:49.348 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T04:06:49.348 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T04:06:49.348 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-19T04:06:49.348 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T04:06:49.348 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T04:06:49.348 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T04:06:49.348 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T04:06:49.348 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T04:06:49.348 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T04:06:49.349 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-19T04:06:49.349 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-19T04:06:49.349 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T04:06:49.349 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T04:06:49.368 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 77957c0a-763c-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T04:06:49.368 DEBUG:teuthology.orchestra.run.smithi007:mon.a> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mon.a.service 2024-09-19T04:06:49.411 DEBUG:teuthology.orchestra.run.smithi007:mgr.x> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mgr.x.service 2024-09-19T04:06:49.454 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T04:06:49.454 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 -v bootstrap --fsid 77957c0a-763c-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.7 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T04:06:49.669 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2024-09-19T04:06:49.669 INFO:teuthology.orchestra.run.smithi007.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961', '-v', 'bootstrap', '--fsid', '77957c0a-763c-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.7', '--skip-admin-label'] 2024-09-19T04:06:49.669 INFO:teuthology.orchestra.run.smithi007.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T04:06:49.669 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying podman|docker is present... 2024-09-19T04:06:49.693 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stdout 5.2.2 2024-09-19T04:06:49.693 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying lvm2 is present... 2024-09-19T04:06:49.694 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying time synchronization is in place... 2024-09-19T04:06:49.701 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T04:06:49.702 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T04:06:49.708 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T04:06:49.708 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-19T04:06:49.715 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout enabled 2024-09-19T04:06:49.722 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout active 2024-09-19T04:06:49.722 INFO:teuthology.orchestra.run.smithi007.stdout:Unit chronyd.service is enabled and running 2024-09-19T04:06:49.722 INFO:teuthology.orchestra.run.smithi007.stdout:Repeating the final host check... 2024-09-19T04:06:49.745 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stdout 5.2.2 2024-09-19T04:06:49.745 INFO:teuthology.orchestra.run.smithi007.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T04:06:49.745 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl is present 2024-09-19T04:06:49.745 INFO:teuthology.orchestra.run.smithi007.stdout:lvcreate is present 2024-09-19T04:06:49.752 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T04:06:49.752 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T04:06:49.758 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T04:06:49.758 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-19T04:06:49.765 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout enabled 2024-09-19T04:06:49.772 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout active 2024-09-19T04:06:49.772 INFO:teuthology.orchestra.run.smithi007.stdout:Unit chronyd.service is enabled and running 2024-09-19T04:06:49.772 INFO:teuthology.orchestra.run.smithi007.stdout:Host looks OK 2024-09-19T04:06:49.772 INFO:teuthology.orchestra.run.smithi007.stdout:Cluster fsid: 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:06:49.772 INFO:teuthology.orchestra.run.smithi007.stdout:Acquiring lock 139645941871616 on /run/cephadm/77957c0a-763c-11ef-bceb-c7b262605968.lock 2024-09-19T04:06:49.772 INFO:teuthology.orchestra.run.smithi007.stdout:Lock 139645941871616 acquired on /run/cephadm/77957c0a-763c-11ef-bceb-c7b262605968.lock 2024-09-19T04:06:49.773 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying IP 172.21.15.7 port 3300 ... 2024-09-19T04:06:49.773 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying IP 172.21.15.7 port 6789 ... 2024-09-19T04:06:49.773 INFO:teuthology.orchestra.run.smithi007.stdout:Base mon IP(s) is [172.21.15.7:3300, 172.21.15.7:6789], mon addrv is [v2:172.21.15.7:3300,v1:172.21.15.7:6789] 2024-09-19T04:06:49.776 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.7 metric 100 2024-09-19T04:06:49.776 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.7 metric 100 2024-09-19T04:06:49.779 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T04:06:49.779 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-19T04:06:49.779 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1794sec hoplimit 64 pref medium 2024-09-19T04:06:49.782 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T04:06:49.782 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T04:06:49.782 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T04:06:49.782 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-19T04:06:49.782 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-09-19T04:06:49.782 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T04:06:49.783 INFO:teuthology.orchestra.run.smithi007.stdout:Mon IP `172.21.15.7` is in CIDR network `172.21.0.0/20` 2024-09-19T04:06:49.783 INFO:teuthology.orchestra.run.smithi007.stdout:Mon IP `172.21.15.7` is in CIDR network `172.21.0.0/20` 2024-09-19T04:06:49.783 INFO:teuthology.orchestra.run.smithi007.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T04:06:49.784 INFO:teuthology.orchestra.run.smithi007.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T04:06:49.784 INFO:teuthology.orchestra.run.smithi007.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T04:06:50.245 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stdout d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T04:06:50.245 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T04:06:50.245 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T04:06:50.245 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Copying blob sha256:c4221751d16d26d2a4b7031ebd71ecffffff13c8cf7401cf95ce80dab3b6d67a 2024-09-19T04:06:50.246 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T04:06:50.246 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Copying config sha256:d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T04:06:50.246 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T04:06:51.091 INFO:teuthology.orchestra.run.smithi007.stdout:ceph: stdout ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T04:06:51.092 INFO:teuthology.orchestra.run.smithi007.stdout:Ceph version: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T04:06:51.092 INFO:teuthology.orchestra.run.smithi007.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T04:06:52.032 INFO:teuthology.orchestra.run.smithi007.stdout:stat: stdout 167 167 2024-09-19T04:06:52.032 INFO:teuthology.orchestra.run.smithi007.stdout:Creating initial keys... 2024-09-19T04:06:52.979 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-authtool: stdout AQBco+tmEvhHFxAAMkQNxPQl82zv7QeXfkqh0w== 2024-09-19T04:06:53.793 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-authtool: stdout AQBdo+tmLpucERAA06dCavH5xohkga2kRaAm4A== 2024-09-19T04:06:54.682 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-authtool: stdout AQBeo+tmmaARBxAA9Qt0QglKAlFsEOYqE1VTeA== 2024-09-19T04:06:54.683 INFO:teuthology.orchestra.run.smithi007.stdout:Creating initial monmap... 2024-09-19T04:06:55.554 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T04:06:55.555 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-19T04:06:55.555 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:06:55.555 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T04:06:55.555 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool for a [v2:172.21.15.7:3300,v1:172.21.15.7:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T04:06:55.555 INFO:teuthology.orchestra.run.smithi007.stdout:setting min_mon_release = quincy 2024-09-19T04:06:55.555 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: set fsid to 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:06:55.555 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T04:06:55.555 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:06:55.555 INFO:teuthology.orchestra.run.smithi007.stdout:Creating mon... 2024-09-19T04:06:56.894 INFO:teuthology.orchestra.run.smithi007.stdout:create mon.a on 2024-09-19T04:06:57.112 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T04:06:57.262 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T04:06:57.434 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-77957c0a-763c-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-77957c0a-763c-11ef-bceb-c7b262605968.target. 2024-09-19T04:06:57.434 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-77957c0a-763c-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-77957c0a-763c-11ef-bceb-c7b262605968.target. 2024-09-19T04:06:57.669 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-77957c0a-763c-11ef-bceb-c7b262605968@mon.a 2024-09-19T04:06:57.669 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to reset failed state of unit ceph-77957c0a-763c-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-77957c0a-763c-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-19T04:06:57.844 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-77957c0a-763c-11ef-bceb-c7b262605968.target.wants/ceph-77957c0a-763c-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-77957c0a-763c-11ef-bceb-c7b262605968@.service. 2024-09-19T04:06:58.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:06:58 smithi007 podman[30963]: 2024-09-19 04:06:58.299515316 +0000 UTC m=+0.324970745 container start fd467922b19bf1a13f60a463fc094b591f87344fce642b7ebbb0a28dc2d487df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-a, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T04:06:58.374 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T04:06:58.374 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout disabled 2024-09-19T04:06:58.382 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T04:06:58.382 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-19T04:06:58.382 INFO:teuthology.orchestra.run.smithi007.stdout:firewalld.service is not enabled 2024-09-19T04:06:58.382 INFO:teuthology.orchestra.run.smithi007.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T04:06:58.384 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mon to start... 2024-09-19T04:06:58.384 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mon... 2024-09-19T04:06:58.596 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:06:58 smithi007 ceph-mon[30983]: mkfs 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:06:58.596 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:06:58 smithi007 ceph-mon[30983]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T04:06:58.596 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:06:58 smithi007 bash[30963]: fd467922b19bf1a13f60a463fc094b591f87344fce642b7ebbb0a28dc2d487df 2024-09-19T04:06:58.596 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:06:58 smithi007 systemd[1]: Started Ceph mon.a for 77957c0a-763c-11ef-bceb-c7b262605968. 2024-09-19T04:06:59.462 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:06:59 smithi007 ceph-mon[30983]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T04:06:59.462 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:06:59 smithi007 ceph-mon[30983]: monmap epoch 1 2024-09-19T04:06:59.462 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:06:59 smithi007 ceph-mon[30983]: fsid 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:06:59.463 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:06:59 smithi007 ceph-mon[30983]: last_changed 2024-09-19T04:06:54.996586+0000 2024-09-19T04:06:59.463 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:06:59 smithi007 ceph-mon[30983]: created 2024-09-19T04:06:54.996586+0000 2024-09-19T04:06:59.463 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:06:59 smithi007 ceph-mon[30983]: min_mon_release 19 (squid) 2024-09-19T04:06:59.463 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:06:59 smithi007 ceph-mon[30983]: election_strategy: 1 2024-09-19T04:06:59.463 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:06:59 smithi007 ceph-mon[30983]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-19T04:06:59.463 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:06:59 smithi007 ceph-mon[30983]: fsmap 2024-09-19T04:06:59.463 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:06:59 smithi007 ceph-mon[30983]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T04:06:59.463 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:06:59 smithi007 ceph-mon[30983]: mgrmap e1: no daemons active 2024-09-19T04:06:59.463 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:06:59 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/4163738874' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-19T04:06:59.470 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T04:06:59.470 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout id: 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:06:59.470 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T04:06:59.470 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-19T04:06:59.470 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout services: 2024-09-19T04:06:59.470 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.517573s) 2024-09-19T04:06:59.470 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T04:06:59.470 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T04:06:59.471 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-19T04:06:59.471 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout data: 2024-09-19T04:06:59.471 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T04:06:59.471 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T04:06:59.471 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T04:06:59.471 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T04:06:59.471 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-19T04:06:59.471 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.779+0000 7f0404e41640 1 Processor -- start 2024-09-19T04:06:59.471 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.779+0000 7f0404e41640 1 -- start start 2024-09-19T04:06:59.471 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.779+0000 7f0404e41640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0400106520 0x7f0400106920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:06:59.471 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.779+0000 7f0404e41640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0400106ef0 con 0x7f0400106520 2024-09-19T04:06:59.472 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.780+0000 7f03fe59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0400106520 0x7f0400106920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:06:59.472 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.780+0000 7f03fe59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0400106520 0x7f0400106920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56414/0 (socket says 172.21.15.7:56414) 2024-09-19T04:06:59.472 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.780+0000 7f03fe59c640 1 -- 172.21.15.7:0/1799788107 learned_addr learned my addr 172.21.15.7:0/1799788107 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:06:59.472 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.780+0000 7f03fe59c640 1 -- 172.21.15.7:0/1799788107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0400107720 con 0x7f0400106520 2024-09-19T04:06:59.472 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.782+0000 7f03fe59c640 1 --2- 172.21.15.7:0/1799788107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0400106520 0x7f0400106920 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f03f0009820 tx=0x7f03f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9982aef9bf52eb46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:06:59.472 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.782+0000 7f03fd59a640 1 -- 172.21.15.7:0/1799788107 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03f0037070 con 0x7f0400106520 2024-09-19T04:06:59.472 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.782+0000 7f03fd59a640 1 -- 172.21.15.7:0/1799788107 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03f0032440 con 0x7f0400106520 2024-09-19T04:06:59.472 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.782+0000 7f03fd59a640 1 -- 172.21.15.7:0/1799788107 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03f0032740 con 0x7f0400106520 2024-09-19T04:06:59.472 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.783+0000 7f0404e41640 1 -- 172.21.15.7:0/1799788107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0400106520 msgr2=0x7f0400106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:06:59.472 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.783+0000 7f0404e41640 1 --2- 172.21.15.7:0/1799788107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0400106520 0x7f0400106920 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f03f0009820 tx=0x7f03f002a270 comp rx=0 tx=0).stop 2024-09-19T04:06:59.473 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.783+0000 7f0404e41640 1 -- 172.21.15.7:0/1799788107 shutdown_connections 2024-09-19T04:06:59.473 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.783+0000 7f0404e41640 1 --2- 172.21.15.7:0/1799788107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0400106520 0x7f0400106920 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:06:59.473 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.783+0000 7f0404e41640 1 -- 172.21.15.7:0/1799788107 >> 172.21.15.7:0/1799788107 conn(0x7f0400101db0 msgr2=0x7f04001041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:06:59.473 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.783+0000 7f0404e41640 1 -- 172.21.15.7:0/1799788107 shutdown_connections 2024-09-19T04:06:59.473 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.783+0000 7f0404e41640 1 -- 172.21.15.7:0/1799788107 wait complete. 2024-09-19T04:06:59.473 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.784+0000 7f0404e41640 1 Processor -- start 2024-09-19T04:06:59.473 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.784+0000 7f0404e41640 1 -- start start 2024-09-19T04:06:59.473 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.784+0000 7f0404e41640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0400106520 0x7f040007ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:06:59.473 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.784+0000 7f0404e41640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0400107cc0 con 0x7f0400106520 2024-09-19T04:06:59.473 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.784+0000 7f03fe59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0400106520 0x7f040007ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:06:59.473 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.784+0000 7f03fe59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0400106520 0x7f040007ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56416/0 (socket says 172.21.15.7:56416) 2024-09-19T04:06:59.473 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.784+0000 7f03fe59c640 1 -- 172.21.15.7:0/4163738874 learned_addr learned my addr 172.21.15.7:0/4163738874 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:06:59.473 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.785+0000 7f03fe59c640 1 -- 172.21.15.7:0/4163738874 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f040019dac0 con 0x7f0400106520 2024-09-19T04:06:59.474 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.785+0000 7f03fe59c640 1 --2- 172.21.15.7:0/4163738874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0400106520 0x7f040007ba50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f03f0009820 tx=0x7f03f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:06:59.474 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.785+0000 7f03ef7fe640 1 -- 172.21.15.7:0/4163738874 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03f0041070 con 0x7f0400106520 2024-09-19T04:06:59.474 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.785+0000 7f03ef7fe640 1 -- 172.21.15.7:0/4163738874 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03f003c7a0 con 0x7f0400106520 2024-09-19T04:06:59.474 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.785+0000 7f03ef7fe640 1 -- 172.21.15.7:0/4163738874 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03f0037040 con 0x7f0400106520 2024-09-19T04:06:59.474 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.785+0000 7f0404e41640 1 -- 172.21.15.7:0/4163738874 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f040019dc90 con 0x7f0400106520 2024-09-19T04:06:59.474 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.785+0000 7f0404e41640 1 -- 172.21.15.7:0/4163738874 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f040019e030 con 0x7f0400106520 2024-09-19T04:06:59.474 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.785+0000 7f03ef7fe640 1 -- 172.21.15.7:0/4163738874 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f03f0044070 con 0x7f0400106520 2024-09-19T04:06:59.474 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.785+0000 7f03ef7fe640 1 -- 172.21.15.7:0/4163738874 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f03f0046dd0 con 0x7f0400106520 2024-09-19T04:06:59.474 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.786+0000 7f0404e41640 1 -- 172.21.15.7:0/4163738874 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0400108310 con 0x7f0400106520 2024-09-19T04:06:59.474 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.790+0000 7f03ef7fe640 1 -- 172.21.15.7:0/4163738874 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f03f0046450 con 0x7f0400106520 2024-09-19T04:06:59.474 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.853+0000 7f0404e41640 1 -- 172.21.15.7:0/4163738874 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f040019e3d0 con 0x7f0400106520 2024-09-19T04:06:59.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.853+0000 7f03ef7fe640 1 -- 172.21.15.7:0/4163738874 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f03f0046630 con 0x7f0400106520 2024-09-19T04:06:59.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.854+0000 7f0404e41640 1 -- 172.21.15.7:0/4163738874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0400106520 msgr2=0x7f040007ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:06:59.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.854+0000 7f0404e41640 1 --2- 172.21.15.7:0/4163738874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0400106520 0x7f040007ba50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f03f0009820 tx=0x7f03f00046c0 comp rx=0 tx=0).stop 2024-09-19T04:06:59.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.854+0000 7f0404e41640 1 -- 172.21.15.7:0/4163738874 shutdown_connections 2024-09-19T04:06:59.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.854+0000 7f0404e41640 1 --2- 172.21.15.7:0/4163738874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0400106520 0x7f040007ba50 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:06:59.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.854+0000 7f0404e41640 1 -- 172.21.15.7:0/4163738874 >> 172.21.15.7:0/4163738874 conn(0x7f0400101db0 msgr2=0x7f040018df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:06:59.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.854+0000 7f0404e41640 1 -- 172.21.15.7:0/4163738874 shutdown_connections 2024-09-19T04:06:59.475 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:58.854+0000 7f0404e41640 1 -- 172.21.15.7:0/4163738874 wait complete. 2024-09-19T04:06:59.475 INFO:teuthology.orchestra.run.smithi007.stdout:mon is available 2024-09-19T04:06:59.475 INFO:teuthology.orchestra.run.smithi007.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T04:07:00.494 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-19T04:07:00.494 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T04:07:00.495 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout fsid = 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:07:00.495 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.7:3300,v1:172.21.15.7:6789] 2024-09-19T04:07:00.495 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T04:07:00.495 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T04:07:00.495 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T04:07:00.495 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T04:07:00.495 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-19T04:07:00.495 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T04:07:00.495 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T04:07:00.495 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-19T04:07:00.495 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T04:07:00.495 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T04:07:00.496 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T04:07:00.496 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T04:07:00.496 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T04:07:00.496 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T04:07:00.496 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.876+0000 7fa7c8f61640 1 Processor -- start 2024-09-19T04:07:00.496 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.876+0000 7fa7c8f61640 1 -- start start 2024-09-19T04:07:00.496 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.876+0000 7fa7c8f61640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7c41081c0 0x7fa7c410a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:00.496 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.876+0000 7fa7c8f61640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c407bdf0 con 0x7fa7c41081c0 2024-09-19T04:07:00.496 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.876+0000 7fa7c259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7c41081c0 0x7fa7c410a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:00.496 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.876+0000 7fa7c259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7c41081c0 0x7fa7c410a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56422/0 (socket says 172.21.15.7:56422) 2024-09-19T04:07:00.496 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.876+0000 7fa7c259c640 1 -- 172.21.15.7:0/1865671651 learned_addr learned my addr 172.21.15.7:0/1865671651 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:00.496 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.877+0000 7fa7c259c640 1 -- 172.21.15.7:0/1865671651 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c410aaf0 con 0x7fa7c41081c0 2024-09-19T04:07:00.496 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.877+0000 7fa7c259c640 1 --2- 172.21.15.7:0/1865671651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7c41081c0 0x7fa7c410a5b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4009820 tx=0x7fa7b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec32bab1bc369039 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:00.497 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.878+0000 7fa7c159a640 1 -- 172.21.15.7:0/1865671651 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7b4037070 con 0x7fa7c41081c0 2024-09-19T04:07:00.497 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.878+0000 7fa7c159a640 1 -- 172.21.15.7:0/1865671651 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7b4032440 con 0x7fa7c41081c0 2024-09-19T04:07:00.497 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.878+0000 7fa7c159a640 1 -- 172.21.15.7:0/1865671651 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7b4032740 con 0x7fa7c41081c0 2024-09-19T04:07:00.497 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.878+0000 7fa7c8f61640 1 -- 172.21.15.7:0/1865671651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7c41081c0 msgr2=0x7fa7c410a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:00.497 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.878+0000 7fa7c8f61640 1 --2- 172.21.15.7:0/1865671651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7c41081c0 0x7fa7c410a5b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4009820 tx=0x7fa7b402a270 comp rx=0 tx=0).stop 2024-09-19T04:07:00.497 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.878+0000 7fa7c8f61640 1 -- 172.21.15.7:0/1865671651 shutdown_connections 2024-09-19T04:07:00.497 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.878+0000 7fa7c8f61640 1 --2- 172.21.15.7:0/1865671651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7c41081c0 0x7fa7c410a5b0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:00.497 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.878+0000 7fa7c8f61640 1 -- 172.21.15.7:0/1865671651 >> 172.21.15.7:0/1865671651 conn(0x7fa7c4101de0 msgr2=0x7fa7c4104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:00.497 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.878+0000 7fa7c8f61640 1 -- 172.21.15.7:0/1865671651 shutdown_connections 2024-09-19T04:07:00.497 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.878+0000 7fa7c8f61640 1 -- 172.21.15.7:0/1865671651 wait complete. 2024-09-19T04:07:00.498 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.879+0000 7fa7c8f61640 1 Processor -- start 2024-09-19T04:07:00.498 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.879+0000 7fa7c8f61640 1 -- start start 2024-09-19T04:07:00.498 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.879+0000 7fa7c8f61640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7c41081c0 0x7fa7c419adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:00.498 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.879+0000 7fa7c8f61640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c410af00 con 0x7fa7c41081c0 2024-09-19T04:07:00.498 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.879+0000 7fa7c259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7c41081c0 0x7fa7c419adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:00.498 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.879+0000 7fa7c259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7c41081c0 0x7fa7c419adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56438/0 (socket says 172.21.15.7:56438) 2024-09-19T04:07:00.498 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.879+0000 7fa7c259c640 1 -- 172.21.15.7:0/2630382493 learned_addr learned my addr 172.21.15.7:0/2630382493 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:00.498 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.880+0000 7fa7c259c640 1 -- 172.21.15.7:0/2630382493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c419b330 con 0x7fa7c41081c0 2024-09-19T04:07:00.498 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.880+0000 7fa7c259c640 1 --2- 172.21.15.7:0/2630382493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7c41081c0 0x7fa7c419adf0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fa7b40090b0 tx=0x7fa7b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:00.498 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.880+0000 7fa7b37fe640 1 -- 172.21.15.7:0/2630382493 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7b4041070 con 0x7fa7c41081c0 2024-09-19T04:07:00.498 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.880+0000 7fa7b37fe640 1 -- 172.21.15.7:0/2630382493 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7b403c7a0 con 0x7fa7c41081c0 2024-09-19T04:07:00.498 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.880+0000 7fa7b37fe640 1 -- 172.21.15.7:0/2630382493 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7b4037040 con 0x7fa7c41081c0 2024-09-19T04:07:00.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.880+0000 7fa7c8f61640 1 -- 172.21.15.7:0/2630382493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7c419b5c0 con 0x7fa7c41081c0 2024-09-19T04:07:00.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.880+0000 7fa7c8f61640 1 -- 172.21.15.7:0/2630382493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7c419e2b0 con 0x7fa7c41081c0 2024-09-19T04:07:00.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.880+0000 7fa7b37fe640 1 -- 172.21.15.7:0/2630382493 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa7b4044070 con 0x7fa7c41081c0 2024-09-19T04:07:00.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.880+0000 7fa7b37fe640 1 -- 172.21.15.7:0/2630382493 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa7b403d3f0 con 0x7fa7c41081c0 2024-09-19T04:07:00.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.881+0000 7fa7c8f61640 1 -- 172.21.15.7:0/2630382493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7c4108620 con 0x7fa7c41081c0 2024-09-19T04:07:00.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.883+0000 7fa7b37fe640 1 -- 172.21.15.7:0/2630382493 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa7b4046450 con 0x7fa7c41081c0 2024-09-19T04:07:00.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.943+0000 7fa7c8f61640 1 -- 172.21.15.7:0/2630382493 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fa7c402d910 con 0x7fa7c41081c0 2024-09-19T04:07:00.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.946+0000 7fa7b37fe640 1 -- 172.21.15.7:0/2630382493 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+427 (secure 0 0 0) 0x7fa7b4046630 con 0x7fa7c41081c0 2024-09-19T04:07:00.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.946+0000 7fa7b37fe640 1 -- 172.21.15.7:0/2630382493 <== mon.0 v2:172.21.15.7:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa7b40584b0 con 0x7fa7c41081c0 2024-09-19T04:07:00.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.947+0000 7fa7c8f61640 1 -- 172.21.15.7:0/2630382493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7c41081c0 msgr2=0x7fa7c419adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:00.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.947+0000 7fa7c8f61640 1 --2- 172.21.15.7:0/2630382493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7c41081c0 0x7fa7c419adf0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fa7b40090b0 tx=0x7fa7b40046c0 comp rx=0 tx=0).stop 2024-09-19T04:07:00.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.947+0000 7fa7c8f61640 1 -- 172.21.15.7:0/2630382493 shutdown_connections 2024-09-19T04:07:00.499 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.947+0000 7fa7c8f61640 1 --2- 172.21.15.7:0/2630382493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7c41081c0 0x7fa7c419adf0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:00.500 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.947+0000 7fa7c8f61640 1 -- 172.21.15.7:0/2630382493 >> 172.21.15.7:0/2630382493 conn(0x7fa7c4101de0 msgr2=0x7fa7c4102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:00.500 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.947+0000 7fa7c8f61640 1 -- 172.21.15.7:0/2630382493 shutdown_connections 2024-09-19T04:07:00.500 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:06:59.947+0000 7fa7c8f61640 1 -- 172.21.15.7:0/2630382493 wait complete. 2024-09-19T04:07:00.500 INFO:teuthology.orchestra.run.smithi007.stdout:Generating new minimal ceph.conf... 2024-09-19T04:07:00.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:00 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2630382493' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T04:07:00.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:00 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2630382493' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-19T04:07:01.541 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:01 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3459201015' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:07:01.548 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.896+0000 7f4b3afbf640 1 Processor -- start 2024-09-19T04:07:01.548 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.896+0000 7f4b3afbf640 1 -- start start 2024-09-19T04:07:01.548 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.897+0000 7f4b3afbf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b341080f0 0x7f4b3410a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:01.548 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.897+0000 7f4b3afbf640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3407be50 con 0x7f4b341080f0 2024-09-19T04:07:01.548 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.897+0000 7f4b38d5b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b341080f0 0x7f4b3410a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:01.548 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.897+0000 7f4b38d5b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b341080f0 0x7f4b3410a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56440/0 (socket says 172.21.15.7:56440) 2024-09-19T04:07:01.548 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.897+0000 7f4b38d5b640 1 -- 172.21.15.7:0/447419091 learned_addr learned my addr 172.21.15.7:0/447419091 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:01.549 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.897+0000 7f4b38d5b640 1 -- 172.21.15.7:0/447419091 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b3410aa20 con 0x7f4b341080f0 2024-09-19T04:07:01.549 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.898+0000 7f4b38d5b640 1 --2- 172.21.15.7:0/447419091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b341080f0 0x7f4b3410a4e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4b30009820 tx=0x7f4b3002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729bdea0e3fc7b58 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:01.549 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.898+0000 7f4b2b7fe640 1 -- 172.21.15.7:0/447419091 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b30037070 con 0x7f4b341080f0 2024-09-19T04:07:01.549 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.898+0000 7f4b2b7fe640 1 -- 172.21.15.7:0/447419091 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4b30032900 con 0x7f4b341080f0 2024-09-19T04:07:01.549 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.898+0000 7f4b2b7fe640 1 -- 172.21.15.7:0/447419091 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b30030850 con 0x7f4b341080f0 2024-09-19T04:07:01.549 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.899+0000 7f4b3afbf640 1 -- 172.21.15.7:0/447419091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b341080f0 msgr2=0x7f4b3410a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:01.549 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.899+0000 7f4b3afbf640 1 --2- 172.21.15.7:0/447419091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b341080f0 0x7f4b3410a4e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4b30009820 tx=0x7f4b3002a270 comp rx=0 tx=0).stop 2024-09-19T04:07:01.549 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.899+0000 7f4b3afbf640 1 -- 172.21.15.7:0/447419091 shutdown_connections 2024-09-19T04:07:01.550 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.899+0000 7f4b3afbf640 1 --2- 172.21.15.7:0/447419091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b341080f0 0x7f4b3410a4e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:01.550 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.899+0000 7f4b3afbf640 1 -- 172.21.15.7:0/447419091 >> 172.21.15.7:0/447419091 conn(0x7f4b34101db0 msgr2=0x7f4b341041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:01.550 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.899+0000 7f4b3afbf640 1 -- 172.21.15.7:0/447419091 shutdown_connections 2024-09-19T04:07:01.550 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.899+0000 7f4b3afbf640 1 -- 172.21.15.7:0/447419091 wait complete. 2024-09-19T04:07:01.550 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.900+0000 7f4b3afbf640 1 Processor -- start 2024-09-19T04:07:01.550 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.900+0000 7f4b3afbf640 1 -- start start 2024-09-19T04:07:01.550 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.900+0000 7f4b3afbf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b341080f0 0x7f4b34107970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:01.550 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.900+0000 7f4b3afbf640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3410ba60 con 0x7f4b341080f0 2024-09-19T04:07:01.550 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.900+0000 7f4b38d5b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b341080f0 0x7f4b34107970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:01.550 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.900+0000 7f4b38d5b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b341080f0 0x7f4b34107970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56448/0 (socket says 172.21.15.7:56448) 2024-09-19T04:07:01.550 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.900+0000 7f4b38d5b640 1 -- 172.21.15.7:0/3459201015 learned_addr learned my addr 172.21.15.7:0/3459201015 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:01.550 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.900+0000 7f4b38d5b640 1 -- 172.21.15.7:0/3459201015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b34107eb0 con 0x7f4b341080f0 2024-09-19T04:07:01.551 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.901+0000 7f4b38d5b640 1 --2- 172.21.15.7:0/3459201015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b341080f0 0x7f4b34107970 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4b300097f0 tx=0x7f4b30030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:01.551 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.901+0000 7f4b29ffb640 1 -- 172.21.15.7:0/3459201015 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b30037040 con 0x7f4b341080f0 2024-09-19T04:07:01.551 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.901+0000 7f4b29ffb640 1 -- 172.21.15.7:0/3459201015 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4b30040070 con 0x7f4b341080f0 2024-09-19T04:07:01.551 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.901+0000 7f4b3afbf640 1 -- 172.21.15.7:0/3459201015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b341060a0 con 0x7f4b341080f0 2024-09-19T04:07:01.551 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.901+0000 7f4b29ffb640 1 -- 172.21.15.7:0/3459201015 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b3003a390 con 0x7f4b341080f0 2024-09-19T04:07:01.551 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.901+0000 7f4b3afbf640 1 -- 172.21.15.7:0/3459201015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b34106580 con 0x7f4b341080f0 2024-09-19T04:07:01.551 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.901+0000 7f4b29ffb640 1 -- 172.21.15.7:0/3459201015 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4b3003a630 con 0x7f4b341080f0 2024-09-19T04:07:01.551 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.901+0000 7f4b29ffb640 1 -- 172.21.15.7:0/3459201015 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4b300459a0 con 0x7f4b341080f0 2024-09-19T04:07:01.551 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.902+0000 7f4b3afbf640 1 -- 172.21.15.7:0/3459201015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b34108550 con 0x7f4b341080f0 2024-09-19T04:07:01.551 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.904+0000 7f4b29ffb640 1 -- 172.21.15.7:0/3459201015 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4b30045460 con 0x7f4b341080f0 2024-09-19T04:07:01.551 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.965+0000 7f4b3afbf640 1 -- 172.21.15.7:0/3459201015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f4b341068c0 con 0x7f4b341080f0 2024-09-19T04:07:01.551 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.965+0000 7f4b29ffb640 1 -- 172.21.15.7:0/3459201015 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+173 (secure 0 0 0) 0x7f4b3003b430 con 0x7f4b341080f0 2024-09-19T04:07:01.552 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.966+0000 7f4b3afbf640 1 -- 172.21.15.7:0/3459201015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b341080f0 msgr2=0x7f4b34107970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:01.552 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.966+0000 7f4b3afbf640 1 --2- 172.21.15.7:0/3459201015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b341080f0 0x7f4b34107970 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4b300097f0 tx=0x7f4b30030d80 comp rx=0 tx=0).stop 2024-09-19T04:07:01.552 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.966+0000 7f4b3afbf640 1 -- 172.21.15.7:0/3459201015 shutdown_connections 2024-09-19T04:07:01.552 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.966+0000 7f4b3afbf640 1 --2- 172.21.15.7:0/3459201015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b341080f0 0x7f4b34107970 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:01.552 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.966+0000 7f4b3afbf640 1 -- 172.21.15.7:0/3459201015 >> 172.21.15.7:0/3459201015 conn(0x7f4b34101db0 msgr2=0x7f4b34102910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:01.552 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.966+0000 7f4b3afbf640 1 -- 172.21.15.7:0/3459201015 shutdown_connections 2024-09-19T04:07:01.552 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:00.966+0000 7f4b3afbf640 1 -- 172.21.15.7:0/3459201015 wait complete. 2024-09-19T04:07:01.552 INFO:teuthology.orchestra.run.smithi007.stdout:Restarting the monitor... 2024-09-19T04:07:01.829 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:01 smithi007 systemd[1]: Stopping Ceph mon.a for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:07:02.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:01 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-a[30978]: 2024-09-19T04:07:01.826+0000 7fe5eeea8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:07:02.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:01 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-a[30978]: 2024-09-19T04:07:01.826+0000 7fe5eeea8640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T04:07:02.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:01 smithi007 podman[31235]: 2024-09-19 04:07:01.940157809 +0000 UTC m=+0.219764007 container stop fd467922b19bf1a13f60a463fc094b591f87344fce642b7ebbb0a28dc2d487df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-a, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T04:07:02.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:01 smithi007 podman[31235]: 2024-09-19 04:07:01.978194098 +0000 UTC m=+0.257800292 container died fd467922b19bf1a13f60a463fc094b591f87344fce642b7ebbb0a28dc2d487df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-a, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T04:07:02.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:02 smithi007 podman[31235]: 2024-09-19 04:07:02.335159151 +0000 UTC m=+0.614765344 container cleanup fd467922b19bf1a13f60a463fc094b591f87344fce642b7ebbb0a28dc2d487df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T04:07:02.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:02 smithi007 bash[31235]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-a 2024-09-19T04:07:02.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:02 smithi007 podman[31247]: 2024-09-19 04:07:02.477731826 +0000 UTC m=+0.527861868 container remove fd467922b19bf1a13f60a463fc094b591f87344fce642b7ebbb0a28dc2d487df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-19T04:07:03.017 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:02 smithi007 systemd[1]: ceph-77957c0a-763c-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T04:07:03.017 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:02 smithi007 systemd[1]: Stopped Ceph mon.a for 77957c0a-763c-11ef-bceb-c7b262605968. 2024-09-19T04:07:03.017 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:02 smithi007 systemd[1]: Starting Ceph mon.a for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:07:03.017 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:02 smithi007 podman[31341]: 2024-09-19 04:07:02.816399265 +0000 UTC m=+0.016404133 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:07:03.018 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:02 smithi007 podman[31341]: 2024-09-19 04:07:02.920213069 +0000 UTC m=+0.120217919 container create 7c492ee8493a3815058048f22dd6ea099cbefb8bf622ffb97a5812803b7f57d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T04:07:03.186 INFO:teuthology.orchestra.run.smithi007.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T04:07:03.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 podman[31341]: 2024-09-19 04:07:03.122466589 +0000 UTC m=+0.322471457 container init 7c492ee8493a3815058048f22dd6ea099cbefb8bf622ffb97a5812803b7f57d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T04:07:03.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 podman[31341]: 2024-09-19 04:07:03.12551655 +0000 UTC m=+0.325521399 container start 7c492ee8493a3815058048f22dd6ea099cbefb8bf622ffb97a5812803b7f57d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T04:07:03.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T04:07:03.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T04:07:03.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: pidfile_write: ignore empty --pid-file 2024-09-19T04:07:03.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: load: jerasure load: lrc 2024-09-19T04:07:03.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: RocksDB version: 7.9.2 2024-09-19T04:07:03.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Git sha 0 2024-09-19T04:07:03.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T04:07:03.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: DB SUMMARY 2024-09-19T04:07:03.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: DB Session ID: KDM0YOM4MW5SQC6OAEBT 2024-09-19T04:07:03.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: CURRENT file: CURRENT 2024-09-19T04:07:03.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T04:07:03.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-19T04:07:03.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T04:07:03.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105388 ; 2024-09-19T04:07:03.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.error_if_exists: 0 2024-09-19T04:07:03.311 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.create_if_missing: 0 2024-09-19T04:07:03.312 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.paranoid_checks: 1 2024-09-19T04:07:03.312 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T04:07:03.312 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T04:07:03.312 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T04:07:03.312 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.env: 0x55d489a86940 2024-09-19T04:07:03.312 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T04:07:03.312 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.info_log: 0x55d48a44b6e0 2024-09-19T04:07:03.312 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T04:07:03.312 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.statistics: (nil) 2024-09-19T04:07:03.312 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.use_fsync: 0 2024-09-19T04:07:03.312 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.max_log_file_size: 0 2024-09-19T04:07:03.312 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T04:07:03.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T04:07:03.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T04:07:03.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T04:07:03.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.allow_fallocate: 1 2024-09-19T04:07:03.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T04:07:03.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T04:07:03.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.use_direct_reads: 0 2024-09-19T04:07:03.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T04:07:03.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T04:07:03.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.db_log_dir: 2024-09-19T04:07:03.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.wal_dir: 2024-09-19T04:07:03.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T04:07:03.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T04:07:03.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T04:07:03.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T04:07:03.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T04:07:03.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T04:07:03.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T04:07:03.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T04:07:03.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.write_buffer_manager: 0x55d48a45adc0 2024-09-19T04:07:03.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T04:07:03.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T04:07:03.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T04:07:03.314 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T04:07:03.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T04:07:03.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T04:07:03.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T04:07:03.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T04:07:03.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.unordered_write: 0 2024-09-19T04:07:03.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T04:07:03.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T04:07:03.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T04:07:03.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T04:07:03.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.row_cache: None 2024-09-19T04:07:03.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.wal_filter: None 2024-09-19T04:07:03.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T04:07:03.317 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T04:07:03.317 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.two_write_queues: 0 2024-09-19T04:07:03.317 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T04:07:03.317 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.wal_compression: 0 2024-09-19T04:07:03.317 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.atomic_flush: 0 2024-09-19T04:07:03.317 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T04:07:03.317 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T04:07:03.317 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T04:07:03.317 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.log_readahead_size: 0 2024-09-19T04:07:03.317 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T04:07:03.317 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T04:07:03.317 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T04:07:03.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T04:07:03.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T04:07:03.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T04:07:03.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T04:07:03.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.max_background_jobs: 2 2024-09-19T04:07:03.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.max_background_compactions: -1 2024-09-19T04:07:03.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.max_subcompactions: 1 2024-09-19T04:07:03.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T04:07:03.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T04:07:03.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T04:07:03.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T04:07:03.318 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T04:07:03.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T04:07:03.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T04:07:03.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T04:07:03.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.max_open_files: -1 2024-09-19T04:07:03.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T04:07:03.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T04:07:03.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T04:07:03.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T04:07:03.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.max_background_flushes: -1 2024-09-19T04:07:03.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Compression algorithms supported: 2024-09-19T04:07:03.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: kZSTD supported: 0 2024-09-19T04:07:03.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: kXpressCompression supported: 0 2024-09-19T04:07:03.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: kBZip2Compression supported: 0 2024-09-19T04:07:03.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T04:07:03.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: kLZ4Compression supported: 1 2024-09-19T04:07:03.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: kZlibCompression supported: 1 2024-09-19T04:07:03.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T04:07:03.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: kSnappyCompression supported: 1 2024-09-19T04:07:03.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T04:07:03.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T04:07:03.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-19T04:07:03.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T04:07:03.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T04:07:03.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.merge_operator: 2024-09-19T04:07:03.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.compaction_filter: None 2024-09-19T04:07:03.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T04:07:03.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T04:07:03.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T04:07:03.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T04:07:03.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d48a44b320) 2024-09-19T04:07:03.321 INFO:journalctl@ceph.mon.a.smithi007.stdout: cache_index_and_filter_blocks: 1 2024-09-19T04:07:03.321 INFO:journalctl@ceph.mon.a.smithi007.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T04:07:03.321 INFO:journalctl@ceph.mon.a.smithi007.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T04:07:03.321 INFO:journalctl@ceph.mon.a.smithi007.stdout: pin_top_level_index_and_filter: 1 2024-09-19T04:07:03.321 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_type: 0 2024-09-19T04:07:03.321 INFO:journalctl@ceph.mon.a.smithi007.stdout: data_block_index_type: 0 2024-09-19T04:07:03.321 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_shortening: 1 2024-09-19T04:07:03.321 INFO:journalctl@ceph.mon.a.smithi007.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T04:07:03.322 INFO:journalctl@ceph.mon.a.smithi007.stdout: checksum: 4 2024-09-19T04:07:03.322 INFO:journalctl@ceph.mon.a.smithi007.stdout: no_block_cache: 0 2024-09-19T04:07:03.322 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache: 0x55d48a43f1f0 2024-09-19T04:07:03.322 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_name: BinnedLRUCache 2024-09-19T04:07:03.322 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_options: 2024-09-19T04:07:03.322 INFO:journalctl@ceph.mon.a.smithi007.stdout: capacity : 536870912 2024-09-19T04:07:03.322 INFO:journalctl@ceph.mon.a.smithi007.stdout: num_shard_bits : 4 2024-09-19T04:07:03.322 INFO:journalctl@ceph.mon.a.smithi007.stdout: strict_capacity_limit : 0 2024-09-19T04:07:03.322 INFO:journalctl@ceph.mon.a.smithi007.stdout: high_pri_pool_ratio: 0.000 2024-09-19T04:07:03.322 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_compressed: (nil) 2024-09-19T04:07:03.322 INFO:journalctl@ceph.mon.a.smithi007.stdout: persistent_cache: (nil) 2024-09-19T04:07:03.322 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_size: 4096 2024-09-19T04:07:03.322 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_size_deviation: 10 2024-09-19T04:07:03.322 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_restart_interval: 16 2024-09-19T04:07:03.323 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_block_restart_interval: 1 2024-09-19T04:07:03.323 INFO:journalctl@ceph.mon.a.smithi007.stdout: metadata_block_size: 4096 2024-09-19T04:07:03.323 INFO:journalctl@ceph.mon.a.smithi007.stdout: partition_filters: 0 2024-09-19T04:07:03.323 INFO:journalctl@ceph.mon.a.smithi007.stdout: use_delta_encoding: 1 2024-09-19T04:07:03.323 INFO:journalctl@ceph.mon.a.smithi007.stdout: filter_policy: bloomfilter 2024-09-19T04:07:03.323 INFO:journalctl@ceph.mon.a.smithi007.stdout: whole_key_filtering: 1 2024-09-19T04:07:03.323 INFO:journalctl@ceph.mon.a.smithi007.stdout: verify_compression: 0 2024-09-19T04:07:03.323 INFO:journalctl@ceph.mon.a.smithi007.stdout: read_amp_bytes_per_bit: 0 2024-09-19T04:07:03.323 INFO:journalctl@ceph.mon.a.smithi007.stdout: format_version: 5 2024-09-19T04:07:03.323 INFO:journalctl@ceph.mon.a.smithi007.stdout: enable_index_compression: 1 2024-09-19T04:07:03.323 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_align: 0 2024-09-19T04:07:03.323 INFO:journalctl@ceph.mon.a.smithi007.stdout: max_auto_readahead_size: 262144 2024-09-19T04:07:03.323 INFO:journalctl@ceph.mon.a.smithi007.stdout: prepopulate_block_cache: 0 2024-09-19T04:07:03.324 INFO:journalctl@ceph.mon.a.smithi007.stdout: initial_auto_readahead_size: 8192 2024-09-19T04:07:03.324 INFO:journalctl@ceph.mon.a.smithi007.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T04:07:03.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T04:07:03.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T04:07:03.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.compression: NoCompression 2024-09-19T04:07:03.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T04:07:03.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T04:07:03.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T04:07:03.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.num_levels: 7 2024-09-19T04:07:03.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T04:07:03.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T04:07:03.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T04:07:03.324 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T04:07:03.325 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T04:07:03.325 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T04:07:03.325 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T04:07:03.325 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T04:07:03.325 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T04:07:03.325 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T04:07:03.325 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T04:07:03.325 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T04:07:03.325 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T04:07:03.325 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T04:07:03.325 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T04:07:03.325 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T04:07:03.325 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T04:07:03.326 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T04:07:03.326 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T04:07:03.326 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T04:07:03.326 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T04:07:03.326 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T04:07:03.326 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T04:07:03.326 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T04:07:03.326 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T04:07:03.326 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T04:07:03.326 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T04:07:03.326 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T04:07:03.326 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T04:07:03.326 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T04:07:03.326 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T04:07:03.327 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T04:07:03.327 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T04:07:03.327 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T04:07:03.327 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T04:07:03.327 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T04:07:03.327 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T04:07:03.327 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T04:07:03.327 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T04:07:03.327 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T04:07:03.327 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T04:07:03.327 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T04:07:03.327 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T04:07:03.327 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T04:07:03.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T04:07:03.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T04:07:03.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T04:07:03.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T04:07:03.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T04:07:03.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T04:07:03.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T04:07:03.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T04:07:03.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T04:07:03.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T04:07:03.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.inplace_update_support: 0 2024-09-19T04:07:03.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T04:07:03.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T04:07:03.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T04:07:03.329 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T04:07:03.329 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.bloom_locality: 0 2024-09-19T04:07:03.329 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.max_successive_merges: 0 2024-09-19T04:07:03.329 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T04:07:03.329 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T04:07:03.329 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T04:07:03.329 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T04:07:03.329 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.ttl: 2592000 2024-09-19T04:07:03.329 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T04:07:03.329 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T04:07:03.329 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T04:07:03.329 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.enable_blob_files: false 2024-09-19T04:07:03.330 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.min_blob_size: 0 2024-09-19T04:07:03.330 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T04:07:03.330 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T04:07:03.330 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T04:07:03.330 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T04:07:03.330 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T04:07:03.330 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T04:07:03.330 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T04:07:03.330 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T04:07:03.330 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-19T04:07:03.330 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-19T04:07:03.330 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 711a0f28-3fcc-4059-8546-257e4d7c44ad 2024-09-19T04:07:03.330 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726718823152278, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-19T04:07:03.330 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-19T04:07:03.330 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726718823153954, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100436, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 328, "table_properties": {"data_size": 98330, "index_size": 298, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14320, "raw_average_key_size": 49, "raw_value_size": 90583, "raw_average_value_size": 315, "num_data_blocks": 12, "num_entries": 287, "num_filter_entries": 287, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726718823, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "711a0f28-3fcc-4059-8546-257e4d7c44ad", "db_session_id": "KDM0YOM4MW5SQC6OAEBT", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-19T04:07:03.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726718823154093, "job": 1, "event": "recovery_finished"} 2024-09-19T04:07:03.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-19T04:07:03.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T04:07:03.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d48a46ce00 2024-09-19T04:07:03.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: DB pointer 0x55d48a568000 2024-09-19T04:07:03.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T04:07:03.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T04:07:03.331 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** DB Stats ** 2024-09-19T04:07:03.331 INFO:journalctl@ceph.mon.a.smithi007.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T04:07:03.331 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T04:07:03.331 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T04:07:03.331 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T04:07:03.331 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T04:07:03.331 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T04:07:03.331 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T04:07:03.332 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-19T04:07:03.332 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** Compaction Stats [default] ** 2024-09-19T04:07:03.332 INFO:journalctl@ceph.mon.a.smithi007.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T04:07:03.332 INFO:journalctl@ceph.mon.a.smithi007.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T04:07:03.332 INFO:journalctl@ceph.mon.a.smithi007.stdout: L0 2/0 99.94 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 94.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T04:07:03.332 INFO:journalctl@ceph.mon.a.smithi007.stdout: Sum 2/0 99.94 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 94.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T04:07:03.332 INFO:journalctl@ceph.mon.a.smithi007.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 94.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T04:07:03.332 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-19T04:07:03.332 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** Compaction Stats [default] ** 2024-09-19T04:07:03.332 INFO:journalctl@ceph.mon.a.smithi007.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T04:07:03.332 INFO:journalctl@ceph.mon.a.smithi007.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T04:07:03.332 INFO:journalctl@ceph.mon.a.smithi007.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 94.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T04:07:03.332 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-19T04:07:03.333 INFO:journalctl@ceph.mon.a.smithi007.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T04:07:03.333 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-19T04:07:03.333 INFO:journalctl@ceph.mon.a.smithi007.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T04:07:03.333 INFO:journalctl@ceph.mon.a.smithi007.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T04:07:03.333 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T04:07:03.333 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T04:07:03.333 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T04:07:03.333 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T04:07:03.333 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative compaction: 0.00 GB write, 20.94 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T04:07:03.333 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval compaction: 0.00 GB write, 20.94 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T04:07:03.333 INFO:journalctl@ceph.mon.a.smithi007.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T04:07:03.333 INFO:journalctl@ceph.mon.a.smithi007.stdout: Block cache BinnedLRUCache@0x55d48a43f1f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-19T04:07:03.333 INFO:journalctl@ceph.mon.a.smithi007.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-19T04:07:03.334 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-19T04:07:03.334 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T04:07:03.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: starting mon.a rank 0 at public addrs [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] at bind addrs [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:07:03.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: mon.a@-1(???) e1 preinit fsid 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:07:03.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: mon.a@-1(???).mds e1 new map 2024-09-19T04:07:03.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: mon.a@-1(???).mds e1 print_map 2024-09-19T04:07:03.334 INFO:journalctl@ceph.mon.a.smithi007.stdout: e1 2024-09-19T04:07:03.334 INFO:journalctl@ceph.mon.a.smithi007.stdout: btime 2024-09-19T04:06:58:337221+0000 2024-09-19T04:07:03.334 INFO:journalctl@ceph.mon.a.smithi007.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T04:07:03.334 INFO:journalctl@ceph.mon.a.smithi007.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T04:07:03.334 INFO:journalctl@ceph.mon.a.smithi007.stdout: legacy client fscid: -1 2024-09-19T04:07:03.334 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-19T04:07:03.334 INFO:journalctl@ceph.mon.a.smithi007.stdout: No filesystems configured 2024-09-19T04:07:03.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T04:07:03.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T04:07:03.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T04:07:03.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T04:07:03.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T04:07:03.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 bash[31341]: 7c492ee8493a3815058048f22dd6ea099cbefb8bf622ffb97a5812803b7f57d0 2024-09-19T04:07:03.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 systemd[1]: Started Ceph mon.a for 77957c0a-763c-11ef-bceb-c7b262605968. 2024-09-19T04:07:03.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T04:07:03.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: monmap epoch 1 2024-09-19T04:07:03.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: fsid 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:07:03.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: last_changed 2024-09-19T04:06:54.996586+0000 2024-09-19T04:07:03.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: created 2024-09-19T04:06:54.996586+0000 2024-09-19T04:07:03.335 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: min_mon_release 19 (squid) 2024-09-19T04:07:03.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: election_strategy: 1 2024-09-19T04:07:03.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-19T04:07:03.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: fsmap 2024-09-19T04:07:03.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T04:07:03.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:03 smithi007 ceph-mon[31360]: mgrmap e1: no daemons active 2024-09-19T04:07:04.321 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.793+0000 7f566e48d640 1 Processor -- start 2024-09-19T04:07:04.321 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.793+0000 7f566e48d640 1 -- start start 2024-09-19T04:07:04.321 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.793+0000 7f566e48d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5668107680 0x7f5668107a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:04.321 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.793+0000 7f566e48d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5668108050 con 0x7f5668107680 2024-09-19T04:07:04.321 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.793+0000 7f5667fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5668107680 0x7f5668107a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:04.321 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.794+0000 7f5667fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5668107680 0x7f5668107a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56464/0 (socket says 172.21.15.7:56464) 2024-09-19T04:07:04.322 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.794+0000 7f5667fff640 1 -- 172.21.15.7:0/1911564458 learned_addr learned my addr 172.21.15.7:0/1911564458 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:04.322 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.794+0000 7f5667fff640 1 -- 172.21.15.7:0/1911564458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5668108830 con 0x7f5668107680 2024-09-19T04:07:04.322 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.796+0000 7f5667fff640 1 --2- 172.21.15.7:0/1911564458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5668107680 0x7f5668107a80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5658009820 tx=0x7f565802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed77a010db80bda2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:04.322 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.796+0000 7f5666ffd640 1 -- 172.21.15.7:0/1911564458 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5658037070 con 0x7f5668107680 2024-09-19T04:07:04.322 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.796+0000 7f5666ffd640 1 -- 172.21.15.7:0/1911564458 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5658032900 con 0x7f5668107680 2024-09-19T04:07:04.322 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.796+0000 7f5666ffd640 1 -- 172.21.15.7:0/1911564458 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5658030850 con 0x7f5668107680 2024-09-19T04:07:04.322 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.796+0000 7f566e48d640 1 -- 172.21.15.7:0/1911564458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5668107680 msgr2=0x7f5668107a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:04.322 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.796+0000 7f566e48d640 1 --2- 172.21.15.7:0/1911564458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5668107680 0x7f5668107a80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5658009820 tx=0x7f565802a270 comp rx=0 tx=0).stop 2024-09-19T04:07:04.322 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.796+0000 7f566e48d640 1 -- 172.21.15.7:0/1911564458 shutdown_connections 2024-09-19T04:07:04.322 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.796+0000 7f566e48d640 1 --2- 172.21.15.7:0/1911564458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5668107680 0x7f5668107a80 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:04.322 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.796+0000 7f566e48d640 1 -- 172.21.15.7:0/1911564458 >> 172.21.15.7:0/1911564458 conn(0x7f5668102e50 msgr2=0x7f5668105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:04.322 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.797+0000 7f566e48d640 1 -- 172.21.15.7:0/1911564458 shutdown_connections 2024-09-19T04:07:04.323 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.797+0000 7f566e48d640 1 -- 172.21.15.7:0/1911564458 wait complete. 2024-09-19T04:07:04.323 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.797+0000 7f566e48d640 1 Processor -- start 2024-09-19T04:07:04.323 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.797+0000 7f566e48d640 1 -- start start 2024-09-19T04:07:04.323 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.797+0000 7f566e48d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5668107680 0x7f566807db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:04.323 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.797+0000 7f566e48d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f566810bbe0 con 0x7f5668107680 2024-09-19T04:07:04.323 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.798+0000 7f5667fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5668107680 0x7f566807db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:04.323 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.798+0000 7f5667fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5668107680 0x7f566807db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56468/0 (socket says 172.21.15.7:56468) 2024-09-19T04:07:04.323 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.798+0000 7f5667fff640 1 -- 172.21.15.7:0/3447118317 learned_addr learned my addr 172.21.15.7:0/3447118317 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:04.323 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.798+0000 7f5667fff640 1 -- 172.21.15.7:0/3447118317 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f566807e0b0 con 0x7f5668107680 2024-09-19T04:07:04.323 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.798+0000 7f5667fff640 1 --2- 172.21.15.7:0/3447118317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5668107680 0x7f566807db70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5658009940 tx=0x7f56580326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:04.323 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.798+0000 7f56657fa640 1 -- 172.21.15.7:0/3447118317 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5658042070 con 0x7f5668107680 2024-09-19T04:07:04.323 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.798+0000 7f56657fa640 1 -- 172.21.15.7:0/3447118317 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5658032be0 con 0x7f5668107680 2024-09-19T04:07:04.323 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.798+0000 7f566e48d640 1 -- 172.21.15.7:0/3447118317 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f566807c2a0 con 0x7f5668107680 2024-09-19T04:07:04.324 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.798+0000 7f56657fa640 1 -- 172.21.15.7:0/3447118317 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5658037040 con 0x7f5668107680 2024-09-19T04:07:04.324 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.798+0000 7f566e48d640 1 -- 172.21.15.7:0/3447118317 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f566807c7e0 con 0x7f5668107680 2024-09-19T04:07:04.324 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.798+0000 7f56657fa640 1 -- 172.21.15.7:0/3447118317 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5658045070 con 0x7f5668107680 2024-09-19T04:07:04.324 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.799+0000 7f56657fa640 1 -- 172.21.15.7:0/3447118317 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5658047a80 con 0x7f5668107680 2024-09-19T04:07:04.324 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.799+0000 7f566e48d640 1 -- 172.21.15.7:0/3447118317 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f566810bd60 con 0x7f5668107680 2024-09-19T04:07:04.324 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.802+0000 7f56657fa640 1 -- 172.21.15.7:0/3447118317 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f5658032d90 con 0x7f5668107680 2024-09-19T04:07:04.324 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.861+0000 7f566e48d640 1 -- 172.21.15.7:0/3447118317 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f566807cb20 con 0x7f5668107680 2024-09-19T04:07:04.324 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.863+0000 7f56657fa640 1 -- 172.21.15.7:0/3447118317 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f565803d430 con 0x7f5668107680 2024-09-19T04:07:04.324 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.863+0000 7f566e48d640 1 -- 172.21.15.7:0/3447118317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5668107680 msgr2=0x7f566807db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:04.324 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.863+0000 7f566e48d640 1 --2- 172.21.15.7:0/3447118317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5668107680 0x7f566807db70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5658009940 tx=0x7f56580326e0 comp rx=0 tx=0).stop 2024-09-19T04:07:04.324 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.863+0000 7f566e48d640 1 -- 172.21.15.7:0/3447118317 shutdown_connections 2024-09-19T04:07:04.324 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.863+0000 7f566e48d640 1 --2- 172.21.15.7:0/3447118317 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5668107680 0x7f566807db70 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:04.325 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.863+0000 7f566e48d640 1 -- 172.21.15.7:0/3447118317 >> 172.21.15.7:0/3447118317 conn(0x7f5668102e50 msgr2=0x7f5668103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:04.325 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.864+0000 7f566e48d640 1 -- 172.21.15.7:0/3447118317 shutdown_connections 2024-09-19T04:07:04.325 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:03.864+0000 7f566e48d640 1 -- 172.21.15.7:0/3447118317 wait complete. 2024-09-19T04:07:04.325 INFO:teuthology.orchestra.run.smithi007.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T04:07:04.346 INFO:teuthology.orchestra.run.smithi007.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T04:07:04.346 INFO:teuthology.orchestra.run.smithi007.stdout:Creating mgr... 2024-09-19T04:07:04.347 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T04:07:04.347 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T04:07:04.613 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-77957c0a-763c-11ef-bceb-c7b262605968@mgr.x 2024-09-19T04:07:04.613 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to reset failed state of unit ceph-77957c0a-763c-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-77957c0a-763c-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-19T04:07:04.784 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-77957c0a-763c-11ef-bceb-c7b262605968.target.wants/ceph-77957c0a-763c-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-77957c0a-763c-11ef-bceb-c7b262605968@.service. 2024-09-19T04:07:05.098 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:04 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3447118317' entity='client.admin' 2024-09-19T04:07:05.274 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T04:07:05.274 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout disabled 2024-09-19T04:07:05.281 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T04:07:05.281 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-19T04:07:05.281 INFO:teuthology.orchestra.run.smithi007.stdout:firewalld.service is not enabled 2024-09-19T04:07:05.282 INFO:teuthology.orchestra.run.smithi007.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T04:07:05.291 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T04:07:05.291 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout disabled 2024-09-19T04:07:05.298 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T04:07:05.298 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-19T04:07:05.299 INFO:teuthology.orchestra.run.smithi007.stdout:firewalld.service is not enabled 2024-09-19T04:07:05.299 INFO:teuthology.orchestra.run.smithi007.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-19T04:07:05.299 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mgr to start... 2024-09-19T04:07:05.299 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mgr... 2024-09-19T04:07:05.377 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:05 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:05.331+0000 7f0aa6375040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T04:07:05.679 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:05 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:05.394+0000 7f0aa6375040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T04:07:05.679 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:05 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:05.550+0000 7f0aa6375040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T04:07:05.680 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:05 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:05.625+0000 7f0aa6375040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T04:07:05.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:05 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2323119507' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T04:07:05.936 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:05 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:05.784+0000 7f0aa6375040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:07:05.936 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:05 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:05.934+0000 7f0aa6375040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T04:07:06.446 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-19T04:07:06.446 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-19T04:07:06.447 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsid": "77957c0a-763c-11ef-bceb-c7b262605968", 2024-09-19T04:07:06.447 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T04:07:06.447 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T04:07:06.447 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T04:07:06.447 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T04:07:06.447 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:07:06.447 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T04:07:06.447 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T04:07:06.447 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 0 2024-09-19T04:07:06.447 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-19T04:07:06.447 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T04:07:06.448 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T04:07:06.448 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-19T04:07:06.448 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-19T04:07:06.448 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T04:07:06.448 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:07:06.448 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T04:07:06.448 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T04:07:06.448 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:07:06.448 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T04:07:06.448 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:07:06.448 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T04:07:06.449 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T04:07:06.449 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T04:07:06.449 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T04:07:06.449 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T04:07:06.449 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T04:07:06.449 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:07:06.449 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T04:07:06.449 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T04:07:06.449 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T04:07:06.449 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T04:07:06.450 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T04:07:06.450 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T04:07:06.450 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T04:07:06.450 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T04:07:06.450 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T04:07:06.450 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:07:06.450 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T04:07:06.450 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:07:06.450 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T04:06:58:337221+0000", 2024-09-19T04:07:06.450 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T04:07:06.450 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T04:07:06.451 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:07:06.451 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T04:07:06.451 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T04:07:06.451 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T04:07:06.451 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T04:07:06.451 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T04:07:06.451 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T04:07:06.451 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T04:07:06.451 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-19T04:07:06.451 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T04:07:06.451 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:07:06.452 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T04:07:06.452 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:07:06.452 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T04:06:58.337912+0000", 2024-09-19T04:07:06.452 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T04:07:06.452 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:07:06.452 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T04:07:06.452 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-19T04:07:06.452 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.758+0000 7f4b05bbc640 1 Processor -- start 2024-09-19T04:07:06.452 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.758+0000 7f4b05bbc640 1 -- start start 2024-09-19T04:07:06.452 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.758+0000 7f4b05bbc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b00108090 0x7f4b0010a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:06.453 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.758+0000 7f4b05bbc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0007beb0 con 0x7f4b00108090 2024-09-19T04:07:06.453 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.759+0000 7f4aff7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b00108090 0x7f4b0010a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:06.453 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.759+0000 7f4aff7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b00108090 0x7f4b0010a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56494/0 (socket says 172.21.15.7:56494) 2024-09-19T04:07:06.453 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.759+0000 7f4aff7fe640 1 -- 172.21.15.7:0/1352289614 learned_addr learned my addr 172.21.15.7:0/1352289614 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:06.453 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.759+0000 7f4aff7fe640 1 -- 172.21.15.7:0/1352289614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b0010a9c0 con 0x7f4b00108090 2024-09-19T04:07:06.453 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.760+0000 7f4aff7fe640 1 --2- 172.21.15.7:0/1352289614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b00108090 0x7f4b0010a480 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4af0009820 tx=0x7f4af002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b81960abb3d0bfc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:06.453 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.760+0000 7f4afeffd640 1 -- 172.21.15.7:0/1352289614 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af0037070 con 0x7f4b00108090 2024-09-19T04:07:06.453 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.760+0000 7f4afeffd640 1 -- 172.21.15.7:0/1352289614 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4af0032900 con 0x7f4b00108090 2024-09-19T04:07:06.453 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.760+0000 7f4afeffd640 1 -- 172.21.15.7:0/1352289614 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af0030850 con 0x7f4b00108090 2024-09-19T04:07:06.453 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.761+0000 7f4b05bbc640 1 -- 172.21.15.7:0/1352289614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b00108090 msgr2=0x7f4b0010a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:06.454 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.761+0000 7f4b05bbc640 1 --2- 172.21.15.7:0/1352289614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b00108090 0x7f4b0010a480 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4af0009820 tx=0x7f4af002a270 comp rx=0 tx=0).stop 2024-09-19T04:07:06.454 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.761+0000 7f4b05bbc640 1 -- 172.21.15.7:0/1352289614 shutdown_connections 2024-09-19T04:07:06.454 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.761+0000 7f4b05bbc640 1 --2- 172.21.15.7:0/1352289614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b00108090 0x7f4b0010a480 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:06.454 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.761+0000 7f4b05bbc640 1 -- 172.21.15.7:0/1352289614 >> 172.21.15.7:0/1352289614 conn(0x7f4b00101db0 msgr2=0x7f4b001041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:06.454 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.761+0000 7f4b05bbc640 1 -- 172.21.15.7:0/1352289614 shutdown_connections 2024-09-19T04:07:06.454 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.761+0000 7f4b05bbc640 1 -- 172.21.15.7:0/1352289614 wait complete. 2024-09-19T04:07:06.454 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.762+0000 7f4b05bbc640 1 Processor -- start 2024-09-19T04:07:06.454 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.762+0000 7f4b05bbc640 1 -- start start 2024-09-19T04:07:06.454 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.762+0000 7f4b05bbc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b00108090 0x7f4b0019b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:06.454 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.762+0000 7f4b05bbc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0010ba60 con 0x7f4b00108090 2024-09-19T04:07:06.454 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.762+0000 7f4aff7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b00108090 0x7f4b0019b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:06.455 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.762+0000 7f4aff7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b00108090 0x7f4b0019b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56508/0 (socket says 172.21.15.7:56508) 2024-09-19T04:07:06.455 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.762+0000 7f4aff7fe640 1 -- 172.21.15.7:0/2323119507 learned_addr learned my addr 172.21.15.7:0/2323119507 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:06.455 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.763+0000 7f4aff7fe640 1 -- 172.21.15.7:0/2323119507 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b0019bb50 con 0x7f4b00108090 2024-09-19T04:07:06.455 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.763+0000 7f4aff7fe640 1 --2- 172.21.15.7:0/2323119507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b00108090 0x7f4b0019b610 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4af00097f0 tx=0x7f4af0030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:06.455 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.763+0000 7f4afd7fa640 1 -- 172.21.15.7:0/2323119507 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af0037040 con 0x7f4b00108090 2024-09-19T04:07:06.455 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.763+0000 7f4afd7fa640 1 -- 172.21.15.7:0/2323119507 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4af0040070 con 0x7f4b00108090 2024-09-19T04:07:06.455 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.763+0000 7f4afd7fa640 1 -- 172.21.15.7:0/2323119507 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af003a390 con 0x7f4b00108090 2024-09-19T04:07:06.455 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.763+0000 7f4b05bbc640 1 -- 172.21.15.7:0/2323119507 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b0019bde0 con 0x7f4b00108090 2024-09-19T04:07:06.455 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.763+0000 7f4b05bbc640 1 -- 172.21.15.7:0/2323119507 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b0019ead0 con 0x7f4b00108090 2024-09-19T04:07:06.455 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.764+0000 7f4afd7fa640 1 -- 172.21.15.7:0/2323119507 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4af003a5e0 con 0x7f4b00108090 2024-09-19T04:07:06.456 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.764+0000 7f4afd7fa640 1 -- 172.21.15.7:0/2323119507 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4af0045950 con 0x7f4b00108090 2024-09-19T04:07:06.456 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.764+0000 7f4b05bbc640 1 -- 172.21.15.7:0/2323119507 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b001084f0 con 0x7f4b00108090 2024-09-19T04:07:06.456 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.767+0000 7f4afd7fa640 1 -- 172.21.15.7:0/2323119507 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4af0045460 con 0x7f4b00108090 2024-09-19T04:07:06.456 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.829+0000 7f4b05bbc640 1 -- 172.21.15.7:0/2323119507 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f4b0019eca0 con 0x7f4b00108090 2024-09-19T04:07:06.456 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.829+0000 7f4afd7fa640 1 -- 172.21.15.7:0/2323119507 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f4af003b430 con 0x7f4b00108090 2024-09-19T04:07:06.456 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.830+0000 7f4b05bbc640 1 -- 172.21.15.7:0/2323119507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b00108090 msgr2=0x7f4b0019b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:06.456 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.830+0000 7f4b05bbc640 1 --2- 172.21.15.7:0/2323119507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b00108090 0x7f4b0019b610 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4af00097f0 tx=0x7f4af0030d80 comp rx=0 tx=0).stop 2024-09-19T04:07:06.456 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.830+0000 7f4b05bbc640 1 -- 172.21.15.7:0/2323119507 shutdown_connections 2024-09-19T04:07:06.456 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.830+0000 7f4b05bbc640 1 --2- 172.21.15.7:0/2323119507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b00108090 0x7f4b0019b610 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:06.456 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.830+0000 7f4b05bbc640 1 -- 172.21.15.7:0/2323119507 >> 172.21.15.7:0/2323119507 conn(0x7f4b00101db0 msgr2=0x7f4b001028c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:06.457 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.831+0000 7f4b05bbc640 1 -- 172.21.15.7:0/2323119507 shutdown_connections 2024-09-19T04:07:06.457 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:05.831+0000 7f4b05bbc640 1 -- 172.21.15.7:0/2323119507 wait complete. 2024-09-19T04:07:06.457 INFO:teuthology.orchestra.run.smithi007.stdout:mgr not available, waiting (1/15)... 2024-09-19T04:07:06.534 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:06 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:06.269+0000 7f0aa6375040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T04:07:06.534 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:06 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:06.333+0000 7f0aa6375040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T04:07:06.534 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:06 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:06.533+0000 7f0aa6375040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T04:07:07.877 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:07 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:07.454+0000 7f0aa6375040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T04:07:07.877 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:07 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:07.525+0000 7f0aa6375040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T04:07:08.556 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:08 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:08.280+0000 7f0aa6375040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T04:07:08.557 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:08 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:08.400+0000 7f0aa6375040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T04:07:08.818 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:08 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:08.555+0000 7f0aa6375040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:07:08.818 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:08 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:08.620+0000 7f0aa6375040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T04:07:08.818 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:08 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:08.778+0000 7f0aa6375040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T04:07:09.107 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:09 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2464118992' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T04:07:09.107 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:08 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:08.850+0000 7f0aa6375040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T04:07:09.107 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:08 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:08.916+0000 7f0aa6375040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T04:07:09.107 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:09 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:09.105+0000 7f0aa6375040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T04:07:09.377 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:09 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:09.178+0000 7f0aa6375040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T04:07:09.377 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:09 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:09.248+0000 7f0aa6375040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T04:07:09.377 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:09 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:09.335+0000 7f0aa6375040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T04:07:09.503 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-19T04:07:09.503 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-19T04:07:09.503 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsid": "77957c0a-763c-11ef-bceb-c7b262605968", 2024-09-19T04:07:09.503 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T04:07:09.503 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T04:07:09.503 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T04:07:09.504 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T04:07:09.504 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:07:09.504 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T04:07:09.504 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T04:07:09.504 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 0 2024-09-19T04:07:09.504 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-19T04:07:09.504 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T04:07:09.504 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T04:07:09.504 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-19T04:07:09.504 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-19T04:07:09.504 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T04:07:09.504 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:07:09.505 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T04:07:09.505 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T04:07:09.505 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:07:09.505 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T04:07:09.505 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:07:09.505 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T04:07:09.505 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T04:07:09.505 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T04:07:09.513 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T04:07:09.513 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T04:07:09.513 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T04:07:09.513 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:07:09.513 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T04:07:09.513 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T04:07:09.513 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T04:07:09.513 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T04:07:09.513 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T04:07:09.514 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T04:07:09.514 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T04:07:09.514 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T04:07:09.514 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T04:07:09.514 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:07:09.514 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T04:07:09.514 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:07:09.514 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T04:06:58:337221+0000", 2024-09-19T04:07:09.514 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T04:07:09.514 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T04:07:09.514 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:07:09.514 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T04:07:09.514 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T04:07:09.514 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T04:07:09.515 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T04:07:09.515 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T04:07:09.515 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T04:07:09.515 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T04:07:09.515 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-19T04:07:09.515 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T04:07:09.515 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:07:09.515 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T04:07:09.515 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:07:09.515 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T04:06:58.337912+0000", 2024-09-19T04:07:09.515 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T04:07:09.515 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:07:09.515 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T04:07:09.515 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-19T04:07:09.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.895+0000 7f4b63661640 1 Processor -- start 2024-09-19T04:07:09.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.896+0000 7f4b63661640 1 -- start start 2024-09-19T04:07:09.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.896+0000 7f4b63661640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b5c107c00 0x7f4b5c108000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:09.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.896+0000 7f4b63661640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c1085d0 con 0x7f4b5c107c00 2024-09-19T04:07:09.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.896+0000 7f4b613fd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b5c107c00 0x7f4b5c108000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:09.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.896+0000 7f4b613fd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b5c107c00 0x7f4b5c108000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46074/0 (socket says 172.21.15.7:46074) 2024-09-19T04:07:09.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.896+0000 7f4b613fd640 1 -- 172.21.15.7:0/2397521144 learned_addr learned my addr 172.21.15.7:0/2397521144 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:09.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.896+0000 7f4b613fd640 1 -- 172.21.15.7:0/2397521144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b5c108750 con 0x7f4b5c107c00 2024-09-19T04:07:09.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.897+0000 7f4b613fd640 1 --2- 172.21.15.7:0/2397521144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b5c107c00 0x7f4b5c108000 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009820 tx=0x7f4b5802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec6d256631bd432 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:09.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.897+0000 7f4b53fff640 1 -- 172.21.15.7:0/2397521144 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b58037070 con 0x7f4b5c107c00 2024-09-19T04:07:09.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.897+0000 7f4b53fff640 1 -- 172.21.15.7:0/2397521144 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4b58032900 con 0x7f4b5c107c00 2024-09-19T04:07:09.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.897+0000 7f4b53fff640 1 -- 172.21.15.7:0/2397521144 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b58030850 con 0x7f4b5c107c00 2024-09-19T04:07:09.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.898+0000 7f4b63661640 1 -- 172.21.15.7:0/2397521144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b5c107c00 msgr2=0x7f4b5c108000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:09.516 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.898+0000 7f4b63661640 1 --2- 172.21.15.7:0/2397521144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b5c107c00 0x7f4b5c108000 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009820 tx=0x7f4b5802a270 comp rx=0 tx=0).stop 2024-09-19T04:07:09.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.898+0000 7f4b63661640 1 -- 172.21.15.7:0/2397521144 shutdown_connections 2024-09-19T04:07:09.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.898+0000 7f4b63661640 1 --2- 172.21.15.7:0/2397521144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b5c107c00 0x7f4b5c108000 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:09.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.898+0000 7f4b63661640 1 -- 172.21.15.7:0/2397521144 >> 172.21.15.7:0/2397521144 conn(0x7f4b5c101550 msgr2=0x7f4b5c103970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:09.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.898+0000 7f4b63661640 1 -- 172.21.15.7:0/2397521144 shutdown_connections 2024-09-19T04:07:09.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.898+0000 7f4b63661640 1 -- 172.21.15.7:0/2397521144 wait complete. 2024-09-19T04:07:09.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.899+0000 7f4b63661640 1 Processor -- start 2024-09-19T04:07:09.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.899+0000 7f4b63661640 1 -- start start 2024-09-19T04:07:09.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.899+0000 7f4b63661640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b5c107c00 0x7f4b5c19d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:09.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.899+0000 7f4b63661640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c1065b0 con 0x7f4b5c107c00 2024-09-19T04:07:09.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.899+0000 7f4b613fd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b5c107c00 0x7f4b5c19d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:09.517 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.899+0000 7f4b613fd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b5c107c00 0x7f4b5c19d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46076/0 (socket says 172.21.15.7:46076) 2024-09-19T04:07:09.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.899+0000 7f4b613fd640 1 -- 172.21.15.7:0/2464118992 learned_addr learned my addr 172.21.15.7:0/2464118992 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:09.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.900+0000 7f4b613fd640 1 -- 172.21.15.7:0/2464118992 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b5c19dd10 con 0x7f4b5c107c00 2024-09-19T04:07:09.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.900+0000 7f4b613fd640 1 --2- 172.21.15.7:0/2464118992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b5c107c00 0x7f4b5c19d7d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4b580097f0 tx=0x7f4b58030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:09.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.900+0000 7f4b527fc640 1 -- 172.21.15.7:0/2464118992 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b58037040 con 0x7f4b5c107c00 2024-09-19T04:07:09.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.900+0000 7f4b527fc640 1 -- 172.21.15.7:0/2464118992 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4b58040070 con 0x7f4b5c107c00 2024-09-19T04:07:09.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.900+0000 7f4b63661640 1 -- 172.21.15.7:0/2464118992 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b5c19dfa0 con 0x7f4b5c107c00 2024-09-19T04:07:09.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.900+0000 7f4b527fc640 1 -- 172.21.15.7:0/2464118992 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b5803a390 con 0x7f4b5c107c00 2024-09-19T04:07:09.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.900+0000 7f4b63661640 1 -- 172.21.15.7:0/2464118992 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b5c1a0c90 con 0x7f4b5c107c00 2024-09-19T04:07:09.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.900+0000 7f4b527fc640 1 -- 172.21.15.7:0/2464118992 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4b5803a630 con 0x7f4b5c107c00 2024-09-19T04:07:09.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.901+0000 7f4b527fc640 1 -- 172.21.15.7:0/2464118992 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4b580459a0 con 0x7f4b5c107c00 2024-09-19T04:07:09.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.901+0000 7f4b63661640 1 -- 172.21.15.7:0/2464118992 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b5c108080 con 0x7f4b5c107c00 2024-09-19T04:07:09.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.903+0000 7f4b527fc640 1 -- 172.21.15.7:0/2464118992 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4b58045460 con 0x7f4b5c107c00 2024-09-19T04:07:09.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.966+0000 7f4b63661640 1 -- 172.21.15.7:0/2464118992 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f4b5c1a0eb0 con 0x7f4b5c107c00 2024-09-19T04:07:09.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.966+0000 7f4b527fc640 1 -- 172.21.15.7:0/2464118992 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f4b5803b430 con 0x7f4b5c107c00 2024-09-19T04:07:09.518 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.967+0000 7f4b63661640 1 -- 172.21.15.7:0/2464118992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b5c107c00 msgr2=0x7f4b5c19d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:09.519 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.967+0000 7f4b63661640 1 --2- 172.21.15.7:0/2464118992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b5c107c00 0x7f4b5c19d7d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4b580097f0 tx=0x7f4b58030d80 comp rx=0 tx=0).stop 2024-09-19T04:07:09.519 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.967+0000 7f4b63661640 1 -- 172.21.15.7:0/2464118992 shutdown_connections 2024-09-19T04:07:09.519 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.967+0000 7f4b63661640 1 --2- 172.21.15.7:0/2464118992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b5c107c00 0x7f4b5c19d7d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:09.519 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.967+0000 7f4b63661640 1 -- 172.21.15.7:0/2464118992 >> 172.21.15.7:0/2464118992 conn(0x7f4b5c101550 msgr2=0x7f4b5c193e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:09.519 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.967+0000 7f4b63661640 1 -- 172.21.15.7:0/2464118992 shutdown_connections 2024-09-19T04:07:09.519 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:08.967+0000 7f4b63661640 1 -- 172.21.15.7:0/2464118992 wait complete. 2024-09-19T04:07:09.519 INFO:teuthology.orchestra.run.smithi007.stdout:mgr not available, waiting (2/15)... 2024-09-19T04:07:09.877 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:09 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:09.398+0000 7f0aa6375040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T04:07:09.877 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:09 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:09.460+0000 7f0aa6375040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T04:07:10.627 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:10 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:10.293+0000 7f0aa6375040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T04:07:10.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:10 smithi007 ceph-mon[31360]: Activating manager daemon x 2024-09-19T04:07:10.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:10 smithi007 ceph-mon[31360]: mgrmap e2: x(active, starting, since 0.00324077s) 2024-09-19T04:07:10.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:10 smithi007 ceph-mon[31360]: from='mgr.14100 172.21.15.7:0/2782415807' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T04:07:10.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:10 smithi007 ceph-mon[31360]: from='mgr.14100 172.21.15.7:0/2782415807' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T04:07:10.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:10 smithi007 ceph-mon[31360]: from='mgr.14100 172.21.15.7:0/2782415807' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T04:07:10.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:10 smithi007 ceph-mon[31360]: from='mgr.14100 172.21.15.7:0/2782415807' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:07:10.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:10 smithi007 ceph-mon[31360]: from='mgr.14100 172.21.15.7:0/2782415807' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T04:07:10.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:10 smithi007 ceph-mon[31360]: Manager daemon x is now available 2024-09-19T04:07:10.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:10 smithi007 ceph-mon[31360]: from='mgr.14100 172.21.15.7:0/2782415807' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T04:07:10.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:10 smithi007 ceph-mon[31360]: from='mgr.14100 172.21.15.7:0/2782415807' entity='mgr.x' 2024-09-19T04:07:10.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:10 smithi007 ceph-mon[31360]: from='mgr.14100 172.21.15.7:0/2782415807' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T04:07:10.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:10 smithi007 ceph-mon[31360]: from='mgr.14100 172.21.15.7:0/2782415807' entity='mgr.x' 2024-09-19T04:07:10.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:10 smithi007 ceph-mon[31360]: from='mgr.14100 172.21.15.7:0/2782415807' entity='mgr.x' 2024-09-19T04:07:12.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:12 smithi007 ceph-mon[31360]: mgrmap e3: x(active, since 1.00725s) 2024-09-19T04:07:12.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:12 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/4093431881' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T04:07:12.818 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-19T04:07:12.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-19T04:07:12.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsid": "77957c0a-763c-11ef-bceb-c7b262605968", 2024-09-19T04:07:12.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T04:07:12.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T04:07:12.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T04:07:12.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T04:07:12.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:07:12.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T04:07:12.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T04:07:12.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 0 2024-09-19T04:07:12.820 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-19T04:07:12.820 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T04:07:12.820 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T04:07:12.820 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-19T04:07:12.820 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-19T04:07:12.820 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T04:07:12.820 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:07:12.820 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T04:07:12.820 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T04:07:12.820 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:07:12.820 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T04:07:12.820 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:07:12.820 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T04:07:12.821 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T04:07:12.821 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T04:07:12.821 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T04:07:12.821 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T04:07:12.821 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T04:07:12.821 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:07:12.821 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T04:07:12.821 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T04:07:12.821 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T04:07:12.821 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T04:07:12.821 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T04:07:12.822 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T04:07:12.822 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T04:07:12.822 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T04:07:12.822 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T04:07:12.822 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:07:12.822 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T04:07:12.822 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:07:12.822 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T04:06:58:337221+0000", 2024-09-19T04:07:12.822 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T04:07:12.822 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T04:07:12.822 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:07:12.822 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T04:07:12.822 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T04:07:12.822 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T04:07:12.823 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T04:07:12.823 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T04:07:12.823 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T04:07:12.823 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T04:07:12.823 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-19T04:07:12.823 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T04:07:12.823 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:07:12.823 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T04:07:12.823 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:07:12.823 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T04:06:58.337912+0000", 2024-09-19T04:07:12.823 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T04:07:12.823 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:07:12.824 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T04:07:12.824 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-19T04:07:12.824 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.891+0000 7f50d9040640 1 Processor -- start 2024-09-19T04:07:12.824 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.891+0000 7f50d9040640 1 -- start start 2024-09-19T04:07:12.824 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.891+0000 7f50d9040640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50d4108160 0x7f50d410a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:12.824 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.891+0000 7f50d9040640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f50d407be50 con 0x7f50d4108160 2024-09-19T04:07:12.824 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.891+0000 7f50d2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50d4108160 0x7f50d410a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:12.824 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.891+0000 7f50d2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50d4108160 0x7f50d410a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46160/0 (socket says 172.21.15.7:46160) 2024-09-19T04:07:12.824 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.891+0000 7f50d2d9d640 1 -- 172.21.15.7:0/3090369530 learned_addr learned my addr 172.21.15.7:0/3090369530 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:12.824 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.892+0000 7f50d2d9d640 1 -- 172.21.15.7:0/3090369530 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d410aa90 con 0x7f50d4108160 2024-09-19T04:07:12.824 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.892+0000 7f50d2d9d640 1 --2- 172.21.15.7:0/3090369530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50d4108160 0x7f50d410a550 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f50c4009820 tx=0x7f50c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dea9b3bf3425cbf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:12.824 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.893+0000 7f50d1d9b640 1 -- 172.21.15.7:0/3090369530 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50c4037070 con 0x7f50d4108160 2024-09-19T04:07:12.824 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.893+0000 7f50d1d9b640 1 -- 172.21.15.7:0/3090369530 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f50c4032900 con 0x7f50d4108160 2024-09-19T04:07:12.825 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.893+0000 7f50d1d9b640 1 -- 172.21.15.7:0/3090369530 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50c4030850 con 0x7f50d4108160 2024-09-19T04:07:12.825 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.893+0000 7f50d9040640 1 -- 172.21.15.7:0/3090369530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50d4108160 msgr2=0x7f50d410a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:12.825 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.893+0000 7f50d9040640 1 --2- 172.21.15.7:0/3090369530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50d4108160 0x7f50d410a550 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f50c4009820 tx=0x7f50c402a270 comp rx=0 tx=0).stop 2024-09-19T04:07:12.825 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.893+0000 7f50d9040640 1 -- 172.21.15.7:0/3090369530 shutdown_connections 2024-09-19T04:07:12.825 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.893+0000 7f50d9040640 1 --2- 172.21.15.7:0/3090369530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50d4108160 0x7f50d410a550 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:12.825 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.893+0000 7f50d9040640 1 -- 172.21.15.7:0/3090369530 >> 172.21.15.7:0/3090369530 conn(0x7f50d4101de0 msgr2=0x7f50d4104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:12.825 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.893+0000 7f50d9040640 1 -- 172.21.15.7:0/3090369530 shutdown_connections 2024-09-19T04:07:12.825 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.893+0000 7f50d9040640 1 -- 172.21.15.7:0/3090369530 wait complete. 2024-09-19T04:07:12.825 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.894+0000 7f50d9040640 1 Processor -- start 2024-09-19T04:07:12.825 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.894+0000 7f50d9040640 1 -- start start 2024-09-19T04:07:12.825 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.894+0000 7f50d9040640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50d4108160 0x7f50d419d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:12.826 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.894+0000 7f50d9040640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f50d410ba60 con 0x7f50d4108160 2024-09-19T04:07:12.826 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.895+0000 7f50d2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50d4108160 0x7f50d419d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:12.826 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.895+0000 7f50d2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50d4108160 0x7f50d419d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46162/0 (socket says 172.21.15.7:46162) 2024-09-19T04:07:12.826 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.895+0000 7f50d2d9d640 1 -- 172.21.15.7:0/4093431881 learned_addr learned my addr 172.21.15.7:0/4093431881 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:12.826 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.895+0000 7f50d2d9d640 1 -- 172.21.15.7:0/4093431881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d419dd50 con 0x7f50d4108160 2024-09-19T04:07:12.826 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.895+0000 7f50d2d9d640 1 --2- 172.21.15.7:0/4093431881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50d4108160 0x7f50d419d810 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f50c4032ce0 tx=0x7f50c4032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:12.826 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.895+0000 7f50bbfff640 1 -- 172.21.15.7:0/4093431881 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50c4042070 con 0x7f50d4108160 2024-09-19T04:07:12.826 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.895+0000 7f50bbfff640 1 -- 172.21.15.7:0/4093431881 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f50c40308c0 con 0x7f50d4108160 2024-09-19T04:07:12.826 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.895+0000 7f50d9040640 1 -- 172.21.15.7:0/4093431881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50d419dfe0 con 0x7f50d4108160 2024-09-19T04:07:12.826 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.895+0000 7f50bbfff640 1 -- 172.21.15.7:0/4093431881 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50c4037040 con 0x7f50d4108160 2024-09-19T04:07:12.826 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.895+0000 7f50d9040640 1 -- 172.21.15.7:0/4093431881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50d41a0cd0 con 0x7f50d4108160 2024-09-19T04:07:12.827 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.896+0000 7f50bbfff640 1 -- 172.21.15.7:0/4093431881 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 3) ==== 46344+0+0 (secure 0 0 0) 0x7f50c4045070 con 0x7f50d4108160 2024-09-19T04:07:12.827 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.896+0000 7f50d9040640 1 -- 172.21.15.7:0/4093431881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50d41085c0 con 0x7f50d4108160 2024-09-19T04:07:12.827 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.897+0000 7f50bbfff640 1 --2- 172.21.15.7:0/4093431881 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f50bc0390a0 0x7f50bc03b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:12.827 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.897+0000 7f50bbfff640 1 -- 172.21.15.7:0/4093431881 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f50c406c040 con 0x7f50d4108160 2024-09-19T04:07:12.827 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.897+0000 7f50d259c640 1 --2- 172.21.15.7:0/4093431881 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f50bc0390a0 0x7f50bc03b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:12.827 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.897+0000 7f50d259c640 1 --2- 172.21.15.7:0/4093431881 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f50bc0390a0 0x7f50bc03b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f50c80098c0 tx=0x7f50c8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:12.827 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:11.902+0000 7f50bbfff640 1 -- 172.21.15.7:0/4093431881 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f50c4045520 con 0x7f50d4108160 2024-09-19T04:07:12.827 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:12.145+0000 7f50d9040640 1 -- 172.21.15.7:0/4093431881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f50d41a1350 con 0x7f50d4108160 2024-09-19T04:07:12.827 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:12.145+0000 7f50bbfff640 1 -- 172.21.15.7:0/4093431881 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f50c403cce0 con 0x7f50d4108160 2024-09-19T04:07:12.827 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:12.148+0000 7f50d9040640 1 -- 172.21.15.7:0/4093431881 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f50bc0390a0 msgr2=0x7f50bc03b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:12.827 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:12.148+0000 7f50d9040640 1 --2- 172.21.15.7:0/4093431881 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f50bc0390a0 0x7f50bc03b560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f50c80098c0 tx=0x7f50c8006db0 comp rx=0 tx=0).stop 2024-09-19T04:07:12.827 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:12.148+0000 7f50d9040640 1 -- 172.21.15.7:0/4093431881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50d4108160 msgr2=0x7f50d419d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:12.827 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:12.148+0000 7f50d9040640 1 --2- 172.21.15.7:0/4093431881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50d4108160 0x7f50d419d810 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f50c4032ce0 tx=0x7f50c4032d10 comp rx=0 tx=0).stop 2024-09-19T04:07:12.828 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:12.148+0000 7f50d9040640 1 -- 172.21.15.7:0/4093431881 shutdown_connections 2024-09-19T04:07:12.828 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:12.148+0000 7f50d9040640 1 --2- 172.21.15.7:0/4093431881 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f50bc0390a0 0x7f50bc03b560 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:12.828 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:12.148+0000 7f50d9040640 1 --2- 172.21.15.7:0/4093431881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50d4108160 0x7f50d419d810 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:12.828 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:12.148+0000 7f50d9040640 1 -- 172.21.15.7:0/4093431881 >> 172.21.15.7:0/4093431881 conn(0x7f50d4101de0 msgr2=0x7f50d41028b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:12.828 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:12.148+0000 7f50d9040640 1 -- 172.21.15.7:0/4093431881 shutdown_connections 2024-09-19T04:07:12.828 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:12.149+0000 7f50d9040640 1 -- 172.21.15.7:0/4093431881 wait complete. 2024-09-19T04:07:12.828 INFO:teuthology.orchestra.run.smithi007.stdout:mgr is available 2024-09-19T04:07:13.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:13 smithi007 ceph-mon[31360]: mgrmap e4: x(active, since 2s) 2024-09-19T04:07:13.952 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-19T04:07:13.953 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T04:07:13.953 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout fsid = 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:07:13.953 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.7:3300,v1:172.21.15.7:6789] 2024-09-19T04:07:13.953 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T04:07:13.953 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T04:07:13.953 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T04:07:13.953 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T04:07:13.953 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-19T04:07:13.953 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T04:07:13.953 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T04:07:13.954 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-19T04:07:13.954 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T04:07:13.954 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T04:07:13.954 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T04:07:13.954 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T04:07:13.954 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T04:07:13.954 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T04:07:13.954 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.228+0000 7f3059795640 1 Processor -- start 2024-09-19T04:07:13.954 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.228+0000 7f3059795640 1 -- start start 2024-09-19T04:07:13.954 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.228+0000 7f3059795640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3054107740 0x7f3054107b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:13.954 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.228+0000 7f3059795640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3054108110 con 0x7f3054107740 2024-09-19T04:07:13.954 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.229+0000 7f3052ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3054107740 0x7f3054107b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:13.955 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.229+0000 7f3052ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3054107740 0x7f3054107b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46178/0 (socket says 172.21.15.7:46178) 2024-09-19T04:07:13.955 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.229+0000 7f3052ffd640 1 -- 172.21.15.7:0/2443837912 learned_addr learned my addr 172.21.15.7:0/2443837912 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:13.955 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.229+0000 7f3052ffd640 1 -- 172.21.15.7:0/2443837912 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30541088a0 con 0x7f3054107740 2024-09-19T04:07:13.955 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.230+0000 7f3052ffd640 1 --2- 172.21.15.7:0/2443837912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3054107740 0x7f3054107b40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3044009820 tx=0x7f304402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b766e536ab0ec0c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:13.955 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.230+0000 7f3051ffb640 1 -- 172.21.15.7:0/2443837912 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3044037070 con 0x7f3054107740 2024-09-19T04:07:13.955 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.230+0000 7f3051ffb640 1 -- 172.21.15.7:0/2443837912 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3044032900 con 0x7f3054107740 2024-09-19T04:07:13.955 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.230+0000 7f3051ffb640 1 -- 172.21.15.7:0/2443837912 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3044030850 con 0x7f3054107740 2024-09-19T04:07:13.955 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.230+0000 7f3059795640 1 -- 172.21.15.7:0/2443837912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3054107740 msgr2=0x7f3054107b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:13.955 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.230+0000 7f3059795640 1 --2- 172.21.15.7:0/2443837912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3054107740 0x7f3054107b40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3044009820 tx=0x7f304402a270 comp rx=0 tx=0).stop 2024-09-19T04:07:13.955 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.231+0000 7f3059795640 1 -- 172.21.15.7:0/2443837912 shutdown_connections 2024-09-19T04:07:13.955 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.231+0000 7f3059795640 1 --2- 172.21.15.7:0/2443837912 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3054107740 0x7f3054107b40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:13.955 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.231+0000 7f3059795640 1 -- 172.21.15.7:0/2443837912 >> 172.21.15.7:0/2443837912 conn(0x7f3054102eb0 msgr2=0x7f3054105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:13.956 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.231+0000 7f3059795640 1 -- 172.21.15.7:0/2443837912 shutdown_connections 2024-09-19T04:07:13.956 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.231+0000 7f3059795640 1 -- 172.21.15.7:0/2443837912 wait complete. 2024-09-19T04:07:13.956 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.231+0000 7f3059795640 1 Processor -- start 2024-09-19T04:07:13.956 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.231+0000 7f3059795640 1 -- start start 2024-09-19T04:07:13.956 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.232+0000 7f3059795640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3054107740 0x7f305419b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:13.956 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.232+0000 7f3059795640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f305410bc50 con 0x7f3054107740 2024-09-19T04:07:13.956 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.232+0000 7f3052ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3054107740 0x7f305419b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:13.956 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.232+0000 7f3052ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3054107740 0x7f305419b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46190/0 (socket says 172.21.15.7:46190) 2024-09-19T04:07:13.956 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.232+0000 7f3052ffd640 1 -- 172.21.15.7:0/2911054380 learned_addr learned my addr 172.21.15.7:0/2911054380 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:13.956 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.232+0000 7f3052ffd640 1 -- 172.21.15.7:0/2911054380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f305419bbf0 con 0x7f3054107740 2024-09-19T04:07:13.956 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.232+0000 7f3052ffd640 1 --2- 172.21.15.7:0/2911054380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3054107740 0x7f305419b6b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3044009940 tx=0x7f30440326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:13.956 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.232+0000 7f303bfff640 1 -- 172.21.15.7:0/2911054380 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3044042070 con 0x7f3054107740 2024-09-19T04:07:13.956 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.232+0000 7f303bfff640 1 -- 172.21.15.7:0/2911054380 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3044032be0 con 0x7f3054107740 2024-09-19T04:07:13.957 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.232+0000 7f3059795640 1 -- 172.21.15.7:0/2911054380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f305419be80 con 0x7f3054107740 2024-09-19T04:07:13.957 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.232+0000 7f303bfff640 1 -- 172.21.15.7:0/2911054380 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3044037040 con 0x7f3054107740 2024-09-19T04:07:13.957 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.233+0000 7f3059795640 1 -- 172.21.15.7:0/2911054380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f305419eb70 con 0x7f3054107740 2024-09-19T04:07:13.957 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.233+0000 7f303bfff640 1 -- 172.21.15.7:0/2911054380 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f3044045070 con 0x7f3054107740 2024-09-19T04:07:13.957 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.234+0000 7f303bfff640 1 --2- 172.21.15.7:0/2911054380 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f303c039160 0x7f303c03b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:13.957 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.234+0000 7f303bfff640 1 -- 172.21.15.7:0/2911054380 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f304406c3c0 con 0x7f3054107740 2024-09-19T04:07:13.957 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.234+0000 7f30527fc640 1 --2- 172.21.15.7:0/2911054380 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f303c039160 0x7f303c03b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:13.957 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.234+0000 7f3059795640 1 -- 172.21.15.7:0/2911054380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3054107bc0 con 0x7f3054107740 2024-09-19T04:07:13.957 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.234+0000 7f30527fc640 1 --2- 172.21.15.7:0/2911054380 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f303c039160 0x7f303c03b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f30480098c0 tx=0x7f3048006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:13.957 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.239+0000 7f303bfff640 1 -- 172.21.15.7:0/2911054380 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f304404b170 con 0x7f3054107740 2024-09-19T04:07:13.957 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.415+0000 7f3059795640 1 -- 172.21.15.7:0/2911054380 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f30541a0250 con 0x7f3054107740 2024-09-19T04:07:13.957 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.415+0000 7f303bfff640 1 -- 172.21.15.7:0/2911054380 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+427 (secure 0 0 0) 0x7f3044032d90 con 0x7f3054107740 2024-09-19T04:07:13.958 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.417+0000 7f3059795640 1 -- 172.21.15.7:0/2911054380 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f303c039160 msgr2=0x7f303c03b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:13.958 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.417+0000 7f3059795640 1 --2- 172.21.15.7:0/2911054380 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f303c039160 0x7f303c03b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f30480098c0 tx=0x7f3048006db0 comp rx=0 tx=0).stop 2024-09-19T04:07:13.958 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.417+0000 7f3059795640 1 -- 172.21.15.7:0/2911054380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3054107740 msgr2=0x7f305419b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:13.958 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.417+0000 7f3059795640 1 --2- 172.21.15.7:0/2911054380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3054107740 0x7f305419b6b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3044009940 tx=0x7f30440326e0 comp rx=0 tx=0).stop 2024-09-19T04:07:13.958 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.417+0000 7f3059795640 1 -- 172.21.15.7:0/2911054380 shutdown_connections 2024-09-19T04:07:13.958 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.418+0000 7f3059795640 1 --2- 172.21.15.7:0/2911054380 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f303c039160 0x7f303c03b620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:13.958 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.418+0000 7f3059795640 1 --2- 172.21.15.7:0/2911054380 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3054107740 0x7f305419b6b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:13.958 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.418+0000 7f3059795640 1 -- 172.21.15.7:0/2911054380 >> 172.21.15.7:0/2911054380 conn(0x7f3054102eb0 msgr2=0x7f3054103a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:13.958 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.418+0000 7f3059795640 1 -- 172.21.15.7:0/2911054380 shutdown_connections 2024-09-19T04:07:13.958 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:13.418+0000 7f3059795640 1 -- 172.21.15.7:0/2911054380 wait complete. 2024-09-19T04:07:13.958 INFO:teuthology.orchestra.run.smithi007.stdout:Enabling cephadm module... 2024-09-19T04:07:14.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:14 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2911054380' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T04:07:15.608 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:15 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/994467362' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T04:07:15.608 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:15 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: ignoring --setuser ceph since I am not root 2024-09-19T04:07:15.608 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:15 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: ignoring --setgroup ceph since I am not root 2024-09-19T04:07:15.608 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:15 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:15.456+0000 7f79206e3040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T04:07:15.608 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:15 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:15.515+0000 7f79206e3040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T04:07:15.877 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:15 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:15.670+0000 7f79206e3040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T04:07:15.877 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:15 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:15.739+0000 7f79206e3040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T04:07:15.890 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.354+0000 7f21f1ae1640 1 Processor -- start 2024-09-19T04:07:15.890 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.354+0000 7f21f1ae1640 1 -- start start 2024-09-19T04:07:15.890 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.354+0000 7f21f1ae1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21ec107740 0x7f21ec107b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:15.890 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.354+0000 7f21f1ae1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f21ec108110 con 0x7f21ec107740 2024-09-19T04:07:15.890 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.354+0000 7f21eb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21ec107740 0x7f21ec107b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:15.890 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.354+0000 7f21eb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21ec107740 0x7f21ec107b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46198/0 (socket says 172.21.15.7:46198) 2024-09-19T04:07:15.890 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.354+0000 7f21eb7fe640 1 -- 172.21.15.7:0/303998322 learned_addr learned my addr 172.21.15.7:0/303998322 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:15.890 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.355+0000 7f21eb7fe640 1 -- 172.21.15.7:0/303998322 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21ec1088a0 con 0x7f21ec107740 2024-09-19T04:07:15.891 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.355+0000 7f21eb7fe640 1 --2- 172.21.15.7:0/303998322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21ec107740 0x7f21ec107b40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f21dc009820 tx=0x7f21dc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60339ea0394e7a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:15.891 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.356+0000 7f21ea7fc640 1 -- 172.21.15.7:0/303998322 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21dc037070 con 0x7f21ec107740 2024-09-19T04:07:15.891 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.356+0000 7f21ea7fc640 1 -- 172.21.15.7:0/303998322 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f21dc032900 con 0x7f21ec107740 2024-09-19T04:07:15.891 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.356+0000 7f21ea7fc640 1 -- 172.21.15.7:0/303998322 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21dc030850 con 0x7f21ec107740 2024-09-19T04:07:15.891 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.356+0000 7f21f1ae1640 1 -- 172.21.15.7:0/303998322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21ec107740 msgr2=0x7f21ec107b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:15.891 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.356+0000 7f21f1ae1640 1 --2- 172.21.15.7:0/303998322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21ec107740 0x7f21ec107b40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f21dc009820 tx=0x7f21dc02a270 comp rx=0 tx=0).stop 2024-09-19T04:07:15.891 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.356+0000 7f21f1ae1640 1 -- 172.21.15.7:0/303998322 shutdown_connections 2024-09-19T04:07:15.891 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.356+0000 7f21f1ae1640 1 --2- 172.21.15.7:0/303998322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21ec107740 0x7f21ec107b40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:15.891 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.356+0000 7f21f1ae1640 1 -- 172.21.15.7:0/303998322 >> 172.21.15.7:0/303998322 conn(0x7f21ec102eb0 msgr2=0x7f21ec105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:15.891 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.356+0000 7f21f1ae1640 1 -- 172.21.15.7:0/303998322 shutdown_connections 2024-09-19T04:07:15.891 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.356+0000 7f21f1ae1640 1 -- 172.21.15.7:0/303998322 wait complete. 2024-09-19T04:07:15.891 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.357+0000 7f21f1ae1640 1 Processor -- start 2024-09-19T04:07:15.891 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.357+0000 7f21f1ae1640 1 -- start start 2024-09-19T04:07:15.892 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.357+0000 7f21f1ae1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21ec107740 0x7f21ec19b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:15.892 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.357+0000 7f21f1ae1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f21ec10bc50 con 0x7f21ec107740 2024-09-19T04:07:15.892 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.357+0000 7f21eb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21ec107740 0x7f21ec19b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:15.892 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.357+0000 7f21eb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21ec107740 0x7f21ec19b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46206/0 (socket says 172.21.15.7:46206) 2024-09-19T04:07:15.892 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.357+0000 7f21eb7fe640 1 -- 172.21.15.7:0/994467362 learned_addr learned my addr 172.21.15.7:0/994467362 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:15.892 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.357+0000 7f21eb7fe640 1 -- 172.21.15.7:0/994467362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21ec19bb90 con 0x7f21ec107740 2024-09-19T04:07:15.892 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.358+0000 7f21eb7fe640 1 --2- 172.21.15.7:0/994467362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21ec107740 0x7f21ec19b650 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f21dc009940 tx=0x7f21dc0326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:15.892 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.358+0000 7f21e8ff9640 1 -- 172.21.15.7:0/994467362 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21dc042070 con 0x7f21ec107740 2024-09-19T04:07:15.892 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.358+0000 7f21f1ae1640 1 -- 172.21.15.7:0/994467362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21ec19be20 con 0x7f21ec107740 2024-09-19T04:07:15.892 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.358+0000 7f21e8ff9640 1 -- 172.21.15.7:0/994467362 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f21dc032be0 con 0x7f21ec107740 2024-09-19T04:07:15.892 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.358+0000 7f21e8ff9640 1 -- 172.21.15.7:0/994467362 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21dc037040 con 0x7f21ec107740 2024-09-19T04:07:15.893 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.358+0000 7f21f1ae1640 1 -- 172.21.15.7:0/994467362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21ec19eb10 con 0x7f21ec107740 2024-09-19T04:07:15.893 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.359+0000 7f21e8ff9640 1 -- 172.21.15.7:0/994467362 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f21dc045070 con 0x7f21ec107740 2024-09-19T04:07:15.893 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.359+0000 7f21f1ae1640 1 -- 172.21.15.7:0/994467362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21ec107bc0 con 0x7f21ec107740 2024-09-19T04:07:15.893 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.359+0000 7f21e8ff9640 1 --2- 172.21.15.7:0/994467362 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f21d4039160 0x7f21d403b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:15.893 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.359+0000 7f21e8ff9640 1 -- 172.21.15.7:0/994467362 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f21dc06c100 con 0x7f21ec107740 2024-09-19T04:07:15.893 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.359+0000 7f21eaffd640 1 --2- 172.21.15.7:0/994467362 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f21d4039160 0x7f21d403b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:15.893 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.359+0000 7f21eaffd640 1 --2- 172.21.15.7:0/994467362 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f21d4039160 0x7f21d403b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f21e00098c0 tx=0x7f21e0006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:15.893 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.364+0000 7f21e8ff9640 1 -- 172.21.15.7:0/994467362 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f21dc032d90 con 0x7f21ec107740 2024-09-19T04:07:15.893 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:14.588+0000 7f21f1ae1640 1 -- 172.21.15.7:0/994467362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f21ec19f190 con 0x7f21ec107740 2024-09-19T04:07:15.893 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:15.305+0000 7f21e8ff9640 1 -- 172.21.15.7:0/994467362 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f21dc02ed90 con 0x7f21ec107740 2024-09-19T04:07:15.893 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:15.307+0000 7f21e8ff9640 1 -- 172.21.15.7:0/994467362 <== mon.0 v2:172.21.15.7:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f21dc03b330 con 0x7f21ec107740 2024-09-19T04:07:15.893 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:15.308+0000 7f21f1ae1640 1 -- 172.21.15.7:0/994467362 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f21d4039160 msgr2=0x7f21d403b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:15.894 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:15.308+0000 7f21f1ae1640 1 --2- 172.21.15.7:0/994467362 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f21d4039160 0x7f21d403b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f21e00098c0 tx=0x7f21e0006db0 comp rx=0 tx=0).stop 2024-09-19T04:07:15.894 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:15.308+0000 7f21f1ae1640 1 -- 172.21.15.7:0/994467362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21ec107740 msgr2=0x7f21ec19b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:15.894 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:15.308+0000 7f21f1ae1640 1 --2- 172.21.15.7:0/994467362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21ec107740 0x7f21ec19b650 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f21dc009940 tx=0x7f21dc0326e0 comp rx=0 tx=0).stop 2024-09-19T04:07:15.894 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:15.308+0000 7f21f1ae1640 1 -- 172.21.15.7:0/994467362 shutdown_connections 2024-09-19T04:07:15.894 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:15.308+0000 7f21f1ae1640 1 --2- 172.21.15.7:0/994467362 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f21d4039160 0x7f21d403b620 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:15.894 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:15.308+0000 7f21f1ae1640 1 --2- 172.21.15.7:0/994467362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21ec107740 0x7f21ec19b650 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:15.894 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:15.308+0000 7f21f1ae1640 1 -- 172.21.15.7:0/994467362 >> 172.21.15.7:0/994467362 conn(0x7f21ec102eb0 msgr2=0x7f21ec103ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:15.894 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:15.309+0000 7f21f1ae1640 1 -- 172.21.15.7:0/994467362 shutdown_connections 2024-09-19T04:07:15.894 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:15.309+0000 7f21f1ae1640 1 -- 172.21.15.7:0/994467362 wait complete. 2024-09-19T04:07:16.148 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:15 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:15.895+0000 7f79206e3040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:07:16.148 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:16 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:16.048+0000 7f79206e3040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T04:07:16.447 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:16 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/994467362' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T04:07:16.447 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:16 smithi007 ceph-mon[31360]: mgrmap e5: x(active, since 5s) 2024-09-19T04:07:16.447 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:16 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:16.381+0000 7f79206e3040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T04:07:16.447 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:16 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:16.445+0000 7f79206e3040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T04:07:16.856 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:16 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:16.643+0000 7f79206e3040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T04:07:17.073 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-19T04:07:17.073 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-19T04:07:17.073 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T04:07:17.073 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T04:07:17.073 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T04:07:17.073 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-19T04:07:17.073 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.322+0000 7fb7d331c640 1 Processor -- start 2024-09-19T04:07:17.073 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.322+0000 7fb7d331c640 1 -- start start 2024-09-19T04:07:17.073 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.323+0000 7fb7d331c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7cc1080f0 0x7fb7cc10a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:17.074 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.323+0000 7fb7d331c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb7cc07be50 con 0x7fb7cc1080f0 2024-09-19T04:07:17.074 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.323+0000 7fb7d10b8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7cc1080f0 0x7fb7cc10a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:17.074 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.323+0000 7fb7d10b8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7cc1080f0 0x7fb7cc10a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46226/0 (socket says 172.21.15.7:46226) 2024-09-19T04:07:17.074 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.323+0000 7fb7d10b8640 1 -- 172.21.15.7:0/4033711276 learned_addr learned my addr 172.21.15.7:0/4033711276 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:17.074 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.323+0000 7fb7d10b8640 1 -- 172.21.15.7:0/4033711276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7cc10aa20 con 0x7fb7cc1080f0 2024-09-19T04:07:17.074 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.324+0000 7fb7d10b8640 1 --2- 172.21.15.7:0/4033711276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7cc1080f0 0x7fb7cc10a4e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8009820 tx=0x7fb7c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e343a0d34cdc313e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:17.074 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.324+0000 7fb7c3fff640 1 -- 172.21.15.7:0/4033711276 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7c8037070 con 0x7fb7cc1080f0 2024-09-19T04:07:17.074 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.324+0000 7fb7c3fff640 1 -- 172.21.15.7:0/4033711276 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb7c8032900 con 0x7fb7cc1080f0 2024-09-19T04:07:17.074 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.324+0000 7fb7c3fff640 1 -- 172.21.15.7:0/4033711276 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7c8030850 con 0x7fb7cc1080f0 2024-09-19T04:07:17.074 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.325+0000 7fb7d331c640 1 -- 172.21.15.7:0/4033711276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7cc1080f0 msgr2=0x7fb7cc10a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:17.074 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.325+0000 7fb7d331c640 1 --2- 172.21.15.7:0/4033711276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7cc1080f0 0x7fb7cc10a4e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8009820 tx=0x7fb7c802a270 comp rx=0 tx=0).stop 2024-09-19T04:07:17.074 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.325+0000 7fb7d331c640 1 -- 172.21.15.7:0/4033711276 shutdown_connections 2024-09-19T04:07:17.074 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.325+0000 7fb7d331c640 1 --2- 172.21.15.7:0/4033711276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7cc1080f0 0x7fb7cc10a4e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:17.074 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.325+0000 7fb7d331c640 1 -- 172.21.15.7:0/4033711276 >> 172.21.15.7:0/4033711276 conn(0x7fb7cc101db0 msgr2=0x7fb7cc1041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:17.075 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.325+0000 7fb7d331c640 1 -- 172.21.15.7:0/4033711276 shutdown_connections 2024-09-19T04:07:17.075 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.325+0000 7fb7d331c640 1 -- 172.21.15.7:0/4033711276 wait complete. 2024-09-19T04:07:17.075 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.325+0000 7fb7d331c640 1 Processor -- start 2024-09-19T04:07:17.075 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.326+0000 7fb7d331c640 1 -- start start 2024-09-19T04:07:17.075 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.326+0000 7fb7d331c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7cc1080f0 0x7fb7cc107970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:17.075 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.326+0000 7fb7d331c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb7cc10ba60 con 0x7fb7cc1080f0 2024-09-19T04:07:17.075 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.326+0000 7fb7d10b8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7cc1080f0 0x7fb7cc107970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:17.075 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.326+0000 7fb7d10b8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7cc1080f0 0x7fb7cc107970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46234/0 (socket says 172.21.15.7:46234) 2024-09-19T04:07:17.075 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.326+0000 7fb7d10b8640 1 -- 172.21.15.7:0/3802545314 learned_addr learned my addr 172.21.15.7:0/3802545314 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:17.075 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.326+0000 7fb7d10b8640 1 -- 172.21.15.7:0/3802545314 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7cc107eb0 con 0x7fb7cc1080f0 2024-09-19T04:07:17.075 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.326+0000 7fb7d10b8640 1 --2- 172.21.15.7:0/3802545314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7cc1080f0 0x7fb7cc107970 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8032ce0 tx=0x7fb7c8032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:17.075 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.326+0000 7fb7c27fc640 1 -- 172.21.15.7:0/3802545314 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7c8042070 con 0x7fb7cc1080f0 2024-09-19T04:07:17.075 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.326+0000 7fb7c27fc640 1 -- 172.21.15.7:0/3802545314 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb7c80308c0 con 0x7fb7cc1080f0 2024-09-19T04:07:17.075 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.327+0000 7fb7d331c640 1 -- 172.21.15.7:0/3802545314 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7cc1060a0 con 0x7fb7cc1080f0 2024-09-19T04:07:17.075 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.327+0000 7fb7d331c640 1 -- 172.21.15.7:0/3802545314 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7cc1065e0 con 0x7fb7cc1080f0 2024-09-19T04:07:17.076 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.327+0000 7fb7c27fc640 1 -- 172.21.15.7:0/3802545314 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7c8037040 con 0x7fb7cc1080f0 2024-09-19T04:07:17.076 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.328+0000 7fb7c27fc640 1 -- 172.21.15.7:0/3802545314 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fb7c8045070 con 0x7fb7cc1080f0 2024-09-19T04:07:17.076 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.328+0000 7fb7d331c640 1 -- 172.21.15.7:0/3802545314 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7b00052c0 con 0x7fb7cc1080f0 2024-09-19T04:07:17.076 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.328+0000 7fb7c27fc640 1 --2- 172.21.15.7:0/3802545314 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7fb7b80391b0 0x7fb7b803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:17.076 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.328+0000 7fb7c27fc640 1 -- 172.21.15.7:0/3802545314 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb7c806c2d0 con 0x7fb7cc1080f0 2024-09-19T04:07:17.076 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.328+0000 7fb7d08b7640 1 -- 172.21.15.7:0/3802545314 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7fb7b80391b0 msgr2=0x7fb7b803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/940106179 2024-09-19T04:07:17.076 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.328+0000 7fb7d08b7640 1 --2- 172.21.15.7:0/3802545314 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7fb7b80391b0 0x7fb7b803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T04:07:17.076 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.333+0000 7fb7c27fc640 1 -- 172.21.15.7:0/3802545314 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb7c803cdd0 con 0x7fb7cc1080f0 2024-09-19T04:07:17.076 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.529+0000 7fb7d08b7640 1 -- 172.21.15.7:0/3802545314 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7fb7b80391b0 msgr2=0x7fb7b803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/940106179 2024-09-19T04:07:17.076 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.529+0000 7fb7d08b7640 1 --2- 172.21.15.7:0/3802545314 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7fb7b80391b0 0x7fb7b803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T04:07:17.076 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.560+0000 7fb7d331c640 1 -- 172.21.15.7:0/3802545314 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fb7b0005dc0 con 0x7fb7cc1080f0 2024-09-19T04:07:17.076 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.561+0000 7fb7c27fc640 1 -- 172.21.15.7:0/3802545314 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fb7c803c850 con 0x7fb7cc1080f0 2024-09-19T04:07:17.076 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.563+0000 7fb7d331c640 1 -- 172.21.15.7:0/3802545314 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7fb7b80391b0 msgr2=0x7fb7b803b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T04:07:17.076 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.563+0000 7fb7d331c640 1 --2- 172.21.15.7:0/3802545314 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7fb7b80391b0 0x7fb7b803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:17.077 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.563+0000 7fb7d331c640 1 -- 172.21.15.7:0/3802545314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7cc1080f0 msgr2=0x7fb7cc107970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:17.077 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.563+0000 7fb7d331c640 1 --2- 172.21.15.7:0/3802545314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7cc1080f0 0x7fb7cc107970 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8032ce0 tx=0x7fb7c8032d10 comp rx=0 tx=0).stop 2024-09-19T04:07:17.077 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.563+0000 7fb7d331c640 1 -- 172.21.15.7:0/3802545314 shutdown_connections 2024-09-19T04:07:17.077 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.563+0000 7fb7d331c640 1 --2- 172.21.15.7:0/3802545314 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7fb7b80391b0 0x7fb7b803b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:17.077 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.563+0000 7fb7d331c640 1 --2- 172.21.15.7:0/3802545314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7cc1080f0 0x7fb7cc107970 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:17.077 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.563+0000 7fb7d331c640 1 -- 172.21.15.7:0/3802545314 >> 172.21.15.7:0/3802545314 conn(0x7fb7cc101db0 msgr2=0x7fb7cc102910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:17.077 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.563+0000 7fb7d331c640 1 -- 172.21.15.7:0/3802545314 shutdown_connections 2024-09-19T04:07:17.077 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:16.563+0000 7fb7d331c640 1 -- 172.21.15.7:0/3802545314 wait complete. 2024-09-19T04:07:17.077 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for the mgr to restart... 2024-09-19T04:07:17.077 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mgr epoch 5... 2024-09-19T04:07:17.476 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:17 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3802545314' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T04:07:17.877 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:17 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:17.585+0000 7f79206e3040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T04:07:17.877 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:17 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:17.655+0000 7f79206e3040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T04:07:18.669 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:18 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:18.399+0000 7f79206e3040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T04:07:18.669 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:18 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:18.519+0000 7f79206e3040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T04:07:18.959 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:18 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:18.667+0000 7f79206e3040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:07:18.959 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:18 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:18.731+0000 7f79206e3040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T04:07:18.959 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:18 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:18.887+0000 7f79206e3040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T04:07:18.959 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:18 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:18.957+0000 7f79206e3040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T04:07:19.254 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:19 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:19.020+0000 7f79206e3040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T04:07:19.254 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:19 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:19.184+0000 7f79206e3040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T04:07:19.254 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:19 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:19.252+0000 7f79206e3040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T04:07:19.532 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:19 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:19.322+0000 7f79206e3040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T04:07:19.533 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:19 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:19.408+0000 7f79206e3040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T04:07:19.533 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:19 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:19.469+0000 7f79206e3040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T04:07:19.533 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:19 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:19.531+0000 7f79206e3040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T04:07:20.548 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:20 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:20.361+0000 7f79206e3040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T04:07:20.548 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:20 smithi007 ceph-mon[31360]: Active manager daemon x restarted 2024-09-19T04:07:20.549 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:20 smithi007 ceph-mon[31360]: Activating manager daemon x 2024-09-19T04:07:20.549 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:20 smithi007 ceph-mon[31360]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T04:07:20.549 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:20 smithi007 ceph-mon[31360]: mgrmap e6: x(active, starting, since 0.00360594s) 2024-09-19T04:07:20.549 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:20 smithi007 ceph-mon[31360]: from='mgr.14118 172.21.15.7:0/3147503308' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:07:20.549 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:20 smithi007 ceph-mon[31360]: from='mgr.14118 172.21.15.7:0/3147503308' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T04:07:20.549 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:20 smithi007 ceph-mon[31360]: from='mgr.14118 172.21.15.7:0/3147503308' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T04:07:20.549 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:20 smithi007 ceph-mon[31360]: from='mgr.14118 172.21.15.7:0/3147503308' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T04:07:20.549 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:20 smithi007 ceph-mon[31360]: from='mgr.14118 172.21.15.7:0/3147503308' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T04:07:20.549 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:20 smithi007 ceph-mon[31360]: Manager daemon x is now available 2024-09-19T04:07:20.549 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:20 smithi007 ceph-mon[31360]: from='mgr.14118 172.21.15.7:0/3147503308' entity='mgr.x' 2024-09-19T04:07:20.549 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:20 smithi007 ceph-mon[31360]: from='mgr.14118 172.21.15.7:0/3147503308' entity='mgr.x' 2024-09-19T04:07:20.549 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:20 smithi007 ceph-mon[31360]: from='mgr.14118 172.21.15.7:0/3147503308' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:07:20.550 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:20 smithi007 ceph-mon[31360]: from='mgr.14118 172.21.15.7:0/3147503308' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:07:20.550 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:20 smithi007 ceph-mon[31360]: from='mgr.14118 172.21.15.7:0/3147503308' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T04:07:20.550 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:20 smithi007 ceph-mon[31360]: from='mgr.14118 172.21.15.7:0/3147503308' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T04:07:22.031 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-19T04:07:22.031 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-19T04:07:22.031 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T04:07:22.031 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-19T04:07:22.032 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.480+0000 7f32c5a79640 1 Processor -- start 2024-09-19T04:07:22.032 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.480+0000 7f32c5a79640 1 -- start start 2024-09-19T04:07:22.032 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.480+0000 7f32c5a79640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32c01080e0 0x7f32c010a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:22.032 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.480+0000 7f32c5a79640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f32c007be00 con 0x7f32c01080e0 2024-09-19T04:07:22.032 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.481+0000 7f32bf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32c01080e0 0x7f32c010a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:22.032 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.481+0000 7f32bf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32c01080e0 0x7f32c010a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42296/0 (socket says 172.21.15.7:42296) 2024-09-19T04:07:22.032 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.481+0000 7f32bf7fe640 1 -- 172.21.15.7:0/4200459730 learned_addr learned my addr 172.21.15.7:0/4200459730 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:22.032 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.481+0000 7f32bf7fe640 1 -- 172.21.15.7:0/4200459730 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c010aa10 con 0x7f32c01080e0 2024-09-19T04:07:22.032 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.482+0000 7f32bf7fe640 1 --2- 172.21.15.7:0/4200459730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32c01080e0 0x7f32c010a4d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f32b0009820 tx=0x7f32b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693690b4d5d3e5d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:22.032 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.482+0000 7f32be7fc640 1 -- 172.21.15.7:0/4200459730 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32b0037070 con 0x7f32c01080e0 2024-09-19T04:07:22.032 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.482+0000 7f32be7fc640 1 -- 172.21.15.7:0/4200459730 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f32b0032900 con 0x7f32c01080e0 2024-09-19T04:07:22.032 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.482+0000 7f32be7fc640 1 -- 172.21.15.7:0/4200459730 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32b0030850 con 0x7f32c01080e0 2024-09-19T04:07:22.033 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.483+0000 7f32c5a79640 1 -- 172.21.15.7:0/4200459730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32c01080e0 msgr2=0x7f32c010a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:22.033 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.483+0000 7f32c5a79640 1 --2- 172.21.15.7:0/4200459730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32c01080e0 0x7f32c010a4d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f32b0009820 tx=0x7f32b002a270 comp rx=0 tx=0).stop 2024-09-19T04:07:22.033 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.483+0000 7f32c5a79640 1 -- 172.21.15.7:0/4200459730 shutdown_connections 2024-09-19T04:07:22.033 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.483+0000 7f32c5a79640 1 --2- 172.21.15.7:0/4200459730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32c01080e0 0x7f32c010a4d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:22.033 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.483+0000 7f32c5a79640 1 -- 172.21.15.7:0/4200459730 >> 172.21.15.7:0/4200459730 conn(0x7f32c0101ca0 msgr2=0x7f32c01040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:22.033 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.483+0000 7f32c5a79640 1 -- 172.21.15.7:0/4200459730 shutdown_connections 2024-09-19T04:07:22.033 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.483+0000 7f32c5a79640 1 -- 172.21.15.7:0/4200459730 wait complete. 2024-09-19T04:07:22.033 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.483+0000 7f32c5a79640 1 Processor -- start 2024-09-19T04:07:22.033 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.484+0000 7f32c5a79640 1 -- start start 2024-09-19T04:07:22.033 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.484+0000 7f32c5a79640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32c01080e0 0x7f32c019b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:22.033 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.484+0000 7f32c5a79640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f32c010b9f0 con 0x7f32c01080e0 2024-09-19T04:07:22.033 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.484+0000 7f32bf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32c01080e0 0x7f32c019b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:22.034 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.484+0000 7f32bf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32c01080e0 0x7f32c019b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42306/0 (socket says 172.21.15.7:42306) 2024-09-19T04:07:22.034 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.484+0000 7f32bf7fe640 1 -- 172.21.15.7:0/1356116577 learned_addr learned my addr 172.21.15.7:0/1356116577 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:22.034 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.484+0000 7f32bf7fe640 1 -- 172.21.15.7:0/1356116577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c019bac0 con 0x7f32c01080e0 2024-09-19T04:07:22.034 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.485+0000 7f32bf7fe640 1 --2- 172.21.15.7:0/1356116577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32c01080e0 0x7f32c019b580 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f32b0032ce0 tx=0x7f32b0032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:22.034 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.485+0000 7f32bcff9640 1 -- 172.21.15.7:0/1356116577 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32b0042070 con 0x7f32c01080e0 2024-09-19T04:07:22.034 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.485+0000 7f32c5a79640 1 -- 172.21.15.7:0/1356116577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32c019bd50 con 0x7f32c01080e0 2024-09-19T04:07:22.034 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.485+0000 7f32bcff9640 1 -- 172.21.15.7:0/1356116577 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f32b00308c0 con 0x7f32c01080e0 2024-09-19T04:07:22.034 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.485+0000 7f32bcff9640 1 -- 172.21.15.7:0/1356116577 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32b0037040 con 0x7f32c01080e0 2024-09-19T04:07:22.034 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.485+0000 7f32c5a79640 1 -- 172.21.15.7:0/1356116577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32c019ea40 con 0x7f32c01080e0 2024-09-19T04:07:22.034 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.486+0000 7f32bcff9640 1 -- 172.21.15.7:0/1356116577 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f32b0045070 con 0x7f32c01080e0 2024-09-19T04:07:22.034 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.486+0000 7f32bcff9640 1 --2- 172.21.15.7:0/1356116577 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f32ac0391b0 0x7f32ac03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:22.034 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.486+0000 7f32bcff9640 1 -- 172.21.15.7:0/1356116577 --> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f32ac03bd80 con 0x7f32ac0391b0 2024-09-19T04:07:22.034 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.486+0000 7f32bcff9640 1 -- 172.21.15.7:0/1356116577 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f32b006c280 con 0x7f32c01080e0 2024-09-19T04:07:22.035 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.486+0000 7f32beffd640 1 -- 172.21.15.7:0/1356116577 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f32ac0391b0 msgr2=0x7f32ac03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/940106179 2024-09-19T04:07:22.035 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.486+0000 7f32beffd640 1 --2- 172.21.15.7:0/1356116577 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f32ac0391b0 0x7f32ac03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T04:07:22.035 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.687+0000 7f32beffd640 1 -- 172.21.15.7:0/1356116577 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f32ac0391b0 msgr2=0x7f32ac03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/940106179 2024-09-19T04:07:22.035 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:17.687+0000 7f32beffd640 1 --2- 172.21.15.7:0/1356116577 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f32ac0391b0 0x7f32ac03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T04:07:22.035 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:18.088+0000 7f32beffd640 1 -- 172.21.15.7:0/1356116577 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f32ac0391b0 msgr2=0x7f32ac03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/940106179 2024-09-19T04:07:22.035 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:18.088+0000 7f32beffd640 1 --2- 172.21.15.7:0/1356116577 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f32ac0391b0 0x7f32ac03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T04:07:22.035 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:18.889+0000 7f32beffd640 1 -- 172.21.15.7:0/1356116577 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f32ac0391b0 msgr2=0x7f32ac03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/940106179 2024-09-19T04:07:22.035 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:18.889+0000 7f32beffd640 1 --2- 172.21.15.7:0/1356116577 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f32ac0391b0 0x7f32ac03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T04:07:22.035 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:20.365+0000 7f32bcff9640 1 -- 172.21.15.7:0/1356116577 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7f32b006ae00 con 0x7f32c01080e0 2024-09-19T04:07:22.035 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:20.365+0000 7f32bcff9640 1 -- 172.21.15.7:0/1356116577 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f32ac0391b0 msgr2=0x7f32ac03b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T04:07:22.035 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:20.365+0000 7f32bcff9640 1 --2- 172.21.15.7:0/1356116577 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f32ac0391b0 0x7f32ac03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:22.035 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:21.366+0000 7f32bcff9640 1 -- 172.21.15.7:0/1356116577 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f32b003cd00 con 0x7f32c01080e0 2024-09-19T04:07:22.036 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:21.367+0000 7f32bcff9640 1 --2- 172.21.15.7:0/1356116577 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f32ac03cae0 0x7f32ac03eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:22.036 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:21.367+0000 7f32bcff9640 1 -- 172.21.15.7:0/1356116577 --> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f32b003ae30 con 0x7f32ac03cae0 2024-09-19T04:07:22.036 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:21.368+0000 7f32beffd640 1 --2- 172.21.15.7:0/1356116577 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f32ac03cae0 0x7f32ac03eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:22.036 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:21.368+0000 7f32beffd640 1 --2- 172.21.15.7:0/1356116577 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f32ac03cae0 0x7f32ac03eed0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f32a8003980 tx=0x7f32a8006e10 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:22.036 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:21.369+0000 7f32bcff9640 1 -- 172.21.15.7:0/1356116577 <== mgr.14118 v2:172.21.15.7:6800/751091002 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f32b003ae30 con 0x7f32ac03cae0 2024-09-19T04:07:22.036 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:21.376+0000 7f32c5a79640 1 -- 172.21.15.7:0/1356116577 --> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f32c0108540 con 0x7f32ac03cae0 2024-09-19T04:07:22.036 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:21.376+0000 7f32bcff9640 1 -- 172.21.15.7:0/1356116577 <== mgr.14118 v2:172.21.15.7:6800/751091002 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f32c0108540 con 0x7f32ac03cae0 2024-09-19T04:07:22.036 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:21.377+0000 7f32c5a79640 1 -- 172.21.15.7:0/1356116577 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f32ac03cae0 msgr2=0x7f32ac03eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:22.036 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:21.377+0000 7f32c5a79640 1 --2- 172.21.15.7:0/1356116577 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f32ac03cae0 0x7f32ac03eed0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f32a8003980 tx=0x7f32a8006e10 comp rx=0 tx=0).stop 2024-09-19T04:07:22.036 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:21.377+0000 7f32c5a79640 1 -- 172.21.15.7:0/1356116577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32c01080e0 msgr2=0x7f32c019b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:22.036 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:21.377+0000 7f32c5a79640 1 --2- 172.21.15.7:0/1356116577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32c01080e0 0x7f32c019b580 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f32b0032ce0 tx=0x7f32b0032d10 comp rx=0 tx=0).stop 2024-09-19T04:07:22.036 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:21.377+0000 7f32c5a79640 1 -- 172.21.15.7:0/1356116577 shutdown_connections 2024-09-19T04:07:22.036 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:21.377+0000 7f32c5a79640 1 --2- 172.21.15.7:0/1356116577 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f32ac03cae0 0x7f32ac03eed0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:22.037 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:21.377+0000 7f32c5a79640 1 --2- 172.21.15.7:0/1356116577 >> [v2:172.21.15.7:6800/940106179,v1:172.21.15.7:6801/940106179] conn(0x7f32ac0391b0 0x7f32ac03b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:22.037 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:21.377+0000 7f32c5a79640 1 --2- 172.21.15.7:0/1356116577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32c01080e0 0x7f32c019b580 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:22.037 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:21.377+0000 7f32c5a79640 1 -- 172.21.15.7:0/1356116577 >> 172.21.15.7:0/1356116577 conn(0x7f32c0101ca0 msgr2=0x7f32c0102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:22.037 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:21.377+0000 7f32c5a79640 1 -- 172.21.15.7:0/1356116577 shutdown_connections 2024-09-19T04:07:22.037 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:21.377+0000 7f32c5a79640 1 -- 172.21.15.7:0/1356116577 wait complete. 2024-09-19T04:07:22.037 INFO:teuthology.orchestra.run.smithi007.stdout:mgr epoch 5 is available 2024-09-19T04:07:22.037 INFO:teuthology.orchestra.run.smithi007.stdout:Setting orchestrator backend to cephadm... 2024-09-19T04:07:22.413 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:22 smithi007 ceph-mon[31360]: Found migration_current of "None". Setting to last migration. 2024-09-19T04:07:22.413 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:22 smithi007 ceph-mon[31360]: from='mgr.14118 172.21.15.7:0/3147503308' entity='mgr.x' 2024-09-19T04:07:22.413 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:22 smithi007 ceph-mon[31360]: from='mgr.14118 172.21.15.7:0/3147503308' entity='mgr.x' 2024-09-19T04:07:22.414 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:22 smithi007 ceph-mon[31360]: mgrmap e7: x(active, since 1.0059s) 2024-09-19T04:07:23.211 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:22 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:22.884+0000 7f788d208640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:04:07:22] ENGINE Error in HTTPServer.serve 2024-09-19T04:07:23.211 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:22 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: Traceback (most recent call last): 2024-09-19T04:07:23.211 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:22 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T04:07:23.211 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:22 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: self._connections.run(self.expiration_interval) 2024-09-19T04:07:23.212 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:22 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T04:07:23.212 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:22 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: self._run(expiration_interval) 2024-09-19T04:07:23.212 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:22 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T04:07:23.212 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:22 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T04:07:23.212 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:22 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T04:07:23.212 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:22 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T04:07:23.212 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:22 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T04:07:23.212 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:22 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: s = self.context.wrap_socket( 2024-09-19T04:07:23.212 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:22 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T04:07:23.212 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:22 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: return self.sslsocket_class._create( 2024-09-19T04:07:23.212 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:22 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T04:07:23.212 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:22 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: self.do_handshake() 2024-09-19T04:07:23.212 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:22 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T04:07:23.213 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:22 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: self._sslobj.do_handshake() 2024-09-19T04:07:23.213 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:22 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T04:07:23.213 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:22 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:23.218 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.412+0000 7fb04f868640 1 Processor -- start 2024-09-19T04:07:23.218 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.412+0000 7fb04f868640 1 -- start start 2024-09-19T04:07:23.218 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.412+0000 7fb04f868640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb048105910 0x7fb048105d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:23.218 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.412+0000 7fb04f868640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb0481062e0 con 0x7fb048105910 2024-09-19T04:07:23.218 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.412+0000 7fb04d604640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb048105910 0x7fb048105d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:23.218 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.412+0000 7fb04d604640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb048105910 0x7fb048105d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42378/0 (socket says 172.21.15.7:42378) 2024-09-19T04:07:23.218 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.412+0000 7fb04d604640 1 -- 172.21.15.7:0/2610946733 learned_addr learned my addr 172.21.15.7:0/2610946733 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:23.218 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.413+0000 7fb04d604640 1 -- 172.21.15.7:0/2610946733 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb048106460 con 0x7fb048105910 2024-09-19T04:07:23.218 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.413+0000 7fb04d604640 1 --2- 172.21.15.7:0/2610946733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb048105910 0x7fb048105d10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb044009820 tx=0x7fb04402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7dbb9dd95a2dc4f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:23.218 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.414+0000 7fb03ffff640 1 -- 172.21.15.7:0/2610946733 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb044037070 con 0x7fb048105910 2024-09-19T04:07:23.219 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.414+0000 7fb03ffff640 1 -- 172.21.15.7:0/2610946733 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb044032900 con 0x7fb048105910 2024-09-19T04:07:23.219 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.414+0000 7fb03ffff640 1 -- 172.21.15.7:0/2610946733 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb044030850 con 0x7fb048105910 2024-09-19T04:07:23.219 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.414+0000 7fb04f868640 1 -- 172.21.15.7:0/2610946733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb048105910 msgr2=0x7fb048105d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:23.219 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.414+0000 7fb04f868640 1 --2- 172.21.15.7:0/2610946733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb048105910 0x7fb048105d10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb044009820 tx=0x7fb04402a270 comp rx=0 tx=0).stop 2024-09-19T04:07:23.219 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.414+0000 7fb04f868640 1 -- 172.21.15.7:0/2610946733 shutdown_connections 2024-09-19T04:07:23.219 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.414+0000 7fb04f868640 1 --2- 172.21.15.7:0/2610946733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb048105910 0x7fb048105d10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:23.219 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.414+0000 7fb04f868640 1 -- 172.21.15.7:0/2610946733 >> 172.21.15.7:0/2610946733 conn(0x7fb048101510 msgr2=0x7fb048103930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:23.219 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.414+0000 7fb04f868640 1 -- 172.21.15.7:0/2610946733 shutdown_connections 2024-09-19T04:07:23.219 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.414+0000 7fb04f868640 1 -- 172.21.15.7:0/2610946733 wait complete. 2024-09-19T04:07:23.219 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.415+0000 7fb04f868640 1 Processor -- start 2024-09-19T04:07:23.219 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.415+0000 7fb04f868640 1 -- start start 2024-09-19T04:07:23.219 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.415+0000 7fb04f868640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb048105910 0x7fb0481081c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:23.219 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.415+0000 7fb04f868640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb04810bb70 con 0x7fb048105910 2024-09-19T04:07:23.220 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.415+0000 7fb04d604640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb048105910 0x7fb0481081c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:23.220 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.415+0000 7fb04d604640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb048105910 0x7fb0481081c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42380/0 (socket says 172.21.15.7:42380) 2024-09-19T04:07:23.220 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.415+0000 7fb04d604640 1 -- 172.21.15.7:0/238104075 learned_addr learned my addr 172.21.15.7:0/238104075 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:23.220 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.416+0000 7fb04d604640 1 -- 172.21.15.7:0/238104075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb048108700 con 0x7fb048105910 2024-09-19T04:07:23.220 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.416+0000 7fb04d604640 1 --2- 172.21.15.7:0/238104075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb048105910 0x7fb0481081c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb0440097f0 tx=0x7fb044030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:23.220 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.416+0000 7fb03e7fc640 1 -- 172.21.15.7:0/238104075 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb044037040 con 0x7fb048105910 2024-09-19T04:07:23.220 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.416+0000 7fb03e7fc640 1 -- 172.21.15.7:0/238104075 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb044040070 con 0x7fb048105910 2024-09-19T04:07:23.220 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.416+0000 7fb04f868640 1 -- 172.21.15.7:0/238104075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0481068f0 con 0x7fb048105910 2024-09-19T04:07:23.220 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.416+0000 7fb03e7fc640 1 -- 172.21.15.7:0/238104075 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb04403a390 con 0x7fb048105910 2024-09-19T04:07:23.220 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.416+0000 7fb04f868640 1 -- 172.21.15.7:0/238104075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb048106dd0 con 0x7fb048105910 2024-09-19T04:07:23.220 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.417+0000 7fb04f868640 1 -- 172.21.15.7:0/238104075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb048105d90 con 0x7fb048105910 2024-09-19T04:07:23.220 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.417+0000 7fb03e7fc640 1 -- 172.21.15.7:0/238104075 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7fb04403b430 con 0x7fb048105910 2024-09-19T04:07:23.221 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.417+0000 7fb03e7fc640 1 --2- 172.21.15.7:0/238104075 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fb0340390f0 0x7fb03403b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:23.221 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.417+0000 7fb03e7fc640 1 -- 172.21.15.7:0/238104075 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb04406c540 con 0x7fb048105910 2024-09-19T04:07:23.221 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.418+0000 7fb04ce03640 1 --2- 172.21.15.7:0/238104075 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fb0340390f0 0x7fb03403b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:23.221 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.418+0000 7fb04ce03640 1 --2- 172.21.15.7:0/238104075 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fb0340390f0 0x7fb03403b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb0380098c0 tx=0x7fb038006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:23.221 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.423+0000 7fb03e7fc640 1 -- 172.21.15.7:0/238104075 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb0440371e0 con 0x7fb048105910 2024-09-19T04:07:23.221 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.613+0000 7fb04f868640 1 -- 172.21.15.7:0/238104075 --> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fb048102780 con 0x7fb0340390f0 2024-09-19T04:07:23.221 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.618+0000 7fb03e7fc640 1 -- 172.21.15.7:0/238104075 <== mgr.14118 v2:172.21.15.7:6800/751091002 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb048102780 con 0x7fb0340390f0 2024-09-19T04:07:23.221 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.620+0000 7fb04f868640 1 -- 172.21.15.7:0/238104075 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fb0340390f0 msgr2=0x7fb03403b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:23.221 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.620+0000 7fb04f868640 1 --2- 172.21.15.7:0/238104075 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fb0340390f0 0x7fb03403b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb0380098c0 tx=0x7fb038006db0 comp rx=0 tx=0).stop 2024-09-19T04:07:23.221 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.620+0000 7fb04f868640 1 -- 172.21.15.7:0/238104075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb048105910 msgr2=0x7fb0481081c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:23.221 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.620+0000 7fb04f868640 1 --2- 172.21.15.7:0/238104075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb048105910 0x7fb0481081c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb0440097f0 tx=0x7fb044030d80 comp rx=0 tx=0).stop 2024-09-19T04:07:23.221 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.620+0000 7fb04f868640 1 -- 172.21.15.7:0/238104075 shutdown_connections 2024-09-19T04:07:23.222 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.620+0000 7fb04f868640 1 --2- 172.21.15.7:0/238104075 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fb0340390f0 0x7fb03403b5b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:23.222 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.620+0000 7fb04f868640 1 --2- 172.21.15.7:0/238104075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb048105910 0x7fb0481081c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:23.222 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.620+0000 7fb04f868640 1 -- 172.21.15.7:0/238104075 >> 172.21.15.7:0/238104075 conn(0x7fb048101510 msgr2=0x7fb048102070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:23.222 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.621+0000 7fb04f868640 1 -- 172.21.15.7:0/238104075 shutdown_connections 2024-09-19T04:07:23.222 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:22.621+0000 7fb04f868640 1 -- 172.21.15.7:0/238104075 wait complete. 2024-09-19T04:07:23.505 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:23 smithi007 ceph-mon[31360]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T04:07:23.505 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:23 smithi007 ceph-mon[31360]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T04:07:23.505 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:23 smithi007 ceph-mon[31360]: from='mgr.14118 172.21.15.7:0/3147503308' entity='mgr.x' 2024-09-19T04:07:23.505 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:23 smithi007 ceph-mon[31360]: from='mgr.14118 172.21.15.7:0/3147503308' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:07:23.505 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:23 smithi007 ceph-mon[31360]: from='mgr.14118 172.21.15.7:0/3147503308' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:07:24.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:24 smithi007 ceph-mon[31360]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:07:24.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:24 smithi007 ceph-mon[31360]: [19/Sep/2024:04:07:22] ENGINE Bus STARTING 2024-09-19T04:07:24.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:24 smithi007 ceph-mon[31360]: [19/Sep/2024:04:07:22] ENGINE Serving on https://172.21.15.7:7150 2024-09-19T04:07:24.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:24 smithi007 ceph-mon[31360]: [19/Sep/2024:04:07:22] ENGINE Error in HTTPServer.serve 2024-09-19T04:07:24.337 INFO:journalctl@ceph.mon.a.smithi007.stdout: Traceback (most recent call last): 2024-09-19T04:07:24.337 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T04:07:24.337 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._connections.run(self.expiration_interval) 2024-09-19T04:07:24.337 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T04:07:24.337 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._run(expiration_interval) 2024-09-19T04:07:24.337 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T04:07:24.337 INFO:journalctl@ceph.mon.a.smithi007.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T04:07:24.337 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T04:07:24.337 INFO:journalctl@ceph.mon.a.smithi007.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T04:07:24.337 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T04:07:24.338 INFO:journalctl@ceph.mon.a.smithi007.stdout: s = self.context.wrap_socket( 2024-09-19T04:07:24.338 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T04:07:24.338 INFO:journalctl@ceph.mon.a.smithi007.stdout: return self.sslsocket_class._create( 2024-09-19T04:07:24.338 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T04:07:24.338 INFO:journalctl@ceph.mon.a.smithi007.stdout: self.do_handshake() 2024-09-19T04:07:24.338 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T04:07:24.338 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._sslobj.do_handshake() 2024-09-19T04:07:24.338 INFO:journalctl@ceph.mon.a.smithi007.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T04:07:24.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:24 smithi007 ceph-mon[31360]: [19/Sep/2024:04:07:22] ENGINE Serving on http://172.21.15.7:8765 2024-09-19T04:07:24.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:24 smithi007 ceph-mon[31360]: [19/Sep/2024:04:07:22] ENGINE Bus STARTED 2024-09-19T04:07:24.338 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:24 smithi007 ceph-mon[31360]: mgrmap e8: x(active, since 2s) 2024-09-19T04:07:24.344 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T04:07:24.344 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.584+0000 7fa03fa51640 1 Processor -- start 2024-09-19T04:07:24.344 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.584+0000 7fa03fa51640 1 -- start start 2024-09-19T04:07:24.345 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.584+0000 7fa03fa51640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa038107700 0x7fa038107b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:24.345 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.584+0000 7fa03fa51640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa0381080d0 con 0x7fa038107700 2024-09-19T04:07:24.345 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.585+0000 7fa03d7ed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa038107700 0x7fa038107b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:24.345 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.585+0000 7fa03d7ed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa038107700 0x7fa038107b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42386/0 (socket says 172.21.15.7:42386) 2024-09-19T04:07:24.345 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.585+0000 7fa03d7ed640 1 -- 172.21.15.7:0/130501231 learned_addr learned my addr 172.21.15.7:0/130501231 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:24.345 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.585+0000 7fa03d7ed640 1 -- 172.21.15.7:0/130501231 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa038108860 con 0x7fa038107700 2024-09-19T04:07:24.345 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.586+0000 7fa03d7ed640 1 --2- 172.21.15.7:0/130501231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa038107700 0x7fa038107b00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa034009820 tx=0x7fa03402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd64f14826a94c0b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:24.345 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.586+0000 7fa02ffff640 1 -- 172.21.15.7:0/130501231 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa034037070 con 0x7fa038107700 2024-09-19T04:07:24.345 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.586+0000 7fa02ffff640 1 -- 172.21.15.7:0/130501231 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa034032900 con 0x7fa038107700 2024-09-19T04:07:24.345 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.586+0000 7fa02ffff640 1 -- 172.21.15.7:0/130501231 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa034030850 con 0x7fa038107700 2024-09-19T04:07:24.345 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.586+0000 7fa03fa51640 1 -- 172.21.15.7:0/130501231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa038107700 msgr2=0x7fa038107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:24.346 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.586+0000 7fa03fa51640 1 --2- 172.21.15.7:0/130501231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa038107700 0x7fa038107b00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa034009820 tx=0x7fa03402a270 comp rx=0 tx=0).stop 2024-09-19T04:07:24.346 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.587+0000 7fa03fa51640 1 -- 172.21.15.7:0/130501231 shutdown_connections 2024-09-19T04:07:24.346 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.587+0000 7fa03fa51640 1 --2- 172.21.15.7:0/130501231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa038107700 0x7fa038107b00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:24.346 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.587+0000 7fa03fa51640 1 -- 172.21.15.7:0/130501231 >> 172.21.15.7:0/130501231 conn(0x7fa038102eb0 msgr2=0x7fa0381052d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:24.346 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.587+0000 7fa03fa51640 1 -- 172.21.15.7:0/130501231 shutdown_connections 2024-09-19T04:07:24.346 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.587+0000 7fa03fa51640 1 -- 172.21.15.7:0/130501231 wait complete. 2024-09-19T04:07:24.346 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.587+0000 7fa03fa51640 1 Processor -- start 2024-09-19T04:07:24.346 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.587+0000 7fa03fa51640 1 -- start start 2024-09-19T04:07:24.346 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.588+0000 7fa03fa51640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa038107700 0x7fa03807db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:24.346 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.588+0000 7fa03fa51640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa03810bc10 con 0x7fa038107700 2024-09-19T04:07:24.346 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.588+0000 7fa03d7ed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa038107700 0x7fa03807db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:24.346 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.588+0000 7fa03d7ed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa038107700 0x7fa03807db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42388/0 (socket says 172.21.15.7:42388) 2024-09-19T04:07:24.346 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.588+0000 7fa03d7ed640 1 -- 172.21.15.7:0/3272447693 learned_addr learned my addr 172.21.15.7:0/3272447693 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:24.346 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.588+0000 7fa03d7ed640 1 -- 172.21.15.7:0/3272447693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa03807e0b0 con 0x7fa038107700 2024-09-19T04:07:24.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.588+0000 7fa03d7ed640 1 --2- 172.21.15.7:0/3272447693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa038107700 0x7fa03807db70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa034009940 tx=0x7fa0340326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:24.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.588+0000 7fa02e7fc640 1 -- 172.21.15.7:0/3272447693 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa034042070 con 0x7fa038107700 2024-09-19T04:07:24.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.588+0000 7fa02e7fc640 1 -- 172.21.15.7:0/3272447693 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa034032be0 con 0x7fa038107700 2024-09-19T04:07:24.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.588+0000 7fa02e7fc640 1 -- 172.21.15.7:0/3272447693 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa034037040 con 0x7fa038107700 2024-09-19T04:07:24.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.588+0000 7fa03fa51640 1 -- 172.21.15.7:0/3272447693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa03807c2a0 con 0x7fa038107700 2024-09-19T04:07:24.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.588+0000 7fa03fa51640 1 -- 172.21.15.7:0/3272447693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa03807c7e0 con 0x7fa038107700 2024-09-19T04:07:24.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.589+0000 7fa02e7fc640 1 -- 172.21.15.7:0/3272447693 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fa034045070 con 0x7fa038107700 2024-09-19T04:07:24.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.589+0000 7fa02e7fc640 1 --2- 172.21.15.7:0/3272447693 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fa024039200 0x7fa02403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:24.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.589+0000 7fa03fa51640 1 -- 172.21.15.7:0/3272447693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa03810bd90 con 0x7fa038107700 2024-09-19T04:07:24.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.589+0000 7fa02e7fc640 1 -- 172.21.15.7:0/3272447693 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa03406c220 con 0x7fa038107700 2024-09-19T04:07:24.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.590+0000 7fa03cfec640 1 --2- 172.21.15.7:0/3272447693 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fa024039200 0x7fa02403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:24.347 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.590+0000 7fa03cfec640 1 --2- 172.21.15.7:0/3272447693 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fa024039200 0x7fa02403b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa0280098c0 tx=0x7fa028006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:24.348 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.594+0000 7fa02e7fc640 1 -- 172.21.15.7:0/3272447693 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa03404b170 con 0x7fa038107700 2024-09-19T04:07:24.348 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.770+0000 7fa03fa51640 1 -- 172.21.15.7:0/3272447693 --> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fa0380008d0 con 0x7fa024039200 2024-09-19T04:07:24.348 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.771+0000 7fa02e7fc640 1 -- 172.21.15.7:0/3272447693 <== mgr.14118 v2:172.21.15.7:6800/751091002 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fa0380008d0 con 0x7fa024039200 2024-09-19T04:07:24.348 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.773+0000 7fa03fa51640 1 -- 172.21.15.7:0/3272447693 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fa024039200 msgr2=0x7fa02403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:24.348 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.773+0000 7fa03fa51640 1 --2- 172.21.15.7:0/3272447693 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fa024039200 0x7fa02403b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa0280098c0 tx=0x7fa028006db0 comp rx=0 tx=0).stop 2024-09-19T04:07:24.348 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.773+0000 7fa03fa51640 1 -- 172.21.15.7:0/3272447693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa038107700 msgr2=0x7fa03807db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:24.348 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.773+0000 7fa03fa51640 1 --2- 172.21.15.7:0/3272447693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa038107700 0x7fa03807db70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa034009940 tx=0x7fa0340326e0 comp rx=0 tx=0).stop 2024-09-19T04:07:24.348 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.773+0000 7fa03fa51640 1 -- 172.21.15.7:0/3272447693 shutdown_connections 2024-09-19T04:07:24.348 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.773+0000 7fa03fa51640 1 --2- 172.21.15.7:0/3272447693 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fa024039200 0x7fa02403b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:24.348 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.773+0000 7fa03fa51640 1 --2- 172.21.15.7:0/3272447693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa038107700 0x7fa03807db70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:24.349 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.773+0000 7fa03fa51640 1 -- 172.21.15.7:0/3272447693 >> 172.21.15.7:0/3272447693 conn(0x7fa038102eb0 msgr2=0x7fa038103a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:24.349 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.774+0000 7fa03fa51640 1 -- 172.21.15.7:0/3272447693 shutdown_connections 2024-09-19T04:07:24.349 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:23.774+0000 7fa03fa51640 1 -- 172.21.15.7:0/3272447693 wait complete. 2024-09-19T04:07:24.349 INFO:teuthology.orchestra.run.smithi007.stdout:Generating ssh key... 2024-09-19T04:07:25.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:25 smithi007 ceph-mon[31360]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:07:25.627 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:25 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: Generating public/private rsa key pair. 2024-09-19T04:07:25.627 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:25 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: Your identification has been saved in /tmp/tmp4jxiique/key 2024-09-19T04:07:25.627 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:25 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: Your public key has been saved in /tmp/tmp4jxiique/key.pub 2024-09-19T04:07:25.628 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:25 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: The key fingerprint is: 2024-09-19T04:07:25.628 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:25 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: SHA256:I/vnbKI2dhtIfuT5Ox+xeSgKiwilwgykpSUTtaY1ekM ceph-77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:07:25.628 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:25 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: The key's randomart image is: 2024-09-19T04:07:25.628 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:25 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: +---[RSA 3072]----+ 2024-09-19T04:07:25.628 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:25 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: |... | 2024-09-19T04:07:25.628 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:25 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: | . . | 2024-09-19T04:07:25.628 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:25 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: |o.E | 2024-09-19T04:07:25.628 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:25 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: |o% . | 2024-09-19T04:07:25.628 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:25 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: |* + o S . | 2024-09-19T04:07:25.628 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:25 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: |++ . o * o = | 2024-09-19T04:07:25.629 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:25 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: |+o = = . = . | 2024-09-19T04:07:25.629 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:25 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: |.. . .+=o=+. o | 2024-09-19T04:07:25.629 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:25 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: | . .oo++*=+. | 2024-09-19T04:07:25.629 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:25 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: +----[SHA256]-----+ 2024-09-19T04:07:25.966 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.746+0000 7f52a71a8640 1 Processor -- start 2024-09-19T04:07:25.966 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.746+0000 7f52a71a8640 1 -- start start 2024-09-19T04:07:25.966 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.746+0000 7f52a71a8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52a0107740 0x7f52a0107b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:25.966 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.746+0000 7f52a71a8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f52a0108110 con 0x7f52a0107740 2024-09-19T04:07:25.967 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.747+0000 7f52a4f44640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52a0107740 0x7f52a0107b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:25.967 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.747+0000 7f52a4f44640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52a0107740 0x7f52a0107b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42392/0 (socket says 172.21.15.7:42392) 2024-09-19T04:07:25.967 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.747+0000 7f52a4f44640 1 -- 172.21.15.7:0/4058771537 learned_addr learned my addr 172.21.15.7:0/4058771537 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:25.967 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.747+0000 7f52a4f44640 1 -- 172.21.15.7:0/4058771537 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52a01088a0 con 0x7f52a0107740 2024-09-19T04:07:25.967 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.748+0000 7f52a4f44640 1 --2- 172.21.15.7:0/4058771537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52a0107740 0x7f52a0107b40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5290009820 tx=0x7f529002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2abaab55e07b24 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:25.967 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.748+0000 7f529f7fe640 1 -- 172.21.15.7:0/4058771537 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5290037070 con 0x7f52a0107740 2024-09-19T04:07:25.967 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.748+0000 7f529f7fe640 1 -- 172.21.15.7:0/4058771537 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5290032900 con 0x7f52a0107740 2024-09-19T04:07:25.967 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.748+0000 7f529f7fe640 1 -- 172.21.15.7:0/4058771537 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5290030850 con 0x7f52a0107740 2024-09-19T04:07:25.967 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.748+0000 7f52a71a8640 1 -- 172.21.15.7:0/4058771537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52a0107740 msgr2=0x7f52a0107b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:25.967 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.748+0000 7f52a71a8640 1 --2- 172.21.15.7:0/4058771537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52a0107740 0x7f52a0107b40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5290009820 tx=0x7f529002a270 comp rx=0 tx=0).stop 2024-09-19T04:07:25.967 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.748+0000 7f52a71a8640 1 -- 172.21.15.7:0/4058771537 shutdown_connections 2024-09-19T04:07:25.967 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.748+0000 7f52a71a8640 1 --2- 172.21.15.7:0/4058771537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52a0107740 0x7f52a0107b40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:25.968 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.748+0000 7f52a71a8640 1 -- 172.21.15.7:0/4058771537 >> 172.21.15.7:0/4058771537 conn(0x7f52a0102eb0 msgr2=0x7f52a0105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:25.968 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.748+0000 7f52a71a8640 1 -- 172.21.15.7:0/4058771537 shutdown_connections 2024-09-19T04:07:25.968 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.749+0000 7f52a71a8640 1 -- 172.21.15.7:0/4058771537 wait complete. 2024-09-19T04:07:25.968 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.749+0000 7f52a71a8640 1 Processor -- start 2024-09-19T04:07:25.968 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.749+0000 7f52a71a8640 1 -- start start 2024-09-19T04:07:25.968 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.749+0000 7f52a71a8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52a0107740 0x7f52a019d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:25.968 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.749+0000 7f52a71a8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f52a010bc50 con 0x7f52a0107740 2024-09-19T04:07:25.968 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.749+0000 7f52a4f44640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52a0107740 0x7f52a019d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:25.968 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.749+0000 7f52a4f44640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52a0107740 0x7f52a019d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42404/0 (socket says 172.21.15.7:42404) 2024-09-19T04:07:25.968 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.749+0000 7f52a4f44640 1 -- 172.21.15.7:0/1420403936 learned_addr learned my addr 172.21.15.7:0/1420403936 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:25.968 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.750+0000 7f52a4f44640 1 -- 172.21.15.7:0/1420403936 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52a019de10 con 0x7f52a0107740 2024-09-19T04:07:25.968 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.750+0000 7f52a4f44640 1 --2- 172.21.15.7:0/1420403936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52a0107740 0x7f52a019d8d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f52900097f0 tx=0x7f5290030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:25.968 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.750+0000 7f529dffb640 1 -- 172.21.15.7:0/1420403936 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5290042070 con 0x7f52a0107740 2024-09-19T04:07:25.969 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.750+0000 7f529dffb640 1 -- 172.21.15.7:0/1420403936 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5290032ca0 con 0x7f52a0107740 2024-09-19T04:07:25.969 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.750+0000 7f52a71a8640 1 -- 172.21.15.7:0/1420403936 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52a019e0a0 con 0x7f52a0107740 2024-09-19T04:07:25.969 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.750+0000 7f529dffb640 1 -- 172.21.15.7:0/1420403936 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5290037040 con 0x7f52a0107740 2024-09-19T04:07:25.969 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.750+0000 7f52a71a8640 1 -- 172.21.15.7:0/1420403936 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52a01a0d90 con 0x7f52a0107740 2024-09-19T04:07:25.969 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.751+0000 7f529dffb640 1 -- 172.21.15.7:0/1420403936 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f5290045070 con 0x7f52a0107740 2024-09-19T04:07:25.969 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.751+0000 7f529dffb640 1 --2- 172.21.15.7:0/1420403936 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f52880391b0 0x7f528803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:25.969 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.751+0000 7f52a71a8640 1 -- 172.21.15.7:0/1420403936 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52a0107bc0 con 0x7f52a0107740 2024-09-19T04:07:25.969 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.751+0000 7f529dffb640 1 -- 172.21.15.7:0/1420403936 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f529006c1a0 con 0x7f52a0107740 2024-09-19T04:07:25.969 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.751+0000 7f529ffff640 1 --2- 172.21.15.7:0/1420403936 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f52880391b0 0x7f528803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:25.969 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.752+0000 7f529ffff640 1 --2- 172.21.15.7:0/1420403936 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f52880391b0 0x7f528803b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f52940098c0 tx=0x7f5294006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:25.969 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.756+0000 7f529dffb640 1 -- 172.21.15.7:0/1420403936 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f529004b170 con 0x7f52a0107740 2024-09-19T04:07:25.969 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:24.934+0000 7f52a71a8640 1 -- 172.21.15.7:0/1420403936 --> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f52a0104160 con 0x7f52880391b0 2024-09-19T04:07:25.969 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:25.456+0000 7f529dffb640 1 -- 172.21.15.7:0/1420403936 <== mgr.14118 v2:172.21.15.7:6800/751091002 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f52a0104160 con 0x7f52880391b0 2024-09-19T04:07:25.969 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:25.458+0000 7f52a71a8640 1 -- 172.21.15.7:0/1420403936 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f52880391b0 msgr2=0x7f528803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:25.970 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:25.458+0000 7f52a71a8640 1 --2- 172.21.15.7:0/1420403936 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f52880391b0 0x7f528803b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f52940098c0 tx=0x7f5294006db0 comp rx=0 tx=0).stop 2024-09-19T04:07:25.970 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:25.458+0000 7f52a71a8640 1 -- 172.21.15.7:0/1420403936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52a0107740 msgr2=0x7f52a019d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:25.970 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:25.458+0000 7f52a71a8640 1 --2- 172.21.15.7:0/1420403936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52a0107740 0x7f52a019d8d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f52900097f0 tx=0x7f5290030ec0 comp rx=0 tx=0).stop 2024-09-19T04:07:25.970 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:25.458+0000 7f52a71a8640 1 -- 172.21.15.7:0/1420403936 shutdown_connections 2024-09-19T04:07:25.970 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:25.458+0000 7f52a71a8640 1 --2- 172.21.15.7:0/1420403936 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f52880391b0 0x7f528803b670 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:25.970 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:25.458+0000 7f52a71a8640 1 --2- 172.21.15.7:0/1420403936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52a0107740 0x7f52a019d8d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:25.970 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:25.458+0000 7f52a71a8640 1 -- 172.21.15.7:0/1420403936 >> 172.21.15.7:0/1420403936 conn(0x7f52a0102eb0 msgr2=0x7f52a0103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:25.970 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:25.458+0000 7f52a71a8640 1 -- 172.21.15.7:0/1420403936 shutdown_connections 2024-09-19T04:07:25.970 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:25.458+0000 7f52a71a8640 1 -- 172.21.15.7:0/1420403936 wait complete. 2024-09-19T04:07:26.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:26 smithi007 ceph-mon[31360]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:07:26.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:26 smithi007 ceph-mon[31360]: Generating ssh key... 2024-09-19T04:07:26.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:26 smithi007 ceph-mon[31360]: from='mgr.14118 172.21.15.7:0/3147503308' entity='mgr.x' 2024-09-19T04:07:26.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:26 smithi007 ceph-mon[31360]: from='mgr.14118 172.21.15.7:0/3147503308' entity='mgr.x' 2024-09-19T04:07:27.116 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtNe8eM4rdwfp1TWQgqsVPRjQNuAYuZrGcgD0CmCX2GhULvIqaXE6bQ0ZtlWrK1RjZASGYWEdazKs/ehvowxPv5a8hM/75eI6jqGt5FXYmsQj+yh3AFqY1wZDTsYbVHtgj2f76qRZKiBkusvbQ0uR4etHqRKQEZf7o/dYYksSsPKkTiKgNHWZpvMeDA5Hu+GZ0IDnsiYYRxim9HGM5Qe6xfXDE9zCMY8j7v3AzO9Ed6rIugzGnQEab9xeA/f06A8FMePiA+U+Za9UQZzAWTesETsPoDsC9lvhw+3c6LhWyhh85vPJ1kvsEjMgpKWNfYikjseDmc1Zpk3JHNCEQnze0PEFaM05HB7MM6jbIpxg5TjHMD68mTvIClwIBvAkNNaNG49WM75c9Nl1mIvL0EoNJSqqdD8BdFgZzLM+t8lMGQOeXXpso8DXA9etRS0Q7Y8iUhMCJad+l/AFcnTZ3Sz6LfWyoHJk6sMvh32kQci1xLj3vZPAM9dYZ+agXBNXM/I8= ceph-77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:07:27.116 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.341+0000 7fd17e649640 1 Processor -- start 2024-09-19T04:07:27.116 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.341+0000 7fd17e649640 1 -- start start 2024-09-19T04:07:27.116 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.341+0000 7fd17e649640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd178107660 0x7fd178107a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:27.116 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.341+0000 7fd17e649640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd178108030 con 0x7fd178107660 2024-09-19T04:07:27.116 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.342+0000 7fd177fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd178107660 0x7fd178107a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:27.116 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.342+0000 7fd177fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd178107660 0x7fd178107a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42412/0 (socket says 172.21.15.7:42412) 2024-09-19T04:07:27.116 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.342+0000 7fd177fff640 1 -- 172.21.15.7:0/2320007698 learned_addr learned my addr 172.21.15.7:0/2320007698 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:27.117 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.342+0000 7fd177fff640 1 -- 172.21.15.7:0/2320007698 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd178108810 con 0x7fd178107660 2024-09-19T04:07:27.117 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.343+0000 7fd177fff640 1 --2- 172.21.15.7:0/2320007698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd178107660 0x7fd178107a60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd168009820 tx=0x7fd16802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99025077e9db132e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:27.117 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.343+0000 7fd176ffd640 1 -- 172.21.15.7:0/2320007698 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd168037070 con 0x7fd178107660 2024-09-19T04:07:27.117 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.343+0000 7fd176ffd640 1 -- 172.21.15.7:0/2320007698 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd168032900 con 0x7fd178107660 2024-09-19T04:07:27.117 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.343+0000 7fd176ffd640 1 -- 172.21.15.7:0/2320007698 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd168030850 con 0x7fd178107660 2024-09-19T04:07:27.117 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.343+0000 7fd17e649640 1 -- 172.21.15.7:0/2320007698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd178107660 msgr2=0x7fd178107a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:27.117 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.343+0000 7fd17e649640 1 --2- 172.21.15.7:0/2320007698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd178107660 0x7fd178107a60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd168009820 tx=0x7fd16802a270 comp rx=0 tx=0).stop 2024-09-19T04:07:27.117 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.344+0000 7fd17e649640 1 -- 172.21.15.7:0/2320007698 shutdown_connections 2024-09-19T04:07:27.117 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.344+0000 7fd17e649640 1 --2- 172.21.15.7:0/2320007698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd178107660 0x7fd178107a60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:27.117 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.344+0000 7fd17e649640 1 -- 172.21.15.7:0/2320007698 >> 172.21.15.7:0/2320007698 conn(0x7fd178102e30 msgr2=0x7fd178105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:27.117 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.344+0000 7fd17e649640 1 -- 172.21.15.7:0/2320007698 shutdown_connections 2024-09-19T04:07:27.117 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.344+0000 7fd17e649640 1 -- 172.21.15.7:0/2320007698 wait complete. 2024-09-19T04:07:27.117 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.344+0000 7fd17e649640 1 Processor -- start 2024-09-19T04:07:27.118 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.344+0000 7fd17e649640 1 -- start start 2024-09-19T04:07:27.118 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.345+0000 7fd17e649640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd178107660 0x7fd17819b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:27.118 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.345+0000 7fd17e649640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd17810bbc0 con 0x7fd178107660 2024-09-19T04:07:27.118 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.345+0000 7fd177fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd178107660 0x7fd17819b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:27.118 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.345+0000 7fd177fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd178107660 0x7fd17819b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42426/0 (socket says 172.21.15.7:42426) 2024-09-19T04:07:27.118 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.345+0000 7fd177fff640 1 -- 172.21.15.7:0/945160130 learned_addr learned my addr 172.21.15.7:0/945160130 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:27.118 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.345+0000 7fd177fff640 1 -- 172.21.15.7:0/945160130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd17819bb70 con 0x7fd178107660 2024-09-19T04:07:27.118 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.345+0000 7fd177fff640 1 --2- 172.21.15.7:0/945160130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd178107660 0x7fd17819b630 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd168009940 tx=0x7fd168032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:27.118 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.345+0000 7fd1757fa640 1 -- 172.21.15.7:0/945160130 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd168042070 con 0x7fd178107660 2024-09-19T04:07:27.118 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.345+0000 7fd1757fa640 1 -- 172.21.15.7:0/945160130 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd1680308c0 con 0x7fd178107660 2024-09-19T04:07:27.118 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.345+0000 7fd17e649640 1 -- 172.21.15.7:0/945160130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd17819be00 con 0x7fd178107660 2024-09-19T04:07:27.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.345+0000 7fd1757fa640 1 -- 172.21.15.7:0/945160130 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd168037040 con 0x7fd178107660 2024-09-19T04:07:27.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.345+0000 7fd17e649640 1 -- 172.21.15.7:0/945160130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd17819eaf0 con 0x7fd178107660 2024-09-19T04:07:27.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.346+0000 7fd1757fa640 1 -- 172.21.15.7:0/945160130 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fd168045070 con 0x7fd178107660 2024-09-19T04:07:27.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.346+0000 7fd1757fa640 1 --2- 172.21.15.7:0/945160130 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fd160039200 0x7fd16003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:27.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.346+0000 7fd17e649640 1 -- 172.21.15.7:0/945160130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd17810bd40 con 0x7fd178107660 2024-09-19T04:07:27.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.346+0000 7fd1757fa640 1 -- 172.21.15.7:0/945160130 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd16806c300 con 0x7fd178107660 2024-09-19T04:07:27.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.347+0000 7fd1777fe640 1 --2- 172.21.15.7:0/945160130 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fd160039200 0x7fd16003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:27.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.347+0000 7fd1777fe640 1 --2- 172.21.15.7:0/945160130 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fd160039200 0x7fd16003b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd16c0098c0 tx=0x7fd16c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:27.119 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.351+0000 7fd1757fa640 1 -- 172.21.15.7:0/945160130 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd168045360 con 0x7fd178107660 2024-09-19T04:07:27.120 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.528+0000 7fd17e649640 1 -- 172.21.15.7:0/945160130 --> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fd178104010 con 0x7fd160039200 2024-09-19T04:07:27.120 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.529+0000 7fd1757fa640 1 -- 172.21.15.7:0/945160130 <== mgr.14118 v2:172.21.15.7:6800/751091002 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fd178104010 con 0x7fd160039200 2024-09-19T04:07:27.120 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.531+0000 7fd17e649640 1 -- 172.21.15.7:0/945160130 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fd160039200 msgr2=0x7fd16003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:27.120 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.531+0000 7fd17e649640 1 --2- 172.21.15.7:0/945160130 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fd160039200 0x7fd16003b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd16c0098c0 tx=0x7fd16c006db0 comp rx=0 tx=0).stop 2024-09-19T04:07:27.120 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.531+0000 7fd17e649640 1 -- 172.21.15.7:0/945160130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd178107660 msgr2=0x7fd17819b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:27.120 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.531+0000 7fd17e649640 1 --2- 172.21.15.7:0/945160130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd178107660 0x7fd17819b630 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd168009940 tx=0x7fd168032ce0 comp rx=0 tx=0).stop 2024-09-19T04:07:27.120 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.532+0000 7fd17e649640 1 -- 172.21.15.7:0/945160130 shutdown_connections 2024-09-19T04:07:27.120 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.532+0000 7fd17e649640 1 --2- 172.21.15.7:0/945160130 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fd160039200 0x7fd16003b6c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:27.120 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.532+0000 7fd17e649640 1 --2- 172.21.15.7:0/945160130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd178107660 0x7fd17819b630 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:27.120 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.532+0000 7fd17e649640 1 -- 172.21.15.7:0/945160130 >> 172.21.15.7:0/945160130 conn(0x7fd178102e30 msgr2=0x7fd178103900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:27.120 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.532+0000 7fd17e649640 1 -- 172.21.15.7:0/945160130 shutdown_connections 2024-09-19T04:07:27.121 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:26.532+0000 7fd17e649640 1 -- 172.21.15.7:0/945160130 wait complete. 2024-09-19T04:07:27.121 INFO:teuthology.orchestra.run.smithi007.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T04:07:27.121 INFO:teuthology.orchestra.run.smithi007.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T04:07:27.121 INFO:teuthology.orchestra.run.smithi007.stdout:Adding host smithi007... 2024-09-19T04:07:27.511 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:27 smithi007 ceph-mon[31360]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:07:28.773 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:28 smithi007 ceph-mon[31360]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi007", "addr": "172.21.15.7", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:07:29.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:29 smithi007 ceph-mon[31360]: Deploying cephadm binary to smithi007 2024-09-19T04:07:32.140 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout Added host 'smithi007' with addr '172.21.15.7' 2024-09-19T04:07:32.140 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.536+0000 7f2cf0d85640 1 Processor -- start 2024-09-19T04:07:32.140 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.536+0000 7f2cf0d85640 1 -- start start 2024-09-19T04:07:32.141 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.537+0000 7f2cf0d85640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cec106520 0x7f2cec106920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:32.141 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.537+0000 7f2cf0d85640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec106ef0 con 0x7f2cec106520 2024-09-19T04:07:32.141 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.537+0000 7f2cea59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cec106520 0x7f2cec106920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:32.141 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.537+0000 7f2cea59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cec106520 0x7f2cec106920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32784/0 (socket says 172.21.15.7:32784) 2024-09-19T04:07:32.141 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.537+0000 7f2cea59c640 1 -- 172.21.15.7:0/3594135046 learned_addr learned my addr 172.21.15.7:0/3594135046 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:32.141 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.537+0000 7f2cea59c640 1 -- 172.21.15.7:0/3594135046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cec107720 con 0x7f2cec106520 2024-09-19T04:07:32.141 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.538+0000 7f2cea59c640 1 --2- 172.21.15.7:0/3594135046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cec106520 0x7f2cec106920 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009820 tx=0x7f2cdc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298f9269fb6d3e92 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:32.141 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.538+0000 7f2ce959a640 1 -- 172.21.15.7:0/3594135046 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cdc037070 con 0x7f2cec106520 2024-09-19T04:07:32.141 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.538+0000 7f2ce959a640 1 -- 172.21.15.7:0/3594135046 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2cdc032900 con 0x7f2cec106520 2024-09-19T04:07:32.141 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.538+0000 7f2ce959a640 1 -- 172.21.15.7:0/3594135046 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cdc030850 con 0x7f2cec106520 2024-09-19T04:07:32.141 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.538+0000 7f2cf0d85640 1 -- 172.21.15.7:0/3594135046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cec106520 msgr2=0x7f2cec106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:32.141 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.538+0000 7f2cf0d85640 1 --2- 172.21.15.7:0/3594135046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cec106520 0x7f2cec106920 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009820 tx=0x7f2cdc02a270 comp rx=0 tx=0).stop 2024-09-19T04:07:32.141 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.539+0000 7f2cf0d85640 1 -- 172.21.15.7:0/3594135046 shutdown_connections 2024-09-19T04:07:32.142 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.539+0000 7f2cf0d85640 1 --2- 172.21.15.7:0/3594135046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cec106520 0x7f2cec106920 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:32.142 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.539+0000 7f2cf0d85640 1 -- 172.21.15.7:0/3594135046 >> 172.21.15.7:0/3594135046 conn(0x7f2cec101db0 msgr2=0x7f2cec1041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:32.142 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.539+0000 7f2cf0d85640 1 -- 172.21.15.7:0/3594135046 shutdown_connections 2024-09-19T04:07:32.142 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.539+0000 7f2cf0d85640 1 -- 172.21.15.7:0/3594135046 wait complete. 2024-09-19T04:07:32.142 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.539+0000 7f2cf0d85640 1 Processor -- start 2024-09-19T04:07:32.142 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.539+0000 7f2cf0d85640 1 -- start start 2024-09-19T04:07:32.142 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.540+0000 7f2cf0d85640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cec106520 0x7f2cec19a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:32.142 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.540+0000 7f2cf0d85640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec10aad0 con 0x7f2cec106520 2024-09-19T04:07:32.142 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.540+0000 7f2cea59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cec106520 0x7f2cec19a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:32.142 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.540+0000 7f2cea59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cec106520 0x7f2cec19a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32798/0 (socket says 172.21.15.7:32798) 2024-09-19T04:07:32.142 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.540+0000 7f2cea59c640 1 -- 172.21.15.7:0/2959289813 learned_addr learned my addr 172.21.15.7:0/2959289813 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:32.142 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.540+0000 7f2cea59c640 1 -- 172.21.15.7:0/2959289813 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cec19aa50 con 0x7f2cec106520 2024-09-19T04:07:32.142 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.540+0000 7f2cea59c640 1 --2- 172.21.15.7:0/2959289813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cec106520 0x7f2cec19a510 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009940 tx=0x7f2cdc032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:32.142 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.540+0000 7f2cdb7fe640 1 -- 172.21.15.7:0/2959289813 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cdc042070 con 0x7f2cec106520 2024-09-19T04:07:32.143 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.540+0000 7f2cdb7fe640 1 -- 172.21.15.7:0/2959289813 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2cdc0308c0 con 0x7f2cec106520 2024-09-19T04:07:32.143 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.540+0000 7f2cdb7fe640 1 -- 172.21.15.7:0/2959289813 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cdc037040 con 0x7f2cec106520 2024-09-19T04:07:32.143 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.540+0000 7f2cf0d85640 1 -- 172.21.15.7:0/2959289813 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cec19ace0 con 0x7f2cec106520 2024-09-19T04:07:32.143 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.540+0000 7f2cf0d85640 1 -- 172.21.15.7:0/2959289813 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cec19d9d0 con 0x7f2cec106520 2024-09-19T04:07:32.143 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.541+0000 7f2cdb7fe640 1 -- 172.21.15.7:0/2959289813 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f2cdc045070 con 0x7f2cec106520 2024-09-19T04:07:32.143 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.542+0000 7f2cf0d85640 1 -- 172.21.15.7:0/2959289813 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cec10ac50 con 0x7f2cec106520 2024-09-19T04:07:32.143 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.542+0000 7f2cdb7fe640 1 --2- 172.21.15.7:0/2959289813 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f2cd4039200 0x7f2cd403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:32.143 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.542+0000 7f2cdb7fe640 1 -- 172.21.15.7:0/2959289813 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2cdc06c440 con 0x7f2cec106520 2024-09-19T04:07:32.143 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.542+0000 7f2ce9d9b640 1 --2- 172.21.15.7:0/2959289813 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f2cd4039200 0x7f2cd403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:32.143 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.542+0000 7f2ce9d9b640 1 --2- 172.21.15.7:0/2959289813 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f2cd4039200 0x7f2cd403b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2ce00098c0 tx=0x7f2ce0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:32.143 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.547+0000 7f2cdb7fe640 1 -- 172.21.15.7:0/2959289813 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2cdc045360 con 0x7f2cec106520 2024-09-19T04:07:32.143 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:27.724+0000 7f2cf0d85640 1 -- 172.21.15.7:0/2959289813 --> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi007", "addr": "172.21.15.7", "target": ["mon-mgr", ""]}) -- 0x7f2cec102fe0 con 0x7f2cd4039200 2024-09-19T04:07:32.144 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:31.640+0000 7f2cdb7fe640 1 -- 172.21.15.7:0/2959289813 <== mgr.14118 v2:172.21.15.7:6800/751091002 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f2cec102fe0 con 0x7f2cd4039200 2024-09-19T04:07:32.144 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:31.643+0000 7f2cf0d85640 1 -- 172.21.15.7:0/2959289813 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f2cd4039200 msgr2=0x7f2cd403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:32.144 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:31.643+0000 7f2cf0d85640 1 --2- 172.21.15.7:0/2959289813 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f2cd4039200 0x7f2cd403b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2ce00098c0 tx=0x7f2ce0006db0 comp rx=0 tx=0).stop 2024-09-19T04:07:32.144 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:31.643+0000 7f2cf0d85640 1 -- 172.21.15.7:0/2959289813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cec106520 msgr2=0x7f2cec19a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:32.144 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:31.643+0000 7f2cf0d85640 1 --2- 172.21.15.7:0/2959289813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cec106520 0x7f2cec19a510 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009940 tx=0x7f2cdc032ce0 comp rx=0 tx=0).stop 2024-09-19T04:07:32.144 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:31.643+0000 7f2cf0d85640 1 -- 172.21.15.7:0/2959289813 shutdown_connections 2024-09-19T04:07:32.144 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:31.643+0000 7f2cf0d85640 1 --2- 172.21.15.7:0/2959289813 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f2cd4039200 0x7f2cd403b6c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:32.144 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:31.643+0000 7f2cf0d85640 1 --2- 172.21.15.7:0/2959289813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cec106520 0x7f2cec19a510 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:32.144 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:31.643+0000 7f2cf0d85640 1 -- 172.21.15.7:0/2959289813 >> 172.21.15.7:0/2959289813 conn(0x7f2cec101db0 msgr2=0x7f2cec1028d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:32.144 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:31.643+0000 7f2cf0d85640 1 -- 172.21.15.7:0/2959289813 shutdown_connections 2024-09-19T04:07:32.144 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:31.643+0000 7f2cf0d85640 1 -- 172.21.15.7:0/2959289813 wait complete. 2024-09-19T04:07:32.144 INFO:teuthology.orchestra.run.smithi007.stdout:Deploying unmanaged mon service... 2024-09-19T04:07:32.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:32 smithi007 ceph-mon[31360]: from='mgr.14118 172.21.15.7:0/3147503308' entity='mgr.x' 2024-09-19T04:07:32.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:32 smithi007 ceph-mon[31360]: Added host smithi007 2024-09-19T04:07:32.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:32 smithi007 ceph-mon[31360]: from='mgr.14118 172.21.15.7:0/3147503308' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:07:33.559 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T04:07:33.559 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.536+0000 7efcea9c1640 1 Processor -- start 2024-09-19T04:07:33.559 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.536+0000 7efcea9c1640 1 -- start start 2024-09-19T04:07:33.559 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.536+0000 7efcea9c1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce4106590 0x7efce4106990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:33.559 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.536+0000 7efcea9c1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efce4106f60 con 0x7efce4106590 2024-09-19T04:07:33.560 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.536+0000 7efce3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce4106590 0x7efce4106990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:33.560 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.536+0000 7efce3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce4106590 0x7efce4106990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32802/0 (socket says 172.21.15.7:32802) 2024-09-19T04:07:33.560 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.536+0000 7efce3fff640 1 -- 172.21.15.7:0/684749056 learned_addr learned my addr 172.21.15.7:0/684749056 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:33.560 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.537+0000 7efce3fff640 1 -- 172.21.15.7:0/684749056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce4107790 con 0x7efce4106590 2024-09-19T04:07:33.560 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.537+0000 7efce3fff640 1 --2- 172.21.15.7:0/684749056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce4106590 0x7efce4106990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009820 tx=0x7efcd402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ee557474a1376 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:33.560 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.538+0000 7efce2ffd640 1 -- 172.21.15.7:0/684749056 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcd4037070 con 0x7efce4106590 2024-09-19T04:07:33.560 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.538+0000 7efce2ffd640 1 -- 172.21.15.7:0/684749056 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efcd4032900 con 0x7efce4106590 2024-09-19T04:07:33.560 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.538+0000 7efce2ffd640 1 -- 172.21.15.7:0/684749056 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcd4030850 con 0x7efce4106590 2024-09-19T04:07:33.560 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.538+0000 7efcea9c1640 1 -- 172.21.15.7:0/684749056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce4106590 msgr2=0x7efce4106990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:33.560 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.538+0000 7efcea9c1640 1 --2- 172.21.15.7:0/684749056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce4106590 0x7efce4106990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efcd4009820 tx=0x7efcd402a270 comp rx=0 tx=0).stop 2024-09-19T04:07:33.560 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.538+0000 7efcea9c1640 1 -- 172.21.15.7:0/684749056 shutdown_connections 2024-09-19T04:07:33.560 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.538+0000 7efcea9c1640 1 --2- 172.21.15.7:0/684749056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce4106590 0x7efce4106990 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:33.560 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.538+0000 7efcea9c1640 1 -- 172.21.15.7:0/684749056 >> 172.21.15.7:0/684749056 conn(0x7efce4101de0 msgr2=0x7efce4104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:33.561 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.538+0000 7efcea9c1640 1 -- 172.21.15.7:0/684749056 shutdown_connections 2024-09-19T04:07:33.561 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.538+0000 7efcea9c1640 1 -- 172.21.15.7:0/684749056 wait complete. 2024-09-19T04:07:33.561 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.539+0000 7efcea9c1640 1 Processor -- start 2024-09-19T04:07:33.561 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.539+0000 7efcea9c1640 1 -- start start 2024-09-19T04:07:33.561 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.539+0000 7efcea9c1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce4106590 0x7efce419b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:33.561 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.539+0000 7efcea9c1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efce410ab40 con 0x7efce4106590 2024-09-19T04:07:33.561 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.539+0000 7efce3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce4106590 0x7efce419b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:33.561 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.540+0000 7efce3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce4106590 0x7efce419b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32816/0 (socket says 172.21.15.7:32816) 2024-09-19T04:07:33.561 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.540+0000 7efce3fff640 1 -- 172.21.15.7:0/3064393536 learned_addr learned my addr 172.21.15.7:0/3064393536 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:33.561 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.540+0000 7efce3fff640 1 -- 172.21.15.7:0/3064393536 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce419bba0 con 0x7efce4106590 2024-09-19T04:07:33.561 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.540+0000 7efce3fff640 1 --2- 172.21.15.7:0/3064393536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce4106590 0x7efce419b660 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efcd40097f0 tx=0x7efcd4030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:33.561 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.540+0000 7efce17fa640 1 -- 172.21.15.7:0/3064393536 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcd4037040 con 0x7efce4106590 2024-09-19T04:07:33.561 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.540+0000 7efce17fa640 1 -- 172.21.15.7:0/3064393536 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efcd4040070 con 0x7efce4106590 2024-09-19T04:07:33.561 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.540+0000 7efcea9c1640 1 -- 172.21.15.7:0/3064393536 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efce419be30 con 0x7efce4106590 2024-09-19T04:07:33.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.540+0000 7efce17fa640 1 -- 172.21.15.7:0/3064393536 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcd403a390 con 0x7efce4106590 2024-09-19T04:07:33.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.540+0000 7efcea9c1640 1 -- 172.21.15.7:0/3064393536 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efce419eb20 con 0x7efce4106590 2024-09-19T04:07:33.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.541+0000 7efce17fa640 1 -- 172.21.15.7:0/3064393536 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7efcd403a690 con 0x7efce4106590 2024-09-19T04:07:33.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.541+0000 7efce17fa640 1 --2- 172.21.15.7:0/3064393536 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7efccc0391b0 0x7efccc03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:33.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.541+0000 7efce17fa640 1 -- 172.21.15.7:0/3064393536 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7efcd406c790 con 0x7efce4106590 2024-09-19T04:07:33.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.541+0000 7efce37fe640 1 --2- 172.21.15.7:0/3064393536 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7efccc0391b0 0x7efccc03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:33.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.541+0000 7efcea9c1640 1 -- 172.21.15.7:0/3064393536 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efce4106a10 con 0x7efce4106590 2024-09-19T04:07:33.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.542+0000 7efce37fe640 1 --2- 172.21.15.7:0/3064393536 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7efccc0391b0 0x7efccc03b670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efcd80098c0 tx=0x7efcd8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:33.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.546+0000 7efce17fa640 1 -- 172.21.15.7:0/3064393536 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efcd4042e30 con 0x7efce4106590 2024-09-19T04:07:33.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.753+0000 7efcea9c1640 1 -- 172.21.15.7:0/3064393536 --> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7efce402d9f0 con 0x7efccc0391b0 2024-09-19T04:07:33.562 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.757+0000 7efce17fa640 1 -- 172.21.15.7:0/3064393536 <== mgr.14118 v2:172.21.15.7:6800/751091002 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7efce402d9f0 con 0x7efccc0391b0 2024-09-19T04:07:33.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.759+0000 7efcea9c1640 1 -- 172.21.15.7:0/3064393536 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7efccc0391b0 msgr2=0x7efccc03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:33.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.759+0000 7efcea9c1640 1 --2- 172.21.15.7:0/3064393536 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7efccc0391b0 0x7efccc03b670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efcd80098c0 tx=0x7efcd8006db0 comp rx=0 tx=0).stop 2024-09-19T04:07:33.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.759+0000 7efcea9c1640 1 -- 172.21.15.7:0/3064393536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce4106590 msgr2=0x7efce419b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:33.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.759+0000 7efcea9c1640 1 --2- 172.21.15.7:0/3064393536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce4106590 0x7efce419b660 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efcd40097f0 tx=0x7efcd4030d80 comp rx=0 tx=0).stop 2024-09-19T04:07:33.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.760+0000 7efcea9c1640 1 -- 172.21.15.7:0/3064393536 shutdown_connections 2024-09-19T04:07:33.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.760+0000 7efcea9c1640 1 --2- 172.21.15.7:0/3064393536 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7efccc0391b0 0x7efccc03b670 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:33.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.760+0000 7efcea9c1640 1 --2- 172.21.15.7:0/3064393536 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efce4106590 0x7efce419b660 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:33.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.760+0000 7efcea9c1640 1 -- 172.21.15.7:0/3064393536 >> 172.21.15.7:0/3064393536 conn(0x7efce4101de0 msgr2=0x7efce4102cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:33.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.760+0000 7efcea9c1640 1 -- 172.21.15.7:0/3064393536 shutdown_connections 2024-09-19T04:07:33.563 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:32.760+0000 7efcea9c1640 1 -- 172.21.15.7:0/3064393536 wait complete. 2024-09-19T04:07:33.563 INFO:teuthology.orchestra.run.smithi007.stdout:Deploying unmanaged mgr service... 2024-09-19T04:07:33.862 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:33 smithi007 ceph-mon[31360]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:07:33.863 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:33 smithi007 ceph-mon[31360]: Saving service mon spec with placement count:5 2024-09-19T04:07:33.863 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:33 smithi007 ceph-mon[31360]: from='mgr.14118 172.21.15.7:0/3147503308' entity='mgr.x' 2024-09-19T04:07:34.818 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T04:07:34.818 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.949+0000 7f4e7d601640 1 Processor -- start 2024-09-19T04:07:34.818 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.949+0000 7f4e7d601640 1 -- start start 2024-09-19T04:07:34.818 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.950+0000 7f4e7d601640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e78105d20 0x7f4e78106120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:34.818 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.950+0000 7f4e7d601640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7807be50 con 0x7f4e78105d20 2024-09-19T04:07:34.818 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.950+0000 7f4e76ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e78105d20 0x7f4e78106120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:34.818 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.950+0000 7f4e76ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e78105d20 0x7f4e78106120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32822/0 (socket says 172.21.15.7:32822) 2024-09-19T04:07:34.818 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.950+0000 7f4e76ffd640 1 -- 172.21.15.7:0/437213890 learned_addr learned my addr 172.21.15.7:0/437213890 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:34.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.950+0000 7f4e76ffd640 1 -- 172.21.15.7:0/437213890 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e78106660 con 0x7f4e78105d20 2024-09-19T04:07:34.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.951+0000 7f4e76ffd640 1 --2- 172.21.15.7:0/437213890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e78105d20 0x7f4e78106120 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009820 tx=0x7f4e6802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fd44700b3b32020 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:34.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.951+0000 7f4e75ffb640 1 -- 172.21.15.7:0/437213890 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e68037070 con 0x7f4e78105d20 2024-09-19T04:07:34.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.951+0000 7f4e75ffb640 1 -- 172.21.15.7:0/437213890 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4e68032900 con 0x7f4e78105d20 2024-09-19T04:07:34.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.951+0000 7f4e75ffb640 1 -- 172.21.15.7:0/437213890 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e68030850 con 0x7f4e78105d20 2024-09-19T04:07:34.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.952+0000 7f4e7d601640 1 -- 172.21.15.7:0/437213890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e78105d20 msgr2=0x7f4e78106120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:34.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.952+0000 7f4e7d601640 1 --2- 172.21.15.7:0/437213890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e78105d20 0x7f4e78106120 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009820 tx=0x7f4e6802a270 comp rx=0 tx=0).stop 2024-09-19T04:07:34.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.952+0000 7f4e7d601640 1 -- 172.21.15.7:0/437213890 shutdown_connections 2024-09-19T04:07:34.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.952+0000 7f4e7d601640 1 --2- 172.21.15.7:0/437213890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e78105d20 0x7f4e78106120 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:34.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.952+0000 7f4e7d601640 1 -- 172.21.15.7:0/437213890 >> 172.21.15.7:0/437213890 conn(0x7f4e78101b90 msgr2=0x7f4e78103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:34.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.952+0000 7f4e7d601640 1 -- 172.21.15.7:0/437213890 shutdown_connections 2024-09-19T04:07:34.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.952+0000 7f4e7d601640 1 -- 172.21.15.7:0/437213890 wait complete. 2024-09-19T04:07:34.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.953+0000 7f4e7d601640 1 Processor -- start 2024-09-19T04:07:34.820 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.953+0000 7f4e7d601640 1 -- start start 2024-09-19T04:07:34.820 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.953+0000 7f4e7d601640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e78105d20 0x7f4e7819d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:34.820 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.953+0000 7f4e7d601640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4e78107760 con 0x7f4e78105d20 2024-09-19T04:07:34.820 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.953+0000 7f4e76ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e78105d20 0x7f4e7819d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:34.820 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.953+0000 7f4e76ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e78105d20 0x7f4e7819d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32832/0 (socket says 172.21.15.7:32832) 2024-09-19T04:07:34.820 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.953+0000 7f4e76ffd640 1 -- 172.21.15.7:0/3624870543 learned_addr learned my addr 172.21.15.7:0/3624870543 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:34.820 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.953+0000 7f4e76ffd640 1 -- 172.21.15.7:0/3624870543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7819dc30 con 0x7f4e78105d20 2024-09-19T04:07:34.820 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.954+0000 7f4e76ffd640 1 --2- 172.21.15.7:0/3624870543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e78105d20 0x7f4e7819d6f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4e680097f0 tx=0x7f4e68030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:34.820 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.954+0000 7f4e5ffff640 1 -- 172.21.15.7:0/3624870543 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e68042070 con 0x7f4e78105d20 2024-09-19T04:07:34.820 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.954+0000 7f4e5ffff640 1 -- 172.21.15.7:0/3624870543 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4e68032ca0 con 0x7f4e78105d20 2024-09-19T04:07:34.820 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.954+0000 7f4e7d601640 1 -- 172.21.15.7:0/3624870543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e7819dec0 con 0x7f4e78105d20 2024-09-19T04:07:34.820 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.954+0000 7f4e5ffff640 1 -- 172.21.15.7:0/3624870543 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e68037040 con 0x7f4e78105d20 2024-09-19T04:07:34.821 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.954+0000 7f4e7d601640 1 -- 172.21.15.7:0/3624870543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e781a0bb0 con 0x7f4e78105d20 2024-09-19T04:07:34.821 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.955+0000 7f4e5ffff640 1 -- 172.21.15.7:0/3624870543 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f4e68045070 con 0x7f4e78105d20 2024-09-19T04:07:34.821 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.955+0000 7f4e7d601640 1 -- 172.21.15.7:0/3624870543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e78106120 con 0x7f4e78105d20 2024-09-19T04:07:34.821 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.955+0000 7f4e5ffff640 1 --2- 172.21.15.7:0/3624870543 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f4e600391b0 0x7f4e6003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:34.821 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.955+0000 7f4e5ffff640 1 -- 172.21.15.7:0/3624870543 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4e6806c260 con 0x7f4e78105d20 2024-09-19T04:07:34.821 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.955+0000 7f4e767fc640 1 --2- 172.21.15.7:0/3624870543 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f4e600391b0 0x7f4e6003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:34.821 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.956+0000 7f4e767fc640 1 --2- 172.21.15.7:0/3624870543 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f4e600391b0 0x7f4e6003b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c0098c0 tx=0x7f4e6c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:34.821 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:33.960+0000 7f4e5ffff640 1 -- 172.21.15.7:0/3624870543 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4e6804b170 con 0x7f4e78105d20 2024-09-19T04:07:34.822 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:34.150+0000 7f4e7d601640 1 -- 172.21.15.7:0/3624870543 --> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f4e780008d0 con 0x7f4e600391b0 2024-09-19T04:07:34.822 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:34.154+0000 7f4e5ffff640 1 -- 172.21.15.7:0/3624870543 <== mgr.14118 v2:172.21.15.7:6800/751091002 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f4e780008d0 con 0x7f4e600391b0 2024-09-19T04:07:34.822 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:34.156+0000 7f4e7d601640 1 -- 172.21.15.7:0/3624870543 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f4e600391b0 msgr2=0x7f4e6003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:34.822 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:34.156+0000 7f4e7d601640 1 --2- 172.21.15.7:0/3624870543 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f4e600391b0 0x7f4e6003b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c0098c0 tx=0x7f4e6c006db0 comp rx=0 tx=0).stop 2024-09-19T04:07:34.822 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:34.156+0000 7f4e7d601640 1 -- 172.21.15.7:0/3624870543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e78105d20 msgr2=0x7f4e7819d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:34.822 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:34.156+0000 7f4e7d601640 1 --2- 172.21.15.7:0/3624870543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e78105d20 0x7f4e7819d6f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4e680097f0 tx=0x7f4e68030ec0 comp rx=0 tx=0).stop 2024-09-19T04:07:34.822 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:34.156+0000 7f4e7d601640 1 -- 172.21.15.7:0/3624870543 shutdown_connections 2024-09-19T04:07:34.822 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:34.156+0000 7f4e7d601640 1 --2- 172.21.15.7:0/3624870543 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f4e600391b0 0x7f4e6003b670 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:34.822 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:34.156+0000 7f4e7d601640 1 --2- 172.21.15.7:0/3624870543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e78105d20 0x7f4e7819d6f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:34.822 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:34.156+0000 7f4e7d601640 1 -- 172.21.15.7:0/3624870543 >> 172.21.15.7:0/3624870543 conn(0x7f4e78101b90 msgr2=0x7f4e78194350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:34.822 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:34.157+0000 7f4e7d601640 1 -- 172.21.15.7:0/3624870543 shutdown_connections 2024-09-19T04:07:34.822 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:34.157+0000 7f4e7d601640 1 -- 172.21.15.7:0/3624870543 wait complete. 2024-09-19T04:07:35.623 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:35 smithi007 ceph-mon[31360]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:07:35.623 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:35 smithi007 ceph-mon[31360]: Saving service mgr spec with placement count:2 2024-09-19T04:07:35.623 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:35 smithi007 ceph-mon[31360]: from='mgr.14118 172.21.15.7:0/3147503308' entity='mgr.x' 2024-09-19T04:07:36.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:36 smithi007 ceph-mon[31360]: from='mgr.14118 172.21.15.7:0/3147503308' entity='mgr.x' 2024-09-19T04:07:36.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:36 smithi007 ceph-mon[31360]: from='mgr.14118 172.21.15.7:0/3147503308' entity='mgr.x' 2024-09-19T04:07:36.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:36 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3469702269' entity='client.admin' 2024-09-19T04:07:36.862 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.084+0000 7fa1c76dd640 1 Processor -- start 2024-09-19T04:07:36.862 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.084+0000 7fa1c76dd640 1 -- start start 2024-09-19T04:07:36.862 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.084+0000 7fa1c76dd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1c0107630 0x7fa1c0107a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:36.862 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.084+0000 7fa1c76dd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c0108000 con 0x7fa1c0107630 2024-09-19T04:07:36.862 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.084+0000 7fa1c5479640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1c0107630 0x7fa1c0107a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:36.862 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.084+0000 7fa1c5479640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1c0107630 0x7fa1c0107a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32838/0 (socket says 172.21.15.7:32838) 2024-09-19T04:07:36.862 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.084+0000 7fa1c5479640 1 -- 172.21.15.7:0/45526579 learned_addr learned my addr 172.21.15.7:0/45526579 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:36.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.085+0000 7fa1c5479640 1 -- 172.21.15.7:0/45526579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c0108830 con 0x7fa1c0107630 2024-09-19T04:07:36.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.085+0000 7fa1c5479640 1 --2- 172.21.15.7:0/45526579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1c0107630 0x7fa1c0107a30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc009820 tx=0x7fa1bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a88f2429f90685e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:36.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.086+0000 7fa1b7fff640 1 -- 172.21.15.7:0/45526579 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1bc037070 con 0x7fa1c0107630 2024-09-19T04:07:36.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.086+0000 7fa1b7fff640 1 -- 172.21.15.7:0/45526579 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1bc032920 con 0x7fa1c0107630 2024-09-19T04:07:36.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.086+0000 7fa1b7fff640 1 -- 172.21.15.7:0/45526579 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1bc030810 con 0x7fa1c0107630 2024-09-19T04:07:36.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.086+0000 7fa1c76dd640 1 -- 172.21.15.7:0/45526579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1c0107630 msgr2=0x7fa1c0107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:36.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.086+0000 7fa1c76dd640 1 --2- 172.21.15.7:0/45526579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1c0107630 0x7fa1c0107a30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc009820 tx=0x7fa1bc02a270 comp rx=0 tx=0).stop 2024-09-19T04:07:36.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.086+0000 7fa1c76dd640 1 -- 172.21.15.7:0/45526579 shutdown_connections 2024-09-19T04:07:36.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.086+0000 7fa1c76dd640 1 --2- 172.21.15.7:0/45526579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1c0107630 0x7fa1c0107a30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:36.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.086+0000 7fa1c76dd640 1 -- 172.21.15.7:0/45526579 >> 172.21.15.7:0/45526579 conn(0x7fa1c0102de0 msgr2=0x7fa1c0105200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:36.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.086+0000 7fa1c76dd640 1 -- 172.21.15.7:0/45526579 shutdown_connections 2024-09-19T04:07:36.863 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.086+0000 7fa1c76dd640 1 -- 172.21.15.7:0/45526579 wait complete. 2024-09-19T04:07:36.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.087+0000 7fa1c76dd640 1 Processor -- start 2024-09-19T04:07:36.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.087+0000 7fa1c76dd640 1 -- start start 2024-09-19T04:07:36.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.087+0000 7fa1c76dd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1c0107630 0x7fa1c019b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:36.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.087+0000 7fa1c76dd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c010bbe0 con 0x7fa1c0107630 2024-09-19T04:07:36.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.087+0000 7fa1c5479640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1c0107630 0x7fa1c019b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:36.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.087+0000 7fa1c5479640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1c0107630 0x7fa1c019b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32852/0 (socket says 172.21.15.7:32852) 2024-09-19T04:07:36.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.087+0000 7fa1c5479640 1 -- 172.21.15.7:0/3469702269 learned_addr learned my addr 172.21.15.7:0/3469702269 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:36.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.088+0000 7fa1c5479640 1 -- 172.21.15.7:0/3469702269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c019bbf0 con 0x7fa1c0107630 2024-09-19T04:07:36.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.088+0000 7fa1c5479640 1 --2- 172.21.15.7:0/3469702269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1c0107630 0x7fa1c019b6b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc030560 tx=0x7fa1bc032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:36.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.088+0000 7fa1b67fc640 1 -- 172.21.15.7:0/3469702269 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1bc037040 con 0x7fa1c0107630 2024-09-19T04:07:36.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.088+0000 7fa1b67fc640 1 -- 172.21.15.7:0/3469702269 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1bc040070 con 0x7fa1c0107630 2024-09-19T04:07:36.864 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.088+0000 7fa1c76dd640 1 -- 172.21.15.7:0/3469702269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1c019be80 con 0x7fa1c0107630 2024-09-19T04:07:36.865 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.088+0000 7fa1b67fc640 1 -- 172.21.15.7:0/3469702269 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1bc03a6d0 con 0x7fa1c0107630 2024-09-19T04:07:36.865 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.088+0000 7fa1c76dd640 1 -- 172.21.15.7:0/3469702269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1c019eb70 con 0x7fa1c0107630 2024-09-19T04:07:36.865 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.089+0000 7fa1b67fc640 1 -- 172.21.15.7:0/3469702269 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fa1bc03a940 con 0x7fa1c0107630 2024-09-19T04:07:36.865 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.089+0000 7fa1c76dd640 1 -- 172.21.15.7:0/3469702269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1c010bd60 con 0x7fa1c0107630 2024-09-19T04:07:36.865 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.089+0000 7fa1b67fc640 1 --2- 172.21.15.7:0/3469702269 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fa1ac0391b0 0x7fa1ac03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:36.865 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.089+0000 7fa1b67fc640 1 -- 172.21.15.7:0/3469702269 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa1bc06c820 con 0x7fa1c0107630 2024-09-19T04:07:36.865 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.089+0000 7fa1c4c78640 1 --2- 172.21.15.7:0/3469702269 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fa1ac0391b0 0x7fa1ac03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:36.865 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.090+0000 7fa1c4c78640 1 --2- 172.21.15.7:0/3469702269 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fa1ac0391b0 0x7fa1ac03b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa1b00098c0 tx=0x7fa1b0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:36.865 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.094+0000 7fa1b67fc640 1 -- 172.21.15.7:0/3469702269 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa1bc044c70 con 0x7fa1c0107630 2024-09-19T04:07:36.865 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.274+0000 7fa1c76dd640 1 -- 172.21.15.7:0/3469702269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fa1c0107ab0 con 0x7fa1c0107630 2024-09-19T04:07:36.865 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.277+0000 7fa1b67fc640 1 -- 172.21.15.7:0/3469702269 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fa1bc041270 con 0x7fa1c0107630 2024-09-19T04:07:36.865 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.280+0000 7fa1c76dd640 1 -- 172.21.15.7:0/3469702269 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fa1ac0391b0 msgr2=0x7fa1ac03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:36.866 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.280+0000 7fa1c76dd640 1 --2- 172.21.15.7:0/3469702269 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fa1ac0391b0 0x7fa1ac03b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa1b00098c0 tx=0x7fa1b0006db0 comp rx=0 tx=0).stop 2024-09-19T04:07:36.866 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.280+0000 7fa1c76dd640 1 -- 172.21.15.7:0/3469702269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1c0107630 msgr2=0x7fa1c019b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:36.866 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.280+0000 7fa1c76dd640 1 --2- 172.21.15.7:0/3469702269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1c0107630 0x7fa1c019b6b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc030560 tx=0x7fa1bc032670 comp rx=0 tx=0).stop 2024-09-19T04:07:36.866 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.280+0000 7fa1c76dd640 1 -- 172.21.15.7:0/3469702269 shutdown_connections 2024-09-19T04:07:36.866 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.280+0000 7fa1c76dd640 1 --2- 172.21.15.7:0/3469702269 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fa1ac0391b0 0x7fa1ac03b670 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:36.866 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.280+0000 7fa1c76dd640 1 --2- 172.21.15.7:0/3469702269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1c0107630 0x7fa1c019b6b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:36.866 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.280+0000 7fa1c76dd640 1 -- 172.21.15.7:0/3469702269 >> 172.21.15.7:0/3469702269 conn(0x7fa1c0102de0 msgr2=0x7fa1c0103990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:36.866 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.280+0000 7fa1c76dd640 1 -- 172.21.15.7:0/3469702269 shutdown_connections 2024-09-19T04:07:36.866 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:36.280+0000 7fa1c76dd640 1 -- 172.21.15.7:0/3469702269 wait complete. 2024-09-19T04:07:38.474 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:38 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3013340997' entity='client.admin' 2024-09-19T04:07:38.474 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:38 smithi007 ceph-mon[31360]: from='mgr.14118 172.21.15.7:0/3147503308' entity='mgr.x' 2024-09-19T04:07:38.482 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.239+0000 7fa8573b0640 1 Processor -- start 2024-09-19T04:07:38.482 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.239+0000 7fa8573b0640 1 -- start start 2024-09-19T04:07:38.482 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.240+0000 7fa8573b0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa850108110 0x7fa85010a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:38.482 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.240+0000 7fa8573b0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa85007be30 con 0x7fa850108110 2024-09-19T04:07:38.482 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.240+0000 7fa85514c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa850108110 0x7fa85010a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:38.482 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.240+0000 7fa85514c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa850108110 0x7fa85010a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32862/0 (socket says 172.21.15.7:32862) 2024-09-19T04:07:38.483 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.240+0000 7fa85514c640 1 -- 172.21.15.7:0/2308586734 learned_addr learned my addr 172.21.15.7:0/2308586734 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:38.483 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.240+0000 7fa85514c640 1 -- 172.21.15.7:0/2308586734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa85010aa40 con 0x7fa850108110 2024-09-19T04:07:38.483 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.241+0000 7fa85514c640 1 --2- 172.21.15.7:0/2308586734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa850108110 0x7fa85010a500 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa84c009820 tx=0x7fa84c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=272ca01fa8d71316 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:38.483 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.241+0000 7fa847fff640 1 -- 172.21.15.7:0/2308586734 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa84c037070 con 0x7fa850108110 2024-09-19T04:07:38.483 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.241+0000 7fa847fff640 1 -- 172.21.15.7:0/2308586734 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa84c032920 con 0x7fa850108110 2024-09-19T04:07:38.483 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.241+0000 7fa847fff640 1 -- 172.21.15.7:0/2308586734 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa84c030810 con 0x7fa850108110 2024-09-19T04:07:38.483 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.241+0000 7fa8573b0640 1 -- 172.21.15.7:0/2308586734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa850108110 msgr2=0x7fa85010a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:38.483 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.241+0000 7fa8573b0640 1 --2- 172.21.15.7:0/2308586734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa850108110 0x7fa85010a500 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa84c009820 tx=0x7fa84c02a270 comp rx=0 tx=0).stop 2024-09-19T04:07:38.483 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.242+0000 7fa8573b0640 1 -- 172.21.15.7:0/2308586734 shutdown_connections 2024-09-19T04:07:38.483 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.242+0000 7fa8573b0640 1 --2- 172.21.15.7:0/2308586734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa850108110 0x7fa85010a500 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:38.483 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.242+0000 7fa8573b0640 1 -- 172.21.15.7:0/2308586734 >> 172.21.15.7:0/2308586734 conn(0x7fa850101db0 msgr2=0x7fa8501041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:38.483 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.242+0000 7fa8573b0640 1 -- 172.21.15.7:0/2308586734 shutdown_connections 2024-09-19T04:07:38.484 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.242+0000 7fa8573b0640 1 -- 172.21.15.7:0/2308586734 wait complete. 2024-09-19T04:07:38.484 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.242+0000 7fa8573b0640 1 Processor -- start 2024-09-19T04:07:38.484 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.242+0000 7fa8573b0640 1 -- start start 2024-09-19T04:07:38.484 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.242+0000 7fa8573b0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa850108110 0x7fa85019b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:38.484 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.242+0000 7fa8573b0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa85010ba60 con 0x7fa850108110 2024-09-19T04:07:38.484 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.243+0000 7fa85514c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa850108110 0x7fa85019b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:38.484 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.243+0000 7fa85514c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa850108110 0x7fa85019b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32872/0 (socket says 172.21.15.7:32872) 2024-09-19T04:07:38.484 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.243+0000 7fa85514c640 1 -- 172.21.15.7:0/3013340997 learned_addr learned my addr 172.21.15.7:0/3013340997 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:38.484 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.243+0000 7fa85514c640 1 -- 172.21.15.7:0/3013340997 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa85019bb80 con 0x7fa850108110 2024-09-19T04:07:38.484 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.243+0000 7fa85514c640 1 --2- 172.21.15.7:0/3013340997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa850108110 0x7fa85019b640 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa84c030380 tx=0x7fa84c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:38.484 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.243+0000 7fa8467fc640 1 -- 172.21.15.7:0/3013340997 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa84c037040 con 0x7fa850108110 2024-09-19T04:07:38.484 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.243+0000 7fa8467fc640 1 -- 172.21.15.7:0/3013340997 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa84c040070 con 0x7fa850108110 2024-09-19T04:07:38.485 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.243+0000 7fa8573b0640 1 -- 172.21.15.7:0/3013340997 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa85019be10 con 0x7fa850108110 2024-09-19T04:07:38.485 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.243+0000 7fa8467fc640 1 -- 172.21.15.7:0/3013340997 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa84c03a7b0 con 0x7fa850108110 2024-09-19T04:07:38.485 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.243+0000 7fa8573b0640 1 -- 172.21.15.7:0/3013340997 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa85019eb00 con 0x7fa850108110 2024-09-19T04:07:38.485 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.244+0000 7fa8467fc640 1 -- 172.21.15.7:0/3013340997 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fa84c03bc00 con 0x7fa850108110 2024-09-19T04:07:38.485 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.244+0000 7fa8573b0640 1 -- 172.21.15.7:0/3013340997 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa850108570 con 0x7fa850108110 2024-09-19T04:07:38.485 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.244+0000 7fa8467fc640 1 --2- 172.21.15.7:0/3013340997 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fa83c0391b0 0x7fa83c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:38.485 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.244+0000 7fa8467fc640 1 -- 172.21.15.7:0/3013340997 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa84c06c8c0 con 0x7fa850108110 2024-09-19T04:07:38.485 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.244+0000 7fa85494b640 1 --2- 172.21.15.7:0/3013340997 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fa83c0391b0 0x7fa83c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:38.485 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.245+0000 7fa85494b640 1 --2- 172.21.15.7:0/3013340997 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fa83c0391b0 0x7fa83c03b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa8400098c0 tx=0x7fa840006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:38.485 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.249+0000 7fa8467fc640 1 -- 172.21.15.7:0/3013340997 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa84c040220 con 0x7fa850108110 2024-09-19T04:07:38.485 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.426+0000 7fa8573b0640 1 -- 172.21.15.7:0/3013340997 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fa85019f160 con 0x7fa850108110 2024-09-19T04:07:38.485 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.429+0000 7fa8467fc640 1 -- 172.21.15.7:0/3013340997 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fa84c042da0 con 0x7fa850108110 2024-09-19T04:07:38.486 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.431+0000 7fa8573b0640 1 -- 172.21.15.7:0/3013340997 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fa83c0391b0 msgr2=0x7fa83c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:38.486 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.431+0000 7fa8573b0640 1 --2- 172.21.15.7:0/3013340997 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fa83c0391b0 0x7fa83c03b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa8400098c0 tx=0x7fa840006db0 comp rx=0 tx=0).stop 2024-09-19T04:07:38.486 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.431+0000 7fa8573b0640 1 -- 172.21.15.7:0/3013340997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa850108110 msgr2=0x7fa85019b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:38.486 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.431+0000 7fa8573b0640 1 --2- 172.21.15.7:0/3013340997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa850108110 0x7fa85019b640 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa84c030380 tx=0x7fa84c032670 comp rx=0 tx=0).stop 2024-09-19T04:07:38.486 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.432+0000 7fa8573b0640 1 -- 172.21.15.7:0/3013340997 shutdown_connections 2024-09-19T04:07:38.486 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.432+0000 7fa8573b0640 1 --2- 172.21.15.7:0/3013340997 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7fa83c0391b0 0x7fa83c03b670 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:38.486 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.432+0000 7fa8573b0640 1 --2- 172.21.15.7:0/3013340997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa850108110 0x7fa85019b640 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:38.486 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.432+0000 7fa8573b0640 1 -- 172.21.15.7:0/3013340997 >> 172.21.15.7:0/3013340997 conn(0x7fa850101db0 msgr2=0x7fa8501028c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:38.486 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.432+0000 7fa8573b0640 1 -- 172.21.15.7:0/3013340997 shutdown_connections 2024-09-19T04:07:38.486 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:37.432+0000 7fa8573b0640 1 -- 172.21.15.7:0/3013340997 wait complete. 2024-09-19T04:07:38.486 INFO:teuthology.orchestra.run.smithi007.stdout:Enabling the dashboard module... 2024-09-19T04:07:40.216 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:39 smithi007 ceph-mon[31360]: from='mgr.14118 172.21.15.7:0/3147503308' entity='mgr.x' 2024-09-19T04:07:40.216 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:39 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2474508654' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T04:07:40.217 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:40 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: ignoring --setuser ceph since I am not root 2024-09-19T04:07:40.217 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:40 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: ignoring --setgroup ceph since I am not root 2024-09-19T04:07:40.217 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:40 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:40.115+0000 7fd30f311040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T04:07:40.217 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:40 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:40.175+0000 7fd30f311040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T04:07:40.555 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:40 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:40.329+0000 7fd30f311040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T04:07:40.555 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:40 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:40.398+0000 7fd30f311040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T04:07:40.555 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:40 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:40.553+0000 7fd30f311040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:07:40.876 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:40 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:40.700+0000 7fd30f311040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T04:07:40.904 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.909+0000 7ff59fd80640 1 Processor -- start 2024-09-19T04:07:40.904 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.909+0000 7ff59fd80640 1 -- start start 2024-09-19T04:07:40.904 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.909+0000 7ff59fd80640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff598108090 0x7ff59810a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:40.904 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.909+0000 7ff59fd80640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff59807beb0 con 0x7ff598108090 2024-09-19T04:07:40.905 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.910+0000 7ff59db1c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff598108090 0x7ff59810a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:40.905 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.910+0000 7ff59db1c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff598108090 0x7ff59810a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44270/0 (socket says 172.21.15.7:44270) 2024-09-19T04:07:40.905 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.910+0000 7ff59db1c640 1 -- 172.21.15.7:0/2948482472 learned_addr learned my addr 172.21.15.7:0/2948482472 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:40.905 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.910+0000 7ff59db1c640 1 -- 172.21.15.7:0/2948482472 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff59810a9c0 con 0x7ff598108090 2024-09-19T04:07:40.905 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.911+0000 7ff59db1c640 1 --2- 172.21.15.7:0/2948482472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff598108090 0x7ff59810a480 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff594009e80 tx=0x7ff59402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d548fcd7807ec80f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:40.905 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.911+0000 7ff59cb1a640 1 -- 172.21.15.7:0/2948482472 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff594036070 con 0x7ff598108090 2024-09-19T04:07:40.905 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.911+0000 7ff59cb1a640 1 -- 172.21.15.7:0/2948482472 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5940318e0 con 0x7ff598108090 2024-09-19T04:07:40.905 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.911+0000 7ff59cb1a640 1 -- 172.21.15.7:0/2948482472 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff594007a00 con 0x7ff598108090 2024-09-19T04:07:40.905 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.912+0000 7ff59fd80640 1 -- 172.21.15.7:0/2948482472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff598108090 msgr2=0x7ff59810a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:40.905 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.912+0000 7ff59fd80640 1 --2- 172.21.15.7:0/2948482472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff598108090 0x7ff59810a480 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff594009e80 tx=0x7ff59402a7a0 comp rx=0 tx=0).stop 2024-09-19T04:07:40.905 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.912+0000 7ff59fd80640 1 -- 172.21.15.7:0/2948482472 shutdown_connections 2024-09-19T04:07:40.905 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.912+0000 7ff59fd80640 1 --2- 172.21.15.7:0/2948482472 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff598108090 0x7ff59810a480 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:40.905 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.912+0000 7ff59fd80640 1 -- 172.21.15.7:0/2948482472 >> 172.21.15.7:0/2948482472 conn(0x7ff598101db0 msgr2=0x7ff5981041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:40.906 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.912+0000 7ff59fd80640 1 -- 172.21.15.7:0/2948482472 shutdown_connections 2024-09-19T04:07:40.906 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.912+0000 7ff59fd80640 1 -- 172.21.15.7:0/2948482472 wait complete. 2024-09-19T04:07:40.906 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.912+0000 7ff59fd80640 1 Processor -- start 2024-09-19T04:07:40.906 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.913+0000 7ff59fd80640 1 -- start start 2024-09-19T04:07:40.906 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.913+0000 7ff59fd80640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff598108090 0x7ff598107910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:40.906 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.913+0000 7ff59fd80640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff59810baa0 con 0x7ff598108090 2024-09-19T04:07:40.906 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.913+0000 7ff59db1c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff598108090 0x7ff598107910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:40.906 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.913+0000 7ff59db1c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff598108090 0x7ff598107910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44274/0 (socket says 172.21.15.7:44274) 2024-09-19T04:07:40.906 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.913+0000 7ff59db1c640 1 -- 172.21.15.7:0/2474508654 learned_addr learned my addr 172.21.15.7:0/2474508654 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:40.906 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.913+0000 7ff59db1c640 1 -- 172.21.15.7:0/2474508654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff598107e50 con 0x7ff598108090 2024-09-19T04:07:40.906 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.913+0000 7ff59db1c640 1 --2- 172.21.15.7:0/2474508654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff598108090 0x7ff598107910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff594031cf0 tx=0x7ff594031d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:40.906 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.913+0000 7ff58effd640 1 -- 172.21.15.7:0/2474508654 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff594036050 con 0x7ff598108090 2024-09-19T04:07:40.906 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.913+0000 7ff58effd640 1 -- 172.21.15.7:0/2474508654 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff594042070 con 0x7ff598108090 2024-09-19T04:07:40.907 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.913+0000 7ff59fd80640 1 -- 172.21.15.7:0/2474508654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff598106040 con 0x7ff598108090 2024-09-19T04:07:40.907 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.913+0000 7ff58effd640 1 -- 172.21.15.7:0/2474508654 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff59403d9b0 con 0x7ff598108090 2024-09-19T04:07:40.907 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.913+0000 7ff59fd80640 1 -- 172.21.15.7:0/2474508654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff598106580 con 0x7ff598108090 2024-09-19T04:07:40.907 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.914+0000 7ff58effd640 1 -- 172.21.15.7:0/2474508654 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7ff59403db50 con 0x7ff598108090 2024-09-19T04:07:40.907 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.914+0000 7ff59fd80640 1 -- 172.21.15.7:0/2474508654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5981084f0 con 0x7ff598108090 2024-09-19T04:07:40.907 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.914+0000 7ff58effd640 1 --2- 172.21.15.7:0/2474508654 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7ff584039200 0x7ff58403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:40.907 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.915+0000 7ff58effd640 1 -- 172.21.15.7:0/2474508654 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff59406d630 con 0x7ff598108090 2024-09-19T04:07:40.907 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.915+0000 7ff59d31b640 1 --2- 172.21.15.7:0/2474508654 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7ff584039200 0x7ff58403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:40.907 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.915+0000 7ff59d31b640 1 --2- 172.21.15.7:0/2474508654 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7ff584039200 0x7ff58403b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff5880098c0 tx=0x7ff588006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:40.907 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:38.920+0000 7ff58effd640 1 -- 172.21.15.7:0/2474508654 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff59403bda0 con 0x7ff598108090 2024-09-19T04:07:40.907 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:39.145+0000 7ff59fd80640 1 -- 172.21.15.7:0/2474508654 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7ff598106e60 con 0x7ff598108090 2024-09-19T04:07:40.907 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:39.958+0000 7ff58effd640 1 -- 172.21.15.7:0/2474508654 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7ff594047460 con 0x7ff598108090 2024-09-19T04:07:40.908 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:39.960+0000 7ff58effd640 1 -- 172.21.15.7:0/2474508654 <== mon.0 v2:172.21.15.7:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7ff59403b610 con 0x7ff598108090 2024-09-19T04:07:40.908 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:39.961+0000 7ff59fd80640 1 -- 172.21.15.7:0/2474508654 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7ff584039200 msgr2=0x7ff58403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:40.908 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:39.962+0000 7ff59fd80640 1 --2- 172.21.15.7:0/2474508654 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7ff584039200 0x7ff58403b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff5880098c0 tx=0x7ff588006db0 comp rx=0 tx=0).stop 2024-09-19T04:07:40.908 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:39.962+0000 7ff59fd80640 1 -- 172.21.15.7:0/2474508654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff598108090 msgr2=0x7ff598107910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:40.908 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:39.962+0000 7ff59fd80640 1 --2- 172.21.15.7:0/2474508654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff598108090 0x7ff598107910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff594031cf0 tx=0x7ff594031d20 comp rx=0 tx=0).stop 2024-09-19T04:07:40.908 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:39.962+0000 7ff59fd80640 1 -- 172.21.15.7:0/2474508654 shutdown_connections 2024-09-19T04:07:40.908 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:39.962+0000 7ff59fd80640 1 --2- 172.21.15.7:0/2474508654 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7ff584039200 0x7ff58403b6c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:40.908 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:39.962+0000 7ff59fd80640 1 --2- 172.21.15.7:0/2474508654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff598108090 0x7ff598107910 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:40.908 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:39.962+0000 7ff59fd80640 1 -- 172.21.15.7:0/2474508654 >> 172.21.15.7:0/2474508654 conn(0x7ff598101db0 msgr2=0x7ff5981028a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:40.908 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:39.962+0000 7ff59fd80640 1 -- 172.21.15.7:0/2474508654 shutdown_connections 2024-09-19T04:07:40.908 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:39.962+0000 7ff59fd80640 1 -- 172.21.15.7:0/2474508654 wait complete. 2024-09-19T04:07:41.167 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:40 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2474508654' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T04:07:41.167 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:40 smithi007 ceph-mon[31360]: mgrmap e9: x(active, since 19s) 2024-09-19T04:07:41.167 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:41 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:41.036+0000 7fd30f311040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T04:07:41.168 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:41 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:41.100+0000 7fd30f311040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T04:07:41.544 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:41 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:41.298+0000 7fd30f311040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T04:07:42.243 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:41 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2555094172' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T04:07:42.280 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-19T04:07:42.280 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T04:07:42.280 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T04:07:42.281 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T04:07:42.281 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T04:07:42.281 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-19T04:07:42.281 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.337+0000 7f6c9066b640 1 Processor -- start 2024-09-19T04:07:42.281 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.337+0000 7f6c9066b640 1 -- start start 2024-09-19T04:07:42.281 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.337+0000 7f6c9066b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c88107740 0x7f6c88107b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:42.281 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.337+0000 7f6c9066b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6c88108110 con 0x7f6c88107740 2024-09-19T04:07:42.281 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.337+0000 7f6c8e407640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c88107740 0x7f6c88107b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:42.281 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.337+0000 7f6c8e407640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c88107740 0x7f6c88107b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44298/0 (socket says 172.21.15.7:44298) 2024-09-19T04:07:42.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.337+0000 7f6c8e407640 1 -- 172.21.15.7:0/2220117567 learned_addr learned my addr 172.21.15.7:0/2220117567 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:42.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.338+0000 7f6c8e407640 1 -- 172.21.15.7:0/2220117567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c881088a0 con 0x7f6c88107740 2024-09-19T04:07:42.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.338+0000 7f6c8e407640 1 --2- 172.21.15.7:0/2220117567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c88107740 0x7f6c88107b40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6c84009820 tx=0x7f6c8402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e47b1d7e0bb1bcec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:42.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.338+0000 7f6c8d405640 1 -- 172.21.15.7:0/2220117567 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c84037070 con 0x7f6c88107740 2024-09-19T04:07:42.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.339+0000 7f6c8d405640 1 -- 172.21.15.7:0/2220117567 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c84032920 con 0x7f6c88107740 2024-09-19T04:07:42.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.339+0000 7f6c8d405640 1 -- 172.21.15.7:0/2220117567 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c84030810 con 0x7f6c88107740 2024-09-19T04:07:42.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.339+0000 7f6c9066b640 1 -- 172.21.15.7:0/2220117567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c88107740 msgr2=0x7f6c88107b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:42.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.339+0000 7f6c9066b640 1 --2- 172.21.15.7:0/2220117567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c88107740 0x7f6c88107b40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6c84009820 tx=0x7f6c8402a270 comp rx=0 tx=0).stop 2024-09-19T04:07:42.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.339+0000 7f6c9066b640 1 -- 172.21.15.7:0/2220117567 shutdown_connections 2024-09-19T04:07:42.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.339+0000 7f6c9066b640 1 --2- 172.21.15.7:0/2220117567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c88107740 0x7f6c88107b40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:42.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.339+0000 7f6c9066b640 1 -- 172.21.15.7:0/2220117567 >> 172.21.15.7:0/2220117567 conn(0x7f6c88102eb0 msgr2=0x7f6c88105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:42.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.339+0000 7f6c9066b640 1 -- 172.21.15.7:0/2220117567 shutdown_connections 2024-09-19T04:07:42.282 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.339+0000 7f6c9066b640 1 -- 172.21.15.7:0/2220117567 wait complete. 2024-09-19T04:07:42.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.340+0000 7f6c9066b640 1 Processor -- start 2024-09-19T04:07:42.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.340+0000 7f6c9066b640 1 -- start start 2024-09-19T04:07:42.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.340+0000 7f6c9066b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c88107740 0x7f6c8807db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:42.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.340+0000 7f6c9066b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8810bc50 con 0x7f6c88107740 2024-09-19T04:07:42.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.340+0000 7f6c8e407640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c88107740 0x7f6c8807db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:42.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.340+0000 7f6c8e407640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c88107740 0x7f6c8807db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44304/0 (socket says 172.21.15.7:44304) 2024-09-19T04:07:42.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.340+0000 7f6c8e407640 1 -- 172.21.15.7:0/2555094172 learned_addr learned my addr 172.21.15.7:0/2555094172 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:42.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.341+0000 7f6c8e407640 1 -- 172.21.15.7:0/2555094172 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c8807e0b0 con 0x7f6c88107740 2024-09-19T04:07:42.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.341+0000 7f6c8e407640 1 --2- 172.21.15.7:0/2555094172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c88107740 0x7f6c8807db70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6c84030560 tx=0x7f6c84032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:42.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.341+0000 7f6c7f7fe640 1 -- 172.21.15.7:0/2555094172 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c84037040 con 0x7f6c88107740 2024-09-19T04:07:42.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.341+0000 7f6c7f7fe640 1 -- 172.21.15.7:0/2555094172 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c84040070 con 0x7f6c88107740 2024-09-19T04:07:42.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.341+0000 7f6c9066b640 1 -- 172.21.15.7:0/2555094172 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c8807c2a0 con 0x7f6c88107740 2024-09-19T04:07:42.283 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.341+0000 7f6c7f7fe640 1 -- 172.21.15.7:0/2555094172 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c8403a6d0 con 0x7f6c88107740 2024-09-19T04:07:42.284 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.341+0000 7f6c9066b640 1 -- 172.21.15.7:0/2555094172 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c8807c7e0 con 0x7f6c88107740 2024-09-19T04:07:42.284 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.342+0000 7f6c7f7fe640 1 -- 172.21.15.7:0/2555094172 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f6c8403bb20 con 0x7f6c88107740 2024-09-19T04:07:42.284 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.342+0000 7f6c9066b640 1 -- 172.21.15.7:0/2555094172 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c88107bc0 con 0x7f6c88107740 2024-09-19T04:07:42.284 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.342+0000 7f6c7f7fe640 1 --2- 172.21.15.7:0/2555094172 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f6c74039260 0x7f6c7403b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:42.284 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.342+0000 7f6c7f7fe640 1 -- 172.21.15.7:0/2555094172 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6c8406c7f0 con 0x7f6c88107740 2024-09-19T04:07:42.284 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.342+0000 7f6c8dc06640 1 -- 172.21.15.7:0/2555094172 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f6c74039260 msgr2=0x7f6c7403b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/751091002 2024-09-19T04:07:42.284 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.342+0000 7f6c8dc06640 1 --2- 172.21.15.7:0/2555094172 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f6c74039260 0x7f6c7403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T04:07:42.284 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.351+0000 7f6c7f7fe640 1 -- 172.21.15.7:0/2555094172 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6c8404a200 con 0x7f6c88107740 2024-09-19T04:07:42.284 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.543+0000 7f6c8dc06640 1 -- 172.21.15.7:0/2555094172 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f6c74039260 msgr2=0x7f6c7403b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/751091002 2024-09-19T04:07:42.284 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.543+0000 7f6c8dc06640 1 --2- 172.21.15.7:0/2555094172 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f6c74039260 0x7f6c7403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T04:07:42.284 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.575+0000 7f6c9066b640 1 -- 172.21.15.7:0/2555094172 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f6c8807cf80 con 0x7f6c88107740 2024-09-19T04:07:42.284 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.575+0000 7f6c7f7fe640 1 -- 172.21.15.7:0/2555094172 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f6c84031e80 con 0x7f6c88107740 2024-09-19T04:07:42.284 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.577+0000 7f6c9066b640 1 -- 172.21.15.7:0/2555094172 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f6c74039260 msgr2=0x7f6c7403b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T04:07:42.285 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.577+0000 7f6c9066b640 1 --2- 172.21.15.7:0/2555094172 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f6c74039260 0x7f6c7403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:42.285 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.577+0000 7f6c9066b640 1 -- 172.21.15.7:0/2555094172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c88107740 msgr2=0x7f6c8807db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:42.285 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.577+0000 7f6c9066b640 1 --2- 172.21.15.7:0/2555094172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c88107740 0x7f6c8807db70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6c84030560 tx=0x7f6c84032670 comp rx=0 tx=0).stop 2024-09-19T04:07:42.285 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.577+0000 7f6c9066b640 1 -- 172.21.15.7:0/2555094172 shutdown_connections 2024-09-19T04:07:42.285 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.577+0000 7f6c9066b640 1 --2- 172.21.15.7:0/2555094172 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f6c74039260 0x7f6c7403b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:42.285 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.577+0000 7f6c9066b640 1 --2- 172.21.15.7:0/2555094172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c88107740 0x7f6c8807db70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:42.285 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.577+0000 7f6c9066b640 1 -- 172.21.15.7:0/2555094172 >> 172.21.15.7:0/2555094172 conn(0x7f6c88102eb0 msgr2=0x7f6c88103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:42.285 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.577+0000 7f6c9066b640 1 -- 172.21.15.7:0/2555094172 shutdown_connections 2024-09-19T04:07:42.285 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:41.577+0000 7f6c9066b640 1 -- 172.21.15.7:0/2555094172 wait complete. 2024-09-19T04:07:42.285 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for the mgr to restart... 2024-09-19T04:07:42.285 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mgr epoch 9... 2024-09-19T04:07:42.499 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:42 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:42.242+0000 7fd30f311040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T04:07:42.499 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:42 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:42.316+0000 7fd30f311040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T04:07:43.195 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:43 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:43.073+0000 7fd30f311040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T04:07:43.195 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:43 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:43.193+0000 7fd30f311040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T04:07:43.564 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:43 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:43.343+0000 7fd30f311040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:07:43.564 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:43 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:43.406+0000 7fd30f311040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T04:07:43.564 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:43 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:43.562+0000 7fd30f311040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T04:07:43.863 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:43 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:43.633+0000 7fd30f311040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T04:07:43.863 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:43 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:43.696+0000 7fd30f311040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T04:07:43.863 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:43 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:43.862+0000 7fd30f311040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T04:07:44.126 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:43 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:43.930+0000 7fd30f311040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T04:07:44.127 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:44 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:43.999+0000 7fd30f311040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T04:07:44.127 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:44 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:44.085+0000 7fd30f311040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T04:07:44.626 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:44 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:44.148+0000 7fd30f311040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T04:07:44.627 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:44 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:44.209+0000 7fd30f311040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T04:07:45.293 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:45 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:45.037+0000 7fd30f311040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T04:07:45.293 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:45 smithi007 ceph-mon[31360]: Active manager daemon x restarted 2024-09-19T04:07:45.293 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:45 smithi007 ceph-mon[31360]: Activating manager daemon x 2024-09-19T04:07:45.293 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:45 smithi007 ceph-mon[31360]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T04:07:45.293 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:45 smithi007 ceph-mon[31360]: mgrmap e10: x(active, starting, since 0.00351013s) 2024-09-19T04:07:45.294 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:45 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:07:45.294 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:45 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T04:07:45.294 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:45 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T04:07:45.294 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:45 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T04:07:45.294 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:45 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T04:07:45.294 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:45 smithi007 ceph-mon[31360]: Manager daemon x is now available 2024-09-19T04:07:45.294 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:45 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:07:45.294 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:45 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T04:07:45.294 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:45 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T04:07:46.814 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-19T04:07:46.814 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T04:07:46.814 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T04:07:46.814 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-19T04:07:46.814 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.670+0000 7f20b25b5640 1 Processor -- start 2024-09-19T04:07:46.814 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.670+0000 7f20b25b5640 1 -- start start 2024-09-19T04:07:46.815 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.670+0000 7f20b25b5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20ac1080e0 0x7f20ac10a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:46.815 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.670+0000 7f20b25b5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f20ac07be00 con 0x7f20ac1080e0 2024-09-19T04:07:46.815 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.670+0000 7f20abfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20ac1080e0 0x7f20ac10a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:46.815 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.670+0000 7f20abfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20ac1080e0 0x7f20ac10a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44314/0 (socket says 172.21.15.7:44314) 2024-09-19T04:07:46.815 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.670+0000 7f20abfff640 1 -- 172.21.15.7:0/1106217097 learned_addr learned my addr 172.21.15.7:0/1106217097 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:46.815 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.671+0000 7f20abfff640 1 -- 172.21.15.7:0/1106217097 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ac10aa10 con 0x7f20ac1080e0 2024-09-19T04:07:46.815 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.671+0000 7f20abfff640 1 --2- 172.21.15.7:0/1106217097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20ac1080e0 0x7f20ac10a4d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f209c009820 tx=0x7f209c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a5ad79c9ab5430 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:46.815 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.671+0000 7f20aaffd640 1 -- 172.21.15.7:0/1106217097 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c037070 con 0x7f20ac1080e0 2024-09-19T04:07:46.815 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.671+0000 7f20aaffd640 1 -- 172.21.15.7:0/1106217097 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f209c032920 con 0x7f20ac1080e0 2024-09-19T04:07:46.815 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.672+0000 7f20aaffd640 1 -- 172.21.15.7:0/1106217097 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c030810 con 0x7f20ac1080e0 2024-09-19T04:07:46.815 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.672+0000 7f20b25b5640 1 -- 172.21.15.7:0/1106217097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20ac1080e0 msgr2=0x7f20ac10a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:46.815 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.672+0000 7f20b25b5640 1 --2- 172.21.15.7:0/1106217097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20ac1080e0 0x7f20ac10a4d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f209c009820 tx=0x7f209c02a270 comp rx=0 tx=0).stop 2024-09-19T04:07:46.816 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.672+0000 7f20b25b5640 1 -- 172.21.15.7:0/1106217097 shutdown_connections 2024-09-19T04:07:46.816 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.672+0000 7f20b25b5640 1 --2- 172.21.15.7:0/1106217097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20ac1080e0 0x7f20ac10a4d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:46.816 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.672+0000 7f20b25b5640 1 -- 172.21.15.7:0/1106217097 >> 172.21.15.7:0/1106217097 conn(0x7f20ac101ca0 msgr2=0x7f20ac1040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:46.816 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.672+0000 7f20b25b5640 1 -- 172.21.15.7:0/1106217097 shutdown_connections 2024-09-19T04:07:46.816 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.672+0000 7f20b25b5640 1 -- 172.21.15.7:0/1106217097 wait complete. 2024-09-19T04:07:46.816 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.673+0000 7f20b25b5640 1 Processor -- start 2024-09-19T04:07:46.816 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.673+0000 7f20b25b5640 1 -- start start 2024-09-19T04:07:46.816 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.673+0000 7f20b25b5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20ac1080e0 0x7f20ac107960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:46.816 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.673+0000 7f20b25b5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f20ac10ba30 con 0x7f20ac1080e0 2024-09-19T04:07:46.816 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.673+0000 7f20abfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20ac1080e0 0x7f20ac107960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:46.816 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.673+0000 7f20abfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20ac1080e0 0x7f20ac107960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44324/0 (socket says 172.21.15.7:44324) 2024-09-19T04:07:46.816 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.673+0000 7f20abfff640 1 -- 172.21.15.7:0/2568157292 learned_addr learned my addr 172.21.15.7:0/2568157292 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:46.817 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.674+0000 7f20abfff640 1 -- 172.21.15.7:0/2568157292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ac107ea0 con 0x7f20ac1080e0 2024-09-19T04:07:46.817 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.674+0000 7f20abfff640 1 --2- 172.21.15.7:0/2568157292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20ac1080e0 0x7f20ac107960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f209c030380 tx=0x7f209c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:46.817 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.674+0000 7f20a97fa640 1 -- 172.21.15.7:0/2568157292 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c037040 con 0x7f20ac1080e0 2024-09-19T04:07:46.817 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.674+0000 7f20b25b5640 1 -- 172.21.15.7:0/2568157292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20ac106090 con 0x7f20ac1080e0 2024-09-19T04:07:46.817 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.674+0000 7f20a97fa640 1 -- 172.21.15.7:0/2568157292 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f209c040070 con 0x7f20ac1080e0 2024-09-19T04:07:46.817 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.674+0000 7f20a97fa640 1 -- 172.21.15.7:0/2568157292 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c03a7b0 con 0x7f20ac1080e0 2024-09-19T04:07:46.817 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.674+0000 7f20b25b5640 1 -- 172.21.15.7:0/2568157292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20ac1065d0 con 0x7f20ac1080e0 2024-09-19T04:07:46.817 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.675+0000 7f20a97fa640 1 -- 172.21.15.7:0/2568157292 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f209c03b420 con 0x7f20ac1080e0 2024-09-19T04:07:46.817 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.676+0000 7f20a97fa640 1 --2- 172.21.15.7:0/2568157292 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f2094039260 0x7f209403b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:46.817 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.676+0000 7f20a97fa640 1 -- 172.21.15.7:0/2568157292 --> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f209403be30 con 0x7f2094039260 2024-09-19T04:07:46.817 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.676+0000 7f20ab7fe640 1 -- 172.21.15.7:0/2568157292 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f2094039260 msgr2=0x7f209403b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/751091002 2024-09-19T04:07:46.817 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.676+0000 7f20a97fa640 1 -- 172.21.15.7:0/2568157292 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f209c06c8b0 con 0x7f20ac1080e0 2024-09-19T04:07:46.818 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.676+0000 7f20ab7fe640 1 --2- 172.21.15.7:0/2568157292 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f2094039260 0x7f209403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T04:07:46.818 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.877+0000 7f20ab7fe640 1 -- 172.21.15.7:0/2568157292 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f2094039260 msgr2=0x7f209403b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/751091002 2024-09-19T04:07:46.818 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:42.877+0000 7f20ab7fe640 1 --2- 172.21.15.7:0/2568157292 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f2094039260 0x7f209403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T04:07:46.818 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:43.278+0000 7f20ab7fe640 1 -- 172.21.15.7:0/2568157292 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f2094039260 msgr2=0x7f209403b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/751091002 2024-09-19T04:07:46.818 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:43.278+0000 7f20ab7fe640 1 --2- 172.21.15.7:0/2568157292 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f2094039260 0x7f209403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T04:07:46.818 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:44.079+0000 7f20ab7fe640 1 -- 172.21.15.7:0/2568157292 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f2094039260 msgr2=0x7f209403b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.7:6800/751091002 2024-09-19T04:07:46.818 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:44.079+0000 7f20ab7fe640 1 --2- 172.21.15.7:0/2568157292 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f2094039260 0x7f209403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T04:07:46.818 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:45.041+0000 7f20a97fa640 1 -- 172.21.15.7:0/2568157292 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7f209c06b360 con 0x7f20ac1080e0 2024-09-19T04:07:46.818 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:45.041+0000 7f20a97fa640 1 -- 172.21.15.7:0/2568157292 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f2094039260 msgr2=0x7f209403b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T04:07:46.818 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:45.041+0000 7f20a97fa640 1 --2- 172.21.15.7:0/2568157292 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f2094039260 0x7f209403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:46.818 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:46.042+0000 7f20a97fa640 1 -- 172.21.15.7:0/2568157292 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f209c06bde0 con 0x7f20ac1080e0 2024-09-19T04:07:46.818 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:46.042+0000 7f20a97fa640 1 --2- 172.21.15.7:0/2568157292 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f209403cd20 0x7f209403f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:46.818 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:46.042+0000 7f20a97fa640 1 -- 172.21.15.7:0/2568157292 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f209c00af30 con 0x7f209403cd20 2024-09-19T04:07:46.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:46.043+0000 7f20ab7fe640 1 --2- 172.21.15.7:0/2568157292 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f209403cd20 0x7f209403f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:46.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:46.044+0000 7f20ab7fe640 1 --2- 172.21.15.7:0/2568157292 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f209403cd20 0x7f209403f110 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f20a0003980 tx=0x7f20a00092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:46.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:46.044+0000 7f20a97fa640 1 -- 172.21.15.7:0/2568157292 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f209c00af30 con 0x7f209403cd20 2024-09-19T04:07:46.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:46.052+0000 7f20b25b5640 1 -- 172.21.15.7:0/2568157292 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f20980025a0 con 0x7f209403cd20 2024-09-19T04:07:46.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:46.052+0000 7f20a97fa640 1 -- 172.21.15.7:0/2568157292 <== mgr.14150 v2:172.21.15.7:6800/1262394163 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f20980025a0 con 0x7f209403cd20 2024-09-19T04:07:46.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:46.053+0000 7f20b25b5640 1 -- 172.21.15.7:0/2568157292 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f209403cd20 msgr2=0x7f209403f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:46.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:46.053+0000 7f20b25b5640 1 --2- 172.21.15.7:0/2568157292 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f209403cd20 0x7f209403f110 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f20a0003980 tx=0x7f20a00092b0 comp rx=0 tx=0).stop 2024-09-19T04:07:46.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:46.053+0000 7f20b25b5640 1 -- 172.21.15.7:0/2568157292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20ac1080e0 msgr2=0x7f20ac107960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:46.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:46.053+0000 7f20b25b5640 1 --2- 172.21.15.7:0/2568157292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20ac1080e0 0x7f20ac107960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f209c030380 tx=0x7f209c032670 comp rx=0 tx=0).stop 2024-09-19T04:07:46.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:46.053+0000 7f20b25b5640 1 -- 172.21.15.7:0/2568157292 shutdown_connections 2024-09-19T04:07:46.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:46.053+0000 7f20b25b5640 1 --2- 172.21.15.7:0/2568157292 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f209403cd20 0x7f209403f110 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:46.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:46.053+0000 7f20b25b5640 1 --2- 172.21.15.7:0/2568157292 >> [v2:172.21.15.7:6800/751091002,v1:172.21.15.7:6801/751091002] conn(0x7f2094039260 0x7f209403b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:46.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:46.053+0000 7f20b25b5640 1 --2- 172.21.15.7:0/2568157292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20ac1080e0 0x7f20ac107960 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:46.819 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:46.053+0000 7f20b25b5640 1 -- 172.21.15.7:0/2568157292 >> 172.21.15.7:0/2568157292 conn(0x7f20ac101ca0 msgr2=0x7f20ac102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:46.820 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:46.053+0000 7f20b25b5640 1 -- 172.21.15.7:0/2568157292 shutdown_connections 2024-09-19T04:07:46.820 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:46.053+0000 7f20b25b5640 1 -- 172.21.15.7:0/2568157292 wait complete. 2024-09-19T04:07:46.820 INFO:teuthology.orchestra.run.smithi007.stdout:mgr epoch 9 is available 2024-09-19T04:07:46.820 INFO:teuthology.orchestra.run.smithi007.stdout:Generating a dashboard self-signed certificate... 2024-09-19T04:07:47.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:47 smithi007 ceph-mon[31360]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T04:07:47.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:47 smithi007 ceph-mon[31360]: mgrmap e11: x(active, since 1.00669s) 2024-09-19T04:07:47.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:47 smithi007 ceph-mon[31360]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T04:07:47.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:47 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:07:47.459 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:47 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:47.194+0000 7fd27a5e5640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:04:07:47] ENGINE Error in HTTPServer.serve 2024-09-19T04:07:47.459 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:47 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: Traceback (most recent call last): 2024-09-19T04:07:47.459 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:47 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T04:07:47.460 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:47 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: self._connections.run(self.expiration_interval) 2024-09-19T04:07:47.460 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:47 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T04:07:47.460 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:47 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: self._run(expiration_interval) 2024-09-19T04:07:47.460 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:47 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T04:07:47.460 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:47 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T04:07:47.460 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:47 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T04:07:47.460 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:47 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T04:07:47.460 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:47 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T04:07:47.460 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:47 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: s = self.context.wrap_socket( 2024-09-19T04:07:47.460 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:47 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T04:07:47.460 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:47 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: return self.sslsocket_class._create( 2024-09-19T04:07:47.460 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:47 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T04:07:47.461 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:47 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: self.do_handshake() 2024-09-19T04:07:47.461 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:47 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T04:07:47.461 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:47 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: self._sslobj.do_handshake() 2024-09-19T04:07:47.461 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:47 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T04:07:47.461 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:07:47 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:07:48.037 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T04:07:48.037 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.209+0000 7f4608657640 1 Processor -- start 2024-09-19T04:07:48.037 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.209+0000 7f4608657640 1 -- start start 2024-09-19T04:07:48.037 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.210+0000 7f4608657640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4600107660 0x7f4600107a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:48.037 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.210+0000 7f4608657640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4600107fa0 con 0x7f4600107660 2024-09-19T04:07:48.037 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.210+0000 7f46063f3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4600107660 0x7f4600107a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:48.037 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.210+0000 7f46063f3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4600107660 0x7f4600107a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44384/0 (socket says 172.21.15.7:44384) 2024-09-19T04:07:48.038 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.210+0000 7f46063f3640 1 -- 172.21.15.7:0/3576756733 learned_addr learned my addr 172.21.15.7:0/3576756733 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:48.038 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.210+0000 7f46063f3640 1 -- 172.21.15.7:0/3576756733 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4600108120 con 0x7f4600107660 2024-09-19T04:07:48.038 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.211+0000 7f46063f3640 1 --2- 172.21.15.7:0/3576756733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4600107660 0x7f4600107a60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f45fc009820 tx=0x7f45fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd81acc9630c1a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:48.038 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.211+0000 7f46053f1640 1 -- 172.21.15.7:0/3576756733 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45fc037070 con 0x7f4600107660 2024-09-19T04:07:48.038 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.211+0000 7f46053f1640 1 -- 172.21.15.7:0/3576756733 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45fc032920 con 0x7f4600107660 2024-09-19T04:07:48.038 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.211+0000 7f46053f1640 1 -- 172.21.15.7:0/3576756733 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45fc030810 con 0x7f4600107660 2024-09-19T04:07:48.038 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.212+0000 7f4608657640 1 -- 172.21.15.7:0/3576756733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4600107660 msgr2=0x7f4600107a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:48.038 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.212+0000 7f4608657640 1 --2- 172.21.15.7:0/3576756733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4600107660 0x7f4600107a60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f45fc009820 tx=0x7f45fc02a270 comp rx=0 tx=0).stop 2024-09-19T04:07:48.038 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.212+0000 7f4608657640 1 -- 172.21.15.7:0/3576756733 shutdown_connections 2024-09-19T04:07:48.038 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.212+0000 7f4608657640 1 --2- 172.21.15.7:0/3576756733 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4600107660 0x7f4600107a60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:48.038 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.212+0000 7f4608657640 1 -- 172.21.15.7:0/3576756733 >> 172.21.15.7:0/3576756733 conn(0x7f4600102eb0 msgr2=0x7f46001052d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:48.038 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.212+0000 7f4608657640 1 -- 172.21.15.7:0/3576756733 shutdown_connections 2024-09-19T04:07:48.038 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.212+0000 7f4608657640 1 -- 172.21.15.7:0/3576756733 wait complete. 2024-09-19T04:07:48.038 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.213+0000 7f4608657640 1 Processor -- start 2024-09-19T04:07:48.039 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.213+0000 7f4608657640 1 -- start start 2024-09-19T04:07:48.039 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.213+0000 7f4608657640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4600107660 0x7f460019d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:48.039 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.213+0000 7f4608657640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f460010bad0 con 0x7f4600107660 2024-09-19T04:07:48.039 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.213+0000 7f46063f3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4600107660 0x7f460019d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:48.039 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.213+0000 7f46063f3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4600107660 0x7f460019d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44400/0 (socket says 172.21.15.7:44400) 2024-09-19T04:07:48.039 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.213+0000 7f46063f3640 1 -- 172.21.15.7:0/3354443079 learned_addr learned my addr 172.21.15.7:0/3354443079 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:48.039 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.214+0000 7f46063f3640 1 -- 172.21.15.7:0/3354443079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f460019dd20 con 0x7f4600107660 2024-09-19T04:07:48.039 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.214+0000 7f46063f3640 1 --2- 172.21.15.7:0/3354443079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4600107660 0x7f460019d7e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f45fc0097f0 tx=0x7f45fc0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:48.039 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.214+0000 7f45f77fe640 1 -- 172.21.15.7:0/3354443079 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45fc037040 con 0x7f4600107660 2024-09-19T04:07:48.039 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.214+0000 7f4608657640 1 -- 172.21.15.7:0/3354443079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f460019dfb0 con 0x7f4600107660 2024-09-19T04:07:48.039 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.214+0000 7f45f77fe640 1 -- 172.21.15.7:0/3354443079 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45fc030cc0 con 0x7f4600107660 2024-09-19T04:07:48.039 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.214+0000 7f4608657640 1 -- 172.21.15.7:0/3354443079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46001a0ca0 con 0x7f4600107660 2024-09-19T04:07:48.039 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.215+0000 7f45f77fe640 1 -- 172.21.15.7:0/3354443079 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45fc03a6b0 con 0x7f4600107660 2024-09-19T04:07:48.040 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.215+0000 7f45f77fe640 1 -- 172.21.15.7:0/3354443079 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f45fc03a8c0 con 0x7f4600107660 2024-09-19T04:07:48.040 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.215+0000 7f4608657640 1 -- 172.21.15.7:0/3354443079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4600107ae0 con 0x7f4600107660 2024-09-19T04:07:48.040 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.215+0000 7f45f77fe640 1 --2- 172.21.15.7:0/3354443079 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f45ec0390f0 0x7f45ec03b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:48.040 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.216+0000 7f45f77fe640 1 -- 172.21.15.7:0/3354443079 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f45fc06c740 con 0x7f4600107660 2024-09-19T04:07:48.040 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.216+0000 7f4605bf2640 1 --2- 172.21.15.7:0/3354443079 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f45ec0390f0 0x7f45ec03b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:48.040 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.216+0000 7f4605bf2640 1 --2- 172.21.15.7:0/3354443079 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f45ec0390f0 0x7f45ec03b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f45f00098c0 tx=0x7f45f0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:48.040 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.225+0000 7f45f77fe640 1 -- 172.21.15.7:0/3354443079 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f45fc043d80 con 0x7f4600107660 2024-09-19T04:07:48.040 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.271+0000 7f45f77fe640 1 -- 172.21.15.7:0/3354443079 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f45fc06ecd0 con 0x7f4600107660 2024-09-19T04:07:48.040 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.416+0000 7f4608657640 1 -- 172.21.15.7:0/3354443079 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f4600104090 con 0x7f45ec0390f0 2024-09-19T04:07:48.040 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.457+0000 7f45f77fe640 1 -- 172.21.15.7:0/3354443079 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f4600104090 con 0x7f45ec0390f0 2024-09-19T04:07:48.040 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.459+0000 7f4608657640 1 -- 172.21.15.7:0/3354443079 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f45ec0390f0 msgr2=0x7f45ec03b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:48.040 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.459+0000 7f4608657640 1 --2- 172.21.15.7:0/3354443079 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f45ec0390f0 0x7f45ec03b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f45f00098c0 tx=0x7f45f0006db0 comp rx=0 tx=0).stop 2024-09-19T04:07:48.040 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.459+0000 7f4608657640 1 -- 172.21.15.7:0/3354443079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4600107660 msgr2=0x7f460019d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:48.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.459+0000 7f4608657640 1 --2- 172.21.15.7:0/3354443079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4600107660 0x7f460019d7e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f45fc0097f0 tx=0x7f45fc0327b0 comp rx=0 tx=0).stop 2024-09-19T04:07:48.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.459+0000 7f4608657640 1 -- 172.21.15.7:0/3354443079 shutdown_connections 2024-09-19T04:07:48.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.459+0000 7f4608657640 1 --2- 172.21.15.7:0/3354443079 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f45ec0390f0 0x7f45ec03b5b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:48.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.459+0000 7f4608657640 1 --2- 172.21.15.7:0/3354443079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4600107660 0x7f460019d7e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:48.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.459+0000 7f4608657640 1 -- 172.21.15.7:0/3354443079 >> 172.21.15.7:0/3354443079 conn(0x7f4600102eb0 msgr2=0x7f4600103980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:48.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.460+0000 7f4608657640 1 -- 172.21.15.7:0/3354443079 shutdown_connections 2024-09-19T04:07:48.041 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:47.460+0000 7f4608657640 1 -- 172.21.15.7:0/3354443079 wait complete. 2024-09-19T04:07:48.041 INFO:teuthology.orchestra.run.smithi007.stdout:Creating initial admin user... 2024-09-19T04:07:48.598 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:48 smithi007 ceph-mon[31360]: [19/Sep/2024:04:07:47] ENGINE Bus STARTING 2024-09-19T04:07:48.598 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:48 smithi007 ceph-mon[31360]: [19/Sep/2024:04:07:47] ENGINE Serving on https://172.21.15.7:7150 2024-09-19T04:07:48.598 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:48 smithi007 ceph-mon[31360]: [19/Sep/2024:04:07:47] ENGINE Error in HTTPServer.serve 2024-09-19T04:07:48.598 INFO:journalctl@ceph.mon.a.smithi007.stdout: Traceback (most recent call last): 2024-09-19T04:07:48.598 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T04:07:48.598 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._connections.run(self.expiration_interval) 2024-09-19T04:07:48.598 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T04:07:48.598 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._run(expiration_interval) 2024-09-19T04:07:48.598 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T04:07:48.598 INFO:journalctl@ceph.mon.a.smithi007.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T04:07:48.599 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T04:07:48.599 INFO:journalctl@ceph.mon.a.smithi007.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T04:07:48.599 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T04:07:48.599 INFO:journalctl@ceph.mon.a.smithi007.stdout: s = self.context.wrap_socket( 2024-09-19T04:07:48.599 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T04:07:48.599 INFO:journalctl@ceph.mon.a.smithi007.stdout: return self.sslsocket_class._create( 2024-09-19T04:07:48.599 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T04:07:48.599 INFO:journalctl@ceph.mon.a.smithi007.stdout: self.do_handshake() 2024-09-19T04:07:48.599 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T04:07:48.599 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._sslobj.do_handshake() 2024-09-19T04:07:48.599 INFO:journalctl@ceph.mon.a.smithi007.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T04:07:48.599 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:48 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:07:48.599 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:48 smithi007 ceph-mon[31360]: mgrmap e12: x(active, since 2s) 2024-09-19T04:07:48.599 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:48 smithi007 ceph-mon[31360]: [19/Sep/2024:04:07:47] ENGINE Serving on http://172.21.15.7:8765 2024-09-19T04:07:48.600 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:48 smithi007 ceph-mon[31360]: [19/Sep/2024:04:07:47] ENGINE Bus STARTED 2024-09-19T04:07:48.600 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:48 smithi007 ceph-mon[31360]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:07:48.600 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:48 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:07:48.600 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:48 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:07:49.614 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$5E/kAWBR6RTv5B/5lNDuY.pThymuzzsnPfmD74Sqdpp97g/RB0tsC", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726718868, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T04:07:49.615 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.433+0000 7fccffce9640 1 Processor -- start 2024-09-19T04:07:49.615 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.434+0000 7fccffce9640 1 -- start start 2024-09-19T04:07:49.615 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.434+0000 7fccffce9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccf8106520 0x7fccf8106920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:49.615 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.434+0000 7fccffce9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fccf8106ef0 con 0x7fccf8106520 2024-09-19T04:07:49.615 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.434+0000 7fccfda85640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccf8106520 0x7fccf8106920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:49.615 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.434+0000 7fccfda85640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccf8106520 0x7fccf8106920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49466/0 (socket says 172.21.15.7:49466) 2024-09-19T04:07:49.615 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.434+0000 7fccfda85640 1 -- 172.21.15.7:0/72350283 learned_addr learned my addr 172.21.15.7:0/72350283 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:49.615 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.435+0000 7fccfda85640 1 -- 172.21.15.7:0/72350283 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf8107720 con 0x7fccf8106520 2024-09-19T04:07:49.615 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.435+0000 7fccfda85640 1 --2- 172.21.15.7:0/72350283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccf8106520 0x7fccf8106920 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcce8009820 tx=0x7fcce802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a6b6f633d32714 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:49.615 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.436+0000 7fccfca83640 1 -- 172.21.15.7:0/72350283 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcce8037070 con 0x7fccf8106520 2024-09-19T04:07:49.615 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.436+0000 7fccfca83640 1 -- 172.21.15.7:0/72350283 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcce8032920 con 0x7fccf8106520 2024-09-19T04:07:49.615 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.436+0000 7fccfca83640 1 -- 172.21.15.7:0/72350283 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcce8030810 con 0x7fccf8106520 2024-09-19T04:07:49.616 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.436+0000 7fccffce9640 1 -- 172.21.15.7:0/72350283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccf8106520 msgr2=0x7fccf8106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:49.616 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.436+0000 7fccffce9640 1 --2- 172.21.15.7:0/72350283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccf8106520 0x7fccf8106920 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcce8009820 tx=0x7fcce802a270 comp rx=0 tx=0).stop 2024-09-19T04:07:49.616 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.436+0000 7fccffce9640 1 -- 172.21.15.7:0/72350283 shutdown_connections 2024-09-19T04:07:49.616 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.436+0000 7fccffce9640 1 --2- 172.21.15.7:0/72350283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccf8106520 0x7fccf8106920 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:49.616 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.436+0000 7fccffce9640 1 -- 172.21.15.7:0/72350283 >> 172.21.15.7:0/72350283 conn(0x7fccf8101db0 msgr2=0x7fccf81041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:49.616 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.437+0000 7fccffce9640 1 -- 172.21.15.7:0/72350283 shutdown_connections 2024-09-19T04:07:49.616 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.437+0000 7fccffce9640 1 -- 172.21.15.7:0/72350283 wait complete. 2024-09-19T04:07:49.616 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.437+0000 7fccffce9640 1 Processor -- start 2024-09-19T04:07:49.616 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.437+0000 7fccffce9640 1 -- start start 2024-09-19T04:07:49.616 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.437+0000 7fccffce9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccf8106520 0x7fccf8191750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:49.616 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.437+0000 7fccffce9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fccf810aad0 con 0x7fccf8106520 2024-09-19T04:07:49.616 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.438+0000 7fccfda85640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccf8106520 0x7fccf8191750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:49.616 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.438+0000 7fccfda85640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccf8106520 0x7fccf8191750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49468/0 (socket says 172.21.15.7:49468) 2024-09-19T04:07:49.617 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.438+0000 7fccfda85640 1 -- 172.21.15.7:0/2355078612 learned_addr learned my addr 172.21.15.7:0/2355078612 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:49.617 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.438+0000 7fccfda85640 1 -- 172.21.15.7:0/2355078612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf8191c90 con 0x7fccf8106520 2024-09-19T04:07:49.617 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.438+0000 7fccfda85640 1 --2- 172.21.15.7:0/2355078612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccf8106520 0x7fccf8191750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcce8030560 tx=0x7fcce8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:49.617 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.438+0000 7fccf6ffd640 1 -- 172.21.15.7:0/2355078612 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcce8037040 con 0x7fccf8106520 2024-09-19T04:07:49.617 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.438+0000 7fccf6ffd640 1 -- 172.21.15.7:0/2355078612 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcce8040070 con 0x7fccf8106520 2024-09-19T04:07:49.617 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.438+0000 7fccffce9640 1 -- 172.21.15.7:0/2355078612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf818fe80 con 0x7fccf8106520 2024-09-19T04:07:49.617 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.438+0000 7fccf6ffd640 1 -- 172.21.15.7:0/2355078612 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcce803a6d0 con 0x7fccf8106520 2024-09-19T04:07:49.617 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.438+0000 7fccffce9640 1 -- 172.21.15.7:0/2355078612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf81903c0 con 0x7fccf8106520 2024-09-19T04:07:49.617 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.439+0000 7fccf6ffd640 1 -- 172.21.15.7:0/2355078612 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fcce803a940 con 0x7fccf8106520 2024-09-19T04:07:49.617 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.440+0000 7fccffce9640 1 -- 172.21.15.7:0/2355078612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccf81069a0 con 0x7fccf8106520 2024-09-19T04:07:49.617 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.440+0000 7fccf6ffd640 1 --2- 172.21.15.7:0/2355078612 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fcce0039260 0x7fcce003b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:49.617 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.440+0000 7fccf6ffd640 1 -- 172.21.15.7:0/2355078612 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fcce806ca20 con 0x7fccf8106520 2024-09-19T04:07:49.617 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.440+0000 7fccfd284640 1 --2- 172.21.15.7:0/2355078612 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fcce0039260 0x7fcce003b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:49.618 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.441+0000 7fccfd284640 1 --2- 172.21.15.7:0/2355078612 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fcce0039260 0x7fcce003b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fccec00ad30 tx=0x7fccec0093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:49.618 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.445+0000 7fccf6ffd640 1 -- 172.21.15.7:0/2355078612 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcce803ad80 con 0x7fccf8106520 2024-09-19T04:07:49.618 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.641+0000 7fccffce9640 1 -- 172.21.15.7:0/2355078612 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fccf81954a0 con 0x7fcce0039260 2024-09-19T04:07:49.618 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.890+0000 7fccf6ffd640 1 -- 172.21.15.7:0/2355078612 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fccf81954a0 con 0x7fcce0039260 2024-09-19T04:07:49.618 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.892+0000 7fccffce9640 1 -- 172.21.15.7:0/2355078612 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fcce0039260 msgr2=0x7fcce003b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:49.618 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.892+0000 7fccffce9640 1 --2- 172.21.15.7:0/2355078612 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fcce0039260 0x7fcce003b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fccec00ad30 tx=0x7fccec0093f0 comp rx=0 tx=0).stop 2024-09-19T04:07:49.618 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.892+0000 7fccffce9640 1 -- 172.21.15.7:0/2355078612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccf8106520 msgr2=0x7fccf8191750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:49.618 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.892+0000 7fccffce9640 1 --2- 172.21.15.7:0/2355078612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccf8106520 0x7fccf8191750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcce8030560 tx=0x7fcce8032670 comp rx=0 tx=0).stop 2024-09-19T04:07:49.618 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.892+0000 7fccffce9640 1 -- 172.21.15.7:0/2355078612 shutdown_connections 2024-09-19T04:07:49.618 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.892+0000 7fccffce9640 1 --2- 172.21.15.7:0/2355078612 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fcce0039260 0x7fcce003b720 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:49.618 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.892+0000 7fccffce9640 1 --2- 172.21.15.7:0/2355078612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccf8106520 0x7fccf8191750 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:49.618 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.892+0000 7fccffce9640 1 -- 172.21.15.7:0/2355078612 >> 172.21.15.7:0/2355078612 conn(0x7fccf8101db0 msgr2=0x7fccf8102cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:49.618 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.892+0000 7fccffce9640 1 -- 172.21.15.7:0/2355078612 shutdown_connections 2024-09-19T04:07:49.619 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:48.892+0000 7fccffce9640 1 -- 172.21.15.7:0/2355078612 wait complete. 2024-09-19T04:07:49.619 INFO:teuthology.orchestra.run.smithi007.stdout:Fetching dashboard port number... 2024-09-19T04:07:50.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:49 smithi007 ceph-mon[31360]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:07:50.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:49 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:07:51.076 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:50 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2398304752' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T04:07:51.361 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T04:07:51.367 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.599+0000 7fe8ef4ad640 1 Processor -- start 2024-09-19T04:07:51.367 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.599+0000 7fe8ef4ad640 1 -- start start 2024-09-19T04:07:51.367 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.600+0000 7fe8ef4ad640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e8105e80 0x7fe8e8106280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:51.367 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.600+0000 7fe8ef4ad640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e807beb0 con 0x7fe8e8105e80 2024-09-19T04:07:51.367 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.600+0000 7fe8ed249640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e8105e80 0x7fe8e8106280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:51.367 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.600+0000 7fe8ed249640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e8105e80 0x7fe8e8106280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49476/0 (socket says 172.21.15.7:49476) 2024-09-19T04:07:51.367 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.600+0000 7fe8ed249640 1 -- 172.21.15.7:0/3304051488 learned_addr learned my addr 172.21.15.7:0/3304051488 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:51.367 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.600+0000 7fe8ed249640 1 -- 172.21.15.7:0/3304051488 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e81067c0 con 0x7fe8e8105e80 2024-09-19T04:07:51.367 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.601+0000 7fe8ed249640 1 --2- 172.21.15.7:0/3304051488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e8105e80 0x7fe8e8106280 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009820 tx=0x7fe8d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb25396ea55e498 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:51.368 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.601+0000 7fe8e7fff640 1 -- 172.21.15.7:0/3304051488 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8d8037070 con 0x7fe8e8105e80 2024-09-19T04:07:51.368 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.601+0000 7fe8e7fff640 1 -- 172.21.15.7:0/3304051488 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8d8032920 con 0x7fe8e8105e80 2024-09-19T04:07:51.368 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.601+0000 7fe8e7fff640 1 -- 172.21.15.7:0/3304051488 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8d8030810 con 0x7fe8e8105e80 2024-09-19T04:07:51.368 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.601+0000 7fe8ef4ad640 1 -- 172.21.15.7:0/3304051488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e8105e80 msgr2=0x7fe8e8106280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:51.368 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.601+0000 7fe8ef4ad640 1 --2- 172.21.15.7:0/3304051488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e8105e80 0x7fe8e8106280 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009820 tx=0x7fe8d802a270 comp rx=0 tx=0).stop 2024-09-19T04:07:51.368 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.602+0000 7fe8ef4ad640 1 -- 172.21.15.7:0/3304051488 shutdown_connections 2024-09-19T04:07:51.368 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.602+0000 7fe8ef4ad640 1 --2- 172.21.15.7:0/3304051488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e8105e80 0x7fe8e8106280 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:51.368 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.602+0000 7fe8ef4ad640 1 -- 172.21.15.7:0/3304051488 >> 172.21.15.7:0/3304051488 conn(0x7fe8e8101db0 msgr2=0x7fe8e81041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:51.368 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.602+0000 7fe8ef4ad640 1 -- 172.21.15.7:0/3304051488 shutdown_connections 2024-09-19T04:07:51.368 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.602+0000 7fe8ef4ad640 1 -- 172.21.15.7:0/3304051488 wait complete. 2024-09-19T04:07:51.368 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.602+0000 7fe8ef4ad640 1 Processor -- start 2024-09-19T04:07:51.368 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.602+0000 7fe8ef4ad640 1 -- start start 2024-09-19T04:07:51.368 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.603+0000 7fe8ef4ad640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e8105e80 0x7fe8e819d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:51.369 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.603+0000 7fe8ef4ad640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e8107900 con 0x7fe8e8105e80 2024-09-19T04:07:51.369 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.603+0000 7fe8ed249640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e8105e80 0x7fe8e819d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:51.369 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.603+0000 7fe8ed249640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e8105e80 0x7fe8e819d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49478/0 (socket says 172.21.15.7:49478) 2024-09-19T04:07:51.369 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.603+0000 7fe8ed249640 1 -- 172.21.15.7:0/2398304752 learned_addr learned my addr 172.21.15.7:0/2398304752 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:51.369 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.603+0000 7fe8ed249640 1 -- 172.21.15.7:0/2398304752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e819dd20 con 0x7fe8e8105e80 2024-09-19T04:07:51.369 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.603+0000 7fe8ed249640 1 --2- 172.21.15.7:0/2398304752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e8105e80 0x7fe8e819d7e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80097f0 tx=0x7fe8d80327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:51.369 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.603+0000 7fe8e67fc640 1 -- 172.21.15.7:0/2398304752 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8d8037040 con 0x7fe8e8105e80 2024-09-19T04:07:51.369 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.603+0000 7fe8e67fc640 1 -- 172.21.15.7:0/2398304752 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8d8030cc0 con 0x7fe8e8105e80 2024-09-19T04:07:51.369 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.603+0000 7fe8ef4ad640 1 -- 172.21.15.7:0/2398304752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e819dfb0 con 0x7fe8e8105e80 2024-09-19T04:07:51.369 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.603+0000 7fe8e67fc640 1 -- 172.21.15.7:0/2398304752 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8d803a6b0 con 0x7fe8e8105e80 2024-09-19T04:07:51.369 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.603+0000 7fe8ef4ad640 1 -- 172.21.15.7:0/2398304752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e81a0ca0 con 0x7fe8e8105e80 2024-09-19T04:07:51.369 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.604+0000 7fe8e67fc640 1 -- 172.21.15.7:0/2398304752 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fe8d803b3f0 con 0x7fe8e8105e80 2024-09-19T04:07:51.369 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.604+0000 7fe8ef4ad640 1 -- 172.21.15.7:0/2398304752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8e8106280 con 0x7fe8e8105e80 2024-09-19T04:07:51.370 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.604+0000 7fe8e67fc640 1 --2- 172.21.15.7:0/2398304752 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe8d0039200 0x7fe8d003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:51.370 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.604+0000 7fe8e67fc640 1 -- 172.21.15.7:0/2398304752 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe8d806c910 con 0x7fe8e8105e80 2024-09-19T04:07:51.370 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.605+0000 7fe8eca48640 1 --2- 172.21.15.7:0/2398304752 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe8d0039200 0x7fe8d003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:51.370 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.605+0000 7fe8eca48640 1 --2- 172.21.15.7:0/2398304752 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe8d0039200 0x7fe8d003b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc0098c0 tx=0x7fe8dc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:51.370 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.609+0000 7fe8e67fc640 1 -- 172.21.15.7:0/2398304752 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe8d8043360 con 0x7fe8e8105e80 2024-09-19T04:07:51.370 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.783+0000 7fe8ef4ad640 1 -- 172.21.15.7:0/2398304752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fe8e8196c50 con 0x7fe8e8105e80 2024-09-19T04:07:51.370 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.783+0000 7fe8e67fc640 1 -- 172.21.15.7:0/2398304752 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fe8d803a8a0 con 0x7fe8e8105e80 2024-09-19T04:07:51.370 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.785+0000 7fe8ef4ad640 1 -- 172.21.15.7:0/2398304752 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe8d0039200 msgr2=0x7fe8d003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:51.370 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.785+0000 7fe8ef4ad640 1 --2- 172.21.15.7:0/2398304752 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe8d0039200 0x7fe8d003b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc0098c0 tx=0x7fe8dc006db0 comp rx=0 tx=0).stop 2024-09-19T04:07:51.370 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.785+0000 7fe8ef4ad640 1 -- 172.21.15.7:0/2398304752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e8105e80 msgr2=0x7fe8e819d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:51.370 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.785+0000 7fe8ef4ad640 1 --2- 172.21.15.7:0/2398304752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e8105e80 0x7fe8e819d7e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80097f0 tx=0x7fe8d80327b0 comp rx=0 tx=0).stop 2024-09-19T04:07:51.370 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.785+0000 7fe8ef4ad640 1 -- 172.21.15.7:0/2398304752 shutdown_connections 2024-09-19T04:07:51.371 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.785+0000 7fe8ef4ad640 1 --2- 172.21.15.7:0/2398304752 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe8d0039200 0x7fe8d003b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:51.371 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.785+0000 7fe8ef4ad640 1 --2- 172.21.15.7:0/2398304752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8e8105e80 0x7fe8e819d7e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:51.371 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.785+0000 7fe8ef4ad640 1 -- 172.21.15.7:0/2398304752 >> 172.21.15.7:0/2398304752 conn(0x7fe8e8101db0 msgr2=0x7fe8e8191ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:51.371 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.786+0000 7fe8ef4ad640 1 -- 172.21.15.7:0/2398304752 shutdown_connections 2024-09-19T04:07:51.371 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:50.786+0000 7fe8ef4ad640 1 -- 172.21.15.7:0/2398304752 wait complete. 2024-09-19T04:07:51.375 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T04:07:51.375 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout disabled 2024-09-19T04:07:51.382 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T04:07:51.382 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-19T04:07:51.382 INFO:teuthology.orchestra.run.smithi007.stdout:firewalld.service is not enabled 2024-09-19T04:07:51.383 INFO:teuthology.orchestra.run.smithi007.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T04:07:51.384 INFO:teuthology.orchestra.run.smithi007.stdout:Ceph Dashboard is now available at: 2024-09-19T04:07:51.384 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:07:51.385 INFO:teuthology.orchestra.run.smithi007.stdout: URL: https://smithi007.front.sepia.ceph.com:8443/ 2024-09-19T04:07:51.385 INFO:teuthology.orchestra.run.smithi007.stdout: User: admin 2024-09-19T04:07:51.385 INFO:teuthology.orchestra.run.smithi007.stdout: Password: s4oe9tz2f8 2024-09-19T04:07:51.385 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:07:51.385 INFO:teuthology.orchestra.run.smithi007.stdout:Saving cluster configuration to /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/config directory 2024-09-19T04:07:52.782 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.884+0000 7f69c4b96640 1 Processor -- start 2024-09-19T04:07:52.782 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.885+0000 7f69c4b96640 1 -- start start 2024-09-19T04:07:52.782 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.885+0000 7f69c4b96640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69c0108090 0x7f69c010a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:52.782 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.885+0000 7f69c4b96640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f69c007beb0 con 0x7f69c0108090 2024-09-19T04:07:52.782 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.885+0000 7f69be59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69c0108090 0x7f69c010a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:52.782 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.885+0000 7f69be59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69c0108090 0x7f69c010a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49490/0 (socket says 172.21.15.7:49490) 2024-09-19T04:07:52.782 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.885+0000 7f69be59c640 1 -- 172.21.15.7:0/3929675769 learned_addr learned my addr 172.21.15.7:0/3929675769 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:52.782 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.885+0000 7f69be59c640 1 -- 172.21.15.7:0/3929675769 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c010a9c0 con 0x7f69c0108090 2024-09-19T04:07:52.782 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.886+0000 7f69be59c640 1 --2- 172.21.15.7:0/3929675769 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69c0108090 0x7f69c010a480 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f69b0009820 tx=0x7f69b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35003f74728baed7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:52.783 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.886+0000 7f69bd59a640 1 -- 172.21.15.7:0/3929675769 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69b0037070 con 0x7f69c0108090 2024-09-19T04:07:52.783 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.886+0000 7f69bd59a640 1 -- 172.21.15.7:0/3929675769 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69b0032920 con 0x7f69c0108090 2024-09-19T04:07:52.783 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.886+0000 7f69bd59a640 1 -- 172.21.15.7:0/3929675769 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69b0030810 con 0x7f69c0108090 2024-09-19T04:07:52.783 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.887+0000 7f69c4b96640 1 -- 172.21.15.7:0/3929675769 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69c0108090 msgr2=0x7f69c010a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:52.783 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.887+0000 7f69c4b96640 1 --2- 172.21.15.7:0/3929675769 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69c0108090 0x7f69c010a480 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f69b0009820 tx=0x7f69b002a270 comp rx=0 tx=0).stop 2024-09-19T04:07:52.783 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.887+0000 7f69c4b96640 1 -- 172.21.15.7:0/3929675769 shutdown_connections 2024-09-19T04:07:52.783 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.887+0000 7f69c4b96640 1 --2- 172.21.15.7:0/3929675769 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69c0108090 0x7f69c010a480 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:52.783 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.887+0000 7f69c4b96640 1 -- 172.21.15.7:0/3929675769 >> 172.21.15.7:0/3929675769 conn(0x7f69c0101db0 msgr2=0x7f69c01041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:52.783 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.887+0000 7f69c4b96640 1 -- 172.21.15.7:0/3929675769 shutdown_connections 2024-09-19T04:07:52.783 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.887+0000 7f69c4b96640 1 -- 172.21.15.7:0/3929675769 wait complete. 2024-09-19T04:07:52.783 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.888+0000 7f69c4b96640 1 Processor -- start 2024-09-19T04:07:52.783 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.888+0000 7f69c4b96640 1 -- start start 2024-09-19T04:07:52.783 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.888+0000 7f69c4b96640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69c0108090 0x7f69c019b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:52.784 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.888+0000 7f69c4b96640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f69c010baa0 con 0x7f69c0108090 2024-09-19T04:07:52.784 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.888+0000 7f69be59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69c0108090 0x7f69c019b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:52.784 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.888+0000 7f69be59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69c0108090 0x7f69c019b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49504/0 (socket says 172.21.15.7:49504) 2024-09-19T04:07:52.784 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.888+0000 7f69be59c640 1 -- 172.21.15.7:0/1052258618 learned_addr learned my addr 172.21.15.7:0/1052258618 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:52.784 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.889+0000 7f69be59c640 1 -- 172.21.15.7:0/1052258618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c019bb10 con 0x7f69c0108090 2024-09-19T04:07:52.784 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.889+0000 7f69be59c640 1 --2- 172.21.15.7:0/1052258618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69c0108090 0x7f69c019b5d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f69b00097f0 tx=0x7f69b00327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:52.784 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.892+0000 7f69af7fe640 1 -- 172.21.15.7:0/1052258618 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69b0037040 con 0x7f69c0108090 2024-09-19T04:07:52.784 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.892+0000 7f69c4b96640 1 -- 172.21.15.7:0/1052258618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69c019bda0 con 0x7f69c0108090 2024-09-19T04:07:52.784 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.892+0000 7f69af7fe640 1 -- 172.21.15.7:0/1052258618 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69b0030cc0 con 0x7f69c0108090 2024-09-19T04:07:52.784 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.892+0000 7f69af7fe640 1 -- 172.21.15.7:0/1052258618 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69b003a6b0 con 0x7f69c0108090 2024-09-19T04:07:52.784 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.892+0000 7f69c4b96640 1 -- 172.21.15.7:0/1052258618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69c019ea90 con 0x7f69c0108090 2024-09-19T04:07:52.784 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.893+0000 7f69af7fe640 1 -- 172.21.15.7:0/1052258618 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f69b003a8c0 con 0x7f69c0108090 2024-09-19T04:07:52.784 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.893+0000 7f69af7fe640 1 --2- 172.21.15.7:0/1052258618 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f69a80392a0 0x7f69a803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:52.785 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.893+0000 7f69af7fe640 1 -- 172.21.15.7:0/1052258618 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f69b006ca10 con 0x7f69c0108090 2024-09-19T04:07:52.785 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.893+0000 7f69c4b96640 1 -- 172.21.15.7:0/1052258618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69c01084f0 con 0x7f69c0108090 2024-09-19T04:07:52.785 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.893+0000 7f69bdd9b640 1 --2- 172.21.15.7:0/1052258618 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f69a80392a0 0x7f69a803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:52.785 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.894+0000 7f69bdd9b640 1 --2- 172.21.15.7:0/1052258618 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f69a80392a0 0x7f69a803b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f69b40098c0 tx=0x7f69b4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:52.785 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:51.902+0000 7f69af7fe640 1 -- 172.21.15.7:0/1052258618 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f69b002fd60 con 0x7f69c0108090 2024-09-19T04:07:52.785 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:52.185+0000 7f69c4b96640 1 -- 172.21.15.7:0/1052258618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f69c019ec60 con 0x7f69c0108090 2024-09-19T04:07:52.785 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:52.187+0000 7f69af7fe640 1 -- 172.21.15.7:0/1052258618 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f69b0044920 con 0x7f69c0108090 2024-09-19T04:07:52.785 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T04:07:52.785 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:52.189+0000 7f69c4b96640 1 -- 172.21.15.7:0/1052258618 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f69a80392a0 msgr2=0x7f69a803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:52.785 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:52.189+0000 7f69c4b96640 1 --2- 172.21.15.7:0/1052258618 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f69a80392a0 0x7f69a803b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f69b40098c0 tx=0x7f69b4006db0 comp rx=0 tx=0).stop 2024-09-19T04:07:52.785 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:52.189+0000 7f69c4b96640 1 -- 172.21.15.7:0/1052258618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69c0108090 msgr2=0x7f69c019b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:52.785 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:52.189+0000 7f69c4b96640 1 --2- 172.21.15.7:0/1052258618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69c0108090 0x7f69c019b5d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f69b00097f0 tx=0x7f69b00327b0 comp rx=0 tx=0).stop 2024-09-19T04:07:52.785 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:52.190+0000 7f69c4b96640 1 -- 172.21.15.7:0/1052258618 shutdown_connections 2024-09-19T04:07:52.785 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:52.190+0000 7f69c4b96640 1 --2- 172.21.15.7:0/1052258618 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f69a80392a0 0x7f69a803b760 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:52.786 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:52.190+0000 7f69c4b96640 1 --2- 172.21.15.7:0/1052258618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f69c0108090 0x7f69c019b5d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:52.786 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:52.190+0000 7f69c4b96640 1 -- 172.21.15.7:0/1052258618 >> 172.21.15.7:0/1052258618 conn(0x7f69c0101db0 msgr2=0x7f69c01028a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:52.786 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:52.190+0000 7f69c4b96640 1 -- 172.21.15.7:0/1052258618 shutdown_connections 2024-09-19T04:07:52.786 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr 2024-09-19T04:07:52.190+0000 7f69c4b96640 1 -- 172.21.15.7:0/1052258618 wait complete. 2024-09-19T04:07:52.786 INFO:teuthology.orchestra.run.smithi007.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T04:07:52.786 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:07:52.786 INFO:teuthology.orchestra.run.smithi007.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T04:07:52.786 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:07:52.786 INFO:teuthology.orchestra.run.smithi007.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T04:07:52.786 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:07:52.786 INFO:teuthology.orchestra.run.smithi007.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T04:07:52.786 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:07:52.786 INFO:teuthology.orchestra.run.smithi007.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T04:07:52.786 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:07:52.787 INFO:teuthology.orchestra.run.smithi007.stdout: ceph telemetry on 2024-09-19T04:07:52.787 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:07:52.787 INFO:teuthology.orchestra.run.smithi007.stdout:For more information see: 2024-09-19T04:07:52.787 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:07:52.787 INFO:teuthology.orchestra.run.smithi007.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-19T04:07:52.787 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:07:52.787 INFO:teuthology.orchestra.run.smithi007.stdout:Bootstrap complete. 2024-09-19T04:07:52.829 INFO:tasks.cephadm:Fetching config... 2024-09-19T04:07:52.829 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T04:07:52.830 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T04:07:52.847 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T04:07:52.847 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T04:07:52.848 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T04:07:52.905 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T04:07:52.905 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T04:07:52.905 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-19T04:07:52.973 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T04:07:52.973 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T04:07:52.973 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T04:07:53.029 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T04:07:53.029 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtNe8eM4rdwfp1TWQgqsVPRjQNuAYuZrGcgD0CmCX2GhULvIqaXE6bQ0ZtlWrK1RjZASGYWEdazKs/ehvowxPv5a8hM/75eI6jqGt5FXYmsQj+yh3AFqY1wZDTsYbVHtgj2f76qRZKiBkusvbQ0uR4etHqRKQEZf7o/dYYksSsPKkTiKgNHWZpvMeDA5Hu+GZ0IDnsiYYRxim9HGM5Qe6xfXDE9zCMY8j7v3AzO9Ed6rIugzGnQEab9xeA/f06A8FMePiA+U+Za9UQZzAWTesETsPoDsC9lvhw+3c6LhWyhh85vPJ1kvsEjMgpKWNfYikjseDmc1Zpk3JHNCEQnze0PEFaM05HB7MM6jbIpxg5TjHMD68mTvIClwIBvAkNNaNG49WM75c9Nl1mIvL0EoNJSqqdD8BdFgZzLM+t8lMGQOeXXpso8DXA9etRS0Q7Y8iUhMCJad+l/AFcnTZ3Sz6LfWyoHJk6sMvh32kQci1xLj3vZPAM9dYZ+agXBNXM/I8= ceph-77957c0a-763c-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T04:07:53.081 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:52 smithi007 ceph-mon[31360]: mgrmap e13: x(active, since 6s) 2024-09-19T04:07:53.081 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:52 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1052258618' entity='client.admin' 2024-09-19T04:07:53.111 INFO:teuthology.orchestra.run.smithi007.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtNe8eM4rdwfp1TWQgqsVPRjQNuAYuZrGcgD0CmCX2GhULvIqaXE6bQ0ZtlWrK1RjZASGYWEdazKs/ehvowxPv5a8hM/75eI6jqGt5FXYmsQj+yh3AFqY1wZDTsYbVHtgj2f76qRZKiBkusvbQ0uR4etHqRKQEZf7o/dYYksSsPKkTiKgNHWZpvMeDA5Hu+GZ0IDnsiYYRxim9HGM5Qe6xfXDE9zCMY8j7v3AzO9Ed6rIugzGnQEab9xeA/f06A8FMePiA+U+Za9UQZzAWTesETsPoDsC9lvhw+3c6LhWyhh85vPJ1kvsEjMgpKWNfYikjseDmc1Zpk3JHNCEQnze0PEFaM05HB7MM6jbIpxg5TjHMD68mTvIClwIBvAkNNaNG49WM75c9Nl1mIvL0EoNJSqqdD8BdFgZzLM+t8lMGQOeXXpso8DXA9etRS0Q7Y8iUhMCJad+l/AFcnTZ3Sz6LfWyoHJk6sMvh32kQci1xLj3vZPAM9dYZ+agXBNXM/I8= ceph-77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:07:53.123 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtNe8eM4rdwfp1TWQgqsVPRjQNuAYuZrGcgD0CmCX2GhULvIqaXE6bQ0ZtlWrK1RjZASGYWEdazKs/ehvowxPv5a8hM/75eI6jqGt5FXYmsQj+yh3AFqY1wZDTsYbVHtgj2f76qRZKiBkusvbQ0uR4etHqRKQEZf7o/dYYksSsPKkTiKgNHWZpvMeDA5Hu+GZ0IDnsiYYRxim9HGM5Qe6xfXDE9zCMY8j7v3AzO9Ed6rIugzGnQEab9xeA/f06A8FMePiA+U+Za9UQZzAWTesETsPoDsC9lvhw+3c6LhWyhh85vPJ1kvsEjMgpKWNfYikjseDmc1Zpk3JHNCEQnze0PEFaM05HB7MM6jbIpxg5TjHMD68mTvIClwIBvAkNNaNG49WM75c9Nl1mIvL0EoNJSqqdD8BdFgZzLM+t8lMGQOeXXpso8DXA9etRS0Q7Y8iUhMCJad+l/AFcnTZ3Sz6LfWyoHJk6sMvh32kQci1xLj3vZPAM9dYZ+agXBNXM/I8= ceph-77957c0a-763c-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T04:07:53.163 INFO:teuthology.orchestra.run.smithi092.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtNe8eM4rdwfp1TWQgqsVPRjQNuAYuZrGcgD0CmCX2GhULvIqaXE6bQ0ZtlWrK1RjZASGYWEdazKs/ehvowxPv5a8hM/75eI6jqGt5FXYmsQj+yh3AFqY1wZDTsYbVHtgj2f76qRZKiBkusvbQ0uR4etHqRKQEZf7o/dYYksSsPKkTiKgNHWZpvMeDA5Hu+GZ0IDnsiYYRxim9HGM5Qe6xfXDE9zCMY8j7v3AzO9Ed6rIugzGnQEab9xeA/f06A8FMePiA+U+Za9UQZzAWTesETsPoDsC9lvhw+3c6LhWyhh85vPJ1kvsEjMgpKWNfYikjseDmc1Zpk3JHNCEQnze0PEFaM05HB7MM6jbIpxg5TjHMD68mTvIClwIBvAkNNaNG49WM75c9Nl1mIvL0EoNJSqqdD8BdFgZzLM+t8lMGQOeXXpso8DXA9etRS0Q7Y8iUhMCJad+l/AFcnTZ3Sz6LfWyoHJk6sMvh32kQci1xLj3vZPAM9dYZ+agXBNXM/I8= ceph-77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:07:53.176 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtNe8eM4rdwfp1TWQgqsVPRjQNuAYuZrGcgD0CmCX2GhULvIqaXE6bQ0ZtlWrK1RjZASGYWEdazKs/ehvowxPv5a8hM/75eI6jqGt5FXYmsQj+yh3AFqY1wZDTsYbVHtgj2f76qRZKiBkusvbQ0uR4etHqRKQEZf7o/dYYksSsPKkTiKgNHWZpvMeDA5Hu+GZ0IDnsiYYRxim9HGM5Qe6xfXDE9zCMY8j7v3AzO9Ed6rIugzGnQEab9xeA/f06A8FMePiA+U+Za9UQZzAWTesETsPoDsC9lvhw+3c6LhWyhh85vPJ1kvsEjMgpKWNfYikjseDmc1Zpk3JHNCEQnze0PEFaM05HB7MM6jbIpxg5TjHMD68mTvIClwIBvAkNNaNG49WM75c9Nl1mIvL0EoNJSqqdD8BdFgZzLM+t8lMGQOeXXpso8DXA9etRS0Q7Y8iUhMCJad+l/AFcnTZ3Sz6LfWyoHJk6sMvh32kQci1xLj3vZPAM9dYZ+agXBNXM/I8= ceph-77957c0a-763c-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T04:07:53.216 INFO:teuthology.orchestra.run.smithi102.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtNe8eM4rdwfp1TWQgqsVPRjQNuAYuZrGcgD0CmCX2GhULvIqaXE6bQ0ZtlWrK1RjZASGYWEdazKs/ehvowxPv5a8hM/75eI6jqGt5FXYmsQj+yh3AFqY1wZDTsYbVHtgj2f76qRZKiBkusvbQ0uR4etHqRKQEZf7o/dYYksSsPKkTiKgNHWZpvMeDA5Hu+GZ0IDnsiYYRxim9HGM5Qe6xfXDE9zCMY8j7v3AzO9Ed6rIugzGnQEab9xeA/f06A8FMePiA+U+Za9UQZzAWTesETsPoDsC9lvhw+3c6LhWyhh85vPJ1kvsEjMgpKWNfYikjseDmc1Zpk3JHNCEQnze0PEFaM05HB7MM6jbIpxg5TjHMD68mTvIClwIBvAkNNaNG49WM75c9Nl1mIvL0EoNJSqqdD8BdFgZzLM+t8lMGQOeXXpso8DXA9etRS0Q7Y8iUhMCJad+l/AFcnTZ3Sz6LfWyoHJk6sMvh32kQci1xLj3vZPAM9dYZ+agXBNXM/I8= ceph-77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:07:53.229 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T04:07:53.483 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:07:53.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:53.955+0000 7f1c1c3c4640 1 -- 172.21.15.7:0/164407328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c141015e0 msgr2=0x7f1c141019e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:53.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:53.955+0000 7f1c1c3c4640 1 --2- 172.21.15.7:0/164407328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c141015e0 0x7f1c141019e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1c10009880 tx=0x7f1c1002a5d0 comp rx=0 tx=0).stop 2024-09-19T04:07:53.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:53.955+0000 7f1c1c3c4640 1 -- 172.21.15.7:0/164407328 shutdown_connections 2024-09-19T04:07:53.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:53.955+0000 7f1c1c3c4640 1 --2- 172.21.15.7:0/164407328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c141015e0 0x7f1c141019e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:53.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:53.955+0000 7f1c1c3c4640 1 -- 172.21.15.7:0/164407328 >> 172.21.15.7:0/164407328 conn(0x7f1c140fcd70 msgr2=0x7f1c140ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:53.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:53.955+0000 7f1c1c3c4640 1 -- 172.21.15.7:0/164407328 shutdown_connections 2024-09-19T04:07:53.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:53.955+0000 7f1c1c3c4640 1 -- 172.21.15.7:0/164407328 wait complete. 2024-09-19T04:07:53.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:53.955+0000 7f1c1c3c4640 1 Processor -- start 2024-09-19T04:07:53.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:53.956+0000 7f1c1c3c4640 1 -- start start 2024-09-19T04:07:53.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:53.956+0000 7f1c1c3c4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c141015e0 0x7f1c14196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:53.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:53.956+0000 7f1c1c3c4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1c141076f0 con 0x7f1c141015e0 2024-09-19T04:07:53.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:53.956+0000 7f1c1a160640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c141015e0 0x7f1c14196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:53.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:53.956+0000 7f1c1a160640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c141015e0 0x7f1c14196db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49512/0 (socket says 172.21.15.7:49512) 2024-09-19T04:07:53.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:53.956+0000 7f1c1a160640 1 -- 172.21.15.7:0/1049284747 learned_addr learned my addr 172.21.15.7:0/1049284747 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:53.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:53.956+0000 7f1c1a160640 1 -- 172.21.15.7:0/1049284747 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c141972f0 con 0x7f1c141015e0 2024-09-19T04:07:53.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:53.956+0000 7f1c1a160640 1 --2- 172.21.15.7:0/1049284747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c141015e0 0x7f1c14196db0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1c10004f60 tx=0x7f1c100048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:53.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:53.956+0000 7f1c0b7fe640 1 -- 172.21.15.7:0/1049284747 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c1003f070 con 0x7f1c141015e0 2024-09-19T04:07:53.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:53.956+0000 7f1c0b7fe640 1 -- 172.21.15.7:0/1049284747 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c10004cc0 con 0x7f1c141015e0 2024-09-19T04:07:53.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:53.956+0000 7f1c1c3c4640 1 -- 172.21.15.7:0/1049284747 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c14197580 con 0x7f1c141015e0 2024-09-19T04:07:53.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:53.956+0000 7f1c0b7fe640 1 -- 172.21.15.7:0/1049284747 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c10035030 con 0x7f1c141015e0 2024-09-19T04:07:53.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:53.957+0000 7f1c1c3c4640 1 -- 172.21.15.7:0/1049284747 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c1419a230 con 0x7f1c141015e0 2024-09-19T04:07:53.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:53.957+0000 7f1c0b7fe640 1 -- 172.21.15.7:0/1049284747 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f1c10042070 con 0x7f1c141015e0 2024-09-19T04:07:53.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:53.958+0000 7f1c0b7fe640 1 --2- 172.21.15.7:0/1049284747 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1c00039300 0x7f1c0003b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:53.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:53.958+0000 7f1c0b7fe640 1 -- 172.21.15.7:0/1049284747 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1c1006d070 con 0x7f1c141015e0 2024-09-19T04:07:53.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:53.958+0000 7f1c1995f640 1 --2- 172.21.15.7:0/1049284747 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1c00039300 0x7f1c0003b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:53.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:53.958+0000 7f1c1c3c4640 1 -- 172.21.15.7:0/1049284747 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c14107e70 con 0x7f1c141015e0 2024-09-19T04:07:53.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:53.958+0000 7f1c1995f640 1 --2- 172.21.15.7:0/1049284747 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1c00039300 0x7f1c0003b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1c040098c0 tx=0x7f1c04006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:53.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:53.963+0000 7f1c0b7fe640 1 -- 172.21.15.7:0/1049284747 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1c100433b0 con 0x7f1c141015e0 2024-09-19T04:07:54.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:54.140+0000 7f1c1c3c4640 1 -- 172.21.15.7:0/1049284747 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f1c1402d7c0 con 0x7f1c141015e0 2024-09-19T04:07:54.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:54.142+0000 7f1c0b7fe640 1 -- 172.21.15.7:0/1049284747 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f1c1002f300 con 0x7f1c141015e0 2024-09-19T04:07:54.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:54.145+0000 7f1c1c3c4640 1 -- 172.21.15.7:0/1049284747 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1c00039300 msgr2=0x7f1c0003b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:54.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:54.145+0000 7f1c1c3c4640 1 --2- 172.21.15.7:0/1049284747 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1c00039300 0x7f1c0003b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1c040098c0 tx=0x7f1c04006db0 comp rx=0 tx=0).stop 2024-09-19T04:07:54.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:54.145+0000 7f1c1c3c4640 1 -- 172.21.15.7:0/1049284747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c141015e0 msgr2=0x7f1c14196db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:54.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:54.145+0000 7f1c1c3c4640 1 --2- 172.21.15.7:0/1049284747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c141015e0 0x7f1c14196db0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1c10004f60 tx=0x7f1c100048f0 comp rx=0 tx=0).stop 2024-09-19T04:07:54.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:54.145+0000 7f1c1c3c4640 1 -- 172.21.15.7:0/1049284747 shutdown_connections 2024-09-19T04:07:54.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:54.145+0000 7f1c1c3c4640 1 --2- 172.21.15.7:0/1049284747 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1c00039300 0x7f1c0003b7c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:54.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:54.145+0000 7f1c1c3c4640 1 --2- 172.21.15.7:0/1049284747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c141015e0 0x7f1c14196db0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:54.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:54.145+0000 7f1c1c3c4640 1 -- 172.21.15.7:0/1049284747 >> 172.21.15.7:0/1049284747 conn(0x7f1c140fcd70 msgr2=0x7f1c140fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:54.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:54.145+0000 7f1c1c3c4640 1 -- 172.21.15.7:0/1049284747 shutdown_connections 2024-09-19T04:07:54.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:54.145+0000 7f1c1c3c4640 1 -- 172.21.15.7:0/1049284747 wait complete. 2024-09-19T04:07:55.327 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T04:07:55.327 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T04:07:55.407 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:55 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1049284747' entity='client.admin' 2024-09-19T04:07:55.407 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:55 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:07:55.408 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:55 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:07:55.408 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:55 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:07:55.408 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:55 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:07:55.408 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:55 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:07:55.408 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:55 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:07:55.660 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:07:56.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.124+0000 7f214e0a4640 1 -- 172.21.15.7:0/2321841018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21481020d0 msgr2=0x7f21481044c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:56.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.124+0000 7f214e0a4640 1 --2- 172.21.15.7:0/2321841018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21481020d0 0x7f21481044c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2138009880 tx=0x7f213802a5d0 comp rx=0 tx=0).stop 2024-09-19T04:07:56.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.124+0000 7f214e0a4640 1 -- 172.21.15.7:0/2321841018 shutdown_connections 2024-09-19T04:07:56.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.124+0000 7f214e0a4640 1 --2- 172.21.15.7:0/2321841018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21481020d0 0x7f21481044c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:56.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.124+0000 7f214e0a4640 1 -- 172.21.15.7:0/2321841018 >> 172.21.15.7:0/2321841018 conn(0x7f21480fbcd0 msgr2=0x7f21480fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:56.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.124+0000 7f214e0a4640 1 -- 172.21.15.7:0/2321841018 shutdown_connections 2024-09-19T04:07:56.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.124+0000 7f214e0a4640 1 -- 172.21.15.7:0/2321841018 wait complete. 2024-09-19T04:07:56.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.125+0000 7f214e0a4640 1 Processor -- start 2024-09-19T04:07:56.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.125+0000 7f214e0a4640 1 -- start start 2024-09-19T04:07:56.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.125+0000 7f214e0a4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21481020d0 0x7f2148196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:56.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.125+0000 7f214e0a4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2148107670 con 0x7f21481020d0 2024-09-19T04:07:56.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.125+0000 7f21477fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21481020d0 0x7f2148196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:56.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.125+0000 7f21477fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21481020d0 0x7f2148196d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49522/0 (socket says 172.21.15.7:49522) 2024-09-19T04:07:56.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.125+0000 7f21477fe640 1 -- 172.21.15.7:0/2008929561 learned_addr learned my addr 172.21.15.7:0/2008929561 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:56.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.126+0000 7f21477fe640 1 -- 172.21.15.7:0/2008929561 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2148197280 con 0x7f21481020d0 2024-09-19T04:07:56.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.126+0000 7f21477fe640 1 --2- 172.21.15.7:0/2008929561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21481020d0 0x7f2148196d40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2138004f60 tx=0x7f21380048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:56.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.126+0000 7f2144ff9640 1 -- 172.21.15.7:0/2008929561 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f213803f070 con 0x7f21481020d0 2024-09-19T04:07:56.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.126+0000 7f214e0a4640 1 -- 172.21.15.7:0/2008929561 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2148197570 con 0x7f21481020d0 2024-09-19T04:07:56.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.126+0000 7f2144ff9640 1 -- 172.21.15.7:0/2008929561 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2138003ad0 con 0x7f21481020d0 2024-09-19T04:07:56.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.126+0000 7f2144ff9640 1 -- 172.21.15.7:0/2008929561 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2138035030 con 0x7f21481020d0 2024-09-19T04:07:56.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.126+0000 7f214e0a4640 1 -- 172.21.15.7:0/2008929561 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f214819a200 con 0x7f21481020d0 2024-09-19T04:07:56.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.127+0000 7f2144ff9640 1 -- 172.21.15.7:0/2008929561 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f2138042070 con 0x7f21481020d0 2024-09-19T04:07:56.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.127+0000 7f214e0a4640 1 -- 172.21.15.7:0/2008929561 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2148107df0 con 0x7f21481020d0 2024-09-19T04:07:56.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.128+0000 7f2144ff9640 1 --2- 172.21.15.7:0/2008929561 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f21300392a0 0x7f213003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:56.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.128+0000 7f2144ff9640 1 -- 172.21.15.7:0/2008929561 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f213806d0d0 con 0x7f21481020d0 2024-09-19T04:07:56.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.128+0000 7f2146ffd640 1 --2- 172.21.15.7:0/2008929561 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f21300392a0 0x7f213003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:56.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.128+0000 7f2146ffd640 1 --2- 172.21.15.7:0/2008929561 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f21300392a0 0x7f213003b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f213c0098c0 tx=0x7f213c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:56.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.133+0000 7f2144ff9640 1 -- 172.21.15.7:0/2008929561 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f213804a260 con 0x7f21481020d0 2024-09-19T04:07:56.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.312+0000 7f214e0a4640 1 -- 172.21.15.7:0/2008929561 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f214802d9b0 con 0x7f21300392a0 2024-09-19T04:07:56.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.315+0000 7f2144ff9640 1 -- 172.21.15.7:0/2008929561 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f214802d9b0 con 0x7f21300392a0 2024-09-19T04:07:56.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.317+0000 7f214e0a4640 1 -- 172.21.15.7:0/2008929561 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f21300392a0 msgr2=0x7f213003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:56.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.317+0000 7f214e0a4640 1 --2- 172.21.15.7:0/2008929561 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f21300392a0 0x7f213003b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f213c0098c0 tx=0x7f213c006db0 comp rx=0 tx=0).stop 2024-09-19T04:07:56.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.317+0000 7f214e0a4640 1 -- 172.21.15.7:0/2008929561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21481020d0 msgr2=0x7f2148196d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:56.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.317+0000 7f214e0a4640 1 --2- 172.21.15.7:0/2008929561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21481020d0 0x7f2148196d40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2138004f60 tx=0x7f21380048f0 comp rx=0 tx=0).stop 2024-09-19T04:07:56.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.317+0000 7f214e0a4640 1 -- 172.21.15.7:0/2008929561 shutdown_connections 2024-09-19T04:07:56.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.317+0000 7f214e0a4640 1 --2- 172.21.15.7:0/2008929561 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f21300392a0 0x7f213003b760 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:56.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.317+0000 7f214e0a4640 1 --2- 172.21.15.7:0/2008929561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21481020d0 0x7f2148196d40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:56.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.317+0000 7f214e0a4640 1 -- 172.21.15.7:0/2008929561 >> 172.21.15.7:0/2008929561 conn(0x7f21480fbcd0 msgr2=0x7f21480fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:56.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.318+0000 7f214e0a4640 1 -- 172.21.15.7:0/2008929561 shutdown_connections 2024-09-19T04:07:56.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:56.318+0000 7f214e0a4640 1 -- 172.21.15.7:0/2008929561 wait complete. 2024-09-19T04:07:57.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:57 smithi007 ceph-mon[31360]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:07:57.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:57 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:07:57.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:57 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:07:57.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:57 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:07:57.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:57 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:07:57.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:57 smithi007 ceph-mon[31360]: Updating smithi007:/etc/ceph/ceph.conf 2024-09-19T04:07:57.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:57 smithi007 ceph-mon[31360]: Updating smithi007:/var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:07:57.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:57 smithi007 ceph-mon[31360]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:07:57.451 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:57 smithi007 ceph-mon[31360]: Updating smithi007:/var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:07:57.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:57 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:07:57.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:57 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:07:57.452 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:57 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:07:57.453 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi092 2024-09-19T04:07:57.453 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-19T04:07:57.453 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/etc/ceph/ceph.conf 2024-09-19T04:07:57.473 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-19T04:07:57.473 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:07:57.532 INFO:tasks.cephadm:Adding host smithi092 to orchestrator... 2024-09-19T04:07:57.532 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph orch host add smithi092 2024-09-19T04:07:57.783 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:07:58.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:58.201+0000 7fad04edd640 1 -- 172.21.15.7:0/3610426183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad001027b0 msgr2=0x7fad00102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:07:58.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:58.201+0000 7fad04edd640 1 --2- 172.21.15.7:0/3610426183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad001027b0 0x7fad00102b90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7facf0009880 tx=0x7facf002a670 comp rx=0 tx=0).stop 2024-09-19T04:07:58.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:58.201+0000 7fad04edd640 1 -- 172.21.15.7:0/3610426183 shutdown_connections 2024-09-19T04:07:58.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:58.201+0000 7fad04edd640 1 --2- 172.21.15.7:0/3610426183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad001027b0 0x7fad00102b90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:07:58.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:58.201+0000 7fad04edd640 1 -- 172.21.15.7:0/3610426183 >> 172.21.15.7:0/3610426183 conn(0x7fad000fc1b0 msgr2=0x7fad000fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:07:58.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:58.201+0000 7fad04edd640 1 -- 172.21.15.7:0/3610426183 shutdown_connections 2024-09-19T04:07:58.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:58.201+0000 7fad04edd640 1 -- 172.21.15.7:0/3610426183 wait complete. 2024-09-19T04:07:58.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:58.202+0000 7fad04edd640 1 Processor -- start 2024-09-19T04:07:58.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:58.202+0000 7fad04edd640 1 -- start start 2024-09-19T04:07:58.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:58.202+0000 7fad04edd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad001027b0 0x7fad001971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:58.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:58.202+0000 7fad04edd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fad0010bcb0 con 0x7fad001027b0 2024-09-19T04:07:58.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:58.202+0000 7facfe59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad001027b0 0x7fad001971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:58.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:58.202+0000 7facfe59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad001027b0 0x7fad001971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56244/0 (socket says 172.21.15.7:56244) 2024-09-19T04:07:58.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:58.202+0000 7facfe59c640 1 -- 172.21.15.7:0/525441377 learned_addr learned my addr 172.21.15.7:0/525441377 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:07:58.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:58.203+0000 7facfe59c640 1 -- 172.21.15.7:0/525441377 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad001976f0 con 0x7fad001027b0 2024-09-19T04:07:58.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:58.203+0000 7facfe59c640 1 --2- 172.21.15.7:0/525441377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad001027b0 0x7fad001971b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7facf0009230 tx=0x7facf0003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:58.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:58.203+0000 7facf77fe640 1 -- 172.21.15.7:0/525441377 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facf003f070 con 0x7fad001027b0 2024-09-19T04:07:58.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:58.203+0000 7facf77fe640 1 -- 172.21.15.7:0/525441377 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facf003bc80 con 0x7fad001027b0 2024-09-19T04:07:58.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:58.203+0000 7fad04edd640 1 -- 172.21.15.7:0/525441377 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad00197980 con 0x7fad001027b0 2024-09-19T04:07:58.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:58.203+0000 7facf77fe640 1 -- 172.21.15.7:0/525441377 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facf0035030 con 0x7fad001027b0 2024-09-19T04:07:58.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:58.203+0000 7fad04edd640 1 -- 172.21.15.7:0/525441377 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad00197de0 con 0x7fad001027b0 2024-09-19T04:07:58.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:58.204+0000 7facf77fe640 1 -- 172.21.15.7:0/525441377 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7facf0042070 con 0x7fad001027b0 2024-09-19T04:07:58.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:58.204+0000 7facf77fe640 1 --2- 172.21.15.7:0/525441377 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7facec0392a0 0x7facec03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:07:58.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:58.204+0000 7facf77fe640 1 -- 172.21.15.7:0/525441377 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7facf006cfb0 con 0x7fad001027b0 2024-09-19T04:07:58.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:58.204+0000 7fad04edd640 1 -- 172.21.15.7:0/525441377 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad0006a750 con 0x7fad001027b0 2024-09-19T04:07:58.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:58.204+0000 7facf7fff640 1 --2- 172.21.15.7:0/525441377 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7facec0392a0 0x7facec03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:07:58.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:58.205+0000 7facf7fff640 1 --2- 172.21.15.7:0/525441377 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7facec0392a0 0x7facec03b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7face80098c0 tx=0x7face8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:07:58.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:58.209+0000 7facf77fe640 1 -- 172.21.15.7:0/525441377 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7facf004c350 con 0x7fad001027b0 2024-09-19T04:07:58.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:07:58.388+0000 7fad04edd640 1 -- 172.21.15.7:0/525441377 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi092", "target": ["mon-mgr", ""]}) -- 0x7fad00198510 con 0x7facec0392a0 2024-09-19T04:07:59.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:07:59 smithi007 ceph-mon[31360]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi092", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:08:00.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:00 smithi007 ceph-mon[31360]: Deploying cephadm binary to smithi092 2024-09-19T04:08:02.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:02.245+0000 7facf77fe640 1 -- 172.21.15.7:0/525441377 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fad00198510 con 0x7facec0392a0 2024-09-19T04:08:02.247 INFO:teuthology.orchestra.run.smithi007.stdout:Added host 'smithi092' with addr '172.21.15.92' 2024-09-19T04:08:02.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:02.248+0000 7fad04edd640 1 -- 172.21.15.7:0/525441377 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7facec0392a0 msgr2=0x7facec03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:02.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:02.248+0000 7fad04edd640 1 --2- 172.21.15.7:0/525441377 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7facec0392a0 0x7facec03b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7face80098c0 tx=0x7face8006db0 comp rx=0 tx=0).stop 2024-09-19T04:08:02.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:02.248+0000 7fad04edd640 1 -- 172.21.15.7:0/525441377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad001027b0 msgr2=0x7fad001971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:02.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:02.248+0000 7fad04edd640 1 --2- 172.21.15.7:0/525441377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad001027b0 0x7fad001971b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7facf0009230 tx=0x7facf0003d40 comp rx=0 tx=0).stop 2024-09-19T04:08:02.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:02.248+0000 7fad04edd640 1 -- 172.21.15.7:0/525441377 shutdown_connections 2024-09-19T04:08:02.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:02.248+0000 7fad04edd640 1 --2- 172.21.15.7:0/525441377 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7facec0392a0 0x7facec03b760 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:02.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:02.248+0000 7fad04edd640 1 --2- 172.21.15.7:0/525441377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad001027b0 0x7fad001971b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:02.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:02.248+0000 7fad04edd640 1 -- 172.21.15.7:0/525441377 >> 172.21.15.7:0/525441377 conn(0x7fad000fc1b0 msgr2=0x7fad00103560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:08:02.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:02.249+0000 7fad04edd640 1 -- 172.21.15.7:0/525441377 shutdown_connections 2024-09-19T04:08:02.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:02.249+0000 7fad04edd640 1 -- 172.21.15.7:0/525441377 wait complete. 2024-09-19T04:08:02.841 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T04:08:03.098 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:08:03.476 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:03 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:03.476 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:03 smithi007 ceph-mon[31360]: Added host smithi092 2024-09-19T04:08:03.476 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:03 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:08:03.476 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:03 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:03.476 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:03 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:03.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.481+0000 7f3d801a5640 1 -- 172.21.15.7:0/3116135441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d781002c0 msgr2=0x7f3d781006a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:03.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.481+0000 7f3d801a5640 1 --2- 172.21.15.7:0/3116135441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d781002c0 0x7f3d781006a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3d68009c10 tx=0x7f3d6802aa10 comp rx=0 tx=0).stop 2024-09-19T04:08:03.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.481+0000 7f3d801a5640 1 -- 172.21.15.7:0/3116135441 shutdown_connections 2024-09-19T04:08:03.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.481+0000 7f3d801a5640 1 --2- 172.21.15.7:0/3116135441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d781002c0 0x7f3d781006a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:03.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.481+0000 7f3d801a5640 1 -- 172.21.15.7:0/3116135441 >> 172.21.15.7:0/3116135441 conn(0x7f3d78077310 msgr2=0x7f3d780fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:08:03.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.482+0000 7f3d801a5640 1 -- 172.21.15.7:0/3116135441 shutdown_connections 2024-09-19T04:08:03.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.482+0000 7f3d801a5640 1 -- 172.21.15.7:0/3116135441 wait complete. 2024-09-19T04:08:03.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.482+0000 7f3d801a5640 1 Processor -- start 2024-09-19T04:08:03.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.482+0000 7f3d801a5640 1 -- start start 2024-09-19T04:08:03.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.482+0000 7f3d801a5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d781002c0 0x7f3d781993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:03.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.482+0000 7f3d801a5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7810de80 con 0x7f3d781002c0 2024-09-19T04:08:03.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.483+0000 7f3d7df41640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d781002c0 0x7f3d781993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:03.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.483+0000 7f3d7df41640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d781002c0 0x7f3d781993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56258/0 (socket says 172.21.15.7:56258) 2024-09-19T04:08:03.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.483+0000 7f3d7df41640 1 -- 172.21.15.7:0/1263812194 learned_addr learned my addr 172.21.15.7:0/1263812194 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:08:03.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.483+0000 7f3d7df41640 1 -- 172.21.15.7:0/1263812194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d78199910 con 0x7f3d781002c0 2024-09-19T04:08:03.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.483+0000 7f3d7df41640 1 --2- 172.21.15.7:0/1263812194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d781002c0 0x7f3d781993d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3d68005dd0 tx=0x7f3d68030c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:08:03.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.483+0000 7f3d76ffd640 1 -- 172.21.15.7:0/1263812194 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d68034070 con 0x7f3d781002c0 2024-09-19T04:08:03.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.483+0000 7f3d76ffd640 1 -- 172.21.15.7:0/1263812194 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d6802f8c0 con 0x7f3d781002c0 2024-09-19T04:08:03.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.483+0000 7f3d801a5640 1 -- 172.21.15.7:0/1263812194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d78199ba0 con 0x7f3d781002c0 2024-09-19T04:08:03.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.483+0000 7f3d76ffd640 1 -- 172.21.15.7:0/1263812194 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d68004520 con 0x7f3d781002c0 2024-09-19T04:08:03.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.483+0000 7f3d801a5640 1 -- 172.21.15.7:0/1263812194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d78199f40 con 0x7f3d781002c0 2024-09-19T04:08:03.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.484+0000 7f3d76ffd640 1 -- 172.21.15.7:0/1263812194 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f3d68037020 con 0x7f3d781002c0 2024-09-19T04:08:03.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.484+0000 7f3d76ffd640 1 --2- 172.21.15.7:0/1263812194 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3d600392a0 0x7f3d6003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:03.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.484+0000 7f3d76ffd640 1 -- 172.21.15.7:0/1263812194 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3d6806d210 con 0x7f3d781002c0 2024-09-19T04:08:03.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.484+0000 7f3d801a5640 1 -- 172.21.15.7:0/1263812194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d78069f90 con 0x7f3d781002c0 2024-09-19T04:08:03.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.484+0000 7f3d7d740640 1 --2- 172.21.15.7:0/1263812194 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3d600392a0 0x7f3d6003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:03.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.485+0000 7f3d7d740640 1 --2- 172.21.15.7:0/1263812194 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3d600392a0 0x7f3d6003b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0098c0 tx=0x7f3d6c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:08:03.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.489+0000 7f3d76ffd640 1 -- 172.21.15.7:0/1263812194 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3d6803f070 con 0x7f3d781002c0 2024-09-19T04:08:03.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.670+0000 7f3d801a5640 1 -- 172.21.15.7:0/1263812194 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3d7819a730 con 0x7f3d600392a0 2024-09-19T04:08:03.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.671+0000 7f3d76ffd640 1 -- 172.21.15.7:0/1263812194 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+158 (secure 0 0 0) 0x7f3d7819a730 con 0x7f3d600392a0 2024-09-19T04:08:03.673 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:08:03.673 INFO:teuthology.orchestra.run.smithi007.stdout:[{"addr": "172.21.15.7", "hostname": "smithi007", "labels": [], "status": ""}, {"addr": "172.21.15.92", "hostname": "smithi092", "labels": [], "status": ""}] 2024-09-19T04:08:03.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.674+0000 7f3d801a5640 1 -- 172.21.15.7:0/1263812194 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3d600392a0 msgr2=0x7f3d6003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:03.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.674+0000 7f3d801a5640 1 --2- 172.21.15.7:0/1263812194 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3d600392a0 0x7f3d6003b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0098c0 tx=0x7f3d6c006db0 comp rx=0 tx=0).stop 2024-09-19T04:08:03.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.674+0000 7f3d801a5640 1 -- 172.21.15.7:0/1263812194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d781002c0 msgr2=0x7f3d781993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:03.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.674+0000 7f3d801a5640 1 --2- 172.21.15.7:0/1263812194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d781002c0 0x7f3d781993d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3d68005dd0 tx=0x7f3d68030c30 comp rx=0 tx=0).stop 2024-09-19T04:08:03.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.674+0000 7f3d801a5640 1 -- 172.21.15.7:0/1263812194 shutdown_connections 2024-09-19T04:08:03.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.674+0000 7f3d801a5640 1 --2- 172.21.15.7:0/1263812194 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3d600392a0 0x7f3d6003b760 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:03.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.674+0000 7f3d801a5640 1 --2- 172.21.15.7:0/1263812194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d781002c0 0x7f3d781993d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:03.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.674+0000 7f3d801a5640 1 -- 172.21.15.7:0/1263812194 >> 172.21.15.7:0/1263812194 conn(0x7f3d78077310 msgr2=0x7f3d780fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:08:03.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.674+0000 7f3d801a5640 1 -- 172.21.15.7:0/1263812194 shutdown_connections 2024-09-19T04:08:03.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:03.674+0000 7f3d801a5640 1 -- 172.21.15.7:0/1263812194 wait complete. 2024-09-19T04:08:04.243 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi102 2024-09-19T04:08:04.243 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T04:08:04.244 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/etc/ceph/ceph.conf 2024-09-19T04:08:04.262 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T04:08:04.262 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:08:04.319 INFO:tasks.cephadm:Adding host smithi102 to orchestrator... 2024-09-19T04:08:04.320 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph orch host add smithi102 2024-09-19T04:08:04.570 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:08:04.874 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:04 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:04.874 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:04 smithi007 ceph-mon[31360]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:08:04.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:04.956+0000 7fe2e93f2640 1 -- 172.21.15.7:0/534288351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2e41027b0 msgr2=0x7fe2e4102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:04.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:04.956+0000 7fe2e93f2640 1 --2- 172.21.15.7:0/534288351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2e41027b0 0x7fe2e4102b90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4009810 tx=0x7fe2d402a540 comp rx=0 tx=0).stop 2024-09-19T04:08:04.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:04.956+0000 7fe2e93f2640 1 -- 172.21.15.7:0/534288351 shutdown_connections 2024-09-19T04:08:04.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:04.956+0000 7fe2e93f2640 1 --2- 172.21.15.7:0/534288351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2e41027b0 0x7fe2e4102b90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:04.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:04.956+0000 7fe2e93f2640 1 -- 172.21.15.7:0/534288351 >> 172.21.15.7:0/534288351 conn(0x7fe2e4077310 msgr2=0x7fe2e40fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:08:04.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:04.956+0000 7fe2e93f2640 1 -- 172.21.15.7:0/534288351 shutdown_connections 2024-09-19T04:08:04.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:04.957+0000 7fe2e93f2640 1 -- 172.21.15.7:0/534288351 wait complete. 2024-09-19T04:08:04.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:04.957+0000 7fe2e93f2640 1 Processor -- start 2024-09-19T04:08:04.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:04.957+0000 7fe2e93f2640 1 -- start start 2024-09-19T04:08:04.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:04.958+0000 7fe2e93f2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2e41027b0 0x7fe2e41971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:04.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:04.958+0000 7fe2e93f2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e410bc80 con 0x7fe2e41027b0 2024-09-19T04:08:04.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:04.958+0000 7fe2e2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2e41027b0 0x7fe2e41971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:04.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:04.958+0000 7fe2e2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2e41027b0 0x7fe2e41971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56284/0 (socket says 172.21.15.7:56284) 2024-09-19T04:08:04.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:04.958+0000 7fe2e2ffd640 1 -- 172.21.15.7:0/3917829212 learned_addr learned my addr 172.21.15.7:0/3917829212 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:08:04.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:04.958+0000 7fe2e2ffd640 1 -- 172.21.15.7:0/3917829212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e41976f0 con 0x7fe2e41027b0 2024-09-19T04:08:04.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:04.958+0000 7fe2e2ffd640 1 --2- 172.21.15.7:0/3917829212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2e41027b0 0x7fe2e41971b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe2d40045e0 tx=0x7fe2d4004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:08:04.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:04.958+0000 7fe2cbfff640 1 -- 172.21.15.7:0/3917829212 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d4030e70 con 0x7fe2e41027b0 2024-09-19T04:08:04.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:04.958+0000 7fe2cbfff640 1 -- 172.21.15.7:0/3917829212 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2d40318e0 con 0x7fe2e41027b0 2024-09-19T04:08:04.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:04.958+0000 7fe2e93f2640 1 -- 172.21.15.7:0/3917829212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2e4197980 con 0x7fe2e41027b0 2024-09-19T04:08:04.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:04.958+0000 7fe2cbfff640 1 -- 172.21.15.7:0/3917829212 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d40049c0 con 0x7fe2e41027b0 2024-09-19T04:08:04.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:04.958+0000 7fe2e93f2640 1 -- 172.21.15.7:0/3917829212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2e4197de0 con 0x7fe2e41027b0 2024-09-19T04:08:04.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:04.959+0000 7fe2cbfff640 1 -- 172.21.15.7:0/3917829212 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fe2d4039040 con 0x7fe2e41027b0 2024-09-19T04:08:04.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:04.959+0000 7fe2e93f2640 1 -- 172.21.15.7:0/3917829212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2e4069f10 con 0x7fe2e41027b0 2024-09-19T04:08:04.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:04.960+0000 7fe2cbfff640 1 --2- 172.21.15.7:0/3917829212 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe2cc039300 0x7fe2cc03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:04.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:04.960+0000 7fe2cbfff640 1 -- 172.21.15.7:0/3917829212 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe2d406d560 con 0x7fe2e41027b0 2024-09-19T04:08:04.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:04.960+0000 7fe2e27fc640 1 --2- 172.21.15.7:0/3917829212 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe2cc039300 0x7fe2cc03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:04.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:04.960+0000 7fe2e27fc640 1 --2- 172.21.15.7:0/3917829212 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe2cc039300 0x7fe2cc03b7c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80098c0 tx=0x7fe2d8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:08:04.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:04.964+0000 7fe2cbfff640 1 -- 172.21.15.7:0/3917829212 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe2d4040030 con 0x7fe2e41027b0 2024-09-19T04:08:05.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:05.147+0000 7fe2e93f2640 1 -- 172.21.15.7:0/3917829212 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi102", "target": ["mon-mgr", ""]}) -- 0x7fe2e4198580 con 0x7fe2cc039300 2024-09-19T04:08:06.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:06 smithi007 ceph-mon[31360]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:06.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:06 smithi007 ceph-mon[31360]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi102", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:08:07.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:07 smithi007 ceph-mon[31360]: Deploying cephadm binary to smithi102 2024-09-19T04:08:07.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:07 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:07.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:07 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:07.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:07 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:07.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:07 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:07.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:07 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi092", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:08:07.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:07 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:07.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:07 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:08:07.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:07 smithi007 ceph-mon[31360]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-19T04:08:07.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:07 smithi007 ceph-mon[31360]: Updating smithi092:/var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:08:07.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:07 smithi007 ceph-mon[31360]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:08:07.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:07 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:07.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:07 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:07.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:07 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:08.876 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:08 smithi007 ceph-mon[31360]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:08.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:08 smithi007 ceph-mon[31360]: Updating smithi092:/var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:08:09.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:09.188+0000 7fe2cbfff640 1 -- 172.21.15.7:0/3917829212 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fe2e4198580 con 0x7fe2cc039300 2024-09-19T04:08:09.190 INFO:teuthology.orchestra.run.smithi007.stdout:Added host 'smithi102' with addr '172.21.15.102' 2024-09-19T04:08:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:09.191+0000 7fe2e93f2640 1 -- 172.21.15.7:0/3917829212 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe2cc039300 msgr2=0x7fe2cc03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:09.191+0000 7fe2e93f2640 1 --2- 172.21.15.7:0/3917829212 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe2cc039300 0x7fe2cc03b7c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80098c0 tx=0x7fe2d8006db0 comp rx=0 tx=0).stop 2024-09-19T04:08:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:09.191+0000 7fe2e93f2640 1 -- 172.21.15.7:0/3917829212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2e41027b0 msgr2=0x7fe2e41971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:09.191+0000 7fe2e93f2640 1 --2- 172.21.15.7:0/3917829212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2e41027b0 0x7fe2e41971b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe2d40045e0 tx=0x7fe2d4004610 comp rx=0 tx=0).stop 2024-09-19T04:08:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:09.191+0000 7fe2e93f2640 1 -- 172.21.15.7:0/3917829212 shutdown_connections 2024-09-19T04:08:09.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:09.191+0000 7fe2e93f2640 1 --2- 172.21.15.7:0/3917829212 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe2cc039300 0x7fe2cc03b7c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:09.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:09.191+0000 7fe2e93f2640 1 --2- 172.21.15.7:0/3917829212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2e41027b0 0x7fe2e41971b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:09.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:09.191+0000 7fe2e93f2640 1 -- 172.21.15.7:0/3917829212 >> 172.21.15.7:0/3917829212 conn(0x7fe2e4077310 msgr2=0x7fe2e4105540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:08:09.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:09.191+0000 7fe2e93f2640 1 -- 172.21.15.7:0/3917829212 shutdown_connections 2024-09-19T04:08:09.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:09.191+0000 7fe2e93f2640 1 -- 172.21.15.7:0/3917829212 wait complete. 2024-09-19T04:08:09.631 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T04:08:09.880 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:08:10.264 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:10 smithi007 ceph-mon[31360]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:10.264 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:10 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:10.264 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:10 smithi007 ceph-mon[31360]: Added host smithi102 2024-09-19T04:08:10.265 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:10 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:08:10.265 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:10 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:10.265 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:10 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:10.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.345+0000 7fab329d5640 1 -- 172.21.15.7:0/284352152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab2c106560 msgr2=0x7fab2c106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:10.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.345+0000 7fab329d5640 1 --2- 172.21.15.7:0/284352152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab2c106560 0x7fab2c106940 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fab1c009880 tx=0x7fab1c02a5d0 comp rx=0 tx=0).stop 2024-09-19T04:08:10.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.345+0000 7fab329d5640 1 -- 172.21.15.7:0/284352152 shutdown_connections 2024-09-19T04:08:10.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.345+0000 7fab329d5640 1 --2- 172.21.15.7:0/284352152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab2c106560 0x7fab2c106940 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:10.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.345+0000 7fab329d5640 1 -- 172.21.15.7:0/284352152 >> 172.21.15.7:0/284352152 conn(0x7fab2c0fc1b0 msgr2=0x7fab2c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:08:10.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.345+0000 7fab329d5640 1 -- 172.21.15.7:0/284352152 shutdown_connections 2024-09-19T04:08:10.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.345+0000 7fab329d5640 1 -- 172.21.15.7:0/284352152 wait complete. 2024-09-19T04:08:10.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.345+0000 7fab329d5640 1 Processor -- start 2024-09-19T04:08:10.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.346+0000 7fab329d5640 1 -- start start 2024-09-19T04:08:10.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.346+0000 7fab329d5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab2c106560 0x7fab2c0fc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:10.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.346+0000 7fab329d5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fab2c10ab90 con 0x7fab2c106560 2024-09-19T04:08:10.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.346+0000 7fab2bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab2c106560 0x7fab2c0fc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:10.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.346+0000 7fab2bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab2c106560 0x7fab2c0fc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57192/0 (socket says 172.21.15.7:57192) 2024-09-19T04:08:10.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.346+0000 7fab2bfff640 1 -- 172.21.15.7:0/4069866195 learned_addr learned my addr 172.21.15.7:0/4069866195 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:08:10.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.346+0000 7fab2bfff640 1 -- 172.21.15.7:0/4069866195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab2c0fe550 con 0x7fab2c106560 2024-09-19T04:08:10.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.346+0000 7fab2bfff640 1 --2- 172.21.15.7:0/4069866195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab2c106560 0x7fab2c0fc660 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fab1c009230 tx=0x7fab1c003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:08:10.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.347+0000 7fab297fa640 1 -- 172.21.15.7:0/4069866195 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab1c03f070 con 0x7fab2c106560 2024-09-19T04:08:10.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.347+0000 7fab297fa640 1 -- 172.21.15.7:0/4069866195 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab1c03bd40 con 0x7fab2c106560 2024-09-19T04:08:10.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.347+0000 7fab329d5640 1 -- 172.21.15.7:0/4069866195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab2c0fcba0 con 0x7fab2c106560 2024-09-19T04:08:10.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.347+0000 7fab297fa640 1 -- 172.21.15.7:0/4069866195 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab1c035030 con 0x7fab2c106560 2024-09-19T04:08:10.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.347+0000 7fab329d5640 1 -- 172.21.15.7:0/4069866195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab2c0fd060 con 0x7fab2c106560 2024-09-19T04:08:10.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.348+0000 7fab297fa640 1 -- 172.21.15.7:0/4069866195 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fab1c042070 con 0x7fab2c106560 2024-09-19T04:08:10.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.348+0000 7fab329d5640 1 -- 172.21.15.7:0/4069866195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab2c101bd0 con 0x7fab2c106560 2024-09-19T04:08:10.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.348+0000 7fab297fa640 1 --2- 172.21.15.7:0/4069866195 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fab140392a0 0x7fab1403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:10.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.348+0000 7fab297fa640 1 -- 172.21.15.7:0/4069866195 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fab1c06cf70 con 0x7fab2c106560 2024-09-19T04:08:10.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.348+0000 7fab2b7fe640 1 --2- 172.21.15.7:0/4069866195 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fab140392a0 0x7fab1403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:10.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.348+0000 7fab2b7fe640 1 --2- 172.21.15.7:0/4069866195 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fab140392a0 0x7fab1403b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fab200098c0 tx=0x7fab20006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:08:10.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.353+0000 7fab297fa640 1 -- 172.21.15.7:0/4069866195 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fab1c03a890 con 0x7fab2c106560 2024-09-19T04:08:10.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.538+0000 7fab329d5640 1 -- 172.21.15.7:0/4069866195 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fab2c0fdc00 con 0x7fab140392a0 2024-09-19T04:08:10.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.539+0000 7fab297fa640 1 -- 172.21.15.7:0/4069866195 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+238 (secure 0 0 0) 0x7fab2c0fdc00 con 0x7fab140392a0 2024-09-19T04:08:10.540 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:08:10.540 INFO:teuthology.orchestra.run.smithi007.stdout:[{"addr": "172.21.15.7", "hostname": "smithi007", "labels": [], "status": ""}, {"addr": "172.21.15.92", "hostname": "smithi092", "labels": [], "status": ""}, {"addr": "172.21.15.102", "hostname": "smithi102", "labels": [], "status": ""}] 2024-09-19T04:08:10.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.541+0000 7fab329d5640 1 -- 172.21.15.7:0/4069866195 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fab140392a0 msgr2=0x7fab1403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:10.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.541+0000 7fab329d5640 1 --2- 172.21.15.7:0/4069866195 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fab140392a0 0x7fab1403b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fab200098c0 tx=0x7fab20006db0 comp rx=0 tx=0).stop 2024-09-19T04:08:10.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.541+0000 7fab329d5640 1 -- 172.21.15.7:0/4069866195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab2c106560 msgr2=0x7fab2c0fc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:10.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.541+0000 7fab329d5640 1 --2- 172.21.15.7:0/4069866195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab2c106560 0x7fab2c0fc660 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fab1c009230 tx=0x7fab1c003d80 comp rx=0 tx=0).stop 2024-09-19T04:08:10.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.541+0000 7fab329d5640 1 -- 172.21.15.7:0/4069866195 shutdown_connections 2024-09-19T04:08:10.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.541+0000 7fab329d5640 1 --2- 172.21.15.7:0/4069866195 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fab140392a0 0x7fab1403b760 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:10.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.541+0000 7fab329d5640 1 --2- 172.21.15.7:0/4069866195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab2c106560 0x7fab2c0fc660 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:10.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.541+0000 7fab329d5640 1 -- 172.21.15.7:0/4069866195 >> 172.21.15.7:0/4069866195 conn(0x7fab2c0fc1b0 msgr2=0x7fab2c069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:08:10.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.541+0000 7fab329d5640 1 -- 172.21.15.7:0/4069866195 shutdown_connections 2024-09-19T04:08:10.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:10.541+0000 7fab329d5640 1 -- 172.21.15.7:0/4069866195 wait complete. 2024-09-19T04:08:11.151 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T04:08:11.151 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T04:08:11.413 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:08:11.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:11 smithi007 ceph-mon[31360]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:08:11.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:11 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:11.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:11.845+0000 7f7bb54c1640 1 -- 172.21.15.7:0/3874273596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bb0106540 msgr2=0x7f7bb0106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:11.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:11.845+0000 7f7bb54c1640 1 --2- 172.21.15.7:0/3874273596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bb0106540 0x7f7bb0106920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0009810 tx=0x7f7ba002a540 comp rx=0 tx=0).stop 2024-09-19T04:08:11.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:11.845+0000 7f7bb54c1640 1 -- 172.21.15.7:0/3874273596 shutdown_connections 2024-09-19T04:08:11.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:11.845+0000 7f7bb54c1640 1 --2- 172.21.15.7:0/3874273596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bb0106540 0x7f7bb0106920 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:11.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:11.845+0000 7f7bb54c1640 1 -- 172.21.15.7:0/3874273596 >> 172.21.15.7:0/3874273596 conn(0x7f7bb0077310 msgr2=0x7f7bb00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:08:11.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:11.845+0000 7f7bb54c1640 1 -- 172.21.15.7:0/3874273596 shutdown_connections 2024-09-19T04:08:11.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:11.845+0000 7f7bb54c1640 1 -- 172.21.15.7:0/3874273596 wait complete. 2024-09-19T04:08:11.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:11.846+0000 7f7bb54c1640 1 Processor -- start 2024-09-19T04:08:11.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:11.846+0000 7f7bb54c1640 1 -- start start 2024-09-19T04:08:11.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:11.846+0000 7f7bb54c1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bb0106540 0x7f7bb01970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:11.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:11.846+0000 7f7bb54c1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb010ab70 con 0x7f7bb0106540 2024-09-19T04:08:11.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:11.846+0000 7f7baeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bb0106540 0x7f7bb01970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:11.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:11.846+0000 7f7baeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bb0106540 0x7f7bb01970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57196/0 (socket says 172.21.15.7:57196) 2024-09-19T04:08:11.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:11.846+0000 7f7baeffd640 1 -- 172.21.15.7:0/1621068215 learned_addr learned my addr 172.21.15.7:0/1621068215 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:08:11.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:11.846+0000 7f7baeffd640 1 -- 172.21.15.7:0/1621068215 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bb0197620 con 0x7f7bb0106540 2024-09-19T04:08:11.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:11.847+0000 7f7baeffd640 1 --2- 172.21.15.7:0/1621068215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bb0106540 0x7f7bb01970e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7ba00045e0 tx=0x7f7ba0004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:08:11.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:11.847+0000 7f7b97fff640 1 -- 172.21.15.7:0/1621068215 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ba0030e70 con 0x7f7bb0106540 2024-09-19T04:08:11.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:11.847+0000 7f7b97fff640 1 -- 172.21.15.7:0/1621068215 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ba00318e0 con 0x7f7bb0106540 2024-09-19T04:08:11.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:11.847+0000 7f7bb54c1640 1 -- 172.21.15.7:0/1621068215 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bb01978b0 con 0x7f7bb0106540 2024-09-19T04:08:11.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:11.847+0000 7f7b97fff640 1 -- 172.21.15.7:0/1621068215 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ba00049c0 con 0x7f7bb0106540 2024-09-19T04:08:11.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:11.847+0000 7f7bb54c1640 1 -- 172.21.15.7:0/1621068215 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bb019b9b0 con 0x7f7bb0106540 2024-09-19T04:08:11.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:11.848+0000 7f7b97fff640 1 -- 172.21.15.7:0/1621068215 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f7ba0039040 con 0x7f7bb0106540 2024-09-19T04:08:11.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:11.848+0000 7f7bb54c1640 1 -- 172.21.15.7:0/1621068215 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bb0101bb0 con 0x7f7bb0106540 2024-09-19T04:08:11.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:11.848+0000 7f7b97fff640 1 --2- 172.21.15.7:0/1621068215 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f7b980392a0 0x7f7b9803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:11.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:11.848+0000 7f7b97fff640 1 -- 172.21.15.7:0/1621068215 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f7ba006d7f0 con 0x7f7bb0106540 2024-09-19T04:08:11.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:11.848+0000 7f7bae7fc640 1 --2- 172.21.15.7:0/1621068215 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f7b980392a0 0x7f7b9803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:11.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:11.849+0000 7f7bae7fc640 1 --2- 172.21.15.7:0/1621068215 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f7b980392a0 0x7f7b9803b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7ba40098c0 tx=0x7f7ba4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:08:11.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:11.853+0000 7f7b97fff640 1 -- 172.21.15.7:0/1621068215 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7ba0040030 con 0x7f7bb0106540 2024-09-19T04:08:12.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:12.034+0000 7f7bb54c1640 1 -- 172.21.15.7:0/1621068215 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f7bb0198440 con 0x7f7bb0106540 2024-09-19T04:08:12.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:12.542+0000 7f7b97fff640 1 -- 172.21.15.7:0/1621068215 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f7ba0037d70 con 0x7f7bb0106540 2024-09-19T04:08:12.543 INFO:teuthology.orchestra.run.smithi007.stderr:adjusted tunables profile to default 2024-09-19T04:08:12.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:12.544+0000 7f7bb54c1640 1 -- 172.21.15.7:0/1621068215 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f7b980392a0 msgr2=0x7f7b9803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:12.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:12.544+0000 7f7bb54c1640 1 --2- 172.21.15.7:0/1621068215 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f7b980392a0 0x7f7b9803b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7ba40098c0 tx=0x7f7ba4006db0 comp rx=0 tx=0).stop 2024-09-19T04:08:12.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:12.544+0000 7f7bb54c1640 1 -- 172.21.15.7:0/1621068215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bb0106540 msgr2=0x7f7bb01970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:12.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:12.544+0000 7f7bb54c1640 1 --2- 172.21.15.7:0/1621068215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bb0106540 0x7f7bb01970e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7ba00045e0 tx=0x7f7ba0004610 comp rx=0 tx=0).stop 2024-09-19T04:08:12.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:12.544+0000 7f7bb54c1640 1 -- 172.21.15.7:0/1621068215 shutdown_connections 2024-09-19T04:08:12.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:12.544+0000 7f7bb54c1640 1 --2- 172.21.15.7:0/1621068215 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f7b980392a0 0x7f7b9803b760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:12.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:12.544+0000 7f7bb54c1640 1 --2- 172.21.15.7:0/1621068215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bb0106540 0x7f7bb01970e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:12.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:12.544+0000 7f7bb54c1640 1 -- 172.21.15.7:0/1621068215 >> 172.21.15.7:0/1621068215 conn(0x7f7bb0077310 msgr2=0x7f7bb00696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:08:12.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:12.545+0000 7f7bb54c1640 1 -- 172.21.15.7:0/1621068215 shutdown_connections 2024-09-19T04:08:12.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:12.545+0000 7f7bb54c1640 1 -- 172.21.15.7:0/1621068215 wait complete. 2024-09-19T04:08:12.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:12 smithi007 ceph-mon[31360]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:12.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:12 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1621068215' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T04:08:13.188 INFO:tasks.cephadm:Adding mon.a on smithi007 2024-09-19T04:08:13.188 INFO:tasks.cephadm:Adding mon.b on smithi092 2024-09-19T04:08:13.188 INFO:tasks.cephadm:Adding mon.c on smithi102 2024-09-19T04:08:13.188 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi007:172.21.15.7=a;smithi092:172.21.15.92=b;smithi102:172.21.15.102=c' 2024-09-19T04:08:13.438 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T04:08:13.483 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T04:08:13.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:13 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1621068215' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T04:08:13.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:13 smithi007 ceph-mon[31360]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:08:13.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:13 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:13.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:13 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:13.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:13 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:13.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:13 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:13.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:13 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi102", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:08:13.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:13 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:13.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:13 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:08:14.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:13.994+0000 7f941c694640 1 -- 172.21.15.102:0/1748404496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94140ff8b0 msgr2=0x7f94140ffcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:14.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:13.994+0000 7f941c694640 1 --2- 172.21.15.102:0/1748404496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94140ff8b0 0x7f94140ffcb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9410009880 tx=0x7f941002a5d0 comp rx=0 tx=0).stop 2024-09-19T04:08:14.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:13.994+0000 7f941c694640 1 -- 172.21.15.102:0/1748404496 shutdown_connections 2024-09-19T04:08:14.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:13.994+0000 7f941c694640 1 --2- 172.21.15.102:0/1748404496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94140ff8b0 0x7f94140ffcb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:14.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:13.994+0000 7f941c694640 1 -- 172.21.15.102:0/1748404496 >> 172.21.15.102:0/1748404496 conn(0x7f94140fb400 msgr2=0x7f94140fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:08:14.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:13.994+0000 7f941c694640 1 -- 172.21.15.102:0/1748404496 shutdown_connections 2024-09-19T04:08:14.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:13.994+0000 7f941c694640 1 -- 172.21.15.102:0/1748404496 wait complete. 2024-09-19T04:08:14.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:13.995+0000 7f941c694640 1 Processor -- start 2024-09-19T04:08:14.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:13.995+0000 7f941c694640 1 -- start start 2024-09-19T04:08:14.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:13.995+0000 7f941c694640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94140ff8b0 0x7f9414102110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:14.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:13.995+0000 7f941c694640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9414107700 con 0x7f94140ff8b0 2024-09-19T04:08:14.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:13.995+0000 7f941a430640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94140ff8b0 0x7f9414102110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:14.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:13.995+0000 7f941a430640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94140ff8b0 0x7f9414102110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.102:38930/0 (socket says 172.21.15.102:38930) 2024-09-19T04:08:14.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:13.995+0000 7f941a430640 1 -- 172.21.15.102:0/3804738365 learned_addr learned my addr 172.21.15.102:0/3804738365 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T04:08:14.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:13.996+0000 7f941a430640 1 -- 172.21.15.102:0/3804738365 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9414102650 con 0x7f94140ff8b0 2024-09-19T04:08:14.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:13.996+0000 7f941a430640 1 --2- 172.21.15.102:0/3804738365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94140ff8b0 0x7f9414102110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9410004f60 tx=0x7f94100048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:08:14.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:13.996+0000 7f940b7fe640 1 -- 172.21.15.102:0/3804738365 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f941003f070 con 0x7f94140ff8b0 2024-09-19T04:08:14.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:13.996+0000 7f940b7fe640 1 -- 172.21.15.102:0/3804738365 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9410004d40 con 0x7f94140ff8b0 2024-09-19T04:08:14.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:13.996+0000 7f941c694640 1 -- 172.21.15.102:0/3804738365 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9414100840 con 0x7f94140ff8b0 2024-09-19T04:08:14.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:13.996+0000 7f940b7fe640 1 -- 172.21.15.102:0/3804738365 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9410035030 con 0x7f94140ff8b0 2024-09-19T04:08:14.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:13.996+0000 7f941c694640 1 -- 172.21.15.102:0/3804738365 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9414100d80 con 0x7f94140ff8b0 2024-09-19T04:08:14.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:13.997+0000 7f940b7fe640 1 -- 172.21.15.102:0/3804738365 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f9410042070 con 0x7f94140ff8b0 2024-09-19T04:08:14.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:13.997+0000 7f941c694640 1 -- 172.21.15.102:0/3804738365 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9414107e80 con 0x7f94140ff8b0 2024-09-19T04:08:14.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:13.997+0000 7f940b7fe640 1 --2- 172.21.15.102:0/3804738365 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f94000392a0 0x7f940003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:14.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:13.997+0000 7f940b7fe640 1 -- 172.21.15.102:0/3804738365 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f941006d070 con 0x7f94140ff8b0 2024-09-19T04:08:14.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:13.998+0000 7f9419c2f640 1 --2- 172.21.15.102:0/3804738365 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f94000392a0 0x7f940003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:14.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:13.998+0000 7f9419c2f640 1 --2- 172.21.15.102:0/3804738365 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f94000392a0 0x7f940003b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f94040098c0 tx=0x7f9404006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:08:14.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:14.003+0000 7f940b7fe640 1 -- 172.21.15.102:0/3804738365 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9410040260 con 0x7f94140ff8b0 2024-09-19T04:08:14.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:14.191+0000 7f941c694640 1 -- 172.21.15.102:0/3804738365 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi007:172.21.15.7=a;smithi092:172.21.15.92=b;smithi102:172.21.15.102=c", "target": ["mon-mgr", ""]}) -- 0x7f9414190270 con 0x7f94000392a0 2024-09-19T04:08:14.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:14.197+0000 7f940b7fe640 1 -- 172.21.15.102:0/3804738365 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f9414190270 con 0x7f94000392a0 2024-09-19T04:08:14.198 INFO:teuthology.orchestra.run.smithi102.stdout:Scheduled mon update... 2024-09-19T04:08:14.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:14.199+0000 7f941c694640 1 -- 172.21.15.102:0/3804738365 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f94000392a0 msgr2=0x7f940003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:14.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:14.199+0000 7f941c694640 1 --2- 172.21.15.102:0/3804738365 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f94000392a0 0x7f940003b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f94040098c0 tx=0x7f9404006db0 comp rx=0 tx=0).stop 2024-09-19T04:08:14.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:14.199+0000 7f941c694640 1 -- 172.21.15.102:0/3804738365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94140ff8b0 msgr2=0x7f9414102110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:14.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:14.199+0000 7f941c694640 1 --2- 172.21.15.102:0/3804738365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94140ff8b0 0x7f9414102110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9410004f60 tx=0x7f94100048f0 comp rx=0 tx=0).stop 2024-09-19T04:08:14.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:14.199+0000 7f941c694640 1 -- 172.21.15.102:0/3804738365 shutdown_connections 2024-09-19T04:08:14.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:14.199+0000 7f941c694640 1 --2- 172.21.15.102:0/3804738365 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f94000392a0 0x7f940003b760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:14.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:14.199+0000 7f941c694640 1 --2- 172.21.15.102:0/3804738365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94140ff8b0 0x7f9414102110 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:14.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:14.199+0000 7f941c694640 1 -- 172.21.15.102:0/3804738365 >> 172.21.15.102:0/3804738365 conn(0x7f94140fb400 msgr2=0x7f94140fbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:08:14.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:14.199+0000 7f941c694640 1 -- 172.21.15.102:0/3804738365 shutdown_connections 2024-09-19T04:08:14.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:14.199+0000 7f941c694640 1 -- 172.21.15.102:0/3804738365 wait complete. 2024-09-19T04:08:14.777 DEBUG:teuthology.orchestra.run.smithi092:mon.b> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mon.b.service 2024-09-19T04:08:14.780 DEBUG:teuthology.orchestra.run.smithi102:mon.c> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mon.c.service 2024-09-19T04:08:14.783 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T04:08:14.783 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T04:08:14.803 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:14 smithi007 ceph-mon[31360]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:14.803 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:14 smithi007 ceph-mon[31360]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-19T04:08:14.803 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:14 smithi007 ceph-mon[31360]: Updating smithi102:/var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:08:14.803 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:14 smithi007 ceph-mon[31360]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:08:14.804 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:14 smithi007 ceph-mon[31360]: Updating smithi102:/var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:08:14.804 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:14 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:14.804 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:14 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:14.804 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:14 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:14.804 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:14 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:14.804 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:14 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:14.804 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:14 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:14.804 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:14 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:14.804 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:14 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:14.804 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:14 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:08:14.805 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:14 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:08:14.805 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:14 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:15.052 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:08:15.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.461+0000 7f0884e86640 1 -- 172.21.15.102:0/450778001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08801097c0 msgr2=0x7f0880109ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:15.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.461+0000 7f0884e86640 1 --2- 172.21.15.102:0/450778001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08801097c0 0x7f0880109ba0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0870009880 tx=0x7f087002a5d0 comp rx=0 tx=0).stop 2024-09-19T04:08:15.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.462+0000 7f0884e86640 1 -- 172.21.15.102:0/450778001 shutdown_connections 2024-09-19T04:08:15.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.462+0000 7f0884e86640 1 --2- 172.21.15.102:0/450778001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08801097c0 0x7f0880109ba0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:15.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.462+0000 7f0884e86640 1 -- 172.21.15.102:0/450778001 >> 172.21.15.102:0/450778001 conn(0x7f08800ff480 msgr2=0x7f08801018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:08:15.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.462+0000 7f0884e86640 1 -- 172.21.15.102:0/450778001 shutdown_connections 2024-09-19T04:08:15.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.462+0000 7f0884e86640 1 -- 172.21.15.102:0/450778001 wait complete. 2024-09-19T04:08:15.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.462+0000 7f0884e86640 1 Processor -- start 2024-09-19T04:08:15.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.462+0000 7f0884e86640 1 -- start start 2024-09-19T04:08:15.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.463+0000 7f0884e86640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08801097c0 0x7f0880199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:15.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.463+0000 7f0884e86640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f088010de80 con 0x7f08801097c0 2024-09-19T04:08:15.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.463+0000 7f087e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08801097c0 0x7f0880199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:15.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.463+0000 7f087e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08801097c0 0x7f0880199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.102:38948/0 (socket says 172.21.15.102:38948) 2024-09-19T04:08:15.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.463+0000 7f087e59c640 1 -- 172.21.15.102:0/1659383268 learned_addr learned my addr 172.21.15.102:0/1659383268 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T04:08:15.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.463+0000 7f087e59c640 1 -- 172.21.15.102:0/1659383268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0880199860 con 0x7f08801097c0 2024-09-19T04:08:15.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.463+0000 7f087e59c640 1 --2- 172.21.15.102:0/1659383268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08801097c0 0x7f0880199320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0870009230 tx=0x7f0870003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:08:15.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.464+0000 7f08777fe640 1 -- 172.21.15.102:0/1659383268 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f087003f070 con 0x7f08801097c0 2024-09-19T04:08:15.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.464+0000 7f0884e86640 1 -- 172.21.15.102:0/1659383268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0880199b50 con 0x7f08801097c0 2024-09-19T04:08:15.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.464+0000 7f08777fe640 1 -- 172.21.15.102:0/1659383268 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f087003bc80 con 0x7f08801097c0 2024-09-19T04:08:15.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.464+0000 7f08777fe640 1 -- 172.21.15.102:0/1659383268 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0870035030 con 0x7f08801097c0 2024-09-19T04:08:15.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.464+0000 7f0884e86640 1 -- 172.21.15.102:0/1659383268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f088019dbf0 con 0x7f08801097c0 2024-09-19T04:08:15.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.465+0000 7f0884e86640 1 -- 172.21.15.102:0/1659383268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0880104f00 con 0x7f08801097c0 2024-09-19T04:08:15.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.465+0000 7f08777fe640 1 -- 172.21.15.102:0/1659383268 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f0870042070 con 0x7f08801097c0 2024-09-19T04:08:15.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.465+0000 7f08777fe640 1 --2- 172.21.15.102:0/1659383268 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f086c0392a0 0x7f086c03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:15.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.465+0000 7f08777fe640 1 -- 172.21.15.102:0/1659383268 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f087006cfb0 con 0x7f08801097c0 2024-09-19T04:08:15.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.465+0000 7f0877fff640 1 --2- 172.21.15.102:0/1659383268 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f086c0392a0 0x7f086c03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:15.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.466+0000 7f0877fff640 1 --2- 172.21.15.102:0/1659383268 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f086c0392a0 0x7f086c03b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f08680098c0 tx=0x7f0868006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:08:15.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.470+0000 7f08777fe640 1 -- 172.21.15.102:0/1659383268 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0870031570 con 0x7f08801097c0 2024-09-19T04:08:15.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.700+0000 7f0884e86640 1 -- 172.21.15.102:0/1659383268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f088019a680 con 0x7f08801097c0 2024-09-19T04:08:15.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.700+0000 7f08777fe640 1 -- 172.21.15.102:0/1659383268 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7f08700303a0 con 0x7f08801097c0 2024-09-19T04:08:15.702 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T04:08:15.702 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":1,"fsid":"77957c0a-763c-11ef-bceb-c7b262605968","modified":"2024-09-19T04:06:54.996586Z","created":"2024-09-19T04:06:54.996586Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T04:08:15.702 INFO:teuthology.orchestra.run.smithi102.stderr:dumped monmap epoch 1 2024-09-19T04:08:15.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.702+0000 7f0884e86640 1 -- 172.21.15.102:0/1659383268 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f086c0392a0 msgr2=0x7f086c03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:15.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.702+0000 7f0884e86640 1 --2- 172.21.15.102:0/1659383268 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f086c0392a0 0x7f086c03b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f08680098c0 tx=0x7f0868006db0 comp rx=0 tx=0).stop 2024-09-19T04:08:15.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.702+0000 7f0884e86640 1 -- 172.21.15.102:0/1659383268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08801097c0 msgr2=0x7f0880199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:15.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.702+0000 7f0884e86640 1 --2- 172.21.15.102:0/1659383268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08801097c0 0x7f0880199320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0870009230 tx=0x7f0870003d40 comp rx=0 tx=0).stop 2024-09-19T04:08:15.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.702+0000 7f0884e86640 1 -- 172.21.15.102:0/1659383268 shutdown_connections 2024-09-19T04:08:15.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.702+0000 7f0884e86640 1 --2- 172.21.15.102:0/1659383268 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f086c0392a0 0x7f086c03b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:15.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.702+0000 7f0884e86640 1 --2- 172.21.15.102:0/1659383268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f08801097c0 0x7f0880199320 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:15.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.702+0000 7f0884e86640 1 -- 172.21.15.102:0/1659383268 >> 172.21.15.102:0/1659383268 conn(0x7f08800ff480 msgr2=0x7f0880100e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:08:15.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.702+0000 7f0884e86640 1 -- 172.21.15.102:0/1659383268 shutdown_connections 2024-09-19T04:08:15.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:15.702+0000 7f0884e86640 1 -- 172.21.15.102:0/1659383268 wait complete. 2024-09-19T04:08:15.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:15 smithi007 ceph-mon[31360]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi007:172.21.15.7=a;smithi092:172.21.15.92=b;smithi102:172.21.15.102=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:08:15.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:15 smithi007 ceph-mon[31360]: Saving service mon spec with placement smithi007:172.21.15.7=a;smithi092:172.21.15.92=b;smithi102:172.21.15.102=c;count:3 2024-09-19T04:08:15.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:15 smithi007 ceph-mon[31360]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T04:08:15.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:15 smithi007 ceph-mon[31360]: Reconfiguring daemon mon.a on smithi007 2024-09-19T04:08:17.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:16 smithi007 ceph-mon[31360]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:17.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:16 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:17.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:16 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:17.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:16 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:08:17.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:16 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:17.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:16 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:08:17.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:16 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:17.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:16 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:08:17.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:16 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:17.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:16 smithi007 ceph-mon[31360]: Deploying daemon mon.c on smithi102 2024-09-19T04:08:17.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:16 smithi007 ceph-mon[31360]: from='client.? 172.21.15.102:0/1659383268' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:08:17.249 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T04:08:17.250 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T04:08:17.902 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:08:18.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:18.879+0000 7f4f4e0fb640 1 -- 172.21.15.102:0/2696407547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f48106540 msgr2=0x7f4f48106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:18.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:18.879+0000 7f4f4e0fb640 1 --2- 172.21.15.102:0/2696407547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f48106540 0x7f4f48106920 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4f38009810 tx=0x7f4f3802a540 comp rx=0 tx=0).stop 2024-09-19T04:08:18.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:18.879+0000 7f4f4e0fb640 1 -- 172.21.15.102:0/2696407547 shutdown_connections 2024-09-19T04:08:18.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:18.879+0000 7f4f4e0fb640 1 --2- 172.21.15.102:0/2696407547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f48106540 0x7f4f48106920 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:18.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:18.879+0000 7f4f4e0fb640 1 -- 172.21.15.102:0/2696407547 >> 172.21.15.102:0/2696407547 conn(0x7f4f48077310 msgr2=0x7f4f480fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:08:18.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:18.879+0000 7f4f4e0fb640 1 -- 172.21.15.102:0/2696407547 shutdown_connections 2024-09-19T04:08:18.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:18.879+0000 7f4f4e0fb640 1 -- 172.21.15.102:0/2696407547 wait complete. 2024-09-19T04:08:18.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:18.879+0000 7f4f4e0fb640 1 Processor -- start 2024-09-19T04:08:18.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:18.880+0000 7f4f4e0fb640 1 -- start start 2024-09-19T04:08:18.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:18.880+0000 7f4f4e0fb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f48106540 0x7f4f48197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:18.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:18.880+0000 7f4f4e0fb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4810ab70 con 0x7f4f48106540 2024-09-19T04:08:18.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:18.880+0000 7f4f477fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f48106540 0x7f4f48197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:18.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:18.880+0000 7f4f477fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f48106540 0x7f4f48197110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.102:38966/0 (socket says 172.21.15.102:38966) 2024-09-19T04:08:18.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:18.880+0000 7f4f477fe640 1 -- 172.21.15.102:0/340096627 learned_addr learned my addr 172.21.15.102:0/340096627 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T04:08:18.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:18.881+0000 7f4f477fe640 1 -- 172.21.15.102:0/340096627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f48197650 con 0x7f4f48106540 2024-09-19T04:08:18.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:18.881+0000 7f4f477fe640 1 --2- 172.21.15.102:0/340096627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f48106540 0x7f4f48197110 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4f380045e0 tx=0x7f4f38004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:08:18.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:18.881+0000 7f4f44ff9640 1 -- 172.21.15.102:0/340096627 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f38030e70 con 0x7f4f48106540 2024-09-19T04:08:18.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:18.881+0000 7f4f4e0fb640 1 -- 172.21.15.102:0/340096627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f481978e0 con 0x7f4f48106540 2024-09-19T04:08:18.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:18.881+0000 7f4f44ff9640 1 -- 172.21.15.102:0/340096627 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f380318e0 con 0x7f4f48106540 2024-09-19T04:08:18.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:18.881+0000 7f4f44ff9640 1 -- 172.21.15.102:0/340096627 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f380049c0 con 0x7f4f48106540 2024-09-19T04:08:18.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:18.881+0000 7f4f4e0fb640 1 -- 172.21.15.102:0/340096627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f4819b9e0 con 0x7f4f48106540 2024-09-19T04:08:18.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:18.882+0000 7f4f44ff9640 1 -- 172.21.15.102:0/340096627 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f4f38039040 con 0x7f4f48106540 2024-09-19T04:08:18.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:18.882+0000 7f4f4e0fb640 1 -- 172.21.15.102:0/340096627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f48101bb0 con 0x7f4f48106540 2024-09-19T04:08:18.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:18.882+0000 7f4f44ff9640 1 --2- 172.21.15.102:0/340096627 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4f300392a0 0x7f4f3003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:18.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:18.883+0000 7f4f44ff9640 1 -- 172.21.15.102:0/340096627 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4f3806d570 con 0x7f4f48106540 2024-09-19T04:08:18.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:18.883+0000 7f4f46ffd640 1 --2- 172.21.15.102:0/340096627 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4f300392a0 0x7f4f3003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:18.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:18.883+0000 7f4f46ffd640 1 --2- 172.21.15.102:0/340096627 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4f300392a0 0x7f4f3003b760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0098c0 tx=0x7f4f3c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:08:18.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:18.888+0000 7f4f44ff9640 1 -- 172.21.15.102:0/340096627 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4f38040030 con 0x7f4f48106540 2024-09-19T04:08:19.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:18 smithi007 ceph-mon[31360]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:19.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:19.139+0000 7f4f4e0fb640 1 -- 172.21.15.102:0/340096627 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f4f481069a0 con 0x7f4f48106540 2024-09-19T04:08:19.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:19.140+0000 7f4f44ff9640 1 -- 172.21.15.102:0/340096627 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7f4f3803ae40 con 0x7f4f48106540 2024-09-19T04:08:19.141 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T04:08:19.141 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":1,"fsid":"77957c0a-763c-11ef-bceb-c7b262605968","modified":"2024-09-19T04:06:54.996586Z","created":"2024-09-19T04:06:54.996586Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T04:08:19.142 INFO:teuthology.orchestra.run.smithi102.stderr:dumped monmap epoch 1 2024-09-19T04:08:19.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:19.142+0000 7f4f4e0fb640 1 -- 172.21.15.102:0/340096627 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4f300392a0 msgr2=0x7f4f3003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:19.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:19.142+0000 7f4f4e0fb640 1 --2- 172.21.15.102:0/340096627 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4f300392a0 0x7f4f3003b760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0098c0 tx=0x7f4f3c006db0 comp rx=0 tx=0).stop 2024-09-19T04:08:19.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:19.142+0000 7f4f4e0fb640 1 -- 172.21.15.102:0/340096627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f48106540 msgr2=0x7f4f48197110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:19.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:19.142+0000 7f4f4e0fb640 1 --2- 172.21.15.102:0/340096627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f48106540 0x7f4f48197110 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4f380045e0 tx=0x7f4f38004610 comp rx=0 tx=0).stop 2024-09-19T04:08:19.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:19.142+0000 7f4f4e0fb640 1 -- 172.21.15.102:0/340096627 shutdown_connections 2024-09-19T04:08:19.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:19.142+0000 7f4f4e0fb640 1 --2- 172.21.15.102:0/340096627 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4f300392a0 0x7f4f3003b760 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:19.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:19.142+0000 7f4f4e0fb640 1 --2- 172.21.15.102:0/340096627 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f48106540 0x7f4f48197110 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:19.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:19.142+0000 7f4f4e0fb640 1 -- 172.21.15.102:0/340096627 >> 172.21.15.102:0/340096627 conn(0x7f4f48077310 msgr2=0x7f4f480696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:08:19.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:19.142+0000 7f4f4e0fb640 1 -- 172.21.15.102:0/340096627 shutdown_connections 2024-09-19T04:08:19.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:19.142+0000 7f4f4e0fb640 1 -- 172.21.15.102:0/340096627 wait complete. 2024-09-19T04:08:19.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:19 smithi102 systemd[1]: Starting Ceph mon.c for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:08:20.028 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:19 smithi007 ceph-mon[31360]: from='client.? 172.21.15.102:0/340096627' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:08:20.229 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:19 smithi102 podman[35427]: 2024-09-19 04:08:19.865687478 +0000 UTC m=+0.015431797 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:08:20.229 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:19 smithi102 podman[35427]: 2024-09-19 04:08:19.985087712 +0000 UTC m=+0.134832028 container create 2d79ec02c4c4742191001c81ea7f205750efc057a29d01ce858c067cb74faf88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-c, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T04:08:20.229 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 podman[35427]: 2024-09-19 04:08:20.228625892 +0000 UTC m=+0.378370216 container init 2d79ec02c4c4742191001c81ea7f205750efc057a29d01ce858c067cb74faf88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-c, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-19T04:08:20.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 podman[35427]: 2024-09-19 04:08:20.231858392 +0000 UTC m=+0.381602707 container start 2d79ec02c4c4742191001c81ea7f205750efc057a29d01ce858c067cb74faf88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-c, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T04:08:20.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T04:08:20.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T04:08:20.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: pidfile_write: ignore empty --pid-file 2024-09-19T04:08:20.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: load: jerasure load: lrc 2024-09-19T04:08:20.660 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: RocksDB version: 7.9.2 2024-09-19T04:08:20.660 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Git sha 0 2024-09-19T04:08:20.660 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T04:08:20.660 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: DB SUMMARY 2024-09-19T04:08:20.660 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: DB Session ID: GFHRI09BWIT0WZENQ76U 2024-09-19T04:08:20.660 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: CURRENT file: CURRENT 2024-09-19T04:08:20.660 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T04:08:20.660 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-19T04:08:20.660 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-19T04:08:20.660 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-19T04:08:20.660 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.error_if_exists: 0 2024-09-19T04:08:20.660 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.create_if_missing: 0 2024-09-19T04:08:20.660 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.paranoid_checks: 1 2024-09-19T04:08:20.661 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T04:08:20.661 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T04:08:20.661 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T04:08:20.661 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.env: 0x557dbaf65940 2024-09-19T04:08:20.661 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T04:08:20.661 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.info_log: 0x557dbc39f6e0 2024-09-19T04:08:20.661 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T04:08:20.661 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.statistics: (nil) 2024-09-19T04:08:20.661 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.use_fsync: 0 2024-09-19T04:08:20.661 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.max_log_file_size: 0 2024-09-19T04:08:20.661 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T04:08:20.661 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T04:08:20.661 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T04:08:20.662 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T04:08:20.662 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.allow_fallocate: 1 2024-09-19T04:08:20.663 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T04:08:20.663 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T04:08:20.663 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.use_direct_reads: 0 2024-09-19T04:08:20.663 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T04:08:20.664 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T04:08:20.664 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.db_log_dir: 2024-09-19T04:08:20.664 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.wal_dir: 2024-09-19T04:08:20.664 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T04:08:20.664 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T04:08:20.664 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T04:08:20.664 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T04:08:20.664 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T04:08:20.664 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T04:08:20.664 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T04:08:20.664 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T04:08:20.664 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.write_buffer_manager: 0x557dbc3aedc0 2024-09-19T04:08:20.664 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T04:08:20.665 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T04:08:20.665 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T04:08:20.665 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T04:08:20.665 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T04:08:20.665 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T04:08:20.665 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T04:08:20.665 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T04:08:20.665 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.unordered_write: 0 2024-09-19T04:08:20.665 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T04:08:20.665 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T04:08:20.665 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T04:08:20.666 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T04:08:20.666 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.row_cache: None 2024-09-19T04:08:20.666 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.wal_filter: None 2024-09-19T04:08:20.666 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T04:08:20.666 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T04:08:20.666 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.two_write_queues: 0 2024-09-19T04:08:20.666 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T04:08:20.666 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.wal_compression: 0 2024-09-19T04:08:20.666 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.atomic_flush: 0 2024-09-19T04:08:20.666 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T04:08:20.666 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T04:08:20.666 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T04:08:20.667 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.log_readahead_size: 0 2024-09-19T04:08:20.667 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T04:08:20.667 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T04:08:20.667 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T04:08:20.667 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T04:08:20.667 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T04:08:20.667 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T04:08:20.667 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T04:08:20.667 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.max_background_jobs: 2 2024-09-19T04:08:20.667 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.max_background_compactions: -1 2024-09-19T04:08:20.667 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.max_subcompactions: 1 2024-09-19T04:08:20.667 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T04:08:20.668 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T04:08:20.668 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T04:08:20.668 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T04:08:20.668 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T04:08:20.668 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T04:08:20.668 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T04:08:20.668 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T04:08:20.668 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.max_open_files: -1 2024-09-19T04:08:20.668 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T04:08:20.668 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T04:08:20.668 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T04:08:20.668 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T04:08:20.669 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.max_background_flushes: -1 2024-09-19T04:08:20.669 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Compression algorithms supported: 2024-09-19T04:08:20.669 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: kZSTD supported: 0 2024-09-19T04:08:20.669 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: kXpressCompression supported: 0 2024-09-19T04:08:20.669 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: kBZip2Compression supported: 0 2024-09-19T04:08:20.669 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T04:08:20.669 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: kLZ4Compression supported: 1 2024-09-19T04:08:20.669 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: kZlibCompression supported: 1 2024-09-19T04:08:20.669 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T04:08:20.669 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: kSnappyCompression supported: 1 2024-09-19T04:08:20.669 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T04:08:20.669 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T04:08:20.670 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-19T04:08:20.670 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T04:08:20.670 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T04:08:20.670 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.merge_operator: 2024-09-19T04:08:20.670 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.compaction_filter: None 2024-09-19T04:08:20.670 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T04:08:20.670 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T04:08:20.670 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T04:08:20.670 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T04:08:20.670 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557dbc39f320) 2024-09-19T04:08:20.670 INFO:journalctl@ceph.mon.c.smithi102.stdout: cache_index_and_filter_blocks: 1 2024-09-19T04:08:20.670 INFO:journalctl@ceph.mon.c.smithi102.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T04:08:20.671 INFO:journalctl@ceph.mon.c.smithi102.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T04:08:20.671 INFO:journalctl@ceph.mon.c.smithi102.stdout: pin_top_level_index_and_filter: 1 2024-09-19T04:08:20.671 INFO:journalctl@ceph.mon.c.smithi102.stdout: index_type: 0 2024-09-19T04:08:20.671 INFO:journalctl@ceph.mon.c.smithi102.stdout: data_block_index_type: 0 2024-09-19T04:08:20.671 INFO:journalctl@ceph.mon.c.smithi102.stdout: index_shortening: 1 2024-09-19T04:08:20.671 INFO:journalctl@ceph.mon.c.smithi102.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T04:08:20.671 INFO:journalctl@ceph.mon.c.smithi102.stdout: checksum: 4 2024-09-19T04:08:20.671 INFO:journalctl@ceph.mon.c.smithi102.stdout: no_block_cache: 0 2024-09-19T04:08:20.671 INFO:journalctl@ceph.mon.c.smithi102.stdout: block_cache: 0x557dbc3931f0 2024-09-19T04:08:20.672 INFO:journalctl@ceph.mon.c.smithi102.stdout: block_cache_name: BinnedLRUCache 2024-09-19T04:08:20.672 INFO:journalctl@ceph.mon.c.smithi102.stdout: block_cache_options: 2024-09-19T04:08:20.672 INFO:journalctl@ceph.mon.c.smithi102.stdout: capacity : 536870912 2024-09-19T04:08:20.672 INFO:journalctl@ceph.mon.c.smithi102.stdout: num_shard_bits : 4 2024-09-19T04:08:20.672 INFO:journalctl@ceph.mon.c.smithi102.stdout: strict_capacity_limit : 0 2024-09-19T04:08:20.672 INFO:journalctl@ceph.mon.c.smithi102.stdout: high_pri_pool_ratio: 0.000 2024-09-19T04:08:20.672 INFO:journalctl@ceph.mon.c.smithi102.stdout: block_cache_compressed: (nil) 2024-09-19T04:08:20.672 INFO:journalctl@ceph.mon.c.smithi102.stdout: persistent_cache: (nil) 2024-09-19T04:08:20.672 INFO:journalctl@ceph.mon.c.smithi102.stdout: block_size: 4096 2024-09-19T04:08:20.672 INFO:journalctl@ceph.mon.c.smithi102.stdout: block_size_deviation: 10 2024-09-19T04:08:20.672 INFO:journalctl@ceph.mon.c.smithi102.stdout: block_restart_interval: 16 2024-09-19T04:08:20.672 INFO:journalctl@ceph.mon.c.smithi102.stdout: index_block_restart_interval: 1 2024-09-19T04:08:20.673 INFO:journalctl@ceph.mon.c.smithi102.stdout: metadata_block_size: 4096 2024-09-19T04:08:20.673 INFO:journalctl@ceph.mon.c.smithi102.stdout: partition_filters: 0 2024-09-19T04:08:20.673 INFO:journalctl@ceph.mon.c.smithi102.stdout: use_delta_encoding: 1 2024-09-19T04:08:20.673 INFO:journalctl@ceph.mon.c.smithi102.stdout: filter_policy: bloomfilter 2024-09-19T04:08:20.673 INFO:journalctl@ceph.mon.c.smithi102.stdout: whole_key_filtering: 1 2024-09-19T04:08:20.673 INFO:journalctl@ceph.mon.c.smithi102.stdout: verify_compression: 0 2024-09-19T04:08:20.673 INFO:journalctl@ceph.mon.c.smithi102.stdout: read_amp_bytes_per_bit: 0 2024-09-19T04:08:20.673 INFO:journalctl@ceph.mon.c.smithi102.stdout: format_version: 5 2024-09-19T04:08:20.673 INFO:journalctl@ceph.mon.c.smithi102.stdout: enable_index_compression: 1 2024-09-19T04:08:20.673 INFO:journalctl@ceph.mon.c.smithi102.stdout: block_align: 0 2024-09-19T04:08:20.673 INFO:journalctl@ceph.mon.c.smithi102.stdout: max_auto_readahead_size: 262144 2024-09-19T04:08:20.673 INFO:journalctl@ceph.mon.c.smithi102.stdout: prepopulate_block_cache: 0 2024-09-19T04:08:20.674 INFO:journalctl@ceph.mon.c.smithi102.stdout: initial_auto_readahead_size: 8192 2024-09-19T04:08:20.674 INFO:journalctl@ceph.mon.c.smithi102.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T04:08:20.674 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T04:08:20.674 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T04:08:20.674 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.compression: NoCompression 2024-09-19T04:08:20.674 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T04:08:20.674 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T04:08:20.674 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T04:08:20.674 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.num_levels: 7 2024-09-19T04:08:20.674 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T04:08:20.674 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T04:08:20.674 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T04:08:20.674 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T04:08:20.674 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T04:08:20.675 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T04:08:20.675 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T04:08:20.675 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T04:08:20.675 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T04:08:20.675 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T04:08:20.675 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T04:08:20.675 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T04:08:20.675 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T04:08:20.675 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T04:08:20.675 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T04:08:20.676 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T04:08:20.676 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T04:08:20.676 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T04:08:20.676 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T04:08:20.676 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T04:08:20.676 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T04:08:20.676 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T04:08:20.676 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T04:08:20.676 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T04:08:20.676 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T04:08:20.676 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T04:08:20.676 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T04:08:20.676 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T04:08:20.677 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T04:08:20.677 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T04:08:20.677 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T04:08:20.677 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T04:08:20.677 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T04:08:20.677 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T04:08:20.677 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T04:08:20.677 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T04:08:20.677 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T04:08:20.677 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T04:08:20.677 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T04:08:20.677 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T04:08:20.678 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T04:08:20.678 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T04:08:20.678 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T04:08:20.678 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T04:08:20.678 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T04:08:20.678 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T04:08:20.678 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T04:08:20.678 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T04:08:20.678 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T04:08:20.678 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T04:08:20.678 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T04:08:20.678 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T04:08:20.678 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T04:08:20.679 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T04:08:20.679 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.inplace_update_support: 0 2024-09-19T04:08:20.679 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T04:08:20.679 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T04:08:20.679 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T04:08:20.679 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T04:08:20.679 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.bloom_locality: 0 2024-09-19T04:08:20.679 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.max_successive_merges: 0 2024-09-19T04:08:20.679 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T04:08:20.679 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T04:08:20.679 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T04:08:20.679 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T04:08:20.679 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.ttl: 2592000 2024-09-19T04:08:20.680 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T04:08:20.680 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T04:08:20.680 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T04:08:20.680 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.enable_blob_files: false 2024-09-19T04:08:20.680 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.min_blob_size: 0 2024-09-19T04:08:20.680 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T04:08:20.680 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T04:08:20.680 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T04:08:20.680 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T04:08:20.680 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T04:08:20.680 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T04:08:20.680 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T04:08:20.680 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T04:08:20.681 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T04:08:20.681 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-19T04:08:20.681 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 3930a20b-7a8e-46ea-8534-28ed41ff8f06 2024-09-19T04:08:20.681 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726718900259151, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-19T04:08:20.681 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-19T04:08:20.681 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726718900259729, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726718900, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "3930a20b-7a8e-46ea-8534-28ed41ff8f06", "db_session_id": "GFHRI09BWIT0WZENQ76U", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-19T04:08:20.681 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726718900259858, "job": 1, "event": "recovery_finished"} 2024-09-19T04:08:20.681 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-19T04:08:20.681 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T04:08:20.681 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x557dbc3c0e00 2024-09-19T04:08:20.681 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: DB pointer 0x557dbc4bc000 2024-09-19T04:08:20.681 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T04:08:20.681 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T04:08:20.682 INFO:journalctl@ceph.mon.c.smithi102.stdout: ** DB Stats ** 2024-09-19T04:08:20.682 INFO:journalctl@ceph.mon.c.smithi102.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T04:08:20.682 INFO:journalctl@ceph.mon.c.smithi102.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T04:08:20.682 INFO:journalctl@ceph.mon.c.smithi102.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T04:08:20.682 INFO:journalctl@ceph.mon.c.smithi102.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T04:08:20.682 INFO:journalctl@ceph.mon.c.smithi102.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T04:08:20.682 INFO:journalctl@ceph.mon.c.smithi102.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T04:08:20.682 INFO:journalctl@ceph.mon.c.smithi102.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T04:08:20.682 INFO:journalctl@ceph.mon.c.smithi102.stdout: 2024-09-19T04:08:20.682 INFO:journalctl@ceph.mon.c.smithi102.stdout: ** Compaction Stats [default] ** 2024-09-19T04:08:20.682 INFO:journalctl@ceph.mon.c.smithi102.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T04:08:20.682 INFO:journalctl@ceph.mon.c.smithi102.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T04:08:20.682 INFO:journalctl@ceph.mon.c.smithi102.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T04:08:20.683 INFO:journalctl@ceph.mon.c.smithi102.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T04:08:20.683 INFO:journalctl@ceph.mon.c.smithi102.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T04:08:20.683 INFO:journalctl@ceph.mon.c.smithi102.stdout: 2024-09-19T04:08:20.683 INFO:journalctl@ceph.mon.c.smithi102.stdout: ** Compaction Stats [default] ** 2024-09-19T04:08:20.683 INFO:journalctl@ceph.mon.c.smithi102.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T04:08:20.683 INFO:journalctl@ceph.mon.c.smithi102.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T04:08:20.683 INFO:journalctl@ceph.mon.c.smithi102.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T04:08:20.683 INFO:journalctl@ceph.mon.c.smithi102.stdout: 2024-09-19T04:08:20.683 INFO:journalctl@ceph.mon.c.smithi102.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T04:08:20.683 INFO:journalctl@ceph.mon.c.smithi102.stdout: 2024-09-19T04:08:20.683 INFO:journalctl@ceph.mon.c.smithi102.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T04:08:20.684 INFO:journalctl@ceph.mon.c.smithi102.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T04:08:20.684 INFO:journalctl@ceph.mon.c.smithi102.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T04:08:20.684 INFO:journalctl@ceph.mon.c.smithi102.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T04:08:20.684 INFO:journalctl@ceph.mon.c.smithi102.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T04:08:20.684 INFO:journalctl@ceph.mon.c.smithi102.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T04:08:20.684 INFO:journalctl@ceph.mon.c.smithi102.stdout: Cumulative compaction: 0.00 GB write, 0.43 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T04:08:20.684 INFO:journalctl@ceph.mon.c.smithi102.stdout: Interval compaction: 0.00 GB write, 0.43 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T04:08:20.684 INFO:journalctl@ceph.mon.c.smithi102.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T04:08:20.684 INFO:journalctl@ceph.mon.c.smithi102.stdout: Block cache BinnedLRUCache@0x557dbc3931f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-19T04:08:20.684 INFO:journalctl@ceph.mon.c.smithi102.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-19T04:08:20.684 INFO:journalctl@ceph.mon.c.smithi102.stdout: 2024-09-19T04:08:20.684 INFO:journalctl@ceph.mon.c.smithi102.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T04:08:20.685 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-19T04:08:20.685 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: using public_addr v2:172.21.15.102:0/0 -> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-19T04:08:20.685 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: starting mon.c rank -1 at public addrs [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] at bind addrs [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:08:20.685 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: mon.c@-1(???) e0 preinit fsid 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:08:20.685 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: mon.c@-1(synchronizing).mds e1 new map 2024-09-19T04:08:20.685 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-19T04:08:20.685 INFO:journalctl@ceph.mon.c.smithi102.stdout: e1 2024-09-19T04:08:20.685 INFO:journalctl@ceph.mon.c.smithi102.stdout: btime 2024-09-19T04:06:58:337221+0000 2024-09-19T04:08:20.685 INFO:journalctl@ceph.mon.c.smithi102.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T04:08:20.685 INFO:journalctl@ceph.mon.c.smithi102.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T04:08:20.685 INFO:journalctl@ceph.mon.c.smithi102.stdout: legacy client fscid: -1 2024-09-19T04:08:20.685 INFO:journalctl@ceph.mon.c.smithi102.stdout: 2024-09-19T04:08:20.685 INFO:journalctl@ceph.mon.c.smithi102.stdout: No filesystems configured 2024-09-19T04:08:20.686 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T04:08:20.686 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T04:08:20.686 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T04:08:20.686 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T04:08:20.686 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T04:08:20.686 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T04:08:20.686 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T04:08:20.686 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T04:08:20.686 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T04:08:20.686 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T04:08:20.686 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1621068215' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T04:08:20.686 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:08:20.686 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:20.686 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:20.687 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:20.687 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:20.687 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi102", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:08:20.687 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:20.687 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:08:20.687 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:20.687 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-19T04:08:20.687 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: Updating smithi102:/var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:08:20.687 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:08:20.687 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: Updating smithi102:/var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:08:20.687 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:20.688 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:20.688 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:20.688 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:20.688 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:20.688 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:20.688 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:20.688 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:20.688 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:08:20.688 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:08:20.688 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:20.688 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi007:172.21.15.7=a;smithi092:172.21.15.92=b;smithi102:172.21.15.102=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:08:20.688 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: Saving service mon spec with placement smithi007:172.21.15.7=a;smithi092:172.21.15.92=b;smithi102:172.21.15.102=c;count:3 2024-09-19T04:08:20.688 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T04:08:20.688 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: Reconfiguring daemon mon.a on smithi007 2024-09-19T04:08:20.689 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:20.689 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:20.689 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:20.689 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:08:20.689 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:20.689 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:08:20.689 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:20.689 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:08:20.689 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:20.689 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: Deploying daemon mon.c on smithi102 2024-09-19T04:08:20.689 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='client.? 172.21.15.102:0/1659383268' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:08:20.689 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:20.689 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: from='client.? 172.21.15.102:0/340096627' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:08:20.689 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 ceph-mon[35446]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T04:08:20.690 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 bash[35427]: 2d79ec02c4c4742191001c81ea7f205750efc057a29d01ce858c067cb74faf88 2024-09-19T04:08:20.690 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:20 smithi102 systemd[1]: Started Ceph mon.c for 77957c0a-763c-11ef-bceb-c7b262605968. 2024-09-19T04:08:20.738 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T04:08:20.738 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T04:08:20.987 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:08:25.612 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:25 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:08:25.613 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:25 smithi102 ceph-mon[35446]: mon.a calling monitor election 2024-09-19T04:08:25.613 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:25 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:08:25.613 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:25 smithi102 ceph-mon[35446]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:25.613 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:25 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:08:25.613 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:25 smithi102 ceph-mon[35446]: mon.c calling monitor election 2024-09-19T04:08:25.613 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:25 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:08:25.613 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:25 smithi102 ceph-mon[35446]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:25.613 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:25 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:08:25.613 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:25 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:08:25.613 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:25 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:08:25.613 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:25 smithi102 ceph-mon[35446]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T04:08:25.613 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:25 smithi102 ceph-mon[35446]: monmap epoch 2 2024-09-19T04:08:25.613 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:25 smithi102 ceph-mon[35446]: fsid 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:08:25.614 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:25 smithi102 ceph-mon[35446]: last_changed 2024-09-19T04:08:20.286034+0000 2024-09-19T04:08:25.614 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:25 smithi102 ceph-mon[35446]: created 2024-09-19T04:06:54.996586+0000 2024-09-19T04:08:25.614 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:25 smithi102 ceph-mon[35446]: min_mon_release 19 (squid) 2024-09-19T04:08:25.614 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:25 smithi102 ceph-mon[35446]: election_strategy: 1 2024-09-19T04:08:25.614 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:25 smithi102 ceph-mon[35446]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-19T04:08:25.614 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:25 smithi102 ceph-mon[35446]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.c 2024-09-19T04:08:25.614 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:25 smithi102 ceph-mon[35446]: fsmap 2024-09-19T04:08:25.614 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:25 smithi102 ceph-mon[35446]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:08:25.614 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:25 smithi102 ceph-mon[35446]: mgrmap e13: x(active, since 40s) 2024-09-19T04:08:25.614 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:25 smithi102 ceph-mon[35446]: overall HEALTH_OK 2024-09-19T04:08:25.614 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:25 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:25.614 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:25 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:25.614 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:25 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:25.615 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:25 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:08:25.615 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:25 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:25.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:25 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:08:25.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:25 smithi007 ceph-mon[31360]: mon.a calling monitor election 2024-09-19T04:08:25.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:25 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:08:25.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:25 smithi007 ceph-mon[31360]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:25.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:25 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:08:25.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:25 smithi007 ceph-mon[31360]: mon.c calling monitor election 2024-09-19T04:08:25.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:25 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:08:25.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:25 smithi007 ceph-mon[31360]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:25.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:25 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:08:25.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:25 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:08:25.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:25 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:08:25.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:25 smithi007 ceph-mon[31360]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T04:08:25.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:25 smithi007 ceph-mon[31360]: monmap epoch 2 2024-09-19T04:08:25.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:25 smithi007 ceph-mon[31360]: fsid 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:08:25.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:25 smithi007 ceph-mon[31360]: last_changed 2024-09-19T04:08:20.286034+0000 2024-09-19T04:08:25.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:25 smithi007 ceph-mon[31360]: created 2024-09-19T04:06:54.996586+0000 2024-09-19T04:08:25.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:25 smithi007 ceph-mon[31360]: min_mon_release 19 (squid) 2024-09-19T04:08:25.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:25 smithi007 ceph-mon[31360]: election_strategy: 1 2024-09-19T04:08:25.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:25 smithi007 ceph-mon[31360]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-19T04:08:25.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:25 smithi007 ceph-mon[31360]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.c 2024-09-19T04:08:25.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:25 smithi007 ceph-mon[31360]: fsmap 2024-09-19T04:08:25.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:25 smithi007 ceph-mon[31360]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:08:25.629 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:25 smithi007 ceph-mon[31360]: mgrmap e13: x(active, since 40s) 2024-09-19T04:08:25.629 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:25 smithi007 ceph-mon[31360]: overall HEALTH_OK 2024-09-19T04:08:25.629 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:25 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:25.629 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:25 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:25.629 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:25 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:25.629 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:25 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:08:25.629 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:25 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:25.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.865+0000 7fe54800c640 1 -- 172.21.15.102:0/3555438827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe52c005740 msgr2=0x7fe52c007bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:25.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.865+0000 7fe54800c640 1 --2- 172.21.15.102:0/3555438827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe52c005740 0x7fe52c007bd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe5401016c0 tx=0x7fe53402c490 comp rx=0 tx=0).stop 2024-09-19T04:08:25.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.865+0000 7fe54800c640 1 -- 172.21.15.102:0/3555438827 shutdown_connections 2024-09-19T04:08:25.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.865+0000 7fe54800c640 1 --2- 172.21.15.102:0/3555438827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe52c005740 0x7fe52c007bd0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:25.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.865+0000 7fe54800c640 1 -- 172.21.15.102:0/3555438827 >> 172.21.15.102:0/3555438827 conn(0x7fe5400fc280 msgr2=0x7fe5400fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:08:25.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.866+0000 7fe54800c640 1 -- 172.21.15.102:0/3555438827 shutdown_connections 2024-09-19T04:08:25.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.866+0000 7fe54800c640 1 -- 172.21.15.102:0/3555438827 wait complete. 2024-09-19T04:08:25.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.867+0000 7fe54800c640 1 Processor -- start 2024-09-19T04:08:25.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.867+0000 7fe54800c640 1 -- start start 2024-09-19T04:08:25.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.867+0000 7fe54800c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe52c005740 0x7fe5401994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:25.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.867+0000 7fe54800c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe540199a00 0x7fe54019dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:25.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.867+0000 7fe54800c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe5401075c0 con 0x7fe52c005740 2024-09-19T04:08:25.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.867+0000 7fe54800c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe540107440 con 0x7fe540199a00 2024-09-19T04:08:25.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.867+0000 7fe5455a7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe540199a00 0x7fe54019dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:25.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.867+0000 7fe5455a7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe540199a00 0x7fe54019dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55362/0 (socket says 172.21.15.102:55362) 2024-09-19T04:08:25.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.867+0000 7fe5455a7640 1 -- 172.21.15.102:0/709487473 learned_addr learned my addr 172.21.15.102:0/709487473 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T04:08:25.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.867+0000 7fe545da8640 1 --2- 172.21.15.102:0/709487473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe52c005740 0x7fe5401994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:25.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.867+0000 7fe5455a7640 1 -- 172.21.15.102:0/709487473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe540199a00 msgr2=0x7fe54019dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T04:08:25.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.867+0000 7fe5455a7640 1 -- 172.21.15.102:0/709487473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe540199a00 msgr2=0x7fe54019dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T04:08:25.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.867+0000 7fe5455a7640 1 --2- 172.21.15.102:0/709487473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe540199a00 0x7fe54019dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T04:08:25.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.868+0000 7fe5455a7640 1 --2- 172.21.15.102:0/709487473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe540199a00 0x7fe54019dd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T04:08:25.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.868+0000 7fe545da8640 1 -- 172.21.15.102:0/709487473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe540199a00 msgr2=0x7fe54019dd90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T04:08:25.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.868+0000 7fe545da8640 1 --2- 172.21.15.102:0/709487473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe540199a00 0x7fe54019dd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:25.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.868+0000 7fe545da8640 1 -- 172.21.15.102:0/709487473 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe54019a020 con 0x7fe52c005740 2024-09-19T04:08:25.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.868+0000 7fe545da8640 1 --2- 172.21.15.102:0/709487473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe52c005740 0x7fe5401994c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe534005f30 tx=0x7fe534033680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:08:25.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.868+0000 7fe532ffd640 1 -- 172.21.15.102:0/709487473 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fe534038040 con 0x7fe52c005740 2024-09-19T04:08:25.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.868+0000 7fe532ffd640 1 -- 172.21.15.102:0/709487473 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe534032e00 con 0x7fe52c005740 2024-09-19T04:08:25.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.868+0000 7fe54800c640 1 -- 172.21.15.102:0/709487473 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe54019e2d0 con 0x7fe52c005740 2024-09-19T04:08:25.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.868+0000 7fe532ffd640 1 -- 172.21.15.102:0/709487473 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fe534004a00 con 0x7fe52c005740 2024-09-19T04:08:25.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.868+0000 7fe54800c640 1 -- 172.21.15.102:0/709487473 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe54019e890 con 0x7fe52c005740 2024-09-19T04:08:25.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.869+0000 7fe532ffd640 1 -- 172.21.15.102:0/709487473 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fe534043020 con 0x7fe52c005740 2024-09-19T04:08:25.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.870+0000 7fe532ffd640 1 --2- 172.21.15.102:0/709487473 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe5240390e0 0x7fe52403b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:25.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.870+0000 7fe532ffd640 1 -- 172.21.15.102:0/709487473 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe53406e950 con 0x7fe52c005740 2024-09-19T04:08:25.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.870+0000 7fe54800c640 1 -- 172.21.15.102:0/709487473 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe540101cc0 con 0x7fe52c005740 2024-09-19T04:08:25.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.870+0000 7fe5455a7640 1 --2- 172.21.15.102:0/709487473 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe5240390e0 0x7fe52403b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:25.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.870+0000 7fe5455a7640 1 --2- 172.21.15.102:0/709487473 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe5240390e0 0x7fe52403b5a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe53c009100 tx=0x7fe53c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:08:25.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:25.875+0000 7fe532ffd640 1 -- 172.21.15.102:0/709487473 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe53404a020 con 0x7fe52c005740 2024-09-19T04:08:26.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:26.108+0000 7fe54800c640 1 -- 172.21.15.102:0/709487473 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fe54018ed50 con 0x7fe52c005740 2024-09-19T04:08:26.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:26.108+0000 7fe532ffd640 1 -- 172.21.15.102:0/709487473 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7fe53404cbc0 con 0x7fe52c005740 2024-09-19T04:08:26.110 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T04:08:26.110 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":2,"fsid":"77957c0a-763c-11ef-bceb-c7b262605968","modified":"2024-09-19T04:08:20.286034Z","created":"2024-09-19T04:06:54.996586Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:3300","nonce":0},{"type":"v1","addr":"172.21.15.102:6789","nonce":0}]},"addr":"172.21.15.102:6789/0","public_addr":"172.21.15.102:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T04:08:26.110 INFO:teuthology.orchestra.run.smithi102.stderr:dumped monmap epoch 2 2024-09-19T04:08:26.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:26.110+0000 7fe54800c640 1 -- 172.21.15.102:0/709487473 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe5240390e0 msgr2=0x7fe52403b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:26.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:26.110+0000 7fe54800c640 1 --2- 172.21.15.102:0/709487473 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe5240390e0 0x7fe52403b5a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe53c009100 tx=0x7fe53c008040 comp rx=0 tx=0).stop 2024-09-19T04:08:26.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:26.110+0000 7fe54800c640 1 -- 172.21.15.102:0/709487473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe52c005740 msgr2=0x7fe5401994c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:26.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:26.110+0000 7fe54800c640 1 --2- 172.21.15.102:0/709487473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe52c005740 0x7fe5401994c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe534005f30 tx=0x7fe534033680 comp rx=0 tx=0).stop 2024-09-19T04:08:26.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:26.110+0000 7fe54800c640 1 -- 172.21.15.102:0/709487473 shutdown_connections 2024-09-19T04:08:26.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:26.110+0000 7fe54800c640 1 --2- 172.21.15.102:0/709487473 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe5240390e0 0x7fe52403b5a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:26.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:26.110+0000 7fe54800c640 1 --2- 172.21.15.102:0/709487473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe540199a00 0x7fe54019dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:26.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:26.110+0000 7fe54800c640 1 --2- 172.21.15.102:0/709487473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe52c005740 0x7fe5401994c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:26.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:26.110+0000 7fe54800c640 1 -- 172.21.15.102:0/709487473 >> 172.21.15.102:0/709487473 conn(0x7fe5400fc280 msgr2=0x7fe5400fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:08:26.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:26.111+0000 7fe54800c640 1 -- 172.21.15.102:0/709487473 shutdown_connections 2024-09-19T04:08:26.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:26.111+0000 7fe54800c640 1 -- 172.21.15.102:0/709487473 wait complete. 2024-09-19T04:08:26.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:26 smithi102 ceph-mon[35446]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:26.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:26 smithi102 ceph-mon[35446]: Deploying daemon mon.b on smithi092 2024-09-19T04:08:26.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:26 smithi102 ceph-mon[35446]: from='client.? 172.21.15.102:0/709487473' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:08:26.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:26 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:08:26.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:26 smithi007 ceph-mon[31360]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:26.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:26 smithi007 ceph-mon[31360]: Deploying daemon mon.b on smithi092 2024-09-19T04:08:26.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:26 smithi007 ceph-mon[31360]: from='client.? 172.21.15.102:0/709487473' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:08:26.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:26 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:08:27.749 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T04:08:27.749 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T04:08:27.996 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:08:28.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:28 smithi102 ceph-mon[35446]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:28.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.425+0000 7f9fd8768640 1 -- 172.21.15.102:0/1217485271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fd0106630 msgr2=0x7f9fd0106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:28.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.425+0000 7f9fd8768640 1 --2- 172.21.15.102:0/1217485271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fd0106630 0x7f9fd0106a10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0009880 tx=0x7f9fc002a5d0 comp rx=0 tx=0).stop 2024-09-19T04:08:28.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.425+0000 7f9fd8768640 1 -- 172.21.15.102:0/1217485271 shutdown_connections 2024-09-19T04:08:28.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.425+0000 7f9fd8768640 1 --2- 172.21.15.102:0/1217485271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fd0106630 0x7f9fd0106a10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:28.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.425+0000 7f9fd8768640 1 -- 172.21.15.102:0/1217485271 >> 172.21.15.102:0/1217485271 conn(0x7f9fd00fc220 msgr2=0x7f9fd00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:08:28.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.425+0000 7f9fd8768640 1 -- 172.21.15.102:0/1217485271 shutdown_connections 2024-09-19T04:08:28.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.425+0000 7f9fd8768640 1 -- 172.21.15.102:0/1217485271 wait complete. 2024-09-19T04:08:28.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.425+0000 7f9fd8768640 1 Processor -- start 2024-09-19T04:08:28.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.425+0000 7f9fd8768640 1 -- start start 2024-09-19T04:08:28.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.426+0000 7f9fd8768640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fd0106630 0x7f9fd01973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:28.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.426+0000 7f9fd8768640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fd01978e0 0x7f9fd019bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:28.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.426+0000 7f9fd8768640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd010bd80 con 0x7f9fd01978e0 2024-09-19T04:08:28.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.426+0000 7f9fd8768640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd010bc00 con 0x7f9fd0106630 2024-09-19T04:08:28.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.426+0000 7f9fd6504640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fd0106630 0x7f9fd01973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:28.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.426+0000 7f9fd6504640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fd0106630 0x7f9fd01973a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55370/0 (socket says 172.21.15.102:55370) 2024-09-19T04:08:28.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.426+0000 7f9fd6504640 1 -- 172.21.15.102:0/4092264442 learned_addr learned my addr 172.21.15.102:0/4092264442 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T04:08:28.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.426+0000 7f9fd6504640 1 -- 172.21.15.102:0/4092264442 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fd0106630 msgr2=0x7f9fd01973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T04:08:28.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.426+0000 7f9fd6504640 1 -- 172.21.15.102:0/4092264442 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fd0106630 msgr2=0x7f9fd01973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T04:08:28.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.426+0000 7f9fd6504640 1 --2- 172.21.15.102:0/4092264442 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fd0106630 0x7f9fd01973a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T04:08:28.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.426+0000 7f9fd6504640 1 --2- 172.21.15.102:0/4092264442 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fd0106630 0x7f9fd01973a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T04:08:28.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.426+0000 7f9fd5d03640 1 --2- 172.21.15.102:0/4092264442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fd01978e0 0x7f9fd019bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:28.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.426+0000 7f9fd5d03640 1 -- 172.21.15.102:0/4092264442 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fd0106630 msgr2=0x7f9fd01973a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T04:08:28.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.426+0000 7f9fd5d03640 1 --2- 172.21.15.102:0/4092264442 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fd0106630 0x7f9fd01973a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:28.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.426+0000 7f9fd5d03640 1 -- 172.21.15.102:0/4092264442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd0197f00 con 0x7f9fd01978e0 2024-09-19T04:08:28.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.427+0000 7f9fd5d03640 1 --2- 172.21.15.102:0/4092264442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fd01978e0 0x7f9fd019bc70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc00b3d0 tx=0x7f9fcc00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:08:28.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.427+0000 7f9fc77fe640 1 -- 172.21.15.102:0/4092264442 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f9fcc011630 con 0x7f9fd01978e0 2024-09-19T04:08:28.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.427+0000 7f9fc77fe640 1 -- 172.21.15.102:0/4092264442 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fcc011cb0 con 0x7f9fd01978e0 2024-09-19T04:08:28.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.427+0000 7f9fc77fe640 1 -- 172.21.15.102:0/4092264442 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f9fcc010df0 con 0x7f9fd01978e0 2024-09-19T04:08:28.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.427+0000 7f9fd8768640 1 -- 172.21.15.102:0/4092264442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fd019c1b0 con 0x7f9fd01978e0 2024-09-19T04:08:28.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.427+0000 7f9fd8768640 1 -- 172.21.15.102:0/4092264442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fd019c770 con 0x7f9fd01978e0 2024-09-19T04:08:28.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.428+0000 7f9fd8768640 1 -- 172.21.15.102:0/4092264442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fd019ca80 con 0x7f9fd01978e0 2024-09-19T04:08:28.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.428+0000 7f9fc77fe640 1 -- 172.21.15.102:0/4092264442 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f9fcc018020 con 0x7f9fd01978e0 2024-09-19T04:08:28.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.428+0000 7f9fc77fe640 1 --2- 172.21.15.102:0/4092264442 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9fbc039040 0x7f9fbc03b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:28.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.428+0000 7f9fc77fe640 1 -- 172.21.15.102:0/4092264442 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9fcc04bf20 con 0x7f9fd01978e0 2024-09-19T04:08:28.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.428+0000 7f9fd6504640 1 --2- 172.21.15.102:0/4092264442 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9fbc039040 0x7f9fbc03b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:28.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.429+0000 7f9fd6504640 1 --2- 172.21.15.102:0/4092264442 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9fbc039040 0x7f9fbc03b500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00096c0 tx=0x7f9fc0005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:08:28.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.434+0000 7f9fc77fe640 1 -- 172.21.15.102:0/4092264442 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9fcc01f020 con 0x7f9fd01978e0 2024-09-19T04:08:28.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:28 smithi007 ceph-mon[31360]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:28.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.662+0000 7f9fd8768640 1 -- 172.21.15.102:0/4092264442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f9fd0198700 con 0x7f9fd01978e0 2024-09-19T04:08:28.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.662+0000 7f9fc77fe640 1 -- 172.21.15.102:0/4092264442 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7f9fcc0172c0 con 0x7f9fd01978e0 2024-09-19T04:08:28.664 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T04:08:28.664 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":2,"fsid":"77957c0a-763c-11ef-bceb-c7b262605968","modified":"2024-09-19T04:08:20.286034Z","created":"2024-09-19T04:06:54.996586Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:3300","nonce":0},{"type":"v1","addr":"172.21.15.102:6789","nonce":0}]},"addr":"172.21.15.102:6789/0","public_addr":"172.21.15.102:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T04:08:28.664 INFO:teuthology.orchestra.run.smithi102.stderr:dumped monmap epoch 2 2024-09-19T04:08:28.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.664+0000 7f9fd8768640 1 -- 172.21.15.102:0/4092264442 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9fbc039040 msgr2=0x7f9fbc03b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:28.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.664+0000 7f9fd8768640 1 --2- 172.21.15.102:0/4092264442 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9fbc039040 0x7f9fbc03b500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00096c0 tx=0x7f9fc0005a40 comp rx=0 tx=0).stop 2024-09-19T04:08:28.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.664+0000 7f9fd8768640 1 -- 172.21.15.102:0/4092264442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fd01978e0 msgr2=0x7f9fd019bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:28.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.664+0000 7f9fd8768640 1 --2- 172.21.15.102:0/4092264442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fd01978e0 0x7f9fd019bc70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc00b3d0 tx=0x7f9fcc00b890 comp rx=0 tx=0).stop 2024-09-19T04:08:28.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.664+0000 7f9fd8768640 1 -- 172.21.15.102:0/4092264442 shutdown_connections 2024-09-19T04:08:28.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.664+0000 7f9fd8768640 1 --2- 172.21.15.102:0/4092264442 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9fbc039040 0x7f9fbc03b500 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:28.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.664+0000 7f9fd8768640 1 --2- 172.21.15.102:0/4092264442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fd01978e0 0x7f9fd019bc70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:28.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.664+0000 7f9fd8768640 1 --2- 172.21.15.102:0/4092264442 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fd0106630 0x7f9fd01973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:28.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.664+0000 7f9fd8768640 1 -- 172.21.15.102:0/4092264442 >> 172.21.15.102:0/4092264442 conn(0x7f9fd00fc220 msgr2=0x7f9fd00fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:08:28.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.664+0000 7f9fd8768640 1 -- 172.21.15.102:0/4092264442 shutdown_connections 2024-09-19T04:08:28.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:28.664+0000 7f9fd8768640 1 -- 172.21.15.102:0/4092264442 wait complete. 2024-09-19T04:08:28.841 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: mon.b@-1(synchronizing).mds e1 new map 2024-09-19T04:08:28.841 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-19T04:08:28.841 INFO:journalctl@ceph.mon.b.smithi092.stdout: e1 2024-09-19T04:08:28.841 INFO:journalctl@ceph.mon.b.smithi092.stdout: btime 2024-09-19T04:06:58:337221+0000 2024-09-19T04:08:28.841 INFO:journalctl@ceph.mon.b.smithi092.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T04:08:28.841 INFO:journalctl@ceph.mon.b.smithi092.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T04:08:28.842 INFO:journalctl@ceph.mon.b.smithi092.stdout: legacy client fscid: -1 2024-09-19T04:08:28.842 INFO:journalctl@ceph.mon.b.smithi092.stdout: 2024-09-19T04:08:28.842 INFO:journalctl@ceph.mon.b.smithi092.stdout: No filesystems configured 2024-09-19T04:08:28.842 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T04:08:29.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T04:08:29.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T04:08:29.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T04:08:29.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T04:08:29.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T04:08:29.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T04:08:29.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T04:08:29.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T04:08:29.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T04:08:29.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1621068215' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T04:08:29.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:08:29.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:29.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:29.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:29.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:29.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi102", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:08:29.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:29.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:08:29.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:29.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-19T04:08:29.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: Updating smithi102:/var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:08:29.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:08:29.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: Updating smithi102:/var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:08:29.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:29.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:29.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:29.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:29.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:29.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:29.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:29.300 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:29.300 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:08:29.300 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:08:29.300 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:29.300 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi007:172.21.15.7=a;smithi092:172.21.15.92=b;smithi102:172.21.15.102=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:08:29.300 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: Saving service mon spec with placement smithi007:172.21.15.7=a;smithi092:172.21.15.92=b;smithi102:172.21.15.102=c;count:3 2024-09-19T04:08:29.300 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T04:08:29.300 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: Reconfiguring daemon mon.a on smithi007 2024-09-19T04:08:29.300 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:29.300 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:29.300 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:29.300 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:08:29.300 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:29.301 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:08:29.301 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:29.301 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:08:29.301 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:29.301 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: Deploying daemon mon.c on smithi102 2024-09-19T04:08:29.301 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='client.? 172.21.15.102:0/1659383268' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:08:29.301 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:29.301 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='client.? 172.21.15.102:0/340096627' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:08:29.302 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:08:29.302 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: mon.a calling monitor election 2024-09-19T04:08:29.302 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:08:29.302 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:29.302 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:08:29.302 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: mon.c calling monitor election 2024-09-19T04:08:29.302 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:08:29.302 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:29.302 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:08:29.302 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:08:29.302 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:08:29.302 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T04:08:29.302 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: monmap epoch 2 2024-09-19T04:08:29.303 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: fsid 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:08:29.303 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: last_changed 2024-09-19T04:08:20.286034+0000 2024-09-19T04:08:29.303 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: created 2024-09-19T04:06:54.996586+0000 2024-09-19T04:08:29.303 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: min_mon_release 19 (squid) 2024-09-19T04:08:29.303 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: election_strategy: 1 2024-09-19T04:08:29.303 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-19T04:08:29.303 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.c 2024-09-19T04:08:29.304 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: fsmap 2024-09-19T04:08:29.304 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:08:29.304 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: mgrmap e13: x(active, since 40s) 2024-09-19T04:08:29.304 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: overall HEALTH_OK 2024-09-19T04:08:29.304 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:29.304 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:29.304 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:29.304 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:08:29.304 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:29.304 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:29.304 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: Deploying daemon mon.b on smithi092 2024-09-19T04:08:29.304 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='client.? 172.21.15.102:0/709487473' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:08:29.304 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:08:29.305 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:29.305 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 ceph-mon[34940]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T04:08:29.305 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 bash[34921]: 26442b8e039cca94cf244a3e7462461c7295801f895feae68bde8bc9c5b5597c 2024-09-19T04:08:29.305 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:28 smithi092 systemd[1]: Started Ceph mon.b for 77957c0a-763c-11ef-bceb-c7b262605968. 2024-09-19T04:08:30.245 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T04:08:30.248 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T04:08:30.506 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:08:33.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.934+0000 7fd63359e640 1 -- 172.21.15.102:0/2090162050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd620003530 msgr2=0x7fd6200059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:33.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.934+0000 7fd63359e640 1 --2- 172.21.15.102:0/2090162050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd620003530 0x7fd6200059c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd634101850 tx=0x7fd62402bce0 comp rx=0 tx=0).stop 2024-09-19T04:08:33.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.934+0000 7fd63359e640 1 -- 172.21.15.102:0/2090162050 shutdown_connections 2024-09-19T04:08:33.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.934+0000 7fd63359e640 1 --2- 172.21.15.102:0/2090162050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd620003530 0x7fd6200059c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:33.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.934+0000 7fd63359e640 1 -- 172.21.15.102:0/2090162050 >> 172.21.15.102:0/2090162050 conn(0x7fd6340fc0a0 msgr2=0x7fd6340fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:08:33.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.934+0000 7fd63359e640 1 -- 172.21.15.102:0/2090162050 shutdown_connections 2024-09-19T04:08:33.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.934+0000 7fd63359e640 1 -- 172.21.15.102:0/2090162050 wait complete. 2024-09-19T04:08:33.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.935+0000 7fd63359e640 1 Processor -- start 2024-09-19T04:08:33.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.935+0000 7fd63359e640 1 -- start start 2024-09-19T04:08:33.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.935+0000 7fd63359e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd620003530 0x7fd634197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:33.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.935+0000 7fd63359e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6341977a0 0x7fd63419ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:33.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.935+0000 7fd63359e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd63419bfd0 0x7fd63419c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:33.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.935+0000 7fd63359e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd634108480 con 0x7fd6341977a0 2024-09-19T04:08:33.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.935+0000 7fd63359e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd634108300 con 0x7fd63419bfd0 2024-09-19T04:08:33.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.935+0000 7fd63359e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd634108600 con 0x7fd620003530 2024-09-19T04:08:33.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.935+0000 7fd63259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd620003530 0x7fd634197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:33.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.935+0000 7fd63259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd620003530 0x7fd634197260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51924/0 (socket says 172.21.15.102:51924) 2024-09-19T04:08:33.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.935+0000 7fd63259c640 1 -- 172.21.15.102:0/2020446888 learned_addr learned my addr 172.21.15.102:0/2020446888 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T04:08:33.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.936+0000 7fd631d9b640 1 --2- 172.21.15.102:0/2020446888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6341977a0 0x7fd63419ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:33.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.936+0000 7fd632d9d640 1 --2- 172.21.15.102:0/2020446888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd63419bfd0 0x7fd63419c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:33.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.936+0000 7fd63259c640 1 -- 172.21.15.102:0/2020446888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd620003530 msgr2=0x7fd634197260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T04:08:33.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.936+0000 7fd63259c640 1 -- 172.21.15.102:0/2020446888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd620003530 msgr2=0x7fd634197260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T04:08:33.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.936+0000 7fd63259c640 1 --2- 172.21.15.102:0/2020446888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd620003530 0x7fd634197260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T04:08:33.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.936+0000 7fd63259c640 1 --2- 172.21.15.102:0/2020446888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd620003530 0x7fd634197260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T04:08:33.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.936+0000 7fd632d9d640 1 -- 172.21.15.102:0/2020446888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd63419bfd0 msgr2=0x7fd63419c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-19T04:08:33.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.936+0000 7fd632d9d640 1 -- 172.21.15.102:0/2020446888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd63419bfd0 msgr2=0x7fd63419c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T04:08:33.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.936+0000 7fd632d9d640 1 --2- 172.21.15.102:0/2020446888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd63419bfd0 0x7fd63419c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T04:08:33.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.936+0000 7fd632d9d640 1 --2- 172.21.15.102:0/2020446888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd63419bfd0 0x7fd63419c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T04:08:33.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.936+0000 7fd631d9b640 1 -- 172.21.15.102:0/2020446888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd620003530 msgr2=0x7fd634197260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T04:08:33.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.936+0000 7fd631d9b640 1 --2- 172.21.15.102:0/2020446888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd620003530 0x7fd634197260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:33.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.936+0000 7fd631d9b640 1 -- 172.21.15.102:0/2020446888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd63419bfd0 msgr2=0x7fd63419c480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T04:08:33.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.936+0000 7fd631d9b640 1 --2- 172.21.15.102:0/2020446888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd63419bfd0 0x7fd63419c480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:33.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.936+0000 7fd631d9b640 1 -- 172.21.15.102:0/2020446888 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6341a3d40 con 0x7fd6341977a0 2024-09-19T04:08:33.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.936+0000 7fd631d9b640 1 --2- 172.21.15.102:0/2020446888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6341977a0 0x7fd63419ba90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd61c00b450 tx=0x7fd61c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:08:33.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.936+0000 7fd62b7fe640 1 -- 172.21.15.102:0/2020446888 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd61c004230 con 0x7fd6341977a0 2024-09-19T04:08:33.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.937+0000 7fd62b7fe640 1 -- 172.21.15.102:0/2020446888 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd61c0043d0 con 0x7fd6341977a0 2024-09-19T04:08:33.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.937+0000 7fd63359e640 1 -- 172.21.15.102:0/2020446888 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6341a3f70 con 0x7fd6341977a0 2024-09-19T04:08:33.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.937+0000 7fd62b7fe640 1 -- 172.21.15.102:0/2020446888 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd61c003cb0 con 0x7fd6341977a0 2024-09-19T04:08:33.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.937+0000 7fd63359e640 1 -- 172.21.15.102:0/2020446888 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6341a4470 con 0x7fd6341977a0 2024-09-19T04:08:33.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.937+0000 7fd62b7fe640 1 -- 172.21.15.102:0/2020446888 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fd61c00f050 con 0x7fd6341977a0 2024-09-19T04:08:33.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.938+0000 7fd62b7fe640 1 --2- 172.21.15.102:0/2020446888 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd614039730 0x7fd61403bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:33.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.938+0000 7fd62b7fe640 1 -- 172.21.15.102:0/2020446888 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd61c04c1d0 con 0x7fd6341977a0 2024-09-19T04:08:33.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.938+0000 7fd63359e640 1 -- 172.21.15.102:0/2020446888 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd634109630 con 0x7fd6341977a0 2024-09-19T04:08:33.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.938+0000 7fd63259c640 1 --2- 172.21.15.102:0/2020446888 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd614039730 0x7fd61403bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:33.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.939+0000 7fd63259c640 1 --2- 172.21.15.102:0/2020446888 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd614039730 0x7fd61403bbf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd624005940 tx=0x7fd6240058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:08:33.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:33.946+0000 7fd62b7fe640 1 -- 172.21.15.102:0/2020446888 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd61c00d040 con 0x7fd6341977a0 2024-09-19T04:08:34.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: mon.c calling monitor election 2024-09-19T04:08:34.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:08:34.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: mon.a calling monitor election 2024-09-19T04:08:34.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:08:34.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:08:34.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:34.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:08:34.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:08:34.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:34.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:08:34.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:08:34.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:08:34.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T04:08:34.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: monmap epoch 3 2024-09-19T04:08:34.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: fsid 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:08:34.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: last_changed 2024-09-19T04:08:28.846561+0000 2024-09-19T04:08:34.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: created 2024-09-19T04:06:54.996586+0000 2024-09-19T04:08:34.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: min_mon_release 19 (squid) 2024-09-19T04:08:34.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: election_strategy: 1 2024-09-19T04:08:34.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-19T04:08:34.161 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.c 2024-09-19T04:08:34.161 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: 2: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.b 2024-09-19T04:08:34.161 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: fsmap 2024-09-19T04:08:34.161 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:08:34.161 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: mgrmap e13: x(active, since 48s) 2024-09-19T04:08:34.161 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: overall HEALTH_OK 2024-09-19T04:08:34.161 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:34.161 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:34.161 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:34.161 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:33 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:34.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:34.190+0000 7fd63359e640 1 -- 172.21.15.102:0/2020446888 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fd63402d7c0 con 0x7fd6341977a0 2024-09-19T04:08:34.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:34.190+0000 7fd62b7fe640 1 -- 172.21.15.102:0/2020446888 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1275 (secure 0 0 0) 0x7fd61c011d00 con 0x7fd6341977a0 2024-09-19T04:08:34.192 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T04:08:34.192 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":3,"fsid":"77957c0a-763c-11ef-bceb-c7b262605968","modified":"2024-09-19T04:08:28.846561Z","created":"2024-09-19T04:06:54.996586Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:3300","nonce":0},{"type":"v1","addr":"172.21.15.102:6789","nonce":0}]},"addr":"172.21.15.102:6789/0","public_addr":"172.21.15.102:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:3300","nonce":0},{"type":"v1","addr":"172.21.15.92:6789","nonce":0}]},"addr":"172.21.15.92:6789/0","public_addr":"172.21.15.92:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T04:08:34.192 INFO:teuthology.orchestra.run.smithi102.stderr:dumped monmap epoch 3 2024-09-19T04:08:34.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:34.192+0000 7fd63359e640 1 -- 172.21.15.102:0/2020446888 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd614039730 msgr2=0x7fd61403bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:34.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:34.192+0000 7fd63359e640 1 --2- 172.21.15.102:0/2020446888 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd614039730 0x7fd61403bbf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd624005940 tx=0x7fd6240058b0 comp rx=0 tx=0).stop 2024-09-19T04:08:34.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:34.192+0000 7fd63359e640 1 -- 172.21.15.102:0/2020446888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6341977a0 msgr2=0x7fd63419ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:34.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:34.192+0000 7fd63359e640 1 --2- 172.21.15.102:0/2020446888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6341977a0 0x7fd63419ba90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd61c00b450 tx=0x7fd61c00b910 comp rx=0 tx=0).stop 2024-09-19T04:08:34.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:34.192+0000 7fd63359e640 1 -- 172.21.15.102:0/2020446888 shutdown_connections 2024-09-19T04:08:34.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:34.192+0000 7fd63359e640 1 --2- 172.21.15.102:0/2020446888 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd614039730 0x7fd61403bbf0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:34.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:34.192+0000 7fd63359e640 1 --2- 172.21.15.102:0/2020446888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd63419bfd0 0x7fd63419c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:34.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:34.192+0000 7fd63359e640 1 --2- 172.21.15.102:0/2020446888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd6341977a0 0x7fd63419ba90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:34.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:34.192+0000 7fd63359e640 1 --2- 172.21.15.102:0/2020446888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd620003530 0x7fd634197260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:34.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:34.192+0000 7fd63359e640 1 -- 172.21.15.102:0/2020446888 >> 172.21.15.102:0/2020446888 conn(0x7fd6340fc0a0 msgr2=0x7fd63406ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:08:34.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:34.192+0000 7fd63359e640 1 -- 172.21.15.102:0/2020446888 shutdown_connections 2024-09-19T04:08:34.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:34.192+0000 7fd63359e640 1 -- 172.21.15.102:0/2020446888 wait complete. 2024-09-19T04:08:34.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: mon.c calling monitor election 2024-09-19T04:08:34.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:08:34.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: mon.a calling monitor election 2024-09-19T04:08:34.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:08:34.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:08:34.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:34.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:08:34.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:08:34.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:34.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:08:34.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:08:34.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:08:34.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T04:08:34.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: monmap epoch 3 2024-09-19T04:08:34.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: fsid 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:08:34.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: last_changed 2024-09-19T04:08:28.846561+0000 2024-09-19T04:08:34.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: created 2024-09-19T04:06:54.996586+0000 2024-09-19T04:08:34.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: min_mon_release 19 (squid) 2024-09-19T04:08:34.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: election_strategy: 1 2024-09-19T04:08:34.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-19T04:08:34.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.c 2024-09-19T04:08:34.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: 2: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.b 2024-09-19T04:08:34.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: fsmap 2024-09-19T04:08:34.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:08:34.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: mgrmap e13: x(active, since 48s) 2024-09-19T04:08:34.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: overall HEALTH_OK 2024-09-19T04:08:34.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:34.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:34.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:34.380 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:33 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:34.768 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T04:08:34.768 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T04:08:35.037 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:08:35.094 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:34 smithi102 ceph-mon[35446]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:35.094 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:34 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:08:35.095 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:34 smithi102 ceph-mon[35446]: from='client.? 172.21.15.102:0/2020446888' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:08:35.095 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:34 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:08:35.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:34 smithi007 ceph-mon[31360]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:35.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:34 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:08:35.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:34 smithi007 ceph-mon[31360]: from='client.? 172.21.15.102:0/2020446888' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:08:35.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:34 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:08:35.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.473+0000 7f33f8b47640 1 -- 172.21.15.7:0/2255390497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f4106630 msgr2=0x7f33f4106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:35.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.473+0000 7f33f8b47640 1 --2- 172.21.15.7:0/2255390497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f4106630 0x7f33f4106a10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f33e4009880 tx=0x7f33e402a5d0 comp rx=0 tx=0).stop 2024-09-19T04:08:35.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.474+0000 7f33f8b47640 1 -- 172.21.15.7:0/2255390497 shutdown_connections 2024-09-19T04:08:35.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.474+0000 7f33f8b47640 1 --2- 172.21.15.7:0/2255390497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f4106630 0x7f33f4106a10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:35.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.474+0000 7f33f8b47640 1 -- 172.21.15.7:0/2255390497 >> 172.21.15.7:0/2255390497 conn(0x7f33f40fc220 msgr2=0x7f33f40fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:08:35.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.474+0000 7f33f8b47640 1 -- 172.21.15.7:0/2255390497 shutdown_connections 2024-09-19T04:08:35.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.474+0000 7f33f8b47640 1 -- 172.21.15.7:0/2255390497 wait complete. 2024-09-19T04:08:35.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.475+0000 7f33f8b47640 1 Processor -- start 2024-09-19T04:08:35.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.475+0000 7f33f8b47640 1 -- start start 2024-09-19T04:08:35.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.475+0000 7f33f8b47640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f4106630 0x7f33f4198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:35.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.475+0000 7f33f8b47640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33f41988b0 0x7f33f4198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:35.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.475+0000 7f33f8b47640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33f41a13e0 0x7f33f41a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:35.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.475+0000 7f33f8b47640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f33f410ac60 con 0x7f33f4106630 2024-09-19T04:08:35.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.475+0000 7f33f8b47640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f33f410aae0 con 0x7f33f41988b0 2024-09-19T04:08:35.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.475+0000 7f33f8b47640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f33f410ade0 con 0x7f33f41a13e0 2024-09-19T04:08:35.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.475+0000 7f33f259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f4106630 0x7f33f4198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:35.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.475+0000 7f33f259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f4106630 0x7f33f4198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48286/0 (socket says 172.21.15.7:48286) 2024-09-19T04:08:35.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.475+0000 7f33f259c640 1 -- 172.21.15.7:0/1776444196 learned_addr learned my addr 172.21.15.7:0/1776444196 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:08:35.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.475+0000 7f33f1d9b640 1 --2- 172.21.15.7:0/1776444196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33f41988b0 0x7f33f4198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:35.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.475+0000 7f33f2d9d640 1 --2- 172.21.15.7:0/1776444196 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33f41a13e0 0x7f33f41a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:35.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.475+0000 7f33f259c640 1 -- 172.21.15.7:0/1776444196 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33f41a13e0 msgr2=0x7f33f41a37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:35.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.475+0000 7f33f259c640 1 --2- 172.21.15.7:0/1776444196 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33f41a13e0 0x7f33f41a37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:35.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.475+0000 7f33f259c640 1 -- 172.21.15.7:0/1776444196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33f41988b0 msgr2=0x7f33f4198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:35.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.475+0000 7f33f259c640 1 --2- 172.21.15.7:0/1776444196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33f41988b0 0x7f33f4198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:35.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.475+0000 7f33f259c640 1 -- 172.21.15.7:0/1776444196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f41a3f70 con 0x7f33f4106630 2024-09-19T04:08:35.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.475+0000 7f33f2d9d640 1 --2- 172.21.15.7:0/1776444196 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33f41a13e0 0x7f33f41a37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:08:35.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.476+0000 7f33f259c640 1 --2- 172.21.15.7:0/1776444196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f4106630 0x7f33f4198370 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f33e4006010 tx=0x7f33e4003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:08:35.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.476+0000 7f33e37fe640 1 -- 172.21.15.7:0/1776444196 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e403f070 con 0x7f33f4106630 2024-09-19T04:08:35.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.476+0000 7f33e37fe640 1 -- 172.21.15.7:0/1776444196 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33e403b460 con 0x7f33f4106630 2024-09-19T04:08:35.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.476+0000 7f33f8b47640 1 -- 172.21.15.7:0/1776444196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33f41a4200 con 0x7f33f4106630 2024-09-19T04:08:35.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.476+0000 7f33e37fe640 1 -- 172.21.15.7:0/1776444196 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e4035030 con 0x7f33f4106630 2024-09-19T04:08:35.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.476+0000 7f33f8b47640 1 -- 172.21.15.7:0/1776444196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33f41a46e0 con 0x7f33f4106630 2024-09-19T04:08:35.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.477+0000 7f33e37fe640 1 -- 172.21.15.7:0/1776444196 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f33e4042070 con 0x7f33f4106630 2024-09-19T04:08:35.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.477+0000 7f33f8b47640 1 -- 172.21.15.7:0/1776444196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33f4106a90 con 0x7f33f4106630 2024-09-19T04:08:35.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.477+0000 7f33e37fe640 1 --2- 172.21.15.7:0/1776444196 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f33dc039730 0x7f33dc03bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:35.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.477+0000 7f33e37fe640 1 -- 172.21.15.7:0/1776444196 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f33e406cef0 con 0x7f33f4106630 2024-09-19T04:08:35.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.477+0000 7f33f1d9b640 1 --2- 172.21.15.7:0/1776444196 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f33dc039730 0x7f33dc03bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:35.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.478+0000 7f33f1d9b640 1 --2- 172.21.15.7:0/1776444196 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f33dc039730 0x7f33dc03bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f33e8009950 tx=0x7f33e8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:08:35.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.482+0000 7f33e37fe640 1 -- 172.21.15.7:0/1776444196 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f33e4039510 con 0x7f33f4106630 2024-09-19T04:08:35.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.663+0000 7f33f8b47640 1 -- 172.21.15.7:0/1776444196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f33f41a4a00 con 0x7f33f4106630 2024-09-19T04:08:35.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.664+0000 7f33e37fe640 1 -- 172.21.15.7:0/1776444196 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+271 (secure 0 0 0) 0x7f33e4039770 con 0x7f33f4106630 2024-09-19T04:08:35.665 INFO:teuthology.orchestra.run.smithi007.stdout:# minimal ceph.conf for 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:08:35.666 INFO:teuthology.orchestra.run.smithi007.stdout:[global] 2024-09-19T04:08:35.666 INFO:teuthology.orchestra.run.smithi007.stdout: fsid = 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:08:35.666 INFO:teuthology.orchestra.run.smithi007.stdout: mon_host = [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] 2024-09-19T04:08:35.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.668+0000 7f33f8b47640 1 -- 172.21.15.7:0/1776444196 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f33dc039730 msgr2=0x7f33dc03bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:35.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.668+0000 7f33f8b47640 1 --2- 172.21.15.7:0/1776444196 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f33dc039730 0x7f33dc03bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f33e8009950 tx=0x7f33e8008040 comp rx=0 tx=0).stop 2024-09-19T04:08:35.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.668+0000 7f33f8b47640 1 -- 172.21.15.7:0/1776444196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f4106630 msgr2=0x7f33f4198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:35.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.668+0000 7f33f8b47640 1 --2- 172.21.15.7:0/1776444196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f4106630 0x7f33f4198370 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f33e4006010 tx=0x7f33e4003c00 comp rx=0 tx=0).stop 2024-09-19T04:08:35.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.668+0000 7f33f8b47640 1 -- 172.21.15.7:0/1776444196 shutdown_connections 2024-09-19T04:08:35.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.668+0000 7f33f8b47640 1 --2- 172.21.15.7:0/1776444196 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f33dc039730 0x7f33dc03bbf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:35.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.668+0000 7f33f8b47640 1 --2- 172.21.15.7:0/1776444196 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33f41a13e0 0x7f33f41a37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:35.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.668+0000 7f33f8b47640 1 --2- 172.21.15.7:0/1776444196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33f41988b0 0x7f33f4198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:35.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.668+0000 7f33f8b47640 1 --2- 172.21.15.7:0/1776444196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33f4106630 0x7f33f4198370 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:35.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.668+0000 7f33f8b47640 1 -- 172.21.15.7:0/1776444196 >> 172.21.15.7:0/1776444196 conn(0x7f33f40fc220 msgr2=0x7f33f40fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:08:35.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.668+0000 7f33f8b47640 1 -- 172.21.15.7:0/1776444196 shutdown_connections 2024-09-19T04:08:35.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:35.668+0000 7f33f8b47640 1 -- 172.21.15.7:0/1776444196 wait complete. 2024-09-19T04:08:36.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: mon.c calling monitor election 2024-09-19T04:08:36.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:08:36.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: mon.a calling monitor election 2024-09-19T04:08:36.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:08:36.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:08:36.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:36.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:08:36.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:08:36.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:36.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:08:36.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:08:36.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:08:36.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T04:08:36.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: monmap epoch 3 2024-09-19T04:08:36.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: fsid 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:08:36.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: last_changed 2024-09-19T04:08:28.846561+0000 2024-09-19T04:08:36.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: created 2024-09-19T04:06:54.996586+0000 2024-09-19T04:08:36.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: min_mon_release 19 (squid) 2024-09-19T04:08:36.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: election_strategy: 1 2024-09-19T04:08:36.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-19T04:08:36.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.c 2024-09-19T04:08:36.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: 2: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.b 2024-09-19T04:08:36.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: fsmap 2024-09-19T04:08:36.300 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:08:36.300 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: mgrmap e13: x(active, since 48s) 2024-09-19T04:08:36.300 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: overall HEALTH_OK 2024-09-19T04:08:36.300 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:36.300 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:36.300 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:36.300 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:36.300 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:36.300 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:08:36.300 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: from='client.? 172.21.15.102:0/2020446888' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:08:36.300 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:35 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:08:36.343 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T04:08:36.344 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T04:08:36.344 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T04:08:36.371 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T04:08:36.371 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:08:36.437 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-19T04:08:36.438 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T04:08:36.465 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-19T04:08:36.465 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:08:36.530 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T04:08:36.530 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T04:08:36.557 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T04:08:36.557 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:08:36.623 INFO:tasks.cephadm:Adding mgr.x on smithi007 2024-09-19T04:08:36.623 INFO:tasks.cephadm:Adding mgr.y on smithi092 2024-09-19T04:08:36.623 INFO:tasks.cephadm:Adding mgr.z on smithi102 2024-09-19T04:08:36.623 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi007=x;smithi092=y;smithi102=z' 2024-09-19T04:08:36.781 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: mon.b calling monitor election 2024-09-19T04:08:36.781 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:36.781 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: Updating smithi007:/etc/ceph/ceph.conf 2024-09-19T04:08:36.781 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-19T04:08:36.781 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-19T04:08:36.782 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: Updating smithi102:/var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:08:36.782 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: Updating smithi092:/var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:08:36.782 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: Updating smithi007:/var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:08:36.782 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: mon.b calling monitor election 2024-09-19T04:08:36.782 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: mon.c calling monitor election 2024-09-19T04:08:36.782 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: mon.a calling monitor election 2024-09-19T04:08:36.782 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T04:08:36.782 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: monmap epoch 3 2024-09-19T04:08:36.782 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: fsid 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:08:36.782 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: last_changed 2024-09-19T04:08:28.846561+0000 2024-09-19T04:08:36.782 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: created 2024-09-19T04:06:54.996586+0000 2024-09-19T04:08:36.782 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: min_mon_release 19 (squid) 2024-09-19T04:08:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: election_strategy: 1 2024-09-19T04:08:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-19T04:08:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.c 2024-09-19T04:08:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: 2: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.b 2024-09-19T04:08:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: fsmap 2024-09-19T04:08:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:08:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: mgrmap e13: x(active, since 50s) 2024-09-19T04:08:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: overall HEALTH_OK 2024-09-19T04:08:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:36.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:08:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:08:36.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:36 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:36.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: mon.b calling monitor election 2024-09-19T04:08:36.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:36.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: Updating smithi007:/etc/ceph/ceph.conf 2024-09-19T04:08:36.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-19T04:08:36.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-19T04:08:36.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: Updating smithi102:/var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:08:36.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: Updating smithi092:/var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:08:36.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: Updating smithi007:/var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:08:36.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: mon.b calling monitor election 2024-09-19T04:08:36.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: mon.c calling monitor election 2024-09-19T04:08:36.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: mon.a calling monitor election 2024-09-19T04:08:36.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T04:08:36.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: monmap epoch 3 2024-09-19T04:08:36.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: fsid 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:08:36.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: last_changed 2024-09-19T04:08:28.846561+0000 2024-09-19T04:08:36.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: created 2024-09-19T04:06:54.996586+0000 2024-09-19T04:08:36.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: min_mon_release 19 (squid) 2024-09-19T04:08:36.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: election_strategy: 1 2024-09-19T04:08:36.799 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-19T04:08:36.799 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.c 2024-09-19T04:08:36.799 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: 2: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.b 2024-09-19T04:08:36.799 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: fsmap 2024-09-19T04:08:36.799 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:08:36.799 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: mgrmap e13: x(active, since 50s) 2024-09-19T04:08:36.799 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: overall HEALTH_OK 2024-09-19T04:08:36.799 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:36.799 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:36.799 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:36.799 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:36.800 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:36.800 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:36.800 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:36.800 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:08:36.800 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:08:36.800 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:36 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:36.899 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:08:36.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: mon.b calling monitor election 2024-09-19T04:08:36.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:36.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: Updating smithi007:/etc/ceph/ceph.conf 2024-09-19T04:08:36.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: Updating smithi092:/etc/ceph/ceph.conf 2024-09-19T04:08:36.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-19T04:08:36.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: Updating smithi102:/var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:08:36.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: Updating smithi092:/var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:08:36.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: Updating smithi007:/var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:08:36.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: mon.b calling monitor election 2024-09-19T04:08:36.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: mon.c calling monitor election 2024-09-19T04:08:36.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: mon.a calling monitor election 2024-09-19T04:08:36.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T04:08:36.910 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: monmap epoch 3 2024-09-19T04:08:36.910 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: fsid 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:08:36.910 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: last_changed 2024-09-19T04:08:28.846561+0000 2024-09-19T04:08:36.910 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: created 2024-09-19T04:06:54.996586+0000 2024-09-19T04:08:36.910 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: min_mon_release 19 (squid) 2024-09-19T04:08:36.910 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: election_strategy: 1 2024-09-19T04:08:36.910 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-19T04:08:36.910 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: 1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.c 2024-09-19T04:08:36.910 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: 2: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.b 2024-09-19T04:08:36.910 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: fsmap 2024-09-19T04:08:36.910 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:08:36.911 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: mgrmap e13: x(active, since 50s) 2024-09-19T04:08:36.911 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: overall HEALTH_OK 2024-09-19T04:08:36.911 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:36.911 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:36.911 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:36.911 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:36.911 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:36.911 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:36.911 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:36.911 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:08:36.911 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:08:36.911 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:36 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:37.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.327+0000 7fe318c10640 1 -- 172.21.15.102:0/2627356024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3141016e0 msgr2=0x7fe314101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:37.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.327+0000 7fe318c10640 1 --2- 172.21.15.102:0/2627356024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3141016e0 0x7fe314101ae0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc009880 tx=0x7fe2fc02a5d0 comp rx=0 tx=0).stop 2024-09-19T04:08:37.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.327+0000 7fe318c10640 1 -- 172.21.15.102:0/2627356024 shutdown_connections 2024-09-19T04:08:37.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.327+0000 7fe318c10640 1 --2- 172.21.15.102:0/2627356024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3141016e0 0x7fe314101ae0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:37.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.327+0000 7fe318c10640 1 -- 172.21.15.102:0/2627356024 >> 172.21.15.102:0/2627356024 conn(0x7fe3140fce90 msgr2=0x7fe3140ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:08:37.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.327+0000 7fe318c10640 1 -- 172.21.15.102:0/2627356024 shutdown_connections 2024-09-19T04:08:37.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.327+0000 7fe318c10640 1 -- 172.21.15.102:0/2627356024 wait complete. 2024-09-19T04:08:37.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.328+0000 7fe318c10640 1 Processor -- start 2024-09-19T04:08:37.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.328+0000 7fe318c10640 1 -- start start 2024-09-19T04:08:37.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.328+0000 7fe318c10640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3141016e0 0x7fe314196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:37.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.328+0000 7fe318c10640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe314197510 0x7fe31419c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:37.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.328+0000 7fe318c10640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe314197990 0x7fe31419eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:37.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.328+0000 7fe318c10640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe3141077d0 con 0x7fe3141016e0 2024-09-19T04:08:37.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.328+0000 7fe318c10640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe314107650 con 0x7fe314197990 2024-09-19T04:08:37.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.328+0000 7fe318c10640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe314107950 con 0x7fe314197510 2024-09-19T04:08:37.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.328+0000 7fe311d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe314197510 0x7fe31419c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:37.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.328+0000 7fe311d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe314197510 0x7fe31419c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51932/0 (socket says 172.21.15.102:51932) 2024-09-19T04:08:37.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.328+0000 7fe311d9b640 1 -- 172.21.15.102:0/1602761967 learned_addr learned my addr 172.21.15.102:0/1602761967 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T04:08:37.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.328+0000 7fe31259c640 1 --2- 172.21.15.102:0/1602761967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3141016e0 0x7fe314196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:37.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.328+0000 7fe312d9d640 1 --2- 172.21.15.102:0/1602761967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe314197990 0x7fe31419eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:37.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.329+0000 7fe311d9b640 1 -- 172.21.15.102:0/1602761967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe314197990 msgr2=0x7fe31419eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:37.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.329+0000 7fe311d9b640 1 --2- 172.21.15.102:0/1602761967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe314197990 0x7fe31419eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:37.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.329+0000 7fe311d9b640 1 -- 172.21.15.102:0/1602761967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3141016e0 msgr2=0x7fe314196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:37.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.329+0000 7fe311d9b640 1 --2- 172.21.15.102:0/1602761967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3141016e0 0x7fe314196fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:37.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.329+0000 7fe311d9b640 1 -- 172.21.15.102:0/1602761967 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe31419f3d0 con 0x7fe314197510 2024-09-19T04:08:37.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.329+0000 7fe311d9b640 1 --2- 172.21.15.102:0/1602761967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe314197510 0x7fe31419c580 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe30400b520 tx=0x7fe30400b9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:08:37.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.329+0000 7fe30b7fe640 1 -- 172.21.15.102:0/1602761967 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe304004230 con 0x7fe314197510 2024-09-19T04:08:37.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.329+0000 7fe30b7fe640 1 -- 172.21.15.102:0/1602761967 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3040043d0 con 0x7fe314197510 2024-09-19T04:08:37.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.329+0000 7fe318c10640 1 -- 172.21.15.102:0/1602761967 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe31419f6c0 con 0x7fe314197510 2024-09-19T04:08:37.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.329+0000 7fe30b7fe640 1 -- 172.21.15.102:0/1602761967 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe304003d60 con 0x7fe314197510 2024-09-19T04:08:37.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.329+0000 7fe318c10640 1 -- 172.21.15.102:0/1602761967 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe31419fcd0 con 0x7fe314197510 2024-09-19T04:08:37.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.330+0000 7fe30b7fe640 1 -- 172.21.15.102:0/1602761967 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fe30400e070 con 0x7fe314197510 2024-09-19T04:08:37.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.330+0000 7fe318c10640 1 -- 172.21.15.102:0/1602761967 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe314190590 con 0x7fe314197510 2024-09-19T04:08:37.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.330+0000 7fe30b7fe640 1 --2- 172.21.15.102:0/1602761967 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe300039730 0x7fe30003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:37.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.330+0000 7fe30b7fe640 1 -- 172.21.15.102:0/1602761967 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe30404bc00 con 0x7fe314197510 2024-09-19T04:08:37.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.330+0000 7fe31259c640 1 --2- 172.21.15.102:0/1602761967 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe300039730 0x7fe30003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:37.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.331+0000 7fe31259c640 1 --2- 172.21.15.102:0/1602761967 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe300039730 0x7fe30003bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc000c00 tx=0x7fe2fc031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:08:37.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.335+0000 7fe30b7fe640 1 -- 172.21.15.102:0/1602761967 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe304052080 con 0x7fe314197510 2024-09-19T04:08:37.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.513+0000 7fe318c10640 1 -- 172.21.15.102:0/1602761967 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi007=x;smithi092=y;smithi102=z", "target": ["mon-mgr", ""]}) -- 0x7fe3140626c0 con 0x7fe300039730 2024-09-19T04:08:37.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.518+0000 7fe30b7fe640 1 -- 172.21.15.102:0/1602761967 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fe3140626c0 con 0x7fe300039730 2024-09-19T04:08:37.519 INFO:teuthology.orchestra.run.smithi102.stdout:Scheduled mgr update... 2024-09-19T04:08:37.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.520+0000 7fe318c10640 1 -- 172.21.15.102:0/1602761967 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe300039730 msgr2=0x7fe30003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:37.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.520+0000 7fe318c10640 1 --2- 172.21.15.102:0/1602761967 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe300039730 0x7fe30003bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc000c00 tx=0x7fe2fc031400 comp rx=0 tx=0).stop 2024-09-19T04:08:37.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.520+0000 7fe318c10640 1 -- 172.21.15.102:0/1602761967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe314197510 msgr2=0x7fe31419c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:37.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.520+0000 7fe318c10640 1 --2- 172.21.15.102:0/1602761967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe314197510 0x7fe31419c580 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe30400b520 tx=0x7fe30400b9e0 comp rx=0 tx=0).stop 2024-09-19T04:08:37.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.520+0000 7fe318c10640 1 -- 172.21.15.102:0/1602761967 shutdown_connections 2024-09-19T04:08:37.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.520+0000 7fe318c10640 1 --2- 172.21.15.102:0/1602761967 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe300039730 0x7fe30003bbf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:37.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.520+0000 7fe318c10640 1 --2- 172.21.15.102:0/1602761967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe314197990 0x7fe31419eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:37.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.520+0000 7fe318c10640 1 --2- 172.21.15.102:0/1602761967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe314197510 0x7fe31419c580 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:37.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.520+0000 7fe318c10640 1 --2- 172.21.15.102:0/1602761967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe3141016e0 0x7fe314196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:37.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.520+0000 7fe318c10640 1 -- 172.21.15.102:0/1602761967 >> 172.21.15.102:0/1602761967 conn(0x7fe3140fce90 msgr2=0x7fe3140fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:08:37.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.520+0000 7fe318c10640 1 -- 172.21.15.102:0/1602761967 shutdown_connections 2024-09-19T04:08:37.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:08:37.520+0000 7fe318c10640 1 -- 172.21.15.102:0/1602761967 wait complete. 2024-09-19T04:08:37.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:37 smithi102 ceph-mon[35446]: Reconfiguring mon.a (monmap changed)... 2024-09-19T04:08:37.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:37 smithi102 ceph-mon[35446]: Reconfiguring daemon mon.a on smithi007 2024-09-19T04:08:37.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:37 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:08:37.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:37 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:37.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:37 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:37.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:37 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:08:37.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:37 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:08:37.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:37 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:37.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:37 smithi092 ceph-mon[34940]: Reconfiguring mon.a (monmap changed)... 2024-09-19T04:08:37.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:37 smithi092 ceph-mon[34940]: Reconfiguring daemon mon.a on smithi007 2024-09-19T04:08:37.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:37 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:08:37.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:37 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:37.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:37 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:37.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:37 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:08:37.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:37 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:08:37.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:37 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:37.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:37 smithi007 ceph-mon[31360]: Reconfiguring mon.a (monmap changed)... 2024-09-19T04:08:37.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:37 smithi007 ceph-mon[31360]: Reconfiguring daemon mon.a on smithi007 2024-09-19T04:08:37.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:37 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:08:37.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:37 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:37.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:37 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:37.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:37 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:08:37.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:37 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:08:37.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:37 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:38.064 DEBUG:teuthology.orchestra.run.smithi092:mgr.y> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mgr.y.service 2024-09-19T04:08:38.067 DEBUG:teuthology.orchestra.run.smithi102:mgr.z> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mgr.z.service 2024-09-19T04:08:38.069 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T04:08:38.069 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T04:08:38.069 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T04:08:38.090 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T04:08:38.090 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_1 2024-09-19T04:08:38.127 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:08:37 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:08:37.846+0000 7fd2ae01a640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-19T04:08:38.146 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T04:08:38.146 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:08:38.146 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-19T04:08:38.146 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:08:38.146 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:08:38.146 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-19 04:07:55.904910331 +0000 2024-09-19T04:08:38.146 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-19 04:03:31.384367956 +0000 2024-09-19T04:08:38.147 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-19 04:03:31.384367956 +0000 2024-09-19T04:08:38.147 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-19 04:03:31.384367956 +0000 2024-09-19T04:08:38.147 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T04:08:38.216 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-19T04:08:38.216 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-19T04:08:38.216 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000129455 s, 4.0 MB/s 2024-09-19T04:08:38.218 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T04:08:38.277 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_2 2024-09-19T04:08:38.336 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T04:08:38.336 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:08:38.336 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-19T04:08:38.336 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:08:38.336 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:08:38.336 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-19 04:07:55.933909895 +0000 2024-09-19T04:08:38.336 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-19 04:03:31.810361542 +0000 2024-09-19T04:08:38.337 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-19 04:03:31.810361542 +0000 2024-09-19T04:08:38.337 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-19 04:03:31.810361542 +0000 2024-09-19T04:08:38.337 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T04:08:38.402 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-19T04:08:38.403 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-19T04:08:38.403 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000121302 s, 4.2 MB/s 2024-09-19T04:08:38.404 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T04:08:38.462 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_3 2024-09-19T04:08:38.519 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T04:08:38.519 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:08:38.519 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T04:08:38.519 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:08:38.519 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:08:38.519 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-19 04:07:55.961909473 +0000 2024-09-19T04:08:38.519 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-19 04:03:32.138356604 +0000 2024-09-19T04:08:38.519 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-19 04:03:32.138356604 +0000 2024-09-19T04:08:38.519 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-19 04:03:32.138356604 +0000 2024-09-19T04:08:38.519 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T04:08:38.585 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-19T04:08:38.585 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-19T04:08:38.585 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000115906 s, 4.4 MB/s 2024-09-19T04:08:38.586 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T04:08:38.644 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_4 2024-09-19T04:08:38.700 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T04:08:38.700 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:08:38.700 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-19T04:08:38.700 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:08:38.700 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:08:38.701 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-19 04:07:55.989909052 +0000 2024-09-19T04:08:38.701 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-19 04:03:32.484351395 +0000 2024-09-19T04:08:38.701 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-19 04:03:32.484351395 +0000 2024-09-19T04:08:38.701 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-19 04:03:32.484351395 +0000 2024-09-19T04:08:38.701 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T04:08:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-19T04:08:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-19T04:08:38.765 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000108857 s, 4.7 MB/s 2024-09-19T04:08:38.766 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T04:08:38.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:38 smithi092 ceph-mon[34940]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:38.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:38 smithi092 ceph-mon[34940]: Reconfiguring mon.b (monmap changed)... 2024-09-19T04:08:38.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:38 smithi092 ceph-mon[34940]: Reconfiguring daemon mon.b on smithi092 2024-09-19T04:08:38.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:38 smithi092 ceph-mon[34940]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi007=x;smithi092=y;smithi102=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:08:38.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:38 smithi092 ceph-mon[34940]: Saving service mgr spec with placement smithi007=x;smithi092=y;smithi102=z;count:3 2024-09-19T04:08:38.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:38 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:38.822 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-09-19T04:08:38.822 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T04:08:38.840 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T04:08:38.840 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_1 2024-09-19T04:08:38.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:38 smithi007 ceph-mon[31360]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:38.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:38 smithi007 ceph-mon[31360]: Reconfiguring mon.b (monmap changed)... 2024-09-19T04:08:38.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:38 smithi007 ceph-mon[31360]: Reconfiguring daemon mon.b on smithi092 2024-09-19T04:08:38.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:38 smithi007 ceph-mon[31360]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi007=x;smithi092=y;smithi102=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:08:38.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:38 smithi007 ceph-mon[31360]: Saving service mgr spec with placement smithi007=x;smithi092=y;smithi102=z;count:3 2024-09-19T04:08:38.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:38 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:38.896 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T04:08:38.897 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:08:38.897 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-19T04:08:38.897 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:08:38.897 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:08:38.897 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-19 04:08:28.283390477 +0000 2024-09-19T04:08:38.897 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-19 04:03:44.250843279 +0000 2024-09-19T04:08:38.897 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-19 04:03:44.250843279 +0000 2024-09-19T04:08:38.897 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-19 04:03:44.250843279 +0000 2024-09-19T04:08:38.897 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T04:08:38.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:38 smithi102 ceph-mon[35446]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:38.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:38 smithi102 ceph-mon[35446]: Reconfiguring mon.b (monmap changed)... 2024-09-19T04:08:38.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:38 smithi102 ceph-mon[35446]: Reconfiguring daemon mon.b on smithi092 2024-09-19T04:08:38.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:38 smithi102 ceph-mon[35446]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi007=x;smithi092=y;smithi102=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:08:38.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:38 smithi102 ceph-mon[35446]: Saving service mgr spec with placement smithi007=x;smithi092=y;smithi102=z;count:3 2024-09-19T04:08:38.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:38 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:38.961 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-19T04:08:38.961 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-19T04:08:38.961 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000276428 s, 1.9 MB/s 2024-09-19T04:08:38.962 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T04:08:39.019 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_2 2024-09-19T04:08:39.075 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T04:08:39.076 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:08:39.076 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T04:08:39.076 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:08:39.076 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:08:39.076 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-19 04:08:28.284390449 +0000 2024-09-19T04:08:39.076 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-19 04:03:44.584833705 +0000 2024-09-19T04:08:39.076 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-19 04:03:44.584833705 +0000 2024-09-19T04:08:39.076 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-19 04:03:44.584833705 +0000 2024-09-19T04:08:39.076 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T04:08:39.139 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-19T04:08:39.140 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-19T04:08:39.140 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000212818 s, 2.4 MB/s 2024-09-19T04:08:39.141 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T04:08:39.197 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_3 2024-09-19T04:08:39.253 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T04:08:39.254 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:08:39.254 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-19T04:08:39.254 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:08:39.254 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:08:39.254 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-19 04:08:28.284390449 +0000 2024-09-19T04:08:39.254 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-19 04:03:44.914824246 +0000 2024-09-19T04:08:39.254 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-19 04:03:44.914824246 +0000 2024-09-19T04:08:39.254 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-19 04:03:44.914824246 +0000 2024-09-19T04:08:39.254 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T04:08:39.317 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-19T04:08:39.317 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-19T04:08:39.317 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000236256 s, 2.2 MB/s 2024-09-19T04:08:39.318 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T04:08:39.375 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_4 2024-09-19T04:08:39.430 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T04:08:39.431 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:08:39.431 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-19T04:08:39.431 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:08:39.431 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:08:39.431 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-09-19 04:08:28.284390449 +0000 2024-09-19T04:08:39.431 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-09-19 04:03:45.238814958 +0000 2024-09-19T04:08:39.431 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-09-19 04:03:45.238814958 +0000 2024-09-19T04:08:39.432 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-09-19 04:03:45.238814958 +0000 2024-09-19T04:08:39.432 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T04:08:39.494 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-09-19T04:08:39.495 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-09-19T04:08:39.495 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000168955 s, 3.0 MB/s 2024-09-19T04:08:39.496 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T04:08:39.553 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T04:08:39.553 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T04:08:39.571 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T04:08:39.571 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_1 2024-09-19T04:08:39.626 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T04:08:39.627 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:08:39.627 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-09-19T04:08:39.627 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:08:39.627 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:08:39.627 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-19 04:08:19.234634084 +0000 2024-09-19T04:08:39.627 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-19 04:03:43.811812192 +0000 2024-09-19T04:08:39.627 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-19 04:03:43.811812192 +0000 2024-09-19T04:08:39.627 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-19 04:03:43.811812192 +0000 2024-09-19T04:08:39.627 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T04:08:39.691 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-19T04:08:39.691 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-19T04:08:39.691 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.00021756 s, 2.4 MB/s 2024-09-19T04:08:39.692 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T04:08:39.749 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_2 2024-09-19T04:08:39.804 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T04:08:39.804 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:08:39.804 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-09-19T04:08:39.804 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:08:39.805 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:08:39.805 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-19 04:08:19.235634065 +0000 2024-09-19T04:08:39.805 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-19 04:03:44.135805816 +0000 2024-09-19T04:08:39.805 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-19 04:03:44.135805816 +0000 2024-09-19T04:08:39.805 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-19 04:03:44.135805816 +0000 2024-09-19T04:08:39.805 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T04:08:39.870 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-19T04:08:39.870 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-19T04:08:39.870 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.00194834 s, 263 kB/s 2024-09-19T04:08:39.871 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T04:08:39.927 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_3 2024-09-19T04:08:39.982 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T04:08:39.982 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:08:39.982 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-19T04:08:39.982 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:08:39.983 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:08:39.983 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-19 04:08:19.235634065 +0000 2024-09-19T04:08:39.983 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-19 04:03:44.469799243 +0000 2024-09-19T04:08:39.983 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-19 04:03:44.469799243 +0000 2024-09-19T04:08:39.983 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-19 04:03:44.469799243 +0000 2024-09-19T04:08:39.983 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T04:08:40.045 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-19T04:08:40.046 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-19T04:08:40.046 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000220038 s, 2.3 MB/s 2024-09-19T04:08:40.047 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T04:08:40.103 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_4 2024-09-19T04:08:40.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:39 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:40.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:39 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:40.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:39 smithi007 ceph-mon[31360]: Reconfiguring mon.c (monmap changed)... 2024-09-19T04:08:40.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:39 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:08:40.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:39 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:08:40.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:39 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:40.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:39 smithi007 ceph-mon[31360]: Reconfiguring daemon mon.c on smithi102 2024-09-19T04:08:40.159 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T04:08:40.159 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:08:40.159 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-19T04:08:40.159 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:08:40.159 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:08:40.159 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-19 04:08:19.236634046 +0000 2024-09-19T04:08:40.159 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-19 04:03:44.795792828 +0000 2024-09-19T04:08:40.159 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-19 04:03:44.795792828 +0000 2024-09-19T04:08:40.159 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-19 04:03:44.795792828 +0000 2024-09-19T04:08:40.159 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T04:08:40.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:39 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:40.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:39 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:40.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:39 smithi102 ceph-mon[35446]: Reconfiguring mon.c (monmap changed)... 2024-09-19T04:08:40.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:39 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:08:40.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:39 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:08:40.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:39 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:40.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:39 smithi102 ceph-mon[35446]: Reconfiguring daemon mon.c on smithi102 2024-09-19T04:08:40.222 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-19T04:08:40.222 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-19T04:08:40.222 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000216521 s, 2.4 MB/s 2024-09-19T04:08:40.224 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T04:08:40.281 INFO:tasks.cephadm:Deploying osd.0 on smithi007 with /dev/vg_nvme/lv_4... 2024-09-19T04:08:40.281 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T04:08:40.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:39 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:40.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:39 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:40.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:39 smithi092 ceph-mon[34940]: Reconfiguring mon.c (monmap changed)... 2024-09-19T04:08:40.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:39 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:08:40.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:39 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:08:40.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:39 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:40.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:39 smithi092 ceph-mon[34940]: Reconfiguring daemon mon.c on smithi102 2024-09-19T04:08:40.547 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:08:40.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:40 smithi007 ceph-mon[31360]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:40.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:40.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:40.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:08:40.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:40.941 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:08:40.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:40.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T04:08:40.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T04:08:40.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T04:08:40.942 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:41.045 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:40 smithi102 ceph-mon[35446]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:41.046 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:41.046 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:41.046 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:08:41.046 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:41.046 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:08:41.046 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:41.046 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T04:08:41.046 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T04:08:41.046 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T04:08:41.046 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:41.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:40 smithi092 ceph-mon[34940]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:41.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:41.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:41.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:08:41.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:41.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:08:41.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:41.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T04:08:41.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T04:08:41.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T04:08:41.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:41.914 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:41 smithi007 ceph-mon[31360]: Deploying daemon mgr.z on smithi102 2024-09-19T04:08:42.029 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:41 smithi102 ceph-mon[35446]: Deploying daemon mgr.z on smithi102 2024-09-19T04:08:42.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:41 smithi092 ceph-mon[34940]: Deploying daemon mgr.z on smithi102 2024-09-19T04:08:42.385 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:42 smithi102 systemd[1]: Starting Ceph mgr.z for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:08:42.653 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:42 smithi102 podman[37231]: 2024-09-19 04:08:42.383968776 +0000 UTC m=+0.101158601 container create 812f1a59d7088987c7c2b2785fda14050c53cb1162dc542eb729729c187fd946 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-19T04:08:42.654 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:42 smithi102 podman[37231]: 2024-09-19 04:08:42.2986775 +0000 UTC m=+0.015867270 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:08:42.654 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:42 smithi102 podman[37231]: 2024-09-19 04:08:42.577835653 +0000 UTC m=+0.295025409 container init 812f1a59d7088987c7c2b2785fda14050c53cb1162dc542eb729729c187fd946 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-19T04:08:42.654 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:42 smithi102 podman[37231]: 2024-09-19 04:08:42.580615275 +0000 UTC m=+0.297805040 container start 812f1a59d7088987c7c2b2785fda14050c53cb1162dc542eb729729c187fd946 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T04:08:42.654 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:42 smithi102 ceph-mgr[37250]: -- 172.21.15.102:0/2234129671 <== mon.1 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ca320530e0 con 0x55ca32031000 2024-09-19T04:08:42.654 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:42 smithi102 bash[37231]: 812f1a59d7088987c7c2b2785fda14050c53cb1162dc542eb729729c187fd946 2024-09-19T04:08:42.909 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:42 smithi102 systemd[1]: Started Ceph mgr.z for 77957c0a-763c-11ef-bceb-c7b262605968. 2024-09-19T04:08:42.909 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:42 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z[37246]: 2024-09-19T04:08:42.701+0000 7f40949d9040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T04:08:42.909 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:42 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z[37246]: 2024-09-19T04:08:42.760+0000 7f40949d9040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T04:08:42.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:42 smithi102 ceph-mon[35446]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:42.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:42 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:42.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:42 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:42.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:42 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:42.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:42 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T04:08:42.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:42 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T04:08:42.910 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:42 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T04:08:42.910 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:42 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:43.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:42 smithi007 ceph-mon[31360]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:43.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:42 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:43.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:42 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:43.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:42 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:43.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:42 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T04:08:43.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:42 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T04:08:43.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:42 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T04:08:43.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:42 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:43.155 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:42 smithi092 ceph-mon[34940]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:43.155 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:42 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:43.155 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:42 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:43.156 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:42 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:43.156 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:42 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T04:08:43.156 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:42 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T04:08:43.156 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:42 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T04:08:43.156 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:42 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:43.157 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:08:43.186 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi007:vg_nvme/lv_4 2024-09-19T04:08:43.254 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:42 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z[37246]: 2024-09-19T04:08:42.907+0000 7f40949d9040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T04:08:43.254 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:42 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z[37246]: 2024-09-19T04:08:42.971+0000 7f40949d9040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T04:08:43.254 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:43 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z[37246]: 2024-09-19T04:08:43.116+0000 7f40949d9040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:08:43.254 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:43 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z[37246]: 2024-09-19T04:08:43.252+0000 7f40949d9040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T04:08:43.438 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:08:43.878 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:43 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z[37246]: 2024-09-19T04:08:43.561+0000 7f40949d9040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T04:08:43.879 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:43 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z[37246]: 2024-09-19T04:08:43.621+0000 7f40949d9040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T04:08:43.879 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:43 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z[37246]: 2024-09-19T04:08:43.800+0000 7f40949d9040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T04:08:44.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.907+0000 7fdbc18b1640 1 -- 172.21.15.7:0/1619869888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbbc1037c0 msgr2=0x7fdbbc10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:44.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.907+0000 7fdbc18b1640 1 --2- 172.21.15.7:0/1619869888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbbc1037c0 0x7fdbbc10a050 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4009ca0 tx=0x7fdbb402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:08:44.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.907+0000 7fdbc18b1640 1 -- 172.21.15.7:0/1619869888 shutdown_connections 2024-09-19T04:08:44.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.907+0000 7fdbc18b1640 1 --2- 172.21.15.7:0/1619869888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbbc1037c0 0x7fdbbc10a050 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:44.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.907+0000 7fdbc18b1640 1 --2- 172.21.15.7:0/1619869888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbbc102e00 0x7fdbbc103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:44.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.907+0000 7fdbc18b1640 1 --2- 172.21.15.7:0/1619869888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdbbc101c00 0x7fdbbc102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:44.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.908+0000 7fdbc18b1640 1 -- 172.21.15.7:0/1619869888 >> 172.21.15.7:0/1619869888 conn(0x7fdbbc0fd390 msgr2=0x7fdbbc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:08:44.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.908+0000 7fdbc18b1640 1 -- 172.21.15.7:0/1619869888 shutdown_connections 2024-09-19T04:08:44.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.908+0000 7fdbc18b1640 1 -- 172.21.15.7:0/1619869888 wait complete. 2024-09-19T04:08:44.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.908+0000 7fdbc18b1640 1 Processor -- start 2024-09-19T04:08:44.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.908+0000 7fdbc18b1640 1 -- start start 2024-09-19T04:08:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.909+0000 7fdbc18b1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbbc101c00 0x7fdbbc075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.909+0000 7fdbc18b1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbbc102e00 0x7fdbbc0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.909+0000 7fdbc18b1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdbbc1037c0 0x7fdbbc074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.909+0000 7fdbc18b1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc10d8d0 con 0x7fdbbc102e00 2024-09-19T04:08:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.909+0000 7fdbc18b1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc10d750 con 0x7fdbbc101c00 2024-09-19T04:08:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.909+0000 7fdbc18b1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc10da50 con 0x7fdbbc1037c0 2024-09-19T04:08:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.909+0000 7fdbba7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbbc102e00 0x7fdbbc0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.909+0000 7fdbba7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbbc102e00 0x7fdbbc0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40246/0 (socket says 172.21.15.7:40246) 2024-09-19T04:08:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.909+0000 7fdbba7fc640 1 -- 172.21.15.7:0/2844586574 learned_addr learned my addr 172.21.15.7:0/2844586574 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:08:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.909+0000 7fdbbaffd640 1 --2- 172.21.15.7:0/2844586574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbbc101c00 0x7fdbbc075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.909+0000 7fdbbb7fe640 1 --2- 172.21.15.7:0/2844586574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdbbc1037c0 0x7fdbbc074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.909+0000 7fdbba7fc640 1 -- 172.21.15.7:0/2844586574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdbbc1037c0 msgr2=0x7fdbbc074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.909+0000 7fdbba7fc640 1 --2- 172.21.15.7:0/2844586574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdbbc1037c0 0x7fdbbc074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:44.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.909+0000 7fdbba7fc640 1 -- 172.21.15.7:0/2844586574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbbc101c00 msgr2=0x7fdbbc075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:08:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.909+0000 7fdbba7fc640 1 --2- 172.21.15.7:0/2844586574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbbc101c00 0x7fdbbc075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:08:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.909+0000 7fdbba7fc640 1 -- 172.21.15.7:0/2844586574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbbc0753e0 con 0x7fdbbc102e00 2024-09-19T04:08:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.909+0000 7fdbba7fc640 1 --2- 172.21.15.7:0/2844586574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbbc102e00 0x7fdbbc0745e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdbb000d950 tx=0x7fdbb000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:08:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.909+0000 7fdbc08af640 1 -- 172.21.15.7:0/2844586574 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0017070 con 0x7fdbbc102e00 2024-09-19T04:08:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.909+0000 7fdbc08af640 1 -- 172.21.15.7:0/2844586574 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbb0009c30 con 0x7fdbbc102e00 2024-09-19T04:08:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.909+0000 7fdbc08af640 1 -- 172.21.15.7:0/2844586574 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb000f6b0 con 0x7fdbbc102e00 2024-09-19T04:08:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.909+0000 7fdbc18b1640 1 -- 172.21.15.7:0/2844586574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbbc1a1fc0 con 0x7fdbbc102e00 2024-09-19T04:08:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.909+0000 7fdbc18b1640 1 -- 172.21.15.7:0/2844586574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbbc1a2420 con 0x7fdbbc102e00 2024-09-19T04:08:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.910+0000 7fdbc08af640 1 -- 172.21.15.7:0/2844586574 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fdbb000f850 con 0x7fdbbc102e00 2024-09-19T04:08:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.910+0000 7fdbc08af640 1 --2- 172.21.15.7:0/2844586574 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fdba40394d0 0x7fdba403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:08:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.910+0000 7fdbc18b1640 1 -- 172.21.15.7:0/2844586574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbbc108f30 con 0x7fdbbc102e00 2024-09-19T04:08:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.911+0000 7fdbc08af640 1 -- 172.21.15.7:0/2844586574 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fdbb004c360 con 0x7fdbbc102e00 2024-09-19T04:08:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.911+0000 7fdbbaffd640 1 --2- 172.21.15.7:0/2844586574 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fdba40394d0 0x7fdba403b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:08:44.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.911+0000 7fdbbaffd640 1 --2- 172.21.15.7:0/2844586574 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fdba40394d0 0x7fdba403b990 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc102c60 tx=0x7fdbac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:08:44.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:43.915+0000 7fdbc08af640 1 -- 172.21.15.7:0/2844586574 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdbb0009de0 con 0x7fdbbc102e00 2024-09-19T04:08:44.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:44.102+0000 7fdbc18b1640 1 -- 172.21.15.7:0/2844586574 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fdbbc062630 con 0x7fdba40394d0 2024-09-19T04:08:44.103 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:43 smithi007 ceph-mon[31360]: Deploying daemon mgr.y on smithi092 2024-09-19T04:08:44.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:43 smithi102 ceph-mon[35446]: Deploying daemon mgr.y on smithi092 2024-09-19T04:08:44.162 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:43 smithi092 ceph-mon[34940]: Deploying daemon mgr.y on smithi092 2024-09-19T04:08:44.515 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:44 smithi092 systemd[1]: Starting Ceph mgr.y for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:08:44.797 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:44 smithi092 podman[36292]: 2024-09-19 04:08:44.72293221 +0000 UTC m=+0.109306641 container create e1a350fd85363b4dd661af9e10186ee5dc23fb69a59fa2725185ecb37487e401 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T04:08:44.797 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:44 smithi092 podman[36292]: 2024-09-19 04:08:44.629276064 +0000 UTC m=+0.015650517 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:08:45.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:44 smithi007 ceph-mon[31360]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:45.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:44 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:08:45.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:44 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:08:45.037 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:44 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:45.111 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:44 smithi092 ceph-mon[34940]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:45.111 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:44 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:08:45.112 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:44 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:08:45.112 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:44 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:45.112 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:44 smithi092 podman[36292]: 2024-09-19 04:08:44.925763566 +0000 UTC m=+0.312137998 container init e1a350fd85363b4dd661af9e10186ee5dc23fb69a59fa2725185ecb37487e401 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T04:08:45.112 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:44 smithi092 podman[36292]: 2024-09-19 04:08:44.929064051 +0000 UTC m=+0.315438484 container start e1a350fd85363b4dd661af9e10186ee5dc23fb69a59fa2725185ecb37487e401 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T04:08:45.112 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:44 smithi092 ceph-mgr[36311]: -- 172.21.15.92:0/3131923873 <== mon.2 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5602d1f9d0e0 con 0x5602d1f7a800 2024-09-19T04:08:45.112 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:45 smithi092 bash[36292]: e1a350fd85363b4dd661af9e10186ee5dc23fb69a59fa2725185ecb37487e401 2024-09-19T04:08:45.112 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:45 smithi092 systemd[1]: Started Ceph mgr.y for 77957c0a-763c-11ef-bceb-c7b262605968. 2024-09-19T04:08:45.112 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:45 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y[36307]: 2024-09-19T04:08:45.049+0000 7f35a53b1040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T04:08:45.112 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:45 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y[36307]: 2024-09-19T04:08:45.109+0000 7f35a53b1040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T04:08:45.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:44 smithi102 ceph-mon[35446]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:45.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:44 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:08:45.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:44 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:08:45.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:44 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:45.159 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:44 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z[37246]: 2024-09-19T04:08:44.673+0000 7f40949d9040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T04:08:45.159 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:44 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z[37246]: 2024-09-19T04:08:44.738+0000 7f40949d9040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T04:08:45.495 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:45 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y[36307]: 2024-09-19T04:08:45.265+0000 7f35a53b1040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T04:08:45.495 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:45 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y[36307]: 2024-09-19T04:08:45.334+0000 7f35a53b1040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T04:08:45.496 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:45 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y[36307]: 2024-09-19T04:08:45.493+0000 7f35a53b1040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:08:45.744 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:45 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z[37246]: 2024-09-19T04:08:45.474+0000 7f40949d9040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T04:08:45.744 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:45 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z[37246]: 2024-09-19T04:08:45.602+0000 7f40949d9040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T04:08:45.744 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:45 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z[37246]: 2024-09-19T04:08:45.742+0000 7f40949d9040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:08:45.763 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:45 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y[36307]: 2024-09-19T04:08:45.643+0000 7f35a53b1040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T04:08:46.015 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:45 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z[37246]: 2024-09-19T04:08:45.806+0000 7f40949d9040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T04:08:46.015 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:45 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z[37246]: 2024-09-19T04:08:45.963+0000 7f40949d9040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T04:08:46.015 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:45 smithi102 ceph-mon[35446]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:08:46.015 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:45 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:46.015 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:45 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:46.016 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:45 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:46.016 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:45 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:46.016 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:45 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:08:46.033 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:45 smithi092 ceph-mon[34940]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:08:46.033 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:45 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:46.033 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:45 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:46.033 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:45 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:46.033 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:45 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:46.033 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:45 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:08:46.034 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:45 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y[36307]: 2024-09-19T04:08:45.968+0000 7f35a53b1040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T04:08:46.034 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:46 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y[36307]: 2024-09-19T04:08:46.030+0000 7f35a53b1040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T04:08:46.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:45 smithi007 ceph-mon[31360]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:08:46.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:45 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:46.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:45 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:46.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:45 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:46.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:45 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:46.149 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:45 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:08:46.297 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:46 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y[36307]: 2024-09-19T04:08:46.225+0000 7f35a53b1040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T04:08:46.327 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:46 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z[37246]: 2024-09-19T04:08:46.032+0000 7f40949d9040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T04:08:46.328 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:46 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z[37246]: 2024-09-19T04:08:46.092+0000 7f40949d9040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T04:08:46.328 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:46 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z[37246]: 2024-09-19T04:08:46.257+0000 7f40949d9040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T04:08:46.328 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:46 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z[37246]: 2024-09-19T04:08:46.326+0000 7f40949d9040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T04:08:46.596 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:46 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z[37246]: 2024-09-19T04:08:46.395+0000 7f40949d9040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T04:08:46.596 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:46 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z[37246]: 2024-09-19T04:08:46.478+0000 7f40949d9040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T04:08:46.596 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:46 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z[37246]: 2024-09-19T04:08:46.536+0000 7f40949d9040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T04:08:46.596 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:46 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z[37246]: 2024-09-19T04:08:46.594+0000 7f40949d9040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T04:08:46.982 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:46 smithi007 ceph-mon[31360]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:46.982 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:46.982 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:46.982 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:46.982 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:46.982 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:46.983 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:08:46.983 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:46.983 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T04:08:46.983 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T04:08:46.983 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:46.983 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:46 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3929224560' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9b93bd5-ee22-4fb0-ba29-bfa208430a86"}]: dispatch 2024-09-19T04:08:46.983 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:46 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3929224560' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9b93bd5-ee22-4fb0-ba29-bfa208430a86"}]': finished 2024-09-19T04:08:46.983 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:46 smithi007 ceph-mon[31360]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T04:08:46.983 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:08:47.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:46 smithi102 ceph-mon[35446]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:47.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:47.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:47.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:47.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:47.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:47.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:08:47.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:47.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T04:08:47.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T04:08:47.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:47.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:46 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3929224560' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9b93bd5-ee22-4fb0-ba29-bfa208430a86"}]: dispatch 2024-09-19T04:08:47.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:46 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3929224560' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9b93bd5-ee22-4fb0-ba29-bfa208430a86"}]': finished 2024-09-19T04:08:47.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:46 smithi102 ceph-mon[35446]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T04:08:47.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:08:47.185 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:47 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y[36307]: 2024-09-19T04:08:47.115+0000 7f35a53b1040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T04:08:47.185 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:47 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y[36307]: 2024-09-19T04:08:47.183+0000 7f35a53b1040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T04:08:47.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:46 smithi092 ceph-mon[34940]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:47.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:46 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:47.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:46 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:47.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:46 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:47.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:46 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:47.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:46 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:47.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:46 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:08:47.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:46 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:47.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:46 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T04:08:47.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:46 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T04:08:47.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:46 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:47.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:46 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3929224560' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9b93bd5-ee22-4fb0-ba29-bfa208430a86"}]: dispatch 2024-09-19T04:08:47.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:46 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3929224560' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9b93bd5-ee22-4fb0-ba29-bfa208430a86"}]': finished 2024-09-19T04:08:47.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:46 smithi092 ceph-mon[34940]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T04:08:47.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:46 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:08:47.658 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:08:47 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z[37246]: 2024-09-19T04:08:47.373+0000 7f40949d9040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T04:08:47.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:47.891+0000 7fdbc08af640 1 -- 172.21.15.7:0/2844586574 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 14) ==== 92407+0+0 (secure 0 0 0) 0x7fdbb0023870 con 0x7fdbbc102e00 2024-09-19T04:08:48.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:47 smithi102 ceph-mon[35446]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T04:08:48.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:47 smithi102 ceph-mon[35446]: Reconfiguring daemon mgr.x on smithi007 2024-09-19T04:08:48.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:47 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2975980902' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:08:48.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:47 smithi102 ceph-mon[35446]: Standby manager daemon z started 2024-09-19T04:08:48.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:47 smithi102 ceph-mon[35446]: from='mgr.? 172.21.15.102:0/2798094043' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T04:08:48.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:47 smithi102 ceph-mon[35446]: from='mgr.? 172.21.15.102:0/2798094043' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:08:48.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:47 smithi102 ceph-mon[35446]: from='mgr.? 172.21.15.102:0/2798094043' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T04:08:48.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:47 smithi102 ceph-mon[35446]: from='mgr.? 172.21.15.102:0/2798094043' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:08:48.161 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:47 smithi092 ceph-mon[34940]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T04:08:48.161 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:47 smithi092 ceph-mon[34940]: Reconfiguring daemon mgr.x on smithi007 2024-09-19T04:08:48.161 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:47 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2975980902' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:08:48.161 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:47 smithi092 ceph-mon[34940]: Standby manager daemon z started 2024-09-19T04:08:48.161 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:47 smithi092 ceph-mon[34940]: from='mgr.? 172.21.15.102:0/2798094043' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T04:08:48.161 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:47 smithi092 ceph-mon[34940]: from='mgr.? 172.21.15.102:0/2798094043' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:08:48.161 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:47 smithi092 ceph-mon[34940]: from='mgr.? 172.21.15.102:0/2798094043' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T04:08:48.161 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:47 smithi092 ceph-mon[34940]: from='mgr.? 172.21.15.102:0/2798094043' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:08:48.161 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:47 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y[36307]: 2024-09-19T04:08:47.900+0000 7f35a53b1040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T04:08:48.161 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:48 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y[36307]: 2024-09-19T04:08:48.016+0000 7f35a53b1040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T04:08:48.162 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:48 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y[36307]: 2024-09-19T04:08:48.158+0000 7f35a53b1040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:08:48.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:47 smithi007 ceph-mon[31360]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T04:08:48.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:47 smithi007 ceph-mon[31360]: Reconfiguring daemon mgr.x on smithi007 2024-09-19T04:08:48.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:47 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2975980902' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:08:48.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:47 smithi007 ceph-mon[31360]: Standby manager daemon z started 2024-09-19T04:08:48.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:47 smithi007 ceph-mon[31360]: from='mgr.? 172.21.15.102:0/2798094043' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T04:08:48.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:47 smithi007 ceph-mon[31360]: from='mgr.? 172.21.15.102:0/2798094043' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:08:48.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:47 smithi007 ceph-mon[31360]: from='mgr.? 172.21.15.102:0/2798094043' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T04:08:48.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:47 smithi007 ceph-mon[31360]: from='mgr.? 172.21.15.102:0/2798094043' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:08:48.438 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:48 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y[36307]: 2024-09-19T04:08:48.220+0000 7f35a53b1040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T04:08:48.438 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:48 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y[36307]: 2024-09-19T04:08:48.369+0000 7f35a53b1040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T04:08:48.438 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:48 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y[36307]: 2024-09-19T04:08:48.436+0000 7f35a53b1040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T04:08:48.716 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:48 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y[36307]: 2024-09-19T04:08:48.495+0000 7f35a53b1040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T04:08:48.716 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:48 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y[36307]: 2024-09-19T04:08:48.650+0000 7f35a53b1040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T04:08:48.716 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:48 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y[36307]: 2024-09-19T04:08:48.713+0000 7f35a53b1040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T04:08:48.981 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:48 smithi092 ceph-mon[34940]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:48.982 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:48 smithi092 ceph-mon[34940]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-19T04:08:48.982 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:48 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T04:08:48.982 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:48 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y[36307]: 2024-09-19T04:08:48.778+0000 7f35a53b1040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T04:08:48.982 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:48 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y[36307]: 2024-09-19T04:08:48.861+0000 7f35a53b1040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T04:08:48.982 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:48 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y[36307]: 2024-09-19T04:08:48.921+0000 7f35a53b1040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T04:08:48.982 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:48 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y[36307]: 2024-09-19T04:08:48.980+0000 7f35a53b1040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T04:08:49.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:48 smithi102 ceph-mon[35446]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:49.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:48 smithi102 ceph-mon[35446]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-19T04:08:49.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:48 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T04:08:49.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:48 smithi007 ceph-mon[31360]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:49.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:48 smithi007 ceph-mon[31360]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-19T04:08:49.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:48 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T04:08:49.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:08:49.899+0000 7fdbc08af640 1 -- 172.21.15.7:0/2844586574 <== mon.0 v2:172.21.15.7:3300/0 8 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7fdbb001e120 con 0x7fdbbc102e00 2024-09-19T04:08:50.047 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:08:49 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y[36307]: 2024-09-19T04:08:49.768+0000 7f35a53b1040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T04:08:50.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:49 smithi092 ceph-mon[34940]: Standby manager daemon y started 2024-09-19T04:08:50.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:49 smithi092 ceph-mon[34940]: from='mgr.? 172.21.15.92:0/3461578207' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T04:08:50.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:49 smithi092 ceph-mon[34940]: from='mgr.? 172.21.15.92:0/3461578207' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:08:50.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:49 smithi092 ceph-mon[34940]: from='mgr.? 172.21.15.92:0/3461578207' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T04:08:50.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:49 smithi092 ceph-mon[34940]: from='mgr.? 172.21.15.92:0/3461578207' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:08:50.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:49 smithi102 ceph-mon[35446]: Standby manager daemon y started 2024-09-19T04:08:50.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:49 smithi102 ceph-mon[35446]: from='mgr.? 172.21.15.92:0/3461578207' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T04:08:50.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:49 smithi102 ceph-mon[35446]: from='mgr.? 172.21.15.92:0/3461578207' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:08:50.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:49 smithi102 ceph-mon[35446]: from='mgr.? 172.21.15.92:0/3461578207' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T04:08:50.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:49 smithi102 ceph-mon[35446]: from='mgr.? 172.21.15.92:0/3461578207' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:08:50.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:49 smithi007 ceph-mon[31360]: Standby manager daemon y started 2024-09-19T04:08:50.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:49 smithi007 ceph-mon[31360]: from='mgr.? 172.21.15.92:0/3461578207' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T04:08:50.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:49 smithi007 ceph-mon[31360]: from='mgr.? 172.21.15.92:0/3461578207' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:08:50.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:49 smithi007 ceph-mon[31360]: from='mgr.? 172.21.15.92:0/3461578207' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T04:08:50.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:49 smithi007 ceph-mon[31360]: from='mgr.? 172.21.15.92:0/3461578207' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:08:51.092 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:50 smithi007 ceph-mon[31360]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:51.092 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:50 smithi007 ceph-mon[31360]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-09-19T04:08:51.093 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:50 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T04:08:51.093 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:50 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:51.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:50 smithi102 ceph-mon[35446]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:51.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:50 smithi102 ceph-mon[35446]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-09-19T04:08:51.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:50 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T04:08:51.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:50 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:51.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:50 smithi092 ceph-mon[34940]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:51.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:50 smithi092 ceph-mon[34940]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-09-19T04:08:51.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:50 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T04:08:51.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:50 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:53.012 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:52 smithi007 ceph-mon[31360]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:53.012 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:52 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:53.013 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:52 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:53.013 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:52 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:08:53.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:52 smithi102 ceph-mon[35446]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:53.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:52 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:53.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:52 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:53.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:52 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:08:53.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:52 smithi092 ceph-mon[34940]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:53.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:52 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:53.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:52 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:53.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:52 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:08:54.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:53 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:54.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:53 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:08:54.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:53 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:54.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:53 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:54.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:53 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:08:54.190 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:53 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:54.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:53 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:54.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:53 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:08:54.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:53 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:08:54.980 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:54 smithi007 ceph-mon[31360]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:55.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:54 smithi102 ceph-mon[35446]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:55.198 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:54 smithi092 ceph-mon[34940]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:56.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:55 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T04:08:56.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:55 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:56.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:55 smithi007 ceph-mon[31360]: Deploying daemon osd.0 on smithi007 2024-09-19T04:08:56.278 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:55 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T04:08:56.278 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:55 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:56.278 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:55 smithi102 ceph-mon[35446]: Deploying daemon osd.0 on smithi007 2024-09-19T04:08:56.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:55 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T04:08:56.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:55 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:08:56.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:55 smithi092 ceph-mon[34940]: Deploying daemon osd.0 on smithi007 2024-09-19T04:08:57.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:56 smithi007 ceph-mon[31360]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:57.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:56 smithi092 ceph-mon[34940]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:57.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:56 smithi102 ceph-mon[35446]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:59.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:08:58 smithi092 ceph-mon[34940]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:59.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:08:58 smithi007 ceph-mon[31360]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:08:59.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:08:58 smithi102 ceph-mon[35446]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:09:01.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:00 smithi092 ceph-mon[34940]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:09:01.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:00 smithi007 ceph-mon[31360]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:09:01.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:00 smithi102 ceph-mon[35446]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:09:02.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:01 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:09:02.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:01 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:02.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:01 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:02.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:01 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:09:02.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:01 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:02.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:01 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:02.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:01 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:09:02.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:01 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:02.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:01 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:03.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:02 smithi007 ceph-mon[31360]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:09:03.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:02 smithi092 ceph-mon[34940]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:09:03.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:02 smithi102 ceph-mon[35446]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:09:04.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:04 smithi007 ceph-mon[31360]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:09:04.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:04 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:04.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:04 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:04.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:04 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:04.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:04 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:09:04.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:04 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:04.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:04 smithi102 ceph-mon[35446]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:09:04.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:04 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:04.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:04 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:04.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:04 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:04.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:04 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:09:04.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:04 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:04.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:04 smithi092 ceph-mon[34940]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:09:04.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:04 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:04.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:04 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:04.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:04 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:04.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:04 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:09:04.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:04 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:05.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:05.222+0000 7fdbc08af640 1 -- 172.21.15.7:0/2844586574 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fdbbc062630 con 0x7fdba40394d0 2024-09-19T04:09:05.225 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 0 on host 'smithi007' 2024-09-19T04:09:05.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:05.225+0000 7fdbc18b1640 1 -- 172.21.15.7:0/2844586574 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fdba40394d0 msgr2=0x7fdba403b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:09:05.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:05.225+0000 7fdbc18b1640 1 --2- 172.21.15.7:0/2844586574 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fdba40394d0 0x7fdba403b990 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc102c60 tx=0x7fdbac005f90 comp rx=0 tx=0).stop 2024-09-19T04:09:05.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:05.225+0000 7fdbc18b1640 1 -- 172.21.15.7:0/2844586574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbbc102e00 msgr2=0x7fdbbc0745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:09:05.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:05.225+0000 7fdbc18b1640 1 --2- 172.21.15.7:0/2844586574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbbc102e00 0x7fdbbc0745e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdbb000d950 tx=0x7fdbb000de10 comp rx=0 tx=0).stop 2024-09-19T04:09:05.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:05.225+0000 7fdbc18b1640 1 -- 172.21.15.7:0/2844586574 shutdown_connections 2024-09-19T04:09:05.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:05.225+0000 7fdbc18b1640 1 --2- 172.21.15.7:0/2844586574 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fdba40394d0 0x7fdba403b990 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:09:05.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:05.225+0000 7fdbc18b1640 1 --2- 172.21.15.7:0/2844586574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdbbc1037c0 0x7fdbbc074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:09:05.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:05.225+0000 7fdbc18b1640 1 --2- 172.21.15.7:0/2844586574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdbbc102e00 0x7fdbbc0745e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:09:05.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:05.225+0000 7fdbc18b1640 1 --2- 172.21.15.7:0/2844586574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbbc101c00 0x7fdbbc075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:09:05.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:05.225+0000 7fdbc18b1640 1 -- 172.21.15.7:0/2844586574 >> 172.21.15.7:0/2844586574 conn(0x7fdbbc0fd390 msgr2=0x7fdbbc106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:09:05.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:05.225+0000 7fdbc18b1640 1 -- 172.21.15.7:0/2844586574 shutdown_connections 2024-09-19T04:09:05.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:05.225+0000 7fdbc18b1640 1 -- 172.21.15.7:0/2844586574 wait complete. 2024-09-19T04:09:05.803 DEBUG:teuthology.orchestra.run.smithi007:osd.0> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T04:09:05.806 INFO:tasks.cephadm:Deploying osd.1 on smithi092 with /dev/vg_nvme/lv_4... 2024-09-19T04:09:05.806 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T04:09:06.070 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:09:06.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:06 smithi007 ceph-mon[31360]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:09:06.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:06 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:09:06.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:06 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:06.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:06 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:06.405 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:06 smithi092 ceph-mon[34940]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:09:06.406 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:06 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:09:06.406 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:06 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:06.406 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:06 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:06.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:06 smithi102 ceph-mon[35446]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:09:06.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:06 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:09:06.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:06 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:06.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:06 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:07.127 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 04:09:06 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-0[45116]: 2024-09-19T04:09:06.902+0000 7f12e8be4640 -1 osd.0 0 log_to_monitors true 2024-09-19T04:09:07.363 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:07 smithi092 ceph-mon[34940]: from='osd.0 [v2:172.21.15.7:6802/240599233,v1:172.21.15.7:6803/240599233]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T04:09:07.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:07 smithi102 ceph-mon[35446]: from='osd.0 [v2:172.21.15.7:6802/240599233,v1:172.21.15.7:6803/240599233]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T04:09:07.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:07 smithi007 ceph-mon[31360]: from='osd.0 [v2:172.21.15.7:6802/240599233,v1:172.21.15.7:6803/240599233]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T04:09:08.343 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T04:09:08.368 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi092:vg_nvme/lv_4 2024-09-19T04:09:08.385 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:08 smithi092 ceph-mon[34940]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:09:08.385 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:08 smithi092 ceph-mon[34940]: from='osd.0 [v2:172.21.15.7:6802/240599233,v1:172.21.15.7:6803/240599233]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T04:09:08.385 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:08 smithi092 ceph-mon[34940]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T04:09:08.385 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:08 smithi092 ceph-mon[34940]: from='osd.0 [v2:172.21.15.7:6802/240599233,v1:172.21.15.7:6803/240599233]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-19T04:09:08.385 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:08 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:09:08.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:08 smithi102 ceph-mon[35446]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:09:08.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:08 smithi102 ceph-mon[35446]: from='osd.0 [v2:172.21.15.7:6802/240599233,v1:172.21.15.7:6803/240599233]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T04:09:08.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:08 smithi102 ceph-mon[35446]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T04:09:08.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:08 smithi102 ceph-mon[35446]: from='osd.0 [v2:172.21.15.7:6802/240599233,v1:172.21.15.7:6803/240599233]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-19T04:09:08.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:08 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:09:08.483 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:08 smithi007 ceph-mon[31360]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:09:08.483 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:08 smithi007 ceph-mon[31360]: from='osd.0 [v2:172.21.15.7:6802/240599233,v1:172.21.15.7:6803/240599233]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T04:09:08.483 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:08 smithi007 ceph-mon[31360]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T04:09:08.483 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:08 smithi007 ceph-mon[31360]: from='osd.0 [v2:172.21.15.7:6802/240599233,v1:172.21.15.7:6803/240599233]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-19T04:09:08.483 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:08 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:09:08.617 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:09:08.812 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 04:09:08 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-0[45116]: 2024-09-19T04:09:08.557+0000 7f12e4b67640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T04:09:08.812 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 04:09:08 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-0[45116]: 2024-09-19T04:09:08.560+0000 7f12dc987640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:09:09.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.045+0000 7fd560b2e640 1 -- 172.21.15.92:0/1309839408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd55c100ad0 msgr2=0x7fd55c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:09:09.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.045+0000 7fd560b2e640 1 --2- 172.21.15.92:0/1309839408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd55c100ad0 0x7fd55c100ed0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd550009900 tx=0x7fd55002a410 comp rx=0 tx=0).stop 2024-09-19T04:09:09.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.045+0000 7fd560b2e640 1 -- 172.21.15.92:0/1309839408 shutdown_connections 2024-09-19T04:09:09.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.045+0000 7fd560b2e640 1 --2- 172.21.15.92:0/1309839408 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd55c102690 0x7fd55c108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:09:09.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.045+0000 7fd560b2e640 1 --2- 172.21.15.92:0/1309839408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd55c101cd0 0x7fd55c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:09:09.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.045+0000 7fd560b2e640 1 --2- 172.21.15.92:0/1309839408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd55c100ad0 0x7fd55c100ed0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:09:09.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.045+0000 7fd560b2e640 1 -- 172.21.15.92:0/1309839408 >> 172.21.15.92:0/1309839408 conn(0x7fd55c0fc280 msgr2=0x7fd55c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:09:09.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.045+0000 7fd560b2e640 1 -- 172.21.15.92:0/1309839408 shutdown_connections 2024-09-19T04:09:09.054 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.045+0000 7fd560b2e640 1 -- 172.21.15.92:0/1309839408 wait complete. 2024-09-19T04:09:09.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.046+0000 7fd560b2e640 1 Processor -- start 2024-09-19T04:09:09.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.046+0000 7fd560b2e640 1 -- start start 2024-09-19T04:09:09.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.046+0000 7fd560b2e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd55c100ad0 0x7fd55c197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:09:09.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.046+0000 7fd560b2e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd55c101cd0 0x7fd55c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:09:09.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.046+0000 7fd560b2e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd55c102690 0x7fd55c19f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:09:09.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.046+0000 7fd560b2e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd55c10c800 con 0x7fd55c102690 2024-09-19T04:09:09.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.046+0000 7fd560b2e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd55c10c680 con 0x7fd55c101cd0 2024-09-19T04:09:09.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.046+0000 7fd560b2e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd55c10c980 con 0x7fd55c100ad0 2024-09-19T04:09:09.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.046+0000 7fd559d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd55c101cd0 0x7fd55c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:09:09.055 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.046+0000 7fd559d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd55c101cd0 0x7fd55c198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:52952/0 (socket says 172.21.15.92:52952) 2024-09-19T04:09:09.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.046+0000 7fd559d9b640 1 -- 172.21.15.92:0/2849962221 learned_addr learned my addr 172.21.15.92:0/2849962221 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T04:09:09.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.047+0000 7fd55a59c640 1 --2- 172.21.15.92:0/2849962221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd55c100ad0 0x7fd55c197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:09:09.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.047+0000 7fd55ad9d640 1 --2- 172.21.15.92:0/2849962221 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd55c102690 0x7fd55c19f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:09:09.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.047+0000 7fd559d9b640 1 -- 172.21.15.92:0/2849962221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd55c100ad0 msgr2=0x7fd55c197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:09:09.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.047+0000 7fd559d9b640 1 --2- 172.21.15.92:0/2849962221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd55c100ad0 0x7fd55c197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:09:09.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.047+0000 7fd559d9b640 1 -- 172.21.15.92:0/2849962221 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd55c102690 msgr2=0x7fd55c19f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:09:09.056 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.047+0000 7fd559d9b640 1 --2- 172.21.15.92:0/2849962221 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd55c102690 0x7fd55c19f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:09:09.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.047+0000 7fd559d9b640 1 -- 172.21.15.92:0/2849962221 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd55c19fb10 con 0x7fd55c101cd0 2024-09-19T04:09:09.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.047+0000 7fd559d9b640 1 --2- 172.21.15.92:0/2849962221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd55c101cd0 0x7fd55c198420 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd54c00c920 tx=0x7fd54c00cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:09:09.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.047+0000 7fd54b7fe640 1 -- 172.21.15.92:0/2849962221 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54c007c70 con 0x7fd55c101cd0 2024-09-19T04:09:09.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.047+0000 7fd54b7fe640 1 -- 172.21.15.92:0/2849962221 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd54c007e10 con 0x7fd55c101cd0 2024-09-19T04:09:09.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.047+0000 7fd560b2e640 1 -- 172.21.15.92:0/2849962221 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd55c19fe00 con 0x7fd55c101cd0 2024-09-19T04:09:09.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.047+0000 7fd54b7fe640 1 -- 172.21.15.92:0/2849962221 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54c018890 con 0x7fd55c101cd0 2024-09-19T04:09:09.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.047+0000 7fd560b2e640 1 -- 172.21.15.92:0/2849962221 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd55c1a0330 con 0x7fd55c101cd0 2024-09-19T04:09:09.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.049+0000 7fd560b2e640 1 -- 172.21.15.92:0/2849962221 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd55c1a05c0 con 0x7fd55c101cd0 2024-09-19T04:09:09.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.050+0000 7fd54b7fe640 1 -- 172.21.15.92:0/2849962221 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7fd54c018a30 con 0x7fd55c101cd0 2024-09-19T04:09:09.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.051+0000 7fd54b7fe640 1 --2- 172.21.15.92:0/2849962221 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd5440a31e0 0x7fd5440a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:09:09.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.051+0000 7fd54b7fe640 1 -- 172.21.15.92:0/2849962221 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7fd54c0cddc0 con 0x7fd55c101cd0 2024-09-19T04:09:09.057 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.051+0000 7fd55a59c640 1 --2- 172.21.15.92:0/2849962221 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd5440a31e0 0x7fd5440a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:09:09.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.052+0000 7fd55a59c640 1 --2- 172.21.15.92:0/2849962221 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd5440a31e0 0x7fd5440a56a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd55002aa00 tx=0x7fd5500315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:09:09.058 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.055+0000 7fd54b7fe640 1 -- 172.21.15.92:0/2849962221 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd54c014030 con 0x7fd55c101cd0 2024-09-19T04:09:09.238 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:09.237+0000 7fd560b2e640 1 -- 172.21.15.92:0/2849962221 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fd55c1a0790 con 0x7fd5440a31e0 2024-09-19T04:09:09.239 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:09 smithi092 ceph-mon[34940]: from='osd.0 [v2:172.21.15.7:6802/240599233,v1:172.21.15.7:6803/240599233]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-19T04:09:09.239 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:09 smithi092 ceph-mon[34940]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T04:09:09.239 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:09 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:09:09.239 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:09 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:09:09.239 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:09 smithi092 ceph-mon[34940]: Detected new or changed devices on smithi007 2024-09-19T04:09:09.239 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:09 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:09.240 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:09 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:09.240 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:09 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:09:09.240 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:09 smithi092 ceph-mon[34940]: Adjusting osd_memory_target on smithi007 to 17092M 2024-09-19T04:09:09.240 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:09 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:09.240 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:09 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:09.240 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:09 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:09:09.241 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:09 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:09.241 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:09 smithi092 ceph-mon[34940]: from='osd.0 [v2:172.21.15.7:6802/240599233,v1:172.21.15.7:6803/240599233]' entity='osd.0' 2024-09-19T04:09:09.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:09 smithi102 ceph-mon[35446]: from='osd.0 [v2:172.21.15.7:6802/240599233,v1:172.21.15.7:6803/240599233]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-19T04:09:09.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:09 smithi102 ceph-mon[35446]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T04:09:09.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:09 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:09:09.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:09 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:09:09.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:09 smithi102 ceph-mon[35446]: Detected new or changed devices on smithi007 2024-09-19T04:09:09.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:09 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:09.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:09 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:09.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:09 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:09:09.410 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:09 smithi102 ceph-mon[35446]: Adjusting osd_memory_target on smithi007 to 17092M 2024-09-19T04:09:09.410 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:09 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:09.410 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:09 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:09.410 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:09 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:09:09.410 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:09 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:09.410 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:09 smithi102 ceph-mon[35446]: from='osd.0 [v2:172.21.15.7:6802/240599233,v1:172.21.15.7:6803/240599233]' entity='osd.0' 2024-09-19T04:09:09.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:09 smithi007 ceph-mon[31360]: from='osd.0 [v2:172.21.15.7:6802/240599233,v1:172.21.15.7:6803/240599233]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-19T04:09:09.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:09 smithi007 ceph-mon[31360]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T04:09:09.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:09 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:09:09.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:09 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:09:09.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:09 smithi007 ceph-mon[31360]: Detected new or changed devices on smithi007 2024-09-19T04:09:09.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:09 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:09.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:09 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:09.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:09 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:09:09.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:09 smithi007 ceph-mon[31360]: Adjusting osd_memory_target on smithi007 to 17092M 2024-09-19T04:09:09.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:09 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:09.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:09 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:09.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:09 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:09:09.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:09 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:09.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:09 smithi007 ceph-mon[31360]: from='osd.0 [v2:172.21.15.7:6802/240599233,v1:172.21.15.7:6803/240599233]' entity='osd.0' 2024-09-19T04:09:10.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:10 smithi092 ceph-mon[34940]: purged_snaps scrub starts 2024-09-19T04:09:10.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:10 smithi092 ceph-mon[34940]: purged_snaps scrub ok 2024-09-19T04:09:10.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:10 smithi092 ceph-mon[34940]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:09:10.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:10 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:09:10.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:10 smithi092 ceph-mon[34940]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:09:10.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:10 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:09:10.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:10 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:09:10.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:10 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:10.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:10 smithi092 ceph-mon[34940]: osd.0 [v2:172.21.15.7:6802/240599233,v1:172.21.15.7:6803/240599233] boot 2024-09-19T04:09:10.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:10 smithi092 ceph-mon[34940]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T04:09:10.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:10 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:09:10.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:10 smithi102 ceph-mon[35446]: purged_snaps scrub starts 2024-09-19T04:09:10.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:10 smithi102 ceph-mon[35446]: purged_snaps scrub ok 2024-09-19T04:09:10.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:10 smithi102 ceph-mon[35446]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:09:10.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:10 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:09:10.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:10 smithi102 ceph-mon[35446]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:09:10.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:10 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:09:10.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:10 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:09:10.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:10 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:10.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:10 smithi102 ceph-mon[35446]: osd.0 [v2:172.21.15.7:6802/240599233,v1:172.21.15.7:6803/240599233] boot 2024-09-19T04:09:10.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:10 smithi102 ceph-mon[35446]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T04:09:10.410 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:10 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:09:10.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:10 smithi007 ceph-mon[31360]: purged_snaps scrub starts 2024-09-19T04:09:10.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:10 smithi007 ceph-mon[31360]: purged_snaps scrub ok 2024-09-19T04:09:10.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:10 smithi007 ceph-mon[31360]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:09:10.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:10 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:09:10.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:10 smithi007 ceph-mon[31360]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:09:10.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:10 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:09:10.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:10 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:09:10.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:10 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:10.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:10 smithi007 ceph-mon[31360]: osd.0 [v2:172.21.15.7:6802/240599233,v1:172.21.15.7:6803/240599233] boot 2024-09-19T04:09:10.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:10 smithi007 ceph-mon[31360]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T04:09:10.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:10 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:09:11.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:11 smithi007 ceph-mon[31360]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T04:09:11.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:11 smithi007 ceph-mon[31360]: from='client.? 172.21.15.92:0/511727524' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db5793e6-f3ad-4075-a02b-206bf7f1e59a"}]: dispatch 2024-09-19T04:09:11.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:11 smithi007 ceph-mon[31360]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db5793e6-f3ad-4075-a02b-206bf7f1e59a"}]: dispatch 2024-09-19T04:09:11.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:11 smithi007 ceph-mon[31360]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "db5793e6-f3ad-4075-a02b-206bf7f1e59a"}]': finished 2024-09-19T04:09:11.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:11 smithi007 ceph-mon[31360]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T04:09:11.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:11 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:09:11.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:11 smithi102 ceph-mon[35446]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T04:09:11.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:11 smithi102 ceph-mon[35446]: from='client.? 172.21.15.92:0/511727524' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db5793e6-f3ad-4075-a02b-206bf7f1e59a"}]: dispatch 2024-09-19T04:09:11.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:11 smithi102 ceph-mon[35446]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db5793e6-f3ad-4075-a02b-206bf7f1e59a"}]: dispatch 2024-09-19T04:09:11.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:11 smithi102 ceph-mon[35446]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "db5793e6-f3ad-4075-a02b-206bf7f1e59a"}]': finished 2024-09-19T04:09:11.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:11 smithi102 ceph-mon[35446]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T04:09:11.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:11 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:09:12.033 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:11 smithi092 ceph-mon[34940]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T04:09:12.033 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:11 smithi092 ceph-mon[34940]: from='client.? 172.21.15.92:0/511727524' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db5793e6-f3ad-4075-a02b-206bf7f1e59a"}]: dispatch 2024-09-19T04:09:12.033 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:11 smithi092 ceph-mon[34940]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db5793e6-f3ad-4075-a02b-206bf7f1e59a"}]: dispatch 2024-09-19T04:09:12.033 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:11 smithi092 ceph-mon[34940]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "db5793e6-f3ad-4075-a02b-206bf7f1e59a"}]': finished 2024-09-19T04:09:12.033 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:11 smithi092 ceph-mon[34940]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T04:09:12.033 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:11 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:09:12.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:12 smithi007 ceph-mon[31360]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:12.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:12 smithi007 ceph-mon[31360]: from='client.? 172.21.15.92:0/807023280' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:09:12.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:12 smithi102 ceph-mon[35446]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:12.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:12 smithi102 ceph-mon[35446]: from='client.? 172.21.15.92:0/807023280' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:09:13.046 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:12 smithi092 ceph-mon[34940]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:13.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:12 smithi092 ceph-mon[34940]: from='client.? 172.21.15.92:0/807023280' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:09:14.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:14 smithi007 ceph-mon[31360]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:14.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:14 smithi102 ceph-mon[35446]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:15.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:14 smithi092 ceph-mon[34940]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:16.650 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:16 smithi092 ceph-mon[34940]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:16.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:16 smithi007 ceph-mon[31360]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:16.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:16 smithi102 ceph-mon[35446]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:18.612 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:18 smithi092 ceph-mon[34940]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:18.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:18 smithi007 ceph-mon[31360]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:18.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:18 smithi102 ceph-mon[35446]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:19.847 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:19 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T04:09:19.847 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:19 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:19.876 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:19 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T04:09:19.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:19 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:19.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:19 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T04:09:19.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:19 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:20.662 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:20 smithi007 ceph-mon[31360]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:20.663 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:20 smithi007 ceph-mon[31360]: Deploying daemon osd.1 on smithi092 2024-09-19T04:09:20.788 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:20 smithi092 ceph-mon[34940]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:20.789 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:20 smithi092 ceph-mon[34940]: Deploying daemon osd.1 on smithi092 2024-09-19T04:09:20.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:20 smithi102 ceph-mon[35446]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:20.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:20 smithi102 ceph-mon[35446]: Deploying daemon osd.1 on smithi092 2024-09-19T04:09:22.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:22 smithi007 ceph-mon[31360]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:22.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:22 smithi102 ceph-mon[35446]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:23.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:22 smithi092 ceph-mon[34940]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:24.751 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:24 smithi092 ceph-mon[34940]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:24.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:24 smithi007 ceph-mon[31360]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:24.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:24 smithi102 ceph-mon[35446]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:25.875 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:25 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:09:25.875 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:25 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:25.876 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:25 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:25.876 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:25 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:09:25.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:25 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:25.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:25 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:25.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:25 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:09:25.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:25 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:25.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:25 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:26.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:26 smithi092 ceph-mon[34940]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:26.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:26 smithi007 ceph-mon[31360]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:26.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:26 smithi102 ceph-mon[35446]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:28.955 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:28 smithi092 ceph-mon[34940]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:28.955 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:28.955 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:28.955 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:28.956 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:09:28.956 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:29.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:28 smithi007 ceph-mon[31360]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:29.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:28 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:29.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:28 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:29.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:28 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:29.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:28 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:09:29.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:28 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:29.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:28 smithi102 ceph-mon[35446]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:29.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:28 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:29.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:28 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:29.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:28 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:29.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:28 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:09:29.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:28 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:29.271 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:29.269+0000 7fd54b7fe640 1 -- 172.21.15.92:0/2849962221 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd55c1a0790 con 0x7fd5440a31e0 2024-09-19T04:09:29.271 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 1 on host 'smithi092' 2024-09-19T04:09:29.272 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:29.271+0000 7fd560b2e640 1 -- 172.21.15.92:0/2849962221 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd5440a31e0 msgr2=0x7fd5440a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:09:29.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:29.271+0000 7fd560b2e640 1 --2- 172.21.15.92:0/2849962221 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd5440a31e0 0x7fd5440a56a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd55002aa00 tx=0x7fd5500315b0 comp rx=0 tx=0).stop 2024-09-19T04:09:29.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:29.271+0000 7fd560b2e640 1 -- 172.21.15.92:0/2849962221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd55c101cd0 msgr2=0x7fd55c198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:09:29.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:29.271+0000 7fd560b2e640 1 --2- 172.21.15.92:0/2849962221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd55c101cd0 0x7fd55c198420 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd54c00c920 tx=0x7fd54c00cde0 comp rx=0 tx=0).stop 2024-09-19T04:09:29.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:29.271+0000 7fd560b2e640 1 -- 172.21.15.92:0/2849962221 shutdown_connections 2024-09-19T04:09:29.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:29.271+0000 7fd560b2e640 1 --2- 172.21.15.92:0/2849962221 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd5440a31e0 0x7fd5440a56a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:09:29.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:29.271+0000 7fd560b2e640 1 --2- 172.21.15.92:0/2849962221 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd55c102690 0x7fd55c19f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:09:29.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:29.271+0000 7fd560b2e640 1 --2- 172.21.15.92:0/2849962221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd55c101cd0 0x7fd55c198420 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:09:29.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:29.271+0000 7fd560b2e640 1 --2- 172.21.15.92:0/2849962221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd55c100ad0 0x7fd55c197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:09:29.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:29.271+0000 7fd560b2e640 1 -- 172.21.15.92:0/2849962221 >> 172.21.15.92:0/2849962221 conn(0x7fd55c0fc280 msgr2=0x7fd55c06a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:09:29.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:29.271+0000 7fd560b2e640 1 -- 172.21.15.92:0/2849962221 shutdown_connections 2024-09-19T04:09:29.273 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:09:29.271+0000 7fd560b2e640 1 -- 172.21.15.92:0/2849962221 wait complete. 2024-09-19T04:09:29.983 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:29 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:09:29.983 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:29 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:29.983 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:29 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:29.985 DEBUG:teuthology.orchestra.run.smithi092:osd.1> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T04:09:30.028 INFO:tasks.cephadm:Deploying osd.2 on smithi102 with /dev/vg_nvme/lv_4... 2024-09-19T04:09:30.028 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T04:09:30.055 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:29 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:09:30.055 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:29 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:30.056 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:29 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:30.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:29 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:09:30.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:29 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:30.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:29 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:30.279 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:09:30.730 INFO:journalctl@ceph.osd.1.smithi092.stdout:Sep 19 04:09:30 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-1[39397]: 2024-09-19T04:09:30.411+0000 7f4a9f8c9640 -1 osd.1 0 log_to_monitors true 2024-09-19T04:09:31.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:30 smithi092 ceph-mon[34940]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:31.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:30 smithi092 ceph-mon[34940]: from='osd.1 [v2:172.21.15.92:6800/902403333,v1:172.21.15.92:6801/902403333]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T04:09:31.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:30 smithi092 ceph-mon[34940]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T04:09:31.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:30 smithi007 ceph-mon[31360]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:31.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:30 smithi007 ceph-mon[31360]: from='osd.1 [v2:172.21.15.92:6800/902403333,v1:172.21.15.92:6801/902403333]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T04:09:31.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:30 smithi007 ceph-mon[31360]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T04:09:31.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:30 smithi102 ceph-mon[35446]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:31.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:30 smithi102 ceph-mon[35446]: from='osd.1 [v2:172.21.15.92:6800/902403333,v1:172.21.15.92:6801/902403333]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T04:09:31.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:30 smithi102 ceph-mon[35446]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T04:09:31.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:31 smithi102 ceph-mon[35446]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T04:09:31.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:31 smithi102 ceph-mon[35446]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T04:09:31.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:31 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:09:31.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:31 smithi102 ceph-mon[35446]: from='osd.1 [v2:172.21.15.92:6800/902403333,v1:172.21.15.92:6801/902403333]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T04:09:31.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:31 smithi102 ceph-mon[35446]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T04:09:32.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:31 smithi092 ceph-mon[34940]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T04:09:32.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:31 smithi092 ceph-mon[34940]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T04:09:32.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:31 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:09:32.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:31 smithi092 ceph-mon[34940]: from='osd.1 [v2:172.21.15.92:6800/902403333,v1:172.21.15.92:6801/902403333]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T04:09:32.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:31 smithi092 ceph-mon[34940]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T04:09:32.048 INFO:journalctl@ceph.osd.1.smithi092.stdout:Sep 19 04:09:31 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-1[39397]: 2024-09-19T04:09:31.737+0000 7f4a9b84c640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T04:09:32.048 INFO:journalctl@ceph.osd.1.smithi092.stdout:Sep 19 04:09:31 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-1[39397]: 2024-09-19T04:09:31.740+0000 7f4a97674640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:09:32.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:31 smithi007 ceph-mon[31360]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T04:09:32.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:31 smithi007 ceph-mon[31360]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T04:09:32.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:31 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:09:32.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:31 smithi007 ceph-mon[31360]: from='osd.1 [v2:172.21.15.92:6800/902403333,v1:172.21.15.92:6801/902403333]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T04:09:32.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:31 smithi007 ceph-mon[31360]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T04:09:32.689 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T04:09:32.714 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi102:vg_nvme/lv_4 2024-09-19T04:09:32.999 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:09:33.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:32 smithi092 ceph-mon[34940]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:33.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:32 smithi092 ceph-mon[34940]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-19T04:09:33.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:32 smithi092 ceph-mon[34940]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T04:09:33.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:32 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:09:33.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:32 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:09:33.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:32 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:33.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:32 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:33.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:32 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:09:33.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:32 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:33.112 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:32 smithi102 ceph-mon[35446]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:33.112 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:32 smithi102 ceph-mon[35446]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-19T04:09:33.112 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:32 smithi102 ceph-mon[35446]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T04:09:33.112 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:32 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:09:33.112 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:32 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:09:33.112 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:32 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:33.112 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:32 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:33.112 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:32 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:09:33.112 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:32 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:33.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:32 smithi007 ceph-mon[31360]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:09:33.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:32 smithi007 ceph-mon[31360]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-19T04:09:33.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:32 smithi007 ceph-mon[31360]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T04:09:33.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:32 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:09:33.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:32 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:09:33.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:32 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:33.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:32 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:33.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:32 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:09:33.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:32 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:33.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.423+0000 7fe0f4257640 1 -- 172.21.15.102:0/829854267 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0ec100de0 msgr2=0x7fe0ec101260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:09:33.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.423+0000 7fe0f4257640 1 --2- 172.21.15.102:0/829854267 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0ec100de0 0x7fe0ec101260 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0009900 tx=0x7fe0e002a410 comp rx=0 tx=0).stop 2024-09-19T04:09:33.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.423+0000 7fe0f4257640 1 -- 172.21.15.102:0/829854267 shutdown_connections 2024-09-19T04:09:33.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.423+0000 7fe0f4257640 1 --2- 172.21.15.102:0/829854267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0ec1017a0 0x7fe0ec109040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:09:33.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.423+0000 7fe0f4257640 1 --2- 172.21.15.102:0/829854267 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0ec100de0 0x7fe0ec101260 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:09:33.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.423+0000 7fe0f4257640 1 --2- 172.21.15.102:0/829854267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0ec1020a0 0x7fe0ec1024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:09:33.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.423+0000 7fe0f4257640 1 -- 172.21.15.102:0/829854267 >> 172.21.15.102:0/829854267 conn(0x7fe0ec0fba40 msgr2=0x7fe0ec0fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:09:33.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.423+0000 7fe0f4257640 1 -- 172.21.15.102:0/829854267 shutdown_connections 2024-09-19T04:09:33.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.423+0000 7fe0f4257640 1 -- 172.21.15.102:0/829854267 wait complete. 2024-09-19T04:09:33.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.423+0000 7fe0f4257640 1 Processor -- start 2024-09-19T04:09:33.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.423+0000 7fe0f4257640 1 -- start start 2024-09-19T04:09:33.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.424+0000 7fe0f4257640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0ec100de0 0x7fe0ec196df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:09:33.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.424+0000 7fe0f4257640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0ec1017a0 0x7fe0ec197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:09:33.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.424+0000 7fe0f4257640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0ec1020a0 0x7fe0ec19e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:09:33.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.424+0000 7fe0f4257640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec10c7a0 con 0x7fe0ec100de0 2024-09-19T04:09:33.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.424+0000 7fe0f4257640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec10c620 con 0x7fe0ec1020a0 2024-09-19T04:09:33.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.424+0000 7fe0f4257640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec10c920 con 0x7fe0ec1017a0 2024-09-19T04:09:33.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.424+0000 7fe0f17f2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0ec1017a0 0x7fe0ec197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:09:33.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.424+0000 7fe0f17f2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0ec1017a0 0x7fe0ec197330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:58266/0 (socket says 172.21.15.102:58266) 2024-09-19T04:09:33.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.424+0000 7fe0f17f2640 1 -- 172.21.15.102:0/2701161195 learned_addr learned my addr 172.21.15.102:0/2701161195 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T04:09:33.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.424+0000 7fe0f1ff3640 1 --2- 172.21.15.102:0/2701161195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0ec100de0 0x7fe0ec196df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:09:33.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.424+0000 7fe0f27f4640 1 --2- 172.21.15.102:0/2701161195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0ec1020a0 0x7fe0ec19e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:09:33.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.424+0000 7fe0f17f2640 1 -- 172.21.15.102:0/2701161195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0ec1020a0 msgr2=0x7fe0ec19e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:09:33.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.424+0000 7fe0f17f2640 1 --2- 172.21.15.102:0/2701161195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0ec1020a0 0x7fe0ec19e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:09:33.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.424+0000 7fe0f17f2640 1 -- 172.21.15.102:0/2701161195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0ec100de0 msgr2=0x7fe0ec196df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:09:33.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.424+0000 7fe0f17f2640 1 --2- 172.21.15.102:0/2701161195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0ec100de0 0x7fe0ec196df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:09:33.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.424+0000 7fe0f17f2640 1 -- 172.21.15.102:0/2701161195 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0ec19ea20 con 0x7fe0ec1017a0 2024-09-19T04:09:33.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.424+0000 7fe0f27f4640 1 --2- 172.21.15.102:0/2701161195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0ec1020a0 0x7fe0ec19e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:09:33.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.424+0000 7fe0f1ff3640 1 --2- 172.21.15.102:0/2701161195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0ec100de0 0x7fe0ec196df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:09:33.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.424+0000 7fe0f17f2640 1 --2- 172.21.15.102:0/2701161195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0ec1017a0 0x7fe0ec197330 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0005940 tx=0x7fe0e0004360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:09:33.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.424+0000 7fe0eaffd640 1 -- 172.21.15.102:0/2701161195 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e003f030 con 0x7fe0ec1017a0 2024-09-19T04:09:33.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.424+0000 7fe0eaffd640 1 -- 172.21.15.102:0/2701161195 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0e0003ce0 con 0x7fe0ec1017a0 2024-09-19T04:09:33.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.424+0000 7fe0f4257640 1 -- 172.21.15.102:0/2701161195 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0ec19ecb0 con 0x7fe0ec1017a0 2024-09-19T04:09:33.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.424+0000 7fe0eaffd640 1 -- 172.21.15.102:0/2701161195 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0035070 con 0x7fe0ec1017a0 2024-09-19T04:09:33.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.424+0000 7fe0f4257640 1 -- 172.21.15.102:0/2701161195 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0ec19f1b0 con 0x7fe0ec1017a0 2024-09-19T04:09:33.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.425+0000 7fe0f4257640 1 -- 172.21.15.102:0/2701161195 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0ec107ff0 con 0x7fe0ec1017a0 2024-09-19T04:09:33.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.426+0000 7fe0eaffd640 1 -- 172.21.15.102:0/2701161195 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7fe0e0042030 con 0x7fe0ec1017a0 2024-09-19T04:09:33.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.427+0000 7fe0eaffd640 1 --2- 172.21.15.102:0/2701161195 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe0d40a3260 0x7fe0d40a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:09:33.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.427+0000 7fe0eaffd640 1 -- 172.21.15.102:0/2701161195 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2309+0+0 (secure 0 0 0) 0x7fe0e00ee6a0 con 0x7fe0ec1017a0 2024-09-19T04:09:33.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.427+0000 7fe0f1ff3640 1 --2- 172.21.15.102:0/2701161195 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe0d40a3260 0x7fe0d40a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:09:33.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.428+0000 7fe0f1ff3640 1 --2- 172.21.15.102:0/2701161195 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe0d40a3260 0x7fe0d40a5720 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec06a510 tx=0x7fe0e4005db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:09:33.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.431+0000 7fe0eaffd640 1 -- 172.21.15.102:0/2701161195 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe0e00bcc10 con 0x7fe0ec1017a0 2024-09-19T04:09:33.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:33.607+0000 7fe0f4257640 1 -- 172.21.15.102:0/2701161195 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fe0ec062630 con 0x7fe0d40a3260 2024-09-19T04:09:34.016 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:33 smithi102 ceph-mon[35446]: purged_snaps scrub starts 2024-09-19T04:09:34.016 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:33 smithi102 ceph-mon[35446]: purged_snaps scrub ok 2024-09-19T04:09:34.016 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:33 smithi102 ceph-mon[35446]: Detected new or changed devices on smithi092 2024-09-19T04:09:34.016 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:33 smithi102 ceph-mon[35446]: Adjusting osd_memory_target on smithi092 to 17088M 2024-09-19T04:09:34.016 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:33 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:34.016 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:33 smithi102 ceph-mon[35446]: osd.1 [v2:172.21.15.92:6800/902403333,v1:172.21.15.92:6801/902403333] boot 2024-09-19T04:09:34.016 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:33 smithi102 ceph-mon[35446]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T04:09:34.016 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:33 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:09:34.016 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:33 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:09:34.017 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:33 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:34.017 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:33 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:09:34.017 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:33 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:09:34.017 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:33 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:34.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:33 smithi092 ceph-mon[34940]: purged_snaps scrub starts 2024-09-19T04:09:34.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:33 smithi092 ceph-mon[34940]: purged_snaps scrub ok 2024-09-19T04:09:34.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:33 smithi092 ceph-mon[34940]: Detected new or changed devices on smithi092 2024-09-19T04:09:34.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:33 smithi092 ceph-mon[34940]: Adjusting osd_memory_target on smithi092 to 17088M 2024-09-19T04:09:34.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:33 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:34.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:33 smithi092 ceph-mon[34940]: osd.1 [v2:172.21.15.92:6800/902403333,v1:172.21.15.92:6801/902403333] boot 2024-09-19T04:09:34.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:33 smithi092 ceph-mon[34940]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T04:09:34.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:33 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:09:34.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:33 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:09:34.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:33 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:34.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:33 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:09:34.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:33 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:09:34.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:33 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:34.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:33 smithi007 ceph-mon[31360]: purged_snaps scrub starts 2024-09-19T04:09:34.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:33 smithi007 ceph-mon[31360]: purged_snaps scrub ok 2024-09-19T04:09:34.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:33 smithi007 ceph-mon[31360]: Detected new or changed devices on smithi092 2024-09-19T04:09:34.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:33 smithi007 ceph-mon[31360]: Adjusting osd_memory_target on smithi092 to 17088M 2024-09-19T04:09:34.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:33 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:34.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:33 smithi007 ceph-mon[31360]: osd.1 [v2:172.21.15.92:6800/902403333,v1:172.21.15.92:6801/902403333] boot 2024-09-19T04:09:34.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:33 smithi007 ceph-mon[31360]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T04:09:34.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:33 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:09:34.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:33 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:09:34.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:33 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:34.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:33 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:09:34.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:33 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:09:34.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:33 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:35.034 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:34 smithi102 ceph-mon[35446]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:35.034 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:34 smithi102 ceph-mon[35446]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:09:35.034 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:34 smithi102 ceph-mon[35446]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T04:09:35.046 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:34 smithi092 ceph-mon[34940]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:35.046 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:34 smithi092 ceph-mon[34940]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:09:35.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:34 smithi092 ceph-mon[34940]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T04:09:35.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:34 smithi007 ceph-mon[31360]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:35.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:34 smithi007 ceph-mon[31360]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:09:35.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:34 smithi007 ceph-mon[31360]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T04:09:37.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:36 smithi092 ceph-mon[34940]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:37.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:36 smithi092 ceph-mon[34940]: from='client.? 172.21.15.102:0/2500180844' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1eb83a1b-82d8-4983-bae3-b161adb3a33a"}]: dispatch 2024-09-19T04:09:37.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:36 smithi092 ceph-mon[34940]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1eb83a1b-82d8-4983-bae3-b161adb3a33a"}]: dispatch 2024-09-19T04:09:37.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:36 smithi092 ceph-mon[34940]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1eb83a1b-82d8-4983-bae3-b161adb3a33a"}]': finished 2024-09-19T04:09:37.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:36 smithi092 ceph-mon[34940]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T04:09:37.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:36 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:09:37.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:36 smithi092 ceph-mon[34940]: from='client.? 172.21.15.102:0/2319804730' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:09:37.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:36 smithi007 ceph-mon[31360]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:37.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:36 smithi007 ceph-mon[31360]: from='client.? 172.21.15.102:0/2500180844' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1eb83a1b-82d8-4983-bae3-b161adb3a33a"}]: dispatch 2024-09-19T04:09:37.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:36 smithi007 ceph-mon[31360]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1eb83a1b-82d8-4983-bae3-b161adb3a33a"}]: dispatch 2024-09-19T04:09:37.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:36 smithi007 ceph-mon[31360]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1eb83a1b-82d8-4983-bae3-b161adb3a33a"}]': finished 2024-09-19T04:09:37.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:36 smithi007 ceph-mon[31360]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T04:09:37.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:36 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:09:37.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:36 smithi007 ceph-mon[31360]: from='client.? 172.21.15.102:0/2319804730' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:09:37.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:36 smithi102 ceph-mon[35446]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:37.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:36 smithi102 ceph-mon[35446]: from='client.? 172.21.15.102:0/2500180844' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1eb83a1b-82d8-4983-bae3-b161adb3a33a"}]: dispatch 2024-09-19T04:09:37.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:36 smithi102 ceph-mon[35446]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1eb83a1b-82d8-4983-bae3-b161adb3a33a"}]: dispatch 2024-09-19T04:09:37.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:36 smithi102 ceph-mon[35446]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1eb83a1b-82d8-4983-bae3-b161adb3a33a"}]': finished 2024-09-19T04:09:37.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:36 smithi102 ceph-mon[35446]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T04:09:37.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:36 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:09:37.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:36 smithi102 ceph-mon[35446]: from='client.? 172.21.15.102:0/2319804730' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:09:39.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:38 smithi092 ceph-mon[34940]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:39.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:38 smithi007 ceph-mon[31360]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:39.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:38 smithi102 ceph-mon[35446]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:41.046 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:40 smithi092 ceph-mon[34940]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:41.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:40 smithi007 ceph-mon[31360]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:41.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:40 smithi102 ceph-mon[35446]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:43.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:42 smithi092 ceph-mon[34940]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:43.094 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:42 smithi102 ceph-mon[35446]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:43.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:42 smithi007 ceph-mon[31360]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:44.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:43 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T04:09:44.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:43 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:44.119 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:43 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T04:09:44.119 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:43 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:44.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:43 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T04:09:44.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:43 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:45.025 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:44 smithi102 ceph-mon[35446]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:45.026 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:44 smithi102 ceph-mon[35446]: Deploying daemon osd.2 on smithi102 2024-09-19T04:09:45.046 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:44 smithi092 ceph-mon[34940]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:45.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:44 smithi092 ceph-mon[34940]: Deploying daemon osd.2 on smithi102 2024-09-19T04:09:45.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:44 smithi007 ceph-mon[31360]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:45.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:44 smithi007 ceph-mon[31360]: Deploying daemon osd.2 on smithi102 2024-09-19T04:09:47.046 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:46 smithi092 ceph-mon[34940]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:47.079 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:46 smithi102 ceph-mon[35446]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:47.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:46 smithi007 ceph-mon[31360]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:49.046 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:48 smithi092 ceph-mon[34940]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:49.082 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:48 smithi102 ceph-mon[35446]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:49.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:48 smithi007 ceph-mon[31360]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:50.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:50 smithi102 ceph-mon[35446]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:50.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:50 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:09:50.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:50 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:50.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:50 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:51.046 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:50 smithi092 ceph-mon[34940]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:51.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:50 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:09:51.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:50 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:51.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:50 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:51.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:50 smithi007 ceph-mon[31360]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:51.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:50 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:09:51.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:50 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:51.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:50 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:53.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:52 smithi092 ceph-mon[34940]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:53.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:52 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:53.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:52 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:53.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:52 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:53.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:52 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:09:53.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:52 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:53.077 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:52 smithi102 ceph-mon[35446]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:53.077 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:52 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:53.077 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:52 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:53.077 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:52 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:53.077 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:52 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:09:53.078 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:52 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:53.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:52 smithi007 ceph-mon[31360]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:53.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:52 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:53.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:52 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:53.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:52 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:53.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:52 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:09:53.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:52 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:53.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:53.359+0000 7fe0eaffd640 1 -- 172.21.15.102:0/2701161195 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe0ec062630 con 0x7fe0d40a3260 2024-09-19T04:09:53.361 INFO:teuthology.orchestra.run.smithi102.stdout:Created osd(s) 2 on host 'smithi102' 2024-09-19T04:09:53.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:53.361+0000 7fe0f4257640 1 -- 172.21.15.102:0/2701161195 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe0d40a3260 msgr2=0x7fe0d40a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:09:53.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:53.361+0000 7fe0f4257640 1 --2- 172.21.15.102:0/2701161195 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe0d40a3260 0x7fe0d40a5720 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec06a510 tx=0x7fe0e4005db0 comp rx=0 tx=0).stop 2024-09-19T04:09:53.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:53.361+0000 7fe0f4257640 1 -- 172.21.15.102:0/2701161195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0ec1017a0 msgr2=0x7fe0ec197330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:09:53.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:53.361+0000 7fe0f4257640 1 --2- 172.21.15.102:0/2701161195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0ec1017a0 0x7fe0ec197330 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0005940 tx=0x7fe0e0004360 comp rx=0 tx=0).stop 2024-09-19T04:09:53.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:53.361+0000 7fe0f4257640 1 -- 172.21.15.102:0/2701161195 shutdown_connections 2024-09-19T04:09:53.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:53.361+0000 7fe0f4257640 1 --2- 172.21.15.102:0/2701161195 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe0d40a3260 0x7fe0d40a5720 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:09:53.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:53.361+0000 7fe0f4257640 1 --2- 172.21.15.102:0/2701161195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0ec1020a0 0x7fe0ec19e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:09:53.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:53.361+0000 7fe0f4257640 1 --2- 172.21.15.102:0/2701161195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0ec1017a0 0x7fe0ec197330 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:09:53.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:53.361+0000 7fe0f4257640 1 --2- 172.21.15.102:0/2701161195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe0ec100de0 0x7fe0ec196df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:09:53.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:53.361+0000 7fe0f4257640 1 -- 172.21.15.102:0/2701161195 >> 172.21.15.102:0/2701161195 conn(0x7fe0ec0fba40 msgr2=0x7fe0ec1051c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:09:53.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:53.361+0000 7fe0f4257640 1 -- 172.21.15.102:0/2701161195 shutdown_connections 2024-09-19T04:09:53.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:09:53.361+0000 7fe0f4257640 1 -- 172.21.15.102:0/2701161195 wait complete. 2024-09-19T04:09:53.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:53 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:09:53.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:53 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:53.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:53 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:53.976 DEBUG:teuthology.orchestra.run.smithi102:osd.2> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T04:09:53.978 INFO:tasks.cephadm:Deploying osd.3 on smithi007 with /dev/vg_nvme/lv_3... 2024-09-19T04:09:53.978 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T04:09:54.046 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:53 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:09:54.046 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:53 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:54.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:53 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:54.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:53 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:09:54.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:53 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:54.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:53 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:54.248 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:09:55.005 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:54 smithi102 ceph-mon[35446]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:55.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:54 smithi092 ceph-mon[34940]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:55.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:54 smithi007 ceph-mon[31360]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:56.262 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 19 04:09:55 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-2[40411]: 2024-09-19T04:09:55.936+0000 7f0d640f3640 -1 osd.2 0 log_to_monitors true 2024-09-19T04:09:56.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:56 smithi007 ceph-mon[31360]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:56.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:56 smithi007 ceph-mon[31360]: from='osd.2 [v2:172.21.15.102:6800/2078441772,v1:172.21.15.102:6801/2078441772]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T04:09:56.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:56 smithi007 ceph-mon[31360]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T04:09:56.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:56 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:56.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:56 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:56.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:56 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:09:56.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:56 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:56.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:56 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:56.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:56 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:09:56.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:56 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:56.881 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:56 smithi102 ceph-mon[35446]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:56.881 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:56 smithi102 ceph-mon[35446]: from='osd.2 [v2:172.21.15.102:6800/2078441772,v1:172.21.15.102:6801/2078441772]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T04:09:56.881 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:56 smithi102 ceph-mon[35446]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T04:09:56.881 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:56 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:56.881 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:56 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:56.882 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:56 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:09:56.882 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:56 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:56.882 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:56 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:56.882 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:56 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:09:56.882 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:56 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:56.882 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:09:56.915 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi007:vg_nvme/lv_3 2024-09-19T04:09:57.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:56 smithi092 ceph-mon[34940]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:57.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:56 smithi092 ceph-mon[34940]: from='osd.2 [v2:172.21.15.102:6800/2078441772,v1:172.21.15.102:6801/2078441772]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T04:09:57.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:56 smithi092 ceph-mon[34940]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T04:09:57.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:56 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:57.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:56 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:57.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:56 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:09:57.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:56 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:57.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:56 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:57.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:56 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:09:57.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:56 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:09:57.172 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:09:57.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.768+0000 7fab42030640 1 -- 172.21.15.7:0/3208750093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab3c101770 msgr2=0x7fab3c101c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:09:57.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.768+0000 7fab42030640 1 --2- 172.21.15.7:0/3208750093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab3c101770 0x7fab3c101c20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fab34009ca0 tx=0x7fab3402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:09:57.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.768+0000 7fab42030640 1 -- 172.21.15.7:0/3208750093 shutdown_connections 2024-09-19T04:09:57.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.768+0000 7fab42030640 1 --2- 172.21.15.7:0/3208750093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab3c101770 0x7fab3c101c20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:09:57.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.768+0000 7fab42030640 1 --2- 172.21.15.7:0/3208750093 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab3c100dd0 0x7fab3c101230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:09:57.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.768+0000 7fab42030640 1 --2- 172.21.15.7:0/3208750093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab3c100490 0x7fab3c100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:09:57.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.768+0000 7fab42030640 1 -- 172.21.15.7:0/3208750093 >> 172.21.15.7:0/3208750093 conn(0x7fab3c0fc2a0 msgr2=0x7fab3c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:09:57.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.768+0000 7fab42030640 1 -- 172.21.15.7:0/3208750093 shutdown_connections 2024-09-19T04:09:57.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.768+0000 7fab42030640 1 -- 172.21.15.7:0/3208750093 wait complete. 2024-09-19T04:09:57.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.769+0000 7fab42030640 1 Processor -- start 2024-09-19T04:09:57.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.769+0000 7fab42030640 1 -- start start 2024-09-19T04:09:57.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.769+0000 7fab42030640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab3c100490 0x7fab3c19a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:09:57.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.769+0000 7fab42030640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab3c100dd0 0x7fab3c19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:09:57.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.769+0000 7fab42030640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab3c101770 0x7fab3c1a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:09:57.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.769+0000 7fab42030640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c10fa80 con 0x7fab3c100dd0 2024-09-19T04:09:57.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.769+0000 7fab42030640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c10f900 con 0x7fab3c101770 2024-09-19T04:09:57.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.769+0000 7fab42030640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c10fc00 con 0x7fab3c100490 2024-09-19T04:09:57.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.769+0000 7fab3affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab3c100dd0 0x7fab3c19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:09:57.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.769+0000 7fab3affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab3c100dd0 0x7fab3c19a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49110/0 (socket says 172.21.15.7:49110) 2024-09-19T04:09:57.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.770+0000 7fab3affd640 1 -- 172.21.15.7:0/3383082561 learned_addr learned my addr 172.21.15.7:0/3383082561 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:09:57.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.770+0000 7fab3bfff640 1 --2- 172.21.15.7:0/3383082561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab3c101770 0x7fab3c1a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:09:57.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.770+0000 7fab3b7fe640 1 --2- 172.21.15.7:0/3383082561 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab3c100490 0x7fab3c19a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:09:57.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.770+0000 7fab3affd640 1 -- 172.21.15.7:0/3383082561 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab3c100490 msgr2=0x7fab3c19a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:09:57.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.770+0000 7fab3affd640 1 --2- 172.21.15.7:0/3383082561 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab3c100490 0x7fab3c19a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:09:57.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.770+0000 7fab3affd640 1 -- 172.21.15.7:0/3383082561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab3c101770 msgr2=0x7fab3c1a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:09:57.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.770+0000 7fab3affd640 1 --2- 172.21.15.7:0/3383082561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab3c101770 0x7fab3c1a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:09:57.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.770+0000 7fab3affd640 1 -- 172.21.15.7:0/3383082561 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab3c1a1cb0 con 0x7fab3c100dd0 2024-09-19T04:09:57.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.770+0000 7fab3affd640 1 --2- 172.21.15.7:0/3383082561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab3c100dd0 0x7fab3c19a5c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fab3000e9f0 tx=0x7fab3000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:09:57.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.770+0000 7fab38ff9640 1 -- 172.21.15.7:0/3383082561 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3000cd80 con 0x7fab3c100dd0 2024-09-19T04:09:57.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.770+0000 7fab38ff9640 1 -- 172.21.15.7:0/3383082561 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab30010910 con 0x7fab3c100dd0 2024-09-19T04:09:57.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.770+0000 7fab42030640 1 -- 172.21.15.7:0/3383082561 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab3c1a1fa0 con 0x7fab3c100dd0 2024-09-19T04:09:57.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.770+0000 7fab38ff9640 1 -- 172.21.15.7:0/3383082561 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab300188f0 con 0x7fab3c100dd0 2024-09-19T04:09:57.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.770+0000 7fab42030640 1 -- 172.21.15.7:0/3383082561 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab3c1a2450 con 0x7fab3c100dd0 2024-09-19T04:09:57.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.771+0000 7fab42030640 1 -- 172.21.15.7:0/3383082561 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab3c10b1e0 con 0x7fab3c100dd0 2024-09-19T04:09:57.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.773+0000 7fab38ff9640 1 -- 172.21.15.7:0/3383082561 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7fab30010ac0 con 0x7fab3c100dd0 2024-09-19T04:09:57.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.773+0000 7fab38ff9640 1 --2- 172.21.15.7:0/3383082561 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fab240a31e0 0x7fab240a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:09:57.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.773+0000 7fab3b7fe640 1 --2- 172.21.15.7:0/3383082561 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fab240a31e0 0x7fab240a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:09:57.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.773+0000 7fab38ff9640 1 -- 172.21.15.7:0/3383082561 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2445+0+0 (secure 0 0 0) 0x7fab300ce7c0 con 0x7fab3c100dd0 2024-09-19T04:09:57.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.774+0000 7fab3b7fe640 1 --2- 172.21.15.7:0/3383082561 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fab240a31e0 0x7fab240a56a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fab2c009bd0 tx=0x7fab2c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:09:57.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.776+0000 7fab38ff9640 1 -- 172.21.15.7:0/3383082561 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fab3009c660 con 0x7fab3c100dd0 2024-09-19T04:09:57.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:09:57.966+0000 7fab42030640 1 -- 172.21.15.7:0/3383082561 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fab3c062630 con 0x7fab240a31e0 2024-09-19T04:09:58.063 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:57 smithi092 ceph-mon[34940]: Detected new or changed devices on smithi102 2024-09-19T04:09:58.063 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:57 smithi092 ceph-mon[34940]: Adjusting osd_memory_target on smithi102 to 17088M 2024-09-19T04:09:58.063 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:57 smithi092 ceph-mon[34940]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T04:09:58.063 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:57 smithi092 ceph-mon[34940]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T04:09:58.063 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:57 smithi092 ceph-mon[34940]: from='osd.2 [v2:172.21.15.102:6800/2078441772,v1:172.21.15.102:6801/2078441772]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T04:09:58.063 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:57 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:09:58.064 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:57 smithi092 ceph-mon[34940]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T04:09:58.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:57 smithi007 ceph-mon[31360]: Detected new or changed devices on smithi102 2024-09-19T04:09:58.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:57 smithi007 ceph-mon[31360]: Adjusting osd_memory_target on smithi102 to 17088M 2024-09-19T04:09:58.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:57 smithi007 ceph-mon[31360]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T04:09:58.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:57 smithi007 ceph-mon[31360]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T04:09:58.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:57 smithi007 ceph-mon[31360]: from='osd.2 [v2:172.21.15.102:6800/2078441772,v1:172.21.15.102:6801/2078441772]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T04:09:58.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:57 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:09:58.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:57 smithi007 ceph-mon[31360]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T04:09:58.158 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 19 04:09:57 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-2[40411]: 2024-09-19T04:09:57.806+0000 7f0d60076640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T04:09:58.159 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 19 04:09:57 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-2[40411]: 2024-09-19T04:09:57.809+0000 7f0d5be9e640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:09:58.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:57 smithi102 ceph-mon[35446]: Detected new or changed devices on smithi102 2024-09-19T04:09:58.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:57 smithi102 ceph-mon[35446]: Adjusting osd_memory_target on smithi102 to 17088M 2024-09-19T04:09:58.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:57 smithi102 ceph-mon[35446]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T04:09:58.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:57 smithi102 ceph-mon[35446]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T04:09:58.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:57 smithi102 ceph-mon[35446]: from='osd.2 [v2:172.21.15.102:6800/2078441772,v1:172.21.15.102:6801/2078441772]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T04:09:58.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:57 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:09:58.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:57 smithi102 ceph-mon[35446]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T04:09:59.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:58 smithi007 ceph-mon[31360]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:59.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:58 smithi007 ceph-mon[31360]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-19T04:09:59.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:58 smithi007 ceph-mon[31360]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T04:09:59.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:58 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:09:59.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:58 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:09:59.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:58 smithi007 ceph-mon[31360]: from='client.14277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:09:59.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:58 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:09:59.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:58 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:09:59.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:58 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:59.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:58 smithi102 ceph-mon[35446]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:59.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:58 smithi102 ceph-mon[35446]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-19T04:09:59.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:58 smithi102 ceph-mon[35446]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T04:09:59.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:58 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:09:59.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:58 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:09:59.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:58 smithi102 ceph-mon[35446]: from='client.14277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:09:59.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:58 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:09:59.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:58 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:09:59.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:58 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:09:59.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:58 smithi092 ceph-mon[34940]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:09:59.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:58 smithi092 ceph-mon[34940]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-19T04:09:59.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:58 smithi092 ceph-mon[34940]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T04:09:59.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:58 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:09:59.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:58 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:09:59.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:58 smithi092 ceph-mon[34940]: from='client.14277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:09:59.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:58 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:09:59.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:58 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:09:59.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:58 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:10:00.067 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:59 smithi007 ceph-mon[31360]: purged_snaps scrub starts 2024-09-19T04:10:00.067 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:59 smithi007 ceph-mon[31360]: purged_snaps scrub ok 2024-09-19T04:10:00.067 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:59 smithi007 ceph-mon[31360]: osd.2 [v2:172.21.15.102:6800/2078441772,v1:172.21.15.102:6801/2078441772] boot 2024-09-19T04:10:00.067 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:59 smithi007 ceph-mon[31360]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T04:10:00.067 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:59 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:10:00.067 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:09:59 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T04:10:00.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:59 smithi102 ceph-mon[35446]: purged_snaps scrub starts 2024-09-19T04:10:00.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:59 smithi102 ceph-mon[35446]: purged_snaps scrub ok 2024-09-19T04:10:00.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:59 smithi102 ceph-mon[35446]: osd.2 [v2:172.21.15.102:6800/2078441772,v1:172.21.15.102:6801/2078441772] boot 2024-09-19T04:10:00.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:59 smithi102 ceph-mon[35446]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T04:10:00.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:59 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:10:00.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:09:59 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T04:10:00.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:59 smithi092 ceph-mon[34940]: purged_snaps scrub starts 2024-09-19T04:10:00.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:59 smithi092 ceph-mon[34940]: purged_snaps scrub ok 2024-09-19T04:10:00.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:59 smithi092 ceph-mon[34940]: osd.2 [v2:172.21.15.102:6800/2078441772,v1:172.21.15.102:6801/2078441772] boot 2024-09-19T04:10:00.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:59 smithi092 ceph-mon[34940]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T04:10:00.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:59 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:10:00.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:09:59 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T04:10:00.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:00 smithi007 ceph-mon[31360]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:10:00.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:00 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T04:10:00.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:00 smithi007 ceph-mon[31360]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T04:10:00.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:00 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T04:10:00.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:00 smithi007 ceph-mon[31360]: overall HEALTH_OK 2024-09-19T04:10:00.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:00 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3187204276' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "68ba79e5-bcf0-4349-9e14-42f2fa9c11b9"}]: dispatch 2024-09-19T04:10:00.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:00 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T04:10:00.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:00 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3187204276' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "68ba79e5-bcf0-4349-9e14-42f2fa9c11b9"}]': finished 2024-09-19T04:10:00.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:00 smithi007 ceph-mon[31360]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T04:10:00.955 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:00 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:10:01.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:00 smithi102 ceph-mon[35446]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:10:01.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:00 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T04:10:01.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:00 smithi102 ceph-mon[35446]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T04:10:01.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:00 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T04:10:01.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:00 smithi102 ceph-mon[35446]: overall HEALTH_OK 2024-09-19T04:10:01.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:00 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3187204276' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "68ba79e5-bcf0-4349-9e14-42f2fa9c11b9"}]: dispatch 2024-09-19T04:10:01.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:00 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T04:10:01.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:00 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3187204276' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "68ba79e5-bcf0-4349-9e14-42f2fa9c11b9"}]': finished 2024-09-19T04:10:01.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:00 smithi102 ceph-mon[35446]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T04:10:01.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:00 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:10:01.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:00 smithi092 ceph-mon[34940]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:10:01.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:00 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T04:10:01.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:00 smithi092 ceph-mon[34940]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T04:10:01.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:00 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T04:10:01.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:00 smithi092 ceph-mon[34940]: overall HEALTH_OK 2024-09-19T04:10:01.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:00 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3187204276' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "68ba79e5-bcf0-4349-9e14-42f2fa9c11b9"}]: dispatch 2024-09-19T04:10:01.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:00 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T04:10:01.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:00 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3187204276' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "68ba79e5-bcf0-4349-9e14-42f2fa9c11b9"}]': finished 2024-09-19T04:10:01.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:00 smithi092 ceph-mon[34940]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T04:10:01.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:00 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:10:01.377 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 04:10:00 smithi007 sudo[49468]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T04:10:01.377 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 04:10:00 smithi007 sudo[49468]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:10:01.377 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 04:10:00 smithi007 sudo[49468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:10:01.377 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 04:10:00 smithi007 sudo[49468]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:10:01.821 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 04:10:01 smithi007 sudo[49517]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T04:10:01.821 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 04:10:01 smithi007 sudo[49517]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:10:01.821 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 04:10:01 smithi007 sudo[49517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:10:01.821 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 04:10:01 smithi007 sudo[49517]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:10:01.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:10:01.825+0000 7fab38ff9640 1 -- 172.21.15.7:0/3383082561 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fab30098cd0 con 0x7fab3c100dd0 2024-09-19T04:10:01.942 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:01 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1740813285' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:10:01.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:01 smithi092 ceph-mon[34940]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T04:10:01.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:01 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:10:01.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:01 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:01.944 INFO:journalctl@ceph.osd.1.smithi092.stdout:Sep 19 04:10:01 smithi092 sudo[43550]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T04:10:01.944 INFO:journalctl@ceph.osd.1.smithi092.stdout:Sep 19 04:10:01 smithi092 sudo[43550]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:10:01.944 INFO:journalctl@ceph.osd.1.smithi092.stdout:Sep 19 04:10:01 smithi092 sudo[43550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:10:01.944 INFO:journalctl@ceph.osd.1.smithi092.stdout:Sep 19 04:10:01 smithi092 sudo[43550]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:10:02.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:01 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1740813285' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:10:02.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:01 smithi007 ceph-mon[31360]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T04:10:02.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:01 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:10:02.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:01 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:02.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:01 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1740813285' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:10:02.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:01 smithi102 ceph-mon[35446]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T04:10:02.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:01 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:10:02.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:01 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:02.296 INFO:journalctl@ceph.osd.1.smithi092.stdout:Sep 19 04:10:01 smithi092 sudo[43553]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T04:10:02.297 INFO:journalctl@ceph.osd.1.smithi092.stdout:Sep 19 04:10:01 smithi092 sudo[43553]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:10:02.297 INFO:journalctl@ceph.osd.1.smithi092.stdout:Sep 19 04:10:01 smithi092 sudo[43553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:10:02.297 INFO:journalctl@ceph.osd.1.smithi092.stdout:Sep 19 04:10:01 smithi092 sudo[43553]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:10:02.465 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 19 04:10:02 smithi102 sudo[44063]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T04:10:02.465 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 19 04:10:02 smithi102 sudo[44063]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:10:02.466 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 19 04:10:02 smithi102 sudo[44063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:10:02.466 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 19 04:10:02 smithi102 sudo[44063]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:10:02.909 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 19 04:10:02 smithi102 sudo[44066]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T04:10:02.909 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 19 04:10:02 smithi102 sudo[44066]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:10:02.909 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 19 04:10:02 smithi102 sudo[44066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:10:02.909 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 19 04:10:02 smithi102 sudo[44066]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:10:03.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:02 smithi007 sudo[49892]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T04:10:03.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:02 smithi007 sudo[49892]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:10:03.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:02 smithi007 sudo[49892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:10:03.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:02 smithi007 sudo[49892]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:10:03.656 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:03 smithi102 ceph-mon[35446]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:10:03.656 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:03 smithi102 ceph-mon[35446]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T04:10:03.656 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:03 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:03.656 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:03 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:03.656 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:03 smithi102 ceph-mon[35446]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T04:10:03.656 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:03 smithi102 sudo[44069]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T04:10:03.657 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:03 smithi102 sudo[44069]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:10:03.657 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:03 smithi102 sudo[44069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:10:03.657 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:03 smithi102 sudo[44069]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:10:03.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:03 smithi092 ceph-mon[34940]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:10:03.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:03 smithi092 ceph-mon[34940]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T04:10:03.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:03 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:03.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:03 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:03.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:03 smithi092 ceph-mon[34940]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T04:10:03.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:03 smithi007 sudo[49897]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T04:10:03.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:03 smithi007 sudo[49897]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:10:03.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:03 smithi007 sudo[49897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:10:03.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:03 smithi007 sudo[49897]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:10:03.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:03 smithi007 ceph-mon[31360]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:10:03.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:03 smithi007 ceph-mon[31360]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T04:10:03.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:03 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:03.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:03 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:03.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:03 smithi007 ceph-mon[31360]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T04:10:03.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:03 smithi102 sudo[44072]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T04:10:03.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:03 smithi102 sudo[44072]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:10:03.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:03 smithi102 sudo[44072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:10:03.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:03 smithi102 sudo[44072]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:10:04.390 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:04 smithi092 sudo[43556]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T04:10:04.390 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:04 smithi092 sudo[43556]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:10:04.390 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:04 smithi092 sudo[43556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:10:04.390 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:04 smithi092 sudo[43556]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:10:04.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:04 smithi102 ceph-mon[35446]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:10:04.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:04 smithi102 ceph-mon[35446]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T04:10:04.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:04 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:10:04.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:04 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:10:04.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:04 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:10:04.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:04 smithi102 ceph-mon[35446]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T04:10:04.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:04 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:10:04.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:04 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:10:04.660 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:04 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:10:04.660 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:04 smithi102 ceph-mon[35446]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T04:10:04.660 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:04 smithi102 ceph-mon[35446]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T04:10:04.660 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:04 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:10:04.660 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:04 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:10:04.660 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:04 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:10:04.660 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:04 smithi102 ceph-mon[35446]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T04:10:04.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:04 smithi092 sudo[43559]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T04:10:04.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:04 smithi092 sudo[43559]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:10:04.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:04 smithi092 sudo[43559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:10:04.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:04 smithi092 sudo[43559]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:10:04.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:04 smithi092 ceph-mon[34940]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:10:04.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:04 smithi092 ceph-mon[34940]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T04:10:04.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:04 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:10:04.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:04 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:10:04.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:04 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:10:04.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:04 smithi092 ceph-mon[34940]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T04:10:04.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:04 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:10:04.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:04 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:10:04.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:04 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:10:04.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:04 smithi092 ceph-mon[34940]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T04:10:04.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:04 smithi092 ceph-mon[34940]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T04:10:04.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:04 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:10:04.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:04 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:10:04.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:04 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:10:04.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:04 smithi092 ceph-mon[34940]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T04:10:04.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:04 smithi007 ceph-mon[31360]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:10:04.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:04 smithi007 ceph-mon[31360]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T04:10:04.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:04 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:10:04.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:04 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:10:04.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:04 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:10:04.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:04 smithi007 ceph-mon[31360]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T04:10:04.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:04 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:10:04.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:04 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:10:04.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:04 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:10:04.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:04 smithi007 ceph-mon[31360]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T04:10:04.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:04 smithi007 ceph-mon[31360]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T04:10:04.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:04 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:10:04.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:04 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:10:04.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:04 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:10:04.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:04 smithi007 ceph-mon[31360]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T04:10:06.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:06 smithi102 ceph-mon[35446]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:10:06.715 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:06 smithi007 ceph-mon[31360]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:10:06.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:06 smithi092 ceph-mon[34940]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:10:08.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:08 smithi102 ceph-mon[35446]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:10:08.765 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:08 smithi007 ceph-mon[31360]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:10:08.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:08 smithi092 ceph-mon[34940]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:10:09.509 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:09 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T04:10:09.509 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:09 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:10:09.509 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:09 smithi007 ceph-mon[31360]: Deploying daemon osd.3 on smithi007 2024-09-19T04:10:09.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:09 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T04:10:09.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:09 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:10:09.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:09 smithi092 ceph-mon[34940]: Deploying daemon osd.3 on smithi007 2024-09-19T04:10:09.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:09 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T04:10:09.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:09 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:10:09.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:09 smithi102 ceph-mon[35446]: Deploying daemon osd.3 on smithi007 2024-09-19T04:10:10.695 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:10 smithi007 ceph-mon[31360]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-19T04:10:10.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:10 smithi092 ceph-mon[34940]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-19T04:10:10.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:10 smithi102 ceph-mon[35446]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-19T04:10:12.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:12 smithi007 ceph-mon[31360]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-19T04:10:12.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:12 smithi092 ceph-mon[34940]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-19T04:10:12.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:12 smithi102 ceph-mon[35446]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-19T04:10:14.745 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:14 smithi007 ceph-mon[31360]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T04:10:14.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:14 smithi092 ceph-mon[34940]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T04:10:14.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:14 smithi102 ceph-mon[35446]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T04:10:15.679 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:15 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:10:15.679 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:15 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:15.679 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:15 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:15.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:15 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:10:15.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:15 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:15.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:15 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:15.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:15 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:10:15.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:15 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:15.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:15 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:17.198 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:17 smithi007 ceph-mon[31360]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T04:10:17.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:17 smithi092 ceph-mon[34940]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T04:10:17.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:17 smithi102 ceph-mon[35446]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T04:10:18.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:18 smithi007 ceph-mon[31360]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T04:10:18.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:18 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:18.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:18 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:18.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:18 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:10:18.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:18 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:10:18.778 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:18 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:18.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:18 smithi092 ceph-mon[34940]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T04:10:18.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:18 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:18.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:18 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:18.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:18 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:10:18.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:18 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:10:18.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:18 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:18.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:10:18.817+0000 7fab38ff9640 1 -- 172.21.15.7:0/3383082561 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fab3c062630 con 0x7fab240a31e0 2024-09-19T04:10:18.820 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 3 on host 'smithi007' 2024-09-19T04:10:18.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:10:18.820+0000 7fab42030640 1 -- 172.21.15.7:0/3383082561 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fab240a31e0 msgr2=0x7fab240a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:10:18.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:10:18.820+0000 7fab42030640 1 --2- 172.21.15.7:0/3383082561 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fab240a31e0 0x7fab240a56a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fab2c009bd0 tx=0x7fab2c005f90 comp rx=0 tx=0).stop 2024-09-19T04:10:18.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:10:18.820+0000 7fab42030640 1 -- 172.21.15.7:0/3383082561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab3c100dd0 msgr2=0x7fab3c19a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:10:18.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:10:18.820+0000 7fab42030640 1 --2- 172.21.15.7:0/3383082561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab3c100dd0 0x7fab3c19a5c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fab3000e9f0 tx=0x7fab3000eeb0 comp rx=0 tx=0).stop 2024-09-19T04:10:18.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:10:18.820+0000 7fab42030640 1 -- 172.21.15.7:0/3383082561 shutdown_connections 2024-09-19T04:10:18.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:10:18.820+0000 7fab42030640 1 --2- 172.21.15.7:0/3383082561 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fab240a31e0 0x7fab240a56a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:10:18.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:10:18.820+0000 7fab42030640 1 --2- 172.21.15.7:0/3383082561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab3c101770 0x7fab3c1a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:10:18.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:10:18.820+0000 7fab42030640 1 --2- 172.21.15.7:0/3383082561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab3c100dd0 0x7fab3c19a5c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:10:18.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:10:18.820+0000 7fab42030640 1 --2- 172.21.15.7:0/3383082561 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab3c100490 0x7fab3c19a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:10:18.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:10:18.820+0000 7fab42030640 1 -- 172.21.15.7:0/3383082561 >> 172.21.15.7:0/3383082561 conn(0x7fab3c0fc2a0 msgr2=0x7fab3c0fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:10:18.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:10:18.820+0000 7fab42030640 1 -- 172.21.15.7:0/3383082561 shutdown_connections 2024-09-19T04:10:18.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:10:18.820+0000 7fab42030640 1 -- 172.21.15.7:0/3383082561 wait complete. 2024-09-19T04:10:18.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:18 smithi102 ceph-mon[35446]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T04:10:18.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:18 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:18.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:18 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:18.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:18 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:10:18.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:18 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:10:18.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:18 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:19.434 DEBUG:teuthology.orchestra.run.smithi007:osd.3> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T04:10:19.437 INFO:tasks.cephadm:Deploying osd.4 on smithi092 with /dev/vg_nvme/lv_3... 2024-09-19T04:10:19.437 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T04:10:19.665 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:19 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:10:19.665 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:19 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:19.665 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:19 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:19.689 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:10:19.783 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:19 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:10:19.783 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:19 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:19.783 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:19 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:19.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:19 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:10:19.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:19 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:19.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:19 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:20.920 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:20 smithi007 ceph-mon[31360]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T04:10:21.107 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:20 smithi092 ceph-mon[34940]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T04:10:21.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:20 smithi102 ceph-mon[35446]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T04:10:21.377 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 04:10:21 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-3[51461]: 2024-09-19T04:10:21.010+0000 7f15b3f23640 -1 osd.3 0 log_to_monitors true 2024-09-19T04:10:21.947 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:21 smithi007 ceph-mon[31360]: from='osd.3 [v2:172.21.15.7:6810/2729561132,v1:172.21.15.7:6811/2729561132]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T04:10:22.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:21 smithi102 ceph-mon[35446]: from='osd.3 [v2:172.21.15.7:6810/2729561132,v1:172.21.15.7:6811/2729561132]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T04:10:22.187 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:21 smithi092 ceph-mon[34940]: from='osd.3 [v2:172.21.15.7:6810/2729561132,v1:172.21.15.7:6811/2729561132]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T04:10:22.190 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T04:10:22.214 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi092:vg_nvme/lv_3 2024-09-19T04:10:22.470 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:10:22.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.876+0000 7fcbf3a3e640 1 -- 172.21.15.92:0/3850626985 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbec102690 msgr2=0x7fcbec108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:10:22.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.876+0000 7fcbf3a3e640 1 --2- 172.21.15.92:0/3850626985 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbec102690 0x7fcbec108f20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4009ca0 tx=0x7fcbe402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:10:22.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.876+0000 7fcbf3a3e640 1 -- 172.21.15.92:0/3850626985 shutdown_connections 2024-09-19T04:10:22.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.876+0000 7fcbf3a3e640 1 --2- 172.21.15.92:0/3850626985 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbec102690 0x7fcbec108f20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:10:22.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.876+0000 7fcbf3a3e640 1 --2- 172.21.15.92:0/3850626985 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbec101cd0 0x7fcbec102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:10:22.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.876+0000 7fcbf3a3e640 1 --2- 172.21.15.92:0/3850626985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbec100ad0 0x7fcbec100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:10:22.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.876+0000 7fcbf3a3e640 1 -- 172.21.15.92:0/3850626985 >> 172.21.15.92:0/3850626985 conn(0x7fcbec0fc280 msgr2=0x7fcbec0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:10:22.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.876+0000 7fcbf3a3e640 1 -- 172.21.15.92:0/3850626985 shutdown_connections 2024-09-19T04:10:22.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.876+0000 7fcbf3a3e640 1 -- 172.21.15.92:0/3850626985 wait complete. 2024-09-19T04:10:22.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.876+0000 7fcbf3a3e640 1 Processor -- start 2024-09-19T04:10:22.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.876+0000 7fcbf3a3e640 1 -- start start 2024-09-19T04:10:22.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.877+0000 7fcbf3a3e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbec100ad0 0x7fcbec197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:10:22.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.877+0000 7fcbf3a3e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbec101cd0 0x7fcbec198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:10:22.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.877+0000 7fcbf3a3e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbec102690 0x7fcbec19f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:10:22.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.877+0000 7fcbf3a3e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec10c7b0 con 0x7fcbec100ad0 2024-09-19T04:10:22.909 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.877+0000 7fcbf3a3e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec10c630 con 0x7fcbec101cd0 2024-09-19T04:10:22.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.877+0000 7fcbf3a3e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec10c930 con 0x7fcbec102690 2024-09-19T04:10:22.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.877+0000 7fcbf0fd9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbec101cd0 0x7fcbec198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:10:22.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.877+0000 7fcbf17da640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbec100ad0 0x7fcbec197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:10:22.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.877+0000 7fcbf0fd9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbec101cd0 0x7fcbec198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48176/0 (socket says 172.21.15.92:48176) 2024-09-19T04:10:22.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.877+0000 7fcbf0fd9640 1 -- 172.21.15.92:0/2930407058 learned_addr learned my addr 172.21.15.92:0/2930407058 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T04:10:22.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.877+0000 7fcbf1fdb640 1 --2- 172.21.15.92:0/2930407058 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbec102690 0x7fcbec19f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:10:22.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.877+0000 7fcbf0fd9640 1 -- 172.21.15.92:0/2930407058 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbec102690 msgr2=0x7fcbec19f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:10:22.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.877+0000 7fcbf0fd9640 1 --2- 172.21.15.92:0/2930407058 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbec102690 0x7fcbec19f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:10:22.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.877+0000 7fcbf0fd9640 1 -- 172.21.15.92:0/2930407058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbec100ad0 msgr2=0x7fcbec197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:10:22.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.877+0000 7fcbf0fd9640 1 --2- 172.21.15.92:0/2930407058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbec100ad0 0x7fcbec197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:10:22.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.877+0000 7fcbf0fd9640 1 -- 172.21.15.92:0/2930407058 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbec19fb00 con 0x7fcbec101cd0 2024-09-19T04:10:22.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.877+0000 7fcbf17da640 1 --2- 172.21.15.92:0/2930407058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbec100ad0 0x7fcbec197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:10:22.910 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.877+0000 7fcbf0fd9640 1 --2- 172.21.15.92:0/2930407058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbec101cd0 0x7fcbec198410 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00b4a0 tx=0x7fcbdc00b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:10:22.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.877+0000 7fcbe27fc640 1 -- 172.21.15.92:0/2930407058 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc014070 con 0x7fcbec101cd0 2024-09-19T04:10:22.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.877+0000 7fcbe27fc640 1 -- 172.21.15.92:0/2930407058 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbdc010af0 con 0x7fcbec101cd0 2024-09-19T04:10:22.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.877+0000 7fcbf3a3e640 1 -- 172.21.15.92:0/2930407058 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbec19fdf0 con 0x7fcbec101cd0 2024-09-19T04:10:22.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.877+0000 7fcbe27fc640 1 -- 172.21.15.92:0/2930407058 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc017d10 con 0x7fcbec101cd0 2024-09-19T04:10:22.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.878+0000 7fcbf3a3e640 1 -- 172.21.15.92:0/2930407058 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbec1a02d0 con 0x7fcbec101cd0 2024-09-19T04:10:22.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.879+0000 7fcbf3a3e640 1 -- 172.21.15.92:0/2930407058 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbec1a0560 con 0x7fcbec101cd0 2024-09-19T04:10:22.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.880+0000 7fcbe27fc640 1 -- 172.21.15.92:0/2930407058 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fcbdc017070 con 0x7fcbec101cd0 2024-09-19T04:10:22.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.880+0000 7fcbe27fc640 1 --2- 172.21.15.92:0/2930407058 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fcbd80a3270 0x7fcbd80a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:10:22.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.880+0000 7fcbe27fc640 1 -- 172.21.15.92:0/2930407058 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3389+0+0 (secure 0 0 0) 0x7fcbdc0cd8b0 con 0x7fcbec101cd0 2024-09-19T04:10:22.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.880+0000 7fcbf17da640 1 --2- 172.21.15.92:0/2930407058 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fcbd80a3270 0x7fcbd80a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:10:22.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.881+0000 7fcbf17da640 1 --2- 172.21.15.92:0/2930407058 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fcbd80a3270 0x7fcbd80a5730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcbec101b30 tx=0x7fcbe8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:10:22.911 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:22.885+0000 7fcbe27fc640 1 -- 172.21.15.92:0/2930407058 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcbdc09b2c0 con 0x7fcbec101cd0 2024-09-19T04:10:23.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:22 smithi092 ceph-mon[34940]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:10:23.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:22 smithi092 ceph-mon[34940]: from='osd.3 [v2:172.21.15.7:6810/2729561132,v1:172.21.15.7:6811/2729561132]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T04:10:23.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:22 smithi092 ceph-mon[34940]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T04:10:23.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:22 smithi092 ceph-mon[34940]: from='osd.3 [v2:172.21.15.7:6810/2729561132,v1:172.21.15.7:6811/2729561132]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-19T04:10:23.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:22 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:10:23.049 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:22 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:23.049 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:22 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:23.049 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:22 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:10:23.049 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:22 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:10:23.049 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:22 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:23.049 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:22 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:10:23.049 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:22 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:10:23.049 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:22 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:23.066 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:23.065+0000 7fcbf3a3e640 1 -- 172.21.15.92:0/2930407058 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fcbec1a0730 con 0x7fcbd80a3270 2024-09-19T04:10:23.127 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 04:10:22 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-3[51461]: 2024-09-19T04:10:22.829+0000 7f15afea6640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T04:10:23.127 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 04:10:22 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-3[51461]: 2024-09-19T04:10:22.837+0000 7f15abcce640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:10:23.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:22 smithi007 ceph-mon[31360]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:10:23.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:22 smithi007 ceph-mon[31360]: from='osd.3 [v2:172.21.15.7:6810/2729561132,v1:172.21.15.7:6811/2729561132]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T04:10:23.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:22 smithi007 ceph-mon[31360]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T04:10:23.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:22 smithi007 ceph-mon[31360]: from='osd.3 [v2:172.21.15.7:6810/2729561132,v1:172.21.15.7:6811/2729561132]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-19T04:10:23.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:22 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:10:23.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:22 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:23.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:22 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:23.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:22 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:10:23.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:22 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:10:23.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:22 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:23.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:22 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:10:23.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:22 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:10:23.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:22 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:23.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:22 smithi102 ceph-mon[35446]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:10:23.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:22 smithi102 ceph-mon[35446]: from='osd.3 [v2:172.21.15.7:6810/2729561132,v1:172.21.15.7:6811/2729561132]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T04:10:23.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:22 smithi102 ceph-mon[35446]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T04:10:23.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:22 smithi102 ceph-mon[35446]: from='osd.3 [v2:172.21.15.7:6810/2729561132,v1:172.21.15.7:6811/2729561132]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-19T04:10:23.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:22 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:10:23.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:22 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:23.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:22 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:23.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:22 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:10:23.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:22 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:10:23.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:22 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:23.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:22 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:10:23.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:22 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:10:23.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:22 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:24.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:23 smithi092 ceph-mon[34940]: Detected new or changed devices on smithi007 2024-09-19T04:10:24.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:23 smithi092 ceph-mon[34940]: Adjusting osd_memory_target on smithi007 to 8546M 2024-09-19T04:10:24.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:23 smithi092 ceph-mon[34940]: from='osd.3 [v2:172.21.15.7:6810/2729561132,v1:172.21.15.7:6811/2729561132]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-19T04:10:24.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:23 smithi092 ceph-mon[34940]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T04:10:24.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:23 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:10:24.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:23 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:10:24.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:23 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:10:24.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:23 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:10:24.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:23 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:10:24.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:23 smithi092 ceph-mon[34940]: osd.3 [v2:172.21.15.7:6810/2729561132,v1:172.21.15.7:6811/2729561132] boot 2024-09-19T04:10:24.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:23 smithi092 ceph-mon[34940]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T04:10:24.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:23 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:10:24.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:23 smithi007 ceph-mon[31360]: Detected new or changed devices on smithi007 2024-09-19T04:10:24.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:23 smithi007 ceph-mon[31360]: Adjusting osd_memory_target on smithi007 to 8546M 2024-09-19T04:10:24.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:23 smithi007 ceph-mon[31360]: from='osd.3 [v2:172.21.15.7:6810/2729561132,v1:172.21.15.7:6811/2729561132]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-19T04:10:24.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:23 smithi007 ceph-mon[31360]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T04:10:24.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:23 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:10:24.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:23 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:10:24.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:23 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:10:24.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:23 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:10:24.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:23 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:10:24.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:23 smithi007 ceph-mon[31360]: osd.3 [v2:172.21.15.7:6810/2729561132,v1:172.21.15.7:6811/2729561132] boot 2024-09-19T04:10:24.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:23 smithi007 ceph-mon[31360]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T04:10:24.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:23 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:10:24.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:23 smithi102 ceph-mon[35446]: Detected new or changed devices on smithi007 2024-09-19T04:10:24.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:23 smithi102 ceph-mon[35446]: Adjusting osd_memory_target on smithi007 to 8546M 2024-09-19T04:10:24.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:23 smithi102 ceph-mon[35446]: from='osd.3 [v2:172.21.15.7:6810/2729561132,v1:172.21.15.7:6811/2729561132]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-19T04:10:24.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:23 smithi102 ceph-mon[35446]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T04:10:24.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:23 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:10:24.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:23 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:10:24.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:23 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:10:24.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:23 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:10:24.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:23 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:10:24.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:23 smithi102 ceph-mon[35446]: osd.3 [v2:172.21.15.7:6810/2729561132,v1:172.21.15.7:6811/2729561132] boot 2024-09-19T04:10:24.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:23 smithi102 ceph-mon[35446]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T04:10:24.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:23 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:10:25.032 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:24 smithi092 ceph-mon[34940]: purged_snaps scrub starts 2024-09-19T04:10:25.033 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:24 smithi092 ceph-mon[34940]: purged_snaps scrub ok 2024-09-19T04:10:25.033 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:24 smithi092 ceph-mon[34940]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:10:25.033 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:24 smithi092 ceph-mon[34940]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:10:25.033 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:24 smithi092 ceph-mon[34940]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T04:10:25.103 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:24 smithi102 ceph-mon[35446]: purged_snaps scrub starts 2024-09-19T04:10:25.103 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:24 smithi102 ceph-mon[35446]: purged_snaps scrub ok 2024-09-19T04:10:25.103 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:24 smithi102 ceph-mon[35446]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:10:25.103 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:24 smithi102 ceph-mon[35446]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:10:25.103 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:24 smithi102 ceph-mon[35446]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T04:10:25.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:24 smithi007 ceph-mon[31360]: purged_snaps scrub starts 2024-09-19T04:10:25.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:24 smithi007 ceph-mon[31360]: purged_snaps scrub ok 2024-09-19T04:10:25.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:24 smithi007 ceph-mon[31360]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:10:25.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:24 smithi007 ceph-mon[31360]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:10:25.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:24 smithi007 ceph-mon[31360]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T04:10:25.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:25 smithi092 ceph-mon[34940]: from='client.? 172.21.15.92:0/424572488' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f20d4a51-121f-4ac8-afeb-5962d83bd697"}]: dispatch 2024-09-19T04:10:25.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:25 smithi092 ceph-mon[34940]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f20d4a51-121f-4ac8-afeb-5962d83bd697"}]: dispatch 2024-09-19T04:10:25.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:25 smithi092 ceph-mon[34940]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f20d4a51-121f-4ac8-afeb-5962d83bd697"}]': finished 2024-09-19T04:10:25.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:25 smithi092 ceph-mon[34940]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T04:10:25.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:25 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:10:26.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:25 smithi007 ceph-mon[31360]: from='client.? 172.21.15.92:0/424572488' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f20d4a51-121f-4ac8-afeb-5962d83bd697"}]: dispatch 2024-09-19T04:10:26.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:25 smithi007 ceph-mon[31360]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f20d4a51-121f-4ac8-afeb-5962d83bd697"}]: dispatch 2024-09-19T04:10:26.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:25 smithi007 ceph-mon[31360]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f20d4a51-121f-4ac8-afeb-5962d83bd697"}]': finished 2024-09-19T04:10:26.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:25 smithi007 ceph-mon[31360]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T04:10:26.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:25 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:10:26.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:25 smithi102 ceph-mon[35446]: from='client.? 172.21.15.92:0/424572488' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f20d4a51-121f-4ac8-afeb-5962d83bd697"}]: dispatch 2024-09-19T04:10:26.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:25 smithi102 ceph-mon[35446]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f20d4a51-121f-4ac8-afeb-5962d83bd697"}]: dispatch 2024-09-19T04:10:26.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:25 smithi102 ceph-mon[35446]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f20d4a51-121f-4ac8-afeb-5962d83bd697"}]': finished 2024-09-19T04:10:26.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:25 smithi102 ceph-mon[35446]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T04:10:26.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:25 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:10:27.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:26 smithi007 ceph-mon[31360]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:10:27.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:26 smithi007 ceph-mon[31360]: from='client.? 172.21.15.92:0/2755470228' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:10:27.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:26 smithi102 ceph-mon[35446]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:10:27.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:26 smithi102 ceph-mon[35446]: from='client.? 172.21.15.92:0/2755470228' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:10:27.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:26 smithi092 ceph-mon[34940]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:10:27.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:26 smithi092 ceph-mon[34940]: from='client.? 172.21.15.92:0/2755470228' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:10:28.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:27 smithi007 ceph-mon[31360]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T04:10:28.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:27 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:10:28.161 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:27 smithi102 ceph-mon[35446]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T04:10:28.161 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:27 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:10:28.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:27 smithi092 ceph-mon[34940]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T04:10:28.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:27 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:10:29.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:28 smithi007 ceph-mon[31360]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:10:29.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:28 smithi007 ceph-mon[31360]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T04:10:29.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:28 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:10:29.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:28 smithi102 ceph-mon[35446]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:10:29.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:28 smithi102 ceph-mon[35446]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T04:10:29.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:28 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:10:29.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:28 smithi092 ceph-mon[34940]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:10:29.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:28 smithi092 ceph-mon[34940]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T04:10:29.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:10:31.046 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:30 smithi092 ceph-mon[34940]: pgmap v100: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 124 KiB/s, 0 objects/s recovering 2024-09-19T04:10:31.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:30 smithi007 ceph-mon[31360]: pgmap v100: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 124 KiB/s, 0 objects/s recovering 2024-09-19T04:10:31.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:30 smithi102 ceph-mon[35446]: pgmap v100: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 124 KiB/s, 0 objects/s recovering 2024-09-19T04:10:33.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:32 smithi007 ceph-mon[31360]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T04:10:33.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:32 smithi102 ceph-mon[35446]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T04:10:33.293 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:32 smithi092 ceph-mon[34940]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T04:10:34.037 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:33 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T04:10:34.037 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:33 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:10:34.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:33 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T04:10:34.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:33 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:10:34.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:33 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T04:10:34.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:33 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:10:35.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:34 smithi007 ceph-mon[31360]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-19T04:10:35.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:34 smithi007 ceph-mon[31360]: Deploying daemon osd.4 on smithi092 2024-09-19T04:10:35.136 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:34 smithi092 ceph-mon[34940]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-19T04:10:35.136 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:34 smithi092 ceph-mon[34940]: Deploying daemon osd.4 on smithi092 2024-09-19T04:10:35.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:34 smithi102 ceph-mon[35446]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-19T04:10:35.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:34 smithi102 ceph-mon[35446]: Deploying daemon osd.4 on smithi092 2024-09-19T04:10:37.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:36 smithi007 ceph-mon[31360]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-19T04:10:37.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:36 smithi102 ceph-mon[35446]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-19T04:10:37.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:36 smithi092 ceph-mon[34940]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-19T04:10:39.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:38 smithi007 ceph-mon[31360]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T04:10:39.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:38 smithi102 ceph-mon[35446]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T04:10:39.202 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:38 smithi092 ceph-mon[34940]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T04:10:40.046 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:39 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:10:40.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:39 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:40.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:39 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:40.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:39 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:10:40.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:39 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:40.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:39 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:40.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:39 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:10:40.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:39 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:40.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:39 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:41.005 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:40 smithi092 ceph-mon[34940]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:10:41.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:40 smithi102 ceph-mon[35446]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:10:41.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:40 smithi007 ceph-mon[31360]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:10:42.582 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:42.581+0000 7fcbe27fc640 1 -- 172.21.15.92:0/2930407058 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcbec1a0730 con 0x7fcbd80a3270 2024-09-19T04:10:42.583 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 4 on host 'smithi092' 2024-09-19T04:10:42.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:42.583+0000 7fcbf3a3e640 1 -- 172.21.15.92:0/2930407058 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fcbd80a3270 msgr2=0x7fcbd80a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:10:42.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:42.583+0000 7fcbf3a3e640 1 --2- 172.21.15.92:0/2930407058 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fcbd80a3270 0x7fcbd80a5730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcbec101b30 tx=0x7fcbe8005f90 comp rx=0 tx=0).stop 2024-09-19T04:10:42.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:42.583+0000 7fcbf3a3e640 1 -- 172.21.15.92:0/2930407058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbec101cd0 msgr2=0x7fcbec198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:10:42.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:42.583+0000 7fcbf3a3e640 1 --2- 172.21.15.92:0/2930407058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbec101cd0 0x7fcbec198410 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc00b4a0 tx=0x7fcbdc00b960 comp rx=0 tx=0).stop 2024-09-19T04:10:42.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:42.583+0000 7fcbf3a3e640 1 -- 172.21.15.92:0/2930407058 shutdown_connections 2024-09-19T04:10:42.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:42.583+0000 7fcbf3a3e640 1 --2- 172.21.15.92:0/2930407058 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fcbd80a3270 0x7fcbd80a5730 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:10:42.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:42.583+0000 7fcbf3a3e640 1 --2- 172.21.15.92:0/2930407058 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbec102690 0x7fcbec19f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:10:42.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:42.583+0000 7fcbf3a3e640 1 --2- 172.21.15.92:0/2930407058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbec101cd0 0x7fcbec198410 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:10:42.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:42.583+0000 7fcbf3a3e640 1 --2- 172.21.15.92:0/2930407058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbec100ad0 0x7fcbec197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:10:42.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:42.583+0000 7fcbf3a3e640 1 -- 172.21.15.92:0/2930407058 >> 172.21.15.92:0/2930407058 conn(0x7fcbec0fc280 msgr2=0x7fcbec0fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:10:42.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:42.584+0000 7fcbf3a3e640 1 -- 172.21.15.92:0/2930407058 shutdown_connections 2024-09-19T04:10:42.586 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:10:42.584+0000 7fcbf3a3e640 1 -- 172.21.15.92:0/2930407058 wait complete. 2024-09-19T04:10:43.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:42 smithi102 ceph-mon[35446]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:10:43.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:42 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:43.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:42 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:43.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:42 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:10:43.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:42 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:10:43.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:42 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:43.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:42 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:10:43.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:42 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:43.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:42 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:43.170 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:42 smithi092 ceph-mon[34940]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:10:43.171 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:42 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:43.171 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:42 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:43.171 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:42 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:10:43.171 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:42 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:10:43.171 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:42 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:43.171 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:42 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:10:43.171 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:42 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:43.171 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:42 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:43.198 DEBUG:teuthology.orchestra.run.smithi092:osd.4> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T04:10:43.200 INFO:tasks.cephadm:Deploying osd.5 on smithi102 with /dev/vg_nvme/lv_3... 2024-09-19T04:10:43.201 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T04:10:43.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:42 smithi007 ceph-mon[31360]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:10:43.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:42 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:43.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:42 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:43.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:42 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:10:43.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:42 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:10:43.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:42 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:43.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:42 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:10:43.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:42 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:43.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:42 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:43.455 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:10:45.147 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:44 smithi102 ceph-mon[35446]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:10:45.286 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:44 smithi092 ceph-mon[34940]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:10:45.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:44 smithi007 ceph-mon[31360]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:10:45.547 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 19 04:10:45 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-4[46309]: 2024-09-19T04:10:45.373+0000 7fcab1c15640 -1 osd.4 0 log_to_monitors true 2024-09-19T04:10:46.067 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:45 smithi102 ceph-mon[35446]: from='osd.4 [v2:172.21.15.92:6808/2799734294,v1:172.21.15.92:6809/2799734294]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T04:10:46.067 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:45 smithi102 ceph-mon[35446]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T04:10:46.071 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T04:10:46.097 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi102:vg_nvme/lv_3 2024-09-19T04:10:46.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:45 smithi092 ceph-mon[34940]: from='osd.4 [v2:172.21.15.92:6808/2799734294,v1:172.21.15.92:6809/2799734294]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T04:10:46.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:45 smithi092 ceph-mon[34940]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T04:10:46.338 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:10:46.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:45 smithi007 ceph-mon[31360]: from='osd.4 [v2:172.21.15.92:6808/2799734294,v1:172.21.15.92:6809/2799734294]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T04:10:46.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:45 smithi007 ceph-mon[31360]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T04:10:46.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.836+0000 7f9cecacd640 1 -- 172.21.15.102:0/2757575525 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ce8104f90 msgr2=0x7f9ce8107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:10:46.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.836+0000 7f9cecacd640 1 --2- 172.21.15.102:0/2757575525 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ce8104f90 0x7f9ce8107380 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0009900 tx=0x7f9cd002a410 comp rx=0 tx=0).stop 2024-09-19T04:10:46.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.836+0000 7f9cecacd640 1 -- 172.21.15.102:0/2757575525 shutdown_connections 2024-09-19T04:10:46.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.836+0000 7f9cecacd640 1 --2- 172.21.15.102:0/2757575525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ce81078c0 0x7f9ce8109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:10:46.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.836+0000 7f9cecacd640 1 --2- 172.21.15.102:0/2757575525 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ce8104f90 0x7f9ce8107380 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:10:46.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.836+0000 7f9cecacd640 1 --2- 172.21.15.102:0/2757575525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ce8102660 0x7f9ce8104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:10:46.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.836+0000 7f9cecacd640 1 -- 172.21.15.102:0/2757575525 >> 172.21.15.102:0/2757575525 conn(0x7f9ce80fc280 msgr2=0x7f9ce80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:10:46.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.836+0000 7f9cecacd640 1 -- 172.21.15.102:0/2757575525 shutdown_connections 2024-09-19T04:10:46.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.836+0000 7f9cecacd640 1 -- 172.21.15.102:0/2757575525 wait complete. 2024-09-19T04:10:46.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.836+0000 7f9cecacd640 1 Processor -- start 2024-09-19T04:10:46.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.836+0000 7f9cecacd640 1 -- start start 2024-09-19T04:10:46.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.837+0000 7f9cecacd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ce8102660 0x7f9ce8197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:10:46.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.837+0000 7f9cecacd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ce8104f90 0x7f9ce8198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:10:46.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.837+0000 7f9cecacd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ce81078c0 0x7f9ce819f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:10:46.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.837+0000 7f9cecacd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce810d860 con 0x7f9ce8102660 2024-09-19T04:10:46.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.837+0000 7f9cecacd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce810d6e0 con 0x7f9ce8104f90 2024-09-19T04:10:46.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.837+0000 7f9cecacd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce810d9e0 con 0x7f9ce81078c0 2024-09-19T04:10:46.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.837+0000 7f9ce6d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ce81078c0 0x7f9ce819f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:10:46.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.837+0000 7f9ce6d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ce81078c0 0x7f9ce819f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43334/0 (socket says 172.21.15.102:43334) 2024-09-19T04:10:46.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.837+0000 7f9ce6d9d640 1 -- 172.21.15.102:0/1622478990 learned_addr learned my addr 172.21.15.102:0/1622478990 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T04:10:46.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.837+0000 7f9ce5d9b640 1 --2- 172.21.15.102:0/1622478990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ce8104f90 0x7f9ce8198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:10:46.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.837+0000 7f9ce659c640 1 --2- 172.21.15.102:0/1622478990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ce8102660 0x7f9ce8197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:10:46.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.837+0000 7f9ce6d9d640 1 -- 172.21.15.102:0/1622478990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ce8104f90 msgr2=0x7f9ce8198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:10:46.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.837+0000 7f9ce6d9d640 1 --2- 172.21.15.102:0/1622478990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ce8104f90 0x7f9ce8198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:10:46.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.837+0000 7f9ce6d9d640 1 -- 172.21.15.102:0/1622478990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ce8102660 msgr2=0x7f9ce8197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:10:46.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.837+0000 7f9ce6d9d640 1 --2- 172.21.15.102:0/1622478990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ce8102660 0x7f9ce8197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:10:46.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.837+0000 7f9ce6d9d640 1 -- 172.21.15.102:0/1622478990 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce819fb40 con 0x7f9ce81078c0 2024-09-19T04:10:46.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.837+0000 7f9ce6d9d640 1 --2- 172.21.15.102:0/1622478990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ce81078c0 0x7f9ce819f4d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9ce000e970 tx=0x7f9ce000ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:10:46.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.837+0000 7f9cdf7fe640 1 -- 172.21.15.102:0/1622478990 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce000ccc0 con 0x7f9ce81078c0 2024-09-19T04:10:46.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.837+0000 7f9cdf7fe640 1 -- 172.21.15.102:0/1622478990 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ce000ce60 con 0x7f9ce81078c0 2024-09-19T04:10:46.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.837+0000 7f9cecacd640 1 -- 172.21.15.102:0/1622478990 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce819fe30 con 0x7f9ce81078c0 2024-09-19T04:10:46.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.837+0000 7f9cdf7fe640 1 -- 172.21.15.102:0/1622478990 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce0010490 con 0x7f9ce81078c0 2024-09-19T04:10:46.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.837+0000 7f9cecacd640 1 -- 172.21.15.102:0/1622478990 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce81a02e0 con 0x7f9ce81078c0 2024-09-19T04:10:46.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.838+0000 7f9cecacd640 1 -- 172.21.15.102:0/1622478990 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ce80fdd70 con 0x7f9ce81078c0 2024-09-19T04:10:46.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.840+0000 7f9cdf7fe640 1 -- 172.21.15.102:0/1622478990 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f9ce0005020 con 0x7f9ce81078c0 2024-09-19T04:10:46.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.840+0000 7f9cdf7fe640 1 --2- 172.21.15.102:0/1622478990 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9cd40a3270 0x7f9cd40a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:10:46.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.840+0000 7f9cdf7fe640 1 -- 172.21.15.102:0/1622478990 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3805+0+0 (secure 0 0 0) 0x7f9ce00cecb0 con 0x7f9ce81078c0 2024-09-19T04:10:46.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.841+0000 7f9ce659c640 1 --2- 172.21.15.102:0/1622478990 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9cd40a3270 0x7f9cd40a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:10:46.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.841+0000 7f9ce659c640 1 --2- 172.21.15.102:0/1622478990 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9cd40a3270 0x7f9cd40a5730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8005fd0 tx=0x7f9cd8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:10:46.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:46.845+0000 7f9cdf7fe640 1 -- 172.21.15.102:0/1622478990 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9ce009cb70 con 0x7f9ce81078c0 2024-09-19T04:10:47.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:10:47.020+0000 7f9cecacd640 1 -- 172.21.15.102:0/1622478990 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f9ce8062630 con 0x7f9cd40a3270 2024-09-19T04:10:47.021 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:46 smithi102 ceph-mon[35446]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:10:47.022 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:46 smithi102 ceph-mon[35446]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T04:10:47.022 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:46 smithi102 ceph-mon[35446]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T04:10:47.022 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:10:47.022 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:46 smithi102 ceph-mon[35446]: from='osd.4 [v2:172.21.15.92:6808/2799734294,v1:172.21.15.92:6809/2799734294]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T04:10:47.022 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:46 smithi102 ceph-mon[35446]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T04:10:47.022 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:46 smithi102 ceph-mon[35446]: Detected new or changed devices on smithi092 2024-09-19T04:10:47.022 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:47.022 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:47.022 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:10:47.022 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:10:47.022 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:46 smithi102 ceph-mon[35446]: Adjusting osd_memory_target on smithi092 to 8544M 2024-09-19T04:10:47.023 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:47.023 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:10:47.023 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:10:47.023 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:47.297 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 19 04:10:46 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-4[46309]: 2024-09-19T04:10:46.896+0000 7fcaadb98640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T04:10:47.297 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 19 04:10:46 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-4[46309]: 2024-09-19T04:10:46.903+0000 7fcaa99c0640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:10:47.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:46 smithi092 ceph-mon[34940]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:10:47.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:46 smithi092 ceph-mon[34940]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T04:10:47.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:46 smithi092 ceph-mon[34940]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T04:10:47.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:46 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:10:47.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:46 smithi092 ceph-mon[34940]: from='osd.4 [v2:172.21.15.92:6808/2799734294,v1:172.21.15.92:6809/2799734294]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T04:10:47.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:46 smithi092 ceph-mon[34940]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T04:10:47.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:46 smithi092 ceph-mon[34940]: Detected new or changed devices on smithi092 2024-09-19T04:10:47.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:46 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:47.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:46 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:47.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:46 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:10:47.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:46 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:10:47.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:46 smithi092 ceph-mon[34940]: Adjusting osd_memory_target on smithi092 to 8544M 2024-09-19T04:10:47.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:46 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:47.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:46 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:10:47.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:46 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:10:47.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:46 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:47.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:46 smithi007 ceph-mon[31360]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:10:47.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:46 smithi007 ceph-mon[31360]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T04:10:47.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:46 smithi007 ceph-mon[31360]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T04:10:47.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:10:47.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:46 smithi007 ceph-mon[31360]: from='osd.4 [v2:172.21.15.92:6808/2799734294,v1:172.21.15.92:6809/2799734294]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T04:10:47.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:46 smithi007 ceph-mon[31360]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T04:10:47.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:46 smithi007 ceph-mon[31360]: Detected new or changed devices on smithi092 2024-09-19T04:10:47.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:47.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:47.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:10:47.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:10:47.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:46 smithi007 ceph-mon[31360]: Adjusting osd_memory_target on smithi092 to 8544M 2024-09-19T04:10:47.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:47.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:10:47.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:10:47.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:10:48.069 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:47 smithi102 ceph-mon[35446]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-19T04:10:48.069 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:47 smithi102 ceph-mon[35446]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T04:10:48.069 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:47 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:10:48.069 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:47 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:10:48.069 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:47 smithi102 ceph-mon[35446]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:10:48.069 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:47 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:10:48.069 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:47 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:10:48.069 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:47 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:10:48.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:47 smithi092 ceph-mon[34940]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-19T04:10:48.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:47 smithi092 ceph-mon[34940]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T04:10:48.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:47 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:10:48.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:47 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:10:48.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:47 smithi092 ceph-mon[34940]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:10:48.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:47 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:10:48.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:47 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:10:48.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:47 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:10:48.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:47 smithi007 ceph-mon[31360]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-19T04:10:48.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:47 smithi007 ceph-mon[31360]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T04:10:48.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:47 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:10:48.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:47 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:10:48.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:47 smithi007 ceph-mon[31360]: from='client.24238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:10:48.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:47 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:10:48.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:47 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:10:48.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:47 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:10:49.054 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:48 smithi102 ceph-mon[35446]: purged_snaps scrub starts 2024-09-19T04:10:49.054 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:48 smithi102 ceph-mon[35446]: purged_snaps scrub ok 2024-09-19T04:10:49.054 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:48 smithi102 ceph-mon[35446]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:10:49.054 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:48 smithi102 ceph-mon[35446]: osd.4 [v2:172.21.15.92:6808/2799734294,v1:172.21.15.92:6809/2799734294] boot 2024-09-19T04:10:49.054 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:48 smithi102 ceph-mon[35446]: osdmap e31: 5 total, 5 up, 5 in 2024-09-19T04:10:49.054 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:48 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:10:49.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:48 smithi092 ceph-mon[34940]: purged_snaps scrub starts 2024-09-19T04:10:49.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:48 smithi092 ceph-mon[34940]: purged_snaps scrub ok 2024-09-19T04:10:49.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:48 smithi092 ceph-mon[34940]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:10:49.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:48 smithi092 ceph-mon[34940]: osd.4 [v2:172.21.15.92:6808/2799734294,v1:172.21.15.92:6809/2799734294] boot 2024-09-19T04:10:49.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:48 smithi092 ceph-mon[34940]: osdmap e31: 5 total, 5 up, 5 in 2024-09-19T04:10:49.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:48 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:10:49.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:48 smithi007 ceph-mon[31360]: purged_snaps scrub starts 2024-09-19T04:10:49.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:48 smithi007 ceph-mon[31360]: purged_snaps scrub ok 2024-09-19T04:10:49.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:48 smithi007 ceph-mon[31360]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:10:49.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:48 smithi007 ceph-mon[31360]: osd.4 [v2:172.21.15.92:6808/2799734294,v1:172.21.15.92:6809/2799734294] boot 2024-09-19T04:10:49.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:48 smithi007 ceph-mon[31360]: osdmap e31: 5 total, 5 up, 5 in 2024-09-19T04:10:49.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:48 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:10:50.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:49 smithi007 ceph-mon[31360]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T04:10:50.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:49 smithi007 ceph-mon[31360]: from='client.? 172.21.15.102:0/3978695090' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aac02b0a-99dc-4457-8898-c68dc196517a"}]: dispatch 2024-09-19T04:10:50.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:49 smithi007 ceph-mon[31360]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aac02b0a-99dc-4457-8898-c68dc196517a"}]: dispatch 2024-09-19T04:10:50.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:49 smithi007 ceph-mon[31360]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aac02b0a-99dc-4457-8898-c68dc196517a"}]': finished 2024-09-19T04:10:50.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:49 smithi007 ceph-mon[31360]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T04:10:50.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:49 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:10:50.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:49 smithi092 ceph-mon[34940]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T04:10:50.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:49 smithi092 ceph-mon[34940]: from='client.? 172.21.15.102:0/3978695090' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aac02b0a-99dc-4457-8898-c68dc196517a"}]: dispatch 2024-09-19T04:10:50.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:49 smithi092 ceph-mon[34940]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aac02b0a-99dc-4457-8898-c68dc196517a"}]: dispatch 2024-09-19T04:10:50.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:49 smithi092 ceph-mon[34940]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aac02b0a-99dc-4457-8898-c68dc196517a"}]': finished 2024-09-19T04:10:50.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:49 smithi092 ceph-mon[34940]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T04:10:50.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:49 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:10:50.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:49 smithi102 ceph-mon[35446]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T04:10:50.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:49 smithi102 ceph-mon[35446]: from='client.? 172.21.15.102:0/3978695090' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aac02b0a-99dc-4457-8898-c68dc196517a"}]: dispatch 2024-09-19T04:10:50.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:49 smithi102 ceph-mon[35446]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aac02b0a-99dc-4457-8898-c68dc196517a"}]: dispatch 2024-09-19T04:10:50.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:49 smithi102 ceph-mon[35446]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aac02b0a-99dc-4457-8898-c68dc196517a"}]': finished 2024-09-19T04:10:50.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:49 smithi102 ceph-mon[35446]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T04:10:50.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:49 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:10:51.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:50 smithi007 ceph-mon[31360]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:10:51.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:50 smithi007 ceph-mon[31360]: from='client.? 172.21.15.102:0/2995525355' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:10:51.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:50 smithi092 ceph-mon[34940]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:10:51.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:50 smithi092 ceph-mon[34940]: from='client.? 172.21.15.102:0/2995525355' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:10:51.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:50 smithi102 ceph-mon[35446]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:10:51.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:50 smithi102 ceph-mon[35446]: from='client.? 172.21.15.102:0/2995525355' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:10:53.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:52 smithi092 ceph-mon[34940]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:10:53.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:52 smithi007 ceph-mon[31360]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:10:53.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:52 smithi102 ceph-mon[35446]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:10:55.224 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:54 smithi102 ceph-mon[35446]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:10:55.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:54 smithi092 ceph-mon[34940]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:10:55.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:54 smithi007 ceph-mon[31360]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:10:57.226 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:56 smithi102 ceph-mon[35446]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:10:57.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:56 smithi092 ceph-mon[34940]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:10:57.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:56 smithi007 ceph-mon[31360]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:10:58.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:57 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T04:10:58.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:57 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:10:58.324 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:57 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T04:10:58.324 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:57 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:10:58.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:57 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T04:10:58.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:57 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:10:59.177 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:58 smithi102 ceph-mon[35446]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:10:59.177 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:10:58 smithi102 ceph-mon[35446]: Deploying daemon osd.5 on smithi102 2024-09-19T04:10:59.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:58 smithi092 ceph-mon[34940]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:10:59.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:10:58 smithi092 ceph-mon[34940]: Deploying daemon osd.5 on smithi102 2024-09-19T04:10:59.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:58 smithi007 ceph-mon[31360]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:10:59.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:10:58 smithi007 ceph-mon[31360]: Deploying daemon osd.5 on smithi102 2024-09-19T04:11:01.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:00 smithi102 ceph-mon[35446]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:11:01.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:00 smithi092 ceph-mon[34940]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:11:01.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:00 smithi007 ceph-mon[31360]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:11:03.075 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:02 smithi102 ceph-mon[35446]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:11:03.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:02 smithi092 ceph-mon[34940]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:11:03.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:02 smithi007 ceph-mon[31360]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:11:04.240 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:03 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:11:04.240 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:03 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:04.241 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:03 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:04.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:03 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:11:04.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:03 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:04.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:03 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:04.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:03 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:11:04.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:03 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:04.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:03 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:05.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:04 smithi102 ceph-mon[35446]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:11:05.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:04 smithi092 ceph-mon[34940]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:11:05.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:04 smithi007 ceph-mon[31360]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:11:07.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:06 smithi102 ceph-mon[35446]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:11:07.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:06 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:07.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:06 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:07.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:06 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:11:07.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:06 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:11:07.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:06 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:07.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:06 smithi092 ceph-mon[34940]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:11:07.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:06 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:07.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:06 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:07.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:06 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:11:07.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:06 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:11:07.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:06 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:07.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:06 smithi007 ceph-mon[31360]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:11:07.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:06 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:07.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:06 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:07.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:06 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:11:07.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:06 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:11:07.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:06 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:07.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:11:07.544+0000 7f9cdf7fe640 1 -- 172.21.15.102:0/1622478990 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9ce8062630 con 0x7f9cd40a3270 2024-09-19T04:11:07.546 INFO:teuthology.orchestra.run.smithi102.stdout:Created osd(s) 5 on host 'smithi102' 2024-09-19T04:11:07.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:11:07.546+0000 7f9cecacd640 1 -- 172.21.15.102:0/1622478990 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9cd40a3270 msgr2=0x7f9cd40a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:11:07.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:11:07.546+0000 7f9cecacd640 1 --2- 172.21.15.102:0/1622478990 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9cd40a3270 0x7f9cd40a5730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8005fd0 tx=0x7f9cd8009500 comp rx=0 tx=0).stop 2024-09-19T04:11:07.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:11:07.546+0000 7f9cecacd640 1 -- 172.21.15.102:0/1622478990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ce81078c0 msgr2=0x7f9ce819f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:11:07.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:11:07.546+0000 7f9cecacd640 1 --2- 172.21.15.102:0/1622478990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ce81078c0 0x7f9ce819f4d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9ce000e970 tx=0x7f9ce000ed70 comp rx=0 tx=0).stop 2024-09-19T04:11:07.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:11:07.546+0000 7f9cecacd640 1 -- 172.21.15.102:0/1622478990 shutdown_connections 2024-09-19T04:11:07.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:11:07.546+0000 7f9cecacd640 1 --2- 172.21.15.102:0/1622478990 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9cd40a3270 0x7f9cd40a5730 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:11:07.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:11:07.546+0000 7f9cecacd640 1 --2- 172.21.15.102:0/1622478990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ce81078c0 0x7f9ce819f4d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:11:07.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:11:07.546+0000 7f9cecacd640 1 --2- 172.21.15.102:0/1622478990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ce8104f90 0x7f9ce8198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:11:07.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:11:07.546+0000 7f9cecacd640 1 --2- 172.21.15.102:0/1622478990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ce8102660 0x7f9ce8197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:11:07.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:11:07.546+0000 7f9cecacd640 1 -- 172.21.15.102:0/1622478990 >> 172.21.15.102:0/1622478990 conn(0x7f9ce80fc280 msgr2=0x7f9ce8102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:11:07.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:11:07.546+0000 7f9cecacd640 1 -- 172.21.15.102:0/1622478990 shutdown_connections 2024-09-19T04:11:07.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:11:07.546+0000 7f9cecacd640 1 -- 172.21.15.102:0/1622478990 wait complete. 2024-09-19T04:11:08.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:07 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:11:08.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:07 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:08.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:07 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:08.229 DEBUG:teuthology.orchestra.run.smithi102:osd.5> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T04:11:08.232 INFO:tasks.cephadm:Deploying osd.6 on smithi007 with /dev/vg_nvme/lv_2... 2024-09-19T04:11:08.232 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T04:11:08.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:07 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:11:08.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:07 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:08.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:07 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:08.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:07 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:11:08.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:07 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:08.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:07 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:08.502 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:11:09.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:08 smithi092 ceph-mon[34940]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:11:09.314 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:08 smithi102 ceph-mon[35446]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:11:09.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:08 smithi007 ceph-mon[31360]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:11:09.659 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:11:09 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:11:09.312+0000 7ff6bd043640 -1 osd.5 0 log_to_monitors true 2024-09-19T04:11:10.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:09 smithi007 ceph-mon[31360]: from='osd.5 [v2:172.21.15.102:6808/3099678146,v1:172.21.15.102:6809/3099678146]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T04:11:10.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:09 smithi007 ceph-mon[31360]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T04:11:10.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:09 smithi092 ceph-mon[34940]: from='osd.5 [v2:172.21.15.102:6808/3099678146,v1:172.21.15.102:6809/3099678146]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T04:11:10.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:09 smithi092 ceph-mon[34940]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T04:11:10.384 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:09 smithi102 ceph-mon[35446]: from='osd.5 [v2:172.21.15.102:6808/3099678146,v1:172.21.15.102:6809/3099678146]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T04:11:10.384 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:09 smithi102 ceph-mon[35446]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T04:11:11.067 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:11:10 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:11:10.964+0000 7ff6b8fc6640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T04:11:11.067 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:11:10 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:11:10.970+0000 7ff6b4dee640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:11:11.067 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:10 smithi102 ceph-mon[35446]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:11:11.067 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:10 smithi102 ceph-mon[35446]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T04:11:11.067 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:10 smithi102 ceph-mon[35446]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T04:11:11.067 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:10 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:11:11.068 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:10 smithi102 ceph-mon[35446]: from='osd.5 [v2:172.21.15.102:6808/3099678146,v1:172.21.15.102:6809/3099678146]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T04:11:11.068 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:10 smithi102 ceph-mon[35446]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T04:11:11.149 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:11:11.177 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi007:vg_nvme/lv_2 2024-09-19T04:11:11.240 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:10 smithi007 ceph-mon[31360]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:11:11.240 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:10 smithi007 ceph-mon[31360]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T04:11:11.241 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:10 smithi007 ceph-mon[31360]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T04:11:11.241 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:10 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:11:11.241 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:10 smithi007 ceph-mon[31360]: from='osd.5 [v2:172.21.15.102:6808/3099678146,v1:172.21.15.102:6809/3099678146]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T04:11:11.241 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:10 smithi007 ceph-mon[31360]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T04:11:11.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:10 smithi092 ceph-mon[34940]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:11:11.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:10 smithi092 ceph-mon[34940]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T04:11:11.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:10 smithi092 ceph-mon[34940]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T04:11:11.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:10 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:11:11.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:10 smithi092 ceph-mon[34940]: from='osd.5 [v2:172.21.15.102:6808/3099678146,v1:172.21.15.102:6809/3099678146]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T04:11:11.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:10 smithi092 ceph-mon[34940]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T04:11:11.483 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:11:11.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.976+0000 7f8c8a768640 1 -- 172.21.15.7:0/2659715634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c841026a0 msgr2=0x7f8c84104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:11:11.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.976+0000 7f8c8a768640 1 --2- 172.21.15.7:0/2659715634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c841026a0 0x7f8c84104a90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8c74009900 tx=0x7f8c7402a410 comp rx=0 tx=0).stop 2024-09-19T04:11:11.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.976+0000 7f8c8a768640 1 -- 172.21.15.7:0/2659715634 shutdown_connections 2024-09-19T04:11:11.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.976+0000 7f8c8a768640 1 --2- 172.21.15.7:0/2659715634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c84107900 0x7f8c84109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:11:11.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.976+0000 7f8c8a768640 1 --2- 172.21.15.7:0/2659715634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c84104fd0 0x7f8c841073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:11:11.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.976+0000 7f8c8a768640 1 --2- 172.21.15.7:0/2659715634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c841026a0 0x7f8c84104a90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:11:11.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.976+0000 7f8c8a768640 1 -- 172.21.15.7:0/2659715634 >> 172.21.15.7:0/2659715634 conn(0x7f8c840fc2a0 msgr2=0x7f8c840fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:11:11.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.976+0000 7f8c8a768640 1 -- 172.21.15.7:0/2659715634 shutdown_connections 2024-09-19T04:11:11.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.976+0000 7f8c8a768640 1 -- 172.21.15.7:0/2659715634 wait complete. 2024-09-19T04:11:11.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.977+0000 7f8c8a768640 1 Processor -- start 2024-09-19T04:11:11.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.977+0000 7f8c8a768640 1 -- start start 2024-09-19T04:11:11.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.977+0000 7f8c8a768640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c841026a0 0x7f8c84102000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:11:11.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.977+0000 7f8c8a768640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c84104fd0 0x7f8c84100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:11:11.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.977+0000 7f8c8a768640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c84107900 0x7f8c84100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:11:11.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.977+0000 7f8c8a768640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8410d8b0 con 0x7f8c84107900 2024-09-19T04:11:11.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.977+0000 7f8c8a768640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8410d730 con 0x7f8c841026a0 2024-09-19T04:11:11.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.977+0000 7f8c8a768640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8410da30 con 0x7f8c84104fd0 2024-09-19T04:11:11.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.977+0000 7f8c88d05640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c84107900 0x7f8c84100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:11:11.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.978+0000 7f8c88d05640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c84107900 0x7f8c84100b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45426/0 (socket says 172.21.15.7:45426) 2024-09-19T04:11:11.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.978+0000 7f8c88d05640 1 -- 172.21.15.7:0/615253683 learned_addr learned my addr 172.21.15.7:0/615253683 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:11:11.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.978+0000 7f8c83fff640 1 --2- 172.21.15.7:0/615253683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c841026a0 0x7f8c84102000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:11:11.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.978+0000 7f8c837fe640 1 --2- 172.21.15.7:0/615253683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c84104fd0 0x7f8c84100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:11:11.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.978+0000 7f8c88d05640 1 -- 172.21.15.7:0/615253683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c84104fd0 msgr2=0x7f8c84100650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:11:11.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.978+0000 7f8c88d05640 1 --2- 172.21.15.7:0/615253683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c84104fd0 0x7f8c84100650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:11:11.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.978+0000 7f8c88d05640 1 -- 172.21.15.7:0/615253683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c841026a0 msgr2=0x7f8c84102000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:11:11.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.978+0000 7f8c88d05640 1 --2- 172.21.15.7:0/615253683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c841026a0 0x7f8c84102000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:11:11.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.978+0000 7f8c88d05640 1 -- 172.21.15.7:0/615253683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c84101450 con 0x7f8c84107900 2024-09-19T04:11:11.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.978+0000 7f8c88d05640 1 --2- 172.21.15.7:0/615253683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c84107900 0x7f8c84100b90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00eb10 tx=0x7f8c7c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:11:11.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.978+0000 7f8c817fa640 1 -- 172.21.15.7:0/615253683 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c004b20 con 0x7f8c84107900 2024-09-19T04:11:11.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.978+0000 7f8c817fa640 1 -- 172.21.15.7:0/615253683 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c7c004cc0 con 0x7f8c84107900 2024-09-19T04:11:11.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.978+0000 7f8c8a768640 1 -- 172.21.15.7:0/615253683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c841a20c0 con 0x7f8c84107900 2024-09-19T04:11:11.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.978+0000 7f8c817fa640 1 -- 172.21.15.7:0/615253683 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c010760 con 0x7f8c84107900 2024-09-19T04:11:11.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.979+0000 7f8c8a768640 1 -- 172.21.15.7:0/615253683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c841a25d0 con 0x7f8c84107900 2024-09-19T04:11:11.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.980+0000 7f8c8a768640 1 -- 172.21.15.7:0/615253683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c840fdd90 con 0x7f8c84107900 2024-09-19T04:11:11.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.981+0000 7f8c817fa640 1 -- 172.21.15.7:0/615253683 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f8c7c005020 con 0x7f8c84107900 2024-09-19T04:11:11.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.982+0000 7f8c817fa640 1 --2- 172.21.15.7:0/615253683 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f8c6c0a32c0 0x7f8c6c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:11:11.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.982+0000 7f8c83fff640 1 --2- 172.21.15.7:0/615253683 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f8c6c0a32c0 0x7f8c6c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:11:11.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.982+0000 7f8c817fa640 1 -- 172.21.15.7:0/615253683 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4566+0+0 (secure 0 0 0) 0x7f8c7c0cef80 con 0x7f8c84107900 2024-09-19T04:11:11.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.982+0000 7f8c83fff640 1 --2- 172.21.15.7:0/615253683 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f8c6c0a32c0 0x7f8c6c0a5780 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8c740314e0 tx=0x7f8c74000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:11:11.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:11.986+0000 7f8c817fa640 1 -- 172.21.15.7:0/615253683 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8c7c09cb40 con 0x7f8c84107900 2024-09-19T04:11:12.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:12.175+0000 7f8c8a768640 1 -- 172.21.15.7:0/615253683 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f8c84062630 con 0x7f8c6c0a32c0 2024-09-19T04:11:12.178 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:11 smithi007 ceph-mon[31360]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-19T04:11:12.178 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:11 smithi007 ceph-mon[31360]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T04:11:12.178 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:11 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:11:12.178 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:11 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:11:12.178 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:11 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:12.178 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:11 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:12.178 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:11 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:11:12.178 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:11 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:11:12.178 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:11 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:12.178 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:11 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:11:12.179 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:11 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:11:12.179 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:11 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:12.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:11 smithi092 ceph-mon[34940]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-19T04:11:12.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:11 smithi092 ceph-mon[34940]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T04:11:12.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:11 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:11:12.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:11 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:11:12.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:11 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:12.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:11 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:12.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:11 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:11:12.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:11 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:11:12.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:11 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:12.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:11 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:11:12.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:11 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:11:12.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:11 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:12.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:11 smithi102 ceph-mon[35446]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-19T04:11:12.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:11 smithi102 ceph-mon[35446]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T04:11:12.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:11 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:11:12.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:11 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:11:12.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:11 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:12.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:11 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:12.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:11 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:11:12.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:11 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:11:12.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:11 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:12.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:11 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:11:12.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:11 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:11:12.410 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:11 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:13.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:12 smithi092 ceph-mon[34940]: purged_snaps scrub starts 2024-09-19T04:11:13.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:12 smithi092 ceph-mon[34940]: purged_snaps scrub ok 2024-09-19T04:11:13.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:12 smithi092 ceph-mon[34940]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:11:13.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:12 smithi092 ceph-mon[34940]: Detected new or changed devices on smithi102 2024-09-19T04:11:13.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:12 smithi092 ceph-mon[34940]: Adjusting osd_memory_target on smithi102 to 8544M 2024-09-19T04:11:13.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:12 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:11:13.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:12 smithi092 ceph-mon[34940]: osd.5 [v2:172.21.15.102:6808/3099678146,v1:172.21.15.102:6809/3099678146] boot 2024-09-19T04:11:13.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:12 smithi092 ceph-mon[34940]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T04:11:13.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:12 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:11:13.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:12 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:11:13.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:12 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:11:13.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:12 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:11:13.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:12 smithi007 ceph-mon[31360]: purged_snaps scrub starts 2024-09-19T04:11:13.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:12 smithi007 ceph-mon[31360]: purged_snaps scrub ok 2024-09-19T04:11:13.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:12 smithi007 ceph-mon[31360]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:11:13.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:12 smithi007 ceph-mon[31360]: Detected new or changed devices on smithi102 2024-09-19T04:11:13.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:12 smithi007 ceph-mon[31360]: Adjusting osd_memory_target on smithi102 to 8544M 2024-09-19T04:11:13.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:12 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:11:13.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:12 smithi007 ceph-mon[31360]: osd.5 [v2:172.21.15.102:6808/3099678146,v1:172.21.15.102:6809/3099678146] boot 2024-09-19T04:11:13.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:12 smithi007 ceph-mon[31360]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T04:11:13.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:12 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:11:13.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:12 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:11:13.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:12 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:11:13.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:12 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:11:13.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:12 smithi102 ceph-mon[35446]: purged_snaps scrub starts 2024-09-19T04:11:13.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:12 smithi102 ceph-mon[35446]: purged_snaps scrub ok 2024-09-19T04:11:13.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:12 smithi102 ceph-mon[35446]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:11:13.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:12 smithi102 ceph-mon[35446]: Detected new or changed devices on smithi102 2024-09-19T04:11:13.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:12 smithi102 ceph-mon[35446]: Adjusting osd_memory_target on smithi102 to 8544M 2024-09-19T04:11:13.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:12 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:11:13.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:12 smithi102 ceph-mon[35446]: osd.5 [v2:172.21.15.102:6808/3099678146,v1:172.21.15.102:6809/3099678146] boot 2024-09-19T04:11:13.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:12 smithi102 ceph-mon[35446]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T04:11:13.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:12 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:11:13.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:12 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:11:13.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:12 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:11:13.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:12 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:11:14.125 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:13 smithi007 ceph-mon[31360]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:11:14.125 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:13 smithi007 ceph-mon[31360]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T04:11:14.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:13 smithi092 ceph-mon[34940]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:11:14.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:13 smithi092 ceph-mon[34940]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T04:11:14.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:13 smithi102 ceph-mon[35446]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:11:14.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:13 smithi102 ceph-mon[35446]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T04:11:15.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:14 smithi092 ceph-mon[34940]: pgmap v131: 1 pgs: 1 remapped+peering; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:11:15.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:14 smithi092 ceph-mon[34940]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T04:11:15.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:14 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1517689448' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7e5a8b30-8406-486c-ace5-79158a3757a2"}]: dispatch 2024-09-19T04:11:15.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:14 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1517689448' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7e5a8b30-8406-486c-ace5-79158a3757a2"}]': finished 2024-09-19T04:11:15.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:14 smithi092 ceph-mon[34940]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T04:11:15.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:14 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:11:15.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:14 smithi007 ceph-mon[31360]: pgmap v131: 1 pgs: 1 remapped+peering; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:11:15.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:14 smithi007 ceph-mon[31360]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T04:11:15.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:14 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1517689448' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7e5a8b30-8406-486c-ace5-79158a3757a2"}]: dispatch 2024-09-19T04:11:15.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:14 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1517689448' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7e5a8b30-8406-486c-ace5-79158a3757a2"}]': finished 2024-09-19T04:11:15.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:14 smithi007 ceph-mon[31360]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T04:11:15.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:14 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:11:15.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:14 smithi102 ceph-mon[35446]: pgmap v131: 1 pgs: 1 remapped+peering; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:11:15.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:14 smithi102 ceph-mon[35446]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T04:11:15.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:14 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1517689448' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7e5a8b30-8406-486c-ace5-79158a3757a2"}]: dispatch 2024-09-19T04:11:15.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:14 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1517689448' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7e5a8b30-8406-486c-ace5-79158a3757a2"}]': finished 2024-09-19T04:11:15.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:14 smithi102 ceph-mon[35446]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T04:11:15.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:14 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:11:16.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:15 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2966593007' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:11:16.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:15 smithi092 ceph-mon[34940]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T04:11:16.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:15 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:11:16.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:15 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2966593007' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:11:16.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:15 smithi007 ceph-mon[31360]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T04:11:16.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:15 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:11:16.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:15 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2966593007' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:11:16.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:15 smithi102 ceph-mon[35446]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T04:11:16.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:15 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:11:17.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:16 smithi092 ceph-mon[34940]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:11:17.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:16 smithi007 ceph-mon[31360]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:11:17.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:16 smithi102 ceph-mon[35446]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:11:19.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:18 smithi092 ceph-mon[34940]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:11:19.312 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:18 smithi007 ceph-mon[31360]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:11:19.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:18 smithi102 ceph-mon[35446]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:11:21.055 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:20 smithi007 ceph-mon[31360]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T04:11:21.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:20 smithi092 ceph-mon[34940]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T04:11:21.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:20 smithi102 ceph-mon[35446]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T04:11:23.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:22 smithi092 ceph-mon[34940]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-19T04:11:23.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:22 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T04:11:23.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:22 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:11:23.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:22 smithi007 ceph-mon[31360]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-19T04:11:23.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:22 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T04:11:23.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:22 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:11:23.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:22 smithi102 ceph-mon[35446]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-19T04:11:23.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:22 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T04:11:23.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:22 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:11:24.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:23 smithi092 ceph-mon[34940]: Deploying daemon osd.6 on smithi007 2024-09-19T04:11:24.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:23 smithi007 ceph-mon[31360]: Deploying daemon osd.6 on smithi007 2024-09-19T04:11:24.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:23 smithi102 ceph-mon[35446]: Deploying daemon osd.6 on smithi007 2024-09-19T04:11:25.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:24 smithi092 ceph-mon[34940]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-19T04:11:25.310 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:24 smithi102 ceph-mon[35446]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-19T04:11:25.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:24 smithi007 ceph-mon[31360]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-19T04:11:27.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:27 smithi007 ceph-mon[31360]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T04:11:27.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:27 smithi092 ceph-mon[34940]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T04:11:27.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:27 smithi102 ceph-mon[35446]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T04:11:29.004 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:29 smithi007 ceph-mon[31360]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-19T04:11:29.004 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:29 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:11:29.004 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:29 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:29.004 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:29 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:29.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:29 smithi092 ceph-mon[34940]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-19T04:11:29.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:29 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:11:29.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:29 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:29.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:29 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:29.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:29 smithi102 ceph-mon[35446]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-19T04:11:29.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:29 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:11:29.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:29 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:29.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:29 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:31.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:31 smithi092 ceph-mon[34940]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:11:31.317 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:31 smithi007 ceph-mon[31360]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:11:31.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:31 smithi102 ceph-mon[35446]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:11:32.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:32.653+0000 7f8c817fa640 1 -- 172.21.15.7:0/615253683 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8c84062630 con 0x7f8c6c0a32c0 2024-09-19T04:11:32.655 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 6 on host 'smithi007' 2024-09-19T04:11:32.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:32.655+0000 7f8c8a768640 1 -- 172.21.15.7:0/615253683 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f8c6c0a32c0 msgr2=0x7f8c6c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:11:32.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:32.655+0000 7f8c8a768640 1 --2- 172.21.15.7:0/615253683 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f8c6c0a32c0 0x7f8c6c0a5780 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8c740314e0 tx=0x7f8c74000bc0 comp rx=0 tx=0).stop 2024-09-19T04:11:32.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:32.655+0000 7f8c8a768640 1 -- 172.21.15.7:0/615253683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c84107900 msgr2=0x7f8c84100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:11:32.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:32.655+0000 7f8c8a768640 1 --2- 172.21.15.7:0/615253683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c84107900 0x7f8c84100b90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00eb10 tx=0x7f8c7c00c2d0 comp rx=0 tx=0).stop 2024-09-19T04:11:32.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:32.655+0000 7f8c8a768640 1 -- 172.21.15.7:0/615253683 shutdown_connections 2024-09-19T04:11:32.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:32.655+0000 7f8c8a768640 1 --2- 172.21.15.7:0/615253683 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f8c6c0a32c0 0x7f8c6c0a5780 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:11:32.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:32.655+0000 7f8c8a768640 1 --2- 172.21.15.7:0/615253683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c84107900 0x7f8c84100b90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:11:32.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:32.655+0000 7f8c8a768640 1 --2- 172.21.15.7:0/615253683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c84104fd0 0x7f8c84100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:11:32.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:32.655+0000 7f8c8a768640 1 --2- 172.21.15.7:0/615253683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c841026a0 0x7f8c84102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:11:32.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:32.656+0000 7f8c8a768640 1 -- 172.21.15.7:0/615253683 >> 172.21.15.7:0/615253683 conn(0x7f8c840fc2a0 msgr2=0x7f8c84103100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:11:32.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:32.656+0000 7f8c8a768640 1 -- 172.21.15.7:0/615253683 shutdown_connections 2024-09-19T04:11:32.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:11:32.656+0000 7f8c8a768640 1 -- 172.21.15.7:0/615253683 wait complete. 2024-09-19T04:11:32.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:32 smithi007 ceph-mon[31360]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:11:32.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:32 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:32.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:32 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:32.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:32 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:11:32.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:32 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:11:32.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:32 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:32.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:32 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:11:32.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:32 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:32.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:32 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:33.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:32 smithi092 ceph-mon[34940]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:11:33.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:32 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:33.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:32 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:33.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:32 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:11:33.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:32 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:11:33.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:32 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:33.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:32 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:11:33.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:32 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:33.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:32 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:33.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:32 smithi102 ceph-mon[35446]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:11:33.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:32 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:33.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:32 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:33.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:32 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:11:33.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:32 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:11:33.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:32 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:33.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:32 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:11:33.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:32 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:33.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:32 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:33.315 DEBUG:teuthology.orchestra.run.smithi007:osd.6> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.6.service 2024-09-19T04:11:33.358 INFO:tasks.cephadm:Deploying osd.7 on smithi092 with /dev/vg_nvme/lv_2... 2024-09-19T04:11:33.358 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T04:11:33.615 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:11:34.610 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:11:34 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:11:34.314+0000 7f44ccebb640 -1 osd.6 0 log_to_monitors true 2024-09-19T04:11:34.861 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:34 smithi007 ceph-mon[31360]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:11:34.861 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:34 smithi007 ceph-mon[31360]: from='osd.6 [v2:172.21.15.7:6818/1569704304,v1:172.21.15.7:6819/1569704304]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T04:11:35.012 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:34 smithi092 ceph-mon[34940]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:11:35.012 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:34 smithi092 ceph-mon[34940]: from='osd.6 [v2:172.21.15.7:6818/1569704304,v1:172.21.15.7:6819/1569704304]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T04:11:35.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:34 smithi102 ceph-mon[35446]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:11:35.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:34 smithi102 ceph-mon[35446]: from='osd.6 [v2:172.21.15.7:6818/1569704304,v1:172.21.15.7:6819/1569704304]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T04:11:35.819 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:11:35 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:11:35.691+0000 7f44c8e3e640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T04:11:35.819 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:11:35 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:11:35.702+0000 7f44c4c66640 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:11:35.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:35 smithi007 ceph-mon[31360]: from='osd.6 [v2:172.21.15.7:6818/1569704304,v1:172.21.15.7:6819/1569704304]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T04:11:35.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:35 smithi007 ceph-mon[31360]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T04:11:35.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:35 smithi007 ceph-mon[31360]: from='osd.6 [v2:172.21.15.7:6818/1569704304,v1:172.21.15.7:6819/1569704304]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-19T04:11:35.820 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:35 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:11:35.820 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:35 smithi007 ceph-mon[31360]: from='osd.6 [v2:172.21.15.7:6818/1569704304,v1:172.21.15.7:6819/1569704304]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-19T04:11:35.942 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:35 smithi092 ceph-mon[34940]: from='osd.6 [v2:172.21.15.7:6818/1569704304,v1:172.21.15.7:6819/1569704304]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T04:11:35.942 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:35 smithi092 ceph-mon[34940]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T04:11:35.942 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:35 smithi092 ceph-mon[34940]: from='osd.6 [v2:172.21.15.7:6818/1569704304,v1:172.21.15.7:6819/1569704304]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-19T04:11:35.942 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:35 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:11:35.942 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:35 smithi092 ceph-mon[34940]: from='osd.6 [v2:172.21.15.7:6818/1569704304,v1:172.21.15.7:6819/1569704304]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-19T04:11:36.035 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:35 smithi102 ceph-mon[35446]: from='osd.6 [v2:172.21.15.7:6818/1569704304,v1:172.21.15.7:6819/1569704304]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T04:11:36.036 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:35 smithi102 ceph-mon[35446]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T04:11:36.036 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:35 smithi102 ceph-mon[35446]: from='osd.6 [v2:172.21.15.7:6818/1569704304,v1:172.21.15.7:6819/1569704304]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-19T04:11:36.036 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:35 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:11:36.036 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:35 smithi102 ceph-mon[35446]: from='osd.6 [v2:172.21.15.7:6818/1569704304,v1:172.21.15.7:6819/1569704304]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-19T04:11:36.221 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T04:11:36.249 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi092:vg_nvme/lv_2 2024-09-19T04:11:36.502 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:11:36.767 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:36 smithi092 ceph-mon[34940]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:11:36.767 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:36 smithi092 ceph-mon[34940]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T04:11:36.767 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:36 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:11:36.767 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:36 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:11:36.767 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:36 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:36.767 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:36 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:36.767 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:36 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:11:36.767 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:36 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:11:36.767 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:36 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:11:36.767 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:36 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:36.767 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:36 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:11:36.767 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:36 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:11:36.768 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:36 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:36.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:36 smithi102 ceph-mon[35446]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:11:36.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:36 smithi102 ceph-mon[35446]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T04:11:36.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:36 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:11:36.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:36 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:11:36.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:36 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:36.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:36 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:36.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:36 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:11:36.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:36 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:11:36.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:36 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:11:36.910 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:36 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:36.910 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:36 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:11:36.910 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:36 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:11:36.910 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:36 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:36.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.982+0000 7f1ac0d26640 1 -- 172.21.15.92:0/2006310812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1abc101cd0 msgr2=0x7f1abc102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:11:36.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.982+0000 7f1ac0d26640 1 --2- 172.21.15.92:0/2006310812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1abc101cd0 0x7f1abc102150 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009900 tx=0x7f1ab002a410 comp rx=0 tx=0).stop 2024-09-19T04:11:36.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.982+0000 7f1ac0d26640 1 -- 172.21.15.92:0/2006310812 shutdown_connections 2024-09-19T04:11:36.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.982+0000 7f1ac0d26640 1 --2- 172.21.15.92:0/2006310812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1abc102690 0x7f1abc108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:11:36.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.982+0000 7f1ac0d26640 1 --2- 172.21.15.92:0/2006310812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1abc101cd0 0x7f1abc102150 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:11:36.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.982+0000 7f1ac0d26640 1 --2- 172.21.15.92:0/2006310812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1abc100ad0 0x7f1abc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:11:36.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.982+0000 7f1ac0d26640 1 -- 172.21.15.92:0/2006310812 >> 172.21.15.92:0/2006310812 conn(0x7f1abc0fc280 msgr2=0x7f1abc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:11:36.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.982+0000 7f1ac0d26640 1 -- 172.21.15.92:0/2006310812 shutdown_connections 2024-09-19T04:11:36.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.982+0000 7f1ac0d26640 1 -- 172.21.15.92:0/2006310812 wait complete. 2024-09-19T04:11:36.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.983+0000 7f1ac0d26640 1 Processor -- start 2024-09-19T04:11:36.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.983+0000 7f1ac0d26640 1 -- start start 2024-09-19T04:11:36.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.983+0000 7f1ac0d26640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1abc100ad0 0x7f1abc195ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:11:36.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.983+0000 7f1ac0d26640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1abc101cd0 0x7f1abc1961e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:11:36.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.983+0000 7f1ac0d26640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1abc102690 0x7f1abc19d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:11:36.998 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.983+0000 7f1ac0d26640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc10b6b0 con 0x7f1abc100ad0 2024-09-19T04:11:36.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.983+0000 7f1ac0d26640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc10b530 con 0x7f1abc101cd0 2024-09-19T04:11:36.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.983+0000 7f1ac0d26640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc10b830 con 0x7f1abc102690 2024-09-19T04:11:36.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.983+0000 7f1ab9d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1abc101cd0 0x7f1abc1961e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:11:36.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.983+0000 7f1ab9d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1abc101cd0 0x7f1abc1961e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:48890/0 (socket says 172.21.15.92:48890) 2024-09-19T04:11:36.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.983+0000 7f1ab9d9b640 1 -- 172.21.15.92:0/2080021560 learned_addr learned my addr 172.21.15.92:0/2080021560 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T04:11:36.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.983+0000 7f1aba59c640 1 --2- 172.21.15.92:0/2080021560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1abc100ad0 0x7f1abc195ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:11:36.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.983+0000 7f1abad9d640 1 --2- 172.21.15.92:0/2080021560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1abc102690 0x7f1abc19d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:11:36.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.983+0000 7f1ab9d9b640 1 -- 172.21.15.92:0/2080021560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1abc102690 msgr2=0x7f1abc19d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:11:36.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.983+0000 7f1ab9d9b640 1 --2- 172.21.15.92:0/2080021560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1abc102690 0x7f1abc19d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:11:36.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.983+0000 7f1ab9d9b640 1 -- 172.21.15.92:0/2080021560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1abc100ad0 msgr2=0x7f1abc195ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:11:36.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.983+0000 7f1ab9d9b640 1 --2- 172.21.15.92:0/2080021560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1abc100ad0 0x7f1abc195ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:11:36.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.983+0000 7f1ab9d9b640 1 -- 172.21.15.92:0/2080021560 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1abc19d8c0 con 0x7f1abc101cd0 2024-09-19T04:11:37.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.983+0000 7f1abad9d640 1 --2- 172.21.15.92:0/2080021560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1abc102690 0x7f1abc19d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:11:37.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.983+0000 7f1ab9d9b640 1 --2- 172.21.15.92:0/2080021560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1abc101cd0 0x7f1abc1961e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0031440 tx=0x7f1ab0032e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:11:37.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.984+0000 7f1aab7fe640 1 -- 172.21.15.92:0/2080021560 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab003f030 con 0x7f1abc101cd0 2024-09-19T04:11:37.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.984+0000 7f1ac0d26640 1 -- 172.21.15.92:0/2080021560 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1abc19db50 con 0x7f1abc101cd0 2024-09-19T04:11:37.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.984+0000 7f1aab7fe640 1 -- 172.21.15.92:0/2080021560 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ab0003ce0 con 0x7f1abc101cd0 2024-09-19T04:11:37.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.984+0000 7f1aab7fe640 1 -- 172.21.15.92:0/2080021560 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0035070 con 0x7f1abc101cd0 2024-09-19T04:11:37.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.984+0000 7f1ac0d26640 1 -- 172.21.15.92:0/2080021560 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1abc19e030 con 0x7f1abc101cd0 2024-09-19T04:11:37.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.985+0000 7f1ac0d26640 1 -- 172.21.15.92:0/2080021560 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1abc107e80 con 0x7f1abc101cd0 2024-09-19T04:11:37.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.987+0000 7f1aab7fe640 1 -- 172.21.15.92:0/2080021560 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f1ab0042030 con 0x7f1abc101cd0 2024-09-19T04:11:37.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.987+0000 7f1aab7fe640 1 --2- 172.21.15.92:0/2080021560 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1aa40a5450 0x7f1aa40a7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:11:37.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.987+0000 7f1aab7fe640 1 -- 172.21.15.92:0/2080021560 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4965+0+0 (secure 0 0 0) 0x7f1ab00ef580 con 0x7f1abc101cd0 2024-09-19T04:11:37.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.987+0000 7f1aba59c640 1 --2- 172.21.15.92:0/2080021560 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1aa40a5450 0x7f1aa40a7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:11:37.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.988+0000 7f1aba59c640 1 --2- 172.21.15.92:0/2080021560 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1aa40a5450 0x7f1aa40a7910 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1abc196b80 tx=0x7f1aac00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:11:37.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:36.991+0000 7f1aab7fe640 1 -- 172.21.15.92:0/2080021560 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1ab00bc960 con 0x7f1abc101cd0 2024-09-19T04:11:37.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:36 smithi007 ceph-mon[31360]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:11:37.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:36 smithi007 ceph-mon[31360]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T04:11:37.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:36 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:11:37.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:36 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:11:37.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:36 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:37.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:36 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:37.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:36 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:11:37.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:36 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:11:37.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:36 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:11:37.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:36 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:37.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:36 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:11:37.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:36 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:11:37.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:36 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:37.168 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:37.167+0000 7f1ac0d26640 1 -- 172.21.15.92:0/2080021560 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f1abc062630 con 0x7f1aa40a5450 2024-09-19T04:11:38.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:37 smithi092 ceph-mon[34940]: purged_snaps scrub starts 2024-09-19T04:11:38.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:37 smithi092 ceph-mon[34940]: purged_snaps scrub ok 2024-09-19T04:11:38.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:37 smithi092 ceph-mon[34940]: Detected new or changed devices on smithi007 2024-09-19T04:11:38.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:37 smithi092 ceph-mon[34940]: Adjusting osd_memory_target on smithi007 to 5697M 2024-09-19T04:11:38.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:37 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:11:38.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:37 smithi092 ceph-mon[34940]: osd.6 [v2:172.21.15.7:6818/1569704304,v1:172.21.15.7:6819/1569704304] boot 2024-09-19T04:11:38.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:37 smithi092 ceph-mon[34940]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T04:11:38.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:37 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:11:38.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:37 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:11:38.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:37 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:11:38.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:37 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:11:38.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:37 smithi007 ceph-mon[31360]: purged_snaps scrub starts 2024-09-19T04:11:38.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:37 smithi007 ceph-mon[31360]: purged_snaps scrub ok 2024-09-19T04:11:38.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:37 smithi007 ceph-mon[31360]: Detected new or changed devices on smithi007 2024-09-19T04:11:38.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:37 smithi007 ceph-mon[31360]: Adjusting osd_memory_target on smithi007 to 5697M 2024-09-19T04:11:38.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:37 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:11:38.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:37 smithi007 ceph-mon[31360]: osd.6 [v2:172.21.15.7:6818/1569704304,v1:172.21.15.7:6819/1569704304] boot 2024-09-19T04:11:38.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:37 smithi007 ceph-mon[31360]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T04:11:38.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:37 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:11:38.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:37 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:11:38.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:37 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:11:38.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:37 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:11:38.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:37 smithi102 ceph-mon[35446]: purged_snaps scrub starts 2024-09-19T04:11:38.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:37 smithi102 ceph-mon[35446]: purged_snaps scrub ok 2024-09-19T04:11:38.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:37 smithi102 ceph-mon[35446]: Detected new or changed devices on smithi007 2024-09-19T04:11:38.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:37 smithi102 ceph-mon[35446]: Adjusting osd_memory_target on smithi007 to 5697M 2024-09-19T04:11:38.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:37 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:11:38.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:37 smithi102 ceph-mon[35446]: osd.6 [v2:172.21.15.7:6818/1569704304,v1:172.21.15.7:6819/1569704304] boot 2024-09-19T04:11:38.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:37 smithi102 ceph-mon[35446]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T04:11:38.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:37 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:11:38.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:37 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:11:38.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:37 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:11:38.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:37 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:11:38.933 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:38 smithi092 ceph-mon[34940]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:11:38.933 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:38 smithi092 ceph-mon[34940]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:11:38.933 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:38 smithi092 ceph-mon[34940]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T04:11:39.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:38 smithi007 ceph-mon[31360]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:11:39.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:38 smithi007 ceph-mon[31360]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:11:39.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:38 smithi007 ceph-mon[31360]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T04:11:39.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:38 smithi102 ceph-mon[35446]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:11:39.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:38 smithi102 ceph-mon[35446]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:11:39.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:38 smithi102 ceph-mon[35446]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T04:11:39.964 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:39 smithi092 ceph-mon[34940]: from='client.? 172.21.15.92:0/2403300908' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6a7049a-17a1-43b2-8ecd-5f4ca7c337be"}]: dispatch 2024-09-19T04:11:39.964 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:39 smithi092 ceph-mon[34940]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6a7049a-17a1-43b2-8ecd-5f4ca7c337be"}]: dispatch 2024-09-19T04:11:39.964 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:39 smithi092 ceph-mon[34940]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6a7049a-17a1-43b2-8ecd-5f4ca7c337be"}]': finished 2024-09-19T04:11:39.964 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:39 smithi092 ceph-mon[34940]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T04:11:39.964 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:39 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:11:40.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:39 smithi007 ceph-mon[31360]: from='client.? 172.21.15.92:0/2403300908' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6a7049a-17a1-43b2-8ecd-5f4ca7c337be"}]: dispatch 2024-09-19T04:11:40.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:39 smithi007 ceph-mon[31360]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6a7049a-17a1-43b2-8ecd-5f4ca7c337be"}]: dispatch 2024-09-19T04:11:40.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:39 smithi007 ceph-mon[31360]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6a7049a-17a1-43b2-8ecd-5f4ca7c337be"}]': finished 2024-09-19T04:11:40.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:39 smithi007 ceph-mon[31360]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T04:11:40.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:39 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:11:40.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:39 smithi102 ceph-mon[35446]: from='client.? 172.21.15.92:0/2403300908' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6a7049a-17a1-43b2-8ecd-5f4ca7c337be"}]: dispatch 2024-09-19T04:11:40.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:39 smithi102 ceph-mon[35446]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e6a7049a-17a1-43b2-8ecd-5f4ca7c337be"}]: dispatch 2024-09-19T04:11:40.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:39 smithi102 ceph-mon[35446]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e6a7049a-17a1-43b2-8ecd-5f4ca7c337be"}]': finished 2024-09-19T04:11:40.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:39 smithi102 ceph-mon[35446]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T04:11:40.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:39 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:11:41.046 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:40 smithi092 ceph-mon[34940]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:11:41.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:40 smithi092 ceph-mon[34940]: from='client.? 172.21.15.92:0/3370763980' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:11:41.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:40 smithi007 ceph-mon[31360]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:11:41.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:40 smithi007 ceph-mon[31360]: from='client.? 172.21.15.92:0/3370763980' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:11:41.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:40 smithi102 ceph-mon[35446]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:11:41.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:40 smithi102 ceph-mon[35446]: from='client.? 172.21.15.92:0/3370763980' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:11:43.046 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:42 smithi092 ceph-mon[34940]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:11:43.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:42 smithi007 ceph-mon[31360]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:11:43.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:42 smithi102 ceph-mon[35446]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:11:45.046 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:44 smithi092 ceph-mon[34940]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:11:45.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:44 smithi007 ceph-mon[31360]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:11:45.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:44 smithi102 ceph-mon[35446]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:11:46.952 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:46 smithi092 ceph-mon[34940]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:11:47.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:46 smithi007 ceph-mon[31360]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:11:47.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:46 smithi102 ceph-mon[35446]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:11:48.905 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:48 smithi092 ceph-mon[34940]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:11:48.905 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:48 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T04:11:48.905 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:48 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:11:49.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:48 smithi007 ceph-mon[31360]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:11:49.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:48 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T04:11:49.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:48 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:11:49.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:48 smithi102 ceph-mon[35446]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:11:49.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:48 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T04:11:49.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:48 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:11:49.837 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:49 smithi092 ceph-mon[34940]: Deploying daemon osd.7 on smithi092 2024-09-19T04:11:50.028 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:49 smithi007 ceph-mon[31360]: Deploying daemon osd.7 on smithi092 2024-09-19T04:11:50.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:49 smithi102 ceph-mon[35446]: Deploying daemon osd.7 on smithi092 2024-09-19T04:11:50.901 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:50 smithi092 ceph-mon[34940]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:11:51.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:50 smithi007 ceph-mon[31360]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:11:51.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:50 smithi102 ceph-mon[35446]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:11:52.974 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:52 smithi092 ceph-mon[34940]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:11:53.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:52 smithi007 ceph-mon[31360]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:11:53.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:52 smithi102 ceph-mon[35446]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:11:54.893 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:54 smithi092 ceph-mon[34940]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:11:54.893 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:54 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:11:54.893 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:54 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:54.893 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:54 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:55.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:54 smithi007 ceph-mon[31360]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:11:55.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:54 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:11:55.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:54 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:55.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:54 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:55.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:54 smithi102 ceph-mon[35446]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:11:55.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:54 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:11:55.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:54 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:55.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:54 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:57.046 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:56 smithi092 ceph-mon[34940]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:11:57.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:56 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:57.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:56 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:57.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:56 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:11:57.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:56 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:11:57.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:56 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:57.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:56 smithi007 ceph-mon[31360]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:11:57.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:56 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:57.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:56 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:57.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:56 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:11:57.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:56 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:11:57.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:56 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:57.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:56 smithi102 ceph-mon[35446]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:11:57.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:56 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:57.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:56 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:57.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:56 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:11:57.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:56 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:11:57.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:56 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:57.448 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 7 on host 'smithi092' 2024-09-19T04:11:57.448 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:57.446+0000 7f1aab7fe640 1 -- 172.21.15.92:0/2080021560 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1abc062630 con 0x7f1aa40a5450 2024-09-19T04:11:57.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:57.448+0000 7f1ac0d26640 1 -- 172.21.15.92:0/2080021560 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1aa40a5450 msgr2=0x7f1aa40a7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:11:57.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:57.448+0000 7f1ac0d26640 1 --2- 172.21.15.92:0/2080021560 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1aa40a5450 0x7f1aa40a7910 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1abc196b80 tx=0x7f1aac00b390 comp rx=0 tx=0).stop 2024-09-19T04:11:57.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:57.448+0000 7f1ac0d26640 1 -- 172.21.15.92:0/2080021560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1abc101cd0 msgr2=0x7f1abc1961e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:11:57.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:57.448+0000 7f1ac0d26640 1 --2- 172.21.15.92:0/2080021560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1abc101cd0 0x7f1abc1961e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0031440 tx=0x7f1ab0032e20 comp rx=0 tx=0).stop 2024-09-19T04:11:57.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:57.448+0000 7f1ac0d26640 1 -- 172.21.15.92:0/2080021560 shutdown_connections 2024-09-19T04:11:57.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:57.448+0000 7f1ac0d26640 1 --2- 172.21.15.92:0/2080021560 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1aa40a5450 0x7f1aa40a7910 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:11:57.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:57.448+0000 7f1ac0d26640 1 --2- 172.21.15.92:0/2080021560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1abc102690 0x7f1abc19d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:11:57.450 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:57.448+0000 7f1ac0d26640 1 --2- 172.21.15.92:0/2080021560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1abc101cd0 0x7f1abc1961e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:11:57.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:57.448+0000 7f1ac0d26640 1 --2- 172.21.15.92:0/2080021560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1abc100ad0 0x7f1abc195ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:11:57.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:57.448+0000 7f1ac0d26640 1 -- 172.21.15.92:0/2080021560 >> 172.21.15.92:0/2080021560 conn(0x7f1abc0fc280 msgr2=0x7f1abc105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:11:57.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:57.448+0000 7f1ac0d26640 1 -- 172.21.15.92:0/2080021560 shutdown_connections 2024-09-19T04:11:57.451 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:11:57.449+0000 7f1ac0d26640 1 -- 172.21.15.92:0/2080021560 wait complete. 2024-09-19T04:11:58.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:57 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:11:58.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:57 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:58.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:57 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:58.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:57 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:11:58.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:57 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:58.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:57 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:58.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:57 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:11:58.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:57 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:58.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:57 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:11:58.177 DEBUG:teuthology.orchestra.run.smithi092:osd.7> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.7.service 2024-09-19T04:11:58.179 INFO:tasks.cephadm:Deploying osd.8 on smithi102 with /dev/vg_nvme/lv_2... 2024-09-19T04:11:58.179 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T04:11:58.433 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:11:58.817 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:11:58 smithi102 ceph-mon[35446]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:11:59.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:11:58 smithi092 ceph-mon[34940]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:11:59.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:11:58 smithi007 ceph-mon[31360]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:12:00.547 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:12:00 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:12:00.080+0000 7efde1748640 -1 osd.7 0 log_to_monitors true 2024-09-19T04:12:00.873 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:00 smithi092 ceph-mon[34940]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:12:00.873 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:00 smithi092 ceph-mon[34940]: from='osd.7 [v2:172.21.15.92:6816/3411102480,v1:172.21.15.92:6817/3411102480]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T04:12:00.873 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:00 smithi092 ceph-mon[34940]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T04:12:01.097 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:00 smithi102 ceph-mon[35446]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:12:01.098 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:00 smithi102 ceph-mon[35446]: from='osd.7 [v2:172.21.15.92:6816/3411102480,v1:172.21.15.92:6817/3411102480]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T04:12:01.098 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:00 smithi102 ceph-mon[35446]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T04:12:01.100 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T04:12:01.126 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi102:vg_nvme/lv_2 2024-09-19T04:12:01.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:00 smithi007 ceph-mon[31360]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:12:01.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:00 smithi007 ceph-mon[31360]: from='osd.7 [v2:172.21.15.92:6816/3411102480,v1:172.21.15.92:6817/3411102480]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T04:12:01.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:00 smithi007 ceph-mon[31360]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T04:12:01.371 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:12:01.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.836+0000 7f980e778640 1 -- 172.21.15.102:0/3360220941 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9808101cd0 msgr2=0x7f9808102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:12:01.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.836+0000 7f980e778640 1 --2- 172.21.15.102:0/3360220941 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9808101cd0 0x7f9808102150 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009900 tx=0x7f97f002a410 comp rx=0 tx=0).stop 2024-09-19T04:12:01.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.836+0000 7f980e778640 1 -- 172.21.15.102:0/3360220941 shutdown_connections 2024-09-19T04:12:01.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.836+0000 7f980e778640 1 --2- 172.21.15.102:0/3360220941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9808102690 0x7f9808108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:12:01.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.836+0000 7f980e778640 1 --2- 172.21.15.102:0/3360220941 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9808101cd0 0x7f9808102150 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:12:01.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.836+0000 7f980e778640 1 --2- 172.21.15.102:0/3360220941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9808100ad0 0x7f9808100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:12:01.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.836+0000 7f980e778640 1 -- 172.21.15.102:0/3360220941 >> 172.21.15.102:0/3360220941 conn(0x7f98080fc280 msgr2=0x7f98080fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:12:01.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.836+0000 7f980e778640 1 -- 172.21.15.102:0/3360220941 shutdown_connections 2024-09-19T04:12:01.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.836+0000 7f980e778640 1 -- 172.21.15.102:0/3360220941 wait complete. 2024-09-19T04:12:01.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.836+0000 7f980e778640 1 Processor -- start 2024-09-19T04:12:01.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.836+0000 7f980e778640 1 -- start start 2024-09-19T04:12:01.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.837+0000 7f980e778640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9808100ad0 0x7f9808197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:12:01.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.837+0000 7f980e778640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9808101cd0 0x7f9808198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:12:01.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.837+0000 7f980e778640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9808102690 0x7f980819f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:12:01.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.837+0000 7f980e778640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f980810c750 con 0x7f9808100ad0 2024-09-19T04:12:01.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.837+0000 7f980e778640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f980810c5d0 con 0x7f9808101cd0 2024-09-19T04:12:01.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.837+0000 7f980e778640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f980810c8d0 con 0x7f9808102690 2024-09-19T04:12:01.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.837+0000 7f980cd15640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9808102690 0x7f980819f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:12:01.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.837+0000 7f980cd15640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9808102690 0x7f980819f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46678/0 (socket says 172.21.15.102:46678) 2024-09-19T04:12:01.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.837+0000 7f980cd15640 1 -- 172.21.15.102:0/2947095623 learned_addr learned my addr 172.21.15.102:0/2947095623 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T04:12:01.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.837+0000 7f98077fe640 1 --2- 172.21.15.102:0/2947095623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9808101cd0 0x7f9808198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:12:01.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.837+0000 7f9807fff640 1 --2- 172.21.15.102:0/2947095623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9808100ad0 0x7f9808197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:12:01.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.837+0000 7f980cd15640 1 -- 172.21.15.102:0/2947095623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9808101cd0 msgr2=0x7f9808198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:12:01.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.837+0000 7f980cd15640 1 --2- 172.21.15.102:0/2947095623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9808101cd0 0x7f9808198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:12:01.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.837+0000 7f980cd15640 1 -- 172.21.15.102:0/2947095623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9808100ad0 msgr2=0x7f9808197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:12:01.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.837+0000 7f980cd15640 1 --2- 172.21.15.102:0/2947095623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9808100ad0 0x7f9808197ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:12:01.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.837+0000 7f980cd15640 1 -- 172.21.15.102:0/2947095623 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f980819faf0 con 0x7f9808102690 2024-09-19T04:12:01.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.837+0000 7f980cd15640 1 --2- 172.21.15.102:0/2947095623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9808102690 0x7f980819f480 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f980000eaa0 tx=0x7f980000ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:12:01.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.837+0000 7f98057fa640 1 -- 172.21.15.102:0/2947095623 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980000cdb0 con 0x7f9808102690 2024-09-19T04:12:01.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.837+0000 7f98057fa640 1 -- 172.21.15.102:0/2947095623 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9800005020 con 0x7f9808102690 2024-09-19T04:12:01.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.837+0000 7f980e778640 1 -- 172.21.15.102:0/2947095623 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f980819fde0 con 0x7f9808102690 2024-09-19T04:12:01.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.838+0000 7f98057fa640 1 -- 172.21.15.102:0/2947095623 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98000116b0 con 0x7f9808102690 2024-09-19T04:12:01.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.838+0000 7f980e778640 1 -- 172.21.15.102:0/2947095623 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98081a0290 con 0x7f9808102690 2024-09-19T04:12:01.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.839+0000 7f980e778640 1 -- 172.21.15.102:0/2947095623 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98081a0520 con 0x7f9808102690 2024-09-19T04:12:01.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.840+0000 7f98057fa640 1 -- 172.21.15.102:0/2947095623 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f9800005560 con 0x7f9808102690 2024-09-19T04:12:01.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.841+0000 7f98057fa640 1 --2- 172.21.15.102:0/2947095623 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f97f40a3270 0x7f97f40a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:12:01.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.841+0000 7f98057fa640 1 -- 172.21.15.102:0/2947095623 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5117+0+0 (secure 0 0 0) 0x7f98000cf280 con 0x7f9808102690 2024-09-19T04:12:01.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.841+0000 7f9807fff640 1 --2- 172.21.15.102:0/2947095623 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f97f40a3270 0x7f97f40a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:12:01.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.841+0000 7f9807fff640 1 --2- 172.21.15.102:0/2947095623 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f97f40a3270 0x7f97f40a5730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9808101b30 tx=0x7f97f8005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:12:01.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:01.844+0000 7f98057fa640 1 -- 172.21.15.102:0/2947095623 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9800016030 con 0x7f9808102690 2024-09-19T04:12:01.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:01 smithi102 ceph-mon[35446]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T04:12:01.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:01 smithi102 ceph-mon[35446]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T04:12:01.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:01 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:12:01.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:01 smithi102 ceph-mon[35446]: from='osd.7 [v2:172.21.15.92:6816/3411102480,v1:172.21.15.92:6817/3411102480]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T04:12:01.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:01 smithi102 ceph-mon[35446]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T04:12:01.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:01 smithi102 ceph-mon[35446]: Detected new or changed devices on smithi092 2024-09-19T04:12:01.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:01 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:01.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:01 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:01.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:01 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:01.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:01 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:01.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:01 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:01.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:01 smithi102 ceph-mon[35446]: Adjusting osd_memory_target on smithi092 to 5696M 2024-09-19T04:12:01.910 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:01 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:01.910 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:01 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:01.910 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:01 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:12:01.910 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:01 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:02.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:02.022+0000 7f980e778640 1 -- 172.21.15.102:0/2947095623 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f98081a06f0 con 0x7f97f40a3270 2024-09-19T04:12:02.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:01 smithi092 ceph-mon[34940]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T04:12:02.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:01 smithi092 ceph-mon[34940]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T04:12:02.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:01 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:12:02.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:01 smithi092 ceph-mon[34940]: from='osd.7 [v2:172.21.15.92:6816/3411102480,v1:172.21.15.92:6817/3411102480]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T04:12:02.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:01 smithi092 ceph-mon[34940]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T04:12:02.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:01 smithi092 ceph-mon[34940]: Detected new or changed devices on smithi092 2024-09-19T04:12:02.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:01 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:02.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:01 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:02.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:01 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:02.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:01 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:02.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:01 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:02.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:01 smithi092 ceph-mon[34940]: Adjusting osd_memory_target on smithi092 to 5696M 2024-09-19T04:12:02.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:01 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:02.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:01 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:02.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:01 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:12:02.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:01 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:02.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:01 smithi007 ceph-mon[31360]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T04:12:02.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:01 smithi007 ceph-mon[31360]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T04:12:02.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:01 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:12:02.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:01 smithi007 ceph-mon[31360]: from='osd.7 [v2:172.21.15.92:6816/3411102480,v1:172.21.15.92:6817/3411102480]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T04:12:02.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:01 smithi007 ceph-mon[31360]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T04:12:02.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:01 smithi007 ceph-mon[31360]: Detected new or changed devices on smithi092 2024-09-19T04:12:02.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:01 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:02.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:01 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:02.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:01 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:02.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:01 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:02.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:01 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:02.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:01 smithi007 ceph-mon[31360]: Adjusting osd_memory_target on smithi092 to 5696M 2024-09-19T04:12:02.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:01 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:02.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:01 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:02.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:01 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:12:02.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:01 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:02.546 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:12:02 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:12:02.161+0000 7efddd6cb640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T04:12:02.547 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:12:02 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:12:02.169+0000 7efdd54eb640 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:12:03.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:02 smithi092 ceph-mon[34940]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:12:03.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:02 smithi092 ceph-mon[34940]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-19T04:12:03.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:02 smithi092 ceph-mon[34940]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T04:12:03.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:02 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:12:03.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:02 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:12:03.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:02 smithi092 ceph-mon[34940]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:12:03.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:02 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:12:03.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:02 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:12:03.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:02 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:03.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:02 smithi092 ceph-mon[34940]: from='osd.7 ' entity='osd.7' 2024-09-19T04:12:03.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:02 smithi007 ceph-mon[31360]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:12:03.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:02 smithi007 ceph-mon[31360]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-19T04:12:03.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:02 smithi007 ceph-mon[31360]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T04:12:03.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:02 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:12:03.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:02 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:12:03.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:02 smithi007 ceph-mon[31360]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:12:03.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:02 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:12:03.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:02 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:12:03.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:02 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:03.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:02 smithi007 ceph-mon[31360]: from='osd.7 ' entity='osd.7' 2024-09-19T04:12:03.133 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:02 smithi102 ceph-mon[35446]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:12:03.133 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:02 smithi102 ceph-mon[35446]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-19T04:12:03.134 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:02 smithi102 ceph-mon[35446]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T04:12:03.134 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:02 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:12:03.134 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:02 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:12:03.134 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:02 smithi102 ceph-mon[35446]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:12:03.134 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:02 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:12:03.134 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:02 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:12:03.134 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:02 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:03.134 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:02 smithi102 ceph-mon[35446]: from='osd.7 ' entity='osd.7' 2024-09-19T04:12:04.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:03 smithi092 ceph-mon[34940]: purged_snaps scrub starts 2024-09-19T04:12:04.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:03 smithi092 ceph-mon[34940]: purged_snaps scrub ok 2024-09-19T04:12:04.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:03 smithi092 ceph-mon[34940]: osd.7 [v2:172.21.15.92:6816/3411102480,v1:172.21.15.92:6817/3411102480] boot 2024-09-19T04:12:04.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:03 smithi092 ceph-mon[34940]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T04:12:04.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:03 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:12:04.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:03 smithi092 ceph-mon[34940]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T04:12:04.079 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:03 smithi102 ceph-mon[35446]: purged_snaps scrub starts 2024-09-19T04:12:04.079 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:03 smithi102 ceph-mon[35446]: purged_snaps scrub ok 2024-09-19T04:12:04.079 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:03 smithi102 ceph-mon[35446]: osd.7 [v2:172.21.15.92:6816/3411102480,v1:172.21.15.92:6817/3411102480] boot 2024-09-19T04:12:04.079 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:03 smithi102 ceph-mon[35446]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T04:12:04.079 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:03 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:12:04.079 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:03 smithi102 ceph-mon[35446]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T04:12:04.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:03 smithi007 ceph-mon[31360]: purged_snaps scrub starts 2024-09-19T04:12:04.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:03 smithi007 ceph-mon[31360]: purged_snaps scrub ok 2024-09-19T04:12:04.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:03 smithi007 ceph-mon[31360]: osd.7 [v2:172.21.15.92:6816/3411102480,v1:172.21.15.92:6817/3411102480] boot 2024-09-19T04:12:04.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:03 smithi007 ceph-mon[31360]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T04:12:04.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:03 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:12:04.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:03 smithi007 ceph-mon[31360]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T04:12:05.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:04 smithi092 ceph-mon[34940]: pgmap v167: 1 pgs: 1 remapped; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:12:05.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:04 smithi092 ceph-mon[34940]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T04:12:05.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:04 smithi092 ceph-mon[34940]: from='client.? 172.21.15.102:0/2975786517' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31879baa-861d-4322-990f-0b9a42b8b610"}]: dispatch 2024-09-19T04:12:05.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:04 smithi092 ceph-mon[34940]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31879baa-861d-4322-990f-0b9a42b8b610"}]: dispatch 2024-09-19T04:12:05.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:04 smithi092 ceph-mon[34940]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31879baa-861d-4322-990f-0b9a42b8b610"}]': finished 2024-09-19T04:12:05.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:04 smithi092 ceph-mon[34940]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T04:12:05.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:04 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:12:05.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:04 smithi007 ceph-mon[31360]: pgmap v167: 1 pgs: 1 remapped; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:12:05.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:04 smithi007 ceph-mon[31360]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T04:12:05.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:04 smithi007 ceph-mon[31360]: from='client.? 172.21.15.102:0/2975786517' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31879baa-861d-4322-990f-0b9a42b8b610"}]: dispatch 2024-09-19T04:12:05.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:04 smithi007 ceph-mon[31360]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31879baa-861d-4322-990f-0b9a42b8b610"}]: dispatch 2024-09-19T04:12:05.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:04 smithi007 ceph-mon[31360]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31879baa-861d-4322-990f-0b9a42b8b610"}]': finished 2024-09-19T04:12:05.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:04 smithi007 ceph-mon[31360]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T04:12:05.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:04 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:12:05.138 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:04 smithi102 ceph-mon[35446]: pgmap v167: 1 pgs: 1 remapped; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:12:05.138 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:04 smithi102 ceph-mon[35446]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T04:12:05.138 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:04 smithi102 ceph-mon[35446]: from='client.? 172.21.15.102:0/2975786517' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31879baa-861d-4322-990f-0b9a42b8b610"}]: dispatch 2024-09-19T04:12:05.138 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:04 smithi102 ceph-mon[35446]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31879baa-861d-4322-990f-0b9a42b8b610"}]: dispatch 2024-09-19T04:12:05.138 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:04 smithi102 ceph-mon[35446]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31879baa-861d-4322-990f-0b9a42b8b610"}]': finished 2024-09-19T04:12:05.138 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:04 smithi102 ceph-mon[35446]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T04:12:05.138 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:04 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:12:06.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:05 smithi092 ceph-mon[34940]: from='client.? 172.21.15.102:0/3678190033' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:12:06.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:05 smithi092 ceph-mon[34940]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T04:12:06.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:05 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:12:06.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:05 smithi007 ceph-mon[31360]: from='client.? 172.21.15.102:0/3678190033' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:12:06.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:05 smithi007 ceph-mon[31360]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T04:12:06.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:05 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:12:06.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:05 smithi102 ceph-mon[35446]: from='client.? 172.21.15.102:0/3678190033' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:12:06.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:05 smithi102 ceph-mon[35446]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T04:12:06.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:05 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:12:07.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:06 smithi092 ceph-mon[34940]: pgmap v171: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:07.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:06 smithi007 ceph-mon[31360]: pgmap v171: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:07.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:06 smithi102 ceph-mon[35446]: pgmap v171: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:09.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:08 smithi092 ceph-mon[34940]: pgmap v173: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:09.117 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:08 smithi102 ceph-mon[35446]: pgmap v173: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:09.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:08 smithi007 ceph-mon[31360]: pgmap v173: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:10.820 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:10 smithi102 ceph-mon[35446]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:11.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:10 smithi092 ceph-mon[34940]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:11.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:10 smithi007 ceph-mon[31360]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:13.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:12 smithi092 ceph-mon[34940]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:13.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:12 smithi007 ceph-mon[31360]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:13.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:12 smithi102 ceph-mon[35446]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:14.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:13 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T04:12:14.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:13 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:14.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:13 smithi007 ceph-mon[31360]: Deploying daemon osd.8 on smithi102 2024-09-19T04:12:14.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:13 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T04:12:14.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:13 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:14.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:13 smithi102 ceph-mon[35446]: Deploying daemon osd.8 on smithi102 2024-09-19T04:12:14.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:13 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T04:12:14.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:13 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:14.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:13 smithi092 ceph-mon[34940]: Deploying daemon osd.8 on smithi102 2024-09-19T04:12:14.810 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:14 smithi102 ceph-mon[35446]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:15.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:14 smithi007 ceph-mon[31360]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:15.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:14 smithi092 ceph-mon[34940]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:17.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:16 smithi007 ceph-mon[31360]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:17.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:16 smithi102 ceph-mon[35446]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:17.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:16 smithi092 ceph-mon[34940]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:19.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:18 smithi007 ceph-mon[31360]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:19.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:18 smithi102 ceph-mon[35446]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:19.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:18 smithi092 ceph-mon[34940]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:20.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:19 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:12:20.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:19 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:20.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:19 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:20.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:19 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:12:20.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:19 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:20.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:19 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:20.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:19 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:12:20.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:19 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:20.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:19 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:21.254 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:20 smithi102 ceph-mon[35446]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:21.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:20 smithi092 ceph-mon[34940]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:21.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:20 smithi007 ceph-mon[31360]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:22.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:22.256+0000 7f98057fa640 1 -- 172.21.15.102:0/2947095623 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f98081a06f0 con 0x7f97f40a3270 2024-09-19T04:12:22.258 INFO:teuthology.orchestra.run.smithi102.stdout:Created osd(s) 8 on host 'smithi102' 2024-09-19T04:12:22.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:22.258+0000 7f980e778640 1 -- 172.21.15.102:0/2947095623 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f97f40a3270 msgr2=0x7f97f40a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:12:22.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:22.258+0000 7f980e778640 1 --2- 172.21.15.102:0/2947095623 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f97f40a3270 0x7f97f40a5730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9808101b30 tx=0x7f97f8005c60 comp rx=0 tx=0).stop 2024-09-19T04:12:22.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:22.258+0000 7f980e778640 1 -- 172.21.15.102:0/2947095623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9808102690 msgr2=0x7f980819f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:12:22.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:22.258+0000 7f980e778640 1 --2- 172.21.15.102:0/2947095623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9808102690 0x7f980819f480 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f980000eaa0 tx=0x7f980000ef60 comp rx=0 tx=0).stop 2024-09-19T04:12:22.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:22.258+0000 7f980e778640 1 -- 172.21.15.102:0/2947095623 shutdown_connections 2024-09-19T04:12:22.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:22.258+0000 7f980e778640 1 --2- 172.21.15.102:0/2947095623 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f97f40a3270 0x7f97f40a5730 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:12:22.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:22.258+0000 7f980e778640 1 --2- 172.21.15.102:0/2947095623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9808102690 0x7f980819f480 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:12:22.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:22.258+0000 7f980e778640 1 --2- 172.21.15.102:0/2947095623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9808101cd0 0x7f9808198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:12:22.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:22.258+0000 7f980e778640 1 --2- 172.21.15.102:0/2947095623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9808100ad0 0x7f9808197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:12:22.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:22.258+0000 7f980e778640 1 -- 172.21.15.102:0/2947095623 >> 172.21.15.102:0/2947095623 conn(0x7f98080fc280 msgr2=0x7f9808069fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:12:22.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:22.258+0000 7f980e778640 1 -- 172.21.15.102:0/2947095623 shutdown_connections 2024-09-19T04:12:22.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:12:22.258+0000 7f980e778640 1 -- 172.21.15.102:0/2947095623 wait complete. 2024-09-19T04:12:22.872 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:22 smithi102 ceph-mon[35446]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:22.872 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:22 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:22.872 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:22 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:22.872 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:22 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:22.872 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:22 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:12:22.872 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:22 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:22.872 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:22 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:12:22.872 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:22 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:22.872 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:22 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:22.899 DEBUG:teuthology.orchestra.run.smithi102:osd.8> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.8.service 2024-09-19T04:12:22.901 INFO:tasks.cephadm:Deploying osd.9 on smithi007 with /dev/vg_nvme/lv_1... 2024-09-19T04:12:22.902 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T04:12:22.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:22 smithi007 ceph-mon[31360]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:22.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:22 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:22.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:22 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:22.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:22 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:22.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:22 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:12:22.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:22 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:22.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:22 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:12:22.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:22 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:22.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:22 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:23.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:22 smithi092 ceph-mon[34940]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:23.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:22 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:23.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:22 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:23.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:22 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:23.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:22 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:12:23.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:22 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:23.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:22 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:12:23.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:22 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:23.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:22 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:23.171 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:12:24.904 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:24 smithi007 ceph-mon[31360]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:24.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:24 smithi102 ceph-mon[35446]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:24.909 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:12:24 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:12:24.734+0000 7fdd5fbad640 -1 osd.8 0 log_to_monitors true 2024-09-19T04:12:25.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:24 smithi092 ceph-mon[34940]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:25.876 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:25 smithi007 ceph-mon[31360]: from='osd.8 [v2:172.21.15.102:6816/2990859925,v1:172.21.15.102:6817/2990859925]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T04:12:25.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:25 smithi007 ceph-mon[31360]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T04:12:25.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:25 smithi102 ceph-mon[35446]: from='osd.8 [v2:172.21.15.102:6816/2990859925,v1:172.21.15.102:6817/2990859925]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T04:12:25.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:25 smithi102 ceph-mon[35446]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T04:12:25.921 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:12:25.956 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi007:vg_nvme/lv_1 2024-09-19T04:12:26.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:25 smithi092 ceph-mon[34940]: from='osd.8 [v2:172.21.15.102:6816/2990859925,v1:172.21.15.102:6817/2990859925]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T04:12:26.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:25 smithi092 ceph-mon[34940]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T04:12:26.254 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:12:26.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.749+0000 7f26e5c38640 1 -- 172.21.15.7:0/2044202513 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e01037c0 msgr2=0x7f26e010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:12:26.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.749+0000 7f26e5c38640 1 --2- 172.21.15.7:0/2044202513 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e01037c0 0x7f26e010a050 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f26d8009ca0 tx=0x7f26d802a8c0 comp rx=0 tx=0).stop 2024-09-19T04:12:26.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.749+0000 7f26e5c38640 1 -- 172.21.15.7:0/2044202513 shutdown_connections 2024-09-19T04:12:26.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.749+0000 7f26e5c38640 1 --2- 172.21.15.7:0/2044202513 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e01037c0 0x7f26e010a050 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:12:26.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.749+0000 7f26e5c38640 1 --2- 172.21.15.7:0/2044202513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26e0102e00 0x7f26e0103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:12:26.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.749+0000 7f26e5c38640 1 --2- 172.21.15.7:0/2044202513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26e0101c00 0x7f26e0102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:12:26.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.749+0000 7f26e5c38640 1 -- 172.21.15.7:0/2044202513 >> 172.21.15.7:0/2044202513 conn(0x7f26e00fd390 msgr2=0x7f26e00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:12:26.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.749+0000 7f26e5c38640 1 -- 172.21.15.7:0/2044202513 shutdown_connections 2024-09-19T04:12:26.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.749+0000 7f26e5c38640 1 -- 172.21.15.7:0/2044202513 wait complete. 2024-09-19T04:12:26.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.750+0000 7f26e5c38640 1 Processor -- start 2024-09-19T04:12:26.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.750+0000 7f26e5c38640 1 -- start start 2024-09-19T04:12:26.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.750+0000 7f26e5c38640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e0101c00 0x7f26e0075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:12:26.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.750+0000 7f26e5c38640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26e0102e00 0x7f26e00745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:12:26.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.750+0000 7f26e5c38640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26e01037c0 0x7f26e0074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:12:26.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.750+0000 7f26e5c38640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f26e010d880 con 0x7f26e0101c00 2024-09-19T04:12:26.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.750+0000 7f26e5c38640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f26e010d700 con 0x7f26e0102e00 2024-09-19T04:12:26.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.750+0000 7f26e5c38640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f26e010da00 con 0x7f26e01037c0 2024-09-19T04:12:26.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.750+0000 7f26df7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e0101c00 0x7f26e0075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:12:26.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.750+0000 7f26df7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e0101c00 0x7f26e0075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46056/0 (socket says 172.21.15.7:46056) 2024-09-19T04:12:26.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.750+0000 7f26df7fe640 1 -- 172.21.15.7:0/2433489319 learned_addr learned my addr 172.21.15.7:0/2433489319 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:12:26.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.750+0000 7f26dffff640 1 --2- 172.21.15.7:0/2433489319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26e01037c0 0x7f26e0074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:12:26.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.750+0000 7f26deffd640 1 --2- 172.21.15.7:0/2433489319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26e0102e00 0x7f26e00745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:12:26.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.751+0000 7f26df7fe640 1 -- 172.21.15.7:0/2433489319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26e01037c0 msgr2=0x7f26e0074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:12:26.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.751+0000 7f26df7fe640 1 --2- 172.21.15.7:0/2433489319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26e01037c0 0x7f26e0074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:12:26.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.751+0000 7f26df7fe640 1 -- 172.21.15.7:0/2433489319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26e0102e00 msgr2=0x7f26e00745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:12:26.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.751+0000 7f26df7fe640 1 --2- 172.21.15.7:0/2433489319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26e0102e00 0x7f26e00745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:12:26.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.751+0000 7f26df7fe640 1 -- 172.21.15.7:0/2433489319 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e00753e0 con 0x7f26e0101c00 2024-09-19T04:12:26.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.751+0000 7f26df7fe640 1 --2- 172.21.15.7:0/2433489319 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e0101c00 0x7f26e0075f90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f26d000c970 tx=0x7f26d000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:12:26.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.751+0000 7f26dcff9640 1 -- 172.21.15.7:0/2433489319 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d0007c10 con 0x7f26e0101c00 2024-09-19T04:12:26.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.751+0000 7f26dcff9640 1 -- 172.21.15.7:0/2433489319 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26d0007db0 con 0x7f26e0101c00 2024-09-19T04:12:26.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.751+0000 7f26e5c38640 1 -- 172.21.15.7:0/2433489319 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26e01a1f80 con 0x7f26e0101c00 2024-09-19T04:12:26.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.751+0000 7f26dcff9640 1 -- 172.21.15.7:0/2433489319 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d000f8a0 con 0x7f26e0101c00 2024-09-19T04:12:26.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.751+0000 7f26e5c38640 1 -- 172.21.15.7:0/2433489319 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26e01a2370 con 0x7f26e0101c00 2024-09-19T04:12:26.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.752+0000 7f26e5c38640 1 -- 172.21.15.7:0/2433489319 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26e0108f30 con 0x7f26e0101c00 2024-09-19T04:12:26.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.753+0000 7f26dcff9640 1 -- 172.21.15.7:0/2433489319 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f26d000fa80 con 0x7f26e0101c00 2024-09-19T04:12:26.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.754+0000 7f26dcff9640 1 --2- 172.21.15.7:0/2433489319 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f26cc0a3240 0x7f26cc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:12:26.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.754+0000 7f26deffd640 1 --2- 172.21.15.7:0/2433489319 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f26cc0a3240 0x7f26cc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:12:26.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.754+0000 7f26dcff9640 1 -- 172.21.15.7:0/2433489319 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5549+0+0 (secure 0 0 0) 0x7f26d00cf180 con 0x7f26e0101c00 2024-09-19T04:12:26.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.755+0000 7f26deffd640 1 --2- 172.21.15.7:0/2433489319 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f26cc0a3240 0x7f26cc0a5700 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f26e0075d10 tx=0x7f26c800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:12:26.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.758+0000 7f26dcff9640 1 -- 172.21.15.7:0/2433489319 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f26d009c960 con 0x7f26e0101c00 2024-09-19T04:12:26.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:26.942+0000 7f26e5c38640 1 -- 172.21.15.7:0/2433489319 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f26e0062630 con 0x7f26cc0a3240 2024-09-19T04:12:26.944 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:26 smithi007 ceph-mon[31360]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:26.944 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:26 smithi007 ceph-mon[31360]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T04:12:26.944 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:26 smithi007 ceph-mon[31360]: from='osd.8 [v2:172.21.15.102:6816/2990859925,v1:172.21.15.102:6817/2990859925]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T04:12:26.944 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:26 smithi007 ceph-mon[31360]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T04:12:26.944 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:26 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:12:26.944 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:26 smithi007 ceph-mon[31360]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T04:12:26.944 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:26 smithi007 ceph-mon[31360]: Detected new or changed devices on smithi102 2024-09-19T04:12:26.944 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:26 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:26.944 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:26 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:26.944 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:26 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:26.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:26 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:26.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:26 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:26.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:26 smithi007 ceph-mon[31360]: Adjusting osd_memory_target on smithi102 to 5696M 2024-09-19T04:12:26.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:26 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:26.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:26 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:26.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:26 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:12:26.945 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:26 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:27.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:26 smithi092 ceph-mon[34940]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:27.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:26 smithi092 ceph-mon[34940]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T04:12:27.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:26 smithi092 ceph-mon[34940]: from='osd.8 [v2:172.21.15.102:6816/2990859925,v1:172.21.15.102:6817/2990859925]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T04:12:27.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:26 smithi092 ceph-mon[34940]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T04:12:27.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:26 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:12:27.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:26 smithi092 ceph-mon[34940]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T04:12:27.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:26 smithi092 ceph-mon[34940]: Detected new or changed devices on smithi102 2024-09-19T04:12:27.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:26 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:27.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:26 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:27.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:26 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:27.049 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:26 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:27.049 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:26 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:27.049 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:26 smithi092 ceph-mon[34940]: Adjusting osd_memory_target on smithi102 to 5696M 2024-09-19T04:12:27.049 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:26 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:27.049 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:26 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:27.049 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:26 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:12:27.049 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:26 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:27.065 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:26 smithi102 ceph-mon[35446]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:27.065 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:26 smithi102 ceph-mon[35446]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T04:12:27.065 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:26 smithi102 ceph-mon[35446]: from='osd.8 [v2:172.21.15.102:6816/2990859925,v1:172.21.15.102:6817/2990859925]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T04:12:27.065 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:26 smithi102 ceph-mon[35446]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T04:12:27.065 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:26 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:12:27.065 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:26 smithi102 ceph-mon[35446]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T04:12:27.065 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:26 smithi102 ceph-mon[35446]: Detected new or changed devices on smithi102 2024-09-19T04:12:27.065 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:26 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:27.065 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:26 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:27.065 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:26 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:27.065 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:26 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:27.066 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:26 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:27.066 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:26 smithi102 ceph-mon[35446]: Adjusting osd_memory_target on smithi102 to 5696M 2024-09-19T04:12:27.066 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:26 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:27.066 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:26 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:27.066 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:26 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:12:27.066 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:26 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:27.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:12:27 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:12:27.063+0000 7fdd5c344640 -1 osd.8 0 waiting for initial osdmap 2024-09-19T04:12:27.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:12:27 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:12:27.071+0000 7fdd53950640 -1 osd.8 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:12:27.948 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:27 smithi092 ceph-mon[34940]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-19T04:12:27.948 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:27 smithi092 ceph-mon[34940]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T04:12:27.948 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:27 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:12:27.948 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:27 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:12:27.948 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:27 smithi092 ceph-mon[34940]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:12:27.949 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:27 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:12:27.949 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:27 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:12:27.949 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:27 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:27.949 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:27 smithi092 ceph-mon[34940]: from='osd.8 ' entity='osd.8' 2024-09-19T04:12:27.996 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:27 smithi007 ceph-mon[31360]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-19T04:12:27.996 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:27 smithi007 ceph-mon[31360]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T04:12:27.996 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:27 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:12:27.996 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:27 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:12:27.996 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:27 smithi007 ceph-mon[31360]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:12:27.996 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:27 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:12:27.996 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:27 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:12:27.997 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:27 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:27.997 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:27 smithi007 ceph-mon[31360]: from='osd.8 ' entity='osd.8' 2024-09-19T04:12:28.081 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:27 smithi102 ceph-mon[35446]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-19T04:12:28.081 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:27 smithi102 ceph-mon[35446]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T04:12:28.081 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:27 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:12:28.081 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:27 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:12:28.081 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:27 smithi102 ceph-mon[35446]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:12:28.081 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:27 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:12:28.081 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:27 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:12:28.081 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:27 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:28.081 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:27 smithi102 ceph-mon[35446]: from='osd.8 ' entity='osd.8' 2024-09-19T04:12:29.029 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:28 smithi102 ceph-mon[35446]: purged_snaps scrub starts 2024-09-19T04:12:29.029 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:28 smithi102 ceph-mon[35446]: purged_snaps scrub ok 2024-09-19T04:12:29.030 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:28 smithi102 ceph-mon[35446]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:29.030 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:28 smithi102 ceph-mon[35446]: osd.8 [v2:172.21.15.102:6816/2990859925,v1:172.21.15.102:6817/2990859925] boot 2024-09-19T04:12:29.030 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:28 smithi102 ceph-mon[35446]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T04:12:29.030 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:28 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:12:29.030 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:28 smithi102 ceph-mon[35446]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T04:12:29.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:28 smithi092 ceph-mon[34940]: purged_snaps scrub starts 2024-09-19T04:12:29.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:28 smithi092 ceph-mon[34940]: purged_snaps scrub ok 2024-09-19T04:12:29.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:28 smithi092 ceph-mon[34940]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:29.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:28 smithi092 ceph-mon[34940]: osd.8 [v2:172.21.15.102:6816/2990859925,v1:172.21.15.102:6817/2990859925] boot 2024-09-19T04:12:29.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:28 smithi092 ceph-mon[34940]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T04:12:29.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:12:29.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:28 smithi092 ceph-mon[34940]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T04:12:29.078 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:28 smithi007 ceph-mon[31360]: purged_snaps scrub starts 2024-09-19T04:12:29.078 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:28 smithi007 ceph-mon[31360]: purged_snaps scrub ok 2024-09-19T04:12:29.078 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:28 smithi007 ceph-mon[31360]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:12:29.078 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:28 smithi007 ceph-mon[31360]: osd.8 [v2:172.21.15.102:6816/2990859925,v1:172.21.15.102:6817/2990859925] boot 2024-09-19T04:12:29.078 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:28 smithi007 ceph-mon[31360]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T04:12:29.078 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:28 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:12:29.078 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:28 smithi007 ceph-mon[31360]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T04:12:30.010 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:29 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3939594398' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6d65db33-926c-4a6e-a072-707e9c9de92a"}]: dispatch 2024-09-19T04:12:30.010 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:29 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3939594398' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d65db33-926c-4a6e-a072-707e9c9de92a"}]': finished 2024-09-19T04:12:30.010 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:29 smithi007 ceph-mon[31360]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T04:12:30.010 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:29 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:12:30.046 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:29 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3939594398' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6d65db33-926c-4a6e-a072-707e9c9de92a"}]: dispatch 2024-09-19T04:12:30.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:29 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3939594398' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d65db33-926c-4a6e-a072-707e9c9de92a"}]': finished 2024-09-19T04:12:30.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:29 smithi092 ceph-mon[34940]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T04:12:30.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:29 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:12:30.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:29 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3939594398' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6d65db33-926c-4a6e-a072-707e9c9de92a"}]: dispatch 2024-09-19T04:12:30.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:29 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3939594398' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d65db33-926c-4a6e-a072-707e9c9de92a"}]': finished 2024-09-19T04:12:30.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:29 smithi102 ceph-mon[35446]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T04:12:30.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:29 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:12:31.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:30 smithi092 ceph-mon[34940]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:12:31.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:30 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1131448426' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:12:31.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:30 smithi092 ceph-mon[34940]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T04:12:31.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:30 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:12:31.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:30 smithi007 ceph-mon[31360]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:12:31.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:30 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1131448426' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:12:31.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:30 smithi007 ceph-mon[31360]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T04:12:31.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:30 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:12:31.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:30 smithi102 ceph-mon[35446]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:12:31.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:30 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1131448426' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:12:31.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:30 smithi102 ceph-mon[35446]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T04:12:31.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:30 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:12:32.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:32 smithi092 ceph-mon[34940]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:12:32.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:32 smithi092 ceph-mon[34940]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T04:12:32.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:32 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:12:32.876 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:32 smithi007 ceph-mon[31360]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:12:32.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:32 smithi007 ceph-mon[31360]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T04:12:32.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:32 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:12:32.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:32 smithi102 ceph-mon[35446]: pgmap v191: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:12:32.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:32 smithi102 ceph-mon[35446]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T04:12:32.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:32 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:12:34.594 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:34 smithi007 ceph-mon[31360]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:12:34.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:34 smithi092 ceph-mon[34940]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:12:34.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:34 smithi102 ceph-mon[35446]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:12:36.684 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:36 smithi007 ceph-mon[31360]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T04:12:36.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:36 smithi092 ceph-mon[34940]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T04:12:36.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:36 smithi102 ceph-mon[35446]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T04:12:38.683 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:38 smithi092 ceph-mon[34940]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-19T04:12:38.683 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:38 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T04:12:38.683 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:38 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:38.777 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:38 smithi007 ceph-mon[31360]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-19T04:12:38.777 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:38 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T04:12:38.777 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:38 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:38.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:38 smithi102 ceph-mon[35446]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-19T04:12:38.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:38 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T04:12:38.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:38 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:39.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:39 smithi092 ceph-mon[34940]: Deploying daemon osd.9 on smithi007 2024-09-19T04:12:39.624 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:39 smithi007 ceph-mon[31360]: Deploying daemon osd.9 on smithi007 2024-09-19T04:12:39.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:39 smithi102 ceph-mon[35446]: Deploying daemon osd.9 on smithi007 2024-09-19T04:12:40.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:40 smithi007 ceph-mon[31360]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T04:12:40.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:40 smithi092 ceph-mon[34940]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T04:12:40.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:40 smithi102 ceph-mon[35446]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T04:12:42.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:42 smithi092 ceph-mon[34940]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T04:12:42.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:42 smithi007 ceph-mon[31360]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T04:12:42.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:42 smithi102 ceph-mon[35446]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T04:12:44.698 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:44 smithi007 ceph-mon[31360]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T04:12:44.698 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:44 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:12:44.698 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:44 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:44.698 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:44 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:44.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:44 smithi092 ceph-mon[34940]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T04:12:44.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:44 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:12:44.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:44 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:44.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:44 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:44.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:44 smithi102 ceph-mon[35446]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T04:12:44.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:44 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:12:44.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:44 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:44.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:44 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:46.578 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:46 smithi007 ceph-mon[31360]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:12:46.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:46 smithi092 ceph-mon[34940]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:12:46.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:46 smithi102 ceph-mon[35446]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:12:47.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:47.734+0000 7f26dcff9640 1 -- 172.21.15.7:0/2433489319 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f26e0062630 con 0x7f26cc0a3240 2024-09-19T04:12:47.736 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 9 on host 'smithi007' 2024-09-19T04:12:47.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:47.736+0000 7f26e5c38640 1 -- 172.21.15.7:0/2433489319 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f26cc0a3240 msgr2=0x7f26cc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:12:47.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:47.736+0000 7f26e5c38640 1 --2- 172.21.15.7:0/2433489319 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f26cc0a3240 0x7f26cc0a5700 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f26e0075d10 tx=0x7f26c800b390 comp rx=0 tx=0).stop 2024-09-19T04:12:47.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:47.736+0000 7f26e5c38640 1 -- 172.21.15.7:0/2433489319 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e0101c00 msgr2=0x7f26e0075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:12:47.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:47.736+0000 7f26e5c38640 1 --2- 172.21.15.7:0/2433489319 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e0101c00 0x7f26e0075f90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f26d000c970 tx=0x7f26d000ce30 comp rx=0 tx=0).stop 2024-09-19T04:12:47.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:47.737+0000 7f26e5c38640 1 -- 172.21.15.7:0/2433489319 shutdown_connections 2024-09-19T04:12:47.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:47.737+0000 7f26e5c38640 1 --2- 172.21.15.7:0/2433489319 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f26cc0a3240 0x7f26cc0a5700 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:12:47.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:47.737+0000 7f26e5c38640 1 --2- 172.21.15.7:0/2433489319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26e01037c0 0x7f26e0074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:12:47.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:47.737+0000 7f26e5c38640 1 --2- 172.21.15.7:0/2433489319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26e0102e00 0x7f26e00745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:12:47.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:47.737+0000 7f26e5c38640 1 --2- 172.21.15.7:0/2433489319 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e0101c00 0x7f26e0075f90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:12:47.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:47.737+0000 7f26e5c38640 1 -- 172.21.15.7:0/2433489319 >> 172.21.15.7:0/2433489319 conn(0x7f26e00fd390 msgr2=0x7f26e0106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:12:47.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:47.737+0000 7f26e5c38640 1 -- 172.21.15.7:0/2433489319 shutdown_connections 2024-09-19T04:12:47.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:12:47.737+0000 7f26e5c38640 1 -- 172.21.15.7:0/2433489319 wait complete. 2024-09-19T04:12:48.438 DEBUG:teuthology.orchestra.run.smithi007:osd.9> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.9.service 2024-09-19T04:12:48.440 INFO:tasks.cephadm:Deploying osd.10 on smithi092 with /dev/vg_nvme/lv_1... 2024-09-19T04:12:48.440 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T04:12:48.694 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:12:49.045 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:48 smithi092 ceph-mon[34940]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:12:49.045 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:48 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:49.046 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:48 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:49.046 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:48 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:49.046 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:48 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:49.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:48 smithi007 ceph-mon[31360]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:12:49.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:48 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:49.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:48 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:49.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:48 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:49.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:48 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:49.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:48 smithi102 ceph-mon[35446]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:12:49.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:48 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:49.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:48 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:49.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:48 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:49.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:48 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:50.627 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:12:50 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:12:50.352+0000 7f2ddb51b640 -1 osd.9 0 log_to_monitors true 2024-09-19T04:12:50.919 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:50 smithi007 ceph-mon[31360]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:12:50.920 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:50 smithi007 ceph-mon[31360]: from='osd.9 [v2:172.21.15.7:6826/1710319475,v1:172.21.15.7:6827/1710319475]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T04:12:51.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:50 smithi092 ceph-mon[34940]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:12:51.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:50 smithi092 ceph-mon[34940]: from='osd.9 [v2:172.21.15.7:6826/1710319475,v1:172.21.15.7:6827/1710319475]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T04:12:51.088 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-09-19T04:12:51.113 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi092:vg_nvme/lv_1 2024-09-19T04:12:51.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:50 smithi102 ceph-mon[35446]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:12:51.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:50 smithi102 ceph-mon[35446]: from='osd.9 [v2:172.21.15.7:6826/1710319475,v1:172.21.15.7:6827/1710319475]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T04:12:51.366 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:12:51.757 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:12:51 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:12:51.739+0000 7f2dd749e640 -1 osd.9 0 waiting for initial osdmap 2024-09-19T04:12:51.757 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:51 smithi007 ceph-mon[31360]: from='osd.9 [v2:172.21.15.7:6826/1710319475,v1:172.21.15.7:6827/1710319475]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T04:12:51.757 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:51 smithi007 ceph-mon[31360]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T04:12:51.757 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:51 smithi007 ceph-mon[31360]: from='osd.9 [v2:172.21.15.7:6826/1710319475,v1:172.21.15.7:6827/1710319475]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-19T04:12:51.757 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:51 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:12:51.758 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:51 smithi007 ceph-mon[31360]: from='osd.9 [v2:172.21.15.7:6826/1710319475,v1:172.21.15.7:6827/1710319475]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-19T04:12:51.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.837+0000 7f6d3d0eb640 1 -- 172.21.15.92:0/1975337520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d381078c0 msgr2=0x7f6d38109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:12:51.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.837+0000 7f6d3d0eb640 1 --2- 172.21.15.92:0/1975337520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d381078c0 0x7f6d38109d10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6d30009ca0 tx=0x7f6d3002a8c0 comp rx=0 tx=0).stop 2024-09-19T04:12:51.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.837+0000 7f6d3d0eb640 1 -- 172.21.15.92:0/1975337520 shutdown_connections 2024-09-19T04:12:51.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.837+0000 7f6d3d0eb640 1 --2- 172.21.15.92:0/1975337520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d381078c0 0x7f6d38109d10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:12:51.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.837+0000 7f6d3d0eb640 1 --2- 172.21.15.92:0/1975337520 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d38104f90 0x7f6d38107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:12:51.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.837+0000 7f6d3d0eb640 1 --2- 172.21.15.92:0/1975337520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d38102660 0x7f6d38104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:12:51.855 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.837+0000 7f6d3d0eb640 1 -- 172.21.15.92:0/1975337520 >> 172.21.15.92:0/1975337520 conn(0x7f6d380fc280 msgr2=0x7f6d380fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:12:51.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.837+0000 7f6d3d0eb640 1 -- 172.21.15.92:0/1975337520 shutdown_connections 2024-09-19T04:12:51.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.837+0000 7f6d3d0eb640 1 -- 172.21.15.92:0/1975337520 wait complete. 2024-09-19T04:12:51.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.838+0000 7f6d3d0eb640 1 Processor -- start 2024-09-19T04:12:51.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.838+0000 7f6d3d0eb640 1 -- start start 2024-09-19T04:12:51.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.838+0000 7f6d3d0eb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d38102660 0x7f6d3819a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:12:51.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.838+0000 7f6d3d0eb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d38104f90 0x7f6d3819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:12:51.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.838+0000 7f6d3d0eb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d381078c0 0x7f6d381a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:12:51.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.838+0000 7f6d3d0eb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3810d880 con 0x7f6d38102660 2024-09-19T04:12:51.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.838+0000 7f6d3d0eb640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3810d700 con 0x7f6d381078c0 2024-09-19T04:12:51.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.838+0000 7f6d3d0eb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3810da00 con 0x7f6d38104f90 2024-09-19T04:12:51.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.838+0000 7f6d3759e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d381078c0 0x7f6d381a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:12:51.856 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.838+0000 7f6d3759e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d381078c0 0x7f6d381a16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46766/0 (socket says 172.21.15.92:46766) 2024-09-19T04:12:51.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.838+0000 7f6d36d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d38102660 0x7f6d3819a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:12:51.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.838+0000 7f6d3759e640 1 -- 172.21.15.92:0/1428212736 learned_addr learned my addr 172.21.15.92:0/1428212736 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-09-19T04:12:51.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.838+0000 7f6d3659c640 1 --2- 172.21.15.92:0/1428212736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d38104f90 0x7f6d3819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:12:51.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.839+0000 7f6d3759e640 1 -- 172.21.15.92:0/1428212736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d38104f90 msgr2=0x7f6d3819a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:12:51.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.839+0000 7f6d3759e640 1 --2- 172.21.15.92:0/1428212736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d38104f90 0x7f6d3819a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:12:51.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.839+0000 7f6d3759e640 1 -- 172.21.15.92:0/1428212736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d38102660 msgr2=0x7f6d3819a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:12:51.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.839+0000 7f6d3759e640 1 --2- 172.21.15.92:0/1428212736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d38102660 0x7f6d3819a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:12:51.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.839+0000 7f6d3759e640 1 -- 172.21.15.92:0/1428212736 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d381a1d40 con 0x7f6d381078c0 2024-09-19T04:12:51.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.839+0000 7f6d36d9d640 1 --2- 172.21.15.92:0/1428212736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d38102660 0x7f6d3819a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:12:51.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.839+0000 7f6d3759e640 1 --2- 172.21.15.92:0/1428212736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d381078c0 0x7f6d381a16d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6d30005e30 tx=0x7f6d30031ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:12:51.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.839+0000 7f6d1ffff640 1 -- 172.21.15.92:0/1428212736 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d30003c30 con 0x7f6d381078c0 2024-09-19T04:12:51.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.839+0000 7f6d1ffff640 1 -- 172.21.15.92:0/1428212736 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d30003dd0 con 0x7f6d381078c0 2024-09-19T04:12:51.857 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.839+0000 7f6d3d0eb640 1 -- 172.21.15.92:0/1428212736 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d381a1fd0 con 0x7f6d381078c0 2024-09-19T04:12:51.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.839+0000 7f6d1ffff640 1 -- 172.21.15.92:0/1428212736 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3002fde0 con 0x7f6d381078c0 2024-09-19T04:12:51.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.839+0000 7f6d3d0eb640 1 -- 172.21.15.92:0/1428212736 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d381a2480 con 0x7f6d381078c0 2024-09-19T04:12:51.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.840+0000 7f6d3d0eb640 1 -- 172.21.15.92:0/1428212736 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d381093b0 con 0x7f6d381078c0 2024-09-19T04:12:51.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.841+0000 7f6d1ffff640 1 -- 172.21.15.92:0/1428212736 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f6d30004050 con 0x7f6d381078c0 2024-09-19T04:12:51.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.842+0000 7f6d1ffff640 1 --2- 172.21.15.92:0/1428212736 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6d200a3270 0x7f6d200a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:12:51.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.842+0000 7f6d1ffff640 1 -- 172.21.15.92:0/1428212736 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5981+0+0 (secure 0 0 0) 0x7f6d300f0170 con 0x7f6d381078c0 2024-09-19T04:12:51.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.842+0000 7f6d36d9d640 1 --2- 172.21.15.92:0/1428212736 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6d200a3270 0x7f6d200a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:12:51.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.843+0000 7f6d36d9d640 1 --2- 172.21.15.92:0/1428212736 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6d200a3270 0x7f6d200a5730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6d28005d00 tx=0x7f6d2800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:12:51.858 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:51.846+0000 7f6d1ffff640 1 -- 172.21.15.92:0/1428212736 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6d300bd7b0 con 0x7f6d381078c0 2024-09-19T04:12:52.028 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:12:51 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:12:51.752+0000 7f2dd32c6640 -1 osd.9 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:12:52.046 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:12:52.044+0000 7f6d3d0eb640 1 -- 172.21.15.92:0/1428212736 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f6d38062630 con 0x7f6d200a3270 2024-09-19T04:12:52.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:51 smithi092 ceph-mon[34940]: from='osd.9 [v2:172.21.15.7:6826/1710319475,v1:172.21.15.7:6827/1710319475]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T04:12:52.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:51 smithi092 ceph-mon[34940]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T04:12:52.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:51 smithi092 ceph-mon[34940]: from='osd.9 [v2:172.21.15.7:6826/1710319475,v1:172.21.15.7:6827/1710319475]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-19T04:12:52.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:51 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:12:52.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:51 smithi092 ceph-mon[34940]: from='osd.9 [v2:172.21.15.7:6826/1710319475,v1:172.21.15.7:6827/1710319475]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-19T04:12:52.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:51 smithi102 ceph-mon[35446]: from='osd.9 [v2:172.21.15.7:6826/1710319475,v1:172.21.15.7:6827/1710319475]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T04:12:52.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:51 smithi102 ceph-mon[35446]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T04:12:52.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:51 smithi102 ceph-mon[35446]: from='osd.9 [v2:172.21.15.7:6826/1710319475,v1:172.21.15.7:6827/1710319475]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]: dispatch 2024-09-19T04:12:52.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:51 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:12:52.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:51 smithi102 ceph-mon[35446]: from='osd.9 [v2:172.21.15.7:6826/1710319475,v1:172.21.15.7:6827/1710319475]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-19T04:12:53.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:52 smithi092 ceph-mon[34940]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:12:53.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:52 smithi092 ceph-mon[34940]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T04:12:53.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:52 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:12:53.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:52 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:12:53.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:52 smithi092 ceph-mon[34940]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:12:53.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:52 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:12:53.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:52 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:12:53.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:52 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:53.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:52 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:53.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:52 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:53.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:52 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:53.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:52 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:53.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:52 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:53.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:52 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:53.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:52 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:53.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:52 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:53.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:52 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:12:53.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:52 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:53.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:52 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:12:53.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:52 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:53.049 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:52 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:12:53.049 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:52 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:53.049 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:52 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:12:53.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:52 smithi007 ceph-mon[31360]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:12:53.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:52 smithi007 ceph-mon[31360]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T04:12:53.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:52 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:12:53.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:52 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:12:53.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:52 smithi007 ceph-mon[31360]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:12:53.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:52 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:12:53.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:52 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:12:53.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:52 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:53.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:52 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:53.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:52 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:53.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:52 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:53.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:52 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:53.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:52 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:53.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:52 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:53.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:52 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:53.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:52 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:53.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:52 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:12:53.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:52 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:53.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:52 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:12:53.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:52 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:53.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:52 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:12:53.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:52 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:53.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:52 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:12:53.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:52 smithi102 ceph-mon[35446]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:12:53.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:52 smithi102 ceph-mon[35446]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T04:12:53.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:52 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:12:53.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:52 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:12:53.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:52 smithi102 ceph-mon[35446]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:12:53.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:52 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:12:53.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:52 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:12:53.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:52 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:53.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:52 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:53.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:52 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:53.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:52 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:53.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:52 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:53.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:52 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:53.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:52 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:12:53.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:52 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:53.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:52 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:53.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:52 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:12:53.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:52 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:53.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:52 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:12:53.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:52 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:12:53.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:52 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:12:53.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:52 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:12:53.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:52 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:12:54.023 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:53 smithi092 ceph-mon[34940]: purged_snaps scrub starts 2024-09-19T04:12:54.023 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:53 smithi092 ceph-mon[34940]: purged_snaps scrub ok 2024-09-19T04:12:54.023 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:53 smithi092 ceph-mon[34940]: Detected new or changed devices on smithi007 2024-09-19T04:12:54.023 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:53 smithi092 ceph-mon[34940]: Adjusting osd_memory_target on smithi007 to 4273M 2024-09-19T04:12:54.023 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:53 smithi092 ceph-mon[34940]: osd.9 [v2:172.21.15.7:6826/1710319475,v1:172.21.15.7:6827/1710319475] boot 2024-09-19T04:12:54.023 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:53 smithi092 ceph-mon[34940]: osdmap e62: 10 total, 10 up, 10 in 2024-09-19T04:12:54.023 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:53 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:12:54.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:53 smithi007 ceph-mon[31360]: purged_snaps scrub starts 2024-09-19T04:12:54.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:53 smithi007 ceph-mon[31360]: purged_snaps scrub ok 2024-09-19T04:12:54.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:53 smithi007 ceph-mon[31360]: Detected new or changed devices on smithi007 2024-09-19T04:12:54.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:53 smithi007 ceph-mon[31360]: Adjusting osd_memory_target on smithi007 to 4273M 2024-09-19T04:12:54.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:53 smithi007 ceph-mon[31360]: osd.9 [v2:172.21.15.7:6826/1710319475,v1:172.21.15.7:6827/1710319475] boot 2024-09-19T04:12:54.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:53 smithi007 ceph-mon[31360]: osdmap e62: 10 total, 10 up, 10 in 2024-09-19T04:12:54.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:53 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:12:54.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:53 smithi102 ceph-mon[35446]: purged_snaps scrub starts 2024-09-19T04:12:54.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:53 smithi102 ceph-mon[35446]: purged_snaps scrub ok 2024-09-19T04:12:54.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:53 smithi102 ceph-mon[35446]: Detected new or changed devices on smithi007 2024-09-19T04:12:54.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:53 smithi102 ceph-mon[35446]: Adjusting osd_memory_target on smithi007 to 4273M 2024-09-19T04:12:54.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:53 smithi102 ceph-mon[35446]: osd.9 [v2:172.21.15.7:6826/1710319475,v1:172.21.15.7:6827/1710319475] boot 2024-09-19T04:12:54.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:53 smithi102 ceph-mon[35446]: osdmap e62: 10 total, 10 up, 10 in 2024-09-19T04:12:54.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:53 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:12:54.925 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:54 smithi092 ceph-mon[34940]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:12:54.925 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:54 smithi092 ceph-mon[34940]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T04:12:54.925 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:54 smithi092 ceph-mon[34940]: from='client.? 172.21.15.92:0/2094894054' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ab681ee-0bef-47bd-bf3d-20b17c6b870c"}]: dispatch 2024-09-19T04:12:54.925 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:54 smithi092 ceph-mon[34940]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ab681ee-0bef-47bd-bf3d-20b17c6b870c"}]: dispatch 2024-09-19T04:12:54.925 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:54 smithi092 ceph-mon[34940]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ab681ee-0bef-47bd-bf3d-20b17c6b870c"}]': finished 2024-09-19T04:12:54.925 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:54 smithi092 ceph-mon[34940]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T04:12:54.925 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:54 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:12:55.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:54 smithi007 ceph-mon[31360]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:12:55.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:54 smithi007 ceph-mon[31360]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T04:12:55.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:54 smithi007 ceph-mon[31360]: from='client.? 172.21.15.92:0/2094894054' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ab681ee-0bef-47bd-bf3d-20b17c6b870c"}]: dispatch 2024-09-19T04:12:55.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:54 smithi007 ceph-mon[31360]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ab681ee-0bef-47bd-bf3d-20b17c6b870c"}]: dispatch 2024-09-19T04:12:55.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:54 smithi007 ceph-mon[31360]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ab681ee-0bef-47bd-bf3d-20b17c6b870c"}]': finished 2024-09-19T04:12:55.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:54 smithi007 ceph-mon[31360]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T04:12:55.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:54 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:12:55.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:54 smithi102 ceph-mon[35446]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:12:55.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:54 smithi102 ceph-mon[35446]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T04:12:55.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:54 smithi102 ceph-mon[35446]: from='client.? 172.21.15.92:0/2094894054' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ab681ee-0bef-47bd-bf3d-20b17c6b870c"}]: dispatch 2024-09-19T04:12:55.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:54 smithi102 ceph-mon[35446]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ab681ee-0bef-47bd-bf3d-20b17c6b870c"}]: dispatch 2024-09-19T04:12:55.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:54 smithi102 ceph-mon[35446]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ab681ee-0bef-47bd-bf3d-20b17c6b870c"}]': finished 2024-09-19T04:12:55.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:54 smithi102 ceph-mon[35446]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T04:12:55.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:54 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:12:56.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:55 smithi092 ceph-mon[34940]: from='client.? 172.21.15.92:0/1104433855' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:12:56.060 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:55 smithi102 ceph-mon[35446]: from='client.? 172.21.15.92:0/1104433855' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:12:56.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:55 smithi007 ceph-mon[31360]: from='client.? 172.21.15.92:0/1104433855' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:12:57.046 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:56 smithi092 ceph-mon[34940]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:12:57.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:56 smithi007 ceph-mon[31360]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:12:57.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:56 smithi102 ceph-mon[35446]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:12:59.046 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:12:58 smithi092 ceph-mon[34940]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:12:59.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:12:58 smithi007 ceph-mon[31360]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:12:59.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:12:58 smithi102 ceph-mon[35446]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:00.929 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:00 smithi092 ceph-mon[34940]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:01.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:00 smithi007 ceph-mon[31360]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:01.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:00 smithi102 ceph-mon[35446]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:02.874 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:02 smithi092 ceph-mon[34940]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:02.874 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:02 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T04:13:02.874 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:02 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:03.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:02 smithi007 ceph-mon[31360]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:03.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:02 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T04:13:03.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:02 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:03.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:02 smithi102 ceph-mon[35446]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:03.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:02 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T04:13:03.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:02 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:04.046 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:03 smithi092 ceph-mon[34940]: Deploying daemon osd.10 on smithi092 2024-09-19T04:13:04.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:03 smithi007 ceph-mon[31360]: Deploying daemon osd.10 on smithi092 2024-09-19T04:13:04.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:03 smithi102 ceph-mon[35446]: Deploying daemon osd.10 on smithi092 2024-09-19T04:13:05.046 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:04 smithi092 ceph-mon[34940]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:05.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:04 smithi007 ceph-mon[31360]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:05.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:04 smithi102 ceph-mon[35446]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:07.004 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:06 smithi092 ceph-mon[34940]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:07.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:06 smithi007 ceph-mon[31360]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:07.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:06 smithi102 ceph-mon[35446]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:09.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:08 smithi092 ceph-mon[34940]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:09.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:08 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:13:09.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:08 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:09.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:08 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:09.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:08 smithi007 ceph-mon[31360]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:09.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:08 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:13:09.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:08 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:09.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:08 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:09.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:08 smithi102 ceph-mon[35446]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:09.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:08 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:13:09.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:08 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:09.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:08 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:11.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:10 smithi092 ceph-mon[34940]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:11.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:10 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:11.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:10 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:11.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:10 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:11.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:10 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:13:11.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:10 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:11.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:10 smithi007 ceph-mon[31360]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:11.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:10 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:11.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:10 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:11.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:10 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:11.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:10 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:13:11.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:10 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:11.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:10 smithi102 ceph-mon[35446]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:11.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:10 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:11.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:10 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:11.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:10 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:11.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:10 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:13:11.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:10 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:11.510 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:13:11.508+0000 7f6d1ffff640 1 -- 172.21.15.92:0/1428212736 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f6d38062630 con 0x7f6d200a3270 2024-09-19T04:13:11.510 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 10 on host 'smithi092' 2024-09-19T04:13:11.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:13:11.511+0000 7f6d3d0eb640 1 -- 172.21.15.92:0/1428212736 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6d200a3270 msgr2=0x7f6d200a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:11.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:13:11.511+0000 7f6d3d0eb640 1 --2- 172.21.15.92:0/1428212736 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6d200a3270 0x7f6d200a5730 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6d28005d00 tx=0x7f6d2800b410 comp rx=0 tx=0).stop 2024-09-19T04:13:11.512 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:13:11.511+0000 7f6d3d0eb640 1 -- 172.21.15.92:0/1428212736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d381078c0 msgr2=0x7f6d381a16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:11.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:13:11.511+0000 7f6d3d0eb640 1 --2- 172.21.15.92:0/1428212736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d381078c0 0x7f6d381a16d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6d30005e30 tx=0x7f6d30031ee0 comp rx=0 tx=0).stop 2024-09-19T04:13:11.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:13:11.511+0000 7f6d3d0eb640 1 -- 172.21.15.92:0/1428212736 shutdown_connections 2024-09-19T04:13:11.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:13:11.511+0000 7f6d3d0eb640 1 --2- 172.21.15.92:0/1428212736 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6d200a3270 0x7f6d200a5730 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:11.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:13:11.511+0000 7f6d3d0eb640 1 --2- 172.21.15.92:0/1428212736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d381078c0 0x7f6d381a16d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:11.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:13:11.511+0000 7f6d3d0eb640 1 --2- 172.21.15.92:0/1428212736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d38104f90 0x7f6d3819a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:11.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:13:11.511+0000 7f6d3d0eb640 1 --2- 172.21.15.92:0/1428212736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d38102660 0x7f6d3819a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:11.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:13:11.511+0000 7f6d3d0eb640 1 -- 172.21.15.92:0/1428212736 >> 172.21.15.92:0/1428212736 conn(0x7f6d380fc280 msgr2=0x7f6d38101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:13:11.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:13:11.511+0000 7f6d3d0eb640 1 -- 172.21.15.92:0/1428212736 shutdown_connections 2024-09-19T04:13:11.513 INFO:teuthology.orchestra.run.smithi092.stderr:2024-09-19T04:13:11.511+0000 7f6d3d0eb640 1 -- 172.21.15.92:0/1428212736 wait complete. 2024-09-19T04:13:12.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:11 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:13:12.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:11 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:12.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:11 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:12.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:11 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:13:12.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:11 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:12.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:11 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:12.143 DEBUG:teuthology.orchestra.run.smithi092:osd.10> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.10.service 2024-09-19T04:13:12.145 INFO:tasks.cephadm:Deploying osd.11 on smithi102 with /dev/vg_nvme/lv_1... 2024-09-19T04:13:12.145 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T04:13:12.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:11 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:13:12.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:11 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:12.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:11 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:12.395 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:13:13.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:12 smithi092 ceph-mon[34940]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:13.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:12 smithi007 ceph-mon[31360]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:13.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:12 smithi102 ceph-mon[35446]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:14.547 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:13:14 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:13:14.107+0000 7f56a9c28640 -1 osd.10 0 log_to_monitors true 2024-09-19T04:13:14.923 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:14 smithi092 ceph-mon[34940]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:14.924 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:14 smithi092 ceph-mon[34940]: from='osd.10 [v2:172.21.15.92:6824/1063265541,v1:172.21.15.92:6825/1063265541]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T04:13:14.924 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:14 smithi092 ceph-mon[34940]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T04:13:15.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:14 smithi007 ceph-mon[31360]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:15.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:14 smithi007 ceph-mon[31360]: from='osd.10 [v2:172.21.15.92:6824/1063265541,v1:172.21.15.92:6825/1063265541]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T04:13:15.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:14 smithi007 ceph-mon[31360]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T04:13:15.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:14 smithi102 ceph-mon[35446]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:15.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:14 smithi102 ceph-mon[35446]: from='osd.10 [v2:172.21.15.92:6824/1063265541,v1:172.21.15.92:6825/1063265541]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T04:13:15.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:14 smithi102 ceph-mon[35446]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T04:13:15.290 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T04:13:15.318 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi102:vg_nvme/lv_1 2024-09-19T04:13:15.603 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:13:15.992 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:15 smithi102 ceph-mon[35446]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T04:13:15.992 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:15 smithi102 ceph-mon[35446]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T04:13:15.993 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:15 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:13:15.993 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:15 smithi102 ceph-mon[35446]: from='osd.10 [v2:172.21.15.92:6824/1063265541,v1:172.21.15.92:6825/1063265541]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T04:13:15.993 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:15 smithi102 ceph-mon[35446]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T04:13:15.993 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:15 smithi102 ceph-mon[35446]: Detected new or changed devices on smithi092 2024-09-19T04:13:15.993 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:15 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:15.993 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:15 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:15.993 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:15 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:13:15.993 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:15 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:13:15.993 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:15 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:13:15.993 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:15 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:13:15.993 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:15 smithi102 ceph-mon[35446]: Adjusting osd_memory_target on smithi092 to 4272M 2024-09-19T04:13:15.994 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:15 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:15.994 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:15 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:15.994 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:15 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:13:15.994 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:15 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:16.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.074+0000 7fd149bf1640 1 -- 172.21.15.102:0/967025105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1441037c0 msgr2=0x7fd14410a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:16.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.074+0000 7fd149bf1640 1 --2- 172.21.15.102:0/967025105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1441037c0 0x7fd14410a050 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd13c009ca0 tx=0x7fd13c02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:13:16.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.074+0000 7fd149bf1640 1 -- 172.21.15.102:0/967025105 shutdown_connections 2024-09-19T04:13:16.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.074+0000 7fd149bf1640 1 --2- 172.21.15.102:0/967025105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1441037c0 0x7fd14410a050 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:16.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.074+0000 7fd149bf1640 1 --2- 172.21.15.102:0/967025105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd144102e00 0x7fd144103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:16.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.074+0000 7fd149bf1640 1 --2- 172.21.15.102:0/967025105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd144101c00 0x7fd144102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:16.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.074+0000 7fd149bf1640 1 -- 172.21.15.102:0/967025105 >> 172.21.15.102:0/967025105 conn(0x7fd1440fd3b0 msgr2=0x7fd1440ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:13:16.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.074+0000 7fd149bf1640 1 -- 172.21.15.102:0/967025105 shutdown_connections 2024-09-19T04:13:16.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.074+0000 7fd149bf1640 1 -- 172.21.15.102:0/967025105 wait complete. 2024-09-19T04:13:16.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.074+0000 7fd149bf1640 1 Processor -- start 2024-09-19T04:13:16.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.074+0000 7fd149bf1640 1 -- start start 2024-09-19T04:13:16.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.075+0000 7fd149bf1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd144101c00 0x7fd144075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:16.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.075+0000 7fd149bf1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd144102e00 0x7fd1440745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:16.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.075+0000 7fd149bf1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1441037c0 0x7fd144074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:16.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.075+0000 7fd149bf1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd14410d860 con 0x7fd1441037c0 2024-09-19T04:13:16.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.075+0000 7fd149bf1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd14410d6e0 con 0x7fd144102e00 2024-09-19T04:13:16.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.075+0000 7fd149bf1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd14410d9e0 con 0x7fd144101c00 2024-09-19T04:13:16.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.075+0000 7fd1437fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd144101c00 0x7fd144075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:16.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.075+0000 7fd1437fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd144101c00 0x7fd144075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57210/0 (socket says 172.21.15.102:57210) 2024-09-19T04:13:16.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.075+0000 7fd1437fe640 1 -- 172.21.15.102:0/1074985013 learned_addr learned my addr 172.21.15.102:0/1074985013 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T04:13:16.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.075+0000 7fd13bfff640 1 --2- 172.21.15.102:0/1074985013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd144102e00 0x7fd1440745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:16.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.075+0000 7fd143fff640 1 --2- 172.21.15.102:0/1074985013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1441037c0 0x7fd144074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:16.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.075+0000 7fd1437fe640 1 -- 172.21.15.102:0/1074985013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd144102e00 msgr2=0x7fd1440745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:16.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.075+0000 7fd1437fe640 1 --2- 172.21.15.102:0/1074985013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd144102e00 0x7fd1440745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:16.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.075+0000 7fd1437fe640 1 -- 172.21.15.102:0/1074985013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1441037c0 msgr2=0x7fd144074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:16.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.075+0000 7fd1437fe640 1 --2- 172.21.15.102:0/1074985013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1441037c0 0x7fd144074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:16.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.075+0000 7fd1437fe640 1 -- 172.21.15.102:0/1074985013 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1440753e0 con 0x7fd144101c00 2024-09-19T04:13:16.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.075+0000 7fd143fff640 1 --2- 172.21.15.102:0/1074985013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1441037c0 0x7fd144074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:13:16.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.075+0000 7fd1437fe640 1 --2- 172.21.15.102:0/1074985013 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd144101c00 0x7fd144075f90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd13400d770 tx=0x7fd13400dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:13:16.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.075+0000 7fd1417fa640 1 -- 172.21.15.102:0/1074985013 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd134017070 con 0x7fd144101c00 2024-09-19T04:13:16.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.075+0000 7fd1417fa640 1 -- 172.21.15.102:0/1074985013 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd134009c30 con 0x7fd144101c00 2024-09-19T04:13:16.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.075+0000 7fd149bf1640 1 -- 172.21.15.102:0/1074985013 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1441a1fc0 con 0x7fd144101c00 2024-09-19T04:13:16.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.075+0000 7fd1417fa640 1 -- 172.21.15.102:0/1074985013 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd134003dd0 con 0x7fd144101c00 2024-09-19T04:13:16.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.075+0000 7fd149bf1640 1 -- 172.21.15.102:0/1074985013 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1441a23b0 con 0x7fd144101c00 2024-09-19T04:13:16.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.076+0000 7fd149bf1640 1 -- 172.21.15.102:0/1074985013 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd144108f80 con 0x7fd144101c00 2024-09-19T04:13:16.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.077+0000 7fd1417fa640 1 -- 172.21.15.102:0/1074985013 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fd134003fb0 con 0x7fd144101c00 2024-09-19T04:13:16.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.078+0000 7fd1417fa640 1 --2- 172.21.15.102:0/1074985013 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd1300a3240 0x7fd1300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:16.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.079+0000 7fd1417fa640 1 -- 172.21.15.102:0/1074985013 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6414+0+0 (secure 0 0 0) 0x7fd1340ceb30 con 0x7fd144101c00 2024-09-19T04:13:16.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.079+0000 7fd13bfff640 1 --2- 172.21.15.102:0/1074985013 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd1300a3240 0x7fd1300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:16.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.079+0000 7fd13bfff640 1 --2- 172.21.15.102:0/1074985013 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd1300a3240 0x7fd1300a5700 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd144075d10 tx=0x7fd12c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:13:16.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.083+0000 7fd1417fa640 1 -- 172.21.15.102:0/1074985013 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd13409bfc0 con 0x7fd144101c00 2024-09-19T04:13:16.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:15 smithi007 ceph-mon[31360]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T04:13:16.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:15 smithi007 ceph-mon[31360]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T04:13:16.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:15 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:13:16.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:15 smithi007 ceph-mon[31360]: from='osd.10 [v2:172.21.15.92:6824/1063265541,v1:172.21.15.92:6825/1063265541]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T04:13:16.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:15 smithi007 ceph-mon[31360]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T04:13:16.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:15 smithi007 ceph-mon[31360]: Detected new or changed devices on smithi092 2024-09-19T04:13:16.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:15 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:16.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:15 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:16.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:15 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:13:16.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:15 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:13:16.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:15 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:13:16.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:15 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:13:16.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:15 smithi007 ceph-mon[31360]: Adjusting osd_memory_target on smithi092 to 4272M 2024-09-19T04:13:16.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:15 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:16.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:15 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:16.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:15 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:13:16.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:15 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:16.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:16.257+0000 7fd149bf1640 1 -- 172.21.15.102:0/1074985013 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fd144062630 con 0x7fd1300a3240 2024-09-19T04:13:16.297 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:13:15 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:13:15.817+0000 7f56a5bab640 -1 osd.10 0 waiting for initial osdmap 2024-09-19T04:13:16.297 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:13:15 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:13:15.827+0000 7f56a19d3640 -1 osd.10 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:13:16.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:15 smithi092 ceph-mon[34940]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T04:13:16.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:15 smithi092 ceph-mon[34940]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T04:13:16.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:15 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:13:16.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:15 smithi092 ceph-mon[34940]: from='osd.10 [v2:172.21.15.92:6824/1063265541,v1:172.21.15.92:6825/1063265541]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T04:13:16.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:15 smithi092 ceph-mon[34940]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-09-19T04:13:16.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:15 smithi092 ceph-mon[34940]: Detected new or changed devices on smithi092 2024-09-19T04:13:16.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:15 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:16.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:15 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:16.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:15 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:13:16.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:15 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:13:16.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:15 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:13:16.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:15 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:13:16.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:15 smithi092 ceph-mon[34940]: Adjusting osd_memory_target on smithi092 to 4272M 2024-09-19T04:13:16.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:15 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:16.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:15 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:16.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:15 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:13:16.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:15 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:16.987 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:16 smithi102 ceph-mon[35446]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:16.987 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:16 smithi102 ceph-mon[35446]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-19T04:13:16.988 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:16 smithi102 ceph-mon[35446]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T04:13:16.988 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:16 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:13:16.988 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:16 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:13:16.988 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:16 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:13:16.988 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:16 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:13:16.988 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:16 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:17.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:16 smithi007 ceph-mon[31360]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:17.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:16 smithi007 ceph-mon[31360]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-19T04:13:17.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:16 smithi007 ceph-mon[31360]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T04:13:17.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:16 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:13:17.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:16 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:13:17.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:16 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:13:17.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:16 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:13:17.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:16 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:17.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:16 smithi092 ceph-mon[34940]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:17.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:16 smithi092 ceph-mon[34940]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-09-19T04:13:17.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:16 smithi092 ceph-mon[34940]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T04:13:17.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:16 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:13:17.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:16 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:13:17.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:16 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:13:17.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:16 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:13:17.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:16 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:18.046 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:17 smithi102 ceph-mon[35446]: purged_snaps scrub starts 2024-09-19T04:13:18.047 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:17 smithi102 ceph-mon[35446]: purged_snaps scrub ok 2024-09-19T04:13:18.047 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:17 smithi102 ceph-mon[35446]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:13:18.047 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:17 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:13:18.047 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:17 smithi102 ceph-mon[35446]: osd.10 [v2:172.21.15.92:6824/1063265541,v1:172.21.15.92:6825/1063265541] boot 2024-09-19T04:13:18.047 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:17 smithi102 ceph-mon[35446]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T04:13:18.047 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:17 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:13:18.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:17 smithi007 ceph-mon[31360]: purged_snaps scrub starts 2024-09-19T04:13:18.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:17 smithi007 ceph-mon[31360]: purged_snaps scrub ok 2024-09-19T04:13:18.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:17 smithi007 ceph-mon[31360]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:13:18.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:17 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:13:18.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:17 smithi007 ceph-mon[31360]: osd.10 [v2:172.21.15.92:6824/1063265541,v1:172.21.15.92:6825/1063265541] boot 2024-09-19T04:13:18.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:17 smithi007 ceph-mon[31360]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T04:13:18.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:17 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:13:18.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:17 smithi092 ceph-mon[34940]: purged_snaps scrub starts 2024-09-19T04:13:18.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:17 smithi092 ceph-mon[34940]: purged_snaps scrub ok 2024-09-19T04:13:18.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:17 smithi092 ceph-mon[34940]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:13:18.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:17 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:13:18.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:17 smithi092 ceph-mon[34940]: osd.10 [v2:172.21.15.92:6824/1063265541,v1:172.21.15.92:6825/1063265541] boot 2024-09-19T04:13:18.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:17 smithi092 ceph-mon[34940]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T04:13:18.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:17 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:13:19.122 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:18 smithi102 ceph-mon[35446]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:19.122 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:18 smithi102 ceph-mon[35446]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T04:13:19.122 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:18 smithi102 ceph-mon[35446]: from='client.? 172.21.15.102:0/617620700' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc398e14-5f9e-4f0a-b158-35cbc1f73a83"}]: dispatch 2024-09-19T04:13:19.122 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:18 smithi102 ceph-mon[35446]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc398e14-5f9e-4f0a-b158-35cbc1f73a83"}]: dispatch 2024-09-19T04:13:19.122 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:18 smithi102 ceph-mon[35446]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dc398e14-5f9e-4f0a-b158-35cbc1f73a83"}]': finished 2024-09-19T04:13:19.123 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:18 smithi102 ceph-mon[35446]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T04:13:19.123 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:18 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:13:19.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:18 smithi007 ceph-mon[31360]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:19.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:18 smithi007 ceph-mon[31360]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T04:13:19.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:18 smithi007 ceph-mon[31360]: from='client.? 172.21.15.102:0/617620700' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc398e14-5f9e-4f0a-b158-35cbc1f73a83"}]: dispatch 2024-09-19T04:13:19.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:18 smithi007 ceph-mon[31360]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc398e14-5f9e-4f0a-b158-35cbc1f73a83"}]: dispatch 2024-09-19T04:13:19.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:18 smithi007 ceph-mon[31360]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dc398e14-5f9e-4f0a-b158-35cbc1f73a83"}]': finished 2024-09-19T04:13:19.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:18 smithi007 ceph-mon[31360]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T04:13:19.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:18 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:13:19.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:18 smithi092 ceph-mon[34940]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:13:19.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:18 smithi092 ceph-mon[34940]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T04:13:19.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:18 smithi092 ceph-mon[34940]: from='client.? 172.21.15.102:0/617620700' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc398e14-5f9e-4f0a-b158-35cbc1f73a83"}]: dispatch 2024-09-19T04:13:19.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:18 smithi092 ceph-mon[34940]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dc398e14-5f9e-4f0a-b158-35cbc1f73a83"}]: dispatch 2024-09-19T04:13:19.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:18 smithi092 ceph-mon[34940]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dc398e14-5f9e-4f0a-b158-35cbc1f73a83"}]': finished 2024-09-19T04:13:19.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:18 smithi092 ceph-mon[34940]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T04:13:19.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:18 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:13:20.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:19 smithi007 ceph-mon[31360]: from='client.? 172.21.15.102:0/478092709' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:13:20.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:19 smithi102 ceph-mon[35446]: from='client.? 172.21.15.102:0/478092709' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:13:20.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:19 smithi092 ceph-mon[34940]: from='client.? 172.21.15.102:0/478092709' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:13:21.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:20 smithi007 ceph-mon[31360]: pgmap v226: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T04:13:21.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:20 smithi007 ceph-mon[31360]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-19T04:13:21.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:20 smithi007 ceph-mon[31360]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T04:13:21.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:20 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:13:21.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:20 smithi102 ceph-mon[35446]: pgmap v226: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T04:13:21.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:20 smithi102 ceph-mon[35446]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-19T04:13:21.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:20 smithi102 ceph-mon[35446]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T04:13:21.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:13:21.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:20 smithi092 ceph-mon[34940]: pgmap v226: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T04:13:21.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:20 smithi092 ceph-mon[34940]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-19T04:13:21.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:20 smithi092 ceph-mon[34940]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T04:13:21.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:20 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:13:22.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:21 smithi007 ceph-mon[31360]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T04:13:22.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:21 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:13:22.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:21 smithi102 ceph-mon[35446]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T04:13:22.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:21 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:13:22.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:21 smithi092 ceph-mon[34940]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T04:13:22.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:21 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:13:23.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:22 smithi007 ceph-mon[31360]: pgmap v229: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T04:13:23.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:22 smithi102 ceph-mon[35446]: pgmap v229: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T04:13:23.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:22 smithi092 ceph-mon[34940]: pgmap v229: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T04:13:25.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:24 smithi007 ceph-mon[31360]: pgmap v230: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T04:13:25.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:24 smithi102 ceph-mon[35446]: pgmap v230: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T04:13:25.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:24 smithi092 ceph-mon[34940]: pgmap v230: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T04:13:25.978 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:25 smithi102 ceph-mon[35446]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-19T04:13:25.978 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:25 smithi102 ceph-mon[35446]: Cluster is now healthy 2024-09-19T04:13:26.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:25 smithi092 ceph-mon[34940]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-19T04:13:26.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:25 smithi092 ceph-mon[34940]: Cluster is now healthy 2024-09-19T04:13:26.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:25 smithi007 ceph-mon[31360]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-19T04:13:26.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:25 smithi007 ceph-mon[31360]: Cluster is now healthy 2024-09-19T04:13:27.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:26 smithi102 ceph-mon[35446]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-19T04:13:27.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:26 smithi092 ceph-mon[34940]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-19T04:13:27.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:26 smithi007 ceph-mon[31360]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-19T04:13:28.014 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:27 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T04:13:28.014 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:27 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:28.197 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:27 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T04:13:28.198 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:27 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:28.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:27 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T04:13:28.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:27 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:29.172 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:28 smithi102 ceph-mon[35446]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T04:13:29.172 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:28 smithi102 ceph-mon[35446]: Deploying daemon osd.11 on smithi102 2024-09-19T04:13:29.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:28 smithi092 ceph-mon[34940]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T04:13:29.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:28 smithi092 ceph-mon[34940]: Deploying daemon osd.11 on smithi102 2024-09-19T04:13:29.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:28 smithi007 ceph-mon[31360]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T04:13:29.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:28 smithi007 ceph-mon[31360]: Deploying daemon osd.11 on smithi102 2024-09-19T04:13:31.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:30 smithi007 ceph-mon[31360]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T04:13:31.169 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:30 smithi102 ceph-mon[35446]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T04:13:31.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:30 smithi092 ceph-mon[34940]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T04:13:33.157 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:32 smithi102 ceph-mon[35446]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-19T04:13:33.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:32 smithi092 ceph-mon[34940]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-19T04:13:33.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:32 smithi007 ceph-mon[31360]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-19T04:13:34.145 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:33 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:13:34.145 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:33 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:34.145 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:33 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:34.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:33 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:13:34.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:33 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:34.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:33 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:34.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:33 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:13:34.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:33 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:34.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:33 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:35.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:34 smithi102 ceph-mon[35446]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:13:35.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:34 smithi092 ceph-mon[34940]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:13:35.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:34 smithi007 ceph-mon[31360]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:13:37.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:37.128+0000 7fd1417fa640 1 -- 172.21.15.102:0/1074985013 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fd144062630 con 0x7fd1300a3240 2024-09-19T04:13:37.131 INFO:teuthology.orchestra.run.smithi102.stdout:Created osd(s) 11 on host 'smithi102' 2024-09-19T04:13:37.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:37.130+0000 7fd149bf1640 1 -- 172.21.15.102:0/1074985013 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd1300a3240 msgr2=0x7fd1300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:37.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:37.130+0000 7fd149bf1640 1 --2- 172.21.15.102:0/1074985013 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd1300a3240 0x7fd1300a5700 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd144075d10 tx=0x7fd12c00b410 comp rx=0 tx=0).stop 2024-09-19T04:13:37.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:37.130+0000 7fd149bf1640 1 -- 172.21.15.102:0/1074985013 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd144101c00 msgr2=0x7fd144075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:37.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:37.130+0000 7fd149bf1640 1 --2- 172.21.15.102:0/1074985013 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd144101c00 0x7fd144075f90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd13400d770 tx=0x7fd13400dc30 comp rx=0 tx=0).stop 2024-09-19T04:13:37.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:37.130+0000 7fd149bf1640 1 -- 172.21.15.102:0/1074985013 shutdown_connections 2024-09-19T04:13:37.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:37.130+0000 7fd149bf1640 1 --2- 172.21.15.102:0/1074985013 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd1300a3240 0x7fd1300a5700 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:37.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:37.130+0000 7fd149bf1640 1 --2- 172.21.15.102:0/1074985013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1441037c0 0x7fd144074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:37.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:37.130+0000 7fd149bf1640 1 --2- 172.21.15.102:0/1074985013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd144102e00 0x7fd1440745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:37.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:37.130+0000 7fd149bf1640 1 --2- 172.21.15.102:0/1074985013 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd144101c00 0x7fd144075f90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:37.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:37.130+0000 7fd149bf1640 1 -- 172.21.15.102:0/1074985013 >> 172.21.15.102:0/1074985013 conn(0x7fd1440fd3b0 msgr2=0x7fd144106150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:13:37.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:37.130+0000 7fd149bf1640 1 -- 172.21.15.102:0/1074985013 shutdown_connections 2024-09-19T04:13:37.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:37.131+0000 7fd149bf1640 1 -- 172.21.15.102:0/1074985013 wait complete. 2024-09-19T04:13:37.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:36 smithi092 ceph-mon[34940]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:13:37.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:36 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:37.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:36 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:37.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:36 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:37.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:36 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:13:37.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:36 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:37.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:36 smithi007 ceph-mon[31360]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:13:37.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:36 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:37.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:36 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:37.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:36 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:37.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:36 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:13:37.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:36 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:37.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:36 smithi102 ceph-mon[35446]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:13:37.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:36 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:37.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:36 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:37.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:36 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:37.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:36 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:13:37.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:36 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:37.905 DEBUG:teuthology.orchestra.run.smithi102:osd.11> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.11.service 2024-09-19T04:13:37.907 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-19T04:13:37.907 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T04:13:38.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:37 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:13:38.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:37 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:38.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:37 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:38.179 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:13:38.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:37 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:13:38.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:37 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:38.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:37 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:38.300 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:37 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:13:38.300 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:37 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:38.301 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:37 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:38.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.625+0000 7f3df9a62640 1 -- 172.21.15.7:0/2640736523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3df410c640 msgr2=0x7f3df410ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:38.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.625+0000 7f3df9a62640 1 --2- 172.21.15.7:0/2640736523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3df410c640 0x7f3df410ca40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3de4009900 tx=0x7f3de402a410 comp rx=0 tx=0).stop 2024-09-19T04:13:38.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.625+0000 7f3df9a62640 1 -- 172.21.15.7:0/2640736523 shutdown_connections 2024-09-19T04:13:38.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.625+0000 7f3df9a62640 1 --2- 172.21.15.7:0/2640736523 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3df410e1f0 0x7f3df4114a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:38.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.625+0000 7f3df9a62640 1 --2- 172.21.15.7:0/2640736523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3df410d830 0x7f3df410dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:38.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.625+0000 7f3df9a62640 1 --2- 172.21.15.7:0/2640736523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3df410c640 0x7f3df410ca40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:38.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.625+0000 7f3df9a62640 1 -- 172.21.15.7:0/2640736523 >> 172.21.15.7:0/2640736523 conn(0x7f3df406c860 msgr2=0x7f3df406cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:13:38.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.625+0000 7f3df9a62640 1 -- 172.21.15.7:0/2640736523 shutdown_connections 2024-09-19T04:13:38.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.625+0000 7f3df9a62640 1 -- 172.21.15.7:0/2640736523 wait complete. 2024-09-19T04:13:38.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.626+0000 7f3df9a62640 1 Processor -- start 2024-09-19T04:13:38.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.626+0000 7f3df9a62640 1 -- start start 2024-09-19T04:13:38.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.626+0000 7f3df9a62640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3df410c640 0x7f3df41a2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:38.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.626+0000 7f3df9a62640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3df410d830 0x7f3df41a2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:38.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.627+0000 7f3df9a62640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3df410e1f0 0x7f3df41a9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:38.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.627+0000 7f3df9a62640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3df41182a0 con 0x7f3df410e1f0 2024-09-19T04:13:38.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.627+0000 7f3df9a62640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3df4118120 con 0x7f3df410c640 2024-09-19T04:13:38.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.627+0000 7f3df9a62640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3df4118420 con 0x7f3df410d830 2024-09-19T04:13:38.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.627+0000 7f3df3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3df410e1f0 0x7f3df41a9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:38.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.627+0000 7f3deaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3df410d830 0x7f3df41a2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:38.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.627+0000 7f3df3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3df410e1f0 0x7f3df41a9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59450/0 (socket says 172.21.15.7:59450) 2024-09-19T04:13:38.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.627+0000 7f3deaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3df410d830 0x7f3df41a2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:33998/0 (socket says 172.21.15.7:33998) 2024-09-19T04:13:38.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.627+0000 7f3df3fff640 1 -- 172.21.15.7:0/1583884195 learned_addr learned my addr 172.21.15.7:0/1583884195 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:13:38.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.627+0000 7f3df37fe640 1 --2- 172.21.15.7:0/1583884195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3df410c640 0x7f3df41a2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:38.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.627+0000 7f3df3fff640 1 -- 172.21.15.7:0/1583884195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3df410d830 msgr2=0x7f3df41a2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:38.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.627+0000 7f3df3fff640 1 --2- 172.21.15.7:0/1583884195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3df410d830 0x7f3df41a2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:38.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.627+0000 7f3df3fff640 1 -- 172.21.15.7:0/1583884195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3df410c640 msgr2=0x7f3df41a2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:38.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.627+0000 7f3df3fff640 1 --2- 172.21.15.7:0/1583884195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3df410c640 0x7f3df41a2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:38.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.627+0000 7f3df3fff640 1 -- 172.21.15.7:0/1583884195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df41aa550 con 0x7f3df410e1f0 2024-09-19T04:13:38.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.627+0000 7f3df3fff640 1 --2- 172.21.15.7:0/1583884195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3df410e1f0 0x7f3df41a9ee0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3dec00e960 tx=0x7f3dec00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:13:38.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.627+0000 7f3df17fa640 1 -- 172.21.15.7:0/1583884195 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec004d20 con 0x7f3df410e1f0 2024-09-19T04:13:38.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.628+0000 7f3df9a62640 1 -- 172.21.15.7:0/1583884195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3df41aa840 con 0x7f3df410e1f0 2024-09-19T04:13:38.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.628+0000 7f3df17fa640 1 -- 172.21.15.7:0/1583884195 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dec005020 con 0x7f3df410e1f0 2024-09-19T04:13:38.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.628+0000 7f3df17fa640 1 -- 172.21.15.7:0/1583884195 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec0116d0 con 0x7f3df410e1f0 2024-09-19T04:13:38.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.628+0000 7f3df9a62640 1 -- 172.21.15.7:0/1583884195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3df41aad80 con 0x7f3df410e1f0 2024-09-19T04:13:38.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.629+0000 7f3df9a62640 1 -- 172.21.15.7:0/1583884195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3df4113ad0 con 0x7f3df410e1f0 2024-09-19T04:13:38.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.631+0000 7f3df17fa640 1 -- 172.21.15.7:0/1583884195 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f3dec005560 con 0x7f3df410e1f0 2024-09-19T04:13:38.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.631+0000 7f3df17fa640 1 --2- 172.21.15.7:0/1583884195 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3de00a3270 0x7f3de00a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:38.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.632+0000 7f3df37fe640 1 --2- 172.21.15.7:0/1583884195 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3de00a3270 0x7f3de00a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:38.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.632+0000 7f3df17fa640 1 -- 172.21.15.7:0/1583884195 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6809+0+0 (secure 0 0 0) 0x7f3dec0cf470 con 0x7f3df410e1f0 2024-09-19T04:13:38.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.632+0000 7f3df37fe640 1 --2- 172.21.15.7:0/1583884195 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3de00a3270 0x7f3de00a5730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3de4005ab0 tx=0x7f3de4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:13:38.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.636+0000 7f3df17fa640 1 -- 172.21.15.7:0/1583884195 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3dec016030 con 0x7f3df410e1f0 2024-09-19T04:13:38.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.812+0000 7f3df9a62640 1 -- 172.21.15.7:0/1583884195 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f3df4062df0 con 0x7f3df410e1f0 2024-09-19T04:13:38.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.813+0000 7f3df17fa640 1 -- 172.21.15.7:0/1583884195 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7f3dec09c080 con 0x7f3df410e1f0 2024-09-19T04:13:38.814 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:13:38.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.815+0000 7f3df9a62640 1 -- 172.21.15.7:0/1583884195 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3de00a3270 msgr2=0x7f3de00a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:38.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.815+0000 7f3df9a62640 1 --2- 172.21.15.7:0/1583884195 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3de00a3270 0x7f3de00a5730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3de4005ab0 tx=0x7f3de4000bc0 comp rx=0 tx=0).stop 2024-09-19T04:13:38.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.815+0000 7f3df9a62640 1 -- 172.21.15.7:0/1583884195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3df410e1f0 msgr2=0x7f3df41a9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:38.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.815+0000 7f3df9a62640 1 --2- 172.21.15.7:0/1583884195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3df410e1f0 0x7f3df41a9ee0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3dec00e960 tx=0x7f3dec00ee20 comp rx=0 tx=0).stop 2024-09-19T04:13:38.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.815+0000 7f3df9a62640 1 -- 172.21.15.7:0/1583884195 shutdown_connections 2024-09-19T04:13:38.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.815+0000 7f3df9a62640 1 --2- 172.21.15.7:0/1583884195 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3de00a3270 0x7f3de00a5730 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:38.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.815+0000 7f3df9a62640 1 --2- 172.21.15.7:0/1583884195 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3df410e1f0 0x7f3df41a9ee0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:38.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.815+0000 7f3df9a62640 1 --2- 172.21.15.7:0/1583884195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3df410d830 0x7f3df41a2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:38.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.815+0000 7f3df9a62640 1 --2- 172.21.15.7:0/1583884195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3df410c640 0x7f3df41a2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:38.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.815+0000 7f3df9a62640 1 -- 172.21.15.7:0/1583884195 >> 172.21.15.7:0/1583884195 conn(0x7f3df406c860 msgr2=0x7f3df4110ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:13:38.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.815+0000 7f3df9a62640 1 -- 172.21.15.7:0/1583884195 shutdown_connections 2024-09-19T04:13:38.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:38.815+0000 7f3df9a62640 1 -- 172.21.15.7:0/1583884195 wait complete. 2024-09-19T04:13:39.243 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:38 smithi102 ceph-mon[35446]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:13:39.243 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:38 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1583884195' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:13:39.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:38 smithi092 ceph-mon[34940]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:13:39.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:38 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1583884195' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:13:39.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:38 smithi007 ceph-mon[31360]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:13:39.304 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:38 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1583884195' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:13:39.582 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:13:39 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:13:39.241+0000 7f725eb92640 -1 osd.11 0 log_to_monitors true 2024-09-19T04:13:39.594 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":71,"num_osds":12,"num_up_osds":11,"osd_up_since":1726719196,"num_in_osds":12,"osd_in_since":1726719198,"num_remapped_pgs":0} 2024-09-19T04:13:40.281 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:39 smithi102 ceph-mon[35446]: from='osd.11 [v2:172.21.15.102:6824/1175425599,v1:172.21.15.102:6825/1175425599]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T04:13:40.281 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:39 smithi102 ceph-mon[35446]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T04:13:40.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:39 smithi092 ceph-mon[34940]: from='osd.11 [v2:172.21.15.102:6824/1175425599,v1:172.21.15.102:6825/1175425599]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T04:13:40.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:39 smithi092 ceph-mon[34940]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T04:13:40.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:39 smithi007 ceph-mon[31360]: from='osd.11 [v2:172.21.15.102:6824/1175425599,v1:172.21.15.102:6825/1175425599]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T04:13:40.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:39 smithi007 ceph-mon[31360]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T04:13:40.595 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T04:13:40.867 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:13:41.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:40 smithi102 ceph-mon[35446]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:13:41.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:40 smithi102 ceph-mon[35446]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T04:13:41.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:40 smithi102 ceph-mon[35446]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T04:13:41.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:13:41.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:40 smithi102 ceph-mon[35446]: from='osd.11 [v2:172.21.15.102:6824/1175425599,v1:172.21.15.102:6825/1175425599]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T04:13:41.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:40 smithi102 ceph-mon[35446]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T04:13:41.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:41.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:41.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:13:41.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:13:41.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:13:41.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:13:41.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:40 smithi007 ceph-mon[31360]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:13:41.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:40 smithi007 ceph-mon[31360]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T04:13:41.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:40 smithi007 ceph-mon[31360]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T04:13:41.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:13:41.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:40 smithi007 ceph-mon[31360]: from='osd.11 [v2:172.21.15.102:6824/1175425599,v1:172.21.15.102:6825/1175425599]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T04:13:41.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:40 smithi007 ceph-mon[31360]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T04:13:41.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:41.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:41.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:13:41.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:13:41.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:13:41.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:13:41.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:40 smithi092 ceph-mon[34940]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:13:41.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:40 smithi092 ceph-mon[34940]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T04:13:41.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:40 smithi092 ceph-mon[34940]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T04:13:41.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:13:41.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:40 smithi092 ceph-mon[34940]: from='osd.11 [v2:172.21.15.102:6824/1175425599,v1:172.21.15.102:6825/1175425599]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T04:13:41.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:40 smithi092 ceph-mon[34940]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]: dispatch 2024-09-19T04:13:41.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:41.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:41.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:13:41.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:13:41.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:13:41.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:13:41.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.360+0000 7fc78a665640 1 -- 172.21.15.7:0/887388462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7841026a0 msgr2=0x7fc784104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:41.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.360+0000 7fc78a665640 1 --2- 172.21.15.7:0/887388462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7841026a0 0x7fc784104a90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc774009900 tx=0x7fc77402a410 comp rx=0 tx=0).stop 2024-09-19T04:13:41.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.361+0000 7fc78a665640 1 -- 172.21.15.7:0/887388462 shutdown_connections 2024-09-19T04:13:41.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.361+0000 7fc78a665640 1 --2- 172.21.15.7:0/887388462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc784107900 0x7fc784109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:41.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.361+0000 7fc78a665640 1 --2- 172.21.15.7:0/887388462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc784104fd0 0x7fc7841073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:41.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.361+0000 7fc78a665640 1 --2- 172.21.15.7:0/887388462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7841026a0 0x7fc784104a90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:41.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.361+0000 7fc78a665640 1 -- 172.21.15.7:0/887388462 >> 172.21.15.7:0/887388462 conn(0x7fc7840fc2a0 msgr2=0x7fc7840fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:13:41.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.361+0000 7fc78a665640 1 -- 172.21.15.7:0/887388462 shutdown_connections 2024-09-19T04:13:41.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.361+0000 7fc78a665640 1 -- 172.21.15.7:0/887388462 wait complete. 2024-09-19T04:13:41.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.361+0000 7fc78a665640 1 Processor -- start 2024-09-19T04:13:41.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.361+0000 7fc78a665640 1 -- start start 2024-09-19T04:13:41.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.362+0000 7fc78a665640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7841026a0 0x7fc784197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:41.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.362+0000 7fc78a665640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc784104fd0 0x7fc7841984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:41.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.362+0000 7fc78a665640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc784107900 0x7fc78419f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:41.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.362+0000 7fc78a665640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc78410d8b0 con 0x7fc784104fd0 2024-09-19T04:13:41.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.362+0000 7fc78a665640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc78410d730 con 0x7fc7841026a0 2024-09-19T04:13:41.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.362+0000 7fc78a665640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc78410da30 con 0x7fc784107900 2024-09-19T04:13:41.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.362+0000 7fc7837fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc784104fd0 0x7fc7841984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:41.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.362+0000 7fc7837fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc784104fd0 0x7fc7841984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59468/0 (socket says 172.21.15.7:59468) 2024-09-19T04:13:41.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.362+0000 7fc7837fe640 1 -- 172.21.15.7:0/2021248337 learned_addr learned my addr 172.21.15.7:0/2021248337 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:13:41.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.362+0000 7fc788c02640 1 --2- 172.21.15.7:0/2021248337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc784107900 0x7fc78419f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:41.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.362+0000 7fc783fff640 1 --2- 172.21.15.7:0/2021248337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7841026a0 0x7fc784197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:41.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.362+0000 7fc7837fe640 1 -- 172.21.15.7:0/2021248337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc784107900 msgr2=0x7fc78419f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:41.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.362+0000 7fc7837fe640 1 --2- 172.21.15.7:0/2021248337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc784107900 0x7fc78419f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:41.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.362+0000 7fc7837fe640 1 -- 172.21.15.7:0/2021248337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7841026a0 msgr2=0x7fc784197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:41.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.362+0000 7fc7837fe640 1 --2- 172.21.15.7:0/2021248337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7841026a0 0x7fc784197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:41.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.362+0000 7fc7837fe640 1 -- 172.21.15.7:0/2021248337 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc78419fb90 con 0x7fc784104fd0 2024-09-19T04:13:41.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.362+0000 7fc7837fe640 1 --2- 172.21.15.7:0/2021248337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc784104fd0 0x7fc7841984a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc77800d770 tx=0x7fc77800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:13:41.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.362+0000 7fc7817fa640 1 -- 172.21.15.7:0/2021248337 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc778017070 con 0x7fc784104fd0 2024-09-19T04:13:41.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.362+0000 7fc7817fa640 1 -- 172.21.15.7:0/2021248337 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc778009c30 con 0x7fc784104fd0 2024-09-19T04:13:41.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.362+0000 7fc78a665640 1 -- 172.21.15.7:0/2021248337 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc78419fe80 con 0x7fc784104fd0 2024-09-19T04:13:41.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.362+0000 7fc7817fa640 1 -- 172.21.15.7:0/2021248337 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77800f620 con 0x7fc784104fd0 2024-09-19T04:13:41.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.363+0000 7fc78a665640 1 -- 172.21.15.7:0/2021248337 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7841a0330 con 0x7fc784104fd0 2024-09-19T04:13:41.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.363+0000 7fc78a665640 1 -- 172.21.15.7:0/2021248337 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7840fdd90 con 0x7fc784104fd0 2024-09-19T04:13:41.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.365+0000 7fc7817fa640 1 -- 172.21.15.7:0/2021248337 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fc77801a070 con 0x7fc784104fd0 2024-09-19T04:13:41.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.365+0000 7fc7817fa640 1 --2- 172.21.15.7:0/2021248337 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc76c0a3270 0x7fc76c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:41.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.365+0000 7fc783fff640 1 --2- 172.21.15.7:0/2021248337 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc76c0a3270 0x7fc76c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:41.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.365+0000 7fc7817fa640 1 -- 172.21.15.7:0/2021248337 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6847+0+0 (secure 0 0 0) 0x7fc7780cee30 con 0x7fc784104fd0 2024-09-19T04:13:41.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.366+0000 7fc783fff640 1 --2- 172.21.15.7:0/2021248337 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc76c0a3270 0x7fc76c0a5730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc7740314e0 tx=0x7fc774000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:13:41.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.370+0000 7fc7817fa640 1 -- 172.21.15.7:0/2021248337 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc77809ba20 con 0x7fc784104fd0 2024-09-19T04:13:41.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.544+0000 7fc78a665640 1 -- 172.21.15.7:0/2021248337 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fc784062e90 con 0x7fc784104fd0 2024-09-19T04:13:41.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.545+0000 7fc7817fa640 1 -- 172.21.15.7:0/2021248337 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7fc77809fd20 con 0x7fc784104fd0 2024-09-19T04:13:41.546 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:13:41.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.547+0000 7fc78a665640 1 -- 172.21.15.7:0/2021248337 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc76c0a3270 msgr2=0x7fc76c0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:41.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.547+0000 7fc78a665640 1 --2- 172.21.15.7:0/2021248337 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc76c0a3270 0x7fc76c0a5730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc7740314e0 tx=0x7fc774000bc0 comp rx=0 tx=0).stop 2024-09-19T04:13:41.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.547+0000 7fc78a665640 1 -- 172.21.15.7:0/2021248337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc784104fd0 msgr2=0x7fc7841984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:41.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.547+0000 7fc78a665640 1 --2- 172.21.15.7:0/2021248337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc784104fd0 0x7fc7841984a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc77800d770 tx=0x7fc77800dc30 comp rx=0 tx=0).stop 2024-09-19T04:13:41.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.547+0000 7fc78a665640 1 -- 172.21.15.7:0/2021248337 shutdown_connections 2024-09-19T04:13:41.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.547+0000 7fc78a665640 1 --2- 172.21.15.7:0/2021248337 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc76c0a3270 0x7fc76c0a5730 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:41.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.547+0000 7fc78a665640 1 --2- 172.21.15.7:0/2021248337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc784107900 0x7fc78419f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:41.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.547+0000 7fc78a665640 1 --2- 172.21.15.7:0/2021248337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc784104fd0 0x7fc7841984a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:41.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.547+0000 7fc78a665640 1 --2- 172.21.15.7:0/2021248337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7841026a0 0x7fc784197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:41.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.547+0000 7fc78a665640 1 -- 172.21.15.7:0/2021248337 >> 172.21.15.7:0/2021248337 conn(0x7fc7840fc2a0 msgr2=0x7fc784103040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:13:41.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.547+0000 7fc78a665640 1 -- 172.21.15.7:0/2021248337 shutdown_connections 2024-09-19T04:13:41.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:41.547+0000 7fc78a665640 1 -- 172.21.15.7:0/2021248337 wait complete. 2024-09-19T04:13:41.658 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:13:41 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:13:41.309+0000 7f725b329640 -1 osd.11 0 waiting for initial osdmap 2024-09-19T04:13:41.659 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:13:41 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:13:41.322+0000 7f7252935640 -1 osd.11 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:13:42.217 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:41 smithi007 ceph-mon[31360]: Detected new or changed devices on smithi102 2024-09-19T04:13:42.217 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:41 smithi007 ceph-mon[31360]: Adjusting osd_memory_target on smithi102 to 4272M 2024-09-19T04:13:42.217 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:41 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:42.217 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:41 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:42.217 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:41 smithi007 ceph-mon[31360]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-19T04:13:42.217 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:41 smithi007 ceph-mon[31360]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T04:13:42.217 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:41 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:13:42.217 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:41 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:13:42.218 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:41 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:42.218 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:41 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:13:42.218 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:41 smithi007 ceph-mon[31360]: from='osd.11 ' entity='osd.11' 2024-09-19T04:13:42.218 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:41 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2021248337' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:13:42.243 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":73,"num_osds":12,"num_up_osds":11,"osd_up_since":1726719196,"num_in_osds":12,"osd_in_since":1726719198,"num_remapped_pgs":0} 2024-09-19T04:13:42.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:41 smithi092 ceph-mon[34940]: Detected new or changed devices on smithi102 2024-09-19T04:13:42.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:41 smithi092 ceph-mon[34940]: Adjusting osd_memory_target on smithi102 to 4272M 2024-09-19T04:13:42.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:41 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:42.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:41 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:42.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:41 smithi092 ceph-mon[34940]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-19T04:13:42.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:41 smithi092 ceph-mon[34940]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T04:13:42.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:41 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:13:42.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:41 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:13:42.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:41 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:42.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:41 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:13:42.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:41 smithi092 ceph-mon[34940]: from='osd.11 ' entity='osd.11' 2024-09-19T04:13:42.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:41 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2021248337' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:13:42.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:41 smithi102 ceph-mon[35446]: Detected new or changed devices on smithi102 2024-09-19T04:13:42.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:41 smithi102 ceph-mon[35446]: Adjusting osd_memory_target on smithi102 to 4272M 2024-09-19T04:13:42.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:41 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:42.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:41 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:42.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:41 smithi102 ceph-mon[35446]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-19T04:13:42.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:41 smithi102 ceph-mon[35446]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T04:13:42.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:41 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:13:42.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:41 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:13:42.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:41 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:42.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:41 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:13:42.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:41 smithi102 ceph-mon[35446]: from='osd.11 ' entity='osd.11' 2024-09-19T04:13:42.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:41 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2021248337' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:13:43.244 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T04:13:43.273 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:42 smithi007 ceph-mon[31360]: purged_snaps scrub starts 2024-09-19T04:13:43.273 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:42 smithi007 ceph-mon[31360]: purged_snaps scrub ok 2024-09-19T04:13:43.274 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:42 smithi007 ceph-mon[31360]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:13:43.274 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:42 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:13:43.274 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:42 smithi007 ceph-mon[31360]: osd.11 [v2:172.21.15.102:6824/1175425599,v1:172.21.15.102:6825/1175425599] boot 2024-09-19T04:13:43.274 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:42 smithi007 ceph-mon[31360]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T04:13:43.274 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:42 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:13:43.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:42 smithi092 ceph-mon[34940]: purged_snaps scrub starts 2024-09-19T04:13:43.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:42 smithi092 ceph-mon[34940]: purged_snaps scrub ok 2024-09-19T04:13:43.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:42 smithi092 ceph-mon[34940]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:13:43.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:42 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:13:43.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:42 smithi092 ceph-mon[34940]: osd.11 [v2:172.21.15.102:6824/1175425599,v1:172.21.15.102:6825/1175425599] boot 2024-09-19T04:13:43.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:42 smithi092 ceph-mon[34940]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T04:13:43.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:42 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:13:43.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:42 smithi102 ceph-mon[35446]: purged_snaps scrub starts 2024-09-19T04:13:43.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:42 smithi102 ceph-mon[35446]: purged_snaps scrub ok 2024-09-19T04:13:43.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:42 smithi102 ceph-mon[35446]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 315 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:13:43.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:42 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:13:43.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:42 smithi102 ceph-mon[35446]: osd.11 [v2:172.21.15.102:6824/1175425599,v1:172.21.15.102:6825/1175425599] boot 2024-09-19T04:13:43.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:42 smithi102 ceph-mon[35446]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T04:13:43.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:42 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:13:43.514 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:13:43.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.967+0000 7f1689917640 1 -- 172.21.15.7:0/1663134023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1684101c00 msgr2=0x7f1684102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:43.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.967+0000 7f1689917640 1 --2- 172.21.15.7:0/1663134023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1684101c00 0x7f1684102000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1674009900 tx=0x7f167402a410 comp rx=0 tx=0).stop 2024-09-19T04:13:43.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.967+0000 7f1689917640 1 -- 172.21.15.7:0/1663134023 shutdown_connections 2024-09-19T04:13:43.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.967+0000 7f1689917640 1 --2- 172.21.15.7:0/1663134023 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16841037c0 0x7f168410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:43.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.967+0000 7f1689917640 1 --2- 172.21.15.7:0/1663134023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1684102e00 0x7f1684103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:43.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.967+0000 7f1689917640 1 --2- 172.21.15.7:0/1663134023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1684101c00 0x7f1684102000 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:43.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.967+0000 7f1689917640 1 -- 172.21.15.7:0/1663134023 >> 172.21.15.7:0/1663134023 conn(0x7f16840fd390 msgr2=0x7f16840ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:13:43.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.967+0000 7f1689917640 1 -- 172.21.15.7:0/1663134023 shutdown_connections 2024-09-19T04:13:43.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.967+0000 7f1689917640 1 -- 172.21.15.7:0/1663134023 wait complete. 2024-09-19T04:13:43.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.968+0000 7f1689917640 1 Processor -- start 2024-09-19T04:13:43.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.968+0000 7f1689917640 1 -- start start 2024-09-19T04:13:43.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.968+0000 7f1689917640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1684101c00 0x7f1684197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:43.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.968+0000 7f1689917640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1684102e00 0x7f1684198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:43.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.968+0000 7f1689917640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16841037c0 0x7f168419f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:43.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.968+0000 7f1689917640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f168410d860 con 0x7f1684101c00 2024-09-19T04:13:43.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.968+0000 7f1689917640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f168410d6e0 con 0x7f1684102e00 2024-09-19T04:13:43.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.968+0000 7f1689917640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f168410d9e0 con 0x7f16841037c0 2024-09-19T04:13:43.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.968+0000 7f1682ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1684101c00 0x7f1684197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:43.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.968+0000 7f1682ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1684101c00 0x7f1684197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59496/0 (socket says 172.21.15.7:59496) 2024-09-19T04:13:43.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.968+0000 7f1682ffd640 1 -- 172.21.15.7:0/2909503574 learned_addr learned my addr 172.21.15.7:0/2909503574 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:13:43.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.968+0000 7f16827fc640 1 --2- 172.21.15.7:0/2909503574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1684102e00 0x7f1684198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:43.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.969+0000 7f1682ffd640 1 -- 172.21.15.7:0/2909503574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16841037c0 msgr2=0x7f168419f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:43.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.969+0000 7f16837fe640 1 --2- 172.21.15.7:0/2909503574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16841037c0 0x7f168419f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:43.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.969+0000 7f1682ffd640 1 --2- 172.21.15.7:0/2909503574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16841037c0 0x7f168419f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:43.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.969+0000 7f1682ffd640 1 -- 172.21.15.7:0/2909503574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1684102e00 msgr2=0x7f1684198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:43.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.969+0000 7f1682ffd640 1 --2- 172.21.15.7:0/2909503574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1684102e00 0x7f1684198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:43.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.969+0000 7f1682ffd640 1 -- 172.21.15.7:0/2909503574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f168419fb30 con 0x7f1684101c00 2024-09-19T04:13:43.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.969+0000 7f16827fc640 1 --2- 172.21.15.7:0/2909503574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1684102e00 0x7f1684198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:13:43.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.969+0000 7f16837fe640 1 --2- 172.21.15.7:0/2909503574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16841037c0 0x7f168419f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:13:43.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.969+0000 7f1682ffd640 1 --2- 172.21.15.7:0/2909503574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1684101c00 0x7f1684197f00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1674031610 tx=0x7f1674004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:13:43.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.969+0000 7f1688915640 1 -- 172.21.15.7:0/2909503574 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167403f030 con 0x7f1684101c00 2024-09-19T04:13:43.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.969+0000 7f1689917640 1 -- 172.21.15.7:0/2909503574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f168419fdc0 con 0x7f1684101c00 2024-09-19T04:13:43.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.969+0000 7f1688915640 1 -- 172.21.15.7:0/2909503574 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1674003ad0 con 0x7f1684101c00 2024-09-19T04:13:43.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.969+0000 7f1688915640 1 -- 172.21.15.7:0/2909503574 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1674035070 con 0x7f1684101c00 2024-09-19T04:13:43.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.969+0000 7f1689917640 1 -- 172.21.15.7:0/2909503574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16841a0210 con 0x7f1684101c00 2024-09-19T04:13:43.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.970+0000 7f1689917640 1 -- 172.21.15.7:0/2909503574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1684109000 con 0x7f1684101c00 2024-09-19T04:13:43.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.971+0000 7f1688915640 1 -- 172.21.15.7:0/2909503574 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f1674042030 con 0x7f1684101c00 2024-09-19T04:13:43.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.972+0000 7f1688915640 1 --2- 172.21.15.7:0/2909503574 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f166c0a3270 0x7f166c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:43.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.972+0000 7f16827fc640 1 --2- 172.21.15.7:0/2909503574 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f166c0a3270 0x7f166c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:43.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.972+0000 7f1688915640 1 -- 172.21.15.7:0/2909503574 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f16740efc30 con 0x7f1684101c00 2024-09-19T04:13:43.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.972+0000 7f16827fc640 1 --2- 172.21.15.7:0/2909503574 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f166c0a3270 0x7f166c0a5730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1684199420 tx=0x7f1678005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:13:43.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:43.976+0000 7f1688915640 1 -- 172.21.15.7:0/2909503574 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f16740bcdf0 con 0x7f1684101c00 2024-09-19T04:13:44.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:44.151+0000 7f1689917640 1 -- 172.21.15.7:0/2909503574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f168402d990 con 0x7f1684101c00 2024-09-19T04:13:44.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:44.152+0000 7f1688915640 1 -- 172.21.15.7:0/2909503574 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) ==== 74+0+133 (secure 0 0 0) 0x7f16740bc6f0 con 0x7f1684101c00 2024-09-19T04:13:44.153 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:13:44.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:44.154+0000 7f1689917640 1 -- 172.21.15.7:0/2909503574 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f166c0a3270 msgr2=0x7f166c0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:44.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:44.154+0000 7f1689917640 1 --2- 172.21.15.7:0/2909503574 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f166c0a3270 0x7f166c0a5730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1684199420 tx=0x7f1678005f90 comp rx=0 tx=0).stop 2024-09-19T04:13:44.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:44.154+0000 7f1689917640 1 -- 172.21.15.7:0/2909503574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1684101c00 msgr2=0x7f1684197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:44.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:44.154+0000 7f1689917640 1 --2- 172.21.15.7:0/2909503574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1684101c00 0x7f1684197f00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1674031610 tx=0x7f1674004270 comp rx=0 tx=0).stop 2024-09-19T04:13:44.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:44.154+0000 7f1689917640 1 -- 172.21.15.7:0/2909503574 shutdown_connections 2024-09-19T04:13:44.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:44.154+0000 7f1689917640 1 --2- 172.21.15.7:0/2909503574 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f166c0a3270 0x7f166c0a5730 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:44.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:44.154+0000 7f1689917640 1 --2- 172.21.15.7:0/2909503574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16841037c0 0x7f168419f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:44.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:44.154+0000 7f1689917640 1 --2- 172.21.15.7:0/2909503574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1684102e00 0x7f1684198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:44.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:44.154+0000 7f1689917640 1 --2- 172.21.15.7:0/2909503574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1684101c00 0x7f1684197f00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:44.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:44.154+0000 7f1689917640 1 -- 172.21.15.7:0/2909503574 >> 172.21.15.7:0/2909503574 conn(0x7f16840fd390 msgr2=0x7f16841061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:13:44.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:44.155+0000 7f1689917640 1 -- 172.21.15.7:0/2909503574 shutdown_connections 2024-09-19T04:13:44.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:44.155+0000 7f1689917640 1 -- 172.21.15.7:0/2909503574 wait complete. 2024-09-19T04:13:44.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:44 smithi007 ceph-mon[31360]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:13:44.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:44 smithi007 ceph-mon[31360]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T04:13:44.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:44 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2909503574' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:13:44.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:44 smithi102 ceph-mon[35446]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:13:44.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:44 smithi102 ceph-mon[35446]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T04:13:44.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:44 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2909503574' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:13:44.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:44 smithi092 ceph-mon[34940]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:13:44.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:44 smithi092 ceph-mon[34940]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T04:13:44.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:44 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2909503574' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:13:44.909 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":75,"num_osds":12,"num_up_osds":12,"osd_up_since":1726719222,"num_in_osds":12,"osd_in_since":1726719198,"num_remapped_pgs":0} 2024-09-19T04:13:44.910 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:13:45.208 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:13:45.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.663+0000 7f1cf24b9640 1 -- 172.21.15.7:0/215924660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cec106f10 msgr2=0x7f1cec10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:45.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.663+0000 7f1cf24b9640 1 --2- 172.21.15.7:0/215924660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cec106f10 0x7f1cec10ea90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4009ca0 tx=0x7f1ce402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:13:45.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.663+0000 7f1cf24b9640 1 -- 172.21.15.7:0/215924660 shutdown_connections 2024-09-19T04:13:45.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.663+0000 7f1cf24b9640 1 --2- 172.21.15.7:0/215924660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cec106f10 0x7f1cec10ea90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:45.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.663+0000 7f1cf24b9640 1 --2- 172.21.15.7:0/215924660 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cec102790 0x7f1cec1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:45.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.663+0000 7f1cf24b9640 1 --2- 172.21.15.7:0/215924660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cec101de0 0x7f1cec1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:45.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.663+0000 7f1cf24b9640 1 -- 172.21.15.7:0/215924660 >> 172.21.15.7:0/215924660 conn(0x7f1cec0fd8c0 msgr2=0x7f1cec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:13:45.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.663+0000 7f1cf24b9640 1 -- 172.21.15.7:0/215924660 shutdown_connections 2024-09-19T04:13:45.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.663+0000 7f1cf24b9640 1 -- 172.21.15.7:0/215924660 wait complete. 2024-09-19T04:13:45.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.664+0000 7f1cf24b9640 1 Processor -- start 2024-09-19T04:13:45.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.664+0000 7f1cf24b9640 1 -- start start 2024-09-19T04:13:45.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.664+0000 7f1cf24b9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cec101de0 0x7f1cec0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:45.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.664+0000 7f1cf24b9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cec102790 0x7f1cec074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:45.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.665+0000 7f1cf24b9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cec106f10 0x7f1cec074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:45.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.665+0000 7f1cf24b9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1cec111f70 con 0x7f1cec101de0 2024-09-19T04:13:45.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.665+0000 7f1cf24b9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1cec111df0 con 0x7f1cec106f10 2024-09-19T04:13:45.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.665+0000 7f1cf24b9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1cec1120f0 con 0x7f1cec102790 2024-09-19T04:13:45.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.665+0000 7f1cebfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cec101de0 0x7f1cec0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:45.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.665+0000 7f1cebfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cec101de0 0x7f1cec0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59524/0 (socket says 172.21.15.7:59524) 2024-09-19T04:13:45.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.665+0000 7f1cebfff640 1 -- 172.21.15.7:0/1001336880 learned_addr learned my addr 172.21.15.7:0/1001336880 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:13:45.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.665+0000 7f1ceb7fe640 1 --2- 172.21.15.7:0/1001336880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cec102790 0x7f1cec074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:45.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.665+0000 7f1cf0a56640 1 --2- 172.21.15.7:0/1001336880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cec106f10 0x7f1cec074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:45.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.665+0000 7f1cebfff640 1 -- 172.21.15.7:0/1001336880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cec102790 msgr2=0x7f1cec074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:45.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.665+0000 7f1cebfff640 1 --2- 172.21.15.7:0/1001336880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cec102790 0x7f1cec074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:45.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.665+0000 7f1cebfff640 1 -- 172.21.15.7:0/1001336880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cec106f10 msgr2=0x7f1cec074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:45.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.665+0000 7f1cebfff640 1 --2- 172.21.15.7:0/1001336880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cec106f10 0x7f1cec074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:45.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.665+0000 7f1cebfff640 1 -- 172.21.15.7:0/1001336880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cec1a68b0 con 0x7f1cec101de0 2024-09-19T04:13:45.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.665+0000 7f1cebfff640 1 --2- 172.21.15.7:0/1001336880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cec101de0 0x7f1cec0744f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00d950 tx=0x7f1cdc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:13:45.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.665+0000 7f1ce97fa640 1 -- 172.21.15.7:0/1001336880 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc017070 con 0x7f1cec101de0 2024-09-19T04:13:45.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.665+0000 7f1ce97fa640 1 -- 172.21.15.7:0/1001336880 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1cdc009c30 con 0x7f1cec101de0 2024-09-19T04:13:45.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.665+0000 7f1cf24b9640 1 -- 172.21.15.7:0/1001336880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cec1a6ba0 con 0x7f1cec101de0 2024-09-19T04:13:45.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.665+0000 7f1ce97fa640 1 -- 172.21.15.7:0/1001336880 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc00f6b0 con 0x7f1cec101de0 2024-09-19T04:13:45.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.665+0000 7f1cf24b9640 1 -- 172.21.15.7:0/1001336880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cec1a70e0 con 0x7f1cec101de0 2024-09-19T04:13:45.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.667+0000 7f1cf24b9640 1 -- 172.21.15.7:0/1001336880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cec1021c0 con 0x7f1cec101de0 2024-09-19T04:13:45.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.668+0000 7f1ce97fa640 1 -- 172.21.15.7:0/1001336880 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f1cdc0109d0 con 0x7f1cec101de0 2024-09-19T04:13:45.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.668+0000 7f1ce97fa640 1 --2- 172.21.15.7:0/1001336880 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1cd40a3240 0x7f1cd40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:45.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.668+0000 7f1ceb7fe640 1 --2- 172.21.15.7:0/1001336880 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1cd40a3240 0x7f1cd40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:45.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.669+0000 7f1ce97fa640 1 -- 172.21.15.7:0/1001336880 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f1cdc0cf010 con 0x7f1cec101de0 2024-09-19T04:13:45.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.669+0000 7f1ceb7fe640 1 --2- 172.21.15.7:0/1001336880 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1cd40a3240 0x7f1cd40a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1cec075f80 tx=0x7f1ce000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:13:45.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.673+0000 7f1ce97fa640 1 -- 172.21.15.7:0/1001336880 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1cdc009de0 con 0x7f1cec101de0 2024-09-19T04:13:45.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.850+0000 7f1cf24b9640 1 -- 172.21.15.7:0/1001336880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1cec075a20 con 0x7f1cec101de0 2024-09-19T04:13:45.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.851+0000 7f1ce97fa640 1 -- 172.21.15.7:0/1001336880 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+18384 (secure 0 0 0) 0x7f1cdc09bb80 con 0x7f1cec101de0 2024-09-19T04:13:45.852 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:13:45.853 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":75,"fsid":"77957c0a-763c-11ef-bceb-c7b262605968","created":"2024-09-19T04:06:58.337394+0000","modified":"2024-09-19T04:13:43.313665+0000","last_up_change":"2024-09-19T04:13:42.312137+0000","last_in_change":"2024-09-19T04:13:18.757925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:09:59.544984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d9b93bd5-ee22-4fb0-ba29-bfa208430a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6803","nonce":240599233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6805","nonce":240599233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6809","nonce":240599233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6807","nonce":240599233}]},"public_addr":"172.21.15.7:6803/240599233","cluster_addr":"172.21.15.7:6805/240599233","heartbeat_back_addr":"172.21.15.7:6809/240599233","heartbeat_front_addr":"172.21.15.7:6807/240599233","state":["exists","up"]},{"osd":1,"uuid":"db5793e6-f3ad-4075-a02b-206bf7f1e59a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6801","nonce":902403333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6803","nonce":902403333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6807","nonce":902403333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6805","nonce":902403333}]},"public_addr":"172.21.15.92:6801/902403333","cluster_addr":"172.21.15.92:6803/902403333","heartbeat_back_addr":"172.21.15.92:6807/902403333","heartbeat_front_addr":"172.21.15.92:6805/902403333","state":["exists","up"]},{"osd":2,"uuid":"1eb83a1b-82d8-4983-bae3-b161adb3a33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6801","nonce":2078441772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6803","nonce":2078441772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6807","nonce":2078441772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6805","nonce":2078441772}]},"public_addr":"172.21.15.102:6801/2078441772","cluster_addr":"172.21.15.102:6803/2078441772","heartbeat_back_addr":"172.21.15.102:6807/2078441772","heartbeat_front_addr":"172.21.15.102:6805/2078441772","state":["exists","up"]},{"osd":3,"uuid":"68ba79e5-bcf0-4349-9e14-42f2fa9c11b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6811","nonce":2729561132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6813","nonce":2729561132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6817","nonce":2729561132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6815","nonce":2729561132}]},"public_addr":"172.21.15.7:6811/2729561132","cluster_addr":"172.21.15.7:6813/2729561132","heartbeat_back_addr":"172.21.15.7:6817/2729561132","heartbeat_front_addr":"172.21.15.7:6815/2729561132","state":["exists","up"]},{"osd":4,"uuid":"f20d4a51-121f-4ac8-afeb-5962d83bd697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6809","nonce":2799734294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6811","nonce":2799734294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6815","nonce":2799734294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6813","nonce":2799734294}]},"public_addr":"172.21.15.92:6809/2799734294","cluster_addr":"172.21.15.92:6811/2799734294","heartbeat_back_addr":"172.21.15.92:6815/2799734294","heartbeat_front_addr":"172.21.15.92:6813/2799734294","state":["exists","up"]},{"osd":5,"uuid":"aac02b0a-99dc-4457-8898-c68dc196517a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6809","nonce":3099678146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6811","nonce":3099678146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6815","nonce":3099678146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6813","nonce":3099678146}]},"public_addr":"172.21.15.102:6809/3099678146","cluster_addr":"172.21.15.102:6811/3099678146","heartbeat_back_addr":"172.21.15.102:6815/3099678146","heartbeat_front_addr":"172.21.15.102:6813/3099678146","state":["exists","up"]},{"osd":6,"uuid":"7e5a8b30-8406-486c-ace5-79158a3757a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6819","nonce":1569704304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6821","nonce":1569704304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6825","nonce":1569704304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6823","nonce":1569704304}]},"public_addr":"172.21.15.7:6819/1569704304","cluster_addr":"172.21.15.7:6821/1569704304","heartbeat_back_addr":"172.21.15.7:6825/1569704304","heartbeat_front_addr":"172.21.15.7:6823/1569704304","state":["exists","up"]},{"osd":7,"uuid":"e6a7049a-17a1-43b2-8ecd-5f4ca7c337be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6817","nonce":3411102480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6819","nonce":3411102480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6823","nonce":3411102480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6821","nonce":3411102480}]},"public_addr":"172.21.15.92:6817/3411102480","cluster_addr":"172.21.15.92:6819/3411102480","heartbeat_back_addr":"172.21.15.92:6823/3411102480","heartbeat_front_addr":"172.21.15.92:6821/3411102480","state":["exists","up"]},{"osd":8,"uuid":"31879baa-861d-4322-990f-0b9a42b8b610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6817","nonce":2990859925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6819","nonce":2990859925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6823","nonce":2990859925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6821","nonce":2990859925}]},"public_addr":"172.21.15.102:6817/2990859925","cluster_addr":"172.21.15.102:6819/2990859925","heartbeat_back_addr":"172.21.15.102:6823/2990859925","heartbeat_front_addr":"172.21.15.102:6821/2990859925","state":["exists","up"]},{"osd":9,"uuid":"6d65db33-926c-4a6e-a072-707e9c9de92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6827","nonce":1710319475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6829","nonce":1710319475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6833","nonce":1710319475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6831","nonce":1710319475}]},"public_addr":"172.21.15.7:6827/1710319475","cluster_addr":"172.21.15.7:6829/1710319475","heartbeat_back_addr":"172.21.15.7:6833/1710319475","heartbeat_front_addr":"172.21.15.7:6831/1710319475","state":["exists","up"]},{"osd":10,"uuid":"9ab681ee-0bef-47bd-bf3d-20b17c6b870c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6825","nonce":1063265541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6827","nonce":1063265541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6831","nonce":1063265541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6829","nonce":1063265541}]},"public_addr":"172.21.15.92:6825/1063265541","cluster_addr":"172.21.15.92:6827/1063265541","heartbeat_back_addr":"172.21.15.92:6831/1063265541","heartbeat_front_addr":"172.21.15.92:6829/1063265541","state":["exists","up"]},{"osd":11,"uuid":"dc398e14-5f9e-4f0a-b158-35cbc1f73a83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6825","nonce":1175425599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6827","nonce":1175425599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6831","nonce":1175425599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6829","nonce":1175425599}]},"public_addr":"172.21.15.102:6825/1175425599","cluster_addr":"172.21.15.102:6827/1175425599","heartbeat_back_addr":"172.21.15.102:6831/1175425599","heartbeat_front_addr":"172.21.15.102:6829/1175425599","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:07.857319+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:31.430120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:56.892301+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:10:22.011884+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:10:46.326025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:11:10.339084+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:11:35.365906+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:01.104309+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:25.717295+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:51.387644+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:13:15.076355+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:13:40.253150+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/2883028938":"2024-09-20T04:07:45.039922+0000","172.21.15.7:0/1186412739":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6800/751091002":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6801/751091002":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6801/940106179":"2024-09-20T04:07:20.364033+0000","172.21.15.7:6800/940106179":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/1450115700":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/2954294373":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/1996930242":"2024-09-20T04:07:45.039922+0000","172.21.15.7:0/3562231347":"2024-09-20T04:07:20.364033+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:13:45.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.853+0000 7f1cf24b9640 1 -- 172.21.15.7:0/1001336880 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1cd40a3240 msgr2=0x7f1cd40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:45.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.853+0000 7f1cf24b9640 1 --2- 172.21.15.7:0/1001336880 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1cd40a3240 0x7f1cd40a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1cec075f80 tx=0x7f1ce000b390 comp rx=0 tx=0).stop 2024-09-19T04:13:45.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.853+0000 7f1cf24b9640 1 -- 172.21.15.7:0/1001336880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cec101de0 msgr2=0x7f1cec0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:45.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.853+0000 7f1cf24b9640 1 --2- 172.21.15.7:0/1001336880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cec101de0 0x7f1cec0744f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00d950 tx=0x7f1cdc00de10 comp rx=0 tx=0).stop 2024-09-19T04:13:45.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.853+0000 7f1cf24b9640 1 -- 172.21.15.7:0/1001336880 shutdown_connections 2024-09-19T04:13:45.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.853+0000 7f1cf24b9640 1 --2- 172.21.15.7:0/1001336880 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1cd40a3240 0x7f1cd40a5700 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:45.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.853+0000 7f1cf24b9640 1 --2- 172.21.15.7:0/1001336880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cec106f10 0x7f1cec074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:45.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.853+0000 7f1cf24b9640 1 --2- 172.21.15.7:0/1001336880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1cec102790 0x7f1cec074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:45.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.853+0000 7f1cf24b9640 1 --2- 172.21.15.7:0/1001336880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1cec101de0 0x7f1cec0744f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:45.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.853+0000 7f1cf24b9640 1 -- 172.21.15.7:0/1001336880 >> 172.21.15.7:0/1001336880 conn(0x7f1cec0fd8c0 msgr2=0x7f1cec0feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:13:45.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.853+0000 7f1cf24b9640 1 -- 172.21.15.7:0/1001336880 shutdown_connections 2024-09-19T04:13:45.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:45.853+0000 7f1cf24b9640 1 -- 172.21.15.7:0/1001336880 wait complete. 2024-09-19T04:13:46.496 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:46 smithi007 ceph-mon[31360]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:13:46.496 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:46 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1001336880' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:13:46.531 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T04:09:59.544984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T04:13:46.531 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T04:13:46.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:46 smithi102 ceph-mon[35446]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:13:46.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:46 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1001336880' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:13:46.790 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:13:46.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:46 smithi092 ceph-mon[34940]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:13:46.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:46 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1001336880' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:13:47.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.233+0000 7f8cbf1c0640 1 -- 172.21.15.7:0/2104219661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cb8100a80 msgr2=0x7f8cb8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:47.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.233+0000 7f8cbf1c0640 1 --2- 172.21.15.7:0/2104219661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cb8100a80 0x7f8cb8100ee0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009930 tx=0x7f8ca802a420 comp rx=0 tx=0).stop 2024-09-19T04:13:47.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.233+0000 7f8cbf1c0640 1 -- 172.21.15.7:0/2104219661 shutdown_connections 2024-09-19T04:13:47.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.233+0000 7f8cbf1c0640 1 --2- 172.21.15.7:0/2104219661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cb8101420 0x7f8cb810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:47.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.233+0000 7f8cbf1c0640 1 --2- 172.21.15.7:0/2104219661 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cb8100a80 0x7f8cb8100ee0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:47.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.233+0000 7f8cbf1c0640 1 --2- 172.21.15.7:0/2104219661 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cb8106a80 0x7f8cb8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:47.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.233+0000 7f8cbf1c0640 1 -- 172.21.15.7:0/2104219661 >> 172.21.15.7:0/2104219661 conn(0x7f8cb80fc7a0 msgr2=0x7f8cb80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:13:47.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.233+0000 7f8cbf1c0640 1 -- 172.21.15.7:0/2104219661 shutdown_connections 2024-09-19T04:13:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.233+0000 7f8cbf1c0640 1 -- 172.21.15.7:0/2104219661 wait complete. 2024-09-19T04:13:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.234+0000 7f8cbf1c0640 1 Processor -- start 2024-09-19T04:13:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.234+0000 7f8cbf1c0640 1 -- start start 2024-09-19T04:13:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.234+0000 7f8cbf1c0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cb8100a80 0x7f8cb80fcd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.234+0000 7f8cbf1c0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cb8101420 0x7f8cb80fd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.234+0000 7f8cbf1c0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cb8106a80 0x7f8cb80fd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.234+0000 7f8cbf1c0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb8110ea0 con 0x7f8cb8100a80 2024-09-19T04:13:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.234+0000 7f8cbf1c0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb8110d20 con 0x7f8cb8101420 2024-09-19T04:13:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.234+0000 7f8cbf1c0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb8111020 con 0x7f8cb8106a80 2024-09-19T04:13:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.234+0000 7f8cbcf5c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cb8100a80 0x7f8cb80fcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.234+0000 7f8cbcf5c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cb8100a80 0x7f8cb80fcd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59554/0 (socket says 172.21.15.7:59554) 2024-09-19T04:13:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.234+0000 7f8cbcf5c640 1 -- 172.21.15.7:0/827633034 learned_addr learned my addr 172.21.15.7:0/827633034 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:13:47.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.234+0000 7f8cbd75d640 1 --2- 172.21.15.7:0/827633034 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cb8106a80 0x7f8cb80fd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:47.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.234+0000 7f8caffff640 1 --2- 172.21.15.7:0/827633034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cb8101420 0x7f8cb80fd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:47.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.234+0000 7f8cbcf5c640 1 -- 172.21.15.7:0/827633034 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cb8106a80 msgr2=0x7f8cb80fd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:47.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.234+0000 7f8cbcf5c640 1 --2- 172.21.15.7:0/827633034 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cb8106a80 0x7f8cb80fd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:47.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.234+0000 7f8cbcf5c640 1 -- 172.21.15.7:0/827633034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cb8101420 msgr2=0x7f8cb80fd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:47.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.234+0000 7f8cbcf5c640 1 --2- 172.21.15.7:0/827633034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cb8101420 0x7f8cb80fd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:47.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.234+0000 7f8cbcf5c640 1 -- 172.21.15.7:0/827633034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb81a6930 con 0x7f8cb8100a80 2024-09-19T04:13:47.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.234+0000 7f8caffff640 1 --2- 172.21.15.7:0/827633034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cb8101420 0x7f8cb80fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:13:47.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.234+0000 7f8cbd75d640 1 --2- 172.21.15.7:0/827633034 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cb8106a80 0x7f8cb80fd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:13:47.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.235+0000 7f8cbcf5c640 1 --2- 172.21.15.7:0/827633034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cb8100a80 0x7f8cb80fcd40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8cb400d950 tx=0x7f8cb400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:13:47.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.235+0000 7f8cadffb640 1 -- 172.21.15.7:0/827633034 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb4017070 con 0x7f8cb8100a80 2024-09-19T04:13:47.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.235+0000 7f8cbf1c0640 1 -- 172.21.15.7:0/827633034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb81a6c20 con 0x7f8cb8100a80 2024-09-19T04:13:47.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.235+0000 7f8cadffb640 1 -- 172.21.15.7:0/827633034 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8cb4009c30 con 0x7f8cb8100a80 2024-09-19T04:13:47.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.235+0000 7f8cadffb640 1 -- 172.21.15.7:0/827633034 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb400f6b0 con 0x7f8cb8100a80 2024-09-19T04:13:47.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.235+0000 7f8cbf1c0640 1 -- 172.21.15.7:0/827633034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb81a7160 con 0x7f8cb8100a80 2024-09-19T04:13:47.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.236+0000 7f8cbf1c0640 1 -- 172.21.15.7:0/827633034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cb8100ee0 con 0x7f8cb8100a80 2024-09-19T04:13:47.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.237+0000 7f8cadffb640 1 -- 172.21.15.7:0/827633034 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f8cb40109d0 con 0x7f8cb8100a80 2024-09-19T04:13:47.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.238+0000 7f8cadffb640 1 --2- 172.21.15.7:0/827633034 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f8ca00a3240 0x7f8ca00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:47.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.238+0000 7f8caffff640 1 --2- 172.21.15.7:0/827633034 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f8ca00a3240 0x7f8ca00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:47.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.238+0000 7f8cadffb640 1 -- 172.21.15.7:0/827633034 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f8cb40cf1d0 con 0x7f8cb8100a80 2024-09-19T04:13:47.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.238+0000 7f8caffff640 1 --2- 172.21.15.7:0/827633034 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f8ca00a3240 0x7f8ca00a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8000c00 tx=0x7f8ca8032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:13:47.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.242+0000 7f8cadffb640 1 -- 172.21.15.7:0/827633034 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8cb4009de0 con 0x7f8cb8100a80 2024-09-19T04:13:47.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.418+0000 7f8cbf1c0640 1 -- 172.21.15.7:0/827633034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8cb802d7c0 con 0x7f8cb8100a80 2024-09-19T04:13:47.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.419+0000 7f8cadffb640 1 -- 172.21.15.7:0/827633034 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7f8cb409c2f0 con 0x7f8cb8100a80 2024-09-19T04:13:47.420 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-19T04:13:47.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.421+0000 7f8cbf1c0640 1 -- 172.21.15.7:0/827633034 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f8ca00a3240 msgr2=0x7f8ca00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:47.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.421+0000 7f8cbf1c0640 1 --2- 172.21.15.7:0/827633034 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f8ca00a3240 0x7f8ca00a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8000c00 tx=0x7f8ca8032c70 comp rx=0 tx=0).stop 2024-09-19T04:13:47.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.421+0000 7f8cbf1c0640 1 -- 172.21.15.7:0/827633034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cb8100a80 msgr2=0x7f8cb80fcd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:47.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.421+0000 7f8cbf1c0640 1 --2- 172.21.15.7:0/827633034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cb8100a80 0x7f8cb80fcd40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8cb400d950 tx=0x7f8cb400de10 comp rx=0 tx=0).stop 2024-09-19T04:13:47.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.421+0000 7f8cbf1c0640 1 -- 172.21.15.7:0/827633034 shutdown_connections 2024-09-19T04:13:47.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.421+0000 7f8cbf1c0640 1 --2- 172.21.15.7:0/827633034 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f8ca00a3240 0x7f8ca00a5700 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:47.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.421+0000 7f8cbf1c0640 1 --2- 172.21.15.7:0/827633034 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cb8106a80 0x7f8cb80fd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:47.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.421+0000 7f8cbf1c0640 1 --2- 172.21.15.7:0/827633034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cb8101420 0x7f8cb80fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:47.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.421+0000 7f8cbf1c0640 1 --2- 172.21.15.7:0/827633034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cb8100a80 0x7f8cb80fcd40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:47.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.421+0000 7f8cbf1c0640 1 -- 172.21.15.7:0/827633034 >> 172.21.15.7:0/827633034 conn(0x7f8cb80fc7a0 msgr2=0x7f8cb806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:13:47.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.421+0000 7f8cbf1c0640 1 -- 172.21.15.7:0/827633034 shutdown_connections 2024-09-19T04:13:47.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:47.421+0000 7f8cbf1c0640 1 -- 172.21.15.7:0/827633034 wait complete. 2024-09-19T04:13:48.053 INFO:tasks.cephadm:Adding mds.a on smithi007 2024-09-19T04:13:48.053 INFO:tasks.cephadm:Adding mds.d on smithi007 2024-09-19T04:13:48.053 INFO:tasks.cephadm:Adding mds.g on smithi007 2024-09-19T04:13:48.053 INFO:tasks.cephadm:Adding mds.j on smithi007 2024-09-19T04:13:48.053 INFO:tasks.cephadm:Adding mds.b on smithi092 2024-09-19T04:13:48.053 INFO:tasks.cephadm:Adding mds.e on smithi092 2024-09-19T04:13:48.053 INFO:tasks.cephadm:Adding mds.h on smithi092 2024-09-19T04:13:48.053 INFO:tasks.cephadm:Adding mds.k on smithi092 2024-09-19T04:13:48.054 INFO:tasks.cephadm:Adding mds.c on smithi102 2024-09-19T04:13:48.054 INFO:tasks.cephadm:Adding mds.f on smithi102 2024-09-19T04:13:48.054 INFO:tasks.cephadm:Adding mds.i on smithi102 2024-09-19T04:13:48.054 INFO:tasks.cephadm:Adding mds.l on smithi102 2024-09-19T04:13:48.054 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi102=c;smithi102=f;smithi102=i;smithi102=l' 2024-09-19T04:13:48.321 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:13:48.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:48 smithi102 ceph-mon[35446]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:13:48.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:48 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/827633034' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T04:13:48.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:48 smithi007 ceph-mon[31360]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:13:48.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:48 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/827633034' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T04:13:48.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:48 smithi092 ceph-mon[34940]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:13:48.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:48 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/827633034' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T04:13:48.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.802+0000 7f2d0cecc640 1 -- 172.21.15.102:0/2054182957 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d08102690 msgr2=0x7f2d08108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:48.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.802+0000 7f2d0cecc640 1 --2- 172.21.15.102:0/2054182957 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d08102690 0x7f2d08108f20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2d00009ca0 tx=0x7f2d0002a8c0 comp rx=0 tx=0).stop 2024-09-19T04:13:48.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.802+0000 7f2d0cecc640 1 -- 172.21.15.102:0/2054182957 shutdown_connections 2024-09-19T04:13:48.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.802+0000 7f2d0cecc640 1 --2- 172.21.15.102:0/2054182957 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d08102690 0x7f2d08108f20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:48.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.802+0000 7f2d0cecc640 1 --2- 172.21.15.102:0/2054182957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d08101cd0 0x7f2d08102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:48.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.802+0000 7f2d0cecc640 1 --2- 172.21.15.102:0/2054182957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d08100ad0 0x7f2d08100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:48.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.802+0000 7f2d0cecc640 1 -- 172.21.15.102:0/2054182957 >> 172.21.15.102:0/2054182957 conn(0x7f2d080fc280 msgr2=0x7f2d080fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:13:48.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.802+0000 7f2d0cecc640 1 -- 172.21.15.102:0/2054182957 shutdown_connections 2024-09-19T04:13:48.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.802+0000 7f2d0cecc640 1 -- 172.21.15.102:0/2054182957 wait complete. 2024-09-19T04:13:48.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.803+0000 7f2d0cecc640 1 Processor -- start 2024-09-19T04:13:48.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.803+0000 7f2d0cecc640 1 -- start start 2024-09-19T04:13:48.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.803+0000 7f2d0cecc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d08100ad0 0x7f2d08197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:48.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.803+0000 7f2d0cecc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d08101cd0 0x7f2d081983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:48.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.803+0000 7f2d0cecc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d08102690 0x7f2d0819f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:48.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.803+0000 7f2d0cecc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0810c730 con 0x7f2d08100ad0 2024-09-19T04:13:48.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.803+0000 7f2d0cecc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0810c5b0 con 0x7f2d08102690 2024-09-19T04:13:48.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.803+0000 7f2d0cecc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0810c8b0 con 0x7f2d08101cd0 2024-09-19T04:13:48.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.803+0000 7f2d05d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d08101cd0 0x7f2d081983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:48.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.803+0000 7f2d05d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d08101cd0 0x7f2d081983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38302/0 (socket says 172.21.15.102:38302) 2024-09-19T04:13:48.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.803+0000 7f2d05d9b640 1 -- 172.21.15.102:0/3302613294 learned_addr learned my addr 172.21.15.102:0/3302613294 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T04:13:48.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.803+0000 7f2d06d9d640 1 --2- 172.21.15.102:0/3302613294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d08102690 0x7f2d0819f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:48.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.803+0000 7f2d0659c640 1 --2- 172.21.15.102:0/3302613294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d08100ad0 0x7f2d08197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:48.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.803+0000 7f2d05d9b640 1 -- 172.21.15.102:0/3302613294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d08102690 msgr2=0x7f2d0819f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:48.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.803+0000 7f2d05d9b640 1 --2- 172.21.15.102:0/3302613294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d08102690 0x7f2d0819f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:48.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.803+0000 7f2d05d9b640 1 -- 172.21.15.102:0/3302613294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d08100ad0 msgr2=0x7f2d08197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:48.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.803+0000 7f2d05d9b640 1 --2- 172.21.15.102:0/3302613294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d08100ad0 0x7f2d08197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:48.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.803+0000 7f2d05d9b640 1 -- 172.21.15.102:0/3302613294 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d0819fae0 con 0x7f2d08101cd0 2024-09-19T04:13:48.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.803+0000 7f2d06d9d640 1 --2- 172.21.15.102:0/3302613294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d08102690 0x7f2d0819f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:13:48.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.803+0000 7f2d05d9b640 1 --2- 172.21.15.102:0/3302613294 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d08101cd0 0x7f2d081983f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2cf800d950 tx=0x7f2cf800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:13:48.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.804+0000 7f2cf77fe640 1 -- 172.21.15.102:0/3302613294 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8017070 con 0x7f2d08101cd0 2024-09-19T04:13:48.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.804+0000 7f2d0cecc640 1 -- 172.21.15.102:0/3302613294 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d0819fdd0 con 0x7f2d08101cd0 2024-09-19T04:13:48.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.804+0000 7f2cf77fe640 1 -- 172.21.15.102:0/3302613294 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cf8009c30 con 0x7f2d08101cd0 2024-09-19T04:13:48.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.804+0000 7f2cf77fe640 1 -- 172.21.15.102:0/3302613294 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf800f6b0 con 0x7f2d08101cd0 2024-09-19T04:13:48.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.804+0000 7f2d0cecc640 1 -- 172.21.15.102:0/3302613294 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d081a0280 con 0x7f2d08101cd0 2024-09-19T04:13:48.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.805+0000 7f2d0cecc640 1 -- 172.21.15.102:0/3302613294 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d081a04b0 con 0x7f2d08101cd0 2024-09-19T04:13:48.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.807+0000 7f2cf77fe640 1 -- 172.21.15.102:0/3302613294 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f2cf80109d0 con 0x7f2d08101cd0 2024-09-19T04:13:48.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.807+0000 7f2cf77fe640 1 --2- 172.21.15.102:0/3302613294 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2cf00a3270 0x7f2cf00a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:48.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.807+0000 7f2cf77fe640 1 -- 172.21.15.102:0/3302613294 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f2cf80cf440 con 0x7f2d08101cd0 2024-09-19T04:13:48.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.808+0000 7f2d0659c640 1 --2- 172.21.15.102:0/3302613294 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2cf00a3270 0x7f2cf00a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:48.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.808+0000 7f2d0659c640 1 --2- 172.21.15.102:0/3302613294 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2cf00a3270 0x7f2cf00a5730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc005db0 tx=0x7f2cfc005d40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:13:48.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.812+0000 7f2cf77fe640 1 -- 172.21.15.102:0/3302613294 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2cf809c600 con 0x7f2d08101cd0 2024-09-19T04:13:49.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:48.999+0000 7f2d0cecc640 1 -- 172.21.15.102:0/3302613294 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi102=c;smithi102=f;smithi102=i;smithi102=l", "target": ["mon-mgr", ""]}) -- 0x7f2d0806a7d0 con 0x7f2cf00a3270 2024-09-19T04:13:49.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:49.007+0000 7f2cf77fe640 1 -- 172.21.15.102:0/3302613294 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f2d0806a7d0 con 0x7f2cf00a3270 2024-09-19T04:13:49.008 INFO:teuthology.orchestra.run.smithi102.stdout:Scheduled mds.all update... 2024-09-19T04:13:49.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:49.009+0000 7f2d0cecc640 1 -- 172.21.15.102:0/3302613294 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2cf00a3270 msgr2=0x7f2cf00a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:49.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:49.009+0000 7f2d0cecc640 1 --2- 172.21.15.102:0/3302613294 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2cf00a3270 0x7f2cf00a5730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc005db0 tx=0x7f2cfc005d40 comp rx=0 tx=0).stop 2024-09-19T04:13:49.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:49.009+0000 7f2d0cecc640 1 -- 172.21.15.102:0/3302613294 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d08101cd0 msgr2=0x7f2d081983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:49.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:49.009+0000 7f2d0cecc640 1 --2- 172.21.15.102:0/3302613294 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d08101cd0 0x7f2d081983f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2cf800d950 tx=0x7f2cf800de10 comp rx=0 tx=0).stop 2024-09-19T04:13:49.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:49.009+0000 7f2d0cecc640 1 -- 172.21.15.102:0/3302613294 shutdown_connections 2024-09-19T04:13:49.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:49.009+0000 7f2d0cecc640 1 --2- 172.21.15.102:0/3302613294 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2cf00a3270 0x7f2cf00a5730 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:49.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:49.009+0000 7f2d0cecc640 1 --2- 172.21.15.102:0/3302613294 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d08102690 0x7f2d0819f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:49.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:49.009+0000 7f2d0cecc640 1 --2- 172.21.15.102:0/3302613294 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d08101cd0 0x7f2d081983f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:49.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:49.009+0000 7f2d0cecc640 1 --2- 172.21.15.102:0/3302613294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d08100ad0 0x7f2d08197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:49.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:49.009+0000 7f2d0cecc640 1 -- 172.21.15.102:0/3302613294 >> 172.21.15.102:0/3302613294 conn(0x7f2d080fc280 msgr2=0x7f2d08069fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:13:49.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:49.009+0000 7f2d0cecc640 1 -- 172.21.15.102:0/3302613294 shutdown_connections 2024-09-19T04:13:49.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T04:13:49.009+0000 7f2d0cecc640 1 -- 172.21.15.102:0/3302613294 wait complete. 2024-09-19T04:13:49.808 DEBUG:teuthology.orchestra.run.smithi007:mds.a> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.a.service 2024-09-19T04:13:49.812 DEBUG:teuthology.orchestra.run.smithi007:mds.d> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.d.service 2024-09-19T04:13:49.855 DEBUG:teuthology.orchestra.run.smithi007:mds.g> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.g.service 2024-09-19T04:13:49.898 DEBUG:teuthology.orchestra.run.smithi007:mds.j> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.j.service 2024-09-19T04:13:49.942 DEBUG:teuthology.orchestra.run.smithi092:mds.b> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.b.service 2024-09-19T04:13:49.945 DEBUG:teuthology.orchestra.run.smithi092:mds.e> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.e.service 2024-09-19T04:13:49.988 DEBUG:teuthology.orchestra.run.smithi092:mds.h> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.h.service 2024-09-19T04:13:50.031 DEBUG:teuthology.orchestra.run.smithi092:mds.k> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.k.service 2024-09-19T04:13:50.041 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:50 smithi102 ceph-mon[35446]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi102=c;smithi102=f;smithi102=i;smithi102=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:13:50.041 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:50 smithi102 ceph-mon[35446]: Saving service mds.all spec with placement smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi102=c;smithi102=f;smithi102=i;smithi102=l;count:12 2024-09-19T04:13:50.041 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:50 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:50.041 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:50 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:13:50.041 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:50 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:50.041 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:50 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:13:50.041 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:50 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:50.041 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:50 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:13:50.041 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:50 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:13:50.042 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:50 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:50.074 DEBUG:teuthology.orchestra.run.smithi102:mds.c> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.c.service 2024-09-19T04:13:50.077 DEBUG:teuthology.orchestra.run.smithi102:mds.f> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.f.service 2024-09-19T04:13:50.121 DEBUG:teuthology.orchestra.run.smithi102:mds.i> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.i.service 2024-09-19T04:13:50.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:50 smithi007 ceph-mon[31360]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi102=c;smithi102=f;smithi102=i;smithi102=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:13:50.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:50 smithi007 ceph-mon[31360]: Saving service mds.all spec with placement smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi102=c;smithi102=f;smithi102=i;smithi102=l;count:12 2024-09-19T04:13:50.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:50 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:50.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:50 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:13:50.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:50 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:50.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:50 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:13:50.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:50 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:50.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:50 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:13:50.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:50 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:13:50.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:50 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:50.164 DEBUG:teuthology.orchestra.run.smithi102:mds.l> sudo journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.l.service 2024-09-19T04:13:50.207 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-19T04:13:50.207 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:13:50.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:50 smithi092 ceph-mon[34940]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi102=c;smithi102=f;smithi102=i;smithi102=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:13:50.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:50 smithi092 ceph-mon[34940]: Saving service mds.all spec with placement smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi102=c;smithi102=f;smithi102=i;smithi102=l;count:12 2024-09-19T04:13:50.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:50 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:50.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:50 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:13:50.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:50 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:50.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:50 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:13:50.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:50 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:50.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:50 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:13:50.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:50 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:13:50.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:50 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:50.473 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:13:50.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.959+0000 7fa6c006a640 1 -- 172.21.15.7:0/545975964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6b8101de0 msgr2=0x7fa6b81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:50.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.959+0000 7fa6c006a640 1 --2- 172.21.15.7:0/545975964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6b8101de0 0x7fa6b81021c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4009900 tx=0x7fa6b402a410 comp rx=0 tx=0).stop 2024-09-19T04:13:50.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.960+0000 7fa6c006a640 1 -- 172.21.15.7:0/545975964 shutdown_connections 2024-09-19T04:13:50.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.960+0000 7fa6c006a640 1 --2- 172.21.15.7:0/545975964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6b8106f10 0x7fa6b810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:50.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.960+0000 7fa6c006a640 1 --2- 172.21.15.7:0/545975964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6b8102790 0x7fa6b81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:50.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.960+0000 7fa6c006a640 1 --2- 172.21.15.7:0/545975964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6b8101de0 0x7fa6b81021c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:50.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.960+0000 7fa6c006a640 1 -- 172.21.15.7:0/545975964 >> 172.21.15.7:0/545975964 conn(0x7fa6b80fd8c0 msgr2=0x7fa6b80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:13:50.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.960+0000 7fa6c006a640 1 -- 172.21.15.7:0/545975964 shutdown_connections 2024-09-19T04:13:50.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.960+0000 7fa6c006a640 1 -- 172.21.15.7:0/545975964 wait complete. 2024-09-19T04:13:50.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.961+0000 7fa6c006a640 1 Processor -- start 2024-09-19T04:13:50.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.961+0000 7fa6c006a640 1 -- start start 2024-09-19T04:13:50.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.961+0000 7fa6c006a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6b8101de0 0x7fa6b8198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:50.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.961+0000 7fa6c006a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6b8102790 0x7fa6b81989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:50.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.961+0000 7fa6c006a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6b8106f10 0x7fa6b819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:50.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.961+0000 7fa6c006a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b8111f80 con 0x7fa6b8102790 2024-09-19T04:13:50.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.961+0000 7fa6c006a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b8111e00 con 0x7fa6b8106f10 2024-09-19T04:13:50.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.961+0000 7fa6c006a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b8112100 con 0x7fa6b8101de0 2024-09-19T04:13:50.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.961+0000 7fa6bd605640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6b8102790 0x7fa6b81989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:50.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.961+0000 7fa6bd605640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6b8102790 0x7fa6b81989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58628/0 (socket says 172.21.15.7:58628) 2024-09-19T04:13:50.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.961+0000 7fa6bd605640 1 -- 172.21.15.7:0/3029964681 learned_addr learned my addr 172.21.15.7:0/3029964681 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:13:50.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.961+0000 7fa6be607640 1 --2- 172.21.15.7:0/3029964681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6b8106f10 0x7fa6b819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:50.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.961+0000 7fa6bde06640 1 --2- 172.21.15.7:0/3029964681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6b8101de0 0x7fa6b8198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:50.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.961+0000 7fa6bd605640 1 -- 172.21.15.7:0/3029964681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6b8101de0 msgr2=0x7fa6b8198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:50.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.961+0000 7fa6bd605640 1 --2- 172.21.15.7:0/3029964681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6b8101de0 0x7fa6b8198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:50.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.961+0000 7fa6bd605640 1 -- 172.21.15.7:0/3029964681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6b8106f10 msgr2=0x7fa6b819cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:50.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.961+0000 7fa6bd605640 1 --2- 172.21.15.7:0/3029964681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6b8106f10 0x7fa6b819cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:50.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.961+0000 7fa6bd605640 1 -- 172.21.15.7:0/3029964681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6b819d410 con 0x7fa6b8102790 2024-09-19T04:13:50.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.961+0000 7fa6bde06640 1 --2- 172.21.15.7:0/3029964681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6b8101de0 0x7fa6b8198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:13:50.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.961+0000 7fa6be607640 1 --2- 172.21.15.7:0/3029964681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6b8106f10 0x7fa6b819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:13:50.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.962+0000 7fa6bd605640 1 --2- 172.21.15.7:0/3029964681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6b8102790 0x7fa6b81989a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa6a800e9f0 tx=0x7fa6a800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:13:50.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.962+0000 7fa6aeffd640 1 -- 172.21.15.7:0/3029964681 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a800cd80 con 0x7fa6b8102790 2024-09-19T04:13:50.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.962+0000 7fa6aeffd640 1 -- 172.21.15.7:0/3029964681 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6a8010910 con 0x7fa6b8102790 2024-09-19T04:13:50.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.962+0000 7fa6c006a640 1 -- 172.21.15.7:0/3029964681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6b819d700 con 0x7fa6b8102790 2024-09-19T04:13:50.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.962+0000 7fa6aeffd640 1 -- 172.21.15.7:0/3029964681 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8018990 con 0x7fa6b8102790 2024-09-19T04:13:50.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.962+0000 7fa6c006a640 1 -- 172.21.15.7:0/3029964681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6b81a4fe0 con 0x7fa6b8102790 2024-09-19T04:13:50.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.963+0000 7fa6c006a640 1 -- 172.21.15.7:0/3029964681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6b81021c0 con 0x7fa6b8102790 2024-09-19T04:13:50.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.964+0000 7fa6aeffd640 1 -- 172.21.15.7:0/3029964681 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fa6a8010ac0 con 0x7fa6b8102790 2024-09-19T04:13:50.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.965+0000 7fa6aeffd640 1 --2- 172.21.15.7:0/3029964681 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa6a40a3240 0x7fa6a40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:50.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.965+0000 7fa6bde06640 1 --2- 172.21.15.7:0/3029964681 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa6a40a3240 0x7fa6a40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:50.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.965+0000 7fa6aeffd640 1 -- 172.21.15.7:0/3029964681 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fa6a80cf830 con 0x7fa6b8102790 2024-09-19T04:13:50.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.966+0000 7fa6bde06640 1 --2- 172.21.15.7:0/3029964681 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa6a40a3240 0x7fa6a40a5700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4000c00 tx=0x7fa6b4005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:13:50.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:50.970+0000 7fa6aeffd640 1 -- 172.21.15.7:0/3029964681 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa6a809c9f0 con 0x7fa6b8102790 2024-09-19T04:13:51.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:51 smithi007 ceph-mon[31360]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:13:51.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:51 smithi007 ceph-mon[31360]: Deploying daemon mds.l on smithi102 2024-09-19T04:13:51.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:51.186+0000 7fa6c006a640 1 -- 172.21.15.7:0/3029964681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6b810a0f0 con 0x7fa6b8102790 2024-09-19T04:13:51.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:51.186+0000 7fa6aeffd640 1 -- 172.21.15.7:0/3029964681 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fa6a809c2f0 con 0x7fa6b8102790 2024-09-19T04:13:51.188 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:13:51.188 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":1,"btime":"2024-09-19T04:06:58:337221+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-19T04:13:51.188 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 1 2024-09-19T04:13:51.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:51.188+0000 7fa6c006a640 1 -- 172.21.15.7:0/3029964681 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa6a40a3240 msgr2=0x7fa6a40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:51.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:51.188+0000 7fa6c006a640 1 --2- 172.21.15.7:0/3029964681 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa6a40a3240 0x7fa6a40a5700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4000c00 tx=0x7fa6b4005a40 comp rx=0 tx=0).stop 2024-09-19T04:13:51.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:51.188+0000 7fa6c006a640 1 -- 172.21.15.7:0/3029964681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6b8102790 msgr2=0x7fa6b81989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:51.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:51.188+0000 7fa6c006a640 1 --2- 172.21.15.7:0/3029964681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6b8102790 0x7fa6b81989a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa6a800e9f0 tx=0x7fa6a800eeb0 comp rx=0 tx=0).stop 2024-09-19T04:13:51.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:51.188+0000 7fa6c006a640 1 -- 172.21.15.7:0/3029964681 shutdown_connections 2024-09-19T04:13:51.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:51.188+0000 7fa6c006a640 1 --2- 172.21.15.7:0/3029964681 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa6a40a3240 0x7fa6a40a5700 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:51.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:51.188+0000 7fa6c006a640 1 --2- 172.21.15.7:0/3029964681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6b8106f10 0x7fa6b819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:51.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:51.188+0000 7fa6c006a640 1 --2- 172.21.15.7:0/3029964681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6b8102790 0x7fa6b81989a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:51.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:51.188+0000 7fa6c006a640 1 --2- 172.21.15.7:0/3029964681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6b8101de0 0x7fa6b8198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:51.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:51.188+0000 7fa6c006a640 1 -- 172.21.15.7:0/3029964681 >> 172.21.15.7:0/3029964681 conn(0x7fa6b80fd8c0 msgr2=0x7fa6b80febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:13:51.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:51.189+0000 7fa6c006a640 1 -- 172.21.15.7:0/3029964681 shutdown_connections 2024-09-19T04:13:51.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:51.189+0000 7fa6c006a640 1 -- 172.21.15.7:0/3029964681 wait complete. 2024-09-19T04:13:51.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:51 smithi092 ceph-mon[34940]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:13:51.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:51 smithi092 ceph-mon[34940]: Deploying daemon mds.l on smithi102 2024-09-19T04:13:51.324 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:51 smithi102 ceph-mon[35446]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:13:51.324 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:51 smithi102 ceph-mon[35446]: Deploying daemon mds.l on smithi102 2024-09-19T04:13:51.909 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 19 04:13:51 smithi102 systemd[1]: Starting Ceph mds.l for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:13:52.254 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:52 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3029964681' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:13:52.255 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 19 04:13:52 smithi102 podman[64846]: 2024-09-19 04:13:51.903860563 +0000 UTC m=+0.015795123 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:13:52.255 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 19 04:13:52 smithi102 podman[64846]: 2024-09-19 04:13:52.001317591 +0000 UTC m=+0.113252152 container create bbbdd03af4089ca5e669353559b6410339961c9ccd1a2cf33c729f3d29b2a0bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-l, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-2f599a4) 2024-09-19T04:13:52.255 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 19 04:13:52 smithi102 podman[64846]: 2024-09-19 04:13:52.253929145 +0000 UTC m=+0.365863704 container init bbbdd03af4089ca5e669353559b6410339961c9ccd1a2cf33c729f3d29b2a0bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-l, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T04:13:52.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:52 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3029964681' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:13:52.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:52 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3029964681' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:13:52.659 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 19 04:13:52 smithi102 podman[64846]: 2024-09-19 04:13:52.256767633 +0000 UTC m=+0.368702200 container start bbbdd03af4089ca5e669353559b6410339961c9ccd1a2cf33c729f3d29b2a0bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-l, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T04:13:52.659 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 19 04:13:52 smithi102 ceph-mds[64865]: -- 172.21.15.102:0/3366594468 <== mon.1 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55de7bf37860 con 0x55de7bf15400 2024-09-19T04:13:52.659 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 19 04:13:52 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-l[64861]: starting mds.l at 2024-09-19T04:13:52.659 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 19 04:13:52 smithi102 bash[64846]: bbbdd03af4089ca5e669353559b6410339961c9ccd1a2cf33c729f3d29b2a0bf 2024-09-19T04:13:52.659 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 19 04:13:52 smithi102 systemd[1]: Started Ceph mds.l for 77957c0a-763c-11ef-bceb-c7b262605968. 2024-09-19T04:13:53.156 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:53 smithi092 ceph-mon[34940]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:13:53.156 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:53 smithi092 ceph-mon[34940]: mds.? [v2:172.21.15.102:6832/3063042931,v1:172.21.15.102:6833/3063042931] up:boot 2024-09-19T04:13:53.156 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:53 smithi092 ceph-mon[34940]: fsmap 1 up:standby 2024-09-19T04:13:53.156 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:53 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T04:13:53.156 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:53 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:53.157 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:53 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:53.157 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:53 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:53.157 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:53 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:13:53.157 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:53 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:13:53.157 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:53 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:53.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:53 smithi007 ceph-mon[31360]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:13:53.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:53 smithi007 ceph-mon[31360]: mds.? [v2:172.21.15.102:6832/3063042931,v1:172.21.15.102:6833/3063042931] up:boot 2024-09-19T04:13:53.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:53 smithi007 ceph-mon[31360]: fsmap 1 up:standby 2024-09-19T04:13:53.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:53 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T04:13:53.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:53 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:53.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:53 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:53.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:53 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:53.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:53 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:13:53.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:53 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:13:53.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:53 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:53.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:53 smithi102 ceph-mon[35446]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:13:53.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:53 smithi102 ceph-mon[35446]: mds.? [v2:172.21.15.102:6832/3063042931,v1:172.21.15.102:6833/3063042931] up:boot 2024-09-19T04:13:53.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:53 smithi102 ceph-mon[35446]: fsmap 1 up:standby 2024-09-19T04:13:53.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:53 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T04:13:53.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:53 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:53.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:53 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:53.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:53 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:53.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:53 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:13:53.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:53 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:13:53.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:53 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:53.928 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:13:54.180 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:54 smithi092 ceph-mon[34940]: Deploying daemon mds.k on smithi092 2024-09-19T04:13:54.200 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:13:54.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:54 smithi007 ceph-mon[31360]: Deploying daemon mds.k on smithi092 2024-09-19T04:13:54.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:54 smithi102 ceph-mon[35446]: Deploying daemon mds.k on smithi092 2024-09-19T04:13:54.547 INFO:journalctl@ceph.mds.k.smithi092.stdout:Sep 19 04:13:54 smithi092 systemd[1]: Starting Ceph mds.k for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:13:54.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.676+0000 7f9cbbd7b640 1 -- 172.21.15.7:0/3381534679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cb4101280 msgr2=0x7f9cb410df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:54.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.676+0000 7f9cbbd7b640 1 --2- 172.21.15.7:0/3381534679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cb4101280 0x7f9cb410df40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4009900 tx=0x7f9ca402a410 comp rx=0 tx=0).stop 2024-09-19T04:13:54.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.676+0000 7f9cbbd7b640 1 -- 172.21.15.7:0/3381534679 shutdown_connections 2024-09-19T04:13:54.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.676+0000 7f9cbbd7b640 1 --2- 172.21.15.7:0/3381534679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cb410e480 0x7f9cb4110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:54.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.676+0000 7f9cbbd7b640 1 --2- 172.21.15.7:0/3381534679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cb4101280 0x7f9cb410df40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:54.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.676+0000 7f9cbbd7b640 1 --2- 172.21.15.7:0/3381534679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9cb41008d0 0x7f9cb4100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:54.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.676+0000 7f9cbbd7b640 1 -- 172.21.15.7:0/3381534679 >> 172.21.15.7:0/3381534679 conn(0x7f9cb40fc7a0 msgr2=0x7f9cb40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:13:54.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.676+0000 7f9cbbd7b640 1 -- 172.21.15.7:0/3381534679 shutdown_connections 2024-09-19T04:13:54.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.676+0000 7f9cbbd7b640 1 -- 172.21.15.7:0/3381534679 wait complete. 2024-09-19T04:13:54.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.676+0000 7f9cbbd7b640 1 Processor -- start 2024-09-19T04:13:54.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.676+0000 7f9cbbd7b640 1 -- start start 2024-09-19T04:13:54.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.677+0000 7f9cbbd7b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9cb41008d0 0x7f9cb41a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:54.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.677+0000 7f9cbbd7b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cb4101280 0x7f9cb41a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:54.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.677+0000 7f9cbbd7b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cb410e480 0x7f9cb419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:54.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.677+0000 7f9cbbd7b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb4114250 con 0x7f9cb410e480 2024-09-19T04:13:54.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.677+0000 7f9cbbd7b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb41140d0 con 0x7f9cb4101280 2024-09-19T04:13:54.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.677+0000 7f9cbbd7b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb41143d0 con 0x7f9cb41008d0 2024-09-19T04:13:54.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.677+0000 7f9cba318640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cb410e480 0x7f9cb419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:54.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.677+0000 7f9cba318640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cb410e480 0x7f9cb419a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58652/0 (socket says 172.21.15.7:58652) 2024-09-19T04:13:54.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.677+0000 7f9cba318640 1 -- 172.21.15.7:0/655827395 learned_addr learned my addr 172.21.15.7:0/655827395 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:13:54.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.677+0000 7f9cb9316640 1 --2- 172.21.15.7:0/655827395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cb4101280 0x7f9cb41a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:54.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.677+0000 7f9cb9b17640 1 --2- 172.21.15.7:0/655827395 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9cb41008d0 0x7f9cb41a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:54.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.677+0000 7f9cba318640 1 -- 172.21.15.7:0/655827395 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9cb41008d0 msgr2=0x7f9cb41a03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:54.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.677+0000 7f9cba318640 1 --2- 172.21.15.7:0/655827395 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9cb41008d0 0x7f9cb41a03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:54.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.677+0000 7f9cba318640 1 -- 172.21.15.7:0/655827395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cb4101280 msgr2=0x7f9cb41a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:54.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.677+0000 7f9cba318640 1 --2- 172.21.15.7:0/655827395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cb4101280 0x7f9cb41a0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:54.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.677+0000 7f9cba318640 1 -- 172.21.15.7:0/655827395 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb419acc0 con 0x7f9cb410e480 2024-09-19T04:13:54.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.677+0000 7f9cba318640 1 --2- 172.21.15.7:0/655827395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cb410e480 0x7f9cb419a590 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9cac00dac0 tx=0x7f9cac00df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:13:54.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.677+0000 7f9caaffd640 1 -- 172.21.15.7:0/655827395 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cac017030 con 0x7f9cb410e480 2024-09-19T04:13:54.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.677+0000 7f9cbbd7b640 1 -- 172.21.15.7:0/655827395 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cb419afb0 con 0x7f9cb410e480 2024-09-19T04:13:54.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.677+0000 7f9caaffd640 1 -- 172.21.15.7:0/655827395 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cac003e50 con 0x7f9cb410e480 2024-09-19T04:13:54.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.677+0000 7f9caaffd640 1 -- 172.21.15.7:0/655827395 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cac010460 con 0x7f9cb410e480 2024-09-19T04:13:54.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.677+0000 7f9cbbd7b640 1 -- 172.21.15.7:0/655827395 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cb41a72a0 con 0x7f9cb410e480 2024-09-19T04:13:54.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.678+0000 7f9cbbd7b640 1 -- 172.21.15.7:0/655827395 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cb4100cb0 con 0x7f9cb410e480 2024-09-19T04:13:54.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.680+0000 7f9caaffd640 1 -- 172.21.15.7:0/655827395 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f9cac01a070 con 0x7f9cb410e480 2024-09-19T04:13:54.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.680+0000 7f9caaffd640 1 --2- 172.21.15.7:0/655827395 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9ca00a3240 0x7f9ca00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:54.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.680+0000 7f9caaffd640 1 -- 172.21.15.7:0/655827395 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f9cac0cf5c0 con 0x7f9cb410e480 2024-09-19T04:13:54.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.680+0000 7f9cb9b17640 1 --2- 172.21.15.7:0/655827395 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9ca00a3240 0x7f9ca00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:54.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.681+0000 7f9cb9b17640 1 --2- 172.21.15.7:0/655827395 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9ca00a3240 0x7f9ca00a5700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009890 tx=0x7f9cb0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:13:54.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.684+0000 7f9caaffd640 1 -- 172.21.15.7:0/655827395 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9cac09c780 con 0x7f9cb410e480 2024-09-19T04:13:54.825 INFO:journalctl@ceph.mds.k.smithi092.stdout:Sep 19 04:13:54 smithi092 podman[64502]: 2024-09-19 04:13:54.469015295 +0000 UTC m=+0.015810647 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:13:54.825 INFO:journalctl@ceph.mds.k.smithi092.stdout:Sep 19 04:13:54 smithi092 podman[64502]: 2024-09-19 04:13:54.596021599 +0000 UTC m=+0.142816948 container create 7a2e05eebdacf95a45c25b9507e1f31077b2b2e029820b6d5aab21f1712f0953 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-k, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-19T04:13:54.825 INFO:journalctl@ceph.mds.k.smithi092.stdout:Sep 19 04:13:54 smithi092 podman[64502]: 2024-09-19 04:13:54.82413234 +0000 UTC m=+0.370927702 container init 7a2e05eebdacf95a45c25b9507e1f31077b2b2e029820b6d5aab21f1712f0953 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-k, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True) 2024-09-19T04:13:54.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.897+0000 7f9cbbd7b640 1 -- 172.21.15.7:0/655827395 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9cb419bac0 con 0x7f9cb410e480 2024-09-19T04:13:54.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.897+0000 7f9caaffd640 1 -- 172.21.15.7:0/655827395 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f9cb419bac0 con 0x7f9cb410e480 2024-09-19T04:13:54.899 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:13:54.899 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":2,"btime":"2024-09-19T04:13:52:284773+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T04:13:54.899 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 2 2024-09-19T04:13:54.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.899+0000 7f9cbbd7b640 1 -- 172.21.15.7:0/655827395 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9ca00a3240 msgr2=0x7f9ca00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:54.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.899+0000 7f9cbbd7b640 1 --2- 172.21.15.7:0/655827395 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9ca00a3240 0x7f9ca00a5700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009890 tx=0x7f9cb0008040 comp rx=0 tx=0).stop 2024-09-19T04:13:54.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.899+0000 7f9cbbd7b640 1 -- 172.21.15.7:0/655827395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cb410e480 msgr2=0x7f9cb419a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:54.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.899+0000 7f9cbbd7b640 1 --2- 172.21.15.7:0/655827395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cb410e480 0x7f9cb419a590 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9cac00dac0 tx=0x7f9cac00df80 comp rx=0 tx=0).stop 2024-09-19T04:13:54.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.900+0000 7f9cbbd7b640 1 -- 172.21.15.7:0/655827395 shutdown_connections 2024-09-19T04:13:54.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.900+0000 7f9cbbd7b640 1 --2- 172.21.15.7:0/655827395 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9ca00a3240 0x7f9ca00a5700 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:54.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.900+0000 7f9cbbd7b640 1 --2- 172.21.15.7:0/655827395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cb410e480 0x7f9cb419a590 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:54.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.900+0000 7f9cbbd7b640 1 --2- 172.21.15.7:0/655827395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9cb4101280 0x7f9cb41a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:54.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.900+0000 7f9cbbd7b640 1 --2- 172.21.15.7:0/655827395 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9cb41008d0 0x7f9cb41a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:54.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.900+0000 7f9cbbd7b640 1 -- 172.21.15.7:0/655827395 >> 172.21.15.7:0/655827395 conn(0x7f9cb40fc7a0 msgr2=0x7f9cb40feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:13:54.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.900+0000 7f9cbbd7b640 1 -- 172.21.15.7:0/655827395 shutdown_connections 2024-09-19T04:13:54.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:54.900+0000 7f9cbbd7b640 1 -- 172.21.15.7:0/655827395 wait complete. 2024-09-19T04:13:55.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:55 smithi092 ceph-mon[34940]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:13:55.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:55 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/655827395' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:13:55.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:55 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:55.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:55 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:55.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:55 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:55.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:55 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:13:55.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:55 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:13:55.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:55 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:55.298 INFO:journalctl@ceph.mds.k.smithi092.stdout:Sep 19 04:13:54 smithi092 podman[64502]: 2024-09-19 04:13:54.827129886 +0000 UTC m=+0.373925244 container start 7a2e05eebdacf95a45c25b9507e1f31077b2b2e029820b6d5aab21f1712f0953 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-k, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T04:13:55.298 INFO:journalctl@ceph.mds.k.smithi092.stdout:Sep 19 04:13:54 smithi092 ceph-mds[64521]: -- 172.21.15.92:0/3701373308 <== mon.2 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a17fdf7860 con 0x55a17fdd5400 2024-09-19T04:13:55.298 INFO:journalctl@ceph.mds.k.smithi092.stdout:Sep 19 04:13:54 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-k[64517]: starting mds.k at 2024-09-19T04:13:55.298 INFO:journalctl@ceph.mds.k.smithi092.stdout:Sep 19 04:13:54 smithi092 bash[64502]: 7a2e05eebdacf95a45c25b9507e1f31077b2b2e029820b6d5aab21f1712f0953 2024-09-19T04:13:55.298 INFO:journalctl@ceph.mds.k.smithi092.stdout:Sep 19 04:13:54 smithi092 systemd[1]: Started Ceph mds.k for 77957c0a-763c-11ef-bceb-c7b262605968. 2024-09-19T04:13:55.345 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:55 smithi007 ceph-mon[31360]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:13:55.345 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:55 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/655827395' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:13:55.345 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:55 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:55.345 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:55 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:55.345 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:55 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:55.346 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:55 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:13:55.346 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:55 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:13:55.346 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:55 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:55.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:55 smithi102 ceph-mon[35446]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:13:55.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:55 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/655827395' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:13:55.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:55 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:55.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:55 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:55.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:55 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:55.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:55 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:13:55.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:55 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:13:55.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:55 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:56.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:56 smithi007 ceph-mon[31360]: Deploying daemon mds.j on smithi007 2024-09-19T04:13:56.197 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:56 smithi007 ceph-mon[31360]: mds.? [v2:172.21.15.92:6832/4006669352,v1:172.21.15.92:6833/4006669352] up:boot 2024-09-19T04:13:56.198 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:56 smithi007 ceph-mon[31360]: fsmap 2 up:standby 2024-09-19T04:13:56.198 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:56 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T04:13:56.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:56 smithi092 ceph-mon[34940]: Deploying daemon mds.j on smithi007 2024-09-19T04:13:56.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:56 smithi092 ceph-mon[34940]: mds.? [v2:172.21.15.92:6832/4006669352,v1:172.21.15.92:6833/4006669352] up:boot 2024-09-19T04:13:56.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:56 smithi092 ceph-mon[34940]: fsmap 2 up:standby 2024-09-19T04:13:56.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:56 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T04:13:56.310 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:56 smithi102 ceph-mon[35446]: Deploying daemon mds.j on smithi007 2024-09-19T04:13:56.310 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:56 smithi102 ceph-mon[35446]: mds.? [v2:172.21.15.92:6832/4006669352,v1:172.21.15.92:6833/4006669352] up:boot 2024-09-19T04:13:56.310 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:56 smithi102 ceph-mon[35446]: fsmap 2 up:standby 2024-09-19T04:13:56.310 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:56 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T04:13:57.259 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:57 smithi092 ceph-mon[34940]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:13:57.268 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:57 smithi007 ceph-mon[31360]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:13:57.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:57 smithi102 ceph-mon[35446]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:13:57.627 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 04:13:57 smithi007 systemd[1]: Starting Ceph mds.j for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:13:57.656 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:13:57.942 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 04:13:57 smithi007 podman[70096]: 2024-09-19 04:13:57.577753426 +0000 UTC m=+0.016233619 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:13:57.943 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 04:13:57 smithi007 podman[70096]: 2024-09-19 04:13:57.705166582 +0000 UTC m=+0.143646758 container create 2a0eb7a3a0489a9e6a592b17e295979c73441be24015039625987db353b01e66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-j, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:13:57.943 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 04:13:57 smithi007 podman[70096]: 2024-09-19 04:13:57.942010177 +0000 UTC m=+0.380490375 container init 2a0eb7a3a0489a9e6a592b17e295979c73441be24015039625987db353b01e66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-j, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T04:13:58.151 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:13:58.274 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 04:13:57 smithi007 podman[70096]: 2024-09-19 04:13:57.945237479 +0000 UTC m=+0.383717666 container start 2a0eb7a3a0489a9e6a592b17e295979c73441be24015039625987db353b01e66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-j, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T04:13:58.274 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 04:13:57 smithi007 ceph-mds[70146]: -- 172.21.15.7:0/3121555136 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cae982f860 con 0x55cae980d000 2024-09-19T04:13:58.275 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 04:13:57 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-j[70129]: starting mds.j at 2024-09-19T04:13:58.275 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 04:13:58 smithi007 bash[70096]: 2a0eb7a3a0489a9e6a592b17e295979c73441be24015039625987db353b01e66 2024-09-19T04:13:58.275 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 04:13:58 smithi007 systemd[1]: Started Ceph mds.j for 77957c0a-763c-11ef-bceb-c7b262605968. 2024-09-19T04:13:58.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.636+0000 7ffbf9073640 1 -- 172.21.15.7:0/2730788106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbf4106a80 msgr2=0x7ffbf4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:58.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.636+0000 7ffbf9073640 1 --2- 172.21.15.7:0/2730788106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbf4106a80 0x7ffbf4106e60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4009930 tx=0x7ffbe402a420 comp rx=0 tx=0).stop 2024-09-19T04:13:58.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.637+0000 7ffbf9073640 1 -- 172.21.15.7:0/2730788106 shutdown_connections 2024-09-19T04:13:58.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.637+0000 7ffbf9073640 1 --2- 172.21.15.7:0/2730788106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbf4101420 0x7ffbf410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:58.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.637+0000 7ffbf9073640 1 --2- 172.21.15.7:0/2730788106 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbf4100a80 0x7ffbf4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:58.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.637+0000 7ffbf9073640 1 --2- 172.21.15.7:0/2730788106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbf4106a80 0x7ffbf4106e60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:58.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.637+0000 7ffbf9073640 1 -- 172.21.15.7:0/2730788106 >> 172.21.15.7:0/2730788106 conn(0x7ffbf40fc7a0 msgr2=0x7ffbf40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:13:58.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.637+0000 7ffbf9073640 1 -- 172.21.15.7:0/2730788106 shutdown_connections 2024-09-19T04:13:58.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.637+0000 7ffbf9073640 1 -- 172.21.15.7:0/2730788106 wait complete. 2024-09-19T04:13:58.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.637+0000 7ffbf9073640 1 Processor -- start 2024-09-19T04:13:58.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.638+0000 7ffbf9073640 1 -- start start 2024-09-19T04:13:58.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.638+0000 7ffbf9073640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbf4100a80 0x7ffbf4198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:58.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.638+0000 7ffbf9073640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbf4101420 0x7ffbf41989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:58.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.638+0000 7ffbf9073640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbf4106a80 0x7ffbf419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:58.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.638+0000 7ffbf9073640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf4110e80 con 0x7ffbf4100a80 2024-09-19T04:13:58.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.638+0000 7ffbf9073640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf4110d00 con 0x7ffbf4106a80 2024-09-19T04:13:58.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.638+0000 7ffbf9073640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf4111000 con 0x7ffbf4101420 2024-09-19T04:13:58.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.638+0000 7ffbf2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbf4100a80 0x7ffbf4198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:58.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.638+0000 7ffbf2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbf4100a80 0x7ffbf4198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58640/0 (socket says 172.21.15.7:58640) 2024-09-19T04:13:58.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.638+0000 7ffbf2d9d640 1 -- 172.21.15.7:0/2939552943 learned_addr learned my addr 172.21.15.7:0/2939552943 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:13:58.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.638+0000 7ffbf359e640 1 --2- 172.21.15.7:0/2939552943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbf4106a80 0x7ffbf419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:58.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.638+0000 7ffbf259c640 1 --2- 172.21.15.7:0/2939552943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbf4101420 0x7ffbf41989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:58.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.638+0000 7ffbf2d9d640 1 -- 172.21.15.7:0/2939552943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbf4101420 msgr2=0x7ffbf41989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:58.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.638+0000 7ffbf2d9d640 1 --2- 172.21.15.7:0/2939552943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbf4101420 0x7ffbf41989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:58.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.638+0000 7ffbf2d9d640 1 -- 172.21.15.7:0/2939552943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbf4106a80 msgr2=0x7ffbf419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:58.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.638+0000 7ffbf2d9d640 1 --2- 172.21.15.7:0/2939552943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbf4106a80 0x7ffbf419cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:58.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.638+0000 7ffbf2d9d640 1 -- 172.21.15.7:0/2939552943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbf419d410 con 0x7ffbf4100a80 2024-09-19T04:13:58.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.638+0000 7ffbf259c640 1 --2- 172.21.15.7:0/2939552943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbf4101420 0x7ffbf41989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:13:58.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.638+0000 7ffbf2d9d640 1 --2- 172.21.15.7:0/2939552943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbf4100a80 0x7ffbf4198460 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4009230 tx=0x7ffbe4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:13:58.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.639+0000 7ffbdbfff640 1 -- 172.21.15.7:0/2939552943 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe403f030 con 0x7ffbf4100a80 2024-09-19T04:13:58.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.639+0000 7ffbf9073640 1 -- 172.21.15.7:0/2939552943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbf419d6a0 con 0x7ffbf4100a80 2024-09-19T04:13:58.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.639+0000 7ffbdbfff640 1 -- 172.21.15.7:0/2939552943 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbe4003ad0 con 0x7ffbf4100a80 2024-09-19T04:13:58.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.639+0000 7ffbf9073640 1 -- 172.21.15.7:0/2939552943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbf41a4fe0 con 0x7ffbf4100a80 2024-09-19T04:13:58.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.639+0000 7ffbdbfff640 1 -- 172.21.15.7:0/2939552943 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe4035070 con 0x7ffbf4100a80 2024-09-19T04:13:58.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.640+0000 7ffbf9073640 1 -- 172.21.15.7:0/2939552943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbf4100ee0 con 0x7ffbf4100a80 2024-09-19T04:13:58.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.641+0000 7ffbdbfff640 1 -- 172.21.15.7:0/2939552943 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7ffbe4042030 con 0x7ffbf4100a80 2024-09-19T04:13:58.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.642+0000 7ffbdbfff640 1 --2- 172.21.15.7:0/2939552943 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffbdc0a3240 0x7ffbdc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:13:58.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.642+0000 7ffbf259c640 1 --2- 172.21.15.7:0/2939552943 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffbdc0a3240 0x7ffbdc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:13:58.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.642+0000 7ffbdbfff640 1 -- 172.21.15.7:0/2939552943 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7ffbe40ef960 con 0x7ffbf4100a80 2024-09-19T04:13:58.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.642+0000 7ffbf259c640 1 --2- 172.21.15.7:0/2939552943 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffbdc0a3240 0x7ffbdc0a5700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ffbe80058c0 tx=0x7ffbe8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:13:58.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.646+0000 7ffbdbfff640 1 -- 172.21.15.7:0/2939552943 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffbe40bca80 con 0x7ffbf4100a80 2024-09-19T04:13:58.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.864+0000 7ffbf9073640 1 -- 172.21.15.7:0/2939552943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffbf41997c0 con 0x7ffbf4100a80 2024-09-19T04:13:58.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.865+0000 7ffbdbfff640 1 -- 172.21.15.7:0/2939552943 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3085 (secure 0 0 0) 0x7ffbe40bc380 con 0x7ffbf4100a80 2024-09-19T04:13:58.866 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:13:58.867 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":4,"btime":"2024-09-19T04:13:58:040997+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-19T04:13:58.867 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 4 2024-09-19T04:13:58.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.867+0000 7ffbf9073640 1 -- 172.21.15.7:0/2939552943 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffbdc0a3240 msgr2=0x7ffbdc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:58.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.867+0000 7ffbf9073640 1 --2- 172.21.15.7:0/2939552943 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffbdc0a3240 0x7ffbdc0a5700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ffbe80058c0 tx=0x7ffbe8005850 comp rx=0 tx=0).stop 2024-09-19T04:13:58.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.867+0000 7ffbf9073640 1 -- 172.21.15.7:0/2939552943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbf4100a80 msgr2=0x7ffbf4198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:13:58.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.867+0000 7ffbf9073640 1 --2- 172.21.15.7:0/2939552943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbf4100a80 0x7ffbf4198460 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4009230 tx=0x7ffbe4004270 comp rx=0 tx=0).stop 2024-09-19T04:13:58.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.867+0000 7ffbf9073640 1 -- 172.21.15.7:0/2939552943 shutdown_connections 2024-09-19T04:13:58.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.867+0000 7ffbf9073640 1 --2- 172.21.15.7:0/2939552943 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffbdc0a3240 0x7ffbdc0a5700 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:58.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.867+0000 7ffbf9073640 1 --2- 172.21.15.7:0/2939552943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbf4106a80 0x7ffbf419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:58.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.867+0000 7ffbf9073640 1 --2- 172.21.15.7:0/2939552943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbf4101420 0x7ffbf41989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:58.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.867+0000 7ffbf9073640 1 --2- 172.21.15.7:0/2939552943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbf4100a80 0x7ffbf4198460 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:13:58.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.867+0000 7ffbf9073640 1 -- 172.21.15.7:0/2939552943 >> 172.21.15.7:0/2939552943 conn(0x7ffbf40fc7a0 msgr2=0x7ffbf406aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:13:58.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.867+0000 7ffbf9073640 1 -- 172.21.15.7:0/2939552943 shutdown_connections 2024-09-19T04:13:58.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:13:58.867+0000 7ffbf9073640 1 -- 172.21.15.7:0/2939552943 wait complete. 2024-09-19T04:13:59.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:59 smithi007 ceph-mon[31360]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:13:59.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:59 smithi007 ceph-mon[31360]: mds.? [v2:172.21.15.7:6834/2094187873,v1:172.21.15.7:6835/2094187873] up:boot 2024-09-19T04:13:59.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:59 smithi007 ceph-mon[31360]: fsmap 3 up:standby 2024-09-19T04:13:59.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:59 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T04:13:59.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:59 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:59.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:59 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:59.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:59 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:59.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:59 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:13:59.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:59 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:13:59.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:59 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:59.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:13:59 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2939552943' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:13:59.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:59 smithi102 ceph-mon[35446]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:13:59.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:59 smithi102 ceph-mon[35446]: mds.? [v2:172.21.15.7:6834/2094187873,v1:172.21.15.7:6835/2094187873] up:boot 2024-09-19T04:13:59.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:59 smithi102 ceph-mon[35446]: fsmap 3 up:standby 2024-09-19T04:13:59.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:59 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T04:13:59.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:59 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:59.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:59 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:59.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:59 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:59.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:59 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:13:59.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:59 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:13:59.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:59 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:59.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:13:59 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2939552943' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:13:59.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:59 smithi092 ceph-mon[34940]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:13:59.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:59 smithi092 ceph-mon[34940]: mds.? [v2:172.21.15.7:6834/2094187873,v1:172.21.15.7:6835/2094187873] up:boot 2024-09-19T04:13:59.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:59 smithi092 ceph-mon[34940]: fsmap 3 up:standby 2024-09-19T04:13:59.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:59 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T04:13:59.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:59 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:59.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:59 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:59.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:59 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:13:59.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:59 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:13:59.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:59 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:13:59.548 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:59 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:13:59.548 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:13:59 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2939552943' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:14:00.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:00 smithi007 ceph-mon[31360]: Deploying daemon mds.d on smithi007 2024-09-19T04:14:00.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:00 smithi102 ceph-mon[35446]: Deploying daemon mds.d on smithi007 2024-09-19T04:14:00.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:00 smithi092 ceph-mon[34940]: Deploying daemon mds.d on smithi007 2024-09-19T04:14:01.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:01 smithi007 ceph-mon[31360]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:01.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:01 smithi102 ceph-mon[35446]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:01.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:01 smithi092 ceph-mon[34940]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:01.727 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:14:01.986 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:14:02.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.464+0000 7f443e95c640 1 -- 172.21.15.7:0/2810705035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4438102de0 msgr2=0x7f44381031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:02.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.464+0000 7f443e95c640 1 --2- 172.21.15.7:0/2810705035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4438102de0 0x7f44381031c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4428009900 tx=0x7f442802a480 comp rx=0 tx=0).stop 2024-09-19T04:14:02.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.464+0000 7f443e95c640 1 -- 172.21.15.7:0/2810705035 shutdown_connections 2024-09-19T04:14:02.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.464+0000 7f443e95c640 1 --2- 172.21.15.7:0/2810705035 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f443810c180 0x7f443810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:02.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.464+0000 7f443e95c640 1 --2- 172.21.15.7:0/2810705035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4438103700 0x7f443810bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:02.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.464+0000 7f443e95c640 1 --2- 172.21.15.7:0/2810705035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4438102de0 0x7f44381031c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:02.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.464+0000 7f443e95c640 1 -- 172.21.15.7:0/2810705035 >> 172.21.15.7:0/2810705035 conn(0x7f44380fc7a0 msgr2=0x7f44380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:02.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.464+0000 7f443e95c640 1 -- 172.21.15.7:0/2810705035 shutdown_connections 2024-09-19T04:14:02.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.464+0000 7f443e95c640 1 -- 172.21.15.7:0/2810705035 wait complete. 2024-09-19T04:14:02.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.465+0000 7f443e95c640 1 Processor -- start 2024-09-19T04:14:02.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.465+0000 7f443e95c640 1 -- start start 2024-09-19T04:14:02.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.465+0000 7f443e95c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4438102de0 0x7f4438198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:02.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.466+0000 7f443e95c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4438103700 0x7f4438198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:02.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.466+0000 7f443e95c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f443810c180 0x7f443819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:02.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.466+0000 7f443e95c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4438111f70 con 0x7f4438103700 2024-09-19T04:14:02.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.466+0000 7f443e95c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4438111df0 con 0x7f4438102de0 2024-09-19T04:14:02.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.466+0000 7f443e95c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f44381120f0 con 0x7f443810c180 2024-09-19T04:14:02.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.466+0000 7f44377fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4438103700 0x7f4438198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:02.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.466+0000 7f44377fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4438103700 0x7f4438198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58670/0 (socket says 172.21.15.7:58670) 2024-09-19T04:14:02.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.466+0000 7f44377fe640 1 -- 172.21.15.7:0/4268988407 learned_addr learned my addr 172.21.15.7:0/4268988407 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:14:02.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.466+0000 7f443cef9640 1 --2- 172.21.15.7:0/4268988407 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f443810c180 0x7f443819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:02.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.466+0000 7f4437fff640 1 --2- 172.21.15.7:0/4268988407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4438102de0 0x7f4438198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:02.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.466+0000 7f44377fe640 1 -- 172.21.15.7:0/4268988407 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f443810c180 msgr2=0x7f443819cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:02.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.466+0000 7f44377fe640 1 --2- 172.21.15.7:0/4268988407 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f443810c180 0x7f443819cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:02.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.466+0000 7f44377fe640 1 -- 172.21.15.7:0/4268988407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4438102de0 msgr2=0x7f4438198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:02.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.466+0000 7f44377fe640 1 --2- 172.21.15.7:0/4268988407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4438102de0 0x7f4438198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:02.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.466+0000 7f44377fe640 1 -- 172.21.15.7:0/4268988407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f443819d3e0 con 0x7f4438103700 2024-09-19T04:14:02.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.466+0000 7f44377fe640 1 --2- 172.21.15.7:0/4268988407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4438103700 0x7f4438198970 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f442c00e9f0 tx=0x7f442c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:02.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.466+0000 7f44357fa640 1 -- 172.21.15.7:0/4268988407 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442c00cd80 con 0x7f4438103700 2024-09-19T04:14:02.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.466+0000 7f44357fa640 1 -- 172.21.15.7:0/4268988407 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f442c010910 con 0x7f4438103700 2024-09-19T04:14:02.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.467+0000 7f44357fa640 1 -- 172.21.15.7:0/4268988407 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442c018990 con 0x7f4438103700 2024-09-19T04:14:02.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.467+0000 7f443e95c640 1 -- 172.21.15.7:0/4268988407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f443819d6d0 con 0x7f4438103700 2024-09-19T04:14:02.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.467+0000 7f443e95c640 1 -- 172.21.15.7:0/4268988407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44381a4fb0 con 0x7f4438103700 2024-09-19T04:14:02.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.468+0000 7f443e95c640 1 -- 172.21.15.7:0/4268988407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44381031c0 con 0x7f4438103700 2024-09-19T04:14:02.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.469+0000 7f44357fa640 1 -- 172.21.15.7:0/4268988407 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f442c010ac0 con 0x7f4438103700 2024-09-19T04:14:02.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.469+0000 7f44357fa640 1 --2- 172.21.15.7:0/4268988407 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f44200a32c0 0x7f44200a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:02.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.469+0000 7f4437fff640 1 --2- 172.21.15.7:0/4268988407 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f44200a32c0 0x7f44200a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:02.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.470+0000 7f44357fa640 1 -- 172.21.15.7:0/4268988407 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f442c0cf6e0 con 0x7f4438103700 2024-09-19T04:14:02.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.470+0000 7f4437fff640 1 --2- 172.21.15.7:0/4268988407 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f44200a32c0 0x7f44200a5780 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4428009230 tx=0x7f44280058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:02.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.474+0000 7f44357fa640 1 -- 172.21.15.7:0/4268988407 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f442c09c250 con 0x7f4438103700 2024-09-19T04:14:02.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.686+0000 7f443e95c640 1 -- 172.21.15.7:0/4268988407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44381a5210 con 0x7f4438103700 2024-09-19T04:14:02.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.688+0000 7f44357fa640 1 -- 172.21.15.7:0/4268988407 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3907 (secure 0 0 0) 0x7f442c0a0550 con 0x7f4438103700 2024-09-19T04:14:02.690 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:14:02.690 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":5,"btime":"2024-09-19T04:14:02:055892+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-19T04:14:02.690 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 5 2024-09-19T04:14:02.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.690+0000 7f443e95c640 1 -- 172.21.15.7:0/4268988407 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f44200a32c0 msgr2=0x7f44200a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:02.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.690+0000 7f443e95c640 1 --2- 172.21.15.7:0/4268988407 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f44200a32c0 0x7f44200a5780 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4428009230 tx=0x7f44280058d0 comp rx=0 tx=0).stop 2024-09-19T04:14:02.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.690+0000 7f443e95c640 1 -- 172.21.15.7:0/4268988407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4438103700 msgr2=0x7f4438198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:02.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.690+0000 7f443e95c640 1 --2- 172.21.15.7:0/4268988407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4438103700 0x7f4438198970 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f442c00e9f0 tx=0x7f442c00eeb0 comp rx=0 tx=0).stop 2024-09-19T04:14:02.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.690+0000 7f443e95c640 1 -- 172.21.15.7:0/4268988407 shutdown_connections 2024-09-19T04:14:02.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.690+0000 7f443e95c640 1 --2- 172.21.15.7:0/4268988407 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f44200a32c0 0x7f44200a5780 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:02.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.690+0000 7f443e95c640 1 --2- 172.21.15.7:0/4268988407 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f443810c180 0x7f443819cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:02.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.690+0000 7f443e95c640 1 --2- 172.21.15.7:0/4268988407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4438103700 0x7f4438198970 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:02.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.690+0000 7f443e95c640 1 --2- 172.21.15.7:0/4268988407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4438102de0 0x7f4438198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:02.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.690+0000 7f443e95c640 1 -- 172.21.15.7:0/4268988407 >> 172.21.15.7:0/4268988407 conn(0x7f44380fc7a0 msgr2=0x7f44380fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:02.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.690+0000 7f443e95c640 1 -- 172.21.15.7:0/4268988407 shutdown_connections 2024-09-19T04:14:02.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:02.690+0000 7f443e95c640 1 -- 172.21.15.7:0/4268988407 wait complete. 2024-09-19T04:14:02.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:02 smithi092 ceph-mon[34940]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:02.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:02 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:02.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:02 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:02.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:02 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:02.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:02 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:14:02.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:02 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:14:02.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:02 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:02.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:02 smithi092 ceph-mon[34940]: Deploying daemon mds.e on smithi092 2024-09-19T04:14:02.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:02 smithi092 ceph-mon[34940]: mds.? [v2:172.21.15.7:6836/1197784412,v1:172.21.15.7:6837/1197784412] up:boot 2024-09-19T04:14:02.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:02 smithi092 ceph-mon[34940]: fsmap 4 up:standby 2024-09-19T04:14:02.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:02 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T04:14:03.002 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:02 smithi007 ceph-mon[31360]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:03.002 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:02 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:03.002 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:02 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:03.002 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:02 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:03.003 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:02 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:14:03.003 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:02 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:14:03.003 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:02 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:03.003 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:02 smithi007 ceph-mon[31360]: Deploying daemon mds.e on smithi092 2024-09-19T04:14:03.003 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:02 smithi007 ceph-mon[31360]: mds.? [v2:172.21.15.7:6836/1197784412,v1:172.21.15.7:6837/1197784412] up:boot 2024-09-19T04:14:03.003 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:02 smithi007 ceph-mon[31360]: fsmap 4 up:standby 2024-09-19T04:14:03.003 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:02 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T04:14:03.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:02 smithi102 ceph-mon[35446]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:03.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:02 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:03.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:02 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:03.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:02 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:03.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:02 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:14:03.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:02 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:14:03.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:02 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:03.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:02 smithi102 ceph-mon[35446]: Deploying daemon mds.e on smithi092 2024-09-19T04:14:03.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:02 smithi102 ceph-mon[35446]: mds.? [v2:172.21.15.7:6836/1197784412,v1:172.21.15.7:6837/1197784412] up:boot 2024-09-19T04:14:03.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:02 smithi102 ceph-mon[35446]: fsmap 4 up:standby 2024-09-19T04:14:03.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:02 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T04:14:03.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:03 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/4268988407' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:14:03.957 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:03 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/4268988407' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:14:03.957 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:14:03 smithi092 systemd[1]: Starting Ceph mds.e for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:14:04.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:03 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/4268988407' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:14:04.221 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:14:03 smithi092 podman[64817]: 2024-09-19 04:14:03.858487319 +0000 UTC m=+0.015956556 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:14:04.221 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:14:03 smithi092 podman[64817]: 2024-09-19 04:14:03.967688821 +0000 UTC m=+0.125158100 container create 0a8e9ccc06fa876c5e6da6d5a9418b0e77ff7b1a4252b19feab6ccc44a78a816 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-e, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-19T04:14:04.221 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:14:04 smithi092 podman[64817]: 2024-09-19 04:14:04.220410032 +0000 UTC m=+0.377879268 container init 0a8e9ccc06fa876c5e6da6d5a9418b0e77ff7b1a4252b19feab6ccc44a78a816 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-e, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T04:14:04.547 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:14:04 smithi092 podman[64817]: 2024-09-19 04:14:04.223138999 +0000 UTC m=+0.380608244 container start 0a8e9ccc06fa876c5e6da6d5a9418b0e77ff7b1a4252b19feab6ccc44a78a816 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T04:14:04.547 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:14:04 smithi092 ceph-mds[64836]: -- 172.21.15.92:0/3068986169 <== mon.2 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562e25c29860 con 0x562e25c07400 2024-09-19T04:14:04.547 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:14:04 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-e[64832]: starting mds.e at 2024-09-19T04:14:04.547 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:14:04 smithi092 bash[64817]: 0a8e9ccc06fa876c5e6da6d5a9418b0e77ff7b1a4252b19feab6ccc44a78a816 2024-09-19T04:14:04.547 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:14:04 smithi092 systemd[1]: Started Ceph mds.e for 77957c0a-763c-11ef-bceb-c7b262605968. 2024-09-19T04:14:05.017 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:04 smithi102 ceph-mon[35446]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:05.017 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:04 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:05.017 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:04 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:05.017 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:04 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:05.017 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:04 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:14:05.017 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:04 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:14:05.017 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:04 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:05.046 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:04 smithi092 ceph-mon[34940]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:05.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:04 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:05.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:04 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:05.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:04 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:05.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:04 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:14:05.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:04 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:14:05.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:04 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:05.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:04 smithi007 ceph-mon[31360]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:05.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:04 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:05.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:04 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:05.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:04 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:05.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:04 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:14:05.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:04 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:14:05.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:04 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:05.477 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:14:05.752 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:14:05.874 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:05 smithi007 ceph-mon[31360]: Deploying daemon mds.f on smithi102 2024-09-19T04:14:05.874 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:05 smithi007 ceph-mon[31360]: mds.? [v2:172.21.15.92:6834/4235013488,v1:172.21.15.92:6835/4235013488] up:boot 2024-09-19T04:14:05.874 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:05 smithi007 ceph-mon[31360]: fsmap 5 up:standby 2024-09-19T04:14:05.874 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:05 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T04:14:06.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:05 smithi092 ceph-mon[34940]: Deploying daemon mds.f on smithi102 2024-09-19T04:14:06.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:05 smithi092 ceph-mon[34940]: mds.? [v2:172.21.15.92:6834/4235013488,v1:172.21.15.92:6835/4235013488] up:boot 2024-09-19T04:14:06.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:05 smithi092 ceph-mon[34940]: fsmap 5 up:standby 2024-09-19T04:14:06.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:05 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T04:14:06.059 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:05 smithi102 ceph-mon[35446]: Deploying daemon mds.f on smithi102 2024-09-19T04:14:06.059 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:05 smithi102 ceph-mon[35446]: mds.? [v2:172.21.15.92:6834/4235013488,v1:172.21.15.92:6835/4235013488] up:boot 2024-09-19T04:14:06.059 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:05 smithi102 ceph-mon[35446]: fsmap 5 up:standby 2024-09-19T04:14:06.059 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:05 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T04:14:06.358 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 19 04:14:06 smithi102 systemd[1]: Starting Ceph mds.f for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:14:06.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.367+0000 7f60e024d640 1 -- 172.21.15.7:0/1210587801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60d8102570 msgr2=0x7f60d81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:06.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.367+0000 7f60e024d640 1 --2- 172.21.15.7:0/1210587801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60d8102570 0x7f60d81029b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f60c8009900 tx=0x7f60c802a480 comp rx=0 tx=0).stop 2024-09-19T04:14:06.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.367+0000 7f60e024d640 1 -- 172.21.15.7:0/1210587801 shutdown_connections 2024-09-19T04:14:06.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.367+0000 7f60e024d640 1 --2- 172.21.15.7:0/1210587801 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60d8102ef0 0x7f60d810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:06.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.367+0000 7f60e024d640 1 --2- 172.21.15.7:0/1210587801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60d8102570 0x7f60d81029b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:06.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.367+0000 7f60e024d640 1 --2- 172.21.15.7:0/1210587801 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60d8100e20 0x7f60d8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:06.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.367+0000 7f60e024d640 1 -- 172.21.15.7:0/1210587801 >> 172.21.15.7:0/1210587801 conn(0x7f60d80fc7d0 msgr2=0x7f60d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:06.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.367+0000 7f60e024d640 1 -- 172.21.15.7:0/1210587801 shutdown_connections 2024-09-19T04:14:06.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.367+0000 7f60e024d640 1 -- 172.21.15.7:0/1210587801 wait complete. 2024-09-19T04:14:06.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.368+0000 7f60e024d640 1 Processor -- start 2024-09-19T04:14:06.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.368+0000 7f60e024d640 1 -- start start 2024-09-19T04:14:06.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.368+0000 7f60e024d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60d8100e20 0x7f60d8198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:06.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.368+0000 7f60e024d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60d8102570 0x7f60d8198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:06.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.368+0000 7f60e024d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60d8102ef0 0x7f60d819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:06.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.368+0000 7f60e024d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f60d8110f80 con 0x7f60d8102ef0 2024-09-19T04:14:06.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.368+0000 7f60e024d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f60d8110e00 con 0x7f60d8102570 2024-09-19T04:14:06.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.368+0000 7f60e024d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f60d8111100 con 0x7f60d8100e20 2024-09-19T04:14:06.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.368+0000 7f60de7ea640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60d8102ef0 0x7f60d819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:06.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.368+0000 7f60de7ea640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60d8102ef0 0x7f60d819cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58686/0 (socket says 172.21.15.7:58686) 2024-09-19T04:14:06.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.368+0000 7f60de7ea640 1 -- 172.21.15.7:0/1405038872 learned_addr learned my addr 172.21.15.7:0/1405038872 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:14:06.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.368+0000 7f60ddfe9640 1 --2- 172.21.15.7:0/1405038872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60d8100e20 0x7f60d8198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:06.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.369+0000 7f60dd7e8640 1 --2- 172.21.15.7:0/1405038872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60d8102570 0x7f60d8198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:06.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.369+0000 7f60de7ea640 1 -- 172.21.15.7:0/1405038872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60d8100e20 msgr2=0x7f60d8198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:06.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.369+0000 7f60de7ea640 1 --2- 172.21.15.7:0/1405038872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60d8100e20 0x7f60d8198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:06.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.369+0000 7f60de7ea640 1 -- 172.21.15.7:0/1405038872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60d8102570 msgr2=0x7f60d8198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:06.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.369+0000 7f60de7ea640 1 --2- 172.21.15.7:0/1405038872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60d8102570 0x7f60d8198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:06.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.369+0000 7f60de7ea640 1 -- 172.21.15.7:0/1405038872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60d819d400 con 0x7f60d8102ef0 2024-09-19T04:14:06.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.369+0000 7f60dd7e8640 1 --2- 172.21.15.7:0/1405038872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60d8102570 0x7f60d8198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:14:06.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.369+0000 7f60de7ea640 1 --2- 172.21.15.7:0/1405038872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60d8102ef0 0x7f60d819cd20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f60d000cce0 tx=0x7f60d000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:06.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.369+0000 7f60ceffd640 1 -- 172.21.15.7:0/1405038872 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d000f450 con 0x7f60d8102ef0 2024-09-19T04:14:06.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.369+0000 7f60ceffd640 1 -- 172.21.15.7:0/1405038872 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60d000fad0 con 0x7f60d8102ef0 2024-09-19T04:14:06.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.369+0000 7f60e024d640 1 -- 172.21.15.7:0/1405038872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60d819d6f0 con 0x7f60d8102ef0 2024-09-19T04:14:06.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.369+0000 7f60ceffd640 1 -- 172.21.15.7:0/1405038872 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d0018c10 con 0x7f60d8102ef0 2024-09-19T04:14:06.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.369+0000 7f60e024d640 1 -- 172.21.15.7:0/1405038872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60d81a4fd0 con 0x7f60d8102ef0 2024-09-19T04:14:06.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.370+0000 7f60e024d640 1 -- 172.21.15.7:0/1405038872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60d8101200 con 0x7f60d8102ef0 2024-09-19T04:14:06.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.371+0000 7f60ceffd640 1 -- 172.21.15.7:0/1405038872 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f60d000f5f0 con 0x7f60d8102ef0 2024-09-19T04:14:06.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.372+0000 7f60ceffd640 1 --2- 172.21.15.7:0/1405038872 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f60c40a32c0 0x7f60c40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:06.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.372+0000 7f60ceffd640 1 -- 172.21.15.7:0/1405038872 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f60d00cfac0 con 0x7f60d8102ef0 2024-09-19T04:14:06.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.372+0000 7f60ddfe9640 1 --2- 172.21.15.7:0/1405038872 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f60c40a32c0 0x7f60c40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:06.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.372+0000 7f60ddfe9640 1 --2- 172.21.15.7:0/1405038872 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f60c40a32c0 0x7f60c40a5780 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f60d4009bd0 tx=0x7f60d4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:06.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.376+0000 7f60ceffd640 1 -- 172.21.15.7:0/1405038872 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f60d0014030 con 0x7f60d8102ef0 2024-09-19T04:14:06.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.589+0000 7f60e024d640 1 -- 172.21.15.7:0/1405038872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60d810a0a0 con 0x7f60d8102ef0 2024-09-19T04:14:06.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.590+0000 7f60ceffd640 1 -- 172.21.15.7:0/1405038872 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4732 (secure 0 0 0) 0x7f60d009cc80 con 0x7f60d8102ef0 2024-09-19T04:14:06.591 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:14:06.592 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":6,"btime":"2024-09-19T04:14:04:689643+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-19T04:14:06.592 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 6 2024-09-19T04:14:06.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.593+0000 7f60e024d640 1 -- 172.21.15.7:0/1405038872 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f60c40a32c0 msgr2=0x7f60c40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:06.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.593+0000 7f60e024d640 1 --2- 172.21.15.7:0/1405038872 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f60c40a32c0 0x7f60c40a5780 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f60d4009bd0 tx=0x7f60d4005f90 comp rx=0 tx=0).stop 2024-09-19T04:14:06.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.593+0000 7f60e024d640 1 -- 172.21.15.7:0/1405038872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60d8102ef0 msgr2=0x7f60d819cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:06.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.593+0000 7f60e024d640 1 --2- 172.21.15.7:0/1405038872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60d8102ef0 0x7f60d819cd20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f60d000cce0 tx=0x7f60d000a620 comp rx=0 tx=0).stop 2024-09-19T04:14:06.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.594+0000 7f60e024d640 1 -- 172.21.15.7:0/1405038872 shutdown_connections 2024-09-19T04:14:06.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.594+0000 7f60e024d640 1 --2- 172.21.15.7:0/1405038872 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f60c40a32c0 0x7f60c40a5780 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:06.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.594+0000 7f60e024d640 1 --2- 172.21.15.7:0/1405038872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60d8102ef0 0x7f60d819cd20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:06.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.594+0000 7f60e024d640 1 --2- 172.21.15.7:0/1405038872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60d8102570 0x7f60d8198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:06.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.594+0000 7f60e024d640 1 --2- 172.21.15.7:0/1405038872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60d8100e20 0x7f60d8198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:06.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.594+0000 7f60e024d640 1 -- 172.21.15.7:0/1405038872 >> 172.21.15.7:0/1405038872 conn(0x7f60d80fc7d0 msgr2=0x7f60d806a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:06.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.594+0000 7f60e024d640 1 -- 172.21.15.7:0/1405038872 shutdown_connections 2024-09-19T04:14:06.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:06.594+0000 7f60e024d640 1 -- 172.21.15.7:0/1405038872 wait complete. 2024-09-19T04:14:06.615 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 19 04:14:06 smithi102 podman[65152]: 2024-09-19 04:14:06.361321851 +0000 UTC m=+0.024339238 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:14:06.615 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 19 04:14:06 smithi102 podman[65152]: 2024-09-19 04:14:06.473853036 +0000 UTC m=+0.136870459 container create 4823c4ef13509da468c903755e28b8f933b4c9e21dad85b97ddee036e237b891 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T04:14:06.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:06 smithi007 ceph-mon[31360]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:06.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:06 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1405038872' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:14:07.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:06 smithi092 ceph-mon[34940]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:07.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:06 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1405038872' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:14:07.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:06 smithi102 ceph-mon[35446]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:07.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:06 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1405038872' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:14:07.159 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 19 04:14:06 smithi102 podman[65152]: 2024-09-19 04:14:06.73515272 +0000 UTC m=+0.398170094 container init 4823c4ef13509da468c903755e28b8f933b4c9e21dad85b97ddee036e237b891 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-f, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4) 2024-09-19T04:14:07.159 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 19 04:14:06 smithi102 podman[65152]: 2024-09-19 04:14:06.738097501 +0000 UTC m=+0.401114887 container start 4823c4ef13509da468c903755e28b8f933b4c9e21dad85b97ddee036e237b891 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-f, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T04:14:07.159 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 19 04:14:06 smithi102 ceph-mds[65172]: -- 172.21.15.102:0/3468353230 <== mon.1 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559acbfdf860 con 0x559acbfbd000 2024-09-19T04:14:07.159 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 19 04:14:06 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-f[65168]: starting mds.f at 2024-09-19T04:14:07.159 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 19 04:14:06 smithi102 bash[65152]: 4823c4ef13509da468c903755e28b8f933b4c9e21dad85b97ddee036e237b891 2024-09-19T04:14:07.159 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 19 04:14:06 smithi102 systemd[1]: Started Ceph mds.f for 77957c0a-763c-11ef-bceb-c7b262605968. 2024-09-19T04:14:07.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:07 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:07.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:07 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:07.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:07 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:07.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:07 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:14:07.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:07 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:14:07.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:07 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:07.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:07 smithi102 ceph-mon[35446]: Deploying daemon mds.c on smithi102 2024-09-19T04:14:07.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:07 smithi102 ceph-mon[35446]: mds.? [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] up:boot 2024-09-19T04:14:07.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:07 smithi102 ceph-mon[35446]: fsmap 6 up:standby 2024-09-19T04:14:07.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:07 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T04:14:08.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:07 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:08.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:07 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:08.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:07 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:08.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:07 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:14:08.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:07 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:14:08.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:07 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:08.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:07 smithi092 ceph-mon[34940]: Deploying daemon mds.c on smithi102 2024-09-19T04:14:08.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:07 smithi092 ceph-mon[34940]: mds.? [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] up:boot 2024-09-19T04:14:08.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:07 smithi092 ceph-mon[34940]: fsmap 6 up:standby 2024-09-19T04:14:08.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:07 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T04:14:08.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:07 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:08.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:07 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:08.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:07 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:08.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:07 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:14:08.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:07 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:14:08.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:07 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:08.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:07 smithi007 ceph-mon[31360]: Deploying daemon mds.c on smithi102 2024-09-19T04:14:08.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:07 smithi007 ceph-mon[31360]: mds.? [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] up:boot 2024-09-19T04:14:08.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:07 smithi007 ceph-mon[31360]: fsmap 6 up:standby 2024-09-19T04:14:08.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:07 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T04:14:08.896 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 19 04:14:08 smithi102 systemd[1]: Starting Ceph mds.c for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:14:09.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:08 smithi102 ceph-mon[35446]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:09.159 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 19 04:14:08 smithi102 podman[65452]: 2024-09-19 04:14:08.880680401 +0000 UTC m=+0.015433533 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:14:09.159 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 19 04:14:09 smithi102 podman[65452]: 2024-09-19 04:14:09.005021091 +0000 UTC m=+0.139774288 container create 48f4d11d16470694df7a7f7fa46c2991982408974d0d8a04ecd1f242d0968c45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-c, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T04:14:09.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:08 smithi092 ceph-mon[34940]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:09.302 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:14:09.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:08 smithi007 ceph-mon[31360]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:09.576 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:14:09.659 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 19 04:14:09 smithi102 podman[65452]: 2024-09-19 04:14:09.266183087 +0000 UTC m=+0.400936208 container init 48f4d11d16470694df7a7f7fa46c2991982408974d0d8a04ecd1f242d0968c45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:14:09.659 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 19 04:14:09 smithi102 podman[65452]: 2024-09-19 04:14:09.268996222 +0000 UTC m=+0.403749353 container start 48f4d11d16470694df7a7f7fa46c2991982408974d0d8a04ecd1f242d0968c45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-c, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T04:14:09.659 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 19 04:14:09 smithi102 ceph-mds[65471]: -- 172.21.15.102:0/1842765008 <== mon.1 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a5c7ba9860 con 0x55a5c7b87000 2024-09-19T04:14:09.659 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 19 04:14:09 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-c[65467]: starting mds.c at 2024-09-19T04:14:09.659 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 19 04:14:09 smithi102 bash[65452]: 48f4d11d16470694df7a7f7fa46c2991982408974d0d8a04ecd1f242d0968c45 2024-09-19T04:14:09.659 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 19 04:14:09 smithi102 systemd[1]: Started Ceph mds.c for 77957c0a-763c-11ef-bceb-c7b262605968. 2024-09-19T04:14:10.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.068+0000 7f0f4ca9a640 1 -- 172.21.15.7:0/1086218662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f48100e20 msgr2=0x7f0f48101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:10.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.068+0000 7f0f4ca9a640 1 --2- 172.21.15.7:0/1086218662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f48100e20 0x7f0f48101200 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0f38009900 tx=0x7f0f3802a480 comp rx=0 tx=0).stop 2024-09-19T04:14:10.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.068+0000 7f0f4ca9a640 1 -- 172.21.15.7:0/1086218662 shutdown_connections 2024-09-19T04:14:10.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.068+0000 7f0f4ca9a640 1 --2- 172.21.15.7:0/1086218662 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f48102ef0 0x7f0f4810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:10.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.068+0000 7f0f4ca9a640 1 --2- 172.21.15.7:0/1086218662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f48102570 0x7f0f481029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:10.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.068+0000 7f0f4ca9a640 1 --2- 172.21.15.7:0/1086218662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f48100e20 0x7f0f48101200 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:10.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.068+0000 7f0f4ca9a640 1 -- 172.21.15.7:0/1086218662 >> 172.21.15.7:0/1086218662 conn(0x7f0f480fc7d0 msgr2=0x7f0f480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:10.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.068+0000 7f0f4ca9a640 1 -- 172.21.15.7:0/1086218662 shutdown_connections 2024-09-19T04:14:10.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.068+0000 7f0f4ca9a640 1 -- 172.21.15.7:0/1086218662 wait complete. 2024-09-19T04:14:10.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.068+0000 7f0f4ca9a640 1 Processor -- start 2024-09-19T04:14:10.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.068+0000 7f0f4ca9a640 1 -- start start 2024-09-19T04:14:10.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.069+0000 7f0f4ca9a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f48100e20 0x7f0f4819a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:10.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.069+0000 7f0f4ca9a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f48102570 0x7f0f4819ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:10.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.069+0000 7f0f4ca9a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f48102ef0 0x7f0f4819f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:10.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.069+0000 7f0f4ca9a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0f48110f80 con 0x7f0f48100e20 2024-09-19T04:14:10.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.069+0000 7f0f4ca9a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0f48110e00 con 0x7f0f48102ef0 2024-09-19T04:14:10.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.069+0000 7f0f4ca9a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0f48111100 con 0x7f0f48102570 2024-09-19T04:14:10.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.069+0000 7f0f4659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f48100e20 0x7f0f4819a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:10.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.069+0000 7f0f4659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f48100e20 0x7f0f4819a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41286/0 (socket says 172.21.15.7:41286) 2024-09-19T04:14:10.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.069+0000 7f0f4659c640 1 -- 172.21.15.7:0/2113934935 learned_addr learned my addr 172.21.15.7:0/2113934935 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:14:10.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.069+0000 7f0f3ffff640 1 --2- 172.21.15.7:0/2113934935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f48102570 0x7f0f4819ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:10.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.069+0000 7f0f46d9d640 1 --2- 172.21.15.7:0/2113934935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f48102ef0 0x7f0f4819f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:10.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.069+0000 7f0f4659c640 1 -- 172.21.15.7:0/2113934935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f48102570 msgr2=0x7f0f4819ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:10.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.069+0000 7f0f4659c640 1 --2- 172.21.15.7:0/2113934935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f48102570 0x7f0f4819ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:10.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.069+0000 7f0f4659c640 1 -- 172.21.15.7:0/2113934935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f48102ef0 msgr2=0x7f0f4819f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:10.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.069+0000 7f0f4659c640 1 --2- 172.21.15.7:0/2113934935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f48102ef0 0x7f0f4819f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:10.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.069+0000 7f0f4659c640 1 -- 172.21.15.7:0/2113934935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4819f700 con 0x7f0f48100e20 2024-09-19T04:14:10.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.070+0000 7f0f4659c640 1 --2- 172.21.15.7:0/2113934935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f48100e20 0x7f0f4819a750 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0f38006010 tx=0x7f0f38005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:10.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.070+0000 7f0f3f7fe640 1 -- 172.21.15.7:0/2113934935 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f38035030 con 0x7f0f48100e20 2024-09-19T04:14:10.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.070+0000 7f0f3f7fe640 1 -- 172.21.15.7:0/2113934935 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f38045070 con 0x7f0f48100e20 2024-09-19T04:14:10.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.070+0000 7f0f4ca9a640 1 -- 172.21.15.7:0/2113934935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f4819f990 con 0x7f0f48100e20 2024-09-19T04:14:10.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.070+0000 7f0f3f7fe640 1 -- 172.21.15.7:0/2113934935 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3804a760 con 0x7f0f48100e20 2024-09-19T04:14:10.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.070+0000 7f0f4ca9a640 1 -- 172.21.15.7:0/2113934935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f48107980 con 0x7f0f48100e20 2024-09-19T04:14:10.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.071+0000 7f0f4ca9a640 1 -- 172.21.15.7:0/2113934935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f481021b0 con 0x7f0f48100e20 2024-09-19T04:14:10.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.072+0000 7f0f3f7fe640 1 -- 172.21.15.7:0/2113934935 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f0f38031540 con 0x7f0f48100e20 2024-09-19T04:14:10.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.073+0000 7f0f3f7fe640 1 --2- 172.21.15.7:0/2113934935 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f0f340a32c0 0x7f0f340a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:10.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.073+0000 7f0f3ffff640 1 --2- 172.21.15.7:0/2113934935 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f0f340a32c0 0x7f0f340a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:10.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.073+0000 7f0f3f7fe640 1 -- 172.21.15.7:0/2113934935 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f0f380f8240 con 0x7f0f48100e20 2024-09-19T04:14:10.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.074+0000 7f0f3ffff640 1 --2- 172.21.15.7:0/2113934935 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f0f340a32c0 0x7f0f340a5780 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0f4810de80 tx=0x7f0f3000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:10.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.077+0000 7f0f3f7fe640 1 -- 172.21.15.7:0/2113934935 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0f38041d60 con 0x7f0f48100e20 2024-09-19T04:14:10.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.298+0000 7f0f4ca9a640 1 -- 172.21.15.7:0/2113934935 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f4819bae0 con 0x7f0f48100e20 2024-09-19T04:14:10.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.299+0000 7f0f3f7fe640 1 -- 172.21.15.7:0/2113934935 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6385 (secure 0 0 0) 0x7f0f4819bae0 con 0x7f0f48100e20 2024-09-19T04:14:10.301 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:14:10.301 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":8,"btime":"2024-09-19T04:14:09:895777+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-19T04:14:10.301 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 8 2024-09-19T04:14:10.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.302+0000 7f0f4ca9a640 1 -- 172.21.15.7:0/2113934935 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f0f340a32c0 msgr2=0x7f0f340a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:10.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.302+0000 7f0f4ca9a640 1 --2- 172.21.15.7:0/2113934935 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f0f340a32c0 0x7f0f340a5780 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0f4810de80 tx=0x7f0f3000b390 comp rx=0 tx=0).stop 2024-09-19T04:14:10.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.302+0000 7f0f4ca9a640 1 -- 172.21.15.7:0/2113934935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f48100e20 msgr2=0x7f0f4819a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:10.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.302+0000 7f0f4ca9a640 1 --2- 172.21.15.7:0/2113934935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f48100e20 0x7f0f4819a750 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0f38006010 tx=0x7f0f38005d90 comp rx=0 tx=0).stop 2024-09-19T04:14:10.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.302+0000 7f0f4ca9a640 1 -- 172.21.15.7:0/2113934935 shutdown_connections 2024-09-19T04:14:10.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.302+0000 7f0f4ca9a640 1 --2- 172.21.15.7:0/2113934935 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f0f340a32c0 0x7f0f340a5780 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:10.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.302+0000 7f0f4ca9a640 1 --2- 172.21.15.7:0/2113934935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f48102ef0 0x7f0f4819f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:10.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.302+0000 7f0f4ca9a640 1 --2- 172.21.15.7:0/2113934935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f48102570 0x7f0f4819ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:10.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.302+0000 7f0f4ca9a640 1 --2- 172.21.15.7:0/2113934935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f48100e20 0x7f0f4819a750 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:10.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.302+0000 7f0f4ca9a640 1 -- 172.21.15.7:0/2113934935 >> 172.21.15.7:0/2113934935 conn(0x7f0f480fc7d0 msgr2=0x7f0f48069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:10.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.302+0000 7f0f4ca9a640 1 -- 172.21.15.7:0/2113934935 shutdown_connections 2024-09-19T04:14:10.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:10.302+0000 7f0f4ca9a640 1 -- 172.21.15.7:0/2113934935 wait complete. 2024-09-19T04:14:10.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:10 smithi007 ceph-mon[31360]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:10.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:10 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:10.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:10 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:10.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:10 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:10.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:10 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:14:10.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:10 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:14:10.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:10 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:10.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:10 smithi007 ceph-mon[31360]: Deploying daemon mds.h on smithi092 2024-09-19T04:14:10.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:10 smithi007 ceph-mon[31360]: mds.? [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] up:boot 2024-09-19T04:14:10.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:10 smithi007 ceph-mon[31360]: fsmap 7 up:standby 2024-09-19T04:14:10.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:10 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T04:14:10.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:10 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2113934935' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:14:10.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:10 smithi092 ceph-mon[34940]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:10.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:10 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:10.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:10 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:10.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:10 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:10.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:10 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:14:10.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:10 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:14:10.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:10 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:10.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:10 smithi092 ceph-mon[34940]: Deploying daemon mds.h on smithi092 2024-09-19T04:14:10.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:10 smithi092 ceph-mon[34940]: mds.? [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] up:boot 2024-09-19T04:14:10.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:10 smithi092 ceph-mon[34940]: fsmap 7 up:standby 2024-09-19T04:14:10.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:10 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T04:14:10.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:10 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2113934935' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:14:10.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:10 smithi102 ceph-mon[35446]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:10.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:10 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:10.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:10 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:10.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:10 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:10.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:10 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:14:10.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:10 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:14:10.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:10 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:10.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:10 smithi102 ceph-mon[35446]: Deploying daemon mds.h on smithi092 2024-09-19T04:14:10.910 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:10 smithi102 ceph-mon[35446]: mds.? [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] up:boot 2024-09-19T04:14:10.910 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:10 smithi102 ceph-mon[35446]: fsmap 7 up:standby 2024-09-19T04:14:10.910 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:10 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T04:14:10.910 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:10 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2113934935' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:14:11.547 INFO:journalctl@ceph.mds.h.smithi092.stdout:Sep 19 04:14:11 smithi092 systemd[1]: Starting Ceph mds.h for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:14:11.977 INFO:journalctl@ceph.mds.h.smithi092.stdout:Sep 19 04:14:11 smithi092 podman[65117]: 2024-09-19 04:14:11.607589166 +0000 UTC m=+0.015857094 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:14:11.977 INFO:journalctl@ceph.mds.h.smithi092.stdout:Sep 19 04:14:11 smithi092 podman[65117]: 2024-09-19 04:14:11.71485749 +0000 UTC m=+0.123125409 container create 54eeb19aa70dde030bd72143343741270f6faf1f4b8781b3306c38b1311e0520 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-h, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-19T04:14:11.977 INFO:journalctl@ceph.mds.h.smithi092.stdout:Sep 19 04:14:11 smithi092 podman[65117]: 2024-09-19 04:14:11.975889587 +0000 UTC m=+0.384157506 container init 54eeb19aa70dde030bd72143343741270f6faf1f4b8781b3306c38b1311e0520 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-h, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2) 2024-09-19T04:14:12.297 INFO:journalctl@ceph.mds.h.smithi092.stdout:Sep 19 04:14:11 smithi092 podman[65117]: 2024-09-19 04:14:11.978849842 +0000 UTC m=+0.387117770 container start 54eeb19aa70dde030bd72143343741270f6faf1f4b8781b3306c38b1311e0520 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-h, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-19T04:14:12.297 INFO:journalctl@ceph.mds.h.smithi092.stdout:Sep 19 04:14:12 smithi092 ceph-mds[65136]: -- 172.21.15.92:0/2005077998 <== mon.2 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5652310d5860 con 0x5652310b3000 2024-09-19T04:14:12.297 INFO:journalctl@ceph.mds.h.smithi092.stdout:Sep 19 04:14:12 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-h[65132]: starting mds.h at 2024-09-19T04:14:12.297 INFO:journalctl@ceph.mds.h.smithi092.stdout:Sep 19 04:14:12 smithi092 bash[65117]: 54eeb19aa70dde030bd72143343741270f6faf1f4b8781b3306c38b1311e0520 2024-09-19T04:14:12.297 INFO:journalctl@ceph.mds.h.smithi092.stdout:Sep 19 04:14:12 smithi092 systemd[1]: Started Ceph mds.h for 77957c0a-763c-11ef-bceb-c7b262605968. 2024-09-19T04:14:12.757 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:12 smithi102 ceph-mon[35446]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:12.757 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:12 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:12.757 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:12 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:12.757 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:12 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:12.757 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:12 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:14:12.757 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:12 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:14:12.757 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:12 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:12.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:12 smithi092 ceph-mon[34940]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:12.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:12 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:12.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:12 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:12.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:12 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:12.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:12 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:14:12.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:12 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:14:12.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:12 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:12.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:12 smithi007 ceph-mon[31360]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:12.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:12 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:12.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:12 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:12.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:12 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:12.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:12 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:14:12.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:12 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:14:12.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:12 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:13.013 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:14:13.286 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:14:13.645 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:13 smithi102 ceph-mon[35446]: Deploying daemon mds.i on smithi102 2024-09-19T04:14:13.645 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:13 smithi102 ceph-mon[35446]: mds.? [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] up:boot 2024-09-19T04:14:13.645 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:13 smithi102 ceph-mon[35446]: fsmap 8 up:standby 2024-09-19T04:14:13.645 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:13 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T04:14:13.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:13 smithi007 ceph-mon[31360]: Deploying daemon mds.i on smithi102 2024-09-19T04:14:13.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:13 smithi007 ceph-mon[31360]: mds.? [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] up:boot 2024-09-19T04:14:13.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:13 smithi007 ceph-mon[31360]: fsmap 8 up:standby 2024-09-19T04:14:13.705 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:13 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T04:14:13.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:13 smithi092 ceph-mon[34940]: Deploying daemon mds.i on smithi102 2024-09-19T04:14:13.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:13 smithi092 ceph-mon[34940]: mds.? [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] up:boot 2024-09-19T04:14:13.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:13 smithi092 ceph-mon[34940]: fsmap 8 up:standby 2024-09-19T04:14:13.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:13 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T04:14:13.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.786+0000 7fbfb89d2640 1 -- 172.21.15.7:0/289677851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfb4102d30 msgr2=0x7fbfb4103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:13.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.786+0000 7fbfb89d2640 1 --2- 172.21.15.7:0/289677851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfb4102d30 0x7fbfb4103110 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009930 tx=0x7fbfac02a420 comp rx=0 tx=0).stop 2024-09-19T04:14:13.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.786+0000 7fbfb89d2640 1 -- 172.21.15.7:0/289677851 shutdown_connections 2024-09-19T04:14:13.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.786+0000 7fbfb89d2640 1 --2- 172.21.15.7:0/289677851 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbfb41082a0 0x7fbfb410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:13.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.786+0000 7fbfb89d2640 1 --2- 172.21.15.7:0/289677851 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfb41036e0 0x7fbfb4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:13.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.786+0000 7fbfb89d2640 1 --2- 172.21.15.7:0/289677851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfb4102d30 0x7fbfb4103110 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:13.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.786+0000 7fbfb89d2640 1 -- 172.21.15.7:0/289677851 >> 172.21.15.7:0/289677851 conn(0x7fbfb40fc7d0 msgr2=0x7fbfb40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:13.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.786+0000 7fbfb89d2640 1 -- 172.21.15.7:0/289677851 shutdown_connections 2024-09-19T04:14:13.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.786+0000 7fbfb89d2640 1 -- 172.21.15.7:0/289677851 wait complete. 2024-09-19T04:14:13.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.787+0000 7fbfb89d2640 1 Processor -- start 2024-09-19T04:14:13.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.787+0000 7fbfb89d2640 1 -- start start 2024-09-19T04:14:13.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.787+0000 7fbfb89d2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbfb4102d30 0x7fbfb41a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:13.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.787+0000 7fbfb89d2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfb41036e0 0x7fbfb41a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:13.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.787+0000 7fbfb89d2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfb41082a0 0x7fbfb419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:13.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.787+0000 7fbfb89d2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb41120a0 con 0x7fbfb41036e0 2024-09-19T04:14:13.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.787+0000 7fbfb89d2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb4111f20 con 0x7fbfb4102d30 2024-09-19T04:14:13.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.787+0000 7fbfb89d2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb4112220 con 0x7fbfb41082a0 2024-09-19T04:14:13.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.787+0000 7fbfb1d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfb41036e0 0x7fbfb41a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:13.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.787+0000 7fbfb1d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfb41036e0 0x7fbfb41a0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41294/0 (socket says 172.21.15.7:41294) 2024-09-19T04:14:13.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.787+0000 7fbfb1d9b640 1 -- 172.21.15.7:0/1898368566 learned_addr learned my addr 172.21.15.7:0/1898368566 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:14:13.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.787+0000 7fbfb259c640 1 --2- 172.21.15.7:0/1898368566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbfb4102d30 0x7fbfb41a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:13.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.787+0000 7fbfb2d9d640 1 --2- 172.21.15.7:0/1898368566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfb41082a0 0x7fbfb419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:13.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.788+0000 7fbfb1d9b640 1 -- 172.21.15.7:0/1898368566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfb41082a0 msgr2=0x7fbfb419a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:13.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.788+0000 7fbfb1d9b640 1 --2- 172.21.15.7:0/1898368566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfb41082a0 0x7fbfb419a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:13.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.788+0000 7fbfb1d9b640 1 -- 172.21.15.7:0/1898368566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbfb4102d30 msgr2=0x7fbfb41a0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:13.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.788+0000 7fbfb1d9b640 1 --2- 172.21.15.7:0/1898368566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbfb4102d30 0x7fbfb41a0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:13.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.788+0000 7fbfb1d9b640 1 -- 172.21.15.7:0/1898368566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb419ad20 con 0x7fbfb41036e0 2024-09-19T04:14:13.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.788+0000 7fbfb259c640 1 --2- 172.21.15.7:0/1898368566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbfb4102d30 0x7fbfb41a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:14:13.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.788+0000 7fbfb1d9b640 1 --2- 172.21.15.7:0/1898368566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfb41036e0 0x7fbfb41a0970 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00d950 tx=0x7fbf9c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:13.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.788+0000 7fbfab7fe640 1 -- 172.21.15.7:0/1898368566 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c017070 con 0x7fbfb41036e0 2024-09-19T04:14:13.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.788+0000 7fbfab7fe640 1 -- 172.21.15.7:0/1898368566 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf9c009c30 con 0x7fbfb41036e0 2024-09-19T04:14:13.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.788+0000 7fbfb89d2640 1 -- 172.21.15.7:0/1898368566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb419b010 con 0x7fbfb41036e0 2024-09-19T04:14:13.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.788+0000 7fbfab7fe640 1 -- 172.21.15.7:0/1898368566 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c0047a0 con 0x7fbfb41036e0 2024-09-19T04:14:13.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.788+0000 7fbfb89d2640 1 -- 172.21.15.7:0/1898368566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb41a7300 con 0x7fbfb41036e0 2024-09-19T04:14:13.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.789+0000 7fbfb89d2640 1 -- 172.21.15.7:0/1898368566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfb406a850 con 0x7fbfb41036e0 2024-09-19T04:14:13.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.790+0000 7fbfab7fe640 1 -- 172.21.15.7:0/1898368566 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fbf9c004020 con 0x7fbfb41036e0 2024-09-19T04:14:13.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.792+0000 7fbfab7fe640 1 --2- 172.21.15.7:0/1898368566 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fbfa00a3240 0x7fbfa00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:13.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.792+0000 7fbfb259c640 1 --2- 172.21.15.7:0/1898368566 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fbfa00a3240 0x7fbfa00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:13.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.792+0000 7fbfab7fe640 1 -- 172.21.15.7:0/1898368566 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fbf9c0cf130 con 0x7fbfb41036e0 2024-09-19T04:14:13.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.792+0000 7fbfb259c640 1 --2- 172.21.15.7:0/1898368566 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fbfa00a3240 0x7fbfa00a5700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009900 tx=0x7fbfac0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:13.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:13.796+0000 7fbfab7fe640 1 -- 172.21.15.7:0/1898368566 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbf9c020020 con 0x7fbfb41036e0 2024-09-19T04:14:14.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:14.007+0000 7fbfb89d2640 1 -- 172.21.15.7:0/1898368566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbfb410c2c0 con 0x7fbfb41036e0 2024-09-19T04:14:14.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:14.008+0000 7fbfab7fe640 1 -- 172.21.15.7:0/1898368566 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7207 (secure 0 0 0) 0x7fbf9c09c2f0 con 0x7fbfb41036e0 2024-09-19T04:14:14.009 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:14:14.010 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":9,"btime":"2024-09-19T04:14:12:425525+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-19T04:14:14.010 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 9 2024-09-19T04:14:14.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:14.010+0000 7fbfb89d2640 1 -- 172.21.15.7:0/1898368566 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fbfa00a3240 msgr2=0x7fbfa00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:14.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:14.010+0000 7fbfb89d2640 1 --2- 172.21.15.7:0/1898368566 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fbfa00a3240 0x7fbfa00a5700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009900 tx=0x7fbfac0058d0 comp rx=0 tx=0).stop 2024-09-19T04:14:14.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:14.010+0000 7fbfb89d2640 1 -- 172.21.15.7:0/1898368566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfb41036e0 msgr2=0x7fbfb41a0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:14.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:14.010+0000 7fbfb89d2640 1 --2- 172.21.15.7:0/1898368566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfb41036e0 0x7fbfb41a0970 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00d950 tx=0x7fbf9c00de10 comp rx=0 tx=0).stop 2024-09-19T04:14:14.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:14.010+0000 7fbfb89d2640 1 -- 172.21.15.7:0/1898368566 shutdown_connections 2024-09-19T04:14:14.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:14.010+0000 7fbfb89d2640 1 --2- 172.21.15.7:0/1898368566 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fbfa00a3240 0x7fbfa00a5700 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:14.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:14.010+0000 7fbfb89d2640 1 --2- 172.21.15.7:0/1898368566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfb41082a0 0x7fbfb419a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:14.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:14.010+0000 7fbfb89d2640 1 --2- 172.21.15.7:0/1898368566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfb41036e0 0x7fbfb41a0970 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:14.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:14.010+0000 7fbfb89d2640 1 --2- 172.21.15.7:0/1898368566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbfb4102d30 0x7fbfb41a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:14.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:14.010+0000 7fbfb89d2640 1 -- 172.21.15.7:0/1898368566 >> 172.21.15.7:0/1898368566 conn(0x7fbfb40fc7d0 msgr2=0x7fbfb4100d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:14.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:14.010+0000 7fbfb89d2640 1 -- 172.21.15.7:0/1898368566 shutdown_connections 2024-09-19T04:14:14.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:14.010+0000 7fbfb89d2640 1 -- 172.21.15.7:0/1898368566 wait complete. 2024-09-19T04:14:14.358 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 19 04:14:14 smithi102 systemd[1]: Starting Ceph mds.i for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:14:14.642 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:14 smithi102 ceph-mon[35446]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:14.642 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:14 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1898368566' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:14:14.642 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 19 04:14:14 smithi102 podman[65757]: 2024-09-19 04:14:14.259471988 +0000 UTC m=+0.015614502 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:14:14.642 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 19 04:14:14 smithi102 podman[65757]: 2024-09-19 04:14:14.380125081 +0000 UTC m=+0.136267598 container create d51a3e24a498e08173d841d88ab017f9909cc91f4ef70ec26635d0fefa11043e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-i, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:14:14.643 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 19 04:14:14 smithi102 podman[65757]: 2024-09-19 04:14:14.641433036 +0000 UTC m=+0.397575541 container init d51a3e24a498e08173d841d88ab017f9909cc91f4ef70ec26635d0fefa11043e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-i, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:14:14.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:14 smithi092 ceph-mon[34940]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:14.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:14 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1898368566' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:14:14.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:14 smithi007 ceph-mon[31360]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:14.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:14 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1898368566' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:14:14.909 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 19 04:14:14 smithi102 podman[65757]: 2024-09-19 04:14:14.644435377 +0000 UTC m=+0.400577890 container start d51a3e24a498e08173d841d88ab017f9909cc91f4ef70ec26635d0fefa11043e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T04:14:14.909 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 19 04:14:14 smithi102 ceph-mds[65776]: -- 172.21.15.102:0/1884429786 <== mon.1 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562b13165860 con 0x562b13143000 2024-09-19T04:14:14.909 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 19 04:14:14 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-i[65772]: starting mds.i at 2024-09-19T04:14:14.909 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 19 04:14:14 smithi102 bash[65757]: d51a3e24a498e08173d841d88ab017f9909cc91f4ef70ec26635d0fefa11043e 2024-09-19T04:14:14.909 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 19 04:14:14 smithi102 systemd[1]: Started Ceph mds.i for 77957c0a-763c-11ef-bceb-c7b262605968. 2024-09-19T04:14:15.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:15 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:15.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:15 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:15.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:15 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:15.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:15 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:14:15.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:15 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:14:15.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:15 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:15.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:15 smithi007 ceph-mon[31360]: Deploying daemon mds.g on smithi007 2024-09-19T04:14:15.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:15 smithi007 ceph-mon[31360]: mds.? [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] up:boot 2024-09-19T04:14:15.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:15 smithi007 ceph-mon[31360]: fsmap 9 up:standby 2024-09-19T04:14:15.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:15 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T04:14:16.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:15 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:16.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:15 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:16.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:15 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:16.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:15 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:14:16.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:15 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:14:16.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:15 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:16.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:15 smithi092 ceph-mon[34940]: Deploying daemon mds.g on smithi007 2024-09-19T04:14:16.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:15 smithi092 ceph-mon[34940]: mds.? [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] up:boot 2024-09-19T04:14:16.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:15 smithi092 ceph-mon[34940]: fsmap 9 up:standby 2024-09-19T04:14:16.048 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:15 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T04:14:16.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:15 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:16.275 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:15 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:16.275 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:15 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:16.275 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:15 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:14:16.275 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:15 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:14:16.275 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:15 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:16.276 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:15 smithi102 ceph-mon[35446]: Deploying daemon mds.g on smithi007 2024-09-19T04:14:16.276 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:15 smithi102 ceph-mon[35446]: mds.? [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] up:boot 2024-09-19T04:14:16.276 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:15 smithi102 ceph-mon[35446]: fsmap 9 up:standby 2024-09-19T04:14:16.276 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:15 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T04:14:16.647 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:14:16.930 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:16 smithi007 ceph-mon[31360]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:16.930 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 04:14:16 smithi007 podman[71310]: 2024-09-19 04:14:16.929748656 +0000 UTC m=+0.131569484 container create ca9cf4cc67e492c98d2c763bd9da62aa28f561e9899c72b59e76b35f3ce88f71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-g, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T04:14:17.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:16 smithi102 ceph-mon[35446]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:17.194 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 04:14:17 smithi007 podman[71310]: 2024-09-19 04:14:17.166252381 +0000 UTC m=+0.368073218 container init ca9cf4cc67e492c98d2c763bd9da62aa28f561e9899c72b59e76b35f3ce88f71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-g, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-19T04:14:17.194 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 04:14:17 smithi007 podman[71310]: 2024-09-19 04:14:17.169624235 +0000 UTC m=+0.371445066 container start ca9cf4cc67e492c98d2c763bd9da62aa28f561e9899c72b59e76b35f3ce88f71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-g, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-19T04:14:17.293 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:14:17.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:16 smithi092 ceph-mon[34940]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:17.560 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 04:14:17 smithi007 ceph-mds[71353]: -- 172.21.15.7:0/1650368501 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562ed0d21860 con 0x562ed0cfe800 2024-09-19T04:14:17.560 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 04:14:17 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-g[71337]: starting mds.g at 2024-09-19T04:14:17.560 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 04:14:17 smithi007 bash[71310]: ca9cf4cc67e492c98d2c763bd9da62aa28f561e9899c72b59e76b35f3ce88f71 2024-09-19T04:14:17.560 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 04:14:17 smithi007 systemd[1]: Started Ceph mds.g for 77957c0a-763c-11ef-bceb-c7b262605968. 2024-09-19T04:14:17.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.786+0000 7f2adbc96640 1 -- 172.21.15.7:0/1902501968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ad4101420 msgr2=0x7f2ad410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:17.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.786+0000 7f2adbc96640 1 --2- 172.21.15.7:0/1902501968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ad4101420 0x7f2ad410d950 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2acc009cd0 tx=0x7f2acc02a8e0 comp rx=0 tx=0).stop 2024-09-19T04:14:17.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.786+0000 7f2adbc96640 1 -- 172.21.15.7:0/1902501968 shutdown_connections 2024-09-19T04:14:17.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.786+0000 7f2adbc96640 1 --2- 172.21.15.7:0/1902501968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ad4101420 0x7f2ad410d950 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:17.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.786+0000 7f2adbc96640 1 --2- 172.21.15.7:0/1902501968 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ad4100a80 0x7f2ad4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:17.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.786+0000 7f2adbc96640 1 --2- 172.21.15.7:0/1902501968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ad4106a80 0x7f2ad4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:17.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.786+0000 7f2adbc96640 1 -- 172.21.15.7:0/1902501968 >> 172.21.15.7:0/1902501968 conn(0x7f2ad40fc7a0 msgr2=0x7f2ad40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:17.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.786+0000 7f2adbc96640 1 -- 172.21.15.7:0/1902501968 shutdown_connections 2024-09-19T04:14:17.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.786+0000 7f2adbc96640 1 -- 172.21.15.7:0/1902501968 wait complete. 2024-09-19T04:14:17.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.787+0000 7f2adbc96640 1 Processor -- start 2024-09-19T04:14:17.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.787+0000 7f2adbc96640 1 -- start start 2024-09-19T04:14:17.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.787+0000 7f2adbc96640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ad4100a80 0x7f2ad4198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:17.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.787+0000 7f2adbc96640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ad4101420 0x7f2ad4198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:17.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.787+0000 7f2adbc96640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ad4106a80 0x7f2ad419ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:17.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.787+0000 7f2adbc96640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad4110e80 con 0x7f2ad4101420 2024-09-19T04:14:17.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.787+0000 7f2adbc96640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad4110d00 con 0x7f2ad4100a80 2024-09-19T04:14:17.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.787+0000 7f2adbc96640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad4111000 con 0x7f2ad4106a80 2024-09-19T04:14:17.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.787+0000 7f2ad9231640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ad4101420 0x7f2ad4198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:17.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.787+0000 7f2ad9231640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ad4101420 0x7f2ad4198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50488/0 (socket says 172.21.15.7:50488) 2024-09-19T04:14:17.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.787+0000 7f2ad9231640 1 -- 172.21.15.7:0/1000666708 learned_addr learned my addr 172.21.15.7:0/1000666708 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:14:17.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.787+0000 7f2ad9a32640 1 --2- 172.21.15.7:0/1000666708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ad4100a80 0x7f2ad4198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:17.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.788+0000 7f2ada233640 1 --2- 172.21.15.7:0/1000666708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ad4106a80 0x7f2ad419ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:17.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.788+0000 7f2ad9231640 1 -- 172.21.15.7:0/1000666708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ad4106a80 msgr2=0x7f2ad419ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:17.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.788+0000 7f2ad9231640 1 --2- 172.21.15.7:0/1000666708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ad4106a80 0x7f2ad419ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:17.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.788+0000 7f2ad9231640 1 -- 172.21.15.7:0/1000666708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ad4100a80 msgr2=0x7f2ad4198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:17.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.788+0000 7f2ad9231640 1 --2- 172.21.15.7:0/1000666708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ad4100a80 0x7f2ad4198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:17.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.788+0000 7f2ad9231640 1 -- 172.21.15.7:0/1000666708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad419d3d0 con 0x7f2ad4101420 2024-09-19T04:14:17.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.788+0000 7f2ad9231640 1 --2- 172.21.15.7:0/1000666708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ad4101420 0x7f2ad4198960 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800d770 tx=0x7f2ac800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:17.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.788+0000 7f2ac6ffd640 1 -- 172.21.15.7:0/1000666708 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac8017070 con 0x7f2ad4101420 2024-09-19T04:14:17.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.788+0000 7f2ac6ffd640 1 -- 172.21.15.7:0/1000666708 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ac8005500 con 0x7f2ad4101420 2024-09-19T04:14:17.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.788+0000 7f2adbc96640 1 -- 172.21.15.7:0/1000666708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ad419d6c0 con 0x7f2ad4101420 2024-09-19T04:14:17.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.788+0000 7f2ac6ffd640 1 -- 172.21.15.7:0/1000666708 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac8004e00 con 0x7f2ad4101420 2024-09-19T04:14:17.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.788+0000 7f2adbc96640 1 -- 172.21.15.7:0/1000666708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ad41a4fa0 con 0x7f2ad4101420 2024-09-19T04:14:17.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.789+0000 7f2adbc96640 1 -- 172.21.15.7:0/1000666708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ad4100ee0 con 0x7f2ad4101420 2024-09-19T04:14:17.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.790+0000 7f2ac6ffd640 1 -- 172.21.15.7:0/1000666708 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f2ac8004fa0 con 0x7f2ad4101420 2024-09-19T04:14:17.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.791+0000 7f2ac6ffd640 1 --2- 172.21.15.7:0/1000666708 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2ac00a3240 0x7f2ac00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:17.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.791+0000 7f2ad9a32640 1 --2- 172.21.15.7:0/1000666708 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2ac00a3240 0x7f2ac00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:17.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.791+0000 7f2ac6ffd640 1 -- 172.21.15.7:0/1000666708 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f2ac80cefe0 con 0x7f2ad4101420 2024-09-19T04:14:17.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.791+0000 7f2ad9a32640 1 --2- 172.21.15.7:0/1000666708 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2ac00a3240 0x7f2ac00a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000cac0 tx=0x7f2ad000c4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:17.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:17.795+0000 7f2ac6ffd640 1 -- 172.21.15.7:0/1000666708 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2ac809c160 con 0x7f2ad4101420 2024-09-19T04:14:18.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:18.013+0000 7f2adbc96640 1 -- 172.21.15.7:0/1000666708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ad410a020 con 0x7f2ad4101420 2024-09-19T04:14:18.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:18.014+0000 7f2ac6ffd640 1 -- 172.21.15.7:0/1000666708 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8860 (secure 0 0 0) 0x7f2ac809ba60 con 0x7f2ad4101420 2024-09-19T04:14:18.016 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:14:18.016 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":11,"btime":"2024-09-19T04:14:17:807721+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14583,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24496,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T04:14:18.016 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 11 2024-09-19T04:14:18.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:18.016+0000 7f2adbc96640 1 -- 172.21.15.7:0/1000666708 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2ac00a3240 msgr2=0x7f2ac00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:18.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:18.016+0000 7f2adbc96640 1 --2- 172.21.15.7:0/1000666708 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2ac00a3240 0x7f2ac00a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000cac0 tx=0x7f2ad000c4a0 comp rx=0 tx=0).stop 2024-09-19T04:14:18.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:18.016+0000 7f2adbc96640 1 -- 172.21.15.7:0/1000666708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ad4101420 msgr2=0x7f2ad4198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:18.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:18.016+0000 7f2adbc96640 1 --2- 172.21.15.7:0/1000666708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ad4101420 0x7f2ad4198960 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800d770 tx=0x7f2ac800dc30 comp rx=0 tx=0).stop 2024-09-19T04:14:18.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:18.016+0000 7f2adbc96640 1 -- 172.21.15.7:0/1000666708 shutdown_connections 2024-09-19T04:14:18.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:18.016+0000 7f2adbc96640 1 --2- 172.21.15.7:0/1000666708 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2ac00a3240 0x7f2ac00a5700 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:18.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:18.016+0000 7f2adbc96640 1 --2- 172.21.15.7:0/1000666708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ad4106a80 0x7f2ad419ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:18.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:18.016+0000 7f2adbc96640 1 --2- 172.21.15.7:0/1000666708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ad4101420 0x7f2ad4198960 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:18.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:18.016+0000 7f2adbc96640 1 --2- 172.21.15.7:0/1000666708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ad4100a80 0x7f2ad4198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:18.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:18.016+0000 7f2adbc96640 1 -- 172.21.15.7:0/1000666708 >> 172.21.15.7:0/1000666708 conn(0x7f2ad40fc7a0 msgr2=0x7f2ad406a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:18.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:18.017+0000 7f2adbc96640 1 -- 172.21.15.7:0/1000666708 shutdown_connections 2024-09-19T04:14:18.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:18.017+0000 7f2adbc96640 1 -- 172.21.15.7:0/1000666708 wait complete. 2024-09-19T04:14:18.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:18 smithi007 ceph-mon[31360]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:18.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:18 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:18.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:18 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:18.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:18 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:18.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:18 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:14:18.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:18 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:14:18.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:18 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:18.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:18 smithi007 ceph-mon[31360]: Deploying daemon mds.a on smithi007 2024-09-19T04:14:18.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:18 smithi007 ceph-mon[31360]: mds.? [v2:172.21.15.7:6838/2492396165,v1:172.21.15.7:6839/2492396165] up:boot 2024-09-19T04:14:18.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:18 smithi007 ceph-mon[31360]: fsmap 10 up:standby 2024-09-19T04:14:18.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:18 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T04:14:18.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:18 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1000666708' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:14:18.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:18 smithi102 ceph-mon[35446]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:18.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:18 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:18.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:18 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:18.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:18 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:18.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:18 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:14:18.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:18 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:14:18.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:18 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:18.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:18 smithi102 ceph-mon[35446]: Deploying daemon mds.a on smithi007 2024-09-19T04:14:18.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:18 smithi102 ceph-mon[35446]: mds.? [v2:172.21.15.7:6838/2492396165,v1:172.21.15.7:6839/2492396165] up:boot 2024-09-19T04:14:18.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:18 smithi102 ceph-mon[35446]: fsmap 10 up:standby 2024-09-19T04:14:18.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:18 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T04:14:18.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:18 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1000666708' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:14:18.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:18 smithi092 ceph-mon[34940]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:18.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:18 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:18.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:18 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:18.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:18 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:18.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:18 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:14:18.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:18 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:14:18.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:18 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:18.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:18 smithi092 ceph-mon[34940]: Deploying daemon mds.a on smithi007 2024-09-19T04:14:18.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:18 smithi092 ceph-mon[34940]: mds.? [v2:172.21.15.7:6838/2492396165,v1:172.21.15.7:6839/2492396165] up:boot 2024-09-19T04:14:18.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:18 smithi092 ceph-mon[34940]: fsmap 10 up:standby 2024-09-19T04:14:18.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:18 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T04:14:18.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:18 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1000666708' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:14:19.572 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 04:14:19 smithi007 systemd[1]: Starting Ceph mds.a for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:14:19.822 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 04:14:19 smithi007 podman[71706]: 2024-09-19 04:14:19.692335591 +0000 UTC m=+0.016570346 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:14:19.822 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 04:14:19 smithi007 podman[71706]: 2024-09-19 04:14:19.821734679 +0000 UTC m=+0.145969407 container create ff8c6b10d2a298b8ad89e412f7c6d670ec3df4590b6cf9a2d4f7920636e4c6d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T04:14:20.077 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 04:14:20 smithi007 podman[71706]: 2024-09-19 04:14:20.049438036 +0000 UTC m=+0.373672784 container init ff8c6b10d2a298b8ad89e412f7c6d670ec3df4590b6cf9a2d4f7920636e4c6d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-19T04:14:20.077 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 04:14:20 smithi007 podman[71706]: 2024-09-19 04:14:20.052261051 +0000 UTC m=+0.376495773 container start ff8c6b10d2a298b8ad89e412f7c6d670ec3df4590b6cf9a2d4f7920636e4c6d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-a, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731) 2024-09-19T04:14:20.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:20 smithi007 ceph-mon[31360]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:20.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:20 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:20.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:20 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:20.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:20 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:20.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:20 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:14:20.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:20 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:14:20.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:20 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:20.378 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 04:14:20 smithi007 ceph-mds[71726]: -- 172.21.15.7:0/1100412346 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5618e70bd860 con 0x5618e709b400 2024-09-19T04:14:20.378 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 04:14:20 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-a[71722]: starting mds.a at 2024-09-19T04:14:20.378 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 04:14:20 smithi007 bash[71706]: ff8c6b10d2a298b8ad89e412f7c6d670ec3df4590b6cf9a2d4f7920636e4c6d8 2024-09-19T04:14:20.378 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 04:14:20 smithi007 systemd[1]: Started Ceph mds.a for 77957c0a-763c-11ef-bceb-c7b262605968. 2024-09-19T04:14:20.652 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:20 smithi092 ceph-mon[34940]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:20.652 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:20 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:20.652 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:20 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:20.653 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:20 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:20.653 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:20 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:14:20.653 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:20 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:14:20.653 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:20 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:20.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:20 smithi102 ceph-mon[35446]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:20.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:20.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:20.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:20.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:14:20.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:14:20.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:20 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:21.599 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:14:21.625 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:21 smithi007 ceph-mon[31360]: Deploying daemon mds.b on smithi092 2024-09-19T04:14:21.625 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:21 smithi007 ceph-mon[31360]: mds.? [v2:172.21.15.7:6840/4142126419,v1:172.21.15.7:6841/4142126419] up:boot 2024-09-19T04:14:21.625 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:21 smithi007 ceph-mon[31360]: fsmap 11 up:standby 2024-09-19T04:14:21.625 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:21 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T04:14:21.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:21 smithi102 ceph-mon[35446]: Deploying daemon mds.b on smithi092 2024-09-19T04:14:21.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:21 smithi102 ceph-mon[35446]: mds.? [v2:172.21.15.7:6840/4142126419,v1:172.21.15.7:6841/4142126419] up:boot 2024-09-19T04:14:21.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:21 smithi102 ceph-mon[35446]: fsmap 11 up:standby 2024-09-19T04:14:21.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:21 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T04:14:21.793 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:21 smithi092 ceph-mon[34940]: Deploying daemon mds.b on smithi092 2024-09-19T04:14:21.793 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:21 smithi092 ceph-mon[34940]: mds.? [v2:172.21.15.7:6840/4142126419,v1:172.21.15.7:6841/4142126419] up:boot 2024-09-19T04:14:21.793 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:21 smithi092 ceph-mon[34940]: fsmap 11 up:standby 2024-09-19T04:14:21.793 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:21 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T04:14:21.871 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:14:22.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.391+0000 7f2ebd7f4640 1 -- 172.21.15.7:0/4046956376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2eb8102570 msgr2=0x7f2eb81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:22.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.391+0000 7f2ebd7f4640 1 --2- 172.21.15.7:0/4046956376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2eb8102570 0x7f2eb81029b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009900 tx=0x7f2eac02a480 comp rx=0 tx=0).stop 2024-09-19T04:14:22.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.391+0000 7f2ebd7f4640 1 -- 172.21.15.7:0/4046956376 shutdown_connections 2024-09-19T04:14:22.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.391+0000 7f2ebd7f4640 1 --2- 172.21.15.7:0/4046956376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2eb8102ef0 0x7f2eb810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:22.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.391+0000 7f2ebd7f4640 1 --2- 172.21.15.7:0/4046956376 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2eb8102570 0x7f2eb81029b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:22.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.391+0000 7f2ebd7f4640 1 --2- 172.21.15.7:0/4046956376 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2eb8100e20 0x7f2eb8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:22.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.391+0000 7f2ebd7f4640 1 -- 172.21.15.7:0/4046956376 >> 172.21.15.7:0/4046956376 conn(0x7f2eb80fc7d0 msgr2=0x7f2eb80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:22.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.391+0000 7f2ebd7f4640 1 -- 172.21.15.7:0/4046956376 shutdown_connections 2024-09-19T04:14:22.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.391+0000 7f2ebd7f4640 1 -- 172.21.15.7:0/4046956376 wait complete. 2024-09-19T04:14:22.394 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:22 smithi007 ceph-mon[31360]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:22.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.392+0000 7f2ebd7f4640 1 Processor -- start 2024-09-19T04:14:22.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.392+0000 7f2ebd7f4640 1 -- start start 2024-09-19T04:14:22.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.392+0000 7f2ebd7f4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2eb8100e20 0x7f2eb8199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:22.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.392+0000 7f2ebd7f4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2eb8102570 0x7f2eb8199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:22.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.393+0000 7f2ebd7f4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2eb8102ef0 0x7f2eb81a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:22.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.393+0000 7f2ebd7f4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb8110f80 con 0x7f2eb8102ef0 2024-09-19T04:14:22.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.393+0000 7f2ebd7f4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb8110e00 con 0x7f2eb8100e20 2024-09-19T04:14:22.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.393+0000 7f2ebd7f4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb8111100 con 0x7f2eb8102570 2024-09-19T04:14:22.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.393+0000 7f2eb6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2eb8100e20 0x7f2eb8199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:22.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.393+0000 7f2eb6ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2eb8100e20 0x7f2eb8199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:41634/0 (socket says 172.21.15.7:41634) 2024-09-19T04:14:22.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.393+0000 7f2eb6ffd640 1 -- 172.21.15.7:0/3239789090 learned_addr learned my addr 172.21.15.7:0/3239789090 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:14:22.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.393+0000 7f2eb77fe640 1 --2- 172.21.15.7:0/3239789090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2eb8102ef0 0x7f2eb81a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:22.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.393+0000 7f2eb67fc640 1 --2- 172.21.15.7:0/3239789090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2eb8102570 0x7f2eb8199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:22.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.393+0000 7f2eb6ffd640 1 -- 172.21.15.7:0/3239789090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2eb8102570 msgr2=0x7f2eb8199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:22.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.393+0000 7f2eb6ffd640 1 --2- 172.21.15.7:0/3239789090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2eb8102570 0x7f2eb8199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:22.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.393+0000 7f2eb6ffd640 1 -- 172.21.15.7:0/3239789090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2eb8102ef0 msgr2=0x7f2eb81a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:22.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.393+0000 7f2eb6ffd640 1 --2- 172.21.15.7:0/3239789090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2eb8102ef0 0x7f2eb81a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:22.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.393+0000 7f2eb6ffd640 1 -- 172.21.15.7:0/3239789090 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb81a4910 con 0x7f2eb8100e20 2024-09-19T04:14:22.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.393+0000 7f2eb67fc640 1 --2- 172.21.15.7:0/3239789090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2eb8102570 0x7f2eb8199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:14:22.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.393+0000 7f2eb6ffd640 1 --2- 172.21.15.7:0/3239789090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2eb8100e20 0x7f2eb8199350 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009de0 tx=0x7f2ea800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:22.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.393+0000 7f2e9ffff640 1 -- 172.21.15.7:0/3239789090 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea801f070 con 0x7f2eb8100e20 2024-09-19T04:14:22.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.393+0000 7f2ebd7f4640 1 -- 172.21.15.7:0/3239789090 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb8197140 con 0x7f2eb8100e20 2024-09-19T04:14:22.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.394+0000 7f2e9ffff640 1 -- 172.21.15.7:0/3239789090 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ea801a8f0 con 0x7f2eb8100e20 2024-09-19T04:14:22.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.394+0000 7f2e9ffff640 1 -- 172.21.15.7:0/3239789090 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea80199a0 con 0x7f2eb8100e20 2024-09-19T04:14:22.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.394+0000 7f2ebd7f4640 1 -- 172.21.15.7:0/3239789090 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb8197680 con 0x7f2eb8100e20 2024-09-19T04:14:22.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.395+0000 7f2ebd7f4640 1 -- 172.21.15.7:0/3239789090 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eb8101200 con 0x7f2eb8100e20 2024-09-19T04:14:22.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.396+0000 7f2e9ffff640 1 -- 172.21.15.7:0/3239789090 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f2ea8022070 con 0x7f2eb8100e20 2024-09-19T04:14:22.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.397+0000 7f2e9ffff640 1 --2- 172.21.15.7:0/3239789090 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2ea00a32c0 0x7f2ea00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:22.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.397+0000 7f2eb67fc640 1 --2- 172.21.15.7:0/3239789090 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2ea00a32c0 0x7f2ea00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:22.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.397+0000 7f2e9ffff640 1 -- 172.21.15.7:0/3239789090 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f2ea80d2fc0 con 0x7f2eb8100e20 2024-09-19T04:14:22.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.398+0000 7f2eb67fc640 1 --2- 172.21.15.7:0/3239789090 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2ea00a32c0 0x7f2ea00a5780 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2eb806aac0 tx=0x7f2eac005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:22.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.402+0000 7f2e9ffff640 1 -- 172.21.15.7:0/3239789090 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2ea809fa90 con 0x7f2eb8100e20 2024-09-19T04:14:22.485 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:22 smithi092 ceph-mon[34940]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:22.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.621+0000 7f2ebd7f4640 1 -- 172.21.15.7:0/3239789090 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2eb8109090 con 0x7f2eb8100e20 2024-09-19T04:14:22.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.622+0000 7f2e9ffff640 1 -- 172.21.15.7:0/3239789090 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9683 (secure 0 0 0) 0x7f2ea80a3d90 con 0x7f2eb8100e20 2024-09-19T04:14:22.624 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:14:22.624 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":12,"btime":"2024-09-19T04:14:20:303260+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14583,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14595,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24496,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T04:14:22.624 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 12 2024-09-19T04:14:22.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.624+0000 7f2ebd7f4640 1 -- 172.21.15.7:0/3239789090 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2ea00a32c0 msgr2=0x7f2ea00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:22.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.624+0000 7f2ebd7f4640 1 --2- 172.21.15.7:0/3239789090 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2ea00a32c0 0x7f2ea00a5780 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2eb806aac0 tx=0x7f2eac005a20 comp rx=0 tx=0).stop 2024-09-19T04:14:22.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.624+0000 7f2ebd7f4640 1 -- 172.21.15.7:0/3239789090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2eb8100e20 msgr2=0x7f2eb8199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:22.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.624+0000 7f2ebd7f4640 1 --2- 172.21.15.7:0/3239789090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2eb8100e20 0x7f2eb8199350 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009de0 tx=0x7f2ea800c6a0 comp rx=0 tx=0).stop 2024-09-19T04:14:22.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.624+0000 7f2ebd7f4640 1 -- 172.21.15.7:0/3239789090 shutdown_connections 2024-09-19T04:14:22.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.624+0000 7f2ebd7f4640 1 --2- 172.21.15.7:0/3239789090 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2ea00a32c0 0x7f2ea00a5780 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:22.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.624+0000 7f2ebd7f4640 1 --2- 172.21.15.7:0/3239789090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2eb8102ef0 0x7f2eb81a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:22.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.624+0000 7f2ebd7f4640 1 --2- 172.21.15.7:0/3239789090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2eb8102570 0x7f2eb8199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:22.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.624+0000 7f2ebd7f4640 1 --2- 172.21.15.7:0/3239789090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2eb8100e20 0x7f2eb8199350 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:22.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.624+0000 7f2ebd7f4640 1 -- 172.21.15.7:0/3239789090 >> 172.21.15.7:0/3239789090 conn(0x7f2eb80fc7d0 msgr2=0x7f2eb81068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:22.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.624+0000 7f2ebd7f4640 1 -- 172.21.15.7:0/3239789090 shutdown_connections 2024-09-19T04:14:22.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:22.624+0000 7f2ebd7f4640 1 -- 172.21.15.7:0/3239789090 wait complete. 2024-09-19T04:14:22.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:22 smithi102 ceph-mon[35446]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:23.046 INFO:journalctl@ceph.mds.b.smithi092.stdout:Sep 19 04:14:22 smithi092 systemd[1]: Started Ceph mds.b for 77957c0a-763c-11ef-bceb-c7b262605968. 2024-09-19T04:14:23.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:23 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3239789090' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:14:23.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:23 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:23.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:23 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:23.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:23 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:23.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:23 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:23.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:23 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:23.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:23 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:14:23.652 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:23 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3239789090' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:14:23.652 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:23 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:23.653 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:23 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:23.653 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:23 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:23.653 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:23 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:23.653 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:23 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:23.653 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:23 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:14:23.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:23 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3239789090' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:14:23.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:23 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:23.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:23 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:23.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:23 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:23.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:23 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:23.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:23 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:23.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:23 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:14:24.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:24 smithi007 ceph-mon[31360]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:24.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:24 smithi007 ceph-mon[31360]: mds.? [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] up:boot 2024-09-19T04:14:24.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:24 smithi007 ceph-mon[31360]: fsmap 12 up:standby 2024-09-19T04:14:24.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:24 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T04:14:24.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:24 smithi102 ceph-mon[35446]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:24.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:24 smithi102 ceph-mon[35446]: mds.? [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] up:boot 2024-09-19T04:14:24.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:24 smithi102 ceph-mon[35446]: fsmap 12 up:standby 2024-09-19T04:14:24.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:24 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T04:14:24.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:24 smithi092 ceph-mon[34940]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:24.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:24 smithi092 ceph-mon[34940]: mds.? [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] up:boot 2024-09-19T04:14:24.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:24 smithi092 ceph-mon[34940]: fsmap 12 up:standby 2024-09-19T04:14:24.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:24 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T04:14:25.294 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:14:25.566 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:14:25.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:25 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:25.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:25 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:25.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:25 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:25.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:25 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:25.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:25 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:25.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:25 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:25.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:25 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:25.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:25 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:25.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:25 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:14:25.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:25 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:25.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:25 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:14:25.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:25 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:25.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:25 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:25.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:25 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:25.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:25 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:25.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:25 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:25.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:25 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:25.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:25 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:25.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:25 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:25.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:25 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:14:25.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:25 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:25.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:25 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:14:25.824 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:25 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:25.825 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:25 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:25.825 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:25 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:25.825 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:25 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:25.825 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:25 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:25.825 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:25 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:25.825 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:25 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:25.825 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:25 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:25.825 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:25 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:14:25.825 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:25 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:25.825 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:25 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:14:26.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.054+0000 7fefb4c29640 1 -- 172.21.15.7:0/2436712913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefb010c180 msgr2=0x7fefb010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:26.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.054+0000 7fefb4c29640 1 --2- 172.21.15.7:0/2436712913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefb010c180 0x7fefb010e610 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fefa8009ca0 tx=0x7fefa802a950 comp rx=0 tx=0).stop 2024-09-19T04:14:26.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.054+0000 7fefb4c29640 1 -- 172.21.15.7:0/2436712913 shutdown_connections 2024-09-19T04:14:26.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.054+0000 7fefb4c29640 1 --2- 172.21.15.7:0/2436712913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefb010c180 0x7fefb010e610 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:26.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.054+0000 7fefb4c29640 1 --2- 172.21.15.7:0/2436712913 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefb0103700 0x7fefb010bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:26.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.054+0000 7fefb4c29640 1 --2- 172.21.15.7:0/2436712913 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fefb0102de0 0x7fefb01031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:26.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.054+0000 7fefb4c29640 1 -- 172.21.15.7:0/2436712913 >> 172.21.15.7:0/2436712913 conn(0x7fefb00fc7a0 msgr2=0x7fefb00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:26.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.054+0000 7fefb4c29640 1 -- 172.21.15.7:0/2436712913 shutdown_connections 2024-09-19T04:14:26.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.054+0000 7fefb4c29640 1 -- 172.21.15.7:0/2436712913 wait complete. 2024-09-19T04:14:26.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.055+0000 7fefb4c29640 1 Processor -- start 2024-09-19T04:14:26.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.055+0000 7fefb4c29640 1 -- start start 2024-09-19T04:14:26.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.055+0000 7fefb4c29640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefb0102de0 0x7fefb01983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:26.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.055+0000 7fefb4c29640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefb0103700 0x7fefb0198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:26.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.055+0000 7fefb4c29640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fefb010c180 0x7fefb019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:26.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.055+0000 7fefb4c29640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fefb0111f70 con 0x7fefb0102de0 2024-09-19T04:14:26.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.055+0000 7fefb4c29640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fefb0111df0 con 0x7fefb0103700 2024-09-19T04:14:26.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.055+0000 7fefb4c29640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fefb01120f0 con 0x7fefb010c180 2024-09-19T04:14:26.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.055+0000 7fefae59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefb0102de0 0x7fefb01983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:26.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.055+0000 7fefae59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefb0102de0 0x7fefb01983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50538/0 (socket says 172.21.15.7:50538) 2024-09-19T04:14:26.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.055+0000 7fefae59c640 1 -- 172.21.15.7:0/3081479520 learned_addr learned my addr 172.21.15.7:0/3081479520 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:14:26.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.055+0000 7fefaed9d640 1 --2- 172.21.15.7:0/3081479520 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fefb010c180 0x7fefb019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:26.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.056+0000 7fefadd9b640 1 --2- 172.21.15.7:0/3081479520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefb0103700 0x7fefb0198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:26.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.056+0000 7fefae59c640 1 -- 172.21.15.7:0/3081479520 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fefb010c180 msgr2=0x7fefb019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:26.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.056+0000 7fefae59c640 1 --2- 172.21.15.7:0/3081479520 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fefb010c180 0x7fefb019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:26.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.056+0000 7fefae59c640 1 -- 172.21.15.7:0/3081479520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefb0103700 msgr2=0x7fefb0198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:26.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.056+0000 7fefae59c640 1 --2- 172.21.15.7:0/3081479520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefb0103700 0x7fefb0198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:26.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.056+0000 7fefae59c640 1 -- 172.21.15.7:0/3081479520 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb019d3a0 con 0x7fefb0102de0 2024-09-19T04:14:26.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.056+0000 7fefae59c640 1 --2- 172.21.15.7:0/3081479520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefb0102de0 0x7fefb01983f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fefa000e9f0 tx=0x7fefa000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:26.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.056+0000 7fef9f7fe640 1 -- 172.21.15.7:0/3081479520 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa000cd80 con 0x7fefb0102de0 2024-09-19T04:14:26.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.056+0000 7fef9f7fe640 1 -- 172.21.15.7:0/3081479520 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefa0010910 con 0x7fefb0102de0 2024-09-19T04:14:26.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.056+0000 7fefb4c29640 1 -- 172.21.15.7:0/3081479520 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefb019d690 con 0x7fefb0102de0 2024-09-19T04:14:26.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.056+0000 7fef9f7fe640 1 -- 172.21.15.7:0/3081479520 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa0018990 con 0x7fefb0102de0 2024-09-19T04:14:26.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.056+0000 7fefb4c29640 1 -- 172.21.15.7:0/3081479520 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefb01a4f70 con 0x7fefb0102de0 2024-09-19T04:14:26.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.057+0000 7fefb4c29640 1 -- 172.21.15.7:0/3081479520 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefb01031c0 con 0x7fefb0102de0 2024-09-19T04:14:26.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.058+0000 7fef9f7fe640 1 -- 172.21.15.7:0/3081479520 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fefa0010ac0 con 0x7fefb0102de0 2024-09-19T04:14:26.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.059+0000 7fef9f7fe640 1 --2- 172.21.15.7:0/3081479520 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fef980a3240 0x7fef980a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:26.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.059+0000 7fefadd9b640 1 --2- 172.21.15.7:0/3081479520 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fef980a3240 0x7fef980a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:26.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.059+0000 7fef9f7fe640 1 -- 172.21.15.7:0/3081479520 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fefa00cfbc0 con 0x7fefb0102de0 2024-09-19T04:14:26.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.059+0000 7fefadd9b640 1 --2- 172.21.15.7:0/3081479520 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fef980a3240 0x7fef980a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fefb00fed30 tx=0x7fefa4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:26.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.062+0000 7fef9f7fe640 1 -- 172.21.15.7:0/3081479520 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fefa009c730 con 0x7fefb0102de0 2024-09-19T04:14:26.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.276+0000 7fefb4c29640 1 -- 172.21.15.7:0/3081479520 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fefb0199750 con 0x7fefb0102de0 2024-09-19T04:14:26.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.277+0000 7fef9f7fe640 1 -- 172.21.15.7:0/3081479520 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10509 (secure 0 0 0) 0x7fefa00a0a30 con 0x7fefb0102de0 2024-09-19T04:14:26.279 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:14:26.279 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":13,"btime":"2024-09-19T04:14:23:314314+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14583,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14595,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24496,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-19T04:14:26.279 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 13 2024-09-19T04:14:26.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.280+0000 7fefb4c29640 1 -- 172.21.15.7:0/3081479520 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fef980a3240 msgr2=0x7fef980a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:26.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.280+0000 7fefb4c29640 1 --2- 172.21.15.7:0/3081479520 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fef980a3240 0x7fef980a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fefb00fed30 tx=0x7fefa4005f90 comp rx=0 tx=0).stop 2024-09-19T04:14:26.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.280+0000 7fefb4c29640 1 -- 172.21.15.7:0/3081479520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefb0102de0 msgr2=0x7fefb01983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:26.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.280+0000 7fefb4c29640 1 --2- 172.21.15.7:0/3081479520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefb0102de0 0x7fefb01983f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fefa000e9f0 tx=0x7fefa000eeb0 comp rx=0 tx=0).stop 2024-09-19T04:14:26.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.280+0000 7fefb4c29640 1 -- 172.21.15.7:0/3081479520 shutdown_connections 2024-09-19T04:14:26.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.280+0000 7fefb4c29640 1 --2- 172.21.15.7:0/3081479520 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fef980a3240 0x7fef980a5700 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:26.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.280+0000 7fefb4c29640 1 --2- 172.21.15.7:0/3081479520 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fefb010c180 0x7fefb019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:26.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.280+0000 7fefb4c29640 1 --2- 172.21.15.7:0/3081479520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fefb0103700 0x7fefb0198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:26.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.280+0000 7fefb4c29640 1 --2- 172.21.15.7:0/3081479520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fefb0102de0 0x7fefb01983f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:26.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.280+0000 7fefb4c29640 1 -- 172.21.15.7:0/3081479520 >> 172.21.15.7:0/3081479520 conn(0x7fefb00fc7a0 msgr2=0x7fefb00fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:26.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.280+0000 7fefb4c29640 1 -- 172.21.15.7:0/3081479520 shutdown_connections 2024-09-19T04:14:26.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:26.280+0000 7fefb4c29640 1 -- 172.21.15.7:0/3081479520 wait complete. 2024-09-19T04:14:26.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:26 smithi007 ceph-mon[31360]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:26.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:26 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3081479520' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:14:26.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:26 smithi092 ceph-mon[34940]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:26.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:26 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3081479520' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:14:26.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:26 smithi102 ceph-mon[35446]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:26.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:26 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3081479520' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:14:27.296 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-19T04:14:27.579 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:14:28.011 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:27 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:28.011 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:27 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:28.011 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:27 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:28.011 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:27 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:28.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:27 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:28.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:27 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:28.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:27 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:28.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:27 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:28.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.091+0000 7f18848d2640 1 -- 172.21.15.7:0/2469543404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1880101420 msgr2=0x7f188010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:28.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.091+0000 7f18848d2640 1 --2- 172.21.15.7:0/2469543404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1880101420 0x7f188010d950 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1878009cd0 tx=0x7f187802a8e0 comp rx=0 tx=0).stop 2024-09-19T04:14:28.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.091+0000 7f18848d2640 1 -- 172.21.15.7:0/2469543404 shutdown_connections 2024-09-19T04:14:28.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.091+0000 7f18848d2640 1 --2- 172.21.15.7:0/2469543404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1880101420 0x7f188010d950 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:28.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.091+0000 7f18848d2640 1 --2- 172.21.15.7:0/2469543404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1880100a80 0x7f1880100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:28.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.091+0000 7f18848d2640 1 --2- 172.21.15.7:0/2469543404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1880106a80 0x7f1880106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:28.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.091+0000 7f18848d2640 1 -- 172.21.15.7:0/2469543404 >> 172.21.15.7:0/2469543404 conn(0x7f18800fc7a0 msgr2=0x7f18800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:28.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.091+0000 7f18848d2640 1 -- 172.21.15.7:0/2469543404 shutdown_connections 2024-09-19T04:14:28.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.091+0000 7f18848d2640 1 -- 172.21.15.7:0/2469543404 wait complete. 2024-09-19T04:14:28.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.092+0000 7f18848d2640 1 Processor -- start 2024-09-19T04:14:28.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.092+0000 7f18848d2640 1 -- start start 2024-09-19T04:14:28.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.092+0000 7f18848d2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1880100a80 0x7f1880198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:28.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.092+0000 7f18848d2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1880101420 0x7f1880198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:28.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.092+0000 7f18848d2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1880106a80 0x7f188019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:28.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.092+0000 7f18848d2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1880110f20 con 0x7f1880100a80 2024-09-19T04:14:28.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.092+0000 7f18848d2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1880110da0 con 0x7f1880101420 2024-09-19T04:14:28.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.092+0000 7f18848d2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f18801110a0 con 0x7f1880106a80 2024-09-19T04:14:28.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.092+0000 7f187e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1880100a80 0x7f1880198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:28.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.092+0000 7f187e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1880100a80 0x7f1880198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42278/0 (socket says 172.21.15.7:42278) 2024-09-19T04:14:28.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.092+0000 7f187e59c640 1 -- 172.21.15.7:0/2046530562 learned_addr learned my addr 172.21.15.7:0/2046530562 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:14:28.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.092+0000 7f187dd9b640 1 --2- 172.21.15.7:0/2046530562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1880101420 0x7f1880198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:28.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.092+0000 7f187ed9d640 1 --2- 172.21.15.7:0/2046530562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1880106a80 0x7f188019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:28.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.092+0000 7f187e59c640 1 -- 172.21.15.7:0/2046530562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1880106a80 msgr2=0x7f188019ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:28.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.092+0000 7f187e59c640 1 --2- 172.21.15.7:0/2046530562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1880106a80 0x7f188019ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:28.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.092+0000 7f187e59c640 1 -- 172.21.15.7:0/2046530562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1880101420 msgr2=0x7f1880198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:28.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.092+0000 7f187e59c640 1 --2- 172.21.15.7:0/2046530562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1880101420 0x7f1880198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:28.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.092+0000 7f187e59c640 1 -- 172.21.15.7:0/2046530562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188019d500 con 0x7f1880100a80 2024-09-19T04:14:28.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.092+0000 7f187ed9d640 1 --2- 172.21.15.7:0/2046530562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1880106a80 0x7f188019ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:14:28.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.092+0000 7f187e59c640 1 --2- 172.21.15.7:0/2046530562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1880100a80 0x7f1880198550 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f187000b4a0 tx=0x7f187000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:28.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.093+0000 7f18777fe640 1 -- 172.21.15.7:0/2046530562 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1870015020 con 0x7f1880100a80 2024-09-19T04:14:28.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.093+0000 7f18777fe640 1 -- 172.21.15.7:0/2046530562 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1870011d10 con 0x7f1880100a80 2024-09-19T04:14:28.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.093+0000 7f18848d2640 1 -- 172.21.15.7:0/2046530562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f188019d7f0 con 0x7f1880100a80 2024-09-19T04:14:28.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.093+0000 7f18777fe640 1 -- 172.21.15.7:0/2046530562 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187000f2e0 con 0x7f1880100a80 2024-09-19T04:14:28.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.093+0000 7f18848d2640 1 -- 172.21.15.7:0/2046530562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18801a50d0 con 0x7f1880100a80 2024-09-19T04:14:28.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.094+0000 7f18848d2640 1 -- 172.21.15.7:0/2046530562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1880100f60 con 0x7f1880100a80 2024-09-19T04:14:28.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.095+0000 7f18777fe640 1 -- 172.21.15.7:0/2046530562 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f1870018020 con 0x7f1880100a80 2024-09-19T04:14:28.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.096+0000 7f18777fe640 1 --2- 172.21.15.7:0/2046530562 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f186c0a3240 0x7f186c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:28.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.096+0000 7f187dd9b640 1 --2- 172.21.15.7:0/2046530562 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f186c0a3240 0x7f186c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:28.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.096+0000 7f18777fe640 1 -- 172.21.15.7:0/2046530562 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f18700cf330 con 0x7f1880100a80 2024-09-19T04:14:28.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.096+0000 7f187dd9b640 1 --2- 172.21.15.7:0/2046530562 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f186c0a3240 0x7f186c0a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f188006b7e0 tx=0x7f1868009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:28.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.099+0000 7f18777fe640 1 -- 172.21.15.7:0/2046530562 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f187001f020 con 0x7f1880100a80 2024-09-19T04:14:28.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:27 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:28.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:27 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:28.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:27 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:28.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:27 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:28.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.276+0000 7f18848d2640 1 -- 172.21.15.7:0/2046530562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f18801998b0 con 0x7f1880100a80 2024-09-19T04:14:28.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.276+0000 7f18777fe640 1 -- 172.21.15.7:0/2046530562 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) ==== 84+0+65 (secure 0 0 0) 0x7f18801998b0 con 0x7f1880100a80 2024-09-19T04:14:28.278 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:14:28.278 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-09-19T04:14:28.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:14:28.278 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2024-09-19T04:14:28.278 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2024-09-19T04:14:28.278 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:14:28.278 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-09-19T04:14:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.278+0000 7f18848d2640 1 -- 172.21.15.7:0/2046530562 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f186c0a3240 msgr2=0x7f186c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.278+0000 7f18848d2640 1 --2- 172.21.15.7:0/2046530562 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f186c0a3240 0x7f186c0a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f188006b7e0 tx=0x7f1868009110 comp rx=0 tx=0).stop 2024-09-19T04:14:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.278+0000 7f18848d2640 1 -- 172.21.15.7:0/2046530562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1880100a80 msgr2=0x7f1880198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.278+0000 7f18848d2640 1 --2- 172.21.15.7:0/2046530562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1880100a80 0x7f1880198550 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f187000b4a0 tx=0x7f187000b8a0 comp rx=0 tx=0).stop 2024-09-19T04:14:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.279+0000 7f18848d2640 1 -- 172.21.15.7:0/2046530562 shutdown_connections 2024-09-19T04:14:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.279+0000 7f18848d2640 1 --2- 172.21.15.7:0/2046530562 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f186c0a3240 0x7f186c0a5700 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.279+0000 7f18848d2640 1 --2- 172.21.15.7:0/2046530562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1880106a80 0x7f188019ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.279+0000 7f18848d2640 1 --2- 172.21.15.7:0/2046530562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1880101420 0x7f1880198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:28.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.279+0000 7f18848d2640 1 --2- 172.21.15.7:0/2046530562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1880100a80 0x7f1880198550 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:28.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.279+0000 7f18848d2640 1 -- 172.21.15.7:0/2046530562 >> 172.21.15.7:0/2046530562 conn(0x7f18800fc7a0 msgr2=0x7f18801048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:28.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.279+0000 7f18848d2640 1 -- 172.21.15.7:0/2046530562 shutdown_connections 2024-09-19T04:14:28.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:28.279+0000 7f18848d2640 1 -- 172.21.15.7:0/2046530562 wait complete. 2024-09-19T04:14:28.897 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T04:14:28.898 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T04:14:29.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:28 smithi007 ceph-mon[31360]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:29.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:28 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:29.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:28 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:29.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:28 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:29.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:28 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:14:29.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:28 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:29.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:28 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2046530562' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T04:14:29.157 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:14:29.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:28 smithi102 ceph-mon[35446]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:29.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:28 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:29.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:28 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:29.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:28 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:29.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:28 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:14:29.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:28 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:29.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:28 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2046530562' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T04:14:29.213 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:28 smithi092 ceph-mon[34940]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:29.213 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:29.213 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:29.213 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:14:29.213 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:14:29.213 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:14:29.213 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:28 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2046530562' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T04:14:29.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.604+0000 7f6d7fef8640 1 -- 172.21.15.7:0/3167859698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d78102790 msgr2=0x7f6d781067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:29.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.604+0000 7f6d7fef8640 1 --2- 172.21.15.7:0/3167859698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d78102790 0x7f6d781067e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6d68009900 tx=0x7f6d6802a410 comp rx=0 tx=0).stop 2024-09-19T04:14:29.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.604+0000 7f6d7fef8640 1 -- 172.21.15.7:0/3167859698 shutdown_connections 2024-09-19T04:14:29.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.604+0000 7f6d7fef8640 1 --2- 172.21.15.7:0/3167859698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d78106f10 0x7f6d7810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:29.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.604+0000 7f6d7fef8640 1 --2- 172.21.15.7:0/3167859698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d78102790 0x7f6d781067e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:29.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.604+0000 7f6d7fef8640 1 --2- 172.21.15.7:0/3167859698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d78101de0 0x7f6d781021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:29.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.604+0000 7f6d7fef8640 1 -- 172.21.15.7:0/3167859698 >> 172.21.15.7:0/3167859698 conn(0x7f6d780fd8c0 msgr2=0x7f6d780ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:29.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.604+0000 7f6d7fef8640 1 -- 172.21.15.7:0/3167859698 shutdown_connections 2024-09-19T04:14:29.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.604+0000 7f6d7fef8640 1 -- 172.21.15.7:0/3167859698 wait complete. 2024-09-19T04:14:29.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.605+0000 7f6d7fef8640 1 Processor -- start 2024-09-19T04:14:29.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.605+0000 7f6d7fef8640 1 -- start start 2024-09-19T04:14:29.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.605+0000 7f6d7fef8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d78101de0 0x7f6d78198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:29.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.605+0000 7f6d7fef8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d78102790 0x7f6d78198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:29.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.605+0000 7f6d7fef8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d78106f10 0x7f6d7819ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:29.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.605+0000 7f6d7fef8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6d78111f90 con 0x7f6d78101de0 2024-09-19T04:14:29.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.605+0000 7f6d7fef8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6d78111e10 con 0x7f6d78106f10 2024-09-19T04:14:29.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.605+0000 7f6d7fef8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6d78112110 con 0x7f6d78102790 2024-09-19T04:14:29.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.605+0000 7f6d7dc94640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d78101de0 0x7f6d78198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:29.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.605+0000 7f6d7dc94640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d78101de0 0x7f6d78198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42296/0 (socket says 172.21.15.7:42296) 2024-09-19T04:14:29.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.605+0000 7f6d7dc94640 1 -- 172.21.15.7:0/760353886 learned_addr learned my addr 172.21.15.7:0/760353886 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:14:29.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.605+0000 7f6d7e495640 1 --2- 172.21.15.7:0/760353886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d78106f10 0x7f6d7819ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:29.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.606+0000 7f6d7d493640 1 --2- 172.21.15.7:0/760353886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d78102790 0x7f6d78198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:29.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.606+0000 7f6d7dc94640 1 -- 172.21.15.7:0/760353886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d78102790 msgr2=0x7f6d78198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:29.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.606+0000 7f6d7dc94640 1 --2- 172.21.15.7:0/760353886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d78102790 0x7f6d78198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:29.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.606+0000 7f6d7dc94640 1 -- 172.21.15.7:0/760353886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d78106f10 msgr2=0x7f6d7819ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:29.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.606+0000 7f6d7dc94640 1 --2- 172.21.15.7:0/760353886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d78106f10 0x7f6d7819ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:29.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.606+0000 7f6d7dc94640 1 -- 172.21.15.7:0/760353886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d7819d520 con 0x7f6d78101de0 2024-09-19T04:14:29.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.606+0000 7f6d7dc94640 1 --2- 172.21.15.7:0/760353886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d78101de0 0x7f6d78198570 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400d950 tx=0x7f6d7400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:29.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.606+0000 7f6d6effd640 1 -- 172.21.15.7:0/760353886 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d74017070 con 0x7f6d78101de0 2024-09-19T04:14:29.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.606+0000 7f6d6effd640 1 -- 172.21.15.7:0/760353886 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d74009c30 con 0x7f6d78101de0 2024-09-19T04:14:29.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.606+0000 7f6d7fef8640 1 -- 172.21.15.7:0/760353886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d7819d810 con 0x7f6d78101de0 2024-09-19T04:14:29.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.606+0000 7f6d6effd640 1 -- 172.21.15.7:0/760353886 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7400f6b0 con 0x7f6d78101de0 2024-09-19T04:14:29.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.606+0000 7f6d7fef8640 1 -- 172.21.15.7:0/760353886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d781a50f0 con 0x7f6d78101de0 2024-09-19T04:14:29.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.607+0000 7f6d7fef8640 1 -- 172.21.15.7:0/760353886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d781021c0 con 0x7f6d78101de0 2024-09-19T04:14:29.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.608+0000 7f6d6effd640 1 -- 172.21.15.7:0/760353886 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f6d740109d0 con 0x7f6d78101de0 2024-09-19T04:14:29.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.609+0000 7f6d6effd640 1 --2- 172.21.15.7:0/760353886 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6d640a32c0 0x7f6d640a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:29.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.609+0000 7f6d7d493640 1 --2- 172.21.15.7:0/760353886 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6d640a32c0 0x7f6d640a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:29.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.609+0000 7f6d6effd640 1 -- 172.21.15.7:0/760353886 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f6d740cf030 con 0x7f6d78101de0 2024-09-19T04:14:29.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.611+0000 7f6d7d493640 1 --2- 172.21.15.7:0/760353886 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6d640a32c0 0x7f6d640a5780 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6d781087b0 tx=0x7f6d68005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:29.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.613+0000 7f6d6effd640 1 -- 172.21.15.7:0/760353886 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6d74009de0 con 0x7f6d78101de0 2024-09-19T04:14:29.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:29.792+0000 7f6d7fef8640 1 -- 172.21.15.7:0/760353886 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f6d781998d0 con 0x7f6d78101de0 2024-09-19T04:14:30.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:30.275+0000 7f6d6effd640 1 -- 172.21.15.7:0/760353886 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) ==== 138+0+0 (secure 0 0 0) 0x7f6d781998d0 con 0x7f6d78101de0 2024-09-19T04:14:30.278 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2024-09-19T04:14:30.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:30.278+0000 7f6d7fef8640 1 -- 172.21.15.7:0/760353886 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6d640a32c0 msgr2=0x7f6d640a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:30.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:30.278+0000 7f6d7fef8640 1 --2- 172.21.15.7:0/760353886 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6d640a32c0 0x7f6d640a5780 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6d781087b0 tx=0x7f6d68005a20 comp rx=0 tx=0).stop 2024-09-19T04:14:30.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:30.278+0000 7f6d7fef8640 1 -- 172.21.15.7:0/760353886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d78101de0 msgr2=0x7f6d78198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:30.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:30.278+0000 7f6d7fef8640 1 --2- 172.21.15.7:0/760353886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d78101de0 0x7f6d78198570 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400d950 tx=0x7f6d7400de10 comp rx=0 tx=0).stop 2024-09-19T04:14:30.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:30.278+0000 7f6d7fef8640 1 -- 172.21.15.7:0/760353886 shutdown_connections 2024-09-19T04:14:30.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:30.278+0000 7f6d7fef8640 1 --2- 172.21.15.7:0/760353886 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6d640a32c0 0x7f6d640a5780 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:30.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:30.278+0000 7f6d7fef8640 1 --2- 172.21.15.7:0/760353886 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d78106f10 0x7f6d7819ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:30.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:30.278+0000 7f6d7fef8640 1 --2- 172.21.15.7:0/760353886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d78102790 0x7f6d78198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:30.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:30.278+0000 7f6d7fef8640 1 --2- 172.21.15.7:0/760353886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d78101de0 0x7f6d78198570 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:30.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:30.278+0000 7f6d7fef8640 1 -- 172.21.15.7:0/760353886 >> 172.21.15.7:0/760353886 conn(0x7f6d780fd8c0 msgr2=0x7f6d780fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:30.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:30.278+0000 7f6d7fef8640 1 -- 172.21.15.7:0/760353886 shutdown_connections 2024-09-19T04:14:30.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:30.279+0000 7f6d7fef8640 1 -- 172.21.15.7:0/760353886 wait complete. 2024-09-19T04:14:30.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:30 smithi092 ceph-mon[34940]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:30.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:30 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/760353886' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T04:14:30.566 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:30 smithi007 ceph-mon[31360]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:30.566 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:30 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/760353886' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T04:14:30.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:30 smithi102 ceph-mon[35446]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:30.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:30 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/760353886' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T04:14:30.896 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-19T04:14:31.158 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:14:31.546 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:31 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/760353886' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T04:14:31.546 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:31 smithi007 ceph-mon[31360]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T04:14:31.546 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:31 smithi007 ceph-mon[31360]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T04:14:31.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:31 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/760353886' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T04:14:31.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:31 smithi092 ceph-mon[34940]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T04:14:31.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:31 smithi092 ceph-mon[34940]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T04:14:31.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.632+0000 7fb0644ad640 1 -- 172.21.15.7:0/1499818334 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb05c100e20 msgr2=0x7fb05c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:31.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.632+0000 7fb0644ad640 1 --2- 172.21.15.7:0/1499818334 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb05c100e20 0x7fb05c101200 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb058009900 tx=0x7fb05802a480 comp rx=0 tx=0).stop 2024-09-19T04:14:31.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.632+0000 7fb0644ad640 1 -- 172.21.15.7:0/1499818334 shutdown_connections 2024-09-19T04:14:31.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.632+0000 7fb0644ad640 1 --2- 172.21.15.7:0/1499818334 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb05c102ef0 0x7fb05c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:31.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.632+0000 7fb0644ad640 1 --2- 172.21.15.7:0/1499818334 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb05c102570 0x7fb05c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:31.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.632+0000 7fb0644ad640 1 --2- 172.21.15.7:0/1499818334 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb05c100e20 0x7fb05c101200 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:31.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.632+0000 7fb0644ad640 1 -- 172.21.15.7:0/1499818334 >> 172.21.15.7:0/1499818334 conn(0x7fb05c0fc7d0 msgr2=0x7fb05c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:31.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.632+0000 7fb0644ad640 1 -- 172.21.15.7:0/1499818334 shutdown_connections 2024-09-19T04:14:31.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.632+0000 7fb0644ad640 1 -- 172.21.15.7:0/1499818334 wait complete. 2024-09-19T04:14:31.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.632+0000 7fb0644ad640 1 Processor -- start 2024-09-19T04:14:31.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.632+0000 7fb0644ad640 1 -- start start 2024-09-19T04:14:31.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.633+0000 7fb0644ad640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb05c100e20 0x7fb05c198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:31.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.633+0000 7fb0644ad640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb05c102570 0x7fb05c198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:31.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.633+0000 7fb0644ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb05c102ef0 0x7fb05c19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:31.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.633+0000 7fb0644ad640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb05c110f80 con 0x7fb05c102570 2024-09-19T04:14:31.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.633+0000 7fb0644ad640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb05c110e00 con 0x7fb05c102ef0 2024-09-19T04:14:31.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.633+0000 7fb0644ad640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb05c111100 con 0x7fb05c100e20 2024-09-19T04:14:31.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.633+0000 7fb061a48640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb05c102570 0x7fb05c198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:31.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.633+0000 7fb062249640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb05c100e20 0x7fb05c198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:31.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.633+0000 7fb061a48640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb05c102570 0x7fb05c198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42328/0 (socket says 172.21.15.7:42328) 2024-09-19T04:14:31.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.633+0000 7fb061a48640 1 -- 172.21.15.7:0/396059156 learned_addr learned my addr 172.21.15.7:0/396059156 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:14:31.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.633+0000 7fb062a4a640 1 --2- 172.21.15.7:0/396059156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb05c102ef0 0x7fb05c19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:31.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.633+0000 7fb061a48640 1 -- 172.21.15.7:0/396059156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb05c100e20 msgr2=0x7fb05c198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:31.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.633+0000 7fb061a48640 1 --2- 172.21.15.7:0/396059156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb05c100e20 0x7fb05c198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:31.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.633+0000 7fb061a48640 1 -- 172.21.15.7:0/396059156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb05c102ef0 msgr2=0x7fb05c19cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:31.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.633+0000 7fb061a48640 1 --2- 172.21.15.7:0/396059156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb05c102ef0 0x7fb05c19cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:31.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.633+0000 7fb061a48640 1 -- 172.21.15.7:0/396059156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb05c19d4d0 con 0x7fb05c102570 2024-09-19T04:14:31.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.633+0000 7fb062a4a640 1 --2- 172.21.15.7:0/396059156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb05c102ef0 0x7fb05c19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:14:31.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.633+0000 7fb061a48640 1 --2- 172.21.15.7:0/396059156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb05c102570 0x7fb05c198a60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00d950 tx=0x7fb04c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:31.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.633+0000 7fb0537fe640 1 -- 172.21.15.7:0/396059156 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c017070 con 0x7fb05c102570 2024-09-19T04:14:31.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.634+0000 7fb0644ad640 1 -- 172.21.15.7:0/396059156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb05c19d7c0 con 0x7fb05c102570 2024-09-19T04:14:31.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.634+0000 7fb0537fe640 1 -- 172.21.15.7:0/396059156 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb04c009c30 con 0x7fb05c102570 2024-09-19T04:14:31.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.634+0000 7fb0537fe640 1 -- 172.21.15.7:0/396059156 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c00f6b0 con 0x7fb05c102570 2024-09-19T04:14:31.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.634+0000 7fb0644ad640 1 -- 172.21.15.7:0/396059156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb05c1a50a0 con 0x7fb05c102570 2024-09-19T04:14:31.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.635+0000 7fb0644ad640 1 -- 172.21.15.7:0/396059156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb05c101200 con 0x7fb05c102570 2024-09-19T04:14:31.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.636+0000 7fb0537fe640 1 -- 172.21.15.7:0/396059156 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fb04c0109d0 con 0x7fb05c102570 2024-09-19T04:14:31.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.637+0000 7fb0537fe640 1 --2- 172.21.15.7:0/396059156 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb0480a3240 0x7fb0480a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:31.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.637+0000 7fb062249640 1 --2- 172.21.15.7:0/396059156 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb0480a3240 0x7fb0480a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:31.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.637+0000 7fb0537fe640 1 -- 172.21.15.7:0/396059156 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7497+0+0 (secure 0 0 0) 0x7fb04c0cf2b0 con 0x7fb05c102570 2024-09-19T04:14:31.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.637+0000 7fb062249640 1 --2- 172.21.15.7:0/396059156 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb0480a3240 0x7fb0480a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb058009230 tx=0x7fb0580058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:31.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.640+0000 7fb0537fe640 1 -- 172.21.15.7:0/396059156 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb04c009de0 con 0x7fb05c102570 2024-09-19T04:14:31.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:31 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/760353886' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T04:14:31.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:31 smithi102 ceph-mon[35446]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T04:14:31.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:31 smithi102 ceph-mon[35446]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T04:14:31.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:31.815+0000 7fb0644ad640 1 -- 172.21.15.7:0/396059156 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fb05c1a52a0 con 0x7fb05c102570 2024-09-19T04:14:32.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:32.286+0000 7fb0537fe640 1 -- 172.21.15.7:0/396059156 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v78) ==== 171+0+0 (secure 0 0 0) 0x7fb04c09c260 con 0x7fb05c102570 2024-09-19T04:14:32.289 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2024-09-19T04:14:32.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:32.288+0000 7fb0644ad640 1 -- 172.21.15.7:0/396059156 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb0480a3240 msgr2=0x7fb0480a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:32.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:32.288+0000 7fb0644ad640 1 --2- 172.21.15.7:0/396059156 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb0480a3240 0x7fb0480a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb058009230 tx=0x7fb0580058d0 comp rx=0 tx=0).stop 2024-09-19T04:14:32.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:32.288+0000 7fb0644ad640 1 -- 172.21.15.7:0/396059156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb05c102570 msgr2=0x7fb05c198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:32.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:32.288+0000 7fb0644ad640 1 --2- 172.21.15.7:0/396059156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb05c102570 0x7fb05c198a60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00d950 tx=0x7fb04c00de10 comp rx=0 tx=0).stop 2024-09-19T04:14:32.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:32.288+0000 7fb0644ad640 1 -- 172.21.15.7:0/396059156 shutdown_connections 2024-09-19T04:14:32.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:32.288+0000 7fb0644ad640 1 --2- 172.21.15.7:0/396059156 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb0480a3240 0x7fb0480a5700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:32.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:32.288+0000 7fb0644ad640 1 --2- 172.21.15.7:0/396059156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb05c102ef0 0x7fb05c19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:32.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:32.288+0000 7fb0644ad640 1 --2- 172.21.15.7:0/396059156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb05c102570 0x7fb05c198a60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:32.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:32.288+0000 7fb0644ad640 1 --2- 172.21.15.7:0/396059156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb05c100e20 0x7fb05c198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:32.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:32.288+0000 7fb0644ad640 1 -- 172.21.15.7:0/396059156 >> 172.21.15.7:0/396059156 conn(0x7fb05c0fc7d0 msgr2=0x7fb05c06a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:32.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:32.288+0000 7fb0644ad640 1 -- 172.21.15.7:0/396059156 shutdown_connections 2024-09-19T04:14:32.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:32.288+0000 7fb0644ad640 1 -- 172.21.15.7:0/396059156 wait complete. 2024-09-19T04:14:32.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:32 smithi007 ceph-mon[31360]: pgmap v269: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:32.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:32 smithi007 ceph-mon[31360]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T04:14:32.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:32 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/396059156' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-19T04:14:32.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:32 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/396059156' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-19T04:14:32.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:32 smithi102 ceph-mon[35446]: pgmap v269: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:32.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:32 smithi102 ceph-mon[35446]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T04:14:32.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:32 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/396059156' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-19T04:14:32.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:32 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/396059156' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-19T04:14:32.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:32 smithi092 ceph-mon[34940]: pgmap v269: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:32.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:32 smithi092 ceph-mon[34940]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T04:14:32.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:32 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/396059156' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-19T04:14:32.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:32 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/396059156' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-19T04:14:33.013 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T04:14:33.268 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:14:33.563 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:33 smithi007 ceph-mon[31360]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T04:14:33.563 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:33 smithi007 ceph-mon[31360]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T04:14:33.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:33 smithi102 ceph-mon[35446]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T04:14:33.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:33 smithi102 ceph-mon[35446]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T04:14:33.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.780+0000 7ff89955a640 1 -- 172.21.15.7:0/2479445888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff894103780 msgr2=0x7ff894107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.780+0000 7ff89955a640 1 --2- 172.21.15.7:0/2479445888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff894103780 0x7ff894107bc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff87c009930 tx=0x7ff87c02a420 comp rx=0 tx=0).stop 2024-09-19T04:14:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.780+0000 7ff89955a640 1 -- 172.21.15.7:0/2479445888 shutdown_connections 2024-09-19T04:14:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.780+0000 7ff89955a640 1 --2- 172.21.15.7:0/2479445888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff894108300 0x7ff89410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.780+0000 7ff89955a640 1 --2- 172.21.15.7:0/2479445888 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff894103780 0x7ff894107bc0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.780+0000 7ff89955a640 1 --2- 172.21.15.7:0/2479445888 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff894102dd0 0x7ff8941031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.780+0000 7ff89955a640 1 -- 172.21.15.7:0/2479445888 >> 172.21.15.7:0/2479445888 conn(0x7ff8940fc7d0 msgr2=0x7ff8940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.781+0000 7ff89955a640 1 -- 172.21.15.7:0/2479445888 shutdown_connections 2024-09-19T04:14:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.781+0000 7ff89955a640 1 -- 172.21.15.7:0/2479445888 wait complete. 2024-09-19T04:14:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.781+0000 7ff89955a640 1 Processor -- start 2024-09-19T04:14:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.781+0000 7ff89955a640 1 -- start start 2024-09-19T04:14:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.781+0000 7ff89955a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff894102dd0 0x7ff8941985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:33.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.781+0000 7ff89955a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff894103780 0x7ff894198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.781+0000 7ff89955a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff894108300 0x7ff89419cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.781+0000 7ff89955a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff894112070 con 0x7ff894102dd0 2024-09-19T04:14:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.781+0000 7ff89955a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff894111ef0 con 0x7ff894103780 2024-09-19T04:14:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.781+0000 7ff89955a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff8941121f0 con 0x7ff894108300 2024-09-19T04:14:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.781+0000 7ff892ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff894102dd0 0x7ff8941985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.782+0000 7ff892ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff894102dd0 0x7ff8941985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42338/0 (socket says 172.21.15.7:42338) 2024-09-19T04:14:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.782+0000 7ff892ffd640 1 -- 172.21.15.7:0/1574772177 learned_addr learned my addr 172.21.15.7:0/1574772177 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:14:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.782+0000 7ff8937fe640 1 --2- 172.21.15.7:0/1574772177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff894108300 0x7ff89419cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.782+0000 7ff88bfff640 1 --2- 172.21.15.7:0/1574772177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff894103780 0x7ff894198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.782+0000 7ff892ffd640 1 -- 172.21.15.7:0/1574772177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff894108300 msgr2=0x7ff89419cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.782+0000 7ff892ffd640 1 --2- 172.21.15.7:0/1574772177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff894108300 0x7ff89419cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.782+0000 7ff892ffd640 1 -- 172.21.15.7:0/1574772177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff894103780 msgr2=0x7ff894198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.782+0000 7ff892ffd640 1 --2- 172.21.15.7:0/1574772177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff894103780 0x7ff894198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:33.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.782+0000 7ff892ffd640 1 -- 172.21.15.7:0/1574772177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff89419d5a0 con 0x7ff894102dd0 2024-09-19T04:14:33.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.782+0000 7ff892ffd640 1 --2- 172.21.15.7:0/1574772177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff894102dd0 0x7ff8941985f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff88400c890 tx=0x7ff88400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:33.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.782+0000 7ff890ff9640 1 -- 172.21.15.7:0/1574772177 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff884004220 con 0x7ff894102dd0 2024-09-19T04:14:33.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.782+0000 7ff890ff9640 1 -- 172.21.15.7:0/1574772177 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8840043c0 con 0x7ff894102dd0 2024-09-19T04:14:33.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.782+0000 7ff89955a640 1 -- 172.21.15.7:0/1574772177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff89419d890 con 0x7ff894102dd0 2024-09-19T04:14:33.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.782+0000 7ff890ff9640 1 -- 172.21.15.7:0/1574772177 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8840049e0 con 0x7ff894102dd0 2024-09-19T04:14:33.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.782+0000 7ff89955a640 1 -- 172.21.15.7:0/1574772177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8941a5170 con 0x7ff894102dd0 2024-09-19T04:14:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.783+0000 7ff89955a640 1 -- 172.21.15.7:0/1574772177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8941031b0 con 0x7ff894102dd0 2024-09-19T04:14:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.785+0000 7ff890ff9640 1 -- 172.21.15.7:0/1574772177 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7ff8840079b0 con 0x7ff894102dd0 2024-09-19T04:14:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.785+0000 7ff890ff9640 1 --2- 172.21.15.7:0/1574772177 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff8800a3240 0x7ff8800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.786+0000 7ff890ff9640 1 -- 172.21.15.7:0/1574772177 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7879+0+0 (secure 0 0 0) 0x7ff8840cfa30 con 0x7ff894102dd0 2024-09-19T04:14:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.786+0000 7ff88bfff640 1 --2- 172.21.15.7:0/1574772177 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff8800a3240 0x7ff8800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.786+0000 7ff88bfff640 1 --2- 172.21.15.7:0/1574772177 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff8800a3240 0x7ff8800a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff87c009230 tx=0x7ff87c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:33.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:33.789+0000 7ff890ff9640 1 -- 172.21.15.7:0/1574772177 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff884014030 con 0x7ff894102dd0 2024-09-19T04:14:33.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:33 smithi092 ceph-mon[34940]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T04:14:33.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:33 smithi092 ceph-mon[34940]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T04:14:34.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:34.005+0000 7ff89955a640 1 -- 172.21.15.7:0/1574772177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff894199950 con 0x7ff894102dd0 2024-09-19T04:14:34.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:34.316+0000 7ff890ff9640 1 -- 172.21.15.7:0/1574772177 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7ff88409c900 con 0x7ff894102dd0 2024-09-19T04:14:34.319 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T04:14:34.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:34.319+0000 7ff89955a640 1 -- 172.21.15.7:0/1574772177 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff8800a3240 msgr2=0x7ff8800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:34.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:34.319+0000 7ff89955a640 1 --2- 172.21.15.7:0/1574772177 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff8800a3240 0x7ff8800a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff87c009230 tx=0x7ff87c000bc0 comp rx=0 tx=0).stop 2024-09-19T04:14:34.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:34.319+0000 7ff89955a640 1 -- 172.21.15.7:0/1574772177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff894102dd0 msgr2=0x7ff8941985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:34.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:34.319+0000 7ff89955a640 1 --2- 172.21.15.7:0/1574772177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff894102dd0 0x7ff8941985f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff88400c890 tx=0x7ff88400cd50 comp rx=0 tx=0).stop 2024-09-19T04:14:34.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:34.319+0000 7ff89955a640 1 -- 172.21.15.7:0/1574772177 shutdown_connections 2024-09-19T04:14:34.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:34.319+0000 7ff89955a640 1 --2- 172.21.15.7:0/1574772177 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff8800a3240 0x7ff8800a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:34.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:34.319+0000 7ff89955a640 1 --2- 172.21.15.7:0/1574772177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff894108300 0x7ff89419cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:34.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:34.319+0000 7ff89955a640 1 --2- 172.21.15.7:0/1574772177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff894103780 0x7ff894198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:34.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:34.319+0000 7ff89955a640 1 --2- 172.21.15.7:0/1574772177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff894102dd0 0x7ff8941985f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:34.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:34.319+0000 7ff89955a640 1 -- 172.21.15.7:0/1574772177 >> 172.21.15.7:0/1574772177 conn(0x7ff8940fc7d0 msgr2=0x7ff894105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:34.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:34.319+0000 7ff89955a640 1 -- 172.21.15.7:0/1574772177 shutdown_connections 2024-09-19T04:14:34.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:34.319+0000 7ff89955a640 1 -- 172.21.15.7:0/1574772177 wait complete. 2024-09-19T04:14:34.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:34 smithi007 ceph-mon[31360]: pgmap v272: 97 pgs: 32 creating+peering, 46 unknown, 19 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:34.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:34 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1574772177' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T04:14:34.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:34 smithi007 ceph-mon[31360]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T04:14:34.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:34 smithi102 ceph-mon[35446]: pgmap v272: 97 pgs: 32 creating+peering, 46 unknown, 19 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:34.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:34 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1574772177' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T04:14:34.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:34 smithi102 ceph-mon[35446]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T04:14:34.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:34 smithi092 ceph-mon[34940]: pgmap v272: 97 pgs: 32 creating+peering, 46 unknown, 19 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:34.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:34 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1574772177' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T04:14:34.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:34 smithi092 ceph-mon[34940]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T04:14:35.016 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-19T04:14:35.016 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-19T04:14:35.273 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:14:35.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:35 smithi007 ceph-mon[31360]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T04:14:35.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:35 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1574772177' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T04:14:35.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:35 smithi007 ceph-mon[31360]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T04:14:35.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:35 smithi007 ceph-mon[31360]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T04:14:35.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:35 smithi102 ceph-mon[35446]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T04:14:35.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:35 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1574772177' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T04:14:35.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:35 smithi102 ceph-mon[35446]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T04:14:35.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:35 smithi102 ceph-mon[35446]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T04:14:35.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.734+0000 7f4f75702640 1 -- 172.21.15.7:0/1523577448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f70103660 msgr2=0x7f4f7010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:35.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.734+0000 7f4f75702640 1 --2- 172.21.15.7:0/1523577448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f70103660 0x7f4f7010bb50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4f58009900 tx=0x7f4f5802a480 comp rx=0 tx=0).stop 2024-09-19T04:14:35.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.734+0000 7f4f75702640 1 -- 172.21.15.7:0/1523577448 shutdown_connections 2024-09-19T04:14:35.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.734+0000 7f4f75702640 1 --2- 172.21.15.7:0/1523577448 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f7010c170 0x7f4f7010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:35.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.734+0000 7f4f75702640 1 --2- 172.21.15.7:0/1523577448 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f70103660 0x7f4f7010bb50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:35.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.734+0000 7f4f75702640 1 --2- 172.21.15.7:0/1523577448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f70102d40 0x7f4f70103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:35.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.734+0000 7f4f75702640 1 -- 172.21.15.7:0/1523577448 >> 172.21.15.7:0/1523577448 conn(0x7f4f700fc7a0 msgr2=0x7f4f700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:35.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.734+0000 7f4f75702640 1 -- 172.21.15.7:0/1523577448 shutdown_connections 2024-09-19T04:14:35.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.734+0000 7f4f75702640 1 -- 172.21.15.7:0/1523577448 wait complete. 2024-09-19T04:14:35.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.735+0000 7f4f75702640 1 Processor -- start 2024-09-19T04:14:35.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.735+0000 7f4f75702640 1 -- start start 2024-09-19T04:14:35.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.735+0000 7f4f75702640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f70102d40 0x7f4f701009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:35.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.735+0000 7f4f75702640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f70103660 0x7f4f70100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:35.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.735+0000 7f4f75702640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f7010c170 0x7f4f70101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:35.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.735+0000 7f4f75702640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4f70111f70 con 0x7f4f70103660 2024-09-19T04:14:35.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.735+0000 7f4f75702640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4f70111df0 con 0x7f4f70102d40 2024-09-19T04:14:35.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.735+0000 7f4f75702640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4f701120f0 con 0x7f4f7010c170 2024-09-19T04:14:35.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.735+0000 7f4f67fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f70103660 0x7f4f70100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:35.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.735+0000 7f4f67fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f70103660 0x7f4f70100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42360/0 (socket says 172.21.15.7:42360) 2024-09-19T04:14:35.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.735+0000 7f4f67fff640 1 -- 172.21.15.7:0/420668925 learned_addr learned my addr 172.21.15.7:0/420668925 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:14:35.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.735+0000 7f4f6f7fe640 1 --2- 172.21.15.7:0/420668925 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f7010c170 0x7f4f70101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:35.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.735+0000 7f4f6effd640 1 --2- 172.21.15.7:0/420668925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f70102d40 0x7f4f701009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:35.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.735+0000 7f4f67fff640 1 -- 172.21.15.7:0/420668925 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f7010c170 msgr2=0x7f4f70101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:35.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.735+0000 7f4f67fff640 1 --2- 172.21.15.7:0/420668925 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f7010c170 0x7f4f70101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:35.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.735+0000 7f4f67fff640 1 -- 172.21.15.7:0/420668925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f70102d40 msgr2=0x7f4f701009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:35.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.735+0000 7f4f67fff640 1 --2- 172.21.15.7:0/420668925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f70102d40 0x7f4f701009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:35.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.735+0000 7f4f67fff640 1 -- 172.21.15.7:0/420668925 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f701a6930 con 0x7f4f70103660 2024-09-19T04:14:35.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.736+0000 7f4f67fff640 1 --2- 172.21.15.7:0/420668925 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f70103660 0x7f4f70100ee0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4f58006010 tx=0x7f4f58004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:35.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.736+0000 7f4f6cff9640 1 -- 172.21.15.7:0/420668925 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f5803f030 con 0x7f4f70103660 2024-09-19T04:14:35.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.736+0000 7f4f75702640 1 -- 172.21.15.7:0/420668925 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f701a6bc0 con 0x7f4f70103660 2024-09-19T04:14:35.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.736+0000 7f4f6cff9640 1 -- 172.21.15.7:0/420668925 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f58004440 con 0x7f4f70103660 2024-09-19T04:14:35.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.736+0000 7f4f6cff9640 1 -- 172.21.15.7:0/420668925 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f58035070 con 0x7f4f70103660 2024-09-19T04:14:35.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.736+0000 7f4f75702640 1 -- 172.21.15.7:0/420668925 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f701a70f0 con 0x7f4f70103660 2024-09-19T04:14:35.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.737+0000 7f4f75702640 1 -- 172.21.15.7:0/420668925 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f70103120 con 0x7f4f70103660 2024-09-19T04:14:35.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.738+0000 7f4f6cff9640 1 -- 172.21.15.7:0/420668925 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f4f58042030 con 0x7f4f70103660 2024-09-19T04:14:35.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.739+0000 7f4f6cff9640 1 --2- 172.21.15.7:0/420668925 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4f5c0a3240 0x7f4f5c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:35.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.739+0000 7f4f6effd640 1 --2- 172.21.15.7:0/420668925 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4f5c0a3240 0x7f4f5c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:35.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.739+0000 7f4f6cff9640 1 -- 172.21.15.7:0/420668925 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f4f580efe90 con 0x7f4f70103660 2024-09-19T04:14:35.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.739+0000 7f4f6effd640 1 --2- 172.21.15.7:0/420668925 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4f5c0a3240 0x7f4f5c0a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4f60009aa0 tx=0x7f4f60005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:35.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.742+0000 7f4f6cff9640 1 -- 172.21.15.7:0/420668925 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4f580bcd00 con 0x7f4f70103660 2024-09-19T04:14:35.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:35 smithi092 ceph-mon[34940]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T04:14:35.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:35 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1574772177' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T04:14:35.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:35 smithi092 ceph-mon[34940]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T04:14:35.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:35 smithi092 ceph-mon[34940]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T04:14:35.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:35.927+0000 7f4f75702640 1 -- 172.21.15.7:0/420668925 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f4f7002d7c0 con 0x7f4f70103660 2024-09-19T04:14:36.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:36.331+0000 7f4f6cff9640 1 -- 172.21.15.7:0/420668925 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v81) ==== 157+0+0 (secure 0 0 0) 0x7f4f580bc600 con 0x7f4f70103660 2024-09-19T04:14:36.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:36.334+0000 7f4f75702640 1 -- 172.21.15.7:0/420668925 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4f5c0a3240 msgr2=0x7f4f5c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:36.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:36.334+0000 7f4f75702640 1 --2- 172.21.15.7:0/420668925 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4f5c0a3240 0x7f4f5c0a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4f60009aa0 tx=0x7f4f60005f90 comp rx=0 tx=0).stop 2024-09-19T04:14:36.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:36.334+0000 7f4f75702640 1 -- 172.21.15.7:0/420668925 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f70103660 msgr2=0x7f4f70100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:36.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:36.334+0000 7f4f75702640 1 --2- 172.21.15.7:0/420668925 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f70103660 0x7f4f70100ee0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4f58006010 tx=0x7f4f58004040 comp rx=0 tx=0).stop 2024-09-19T04:14:36.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:36.334+0000 7f4f75702640 1 -- 172.21.15.7:0/420668925 shutdown_connections 2024-09-19T04:14:36.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:36.334+0000 7f4f75702640 1 --2- 172.21.15.7:0/420668925 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4f5c0a3240 0x7f4f5c0a5700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:36.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:36.334+0000 7f4f75702640 1 --2- 172.21.15.7:0/420668925 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f7010c170 0x7f4f70101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:36.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:36.334+0000 7f4f75702640 1 --2- 172.21.15.7:0/420668925 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f70103660 0x7f4f70100ee0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:36.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:36.334+0000 7f4f75702640 1 --2- 172.21.15.7:0/420668925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f70102d40 0x7f4f701009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:36.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:36.334+0000 7f4f75702640 1 -- 172.21.15.7:0/420668925 >> 172.21.15.7:0/420668925 conn(0x7f4f700fc7a0 msgr2=0x7f4f700fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:36.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:36.334+0000 7f4f75702640 1 -- 172.21.15.7:0/420668925 shutdown_connections 2024-09-19T04:14:36.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:36.334+0000 7f4f75702640 1 -- 172.21.15.7:0/420668925 wait complete. 2024-09-19T04:14:36.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:36 smithi007 ceph-mon[31360]: pgmap v275: 97 pgs: 32 creating+peering, 8 unknown, 57 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 0 op/s 2024-09-19T04:14:36.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:36 smithi007 ceph-mon[31360]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T04:14:36.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:36 smithi007 ceph-mon[31360]: Cluster is now healthy 2024-09-19T04:14:36.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:36 smithi007 ceph-mon[31360]: mds.? [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] up:active 2024-09-19T04:14:36.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:36 smithi007 ceph-mon[31360]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T04:14:36.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:36 smithi007 ceph-mon[31360]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T04:14:36.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:36 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/420668925' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-19T04:14:36.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:36 smithi102 ceph-mon[35446]: pgmap v275: 97 pgs: 32 creating+peering, 8 unknown, 57 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 0 op/s 2024-09-19T04:14:36.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:36 smithi102 ceph-mon[35446]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T04:14:36.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:36 smithi102 ceph-mon[35446]: Cluster is now healthy 2024-09-19T04:14:36.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:36 smithi102 ceph-mon[35446]: mds.? [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] up:active 2024-09-19T04:14:36.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:36 smithi102 ceph-mon[35446]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T04:14:36.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:36 smithi102 ceph-mon[35446]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T04:14:36.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:36 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/420668925' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-19T04:14:36.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:36 smithi092 ceph-mon[34940]: pgmap v275: 97 pgs: 32 creating+peering, 8 unknown, 57 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 0 op/s 2024-09-19T04:14:36.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:36 smithi092 ceph-mon[34940]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T04:14:36.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:36 smithi092 ceph-mon[34940]: Cluster is now healthy 2024-09-19T04:14:36.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:36 smithi092 ceph-mon[34940]: mds.? [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] up:active 2024-09-19T04:14:36.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:36 smithi092 ceph-mon[34940]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T04:14:36.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:36 smithi092 ceph-mon[34940]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T04:14:36.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:36 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/420668925' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-19T04:14:36.972 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T04:14:37.234 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:14:37.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:37 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/420668925' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-19T04:14:37.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:37 smithi007 ceph-mon[31360]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T04:14:37.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:37 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/420668925' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-19T04:14:37.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:37 smithi102 ceph-mon[35446]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T04:14:37.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.754+0000 7f2c8e145640 1 -- 172.21.15.7:0/4107926150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c88102d40 msgr2=0x7f2c88103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:37.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.754+0000 7f2c8e145640 1 --2- 172.21.15.7:0/4107926150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c88102d40 0x7f2c88103120 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2c78009900 tx=0x7f2c7802a480 comp rx=0 tx=0).stop 2024-09-19T04:14:37.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.754+0000 7f2c8e145640 1 -- 172.21.15.7:0/4107926150 shutdown_connections 2024-09-19T04:14:37.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.754+0000 7f2c8e145640 1 --2- 172.21.15.7:0/4107926150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c8810c170 0x7f2c8810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:37.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.754+0000 7f2c8e145640 1 --2- 172.21.15.7:0/4107926150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c88103660 0x7f2c8810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:37.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.754+0000 7f2c8e145640 1 --2- 172.21.15.7:0/4107926150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c88102d40 0x7f2c88103120 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:37.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.754+0000 7f2c8e145640 1 -- 172.21.15.7:0/4107926150 >> 172.21.15.7:0/4107926150 conn(0x7f2c880fc7a0 msgr2=0x7f2c880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:37.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.754+0000 7f2c8e145640 1 -- 172.21.15.7:0/4107926150 shutdown_connections 2024-09-19T04:14:37.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.754+0000 7f2c8e145640 1 -- 172.21.15.7:0/4107926150 wait complete. 2024-09-19T04:14:37.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.755+0000 7f2c8e145640 1 Processor -- start 2024-09-19T04:14:37.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.755+0000 7f2c8e145640 1 -- start start 2024-09-19T04:14:37.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.755+0000 7f2c8e145640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c88102d40 0x7f2c881009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:37.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.755+0000 7f2c8e145640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c88103660 0x7f2c88100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:37.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.755+0000 7f2c8e145640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c8810c170 0x7f2c88101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:37.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.755+0000 7f2c8e145640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2c88112020 con 0x7f2c88102d40 2024-09-19T04:14:37.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.755+0000 7f2c8e145640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2c88111ea0 con 0x7f2c8810c170 2024-09-19T04:14:37.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.755+0000 7f2c8e145640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2c881121a0 con 0x7f2c88103660 2024-09-19T04:14:37.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.755+0000 7f2c877fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c88102d40 0x7f2c881009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:37.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.755+0000 7f2c877fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c88102d40 0x7f2c881009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50448/0 (socket says 172.21.15.7:50448) 2024-09-19T04:14:37.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.755+0000 7f2c877fe640 1 -- 172.21.15.7:0/74017845 learned_addr learned my addr 172.21.15.7:0/74017845 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:14:37.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.756+0000 7f2c86ffd640 1 --2- 172.21.15.7:0/74017845 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c88103660 0x7f2c88100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:37.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.756+0000 7f2c87fff640 1 --2- 172.21.15.7:0/74017845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c8810c170 0x7f2c88101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:37.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.756+0000 7f2c877fe640 1 -- 172.21.15.7:0/74017845 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c88103660 msgr2=0x7f2c88100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:37.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.756+0000 7f2c877fe640 1 --2- 172.21.15.7:0/74017845 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c88103660 0x7f2c88100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:37.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.756+0000 7f2c877fe640 1 -- 172.21.15.7:0/74017845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c8810c170 msgr2=0x7f2c88101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:37.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.756+0000 7f2c877fe640 1 --2- 172.21.15.7:0/74017845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c8810c170 0x7f2c88101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:37.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.756+0000 7f2c877fe640 1 -- 172.21.15.7:0/74017845 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c881a6980 con 0x7f2c88102d40 2024-09-19T04:14:37.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.756+0000 7f2c87fff640 1 --2- 172.21.15.7:0/74017845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c8810c170 0x7f2c88101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:14:37.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.756+0000 7f2c877fe640 1 --2- 172.21.15.7:0/74017845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c88102d40 0x7f2c881009a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2c78004770 tx=0x7f2c78003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:37.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.756+0000 7f2c84ff9640 1 -- 172.21.15.7:0/74017845 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7803f070 con 0x7f2c88102d40 2024-09-19T04:14:37.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.756+0000 7f2c84ff9640 1 -- 172.21.15.7:0/74017845 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c78031ca0 con 0x7f2c88102d40 2024-09-19T04:14:37.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.756+0000 7f2c8e145640 1 -- 172.21.15.7:0/74017845 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c881a6c10 con 0x7f2c88102d40 2024-09-19T04:14:37.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.757+0000 7f2c84ff9640 1 -- 172.21.15.7:0/74017845 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78035030 con 0x7f2c88102d40 2024-09-19T04:14:37.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.757+0000 7f2c8e145640 1 -- 172.21.15.7:0/74017845 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c881a7080 con 0x7f2c88102d40 2024-09-19T04:14:37.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.758+0000 7f2c8e145640 1 -- 172.21.15.7:0/74017845 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c8806b070 con 0x7f2c88102d40 2024-09-19T04:14:37.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.759+0000 7f2c84ff9640 1 -- 172.21.15.7:0/74017845 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f2c78042070 con 0x7f2c88102d40 2024-09-19T04:14:37.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.759+0000 7f2c84ff9640 1 --2- 172.21.15.7:0/74017845 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2c700a3190 0x7f2c700a5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:37.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.760+0000 7f2c86ffd640 1 --2- 172.21.15.7:0/74017845 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2c700a3190 0x7f2c700a5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:37.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.760+0000 7f2c84ff9640 1 -- 172.21.15.7:0/74017845 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8277+0+0 (secure 0 0 0) 0x7f2c780efc10 con 0x7f2c88102d40 2024-09-19T04:14:37.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.760+0000 7f2c86ffd640 1 --2- 172.21.15.7:0/74017845 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2c700a3190 0x7f2c700a5650 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2c88102430 tx=0x7f2c7c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:37.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.764+0000 7f2c84ff9640 1 -- 172.21.15.7:0/74017845 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2c780bc8a0 con 0x7f2c88102d40 2024-09-19T04:14:37.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:37 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/420668925' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-19T04:14:37.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:37 smithi092 ceph-mon[34940]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T04:14:37.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:37.939+0000 7f2c8e145640 1 -- 172.21.15.7:0/74017845 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f2c881a7310 con 0x7f2c88102d40 2024-09-19T04:14:38.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:38 smithi007 ceph-mon[31360]: pgmap v277: 97 pgs: 32 creating+peering, 65 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 0 op/s 2024-09-19T04:14:38.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:38 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/74017845' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T04:14:38.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:38 smithi102 ceph-mon[35446]: pgmap v277: 97 pgs: 32 creating+peering, 65 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 0 op/s 2024-09-19T04:14:38.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:38 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/74017845' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T04:14:38.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:38 smithi092 ceph-mon[34940]: pgmap v277: 97 pgs: 32 creating+peering, 65 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 0 op/s 2024-09-19T04:14:38.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:38 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/74017845' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T04:14:38.797 INFO:journalctl@ceph.mds.b.smithi092.stdout:Sep 19 04:14:38 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-b[65433]: 2024-09-19T04:14:38.322+0000 7f43567f6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T04:14:39.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:39.350+0000 7f2c84ff9640 1 -- 172.21.15.7:0/74017845 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v83) ==== 228+0+0 (secure 0 0 0) 0x7f2c780bc1a0 con 0x7f2c88102d40 2024-09-19T04:14:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data_ec' created 2024-09-19T04:14:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:39.353+0000 7f2c8e145640 1 -- 172.21.15.7:0/74017845 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2c700a3190 msgr2=0x7f2c700a5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:39.353+0000 7f2c8e145640 1 --2- 172.21.15.7:0/74017845 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2c700a3190 0x7f2c700a5650 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2c88102430 tx=0x7f2c7c008040 comp rx=0 tx=0).stop 2024-09-19T04:14:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:39.353+0000 7f2c8e145640 1 -- 172.21.15.7:0/74017845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c88102d40 msgr2=0x7f2c881009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:39.353+0000 7f2c8e145640 1 --2- 172.21.15.7:0/74017845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c88102d40 0x7f2c881009a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2c78004770 tx=0x7f2c78003c10 comp rx=0 tx=0).stop 2024-09-19T04:14:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:39.353+0000 7f2c8e145640 1 -- 172.21.15.7:0/74017845 shutdown_connections 2024-09-19T04:14:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:39.353+0000 7f2c8e145640 1 --2- 172.21.15.7:0/74017845 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2c700a3190 0x7f2c700a5650 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:39.353+0000 7f2c8e145640 1 --2- 172.21.15.7:0/74017845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c8810c170 0x7f2c88101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:39.353+0000 7f2c8e145640 1 --2- 172.21.15.7:0/74017845 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c88103660 0x7f2c88100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:39.353+0000 7f2c8e145640 1 --2- 172.21.15.7:0/74017845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2c88102d40 0x7f2c881009a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:39.353+0000 7f2c8e145640 1 -- 172.21.15.7:0/74017845 >> 172.21.15.7:0/74017845 conn(0x7f2c880fc7a0 msgr2=0x7f2c880fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:39.353+0000 7f2c8e145640 1 -- 172.21.15.7:0/74017845 shutdown_connections 2024-09-19T04:14:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:39.353+0000 7f2c8e145640 1 -- 172.21.15.7:0/74017845 wait complete. 2024-09-19T04:14:39.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:39 smithi007 ceph-mon[31360]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T04:14:39.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:39 smithi102 ceph-mon[35446]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T04:14:39.678 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:39 smithi092 ceph-mon[34940]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T04:14:39.983 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-19T04:14:40.246 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:14:40.366 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:40 smithi007 ceph-mon[31360]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-19T04:14:40.367 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:40 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/74017845' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T04:14:40.367 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:40 smithi007 ceph-mon[31360]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T04:14:40.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:40 smithi092 ceph-mon[34940]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-19T04:14:40.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:40 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/74017845' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T04:14:40.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:40 smithi092 ceph-mon[34940]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T04:14:40.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:40 smithi102 ceph-mon[35446]: pgmap v279: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-19T04:14:40.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:40 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/74017845' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T04:14:40.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:40 smithi102 ceph-mon[35446]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T04:14:40.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.720+0000 7f0ac0ae0640 1 -- 172.21.15.7:0/3325254200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0abc100a80 msgr2=0x7f0abc100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:40.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.720+0000 7f0ac0ae0640 1 --2- 172.21.15.7:0/3325254200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0abc100a80 0x7f0abc100ee0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4009930 tx=0x7f0aa402a420 comp rx=0 tx=0).stop 2024-09-19T04:14:40.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.720+0000 7f0ac0ae0640 1 -- 172.21.15.7:0/3325254200 shutdown_connections 2024-09-19T04:14:40.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.720+0000 7f0ac0ae0640 1 --2- 172.21.15.7:0/3325254200 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0abc101420 0x7f0abc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:40.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.720+0000 7f0ac0ae0640 1 --2- 172.21.15.7:0/3325254200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0abc100a80 0x7f0abc100ee0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:40.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.720+0000 7f0ac0ae0640 1 --2- 172.21.15.7:0/3325254200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0abc106a80 0x7f0abc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:40.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.720+0000 7f0ac0ae0640 1 -- 172.21.15.7:0/3325254200 >> 172.21.15.7:0/3325254200 conn(0x7f0abc0fc7a0 msgr2=0x7f0abc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:40.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.720+0000 7f0ac0ae0640 1 -- 172.21.15.7:0/3325254200 shutdown_connections 2024-09-19T04:14:40.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.720+0000 7f0ac0ae0640 1 -- 172.21.15.7:0/3325254200 wait complete. 2024-09-19T04:14:40.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.721+0000 7f0ac0ae0640 1 Processor -- start 2024-09-19T04:14:40.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.721+0000 7f0ac0ae0640 1 -- start start 2024-09-19T04:14:40.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.721+0000 7f0ac0ae0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0abc100a80 0x7f0abc1992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:40.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.721+0000 7f0ac0ae0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0abc101420 0x7f0abc1997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:40.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.721+0000 7f0ac0ae0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0abc106a80 0x7f0abc1a4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:40.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.721+0000 7f0ac0ae0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0abc110e80 con 0x7f0abc106a80 2024-09-19T04:14:40.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.721+0000 7f0ac0ae0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0abc110d00 con 0x7f0abc101420 2024-09-19T04:14:40.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.721+0000 7f0ac0ae0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0abc111000 con 0x7f0abc100a80 2024-09-19T04:14:40.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.721+0000 7f0abad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0abc106a80 0x7f0abc1a4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:40.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.722+0000 7f0abad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0abc106a80 0x7f0abc1a4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50454/0 (socket says 172.21.15.7:50454) 2024-09-19T04:14:40.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.722+0000 7f0abad9d640 1 -- 172.21.15.7:0/2467386061 learned_addr learned my addr 172.21.15.7:0/2467386061 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:14:40.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.722+0000 7f0aba59c640 1 --2- 172.21.15.7:0/2467386061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0abc100a80 0x7f0abc1992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:40.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.722+0000 7f0ab3fff640 1 --2- 172.21.15.7:0/2467386061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0abc101420 0x7f0abc1997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:40.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.722+0000 7f0abad9d640 1 -- 172.21.15.7:0/2467386061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0abc100a80 msgr2=0x7f0abc1992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:40.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.722+0000 7f0abad9d640 1 --2- 172.21.15.7:0/2467386061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0abc100a80 0x7f0abc1992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:40.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.722+0000 7f0abad9d640 1 -- 172.21.15.7:0/2467386061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0abc101420 msgr2=0x7f0abc1997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:40.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.722+0000 7f0abad9d640 1 --2- 172.21.15.7:0/2467386061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0abc101420 0x7f0abc1997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:40.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.722+0000 7f0abad9d640 1 -- 172.21.15.7:0/2467386061 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0abc1a4860 con 0x7f0abc106a80 2024-09-19T04:14:40.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.722+0000 7f0abad9d640 1 --2- 172.21.15.7:0/2467386061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0abc106a80 0x7f0abc1a4320 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400eaa0 tx=0x7f0ab400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:40.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.722+0000 7f0ab37fe640 1 -- 172.21.15.7:0/2467386061 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab400cdb0 con 0x7f0abc106a80 2024-09-19T04:14:40.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.722+0000 7f0ac0ae0640 1 -- 172.21.15.7:0/2467386061 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0abc1a4a30 con 0x7f0abc106a80 2024-09-19T04:14:40.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.722+0000 7f0ab37fe640 1 -- 172.21.15.7:0/2467386061 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ab4005020 con 0x7f0abc106a80 2024-09-19T04:14:40.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.722+0000 7f0ab37fe640 1 -- 172.21.15.7:0/2467386061 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab40116d0 con 0x7f0abc106a80 2024-09-19T04:14:40.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.722+0000 7f0ac0ae0640 1 -- 172.21.15.7:0/2467386061 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0abc1a4f40 con 0x7f0abc106a80 2024-09-19T04:14:40.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.723+0000 7f0ac0ae0640 1 -- 172.21.15.7:0/2467386061 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0abc100ee0 con 0x7f0abc106a80 2024-09-19T04:14:40.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.725+0000 7f0ab37fe640 1 -- 172.21.15.7:0/2467386061 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f0ab40054d0 con 0x7f0abc106a80 2024-09-19T04:14:40.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.726+0000 7f0ab37fe640 1 --2- 172.21.15.7:0/2467386061 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f0aa80a3240 0x7f0aa80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:40.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.726+0000 7f0ab37fe640 1 -- 172.21.15.7:0/2467386061 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8770+0+0 (secure 0 0 0) 0x7f0ab40d0050 con 0x7f0abc106a80 2024-09-19T04:14:40.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.726+0000 7f0aba59c640 1 --2- 172.21.15.7:0/2467386061 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f0aa80a3240 0x7f0aa80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:40.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.726+0000 7f0aba59c640 1 --2- 172.21.15.7:0/2467386061 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f0aa80a3240 0x7f0aa80a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0aac005d00 tx=0x7f0aac00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:40.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.729+0000 7f0ab37fe640 1 -- 172.21.15.7:0/2467386061 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0ab4016030 con 0x7f0abc106a80 2024-09-19T04:14:40.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:40.904+0000 7f0ac0ae0640 1 -- 172.21.15.7:0/2467386061 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f0abc108a80 con 0x7f0abc106a80 2024-09-19T04:14:41.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:41.363+0000 7f0ab37fe640 1 -- 172.21.15.7:0/2467386061 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v85) ==== 169+0+0 (secure 0 0 0) 0x7f0ab409c500 con 0x7f0abc106a80 2024-09-19T04:14:41.364 INFO:teuthology.orchestra.run.smithi007.stderr:set pool 4 allow_ec_overwrites to true 2024-09-19T04:14:41.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:41.366+0000 7f0ac0ae0640 1 -- 172.21.15.7:0/2467386061 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f0aa80a3240 msgr2=0x7f0aa80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:41.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:41.366+0000 7f0ac0ae0640 1 --2- 172.21.15.7:0/2467386061 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f0aa80a3240 0x7f0aa80a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0aac005d00 tx=0x7f0aac00b410 comp rx=0 tx=0).stop 2024-09-19T04:14:41.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:41.366+0000 7f0ac0ae0640 1 -- 172.21.15.7:0/2467386061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0abc106a80 msgr2=0x7f0abc1a4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:41.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:41.366+0000 7f0ac0ae0640 1 --2- 172.21.15.7:0/2467386061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0abc106a80 0x7f0abc1a4320 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400eaa0 tx=0x7f0ab400ef60 comp rx=0 tx=0).stop 2024-09-19T04:14:41.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:41.366+0000 7f0ac0ae0640 1 -- 172.21.15.7:0/2467386061 shutdown_connections 2024-09-19T04:14:41.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:41.366+0000 7f0ac0ae0640 1 --2- 172.21.15.7:0/2467386061 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f0aa80a3240 0x7f0aa80a5700 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:41.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:41.366+0000 7f0ac0ae0640 1 --2- 172.21.15.7:0/2467386061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0abc106a80 0x7f0abc1a4320 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:41.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:41.366+0000 7f0ac0ae0640 1 --2- 172.21.15.7:0/2467386061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0abc101420 0x7f0abc1997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:41.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:41.366+0000 7f0ac0ae0640 1 --2- 172.21.15.7:0/2467386061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0abc100a80 0x7f0abc1992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:41.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:41.366+0000 7f0ac0ae0640 1 -- 172.21.15.7:0/2467386061 >> 172.21.15.7:0/2467386061 conn(0x7f0abc0fc7a0 msgr2=0x7f0abc0fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:41.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:41.366+0000 7f0ac0ae0640 1 -- 172.21.15.7:0/2467386061 shutdown_connections 2024-09-19T04:14:41.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:41.366+0000 7f0ac0ae0640 1 -- 172.21.15.7:0/2467386061 wait complete. 2024-09-19T04:14:41.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:41 smithi007 ceph-mon[31360]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T04:14:41.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:41 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2467386061' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-19T04:14:41.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:41 smithi102 ceph-mon[35446]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T04:14:41.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:41 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2467386061' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-19T04:14:41.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:41 smithi092 ceph-mon[34940]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T04:14:41.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:41 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2467386061' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-19T04:14:42.089 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-19T04:14:42.350 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:14:42.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:42 smithi007 ceph-mon[31360]: pgmap v282: 129 pgs: 6 creating+peering, 26 unknown, 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 8 op/s 2024-09-19T04:14:42.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:42 smithi007 ceph-mon[31360]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T04:14:42.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:42 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2467386061' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-19T04:14:42.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:42 smithi007 ceph-mon[31360]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T04:14:42.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:42 smithi102 ceph-mon[35446]: pgmap v282: 129 pgs: 6 creating+peering, 26 unknown, 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 8 op/s 2024-09-19T04:14:42.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:42 smithi102 ceph-mon[35446]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T04:14:42.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:42 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2467386061' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-19T04:14:42.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:42 smithi102 ceph-mon[35446]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T04:14:42.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:42 smithi092 ceph-mon[34940]: pgmap v282: 129 pgs: 6 creating+peering, 26 unknown, 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 8 op/s 2024-09-19T04:14:42.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:42 smithi092 ceph-mon[34940]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T04:14:42.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:42 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2467386061' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-19T04:14:42.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:42 smithi092 ceph-mon[34940]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T04:14:42.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.889+0000 7faf5359e640 1 -- 172.21.15.7:0/3704814491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf541068d0 msgr2=0x7faf54106cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:42.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.889+0000 7faf5359e640 1 --2- 172.21.15.7:0/3704814491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf541068d0 0x7faf54106cb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7faf44009930 tx=0x7faf4402a420 comp rx=0 tx=0).stop 2024-09-19T04:14:42.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.889+0000 7faf5359e640 1 -- 172.21.15.7:0/3704814491 shutdown_connections 2024-09-19T04:14:42.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.889+0000 7faf5359e640 1 --2- 172.21.15.7:0/3704814491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf54101270 0x7faf5410d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:42.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.889+0000 7faf5359e640 1 --2- 172.21.15.7:0/3704814491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf541008d0 0x7faf54100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:42.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.889+0000 7faf5359e640 1 --2- 172.21.15.7:0/3704814491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf541068d0 0x7faf54106cb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:42.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.889+0000 7faf5359e640 1 -- 172.21.15.7:0/3704814491 >> 172.21.15.7:0/3704814491 conn(0x7faf540fc630 msgr2=0x7faf540fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:42.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.889+0000 7faf5359e640 1 -- 172.21.15.7:0/3704814491 shutdown_connections 2024-09-19T04:14:42.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.889+0000 7faf5359e640 1 -- 172.21.15.7:0/3704814491 wait complete. 2024-09-19T04:14:42.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.890+0000 7faf5359e640 1 Processor -- start 2024-09-19T04:14:42.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.890+0000 7faf5359e640 1 -- start start 2024-09-19T04:14:42.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.890+0000 7faf5359e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf541008d0 0x7faf54198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:42.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.890+0000 7faf5359e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf54101270 0x7faf54198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:42.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.890+0000 7faf5359e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf541068d0 0x7faf5419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:42.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.890+0000 7faf5359e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faf54110cd0 con 0x7faf54101270 2024-09-19T04:14:42.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.890+0000 7faf5359e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faf54110b50 con 0x7faf541008d0 2024-09-19T04:14:42.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.890+0000 7faf5359e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7faf54110e50 con 0x7faf541068d0 2024-09-19T04:14:42.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.890+0000 7faf51d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf54101270 0x7faf54198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:42.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.890+0000 7faf51d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf54101270 0x7faf54198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50484/0 (socket says 172.21.15.7:50484) 2024-09-19T04:14:42.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.890+0000 7faf51d9b640 1 -- 172.21.15.7:0/3411986030 learned_addr learned my addr 172.21.15.7:0/3411986030 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:14:42.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.891+0000 7faf5259c640 1 --2- 172.21.15.7:0/3411986030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf541008d0 0x7faf54198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:42.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.891+0000 7faf52d9d640 1 --2- 172.21.15.7:0/3411986030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf541068d0 0x7faf5419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:42.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.891+0000 7faf51d9b640 1 -- 172.21.15.7:0/3411986030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf541068d0 msgr2=0x7faf5419cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:42.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.891+0000 7faf51d9b640 1 --2- 172.21.15.7:0/3411986030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf541068d0 0x7faf5419cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:42.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.891+0000 7faf51d9b640 1 -- 172.21.15.7:0/3411986030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf541008d0 msgr2=0x7faf54198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:42.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.891+0000 7faf51d9b640 1 --2- 172.21.15.7:0/3411986030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf541008d0 0x7faf54198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:42.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.891+0000 7faf51d9b640 1 -- 172.21.15.7:0/3411986030 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5419d2f0 con 0x7faf54101270 2024-09-19T04:14:42.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.891+0000 7faf52d9d640 1 --2- 172.21.15.7:0/3411986030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf541068d0 0x7faf5419cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:14:42.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.891+0000 7faf5259c640 1 --2- 172.21.15.7:0/3411986030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf541008d0 0x7faf54198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:14:42.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.891+0000 7faf51d9b640 1 --2- 172.21.15.7:0/3411986030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf54101270 0x7faf54198880 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faf4800d770 tx=0x7faf4800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:42.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.891+0000 7faf437fe640 1 -- 172.21.15.7:0/3411986030 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf48017070 con 0x7faf54101270 2024-09-19T04:14:42.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.891+0000 7faf5359e640 1 -- 172.21.15.7:0/3411986030 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf5419d5e0 con 0x7faf54101270 2024-09-19T04:14:42.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.891+0000 7faf437fe640 1 -- 172.21.15.7:0/3411986030 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf48005500 con 0x7faf54101270 2024-09-19T04:14:42.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.891+0000 7faf437fe640 1 -- 172.21.15.7:0/3411986030 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf48004e00 con 0x7faf54101270 2024-09-19T04:14:42.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.891+0000 7faf5359e640 1 -- 172.21.15.7:0/3411986030 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf541a4ec0 con 0x7faf54101270 2024-09-19T04:14:42.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.892+0000 7faf5359e640 1 -- 172.21.15.7:0/3411986030 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf54100d30 con 0x7faf54101270 2024-09-19T04:14:42.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.894+0000 7faf437fe640 1 -- 172.21.15.7:0/3411986030 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7faf48004fa0 con 0x7faf54101270 2024-09-19T04:14:42.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.895+0000 7faf437fe640 1 --2- 172.21.15.7:0/3411986030 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7faf3c0a3240 0x7faf3c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:42.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.895+0000 7faf5259c640 1 --2- 172.21.15.7:0/3411986030 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7faf3c0a3240 0x7faf3c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:42.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.895+0000 7faf437fe640 1 -- 172.21.15.7:0/3411986030 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8770+0+0 (secure 0 0 0) 0x7faf480cfaf0 con 0x7faf54101270 2024-09-19T04:14:42.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.895+0000 7faf5259c640 1 --2- 172.21.15.7:0/3411986030 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7faf3c0a3240 0x7faf3c0a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faf44000c00 tx=0x7faf44032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:42.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:42.898+0000 7faf437fe640 1 -- 172.21.15.7:0/3411986030 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faf4809c590 con 0x7faf54101270 2024-09-19T04:14:43.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:43.112+0000 7faf5359e640 1 -- 172.21.15.7:0/3411986030 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7faf541996a0 con 0x7faf54101270 2024-09-19T04:14:43.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:43.372+0000 7faf437fe640 1 -- 172.21.15.7:0/3411986030 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7faf541996a0 con 0x7faf54101270 2024-09-19T04:14:43.373 INFO:teuthology.orchestra.run.smithi007.stderr:added data pool 4 to fsmap 2024-09-19T04:14:43.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:43.375+0000 7faf5359e640 1 -- 172.21.15.7:0/3411986030 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7faf3c0a3240 msgr2=0x7faf3c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:43.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:43.375+0000 7faf5359e640 1 --2- 172.21.15.7:0/3411986030 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7faf3c0a3240 0x7faf3c0a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faf44000c00 tx=0x7faf44032c70 comp rx=0 tx=0).stop 2024-09-19T04:14:43.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:43.375+0000 7faf5359e640 1 -- 172.21.15.7:0/3411986030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf54101270 msgr2=0x7faf54198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:43.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:43.375+0000 7faf5359e640 1 --2- 172.21.15.7:0/3411986030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf54101270 0x7faf54198880 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7faf4800d770 tx=0x7faf4800dc30 comp rx=0 tx=0).stop 2024-09-19T04:14:43.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:43.375+0000 7faf5359e640 1 -- 172.21.15.7:0/3411986030 shutdown_connections 2024-09-19T04:14:43.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:43.375+0000 7faf5359e640 1 --2- 172.21.15.7:0/3411986030 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7faf3c0a3240 0x7faf3c0a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:43.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:43.375+0000 7faf5359e640 1 --2- 172.21.15.7:0/3411986030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf541068d0 0x7faf5419cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:43.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:43.375+0000 7faf5359e640 1 --2- 172.21.15.7:0/3411986030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf54101270 0x7faf54198880 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:43.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:43.375+0000 7faf5359e640 1 --2- 172.21.15.7:0/3411986030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf541008d0 0x7faf54198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:43.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:43.375+0000 7faf5359e640 1 -- 172.21.15.7:0/3411986030 >> 172.21.15.7:0/3411986030 conn(0x7faf540fc630 msgr2=0x7faf5406aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:43.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:43.375+0000 7faf5359e640 1 -- 172.21.15.7:0/3411986030 shutdown_connections 2024-09-19T04:14:43.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:43.375+0000 7faf5359e640 1 -- 172.21.15.7:0/3411986030 wait complete. 2024-09-19T04:14:43.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:43 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3411986030' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-19T04:14:43.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:43 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3411986030' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-19T04:14:43.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:43 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3411986030' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-19T04:14:43.995 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:14:44.256 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:14:44.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:44 smithi007 ceph-mon[31360]: pgmap v284: 129 pgs: 6 creating+peering, 14 unknown, 109 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 214 B/s wr, 1 op/s 2024-09-19T04:14:44.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:44 smithi007 ceph-mon[31360]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T04:14:44.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:44 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3411986030' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-19T04:14:44.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:44 smithi007 ceph-mon[31360]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T04:14:44.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:44 smithi102 ceph-mon[35446]: pgmap v284: 129 pgs: 6 creating+peering, 14 unknown, 109 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 214 B/s wr, 1 op/s 2024-09-19T04:14:44.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:44 smithi102 ceph-mon[35446]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T04:14:44.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:44 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3411986030' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-19T04:14:44.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:44 smithi102 ceph-mon[35446]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T04:14:44.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.740+0000 7f11ec3db640 1 -- 172.21.15.7:0/3979934481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11e4106a80 msgr2=0x7f11e4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:44.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.740+0000 7f11ec3db640 1 --2- 172.21.15.7:0/3979934481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11e4106a80 0x7f11e4106e60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f11e0009930 tx=0x7f11e002a420 comp rx=0 tx=0).stop 2024-09-19T04:14:44.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.740+0000 7f11ec3db640 1 -- 172.21.15.7:0/3979934481 shutdown_connections 2024-09-19T04:14:44.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.740+0000 7f11ec3db640 1 --2- 172.21.15.7:0/3979934481 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11e4101420 0x7f11e410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:44.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.740+0000 7f11ec3db640 1 --2- 172.21.15.7:0/3979934481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11e4100a80 0x7f11e4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:44.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.740+0000 7f11ec3db640 1 --2- 172.21.15.7:0/3979934481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11e4106a80 0x7f11e4106e60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:44.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.740+0000 7f11ec3db640 1 -- 172.21.15.7:0/3979934481 >> 172.21.15.7:0/3979934481 conn(0x7f11e40fc7a0 msgr2=0x7f11e40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:44.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.740+0000 7f11ec3db640 1 -- 172.21.15.7:0/3979934481 shutdown_connections 2024-09-19T04:14:44.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.740+0000 7f11ec3db640 1 -- 172.21.15.7:0/3979934481 wait complete. 2024-09-19T04:14:44.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.741+0000 7f11ec3db640 1 Processor -- start 2024-09-19T04:14:44.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.741+0000 7f11ec3db640 1 -- start start 2024-09-19T04:14:44.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.741+0000 7f11ec3db640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11e4100a80 0x7f11e40fcd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:44.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.741+0000 7f11ec3db640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11e4101420 0x7f11e40fd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:44.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.741+0000 7f11ec3db640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11e4106a80 0x7f11e40fd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:44.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.741+0000 7f11ec3db640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f11e4110e40 con 0x7f11e4106a80 2024-09-19T04:14:44.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.741+0000 7f11ec3db640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f11e4110cc0 con 0x7f11e4100a80 2024-09-19T04:14:44.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.741+0000 7f11ec3db640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f11e4110fc0 con 0x7f11e4101420 2024-09-19T04:14:44.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.741+0000 7f11ea978640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11e4106a80 0x7f11e40fd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:44.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.741+0000 7f11ea978640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11e4106a80 0x7f11e40fd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50514/0 (socket says 172.21.15.7:50514) 2024-09-19T04:14:44.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.741+0000 7f11ea978640 1 -- 172.21.15.7:0/1115550768 learned_addr learned my addr 172.21.15.7:0/1115550768 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:14:44.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.741+0000 7f11ea177640 1 --2- 172.21.15.7:0/1115550768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11e4100a80 0x7f11e40fcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:44.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.742+0000 7f11e9976640 1 --2- 172.21.15.7:0/1115550768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11e4101420 0x7f11e40fd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:44.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.742+0000 7f11ea978640 1 -- 172.21.15.7:0/1115550768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11e4101420 msgr2=0x7f11e40fd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:44.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.742+0000 7f11ea978640 1 --2- 172.21.15.7:0/1115550768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11e4101420 0x7f11e40fd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:44.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.742+0000 7f11ea978640 1 -- 172.21.15.7:0/1115550768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11e4100a80 msgr2=0x7f11e40fcd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:44.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.742+0000 7f11ea978640 1 --2- 172.21.15.7:0/1115550768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11e4100a80 0x7f11e40fcd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:44.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.742+0000 7f11ea978640 1 -- 172.21.15.7:0/1115550768 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e41a6880 con 0x7f11e4106a80 2024-09-19T04:14:44.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.742+0000 7f11ea978640 1 --2- 172.21.15.7:0/1115550768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11e4106a80 0x7f11e40fd7e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f11dc00eaa0 tx=0x7f11dc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:44.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.742+0000 7f11db7fe640 1 -- 172.21.15.7:0/1115550768 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11dc00cdb0 con 0x7f11e4106a80 2024-09-19T04:14:44.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.742+0000 7f11db7fe640 1 -- 172.21.15.7:0/1115550768 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11dc005020 con 0x7f11e4106a80 2024-09-19T04:14:44.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.742+0000 7f11ec3db640 1 -- 172.21.15.7:0/1115550768 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11e41a6b70 con 0x7f11e4106a80 2024-09-19T04:14:44.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.742+0000 7f11db7fe640 1 -- 172.21.15.7:0/1115550768 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11dc0116b0 con 0x7f11e4106a80 2024-09-19T04:14:44.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.742+0000 7f11ec3db640 1 -- 172.21.15.7:0/1115550768 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11e41a70b0 con 0x7f11e4106a80 2024-09-19T04:14:44.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.743+0000 7f11ec3db640 1 -- 172.21.15.7:0/1115550768 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11e4100ee0 con 0x7f11e4106a80 2024-09-19T04:14:44.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.744+0000 7f11db7fe640 1 -- 172.21.15.7:0/1115550768 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f11dc005560 con 0x7f11e4106a80 2024-09-19T04:14:44.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.745+0000 7f11db7fe640 1 --2- 172.21.15.7:0/1115550768 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f11d00a32c0 0x7f11d00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:44.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.745+0000 7f11db7fe640 1 -- 172.21.15.7:0/1115550768 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f11dc0cfd90 con 0x7f11e4106a80 2024-09-19T04:14:44.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.745+0000 7f11ea177640 1 --2- 172.21.15.7:0/1115550768 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f11d00a32c0 0x7f11d00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:44.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.745+0000 7f11ea177640 1 --2- 172.21.15.7:0/1115550768 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f11d00a32c0 0x7f11d00a5780 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f11e0000c00 tx=0x7f11e0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:44.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.749+0000 7f11db7fe640 1 -- 172.21.15.7:0/1115550768 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f11dc016030 con 0x7f11e4106a80 2024-09-19T04:14:44.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:44 smithi092 ceph-mon[34940]: pgmap v284: 129 pgs: 6 creating+peering, 14 unknown, 109 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 214 B/s wr, 1 op/s 2024-09-19T04:14:44.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:44 smithi092 ceph-mon[34940]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T04:14:44.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:44 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3411986030' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-19T04:14:44.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:44 smithi092 ceph-mon[34940]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T04:14:44.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.963+0000 7f11ec3db640 1 -- 172.21.15.7:0/1115550768 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11e410a000 con 0x7f11e4106a80 2024-09-19T04:14:44.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.964+0000 7f11db7fe640 1 -- 172.21.15.7:0/1115550768 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11827 (secure 0 0 0) 0x7f11dc09c870 con 0x7f11e4106a80 2024-09-19T04:14:44.966 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:14:44.966 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":17,"btime":"2024-09-19T04:14:43:365657+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14583,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14595,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24496,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:14:43.113488+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24506},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24506,"qdb_cluster":[24506]},"id":1}]} 2024-09-19T04:14:44.966 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 17 2024-09-19T04:14:44.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.966+0000 7f11ec3db640 1 -- 172.21.15.7:0/1115550768 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f11d00a32c0 msgr2=0x7f11d00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:44.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.966+0000 7f11ec3db640 1 --2- 172.21.15.7:0/1115550768 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f11d00a32c0 0x7f11d00a5780 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f11e0000c00 tx=0x7f11e0005a20 comp rx=0 tx=0).stop 2024-09-19T04:14:44.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.966+0000 7f11ec3db640 1 -- 172.21.15.7:0/1115550768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11e4106a80 msgr2=0x7f11e40fd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:44.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.966+0000 7f11ec3db640 1 --2- 172.21.15.7:0/1115550768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11e4106a80 0x7f11e40fd7e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f11dc00eaa0 tx=0x7f11dc00ef60 comp rx=0 tx=0).stop 2024-09-19T04:14:44.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.966+0000 7f11ec3db640 1 -- 172.21.15.7:0/1115550768 shutdown_connections 2024-09-19T04:14:44.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.966+0000 7f11ec3db640 1 --2- 172.21.15.7:0/1115550768 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f11d00a32c0 0x7f11d00a5780 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:44.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.966+0000 7f11ec3db640 1 --2- 172.21.15.7:0/1115550768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11e4106a80 0x7f11e40fd7e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:44.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.966+0000 7f11ec3db640 1 --2- 172.21.15.7:0/1115550768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11e4101420 0x7f11e40fd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:44.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.966+0000 7f11ec3db640 1 --2- 172.21.15.7:0/1115550768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11e4100a80 0x7f11e40fcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:44.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.966+0000 7f11ec3db640 1 -- 172.21.15.7:0/1115550768 >> 172.21.15.7:0/1115550768 conn(0x7f11e40fc7a0 msgr2=0x7f11e406a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:44.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.966+0000 7f11ec3db640 1 -- 172.21.15.7:0/1115550768 shutdown_connections 2024-09-19T04:14:44.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:44.966+0000 7f11ec3db640 1 -- 172.21.15.7:0/1115550768 wait complete. 2024-09-19T04:14:45.627 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:14:45.651 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:45 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1115550768' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:14:45.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:45 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1115550768' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:14:45.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:45 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1115550768' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:14:45.884 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:14:46.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.357+0000 7ff7ebc9f640 1 -- 172.21.15.7:0/3741293052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7e4100b20 msgr2=0x7ff7e4100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:46.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.357+0000 7ff7ebc9f640 1 --2- 172.21.15.7:0/3741293052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7e4100b20 0x7ff7e4100f00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4009ca0 tx=0x7ff7d402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:14:46.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.357+0000 7ff7ebc9f640 1 -- 172.21.15.7:0/3741293052 shutdown_connections 2024-09-19T04:14:46.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.357+0000 7ff7ebc9f640 1 --2- 172.21.15.7:0/3741293052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7e410e500 0x7ff7e4110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:46.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.357+0000 7ff7ebc9f640 1 --2- 172.21.15.7:0/3741293052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7e4101440 0x7ff7e410df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:46.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.357+0000 7ff7ebc9f640 1 --2- 172.21.15.7:0/3741293052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7e4100b20 0x7ff7e4100f00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:46.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.357+0000 7ff7ebc9f640 1 -- 172.21.15.7:0/3741293052 >> 172.21.15.7:0/3741293052 conn(0x7ff7e40fc7d0 msgr2=0x7ff7e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:46.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.357+0000 7ff7ebc9f640 1 -- 172.21.15.7:0/3741293052 shutdown_connections 2024-09-19T04:14:46.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.357+0000 7ff7ebc9f640 1 -- 172.21.15.7:0/3741293052 wait complete. 2024-09-19T04:14:46.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.357+0000 7ff7ebc9f640 1 Processor -- start 2024-09-19T04:14:46.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.357+0000 7ff7ebc9f640 1 -- start start 2024-09-19T04:14:46.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.358+0000 7ff7ebc9f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7e4100b20 0x7ff7e419a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:46.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.358+0000 7ff7ebc9f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7e4101440 0x7ff7e419ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:46.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.358+0000 7ff7ebc9f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7e410e500 0x7ff7e419efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:46.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.358+0000 7ff7ebc9f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e41142b0 con 0x7ff7e410e500 2024-09-19T04:14:46.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.358+0000 7ff7ebc9f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e4114130 con 0x7ff7e4101440 2024-09-19T04:14:46.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.358+0000 7ff7ebc9f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e4114430 con 0x7ff7e4100b20 2024-09-19T04:14:46.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.358+0000 7ff7ea23c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7e410e500 0x7ff7e419efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:46.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.358+0000 7ff7ea23c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7e410e500 0x7ff7e419efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50540/0 (socket says 172.21.15.7:50540) 2024-09-19T04:14:46.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.358+0000 7ff7ea23c640 1 -- 172.21.15.7:0/1143136079 learned_addr learned my addr 172.21.15.7:0/1143136079 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:14:46.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.358+0000 7ff7e923a640 1 --2- 172.21.15.7:0/1143136079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7e4101440 0x7ff7e419ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:46.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.358+0000 7ff7e9a3b640 1 --2- 172.21.15.7:0/1143136079 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7e4100b20 0x7ff7e419a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:46.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.358+0000 7ff7ea23c640 1 -- 172.21.15.7:0/1143136079 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7e4100b20 msgr2=0x7ff7e419a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:46.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.358+0000 7ff7ea23c640 1 --2- 172.21.15.7:0/1143136079 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7e4100b20 0x7ff7e419a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:46.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.358+0000 7ff7ea23c640 1 -- 172.21.15.7:0/1143136079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7e4101440 msgr2=0x7ff7e419ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:46.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.358+0000 7ff7ea23c640 1 --2- 172.21.15.7:0/1143136079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7e4101440 0x7ff7e419ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:46.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.358+0000 7ff7ea23c640 1 -- 172.21.15.7:0/1143136079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7e419f6a0 con 0x7ff7e410e500 2024-09-19T04:14:46.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.358+0000 7ff7ea23c640 1 --2- 172.21.15.7:0/1143136079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7e410e500 0x7ff7e419efc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00d950 tx=0x7ff7dc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:46.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.358+0000 7ff7e2ffd640 1 -- 172.21.15.7:0/1143136079 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc017070 con 0x7ff7e410e500 2024-09-19T04:14:46.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.358+0000 7ff7ebc9f640 1 -- 172.21.15.7:0/1143136079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7e419f990 con 0x7ff7e410e500 2024-09-19T04:14:46.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.359+0000 7ff7e2ffd640 1 -- 172.21.15.7:0/1143136079 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7dc009c30 con 0x7ff7e410e500 2024-09-19T04:14:46.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.359+0000 7ff7e2ffd640 1 -- 172.21.15.7:0/1143136079 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc003d60 con 0x7ff7e410e500 2024-09-19T04:14:46.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.359+0000 7ff7ebc9f640 1 -- 172.21.15.7:0/1143136079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7e41a7270 con 0x7ff7e410e500 2024-09-19T04:14:46.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.360+0000 7ff7ebc9f640 1 -- 172.21.15.7:0/1143136079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7e406a850 con 0x7ff7e410e500 2024-09-19T04:14:46.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.361+0000 7ff7e2ffd640 1 -- 172.21.15.7:0/1143136079 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7ff7dc003f00 con 0x7ff7e410e500 2024-09-19T04:14:46.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.362+0000 7ff7e2ffd640 1 --2- 172.21.15.7:0/1143136079 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff7cc0a3240 0x7ff7cc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:46.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.362+0000 7ff7e9a3b640 1 --2- 172.21.15.7:0/1143136079 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff7cc0a3240 0x7ff7cc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:46.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.362+0000 7ff7e2ffd640 1 -- 172.21.15.7:0/1143136079 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7ff7dc0cf4f0 con 0x7ff7e410e500 2024-09-19T04:14:46.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.362+0000 7ff7e9a3b640 1 --2- 172.21.15.7:0/1143136079 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff7cc0a3240 0x7ff7cc0a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4000f80 tx=0x7ff7d4009940 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:46.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.365+0000 7ff7e2ffd640 1 -- 172.21.15.7:0/1143136079 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff7dc09bf70 con 0x7ff7e410e500 2024-09-19T04:14:46.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.541+0000 7ff7ebc9f640 1 -- 172.21.15.7:0/1143136079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff7e41a7440 con 0x7ff7e410e500 2024-09-19T04:14:46.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:46 smithi007 ceph-mon[31360]: pgmap v286: 129 pgs: 2 creating+peering, 127 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:46.542 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:46 smithi007 ceph-mon[31360]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-19T04:14:46.543 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:46 smithi007 ceph-mon[31360]: Cluster is now healthy 2024-09-19T04:14:46.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.542+0000 7ff7e2ffd640 1 -- 172.21.15.7:0/1143136079 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24128 (secure 0 0 0) 0x7ff7dc09b870 con 0x7ff7e410e500 2024-09-19T04:14:46.544 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:14:46.544 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":86,"fsid":"77957c0a-763c-11ef-bceb-c7b262605968","created":"2024-09-19T04:06:58.337394+0000","modified":"2024-09-19T04:14:43.113323+0000","last_up_change":"2024-09-19T04:13:42.312137+0000","last_in_change":"2024-09-19T04:13:18.757925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:09:59.544984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:14:30.225637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:14:32.252497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T04:14:38.781821+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d9b93bd5-ee22-4fb0-ba29-bfa208430a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6803","nonce":240599233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6805","nonce":240599233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6809","nonce":240599233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6807","nonce":240599233}]},"public_addr":"172.21.15.7:6803/240599233","cluster_addr":"172.21.15.7:6805/240599233","heartbeat_back_addr":"172.21.15.7:6809/240599233","heartbeat_front_addr":"172.21.15.7:6807/240599233","state":["exists","up"]},{"osd":1,"uuid":"db5793e6-f3ad-4075-a02b-206bf7f1e59a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6801","nonce":902403333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6803","nonce":902403333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6807","nonce":902403333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6805","nonce":902403333}]},"public_addr":"172.21.15.92:6801/902403333","cluster_addr":"172.21.15.92:6803/902403333","heartbeat_back_addr":"172.21.15.92:6807/902403333","heartbeat_front_addr":"172.21.15.92:6805/902403333","state":["exists","up"]},{"osd":2,"uuid":"1eb83a1b-82d8-4983-bae3-b161adb3a33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6801","nonce":2078441772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6803","nonce":2078441772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6807","nonce":2078441772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6805","nonce":2078441772}]},"public_addr":"172.21.15.102:6801/2078441772","cluster_addr":"172.21.15.102:6803/2078441772","heartbeat_back_addr":"172.21.15.102:6807/2078441772","heartbeat_front_addr":"172.21.15.102:6805/2078441772","state":["exists","up"]},{"osd":3,"uuid":"68ba79e5-bcf0-4349-9e14-42f2fa9c11b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6811","nonce":2729561132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6813","nonce":2729561132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6817","nonce":2729561132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6815","nonce":2729561132}]},"public_addr":"172.21.15.7:6811/2729561132","cluster_addr":"172.21.15.7:6813/2729561132","heartbeat_back_addr":"172.21.15.7:6817/2729561132","heartbeat_front_addr":"172.21.15.7:6815/2729561132","state":["exists","up"]},{"osd":4,"uuid":"f20d4a51-121f-4ac8-afeb-5962d83bd697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6809","nonce":2799734294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6811","nonce":2799734294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6815","nonce":2799734294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6813","nonce":2799734294}]},"public_addr":"172.21.15.92:6809/2799734294","cluster_addr":"172.21.15.92:6811/2799734294","heartbeat_back_addr":"172.21.15.92:6815/2799734294","heartbeat_front_addr":"172.21.15.92:6813/2799734294","state":["exists","up"]},{"osd":5,"uuid":"aac02b0a-99dc-4457-8898-c68dc196517a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6809","nonce":3099678146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6811","nonce":3099678146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6815","nonce":3099678146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6813","nonce":3099678146}]},"public_addr":"172.21.15.102:6809/3099678146","cluster_addr":"172.21.15.102:6811/3099678146","heartbeat_back_addr":"172.21.15.102:6815/3099678146","heartbeat_front_addr":"172.21.15.102:6813/3099678146","state":["exists","up"]},{"osd":6,"uuid":"7e5a8b30-8406-486c-ace5-79158a3757a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6819","nonce":1569704304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6821","nonce":1569704304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6825","nonce":1569704304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6823","nonce":1569704304}]},"public_addr":"172.21.15.7:6819/1569704304","cluster_addr":"172.21.15.7:6821/1569704304","heartbeat_back_addr":"172.21.15.7:6825/1569704304","heartbeat_front_addr":"172.21.15.7:6823/1569704304","state":["exists","up"]},{"osd":7,"uuid":"e6a7049a-17a1-43b2-8ecd-5f4ca7c337be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6817","nonce":3411102480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6819","nonce":3411102480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6823","nonce":3411102480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6821","nonce":3411102480}]},"public_addr":"172.21.15.92:6817/3411102480","cluster_addr":"172.21.15.92:6819/3411102480","heartbeat_back_addr":"172.21.15.92:6823/3411102480","heartbeat_front_addr":"172.21.15.92:6821/3411102480","state":["exists","up"]},{"osd":8,"uuid":"31879baa-861d-4322-990f-0b9a42b8b610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6817","nonce":2990859925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6819","nonce":2990859925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6823","nonce":2990859925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6821","nonce":2990859925}]},"public_addr":"172.21.15.102:6817/2990859925","cluster_addr":"172.21.15.102:6819/2990859925","heartbeat_back_addr":"172.21.15.102:6823/2990859925","heartbeat_front_addr":"172.21.15.102:6821/2990859925","state":["exists","up"]},{"osd":9,"uuid":"6d65db33-926c-4a6e-a072-707e9c9de92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6827","nonce":1710319475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6829","nonce":1710319475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6833","nonce":1710319475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6831","nonce":1710319475}]},"public_addr":"172.21.15.7:6827/1710319475","cluster_addr":"172.21.15.7:6829/1710319475","heartbeat_back_addr":"172.21.15.7:6833/1710319475","heartbeat_front_addr":"172.21.15.7:6831/1710319475","state":["exists","up"]},{"osd":10,"uuid":"9ab681ee-0bef-47bd-bf3d-20b17c6b870c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6825","nonce":1063265541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6827","nonce":1063265541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6831","nonce":1063265541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6829","nonce":1063265541}]},"public_addr":"172.21.15.92:6825/1063265541","cluster_addr":"172.21.15.92:6827/1063265541","heartbeat_back_addr":"172.21.15.92:6831/1063265541","heartbeat_front_addr":"172.21.15.92:6829/1063265541","state":["exists","up"]},{"osd":11,"uuid":"dc398e14-5f9e-4f0a-b158-35cbc1f73a83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6825","nonce":1175425599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6827","nonce":1175425599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6831","nonce":1175425599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6829","nonce":1175425599}]},"public_addr":"172.21.15.102:6825/1175425599","cluster_addr":"172.21.15.102:6827/1175425599","heartbeat_back_addr":"172.21.15.102:6831/1175425599","heartbeat_front_addr":"172.21.15.102:6829/1175425599","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:07.857319+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:31.430120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:56.892301+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:10:22.011884+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:10:46.326025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:11:10.339084+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:11:35.365906+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:01.104309+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:25.717295+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:51.387644+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:13:15.076355+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:13:40.253150+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/2883028938":"2024-09-20T04:07:45.039922+0000","172.21.15.7:0/1186412739":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6800/751091002":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6801/751091002":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6801/940106179":"2024-09-20T04:07:20.364033+0000","172.21.15.7:6800/940106179":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/1450115700":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/2954294373":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/1996930242":"2024-09-20T04:07:45.039922+0000","172.21.15.7:0/3562231347":"2024-09-20T04:07:20.364033+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:14:46.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.544+0000 7ff7ebc9f640 1 -- 172.21.15.7:0/1143136079 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff7cc0a3240 msgr2=0x7ff7cc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:46.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.544+0000 7ff7ebc9f640 1 --2- 172.21.15.7:0/1143136079 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff7cc0a3240 0x7ff7cc0a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4000f80 tx=0x7ff7d4009940 comp rx=0 tx=0).stop 2024-09-19T04:14:46.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.544+0000 7ff7ebc9f640 1 -- 172.21.15.7:0/1143136079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7e410e500 msgr2=0x7ff7e419efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:46.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.544+0000 7ff7ebc9f640 1 --2- 172.21.15.7:0/1143136079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7e410e500 0x7ff7e419efc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc00d950 tx=0x7ff7dc00de10 comp rx=0 tx=0).stop 2024-09-19T04:14:46.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.545+0000 7ff7ebc9f640 1 -- 172.21.15.7:0/1143136079 shutdown_connections 2024-09-19T04:14:46.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.545+0000 7ff7ebc9f640 1 --2- 172.21.15.7:0/1143136079 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff7cc0a3240 0x7ff7cc0a5700 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:46.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.545+0000 7ff7ebc9f640 1 --2- 172.21.15.7:0/1143136079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7e410e500 0x7ff7e419efc0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:46.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.545+0000 7ff7ebc9f640 1 --2- 172.21.15.7:0/1143136079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7e4101440 0x7ff7e419ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:46.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.545+0000 7ff7ebc9f640 1 --2- 172.21.15.7:0/1143136079 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7e4100b20 0x7ff7e419a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:46.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.545+0000 7ff7ebc9f640 1 -- 172.21.15.7:0/1143136079 >> 172.21.15.7:0/1143136079 conn(0x7ff7e40fc7d0 msgr2=0x7ff7e40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:46.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.545+0000 7ff7ebc9f640 1 -- 172.21.15.7:0/1143136079 shutdown_connections 2024-09-19T04:14:46.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:46.545+0000 7ff7ebc9f640 1 -- 172.21.15.7:0/1143136079 wait complete. 2024-09-19T04:14:46.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:46 smithi102 ceph-mon[35446]: pgmap v286: 129 pgs: 2 creating+peering, 127 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:46.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:46 smithi102 ceph-mon[35446]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-19T04:14:46.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:46 smithi102 ceph-mon[35446]: Cluster is now healthy 2024-09-19T04:14:46.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:46 smithi092 ceph-mon[34940]: pgmap v286: 129 pgs: 2 creating+peering, 127 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:46.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:46 smithi092 ceph-mon[34940]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-19T04:14:46.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:46 smithi092 ceph-mon[34940]: Cluster is now healthy 2024-09-19T04:14:47.188 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:14:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:14:47.611 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:47 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1143136079' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:14:47.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:47 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1143136079' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:14:47.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:47 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1143136079' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:14:47.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.957+0000 7ffb541fe640 1 -- 172.21.15.7:0/3896988563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb4c106a80 msgr2=0x7ffb4c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:47.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.957+0000 7ffb541fe640 1 --2- 172.21.15.7:0/3896988563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb4c106a80 0x7ffb4c106e60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009930 tx=0x7ffb4802a420 comp rx=0 tx=0).stop 2024-09-19T04:14:47.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.957+0000 7ffb541fe640 1 -- 172.21.15.7:0/3896988563 shutdown_connections 2024-09-19T04:14:47.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.957+0000 7ffb541fe640 1 --2- 172.21.15.7:0/3896988563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb4c101420 0x7ffb4c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:47.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.957+0000 7ffb541fe640 1 --2- 172.21.15.7:0/3896988563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb4c100a80 0x7ffb4c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:47.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.957+0000 7ffb541fe640 1 --2- 172.21.15.7:0/3896988563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb4c106a80 0x7ffb4c106e60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:47.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.957+0000 7ffb541fe640 1 -- 172.21.15.7:0/3896988563 >> 172.21.15.7:0/3896988563 conn(0x7ffb4c0fc7a0 msgr2=0x7ffb4c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:47.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.957+0000 7ffb541fe640 1 -- 172.21.15.7:0/3896988563 shutdown_connections 2024-09-19T04:14:47.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.958+0000 7ffb541fe640 1 -- 172.21.15.7:0/3896988563 wait complete. 2024-09-19T04:14:47.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.958+0000 7ffb541fe640 1 Processor -- start 2024-09-19T04:14:47.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.958+0000 7ffb541fe640 1 -- start start 2024-09-19T04:14:47.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.958+0000 7ffb541fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb4c100a80 0x7ffb4c1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:47.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.958+0000 7ffb541fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb4c101420 0x7ffb4c199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:47.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.958+0000 7ffb541fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb4c106a80 0x7ffb4c1a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:47.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.958+0000 7ffb541fe640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffb4c110ea0 con 0x7ffb4c100a80 2024-09-19T04:14:47.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.958+0000 7ffb541fe640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffb4c110d20 con 0x7ffb4c101420 2024-09-19T04:14:47.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.958+0000 7ffb541fe640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffb4c111020 con 0x7ffb4c106a80 2024-09-19T04:14:47.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.958+0000 7ffb51f9a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb4c100a80 0x7ffb4c1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:47.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.958+0000 7ffb51f9a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb4c100a80 0x7ffb4c1992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48246/0 (socket says 172.21.15.7:48246) 2024-09-19T04:14:47.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.958+0000 7ffb51f9a640 1 -- 172.21.15.7:0/3010545977 learned_addr learned my addr 172.21.15.7:0/3010545977 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:14:47.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.959+0000 7ffb5279b640 1 --2- 172.21.15.7:0/3010545977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb4c106a80 0x7ffb4c1a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:47.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.959+0000 7ffb51799640 1 --2- 172.21.15.7:0/3010545977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb4c101420 0x7ffb4c199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:47.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.959+0000 7ffb51f9a640 1 -- 172.21.15.7:0/3010545977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb4c106a80 msgr2=0x7ffb4c1a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:47.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.959+0000 7ffb51f9a640 1 --2- 172.21.15.7:0/3010545977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb4c106a80 0x7ffb4c1a4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:47.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.959+0000 7ffb51f9a640 1 -- 172.21.15.7:0/3010545977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb4c101420 msgr2=0x7ffb4c199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:47.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.959+0000 7ffb51f9a640 1 --2- 172.21.15.7:0/3010545977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb4c101420 0x7ffb4c199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:47.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.959+0000 7ffb51f9a640 1 -- 172.21.15.7:0/3010545977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb4c1a48b0 con 0x7ffb4c100a80 2024-09-19T04:14:47.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.959+0000 7ffb51f9a640 1 --2- 172.21.15.7:0/3010545977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb4c100a80 0x7ffb4c1992f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009a50 tx=0x7ffb48004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:47.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.959+0000 7ffb3effd640 1 -- 172.21.15.7:0/3010545977 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4803f030 con 0x7ffb4c100a80 2024-09-19T04:14:47.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.959+0000 7ffb3effd640 1 -- 172.21.15.7:0/3010545977 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb48003ce0 con 0x7ffb4c100a80 2024-09-19T04:14:47.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.959+0000 7ffb541fe640 1 -- 172.21.15.7:0/3010545977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb4c1a4a80 con 0x7ffb4c100a80 2024-09-19T04:14:47.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.959+0000 7ffb3effd640 1 -- 172.21.15.7:0/3010545977 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb48035070 con 0x7ffb4c100a80 2024-09-19T04:14:47.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.959+0000 7ffb541fe640 1 -- 172.21.15.7:0/3010545977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb4c1a4ed0 con 0x7ffb4c100a80 2024-09-19T04:14:47.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.960+0000 7ffb541fe640 1 -- 172.21.15.7:0/3010545977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb4c100ee0 con 0x7ffb4c100a80 2024-09-19T04:14:47.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.961+0000 7ffb3effd640 1 -- 172.21.15.7:0/3010545977 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7ffb48042030 con 0x7ffb4c100a80 2024-09-19T04:14:47.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.962+0000 7ffb3effd640 1 --2- 172.21.15.7:0/3010545977 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffb380a3240 0x7ffb380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:47.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.962+0000 7ffb3effd640 1 -- 172.21.15.7:0/3010545977 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7ffb480efe40 con 0x7ffb4c100a80 2024-09-19T04:14:47.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.962+0000 7ffb51799640 1 --2- 172.21.15.7:0/3010545977 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffb380a3240 0x7ffb380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:47.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.962+0000 7ffb51799640 1 --2- 172.21.15.7:0/3010545977 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffb380a3240 0x7ffb380a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c06b2e0 tx=0x7ffb40008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:47.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:47.966+0000 7ffb3effd640 1 -- 172.21.15.7:0/3010545977 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffb480bc920 con 0x7ffb4c100a80 2024-09-19T04:14:48.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:48.143+0000 7ffb541fe640 1 -- 172.21.15.7:0/3010545977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffb4c108a60 con 0x7ffb4c100a80 2024-09-19T04:14:48.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:48.145+0000 7ffb3effd640 1 -- 172.21.15.7:0/3010545977 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24128 (secure 0 0 0) 0x7ffb480bc220 con 0x7ffb4c100a80 2024-09-19T04:14:48.146 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:14:48.147 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":86,"fsid":"77957c0a-763c-11ef-bceb-c7b262605968","created":"2024-09-19T04:06:58.337394+0000","modified":"2024-09-19T04:14:43.113323+0000","last_up_change":"2024-09-19T04:13:42.312137+0000","last_in_change":"2024-09-19T04:13:18.757925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:09:59.544984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:14:30.225637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:14:32.252497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T04:14:38.781821+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d9b93bd5-ee22-4fb0-ba29-bfa208430a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6803","nonce":240599233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6805","nonce":240599233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6809","nonce":240599233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6807","nonce":240599233}]},"public_addr":"172.21.15.7:6803/240599233","cluster_addr":"172.21.15.7:6805/240599233","heartbeat_back_addr":"172.21.15.7:6809/240599233","heartbeat_front_addr":"172.21.15.7:6807/240599233","state":["exists","up"]},{"osd":1,"uuid":"db5793e6-f3ad-4075-a02b-206bf7f1e59a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6801","nonce":902403333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6803","nonce":902403333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6807","nonce":902403333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6805","nonce":902403333}]},"public_addr":"172.21.15.92:6801/902403333","cluster_addr":"172.21.15.92:6803/902403333","heartbeat_back_addr":"172.21.15.92:6807/902403333","heartbeat_front_addr":"172.21.15.92:6805/902403333","state":["exists","up"]},{"osd":2,"uuid":"1eb83a1b-82d8-4983-bae3-b161adb3a33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6801","nonce":2078441772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6803","nonce":2078441772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6807","nonce":2078441772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6805","nonce":2078441772}]},"public_addr":"172.21.15.102:6801/2078441772","cluster_addr":"172.21.15.102:6803/2078441772","heartbeat_back_addr":"172.21.15.102:6807/2078441772","heartbeat_front_addr":"172.21.15.102:6805/2078441772","state":["exists","up"]},{"osd":3,"uuid":"68ba79e5-bcf0-4349-9e14-42f2fa9c11b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6811","nonce":2729561132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6813","nonce":2729561132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6817","nonce":2729561132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6815","nonce":2729561132}]},"public_addr":"172.21.15.7:6811/2729561132","cluster_addr":"172.21.15.7:6813/2729561132","heartbeat_back_addr":"172.21.15.7:6817/2729561132","heartbeat_front_addr":"172.21.15.7:6815/2729561132","state":["exists","up"]},{"osd":4,"uuid":"f20d4a51-121f-4ac8-afeb-5962d83bd697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6809","nonce":2799734294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6811","nonce":2799734294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6815","nonce":2799734294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6813","nonce":2799734294}]},"public_addr":"172.21.15.92:6809/2799734294","cluster_addr":"172.21.15.92:6811/2799734294","heartbeat_back_addr":"172.21.15.92:6815/2799734294","heartbeat_front_addr":"172.21.15.92:6813/2799734294","state":["exists","up"]},{"osd":5,"uuid":"aac02b0a-99dc-4457-8898-c68dc196517a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6809","nonce":3099678146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6811","nonce":3099678146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6815","nonce":3099678146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6813","nonce":3099678146}]},"public_addr":"172.21.15.102:6809/3099678146","cluster_addr":"172.21.15.102:6811/3099678146","heartbeat_back_addr":"172.21.15.102:6815/3099678146","heartbeat_front_addr":"172.21.15.102:6813/3099678146","state":["exists","up"]},{"osd":6,"uuid":"7e5a8b30-8406-486c-ace5-79158a3757a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6819","nonce":1569704304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6821","nonce":1569704304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6825","nonce":1569704304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6823","nonce":1569704304}]},"public_addr":"172.21.15.7:6819/1569704304","cluster_addr":"172.21.15.7:6821/1569704304","heartbeat_back_addr":"172.21.15.7:6825/1569704304","heartbeat_front_addr":"172.21.15.7:6823/1569704304","state":["exists","up"]},{"osd":7,"uuid":"e6a7049a-17a1-43b2-8ecd-5f4ca7c337be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6817","nonce":3411102480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6819","nonce":3411102480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6823","nonce":3411102480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6821","nonce":3411102480}]},"public_addr":"172.21.15.92:6817/3411102480","cluster_addr":"172.21.15.92:6819/3411102480","heartbeat_back_addr":"172.21.15.92:6823/3411102480","heartbeat_front_addr":"172.21.15.92:6821/3411102480","state":["exists","up"]},{"osd":8,"uuid":"31879baa-861d-4322-990f-0b9a42b8b610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6817","nonce":2990859925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6819","nonce":2990859925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6823","nonce":2990859925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6821","nonce":2990859925}]},"public_addr":"172.21.15.102:6817/2990859925","cluster_addr":"172.21.15.102:6819/2990859925","heartbeat_back_addr":"172.21.15.102:6823/2990859925","heartbeat_front_addr":"172.21.15.102:6821/2990859925","state":["exists","up"]},{"osd":9,"uuid":"6d65db33-926c-4a6e-a072-707e9c9de92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6827","nonce":1710319475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6829","nonce":1710319475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6833","nonce":1710319475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6831","nonce":1710319475}]},"public_addr":"172.21.15.7:6827/1710319475","cluster_addr":"172.21.15.7:6829/1710319475","heartbeat_back_addr":"172.21.15.7:6833/1710319475","heartbeat_front_addr":"172.21.15.7:6831/1710319475","state":["exists","up"]},{"osd":10,"uuid":"9ab681ee-0bef-47bd-bf3d-20b17c6b870c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6825","nonce":1063265541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6827","nonce":1063265541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6831","nonce":1063265541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6829","nonce":1063265541}]},"public_addr":"172.21.15.92:6825/1063265541","cluster_addr":"172.21.15.92:6827/1063265541","heartbeat_back_addr":"172.21.15.92:6831/1063265541","heartbeat_front_addr":"172.21.15.92:6829/1063265541","state":["exists","up"]},{"osd":11,"uuid":"dc398e14-5f9e-4f0a-b158-35cbc1f73a83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6825","nonce":1175425599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6827","nonce":1175425599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6831","nonce":1175425599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6829","nonce":1175425599}]},"public_addr":"172.21.15.102:6825/1175425599","cluster_addr":"172.21.15.102:6827/1175425599","heartbeat_back_addr":"172.21.15.102:6831/1175425599","heartbeat_front_addr":"172.21.15.102:6829/1175425599","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:07.857319+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:31.430120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:56.892301+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:10:22.011884+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:10:46.326025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:11:10.339084+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:11:35.365906+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:01.104309+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:25.717295+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:51.387644+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:13:15.076355+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:13:40.253150+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/2883028938":"2024-09-20T04:07:45.039922+0000","172.21.15.7:0/1186412739":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6800/751091002":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6801/751091002":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6801/940106179":"2024-09-20T04:07:20.364033+0000","172.21.15.7:6800/940106179":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/1450115700":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/2954294373":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/1996930242":"2024-09-20T04:07:45.039922+0000","172.21.15.7:0/3562231347":"2024-09-20T04:07:20.364033+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:14:48.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:48.147+0000 7ffb541fe640 1 -- 172.21.15.7:0/3010545977 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffb380a3240 msgr2=0x7ffb380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:48.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:48.147+0000 7ffb541fe640 1 --2- 172.21.15.7:0/3010545977 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffb380a3240 0x7ffb380a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c06b2e0 tx=0x7ffb40008040 comp rx=0 tx=0).stop 2024-09-19T04:14:48.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:48.147+0000 7ffb541fe640 1 -- 172.21.15.7:0/3010545977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb4c100a80 msgr2=0x7ffb4c1992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:48.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:48.147+0000 7ffb541fe640 1 --2- 172.21.15.7:0/3010545977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb4c100a80 0x7ffb4c1992f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009a50 tx=0x7ffb48004270 comp rx=0 tx=0).stop 2024-09-19T04:14:48.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:48.147+0000 7ffb541fe640 1 -- 172.21.15.7:0/3010545977 shutdown_connections 2024-09-19T04:14:48.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:48.147+0000 7ffb541fe640 1 --2- 172.21.15.7:0/3010545977 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffb380a3240 0x7ffb380a5700 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:48.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:48.147+0000 7ffb541fe640 1 --2- 172.21.15.7:0/3010545977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb4c106a80 0x7ffb4c1a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:48.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:48.147+0000 7ffb541fe640 1 --2- 172.21.15.7:0/3010545977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb4c101420 0x7ffb4c199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:48.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:48.147+0000 7ffb541fe640 1 --2- 172.21.15.7:0/3010545977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb4c100a80 0x7ffb4c1992f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:48.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:48.147+0000 7ffb541fe640 1 -- 172.21.15.7:0/3010545977 >> 172.21.15.7:0/3010545977 conn(0x7ffb4c0fc7a0 msgr2=0x7ffb4c0fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:48.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:48.147+0000 7ffb541fe640 1 -- 172.21.15.7:0/3010545977 shutdown_connections 2024-09-19T04:14:48.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:48.147+0000 7ffb541fe640 1 -- 172.21.15.7:0/3010545977 wait complete. 2024-09-19T04:14:48.475 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:48 smithi007 ceph-mon[31360]: pgmap v287: 129 pgs: 129 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:48.475 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:48 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3010545977' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:14:48.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:48 smithi102 ceph-mon[35446]: pgmap v287: 129 pgs: 129 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:48.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:48 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3010545977' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:14:48.805 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:14:48.805 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:48 smithi092 ceph-mon[34940]: pgmap v287: 129 pgs: 129 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:48.805 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:48 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3010545977' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:14:49.062 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:14:49.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.535+0000 7f7139adc640 1 -- 172.21.15.7:0/3076800406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71341055b0 msgr2=0x7f713410d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:49.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.535+0000 7f7139adc640 1 --2- 172.21.15.7:0/3076800406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71341055b0 0x7f713410d130 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f712c009ca0 tx=0x7f712c02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:14:49.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.535+0000 7f7139adc640 1 -- 172.21.15.7:0/3076800406 shutdown_connections 2024-09-19T04:14:49.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.535+0000 7f7139adc640 1 --2- 172.21.15.7:0/3076800406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71341055b0 0x7f713410d130 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:49.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.535+0000 7f7139adc640 1 --2- 172.21.15.7:0/3076800406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7134100e30 0x7f7134104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:49.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.536+0000 7f7139adc640 1 --2- 172.21.15.7:0/3076800406 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7134100480 0x7f7134100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:49.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.536+0000 7f7139adc640 1 -- 172.21.15.7:0/3076800406 >> 172.21.15.7:0/3076800406 conn(0x7f7134077210 msgr2=0x7f71340fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:49.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.536+0000 7f7139adc640 1 -- 172.21.15.7:0/3076800406 shutdown_connections 2024-09-19T04:14:49.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.536+0000 7f7139adc640 1 -- 172.21.15.7:0/3076800406 wait complete. 2024-09-19T04:14:49.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.536+0000 7f7139adc640 1 Processor -- start 2024-09-19T04:14:49.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.536+0000 7f7139adc640 1 -- start start 2024-09-19T04:14:49.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.537+0000 7f7139adc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7134100480 0x7f7134198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:49.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.537+0000 7f7139adc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7134100e30 0x7f7134198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:49.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.537+0000 7f7139adc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71341055b0 0x7f713419cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:49.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.537+0000 7f7139adc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7134111f90 con 0x7f71341055b0 2024-09-19T04:14:49.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.537+0000 7f7139adc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7134111e10 con 0x7f7134100e30 2024-09-19T04:14:49.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.537+0000 7f7139adc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7134112110 con 0x7f7134100480 2024-09-19T04:14:49.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.537+0000 7f7133fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71341055b0 0x7f713419cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:49.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.537+0000 7f7133fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71341055b0 0x7f713419cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48270/0 (socket says 172.21.15.7:48270) 2024-09-19T04:14:49.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.537+0000 7f7133fff640 1 -- 172.21.15.7:0/130129927 learned_addr learned my addr 172.21.15.7:0/130129927 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:14:49.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.537+0000 7f7132ffd640 1 --2- 172.21.15.7:0/130129927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7134100e30 0x7f7134198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:49.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.537+0000 7f71337fe640 1 --2- 172.21.15.7:0/130129927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7134100480 0x7f7134198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:49.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.537+0000 7f7133fff640 1 -- 172.21.15.7:0/130129927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7134100480 msgr2=0x7f7134198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:49.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.537+0000 7f7133fff640 1 --2- 172.21.15.7:0/130129927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7134100480 0x7f7134198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:49.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.537+0000 7f7133fff640 1 -- 172.21.15.7:0/130129927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7134100e30 msgr2=0x7f7134198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:49.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.537+0000 7f7133fff640 1 --2- 172.21.15.7:0/130129927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7134100e30 0x7f7134198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:49.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.537+0000 7f7133fff640 1 -- 172.21.15.7:0/130129927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f713419d300 con 0x7f71341055b0 2024-09-19T04:14:49.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.537+0000 7f7133fff640 1 --2- 172.21.15.7:0/130129927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71341055b0 0x7f713419cc20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f712c031a20 tx=0x7f712c031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:49.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.537+0000 7f7130ff9640 1 -- 172.21.15.7:0/130129927 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712c003b70 con 0x7f71341055b0 2024-09-19T04:14:49.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.537+0000 7f7130ff9640 1 -- 172.21.15.7:0/130129927 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f712c003d10 con 0x7f71341055b0 2024-09-19T04:14:49.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.537+0000 7f7139adc640 1 -- 172.21.15.7:0/130129927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f713419d590 con 0x7f71341055b0 2024-09-19T04:14:49.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.537+0000 7f7130ff9640 1 -- 172.21.15.7:0/130129927 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712c02fc80 con 0x7f71341055b0 2024-09-19T04:14:49.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.537+0000 7f7139adc640 1 -- 172.21.15.7:0/130129927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71341a4ed0 con 0x7f71341055b0 2024-09-19T04:14:49.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.539+0000 7f7139adc640 1 -- 172.21.15.7:0/130129927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7134100860 con 0x7f71341055b0 2024-09-19T04:14:49.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.540+0000 7f7130ff9640 1 -- 172.21.15.7:0/130129927 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f712c0046a0 con 0x7f71341055b0 2024-09-19T04:14:49.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.540+0000 7f7130ff9640 1 --2- 172.21.15.7:0/130129927 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f711c0a3240 0x7f711c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:49.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.540+0000 7f71337fe640 1 --2- 172.21.15.7:0/130129927 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f711c0a3240 0x7f711c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:49.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.540+0000 7f7130ff9640 1 -- 172.21.15.7:0/130129927 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f712c0f0d00 con 0x7f71341055b0 2024-09-19T04:14:49.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.541+0000 7f71337fe640 1 --2- 172.21.15.7:0/130129927 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f711c0a3240 0x7f711c0a5700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7124005d00 tx=0x7f712400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:49.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.544+0000 7f7130ff9640 1 -- 172.21.15.7:0/130129927 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f712c0bd870 con 0x7f71341055b0 2024-09-19T04:14:49.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.757+0000 7f7139adc640 1 -- 172.21.15.7:0/130129927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71341087f0 con 0x7f71341055b0 2024-09-19T04:14:49.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.758+0000 7f7130ff9640 1 -- 172.21.15.7:0/130129927 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11827 (secure 0 0 0) 0x7f712c0bd170 con 0x7f71341055b0 2024-09-19T04:14:49.759 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:14:49.760 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":17,"btime":"2024-09-19T04:14:43:365657+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14583,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14595,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24472,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24496,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:14:43.113488+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24506},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24506,"qdb_cluster":[24506]},"id":1}]} 2024-09-19T04:14:49.760 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 17 2024-09-19T04:14:49.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.761+0000 7f7139adc640 1 -- 172.21.15.7:0/130129927 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f711c0a3240 msgr2=0x7f711c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:49.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.761+0000 7f7139adc640 1 --2- 172.21.15.7:0/130129927 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f711c0a3240 0x7f711c0a5700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7124005d00 tx=0x7f712400b410 comp rx=0 tx=0).stop 2024-09-19T04:14:49.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.761+0000 7f7139adc640 1 -- 172.21.15.7:0/130129927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71341055b0 msgr2=0x7f713419cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:49.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.761+0000 7f7139adc640 1 --2- 172.21.15.7:0/130129927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71341055b0 0x7f713419cc20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f712c031a20 tx=0x7f712c031a50 comp rx=0 tx=0).stop 2024-09-19T04:14:49.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.761+0000 7f7139adc640 1 -- 172.21.15.7:0/130129927 shutdown_connections 2024-09-19T04:14:49.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.761+0000 7f7139adc640 1 --2- 172.21.15.7:0/130129927 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f711c0a3240 0x7f711c0a5700 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:49.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.761+0000 7f7139adc640 1 --2- 172.21.15.7:0/130129927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71341055b0 0x7f713419cc20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:49.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.761+0000 7f7139adc640 1 --2- 172.21.15.7:0/130129927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7134100e30 0x7f7134198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:49.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.761+0000 7f7139adc640 1 --2- 172.21.15.7:0/130129927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7134100480 0x7f7134198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:49.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.761+0000 7f7139adc640 1 -- 172.21.15.7:0/130129927 >> 172.21.15.7:0/130129927 conn(0x7f7134077210 msgr2=0x7f7134103c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:49.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.761+0000 7f7139adc640 1 -- 172.21.15.7:0/130129927 shutdown_connections 2024-09-19T04:14:49.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:49.761+0000 7f7139adc640 1 -- 172.21.15.7:0/130129927 wait complete. 2024-09-19T04:14:50.446 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:14:50.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:50 smithi102 ceph-mon[35446]: pgmap v288: 129 pgs: 129 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:50.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:50 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/130129927' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:14:50.705 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:14:50.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:50 smithi092 ceph-mon[34940]: pgmap v288: 129 pgs: 129 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:50.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:50 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/130129927' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:14:50.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:50 smithi007 ceph-mon[31360]: pgmap v288: 129 pgs: 129 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:50.826 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:50 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/130129927' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:14:51.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.220+0000 7f300e423640 1 -- 172.21.15.7:0/847815933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3008102790 msgr2=0x7f30081067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:51.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.220+0000 7f300e423640 1 --2- 172.21.15.7:0/847815933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3008102790 0x7f30081067e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009900 tx=0x7f2ffc02a3f0 comp rx=0 tx=0).stop 2024-09-19T04:14:51.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.220+0000 7f300e423640 1 -- 172.21.15.7:0/847815933 shutdown_connections 2024-09-19T04:14:51.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.220+0000 7f300e423640 1 --2- 172.21.15.7:0/847815933 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3008106f10 0x7f300810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:51.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.220+0000 7f300e423640 1 --2- 172.21.15.7:0/847815933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3008102790 0x7f30081067e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:51.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.220+0000 7f300e423640 1 --2- 172.21.15.7:0/847815933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3008101de0 0x7f30081021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:51.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.220+0000 7f300e423640 1 -- 172.21.15.7:0/847815933 >> 172.21.15.7:0/847815933 conn(0x7f30080fd8c0 msgr2=0x7f30080ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:51.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.220+0000 7f300e423640 1 -- 172.21.15.7:0/847815933 shutdown_connections 2024-09-19T04:14:51.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.220+0000 7f300e423640 1 -- 172.21.15.7:0/847815933 wait complete. 2024-09-19T04:14:51.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.221+0000 7f300e423640 1 Processor -- start 2024-09-19T04:14:51.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.221+0000 7f300e423640 1 -- start start 2024-09-19T04:14:51.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.221+0000 7f300e423640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3008101de0 0x7f3008198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:51.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.221+0000 7f300e423640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3008102790 0x7f3008198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:51.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.221+0000 7f300e423640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3008106f10 0x7f300819ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:51.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.221+0000 7f300e423640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3008111f90 con 0x7f3008102790 2024-09-19T04:14:51.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.221+0000 7f300e423640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3008111e10 con 0x7f3008106f10 2024-09-19T04:14:51.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.221+0000 7f300e423640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3008112110 con 0x7f3008101de0 2024-09-19T04:14:51.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.221+0000 7f30077fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3008102790 0x7f3008198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:51.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.221+0000 7f30077fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3008102790 0x7f3008198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48280/0 (socket says 172.21.15.7:48280) 2024-09-19T04:14:51.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.221+0000 7f30077fe640 1 -- 172.21.15.7:0/1466550463 learned_addr learned my addr 172.21.15.7:0/1466550463 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:14:51.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.222+0000 7f3007fff640 1 --2- 172.21.15.7:0/1466550463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3008101de0 0x7f3008198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:51.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.222+0000 7f30077fe640 1 -- 172.21.15.7:0/1466550463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3008101de0 msgr2=0x7f3008198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:51.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.222+0000 7f300c9c0640 1 --2- 172.21.15.7:0/1466550463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3008106f10 0x7f300819ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:51.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.222+0000 7f30077fe640 1 --2- 172.21.15.7:0/1466550463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3008101de0 0x7f3008198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:51.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.222+0000 7f30077fe640 1 -- 172.21.15.7:0/1466550463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3008106f10 msgr2=0x7f300819ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:51.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.222+0000 7f30077fe640 1 --2- 172.21.15.7:0/1466550463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3008106f10 0x7f300819ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:51.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.222+0000 7f30077fe640 1 -- 172.21.15.7:0/1466550463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f300819d3d0 con 0x7f3008102790 2024-09-19T04:14:51.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.222+0000 7f300c9c0640 1 --2- 172.21.15.7:0/1466550463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3008106f10 0x7f300819ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:14:51.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.222+0000 7f30077fe640 1 --2- 172.21.15.7:0/1466550463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3008102790 0x7f3008198960 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc005ab0 tx=0x7f2ffc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:51.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.222+0000 7f30057fa640 1 -- 172.21.15.7:0/1466550463 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc03f030 con 0x7f3008102790 2024-09-19T04:14:51.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.222+0000 7f300e423640 1 -- 172.21.15.7:0/1466550463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f300819d660 con 0x7f3008102790 2024-09-19T04:14:51.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.222+0000 7f30057fa640 1 -- 172.21.15.7:0/1466550463 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ffc003ce0 con 0x7f3008102790 2024-09-19T04:14:51.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.222+0000 7f30057fa640 1 -- 172.21.15.7:0/1466550463 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc035070 con 0x7f3008102790 2024-09-19T04:14:51.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.222+0000 7f300e423640 1 -- 172.21.15.7:0/1466550463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30081a4fa0 con 0x7f3008102790 2024-09-19T04:14:51.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.223+0000 7f300e423640 1 -- 172.21.15.7:0/1466550463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30081032c0 con 0x7f3008102790 2024-09-19T04:14:51.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.224+0000 7f30057fa640 1 -- 172.21.15.7:0/1466550463 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f2ffc042030 con 0x7f3008102790 2024-09-19T04:14:51.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.225+0000 7f30057fa640 1 --2- 172.21.15.7:0/1466550463 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2ff00a3240 0x7f2ff00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:51.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.225+0000 7f3007fff640 1 --2- 172.21.15.7:0/1466550463 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2ff00a3240 0x7f2ff00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:51.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.225+0000 7f30057fa640 1 -- 172.21.15.7:0/1466550463 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f2ffc0f0550 con 0x7f3008102790 2024-09-19T04:14:51.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.225+0000 7f3007fff640 1 --2- 172.21.15.7:0/1466550463 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2ff00a3240 0x7f2ff00a5700 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8005e10 tx=0x7f2ff8005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:51.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.229+0000 7f30057fa640 1 -- 172.21.15.7:0/1466550463 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2ffc0bcfd0 con 0x7f3008102790 2024-09-19T04:14:51.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.406+0000 7f300e423640 1 -- 172.21.15.7:0/1466550463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f300810a0f0 con 0x7f3008102790 2024-09-19T04:14:51.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.408+0000 7f30057fa640 1 -- 172.21.15.7:0/1466550463 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24128 (secure 0 0 0) 0x7f2ffc0bc8d0 con 0x7f3008102790 2024-09-19T04:14:51.410 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:14:51.410 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":86,"fsid":"77957c0a-763c-11ef-bceb-c7b262605968","created":"2024-09-19T04:06:58.337394+0000","modified":"2024-09-19T04:14:43.113323+0000","last_up_change":"2024-09-19T04:13:42.312137+0000","last_in_change":"2024-09-19T04:13:18.757925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:09:59.544984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:14:30.225637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:14:32.252497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T04:14:38.781821+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d9b93bd5-ee22-4fb0-ba29-bfa208430a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6803","nonce":240599233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6805","nonce":240599233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6809","nonce":240599233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6807","nonce":240599233}]},"public_addr":"172.21.15.7:6803/240599233","cluster_addr":"172.21.15.7:6805/240599233","heartbeat_back_addr":"172.21.15.7:6809/240599233","heartbeat_front_addr":"172.21.15.7:6807/240599233","state":["exists","up"]},{"osd":1,"uuid":"db5793e6-f3ad-4075-a02b-206bf7f1e59a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6801","nonce":902403333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6803","nonce":902403333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6807","nonce":902403333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6805","nonce":902403333}]},"public_addr":"172.21.15.92:6801/902403333","cluster_addr":"172.21.15.92:6803/902403333","heartbeat_back_addr":"172.21.15.92:6807/902403333","heartbeat_front_addr":"172.21.15.92:6805/902403333","state":["exists","up"]},{"osd":2,"uuid":"1eb83a1b-82d8-4983-bae3-b161adb3a33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6801","nonce":2078441772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6803","nonce":2078441772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6807","nonce":2078441772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6805","nonce":2078441772}]},"public_addr":"172.21.15.102:6801/2078441772","cluster_addr":"172.21.15.102:6803/2078441772","heartbeat_back_addr":"172.21.15.102:6807/2078441772","heartbeat_front_addr":"172.21.15.102:6805/2078441772","state":["exists","up"]},{"osd":3,"uuid":"68ba79e5-bcf0-4349-9e14-42f2fa9c11b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6811","nonce":2729561132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6813","nonce":2729561132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6817","nonce":2729561132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6815","nonce":2729561132}]},"public_addr":"172.21.15.7:6811/2729561132","cluster_addr":"172.21.15.7:6813/2729561132","heartbeat_back_addr":"172.21.15.7:6817/2729561132","heartbeat_front_addr":"172.21.15.7:6815/2729561132","state":["exists","up"]},{"osd":4,"uuid":"f20d4a51-121f-4ac8-afeb-5962d83bd697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6809","nonce":2799734294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6811","nonce":2799734294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6815","nonce":2799734294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6813","nonce":2799734294}]},"public_addr":"172.21.15.92:6809/2799734294","cluster_addr":"172.21.15.92:6811/2799734294","heartbeat_back_addr":"172.21.15.92:6815/2799734294","heartbeat_front_addr":"172.21.15.92:6813/2799734294","state":["exists","up"]},{"osd":5,"uuid":"aac02b0a-99dc-4457-8898-c68dc196517a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6809","nonce":3099678146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6811","nonce":3099678146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6815","nonce":3099678146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6813","nonce":3099678146}]},"public_addr":"172.21.15.102:6809/3099678146","cluster_addr":"172.21.15.102:6811/3099678146","heartbeat_back_addr":"172.21.15.102:6815/3099678146","heartbeat_front_addr":"172.21.15.102:6813/3099678146","state":["exists","up"]},{"osd":6,"uuid":"7e5a8b30-8406-486c-ace5-79158a3757a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6819","nonce":1569704304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6821","nonce":1569704304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6825","nonce":1569704304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6823","nonce":1569704304}]},"public_addr":"172.21.15.7:6819/1569704304","cluster_addr":"172.21.15.7:6821/1569704304","heartbeat_back_addr":"172.21.15.7:6825/1569704304","heartbeat_front_addr":"172.21.15.7:6823/1569704304","state":["exists","up"]},{"osd":7,"uuid":"e6a7049a-17a1-43b2-8ecd-5f4ca7c337be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6817","nonce":3411102480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6819","nonce":3411102480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6823","nonce":3411102480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6821","nonce":3411102480}]},"public_addr":"172.21.15.92:6817/3411102480","cluster_addr":"172.21.15.92:6819/3411102480","heartbeat_back_addr":"172.21.15.92:6823/3411102480","heartbeat_front_addr":"172.21.15.92:6821/3411102480","state":["exists","up"]},{"osd":8,"uuid":"31879baa-861d-4322-990f-0b9a42b8b610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6817","nonce":2990859925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6819","nonce":2990859925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6823","nonce":2990859925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6821","nonce":2990859925}]},"public_addr":"172.21.15.102:6817/2990859925","cluster_addr":"172.21.15.102:6819/2990859925","heartbeat_back_addr":"172.21.15.102:6823/2990859925","heartbeat_front_addr":"172.21.15.102:6821/2990859925","state":["exists","up"]},{"osd":9,"uuid":"6d65db33-926c-4a6e-a072-707e9c9de92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6827","nonce":1710319475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6829","nonce":1710319475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6833","nonce":1710319475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6831","nonce":1710319475}]},"public_addr":"172.21.15.7:6827/1710319475","cluster_addr":"172.21.15.7:6829/1710319475","heartbeat_back_addr":"172.21.15.7:6833/1710319475","heartbeat_front_addr":"172.21.15.7:6831/1710319475","state":["exists","up"]},{"osd":10,"uuid":"9ab681ee-0bef-47bd-bf3d-20b17c6b870c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6825","nonce":1063265541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6827","nonce":1063265541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6831","nonce":1063265541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6829","nonce":1063265541}]},"public_addr":"172.21.15.92:6825/1063265541","cluster_addr":"172.21.15.92:6827/1063265541","heartbeat_back_addr":"172.21.15.92:6831/1063265541","heartbeat_front_addr":"172.21.15.92:6829/1063265541","state":["exists","up"]},{"osd":11,"uuid":"dc398e14-5f9e-4f0a-b158-35cbc1f73a83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6825","nonce":1175425599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6827","nonce":1175425599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6831","nonce":1175425599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6829","nonce":1175425599}]},"public_addr":"172.21.15.102:6825/1175425599","cluster_addr":"172.21.15.102:6827/1175425599","heartbeat_back_addr":"172.21.15.102:6831/1175425599","heartbeat_front_addr":"172.21.15.102:6829/1175425599","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:07.857319+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:31.430120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:56.892301+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:10:22.011884+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:10:46.326025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:11:10.339084+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:11:35.365906+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:01.104309+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:25.717295+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:51.387644+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:13:15.076355+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:13:40.253150+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/2883028938":"2024-09-20T04:07:45.039922+0000","172.21.15.7:0/1186412739":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6800/751091002":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6801/751091002":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6801/940106179":"2024-09-20T04:07:20.364033+0000","172.21.15.7:6800/940106179":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/1450115700":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/2954294373":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/1996930242":"2024-09-20T04:07:45.039922+0000","172.21.15.7:0/3562231347":"2024-09-20T04:07:20.364033+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:14:51.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.410+0000 7f300e423640 1 -- 172.21.15.7:0/1466550463 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2ff00a3240 msgr2=0x7f2ff00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:51.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.410+0000 7f300e423640 1 --2- 172.21.15.7:0/1466550463 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2ff00a3240 0x7f2ff00a5700 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8005e10 tx=0x7f2ff8005da0 comp rx=0 tx=0).stop 2024-09-19T04:14:51.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.410+0000 7f300e423640 1 -- 172.21.15.7:0/1466550463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3008102790 msgr2=0x7f3008198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:51.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.410+0000 7f300e423640 1 --2- 172.21.15.7:0/1466550463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3008102790 0x7f3008198960 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc005ab0 tx=0x7f2ffc0042f0 comp rx=0 tx=0).stop 2024-09-19T04:14:51.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.411+0000 7f300e423640 1 -- 172.21.15.7:0/1466550463 shutdown_connections 2024-09-19T04:14:51.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.411+0000 7f300e423640 1 --2- 172.21.15.7:0/1466550463 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2ff00a3240 0x7f2ff00a5700 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:51.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.411+0000 7f300e423640 1 --2- 172.21.15.7:0/1466550463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3008106f10 0x7f300819ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:51.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.411+0000 7f300e423640 1 --2- 172.21.15.7:0/1466550463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3008102790 0x7f3008198960 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:51.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.411+0000 7f300e423640 1 --2- 172.21.15.7:0/1466550463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3008101de0 0x7f3008198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:51.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.411+0000 7f300e423640 1 -- 172.21.15.7:0/1466550463 >> 172.21.15.7:0/1466550463 conn(0x7f30080fd8c0 msgr2=0x7f30080fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:51.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.411+0000 7f300e423640 1 -- 172.21.15.7:0/1466550463 shutdown_connections 2024-09-19T04:14:51.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:51.411+0000 7f300e423640 1 -- 172.21.15.7:0/1466550463 wait complete. 2024-09-19T04:14:52.051 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T04:14:34.007803+0000', 'modified': '2024-09-19T04:14:43.113488+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24506}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24506': {'gid': 24506, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.92:6839/3805481296', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6838', 'nonce': 3805481296}, {'type': 'v1', 'addr': '172.21.15.92:6839', 'nonce': 3805481296}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24506, 'qdb_cluster': [24506]} 2024-09-19T04:14:52.051 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T04:14:52.051 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T04:14:52.307 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:14:52.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:52 smithi102 ceph-mon[35446]: pgmap v289: 129 pgs: 129 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:52.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:52 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1466550463' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:14:52.716 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:52 smithi007 ceph-mon[31360]: pgmap v289: 129 pgs: 129 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:52.716 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:52 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1466550463' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:14:52.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:52 smithi092 ceph-mon[34940]: pgmap v289: 129 pgs: 129 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:52.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:52 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1466550463' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:14:52.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.796+0000 7f50ecc18640 1 -- 172.21.15.7:0/2227891142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50e8101420 msgr2=0x7f50e810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:52.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.796+0000 7f50ecc18640 1 --2- 172.21.15.7:0/2227891142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50e8101420 0x7f50e810d950 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f50e0009cd0 tx=0x7f50e002a8e0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.796+0000 7f50ecc18640 1 -- 172.21.15.7:0/2227891142 shutdown_connections 2024-09-19T04:14:52.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.796+0000 7f50ecc18640 1 --2- 172.21.15.7:0/2227891142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50e8101420 0x7f50e810d950 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.796+0000 7f50ecc18640 1 --2- 172.21.15.7:0/2227891142 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50e8100a80 0x7f50e8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.796+0000 7f50ecc18640 1 --2- 172.21.15.7:0/2227891142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50e8106a80 0x7f50e8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.796+0000 7f50ecc18640 1 -- 172.21.15.7:0/2227891142 >> 172.21.15.7:0/2227891142 conn(0x7f50e80fc7a0 msgr2=0x7f50e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:52.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.796+0000 7f50ecc18640 1 -- 172.21.15.7:0/2227891142 shutdown_connections 2024-09-19T04:14:52.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.797+0000 7f50ecc18640 1 -- 172.21.15.7:0/2227891142 wait complete. 2024-09-19T04:14:52.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.797+0000 7f50ecc18640 1 Processor -- start 2024-09-19T04:14:52.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.797+0000 7f50ecc18640 1 -- start start 2024-09-19T04:14:52.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.798+0000 7f50ecc18640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50e8100a80 0x7f50e8199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.798+0000 7f50ecc18640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50e8101420 0x7f50e81997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.798+0000 7f50ecc18640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50e8106a80 0x7f50e81a4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.798+0000 7f50ecc18640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f50e8110e80 con 0x7f50e8101420 2024-09-19T04:14:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.798+0000 7f50ecc18640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f50e8110d00 con 0x7f50e8106a80 2024-09-19T04:14:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.798+0000 7f50ecc18640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f50e8111000 con 0x7f50e8100a80 2024-09-19T04:14:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.798+0000 7f50ddd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50e8101420 0x7f50e81997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.798+0000 7f50e659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50e8100a80 0x7f50e8199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.798+0000 7f50ddd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50e8101420 0x7f50e81997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48300/0 (socket says 172.21.15.7:48300) 2024-09-19T04:14:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.798+0000 7f50ddd9b640 1 -- 172.21.15.7:0/1310646437 learned_addr learned my addr 172.21.15.7:0/1310646437 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:14:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.798+0000 7f50e6d9d640 1 --2- 172.21.15.7:0/1310646437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50e8106a80 0x7f50e81a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.798+0000 7f50ddd9b640 1 -- 172.21.15.7:0/1310646437 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50e8100a80 msgr2=0x7f50e8199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.798+0000 7f50ddd9b640 1 --2- 172.21.15.7:0/1310646437 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50e8100a80 0x7f50e8199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.798+0000 7f50ddd9b640 1 -- 172.21.15.7:0/1310646437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50e8106a80 msgr2=0x7f50e81a4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:52.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.798+0000 7f50ddd9b640 1 --2- 172.21.15.7:0/1310646437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50e8106a80 0x7f50e81a4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.798+0000 7f50ddd9b640 1 -- 172.21.15.7:0/1310646437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e81a4850 con 0x7f50e8101420 2024-09-19T04:14:52.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.798+0000 7f50e6d9d640 1 --2- 172.21.15.7:0/1310646437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50e8106a80 0x7f50e81a4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:14:52.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.798+0000 7f50e659c640 1 --2- 172.21.15.7:0/1310646437 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50e8100a80 0x7f50e8199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:14:52.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.798+0000 7f50ddd9b640 1 --2- 172.21.15.7:0/1310646437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50e8101420 0x7f50e81997d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f50d000e9f0 tx=0x7f50d000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:52.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.798+0000 7f50dffff640 1 -- 172.21.15.7:0/1310646437 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d000cd80 con 0x7f50e8101420 2024-09-19T04:14:52.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.799+0000 7f50dffff640 1 -- 172.21.15.7:0/1310646437 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50d0005500 con 0x7f50e8101420 2024-09-19T04:14:52.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.799+0000 7f50ecc18640 1 -- 172.21.15.7:0/1310646437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e81a4a20 con 0x7f50e8101420 2024-09-19T04:14:52.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.799+0000 7f50dffff640 1 -- 172.21.15.7:0/1310646437 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d0010690 con 0x7f50e8101420 2024-09-19T04:14:52.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.799+0000 7f50ecc18640 1 -- 172.21.15.7:0/1310646437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e81a4ee0 con 0x7f50e8101420 2024-09-19T04:14:52.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.801+0000 7f50dffff640 1 -- 172.21.15.7:0/1310646437 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f50d00046c0 con 0x7f50e8101420 2024-09-19T04:14:52.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.801+0000 7f50eeff1740 1 Processor -- start 2024-09-19T04:14:52.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.801+0000 7f50eeff1740 1 -- start start 2024-09-19T04:14:52.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.801+0000 7f50eeff1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56302597a8f0 0x56302597acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:52.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.802+0000 7f50eeff1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56302597b210 0x563025989a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:52.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.802+0000 7f50eeff1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563025989fc0 0x56302598c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:52.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.802+0000 7f50eeff1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5630258e1090 con 0x56302597a8f0 2024-09-19T04:14:52.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.802+0000 7f50eeff1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563025888a70 con 0x563025989fc0 2024-09-19T04:14:52.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.802+0000 7f50eeff1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5630258dd050 con 0x56302597b210 2024-09-19T04:14:52.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.802+0000 7f50dffff640 1 --2- 172.21.15.7:0/1310646437 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f50d40a3240 0x7f50d40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:52.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.802+0000 7f50e6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56302597a8f0 0x56302597acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:52.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.802+0000 7f50e6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56302597a8f0 0x56302597acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48306/0 (socket says 172.21.15.7:48306) 2024-09-19T04:14:52.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.802+0000 7f50e6d9d640 1 -- 172.21.15.7:0/1933516679 learned_addr learned my addr 172.21.15.7:0/1933516679 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:14:52.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.802+0000 7f50ddd9b640 1 --2- 172.21.15.7:0/1933516679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563025989fc0 0x56302598c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.802+0000 7f50e659c640 1 --2- 172.21.15.7:0/1933516679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56302597b210 0x563025989a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.802+0000 7f50e6d9d640 1 --2- 172.21.15.7:0/1310646437 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f50d40a3240 0x7f50d40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.802+0000 7f50dffff640 1 -- 172.21.15.7:0/1310646437 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f50d00cffe0 con 0x7f50e8101420 2024-09-19T04:14:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.802+0000 7f50e6d9d640 1 -- 172.21.15.7:0/1933516679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56302597b210 msgr2=0x563025989a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:14:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.802+0000 7f50e6d9d640 1 --2- 172.21.15.7:0/1933516679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56302597b210 0x563025989a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.802+0000 7f50e6d9d640 1 -- 172.21.15.7:0/1933516679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563025989fc0 msgr2=0x56302598c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:14:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.802+0000 7f50e6d9d640 1 --2- 172.21.15.7:0/1933516679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563025989fc0 0x56302598c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.802+0000 7f50e6d9d640 1 -- 172.21.15.7:0/1933516679 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563025895130 con 0x56302597a8f0 2024-09-19T04:14:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.802+0000 7f50e6d9d640 1 --2- 172.21.15.7:0/1933516679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56302597a8f0 0x56302597acd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f50e0035000 tx=0x7f50e0031940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa13fb95e3873702 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.803+0000 7f50dcd99640 1 -- 172.21.15.7:0/1933516679 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e0004040 con 0x56302597a8f0 2024-09-19T04:14:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.803+0000 7f50dcd99640 1 -- 172.21.15.7:0/1933516679 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50e0036040 con 0x56302597a8f0 2024-09-19T04:14:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.803+0000 7f50dcd99640 1 -- 172.21.15.7:0/1933516679 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e0030960 con 0x56302597a8f0 2024-09-19T04:14:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.803+0000 7f50eeff1740 1 -- 172.21.15.7:0/1933516679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56302597a8f0 msgr2=0x56302597acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:52.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.803+0000 7f50e6d9d640 1 --2- 172.21.15.7:0/1310646437 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f50d40a3240 0x7f50d40a5700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f50e004d000 tx=0x7f50e004b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:52.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.803+0000 7f50eeff1740 1 --2- 172.21.15.7:0/1933516679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56302597a8f0 0x56302597acd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f50e0035000 tx=0x7f50e0031940 comp rx=0 tx=0).stop 2024-09-19T04:14:52.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.803+0000 7f50eeff1740 1 -- 172.21.15.7:0/1933516679 shutdown_connections 2024-09-19T04:14:52.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.803+0000 7f50eeff1740 1 --2- 172.21.15.7:0/1933516679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563025989fc0 0x56302598c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.803+0000 7f50eeff1740 1 --2- 172.21.15.7:0/1933516679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56302597b210 0x563025989a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.803+0000 7f50eeff1740 1 --2- 172.21.15.7:0/1933516679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56302597a8f0 0x56302597acd0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.803+0000 7f50eeff1740 1 -- 172.21.15.7:0/1933516679 >> 172.21.15.7:0/1933516679 conn(0x563025976f60 msgr2=0x563025977340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:52.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.803+0000 7f50eeff1740 1 -- 172.21.15.7:0/1933516679 shutdown_connections 2024-09-19T04:14:52.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.803+0000 7f50eeff1740 1 -- 172.21.15.7:0/1933516679 wait complete. 2024-09-19T04:14:52.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.804+0000 7f50eeff1740 1 -- start start 2024-09-19T04:14:52.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.804+0000 7f50eeff1740 1 Processor -- start 2024-09-19T04:14:52.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.804+0000 7f50eeff1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56302597a8f0 0x563025989850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:52.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.804+0000 7f50eeff1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56302597b210 0x563025986ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:52.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.804+0000 7f50eeff1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563025989fc0 0x5630259870e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:52.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.804+0000 7f50eeff1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56302598cb30 con 0x56302597b210 2024-09-19T04:14:52.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.804+0000 7f50eeff1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56302589bf20 con 0x56302597a8f0 2024-09-19T04:14:52.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.804+0000 7f50eeff1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56302598ccb0 con 0x563025989fc0 2024-09-19T04:14:52.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.804+0000 7f50eeff1740 10 client.0 _ll_register_callbacks cb 0x563025865030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:14:52.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.804+0000 7f50ddd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56302597b210 0x563025986ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:52.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.804+0000 7f50ddd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56302597b210 0x563025986ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48322/0 (socket says 172.21.15.7:48322) 2024-09-19T04:14:52.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.804+0000 7f50ddd9b640 1 -- 172.21.15.7:0/4066490278 learned_addr learned my addr 172.21.15.7:0/4066490278 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:14:52.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.804+0000 7f50e6d9d640 1 --2- 172.21.15.7:0/4066490278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563025989fc0 0x5630259870e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:52.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.804+0000 7f50e659c640 1 --2- 172.21.15.7:0/4066490278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56302597a8f0 0x563025989850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:52.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.804+0000 7f50ddd9b640 1 -- 172.21.15.7:0/4066490278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563025989fc0 msgr2=0x5630259870e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:14:52.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.804+0000 7f50ddd9b640 1 --2- 172.21.15.7:0/4066490278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563025989fc0 0x5630259870e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.805+0000 7f50ddd9b640 1 -- 172.21.15.7:0/4066490278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56302597a8f0 msgr2=0x563025989850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:14:52.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.805+0000 7f50ddd9b640 1 --2- 172.21.15.7:0/4066490278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56302597a8f0 0x563025989850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.805+0000 7f50ddd9b640 1 -- 172.21.15.7:0/4066490278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630256522b0 con 0x56302597b210 2024-09-19T04:14:52.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.805+0000 7f50ddd9b640 1 --2- 172.21.15.7:0/4066490278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56302597b210 0x563025986ba0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f50d009c0c0 tx=0x7f50d006f300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bcfbc6e177acab0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:52.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.805+0000 7f50cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:14:52.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.805+0000 7f50cdffb640 1 -- 172.21.15.7:0/4066490278 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d009bd20 con 0x56302597b210 2024-09-19T04:14:52.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.805+0000 7f50cdffb640 1 -- 172.21.15.7:0/4066490278 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f50d00a4ba0 con 0x56302597b210 2024-09-19T04:14:52.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.805+0000 7f50eeff1740 1 -- 172.21.15.7:0/4066490278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50e0036040 con 0x56302597b210 2024-09-19T04:14:52.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.805+0000 7f50cdffb640 1 -- 172.21.15.7:0/4066490278 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f50d00d2310 con 0x56302597b210 2024-09-19T04:14:52.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.805+0000 7f50eeff1740 10 client.14700 fetch_fsmap learned FSMap version 17 2024-09-19T04:14:52.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.805+0000 7f50eeff1740 1 -- 172.21.15.7:0/4066490278 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x563025998540 con 0x56302597b210 2024-09-19T04:14:52.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.805+0000 7f50cdffb640 1 -- 172.21.15.7:0/4066490278 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50e0036040 con 0x56302597b210 2024-09-19T04:14:52.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.805+0000 7f50cdffb640 1 -- 172.21.15.7:0/4066490278 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f50d00b5240 con 0x56302597b210 2024-09-19T04:14:52.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.805+0000 7f50eeff1740 10 client.14700 fetch_fsmap finished waiting for FSMap version 17 2024-09-19T04:14:52.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.805+0000 7f50eeff1740 10 client.14700 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T04:14:52.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.805+0000 7f50eeff1740 20 client.14700 populate_metadata read hostname 'smithi007' 2024-09-19T04:14:52.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.805+0000 7f50eeff1740 1 --2- 172.21.15.7:0/4066490278 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x56302599ab50 0x56302599bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:52.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.805+0000 7f50eeff1740 4 client.14700 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:14:52.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.805+0000 7f50eeff1740 1 -- 172.21.15.7:0/4066490278 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630258ee600 con 0x56302599ab50 2024-09-19T04:14:52.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.806+0000 7f50e659c640 1 --2- 172.21.15.7:0/4066490278 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x56302599ab50 0x56302599bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:52.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.806+0000 7f50cdffb640 10 client.14700 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:14:52.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.806+0000 7f50e659c640 1 --2- 172.21.15.7:0/4066490278 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x56302599ab50 0x56302599bfc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c597dcd6d3eaf4ac server_cookie=a4969e46268a4840 in_seq=0 out_seq=0 2024-09-19T04:14:52.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.807+0000 7f50cdffb640 1 -- 172.21.15.7:0/4066490278 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5630258ee600 con 0x56302599ab50 2024-09-19T04:14:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.807+0000 7f50cdffb640 10 client.14700 handle_command_reply: tid=0 2024-09-19T04:14:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.807+0000 7f50eeff1740 1 client.14700 shutdown 2024-09-19T04:14:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.807+0000 7f50eeff1740 1 -- 172.21.15.7:0/4066490278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56302597b210 msgr2=0x563025986ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.807+0000 7f50eeff1740 1 --2- 172.21.15.7:0/4066490278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56302597b210 0x563025986ba0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f50d009c0c0 tx=0x7f50d006f300 comp rx=0 tx=0).stop 2024-09-19T04:14:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.807+0000 7f50eeff1740 1 -- 172.21.15.7:0/4066490278 shutdown_connections 2024-09-19T04:14:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.807+0000 7f50eeff1740 1 --2- 172.21.15.7:0/4066490278 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x56302599ab50 0x56302599bfc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.807+0000 7f50eeff1740 1 --2- 172.21.15.7:0/4066490278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563025989fc0 0x5630259870e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.807+0000 7f50eeff1740 1 --2- 172.21.15.7:0/4066490278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56302597b210 0x563025986ba0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.807+0000 7f50eeff1740 1 --2- 172.21.15.7:0/4066490278 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56302597a8f0 0x563025989850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.807+0000 7f50eeff1740 1 -- 172.21.15.7:0/4066490278 >> 172.21.15.7:0/4066490278 conn(0x563025976f60 msgr2=0x56302597cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.807+0000 7f50cdffb640 0 client.14700 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:14:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.807+0000 7f50eeff1740 1 -- 172.21.15.7:0/4066490278 shutdown_connections 2024-09-19T04:14:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.807+0000 7f50eeff1740 1 -- 172.21.15.7:0/4066490278 wait complete. 2024-09-19T04:14:52.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.807+0000 7f50eeff1740 20 client.14700 trim_cache size 0 max 16384 2024-09-19T04:14:52.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.825+0000 7f50eeff1740 1 Processor -- start 2024-09-19T04:14:52.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.825+0000 7f50eeff1740 1 -- start start 2024-09-19T04:14:52.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.826+0000 7f50eeff1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56302597a8f0 0x56302599b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:52.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.826+0000 7f50eeff1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56302597b210 0x563025971ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:52.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.826+0000 7f50eeff1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563025989fc0 0x5630259854b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:52.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.826+0000 7f50eeff1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56302599a300 con 0x56302597b210 2024-09-19T04:14:52.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.826+0000 7f50eeff1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56302599a9d0 con 0x563025989fc0 2024-09-19T04:14:52.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.826+0000 7f50eeff1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56302599b0a0 con 0x56302597a8f0 2024-09-19T04:14:52.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.826+0000 7f50ddd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56302597b210 0x563025971ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:52.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.826+0000 7f50ddd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56302597b210 0x563025971ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48326/0 (socket says 172.21.15.7:48326) 2024-09-19T04:14:52.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.826+0000 7f50ddd9b640 1 -- 172.21.15.7:0/2967812642 learned_addr learned my addr 172.21.15.7:0/2967812642 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:14:52.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.826+0000 7f50e6d9d640 1 --2- 172.21.15.7:0/2967812642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563025989fc0 0x5630259854b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:52.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.826+0000 7f50e659c640 1 --2- 172.21.15.7:0/2967812642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56302597a8f0 0x56302599b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:52.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.826+0000 7f50ddd9b640 1 -- 172.21.15.7:0/2967812642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56302597a8f0 msgr2=0x56302599b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:14:52.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.826+0000 7f50ddd9b640 1 --2- 172.21.15.7:0/2967812642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56302597a8f0 0x56302599b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.826+0000 7f50ddd9b640 1 -- 172.21.15.7:0/2967812642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563025989fc0 msgr2=0x5630259854b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:14:52.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.826+0000 7f50ddd9b640 1 --2- 172.21.15.7:0/2967812642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563025989fc0 0x5630259854b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.826+0000 7f50ddd9b640 1 -- 172.21.15.7:0/2967812642 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630259876e0 con 0x56302597b210 2024-09-19T04:14:52.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.826+0000 7f50ddd9b640 1 --2- 172.21.15.7:0/2967812642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56302597b210 0x563025971ce0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f50d0098820 tx=0x7f50d009a8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df0f0be52d7e5e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:52.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.826+0000 7f50cffff640 1 -- 172.21.15.7:0/2967812642 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d009bd20 con 0x56302597b210 2024-09-19T04:14:52.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.826+0000 7f50cffff640 1 -- 172.21.15.7:0/2967812642 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50d009cac0 con 0x56302597b210 2024-09-19T04:14:52.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.826+0000 7f50cffff640 1 -- 172.21.15.7:0/2967812642 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d009c190 con 0x56302597b210 2024-09-19T04:14:52.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.827+0000 7f50eeff1740 1 -- 172.21.15.7:0/2967812642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56302597b210 msgr2=0x563025971ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:52.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.827+0000 7f50eeff1740 1 --2- 172.21.15.7:0/2967812642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56302597b210 0x563025971ce0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f50d0098820 tx=0x7f50d009a8d0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.827+0000 7f50eeff1740 1 -- 172.21.15.7:0/2967812642 shutdown_connections 2024-09-19T04:14:52.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.827+0000 7f50eeff1740 1 --2- 172.21.15.7:0/2967812642 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563025989fc0 0x5630259854b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.827+0000 7f50eeff1740 1 --2- 172.21.15.7:0/2967812642 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56302597b210 0x563025971ce0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.827+0000 7f50eeff1740 1 --2- 172.21.15.7:0/2967812642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56302597a8f0 0x56302599b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.827+0000 7f50eeff1740 1 -- 172.21.15.7:0/2967812642 >> 172.21.15.7:0/2967812642 conn(0x563025976f60 msgr2=0x563025977340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:52.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.827+0000 7f50eeff1740 1 -- 172.21.15.7:0/2967812642 shutdown_connections 2024-09-19T04:14:52.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.827+0000 7f50eeff1740 1 -- 172.21.15.7:0/2967812642 wait complete. 2024-09-19T04:14:52.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.827+0000 7f50eeff1740 1 -- start start 2024-09-19T04:14:52.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.828+0000 7f50eeff1740 1 Processor -- start 2024-09-19T04:14:52.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.828+0000 7f50eeff1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56302597a8f0 0x5630259831f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:52.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.828+0000 7f50eeff1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56302597b210 0x563025983730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:52.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.828+0000 7f50eeff1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563025989fc0 0x5630259a3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:52.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.828+0000 7f50eeff1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56302599be40 con 0x563025989fc0 2024-09-19T04:14:52.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.828+0000 7f50eeff1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56302599b770 con 0x56302597a8f0 2024-09-19T04:14:52.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.828+0000 7f50eeff1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56302599c510 con 0x56302597b210 2024-09-19T04:14:52.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.828+0000 7f50e6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563025989fc0 0x5630259a3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:52.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.828+0000 7f50e6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563025989fc0 0x5630259a3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48332/0 (socket says 172.21.15.7:48332) 2024-09-19T04:14:52.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.828+0000 7f50e6d9d640 1 -- 172.21.15.7:0/2659975804 learned_addr learned my addr 172.21.15.7:0/2659975804 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:14:52.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.828+0000 7f50eeff1740 10 client.0 _ll_register_callbacks cb 0x7f50d0009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:14:52.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.828+0000 7f50ddd9b640 1 --2- 172.21.15.7:0/2659975804 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56302597b210 0x563025983730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:52.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.828+0000 7f50e659c640 1 --2- 172.21.15.7:0/2659975804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56302597a8f0 0x5630259831f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:52.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.828+0000 7f50e6d9d640 1 -- 172.21.15.7:0/2659975804 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56302597b210 msgr2=0x563025983730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:14:52.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.828+0000 7f50e6d9d640 1 --2- 172.21.15.7:0/2659975804 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56302597b210 0x563025983730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.828+0000 7f50e6d9d640 1 -- 172.21.15.7:0/2659975804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56302597a8f0 msgr2=0x5630259831f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:14:52.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.828+0000 7f50e6d9d640 1 --2- 172.21.15.7:0/2659975804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56302597a8f0 0x5630259831f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.828+0000 7f50e6d9d640 1 -- 172.21.15.7:0/2659975804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630259a3750 con 0x563025989fc0 2024-09-19T04:14:52.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.829+0000 7f50e6d9d640 1 --2- 172.21.15.7:0/2659975804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563025989fc0 0x5630259a3210 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f50e002ae00 tx=0x7f50e0005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b67fecd63a070a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:52.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.829+0000 7f50cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:14:52.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.829+0000 7f50cdffb640 1 -- 172.21.15.7:0/2659975804 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e0030c40 con 0x563025989fc0 2024-09-19T04:14:52.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.829+0000 7f50cdffb640 1 -- 172.21.15.7:0/2659975804 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f50e002e050 con 0x563025989fc0 2024-09-19T04:14:52.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.829+0000 7f50eeff1740 1 -- 172.21.15.7:0/2659975804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50d009cac0 con 0x563025989fc0 2024-09-19T04:14:52.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.829+0000 7f50cdffb640 1 -- 172.21.15.7:0/2659975804 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f50e0069050 con 0x563025989fc0 2024-09-19T04:14:52.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.829+0000 7f50eeff1740 10 client.14706 fetch_fsmap learned FSMap version 17 2024-09-19T04:14:52.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.829+0000 7f50eeff1740 1 -- 172.21.15.7:0/2659975804 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x5630259a4a50 con 0x563025989fc0 2024-09-19T04:14:52.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.829+0000 7f50cdffb640 1 -- 172.21.15.7:0/2659975804 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50d009cac0 con 0x563025989fc0 2024-09-19T04:14:52.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.829+0000 7f50cdffb640 1 -- 172.21.15.7:0/2659975804 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f50e0030070 con 0x563025989fc0 2024-09-19T04:14:52.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.829+0000 7f50eeff1740 10 client.14706 fetch_fsmap finished waiting for FSMap version 17 2024-09-19T04:14:52.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.829+0000 7f50eeff1740 10 client.14706 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T04:14:52.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.829+0000 7f50eeff1740 20 client.14706 populate_metadata read hostname 'smithi007' 2024-09-19T04:14:52.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.829+0000 7f50eeff1740 1 --2- 172.21.15.7:0/2659975804 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x563025a09170 0x563025a07e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:52.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.829+0000 7f50eeff1740 4 client.14706 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T04:14:52.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.829+0000 7f50eeff1740 1 -- 172.21.15.7:0/2659975804 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "status"}) -- 0x5630258e8b10 con 0x563025a09170 2024-09-19T04:14:52.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.830+0000 7f50e659c640 1 --2- 172.21.15.7:0/2659975804 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x563025a09170 0x563025a07e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:52.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.830+0000 7f50e659c640 1 --2- 172.21.15.7:0/2659975804 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x563025a09170 0x563025a07e80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c539fa15ade24ab server_cookie=594909072ebcd4da in_seq=0 out_seq=0 2024-09-19T04:14:52.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.830+0000 7f50cdffb640 10 client.14706 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:14:52.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.830+0000 7f50cdffb640 1 -- 172.21.15.7:0/2659975804 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5630258e8b10 con 0x563025a09170 2024-09-19T04:14:52.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.830+0000 7f50cdffb640 10 client.14706 handle_command_reply: tid=0 2024-09-19T04:14:52.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.830+0000 7f50eeff1740 1 client.14706 shutdown 2024-09-19T04:14:52.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.830+0000 7f50eeff1740 1 -- 172.21.15.7:0/2659975804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563025989fc0 msgr2=0x5630259a3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:52.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.830+0000 7f50eeff1740 1 --2- 172.21.15.7:0/2659975804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563025989fc0 0x5630259a3210 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f50e002ae00 tx=0x7f50e0005ef0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.830+0000 7f50eeff1740 1 -- 172.21.15.7:0/2659975804 shutdown_connections 2024-09-19T04:14:52.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.830+0000 7f50eeff1740 1 --2- 172.21.15.7:0/2659975804 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x563025a09170 0x563025a07e80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.830+0000 7f50eeff1740 1 --2- 172.21.15.7:0/2659975804 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563025989fc0 0x5630259a3210 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.830+0000 7f50eeff1740 1 --2- 172.21.15.7:0/2659975804 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56302597b210 0x563025983730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.831+0000 7f50eeff1740 1 --2- 172.21.15.7:0/2659975804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56302597a8f0 0x5630259831f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.831+0000 7f50eeff1740 1 -- 172.21.15.7:0/2659975804 >> 172.21.15.7:0/2659975804 conn(0x563025976f60 msgr2=0x563025971ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:52.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.831+0000 7f50cdffb640 0 client.14706 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:14:52.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.831+0000 7f50eeff1740 1 -- 172.21.15.7:0/2659975804 shutdown_connections 2024-09-19T04:14:52.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.831+0000 7f50eeff1740 1 -- 172.21.15.7:0/2659975804 wait complete. 2024-09-19T04:14:52.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.831+0000 7f50eeff1740 20 client.14706 trim_cache size 0 max 16384 2024-09-19T04:14:52.839 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:14:52.839 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "77957c0a-763c-11ef-bceb-c7b262605968", 2024-09-19T04:14:52.839 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-09-19T04:14:52.839 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24506, 2024-09-19T04:14:52.839 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-19T04:14:52.839 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-19T04:14:52.839 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-19T04:14:52.840 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 18.511546572, 2024-09-19T04:14:52.840 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 17, 2024-09-19T04:14:52.840 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 86, 2024-09-19T04:14:52.840 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 86, 2024-09-19T04:14:52.840 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 30.031168954000002 2024-09-19T04:14:52.840 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:14:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.831+0000 7f50ecc18640 1 -- 172.21.15.7:0/1310646437 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f50d40a3240 msgr2=0x7f50d40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.831+0000 7f50ecc18640 1 --2- 172.21.15.7:0/1310646437 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f50d40a3240 0x7f50d40a5700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f50e004d000 tx=0x7f50e004b000 comp rx=0 tx=0).stop 2024-09-19T04:14:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.831+0000 7f50ecc18640 1 -- 172.21.15.7:0/1310646437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50e8101420 msgr2=0x7f50e81997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.831+0000 7f50ecc18640 1 --2- 172.21.15.7:0/1310646437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50e8101420 0x7f50e81997d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f50d000e9f0 tx=0x7f50d000edf0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.831+0000 7f50ecc18640 1 -- 172.21.15.7:0/1310646437 shutdown_connections 2024-09-19T04:14:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.831+0000 7f50ecc18640 1 --2- 172.21.15.7:0/1310646437 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f50d40a3240 0x7f50d40a5700 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.831+0000 7f50ecc18640 1 --2- 172.21.15.7:0/1310646437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50e8106a80 0x7f50e81a4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.831+0000 7f50ecc18640 1 --2- 172.21.15.7:0/1310646437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50e8101420 0x7f50e81997d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.831+0000 7f50ecc18640 1 --2- 172.21.15.7:0/1310646437 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50e8100a80 0x7f50e8199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.831+0000 7f50ecc18640 1 -- 172.21.15.7:0/1310646437 >> 172.21.15.7:0/1310646437 conn(0x7f50e80fc7a0 msgr2=0x7f50e80fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.831+0000 7f50ecc18640 1 -- 172.21.15.7:0/1310646437 shutdown_connections 2024-09-19T04:14:52.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:52.832+0000 7f50ecc18640 1 -- 172.21.15.7:0/1310646437 wait complete. 2024-09-19T04:14:53.567 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T04:14:53.567 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-19T04:14:53.567 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T04:14:53.822 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:14:54.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.300+0000 7fd3e7eca640 1 -- 172.21.15.7:0/4074868085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3e010c1a0 msgr2=0x7fd3e010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:54.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.300+0000 7fd3e7eca640 1 --2- 172.21.15.7:0/4074868085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3e010c1a0 0x7fd3e010e610 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8009ca0 tx=0x7fd3d802a950 comp rx=0 tx=0).stop 2024-09-19T04:14:54.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.300+0000 7fd3e7eca640 1 -- 172.21.15.7:0/4074868085 shutdown_connections 2024-09-19T04:14:54.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.300+0000 7fd3e7eca640 1 --2- 172.21.15.7:0/4074868085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3e010c1a0 0x7fd3e010e610 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:54.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.300+0000 7fd3e7eca640 1 --2- 172.21.15.7:0/4074868085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3e0103720 0x7fd3e010bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:54.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.300+0000 7fd3e7eca640 1 --2- 172.21.15.7:0/4074868085 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3e0102e00 0x7fd3e01031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:54.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.300+0000 7fd3e7eca640 1 -- 172.21.15.7:0/4074868085 >> 172.21.15.7:0/4074868085 conn(0x7fd3e00fc7a0 msgr2=0x7fd3e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:54.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.300+0000 7fd3e7eca640 1 -- 172.21.15.7:0/4074868085 shutdown_connections 2024-09-19T04:14:54.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.300+0000 7fd3e7eca640 1 -- 172.21.15.7:0/4074868085 wait complete. 2024-09-19T04:14:54.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.300+0000 7fd3e7eca640 1 Processor -- start 2024-09-19T04:14:54.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.300+0000 7fd3e7eca640 1 -- start start 2024-09-19T04:14:54.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.301+0000 7fd3e7eca640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3e0102e00 0x7fd3e0100a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:54.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.301+0000 7fd3e7eca640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3e0103720 0x7fd3e0100fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:54.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.301+0000 7fd3e7eca640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3e010c1a0 0x7fd3e01014e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:54.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.301+0000 7fd3e7eca640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e0111f70 con 0x7fd3e010c1a0 2024-09-19T04:14:54.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.301+0000 7fd3e7eca640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e0111df0 con 0x7fd3e0103720 2024-09-19T04:14:54.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.301+0000 7fd3e7eca640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e01120f0 con 0x7fd3e0102e00 2024-09-19T04:14:54.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.301+0000 7fd3e6467640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3e010c1a0 0x7fd3e01014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:54.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.301+0000 7fd3e6467640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3e010c1a0 0x7fd3e01014e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48362/0 (socket says 172.21.15.7:48362) 2024-09-19T04:14:54.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.301+0000 7fd3e6467640 1 -- 172.21.15.7:0/2580028050 learned_addr learned my addr 172.21.15.7:0/2580028050 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:14:54.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.301+0000 7fd3e5465640 1 --2- 172.21.15.7:0/2580028050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3e0103720 0x7fd3e0100fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:54.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.301+0000 7fd3e5c66640 1 --2- 172.21.15.7:0/2580028050 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3e0102e00 0x7fd3e0100a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:54.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.301+0000 7fd3e6467640 1 -- 172.21.15.7:0/2580028050 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3e0102e00 msgr2=0x7fd3e0100a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:54.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.301+0000 7fd3e6467640 1 --2- 172.21.15.7:0/2580028050 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3e0102e00 0x7fd3e0100a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:54.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.301+0000 7fd3e6467640 1 -- 172.21.15.7:0/2580028050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3e0103720 msgr2=0x7fd3e0100fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:54.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.301+0000 7fd3e6467640 1 --2- 172.21.15.7:0/2580028050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3e0103720 0x7fd3e0100fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:54.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.301+0000 7fd3e6467640 1 -- 172.21.15.7:0/2580028050 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e01a68b0 con 0x7fd3e010c1a0 2024-09-19T04:14:54.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.301+0000 7fd3e6467640 1 --2- 172.21.15.7:0/2580028050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3e010c1a0 0x7fd3e01014e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd3d802ae70 tx=0x7fd3d802f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:54.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.301+0000 7fd3d6ffd640 1 -- 172.21.15.7:0/2580028050 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8034040 con 0x7fd3e010c1a0 2024-09-19T04:14:54.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.301+0000 7fd3d6ffd640 1 -- 172.21.15.7:0/2580028050 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3d8030920 con 0x7fd3e010c1a0 2024-09-19T04:14:54.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.301+0000 7fd3e7eca640 1 -- 172.21.15.7:0/2580028050 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3e01a6b40 con 0x7fd3e010c1a0 2024-09-19T04:14:54.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.301+0000 7fd3d6ffd640 1 -- 172.21.15.7:0/2580028050 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8045480 con 0x7fd3e010c1a0 2024-09-19T04:14:54.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.302+0000 7fd3e7eca640 1 -- 172.21.15.7:0/2580028050 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3e01a7020 con 0x7fd3e010c1a0 2024-09-19T04:14:54.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.302+0000 7fd3e7eca640 1 -- 172.21.15.7:0/2580028050 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3e01031e0 con 0x7fd3e010c1a0 2024-09-19T04:14:54.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.304+0000 7fd3d6ffd640 1 -- 172.21.15.7:0/2580028050 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fd3d8037020 con 0x7fd3e010c1a0 2024-09-19T04:14:54.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.304+0000 7fd3d6ffd640 1 --2- 172.21.15.7:0/2580028050 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd3cc0a3240 0x7fd3cc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:54.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.304+0000 7fd3e5c66640 1 --2- 172.21.15.7:0/2580028050 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd3cc0a3240 0x7fd3cc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:54.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.304+0000 7fd3d6ffd640 1 -- 172.21.15.7:0/2580028050 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fd3d80f09d0 con 0x7fd3e010c1a0 2024-09-19T04:14:54.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.305+0000 7fd3e5c66640 1 --2- 172.21.15.7:0/2580028050 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd3cc0a3240 0x7fd3cc0a5700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc005fd0 tx=0x7fd3dc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:54.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.309+0000 7fd3d6ffd640 1 -- 172.21.15.7:0/2580028050 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd3d80bd4b0 con 0x7fd3e010c1a0 2024-09-19T04:14:54.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.526+0000 7fd3e7eca640 1 -- 172.21.15.7:0/2580028050 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd3e0107280 con 0x7fd3e010c1a0 2024-09-19T04:14:54.527 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:54 smithi007 ceph-mon[31360]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:54.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.526+0000 7fd3d6ffd640 1 -- 172.21.15.7:0/2580028050 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7fd3d80bcdb0 con 0x7fd3e010c1a0 2024-09-19T04:14:54.528 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-19T04:14:54.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.528+0000 7fd3e7eca640 1 -- 172.21.15.7:0/2580028050 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd3cc0a3240 msgr2=0x7fd3cc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:54.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.528+0000 7fd3e7eca640 1 --2- 172.21.15.7:0/2580028050 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd3cc0a3240 0x7fd3cc0a5700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc005fd0 tx=0x7fd3dc00b390 comp rx=0 tx=0).stop 2024-09-19T04:14:54.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.528+0000 7fd3e7eca640 1 -- 172.21.15.7:0/2580028050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3e010c1a0 msgr2=0x7fd3e01014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:54.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.528+0000 7fd3e7eca640 1 --2- 172.21.15.7:0/2580028050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3e010c1a0 0x7fd3e01014e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd3d802ae70 tx=0x7fd3d802f5b0 comp rx=0 tx=0).stop 2024-09-19T04:14:54.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.528+0000 7fd3e7eca640 1 -- 172.21.15.7:0/2580028050 shutdown_connections 2024-09-19T04:14:54.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.528+0000 7fd3e7eca640 1 --2- 172.21.15.7:0/2580028050 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd3cc0a3240 0x7fd3cc0a5700 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:54.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.528+0000 7fd3e7eca640 1 --2- 172.21.15.7:0/2580028050 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3e010c1a0 0x7fd3e01014e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:54.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.528+0000 7fd3e7eca640 1 --2- 172.21.15.7:0/2580028050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3e0103720 0x7fd3e0100fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:54.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.528+0000 7fd3e7eca640 1 --2- 172.21.15.7:0/2580028050 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3e0102e00 0x7fd3e0100a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:54.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.528+0000 7fd3e7eca640 1 -- 172.21.15.7:0/2580028050 >> 172.21.15.7:0/2580028050 conn(0x7fd3e00fc7a0 msgr2=0x7fd3e00fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:54.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.529+0000 7fd3e7eca640 1 -- 172.21.15.7:0/2580028050 shutdown_connections 2024-09-19T04:14:54.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:54.529+0000 7fd3e7eca640 1 -- 172.21.15.7:0/2580028050 wait complete. 2024-09-19T04:14:54.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:54 smithi102 ceph-mon[35446]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:54.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:54 smithi092 ceph-mon[34940]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:55.261 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T04:14:55.261 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T04:14:55.261 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-09-19T04:14:55.261 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-19T04:14:55.261 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-19T04:14:55.261 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T04:14:55.262 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T04:14:55.262 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T04:14:55.262 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-19T04:14:55.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:14:55.262 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-09-19T04:14:55.279 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T04:14:55.279 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T04:14:55.279 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T04:14:55.279 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-09-19T04:14:55.280 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-09-19T04:14:55.280 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-09-19T04:14:55.280 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T04:14:55.280 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-09-19T04:14:55.280 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-09-19T04:14:55.280 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T04:14:55.280 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-09-19T04:14:55.280 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-09-19T04:14:55.280 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T04:14:55.280 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-09-19T04:14:55.280 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-09-19T04:14:55.280 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T04:14:55.280 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42271sec preferred_lft 42271sec 2024-09-19T04:14:55.281 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-09-19T04:14:55.281 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-09-19T04:14:55.281 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T04:14:55.281 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-09-19T04:14:55.281 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-09-19T04:14:55.282 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T04:14:55.282 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T04:14:55.282 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-19T04:14:55.282 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add name ceph-brx type bridge 2024-09-19T04:14:55.282 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr flush dev ceph-brx 2024-09-19T04:14:55.282 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set ceph-brx up 2024-09-19T04:14:55.282 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T04:14:55.282 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-19T04:14:55.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T04:14:55.484 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:55 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2580028050' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T04:14:55.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T04:14:55.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:14:55.494 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T04:14:55.521 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-09-19T04:14:55.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:14:55.523 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-09-19T04:14:55.601 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-09-19T04:14:55.601 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T04:14:55.601 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T04:14:55.601 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T04:14:55.601 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T04:14:55.602 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T04:14:55.602 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-19T04:14:55.602 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T04:14:55.602 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T04:14:55.602 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T04:14:55.602 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-19T04:14:55.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:55 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2580028050' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T04:14:55.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T04:14:55.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:55 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2580028050' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T04:14:55.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T04:14:55.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:14:55.940 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-09-19T04:14:55.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:14:55.957 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list-id 2024-09-19T04:14:56.013 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T04:14:56.014 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-19T04:14:56.014 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T04:14:56.014 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-19T04:14:56.014 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-19T04:14:56.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T04:14:56.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T04:14:56.133 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-19T04:14:56.133 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T04:14:56.134 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-19T04:14:56.134 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-19T04:14:56.134 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T04:14:56.134 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-19T04:14:56.134 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-19T04:14:56.134 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-19T04:14:56.134 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-19T04:14:56.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T04:14:56.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T04:14:56.261 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T04:14:56.261 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-19T04:14:56.261 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-09-19T04:14:56.262 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T04:14:56.262 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-19T04:14:56.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T04:14:56.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T04:14:56.342 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-19T04:14:56.342 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T04:14:56.343 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-19T04:14:56.359 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-19T04:14:56.359 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T04:14:56.359 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-19T04:14:56.416 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2024-09-19T04:14:56.483 DEBUG:teuthology.orchestra.run.smithi007:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T04:14:56.540 INFO:teuthology.orchestra.run.smithi007.stdout:/proc 2024-09-19T04:14:56.540 INFO:teuthology.orchestra.run.smithi007.stdout:/sys 2024-09-19T04:14:56.541 INFO:teuthology.orchestra.run.smithi007.stdout:/dev 2024-09-19T04:14:56.541 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/security 2024-09-19T04:14:56.541 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/shm 2024-09-19T04:14:56.541 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/pts 2024-09-19T04:14:56.542 INFO:teuthology.orchestra.run.smithi007.stdout:/run 2024-09-19T04:14:56.542 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup 2024-09-19T04:14:56.542 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/pstore 2024-09-19T04:14:56.542 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/bpf 2024-09-19T04:14:56.542 INFO:teuthology.orchestra.run.smithi007.stdout:/ 2024-09-19T04:14:56.542 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/selinux 2024-09-19T04:14:56.542 INFO:teuthology.orchestra.run.smithi007.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T04:14:56.543 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/debug 2024-09-19T04:14:56.543 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/hugepages 2024-09-19T04:14:56.543 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/mqueue 2024-09-19T04:14:56.543 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/tracing 2024-09-19T04:14:56.543 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T04:14:56.543 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/fuse/connections 2024-09-19T04:14:56.543 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T04:14:56.543 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/config 2024-09-19T04:14:56.544 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T04:14:56.544 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T04:14:56.544 INFO:teuthology.orchestra.run.smithi007.stdout:/run/user/1000 2024-09-19T04:14:56.544 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/ceph 2024-09-19T04:14:56.544 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay 2024-09-19T04:14:56.544 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/1f4266b5c0180644153b26053a5cde1d670633da925bd6302fd9754127790034/merged 2024-09-19T04:14:56.544 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/4b8c1fc9dda745ff2afea2d89dae9cf6cff02db6895d575be136b3b3606dfd07/merged 2024-09-19T04:14:56.544 INFO:teuthology.orchestra.run.smithi007.stdout:/run/user/0 2024-09-19T04:14:56.545 INFO:teuthology.orchestra.run.smithi007.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T04:14:56.545 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/8d9cb3c3148be641109bf4d3f5961720de1c04000a883a0d13fa8473d3a71a21/merged 2024-09-19T04:14:56.545 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/69d5f3b41c6d42ce8a73eeeb0e6ec7426bfec044ff1655de9489473c146ab6d8/merged 2024-09-19T04:14:56.545 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/4b6f8e36e18f3e11bc6f1d8ec69df7322fb8f70c18af576d064ca19da60115d6/merged 2024-09-19T04:14:56.545 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/7a81566264088ae8ef0f342c0a2b63b39e4b7904d0a3b78a01578d7913dc3667/merged 2024-09-19T04:14:56.545 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/5872f99c7b5cbaa56136286465a9ae1dd8b608d3deff53e8a022fd639fa30358/merged 2024-09-19T04:14:56.545 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/c23b1500f472c6dc4332b5159038ab34fb82db46f6c81fc3dbaf5ade9b9e1029/merged 2024-09-19T04:14:56.545 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/227acbc4a6daabf095fb37a3bcef336749335a1b8c5631cca4f2051dbb0e99b8/merged 2024-09-19T04:14:56.546 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/88f0af576062ef01991c55dd7d5bf4c3bcc2a84c0f4257c99297279b158929da/merged 2024-09-19T04:14:56.546 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns 2024-09-19T04:14:56.546 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T04:14:56.546 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T04:14:56.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:14:56.546 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2024-09-19T04:14:56.597 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T04:14:56.597 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-19T04:14:56.639 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2024-09-19T04:14:56.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:56 smithi102 ceph-mon[35446]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:56.660 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:56 smithi007 ceph-mon[31360]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:56.665 DEBUG:teuthology.orchestra.run.smithi007:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T04:14:56.722 INFO:teuthology.orchestra.run.smithi007.stdout:/proc 2024-09-19T04:14:56.722 INFO:teuthology.orchestra.run.smithi007.stdout:/sys 2024-09-19T04:14:56.722 INFO:teuthology.orchestra.run.smithi007.stdout:/dev 2024-09-19T04:14:56.722 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/security 2024-09-19T04:14:56.722 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/shm 2024-09-19T04:14:56.722 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/pts 2024-09-19T04:14:56.722 INFO:teuthology.orchestra.run.smithi007.stdout:/run 2024-09-19T04:14:56.723 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup 2024-09-19T04:14:56.723 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/pstore 2024-09-19T04:14:56.723 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/bpf 2024-09-19T04:14:56.723 INFO:teuthology.orchestra.run.smithi007.stdout:/ 2024-09-19T04:14:56.723 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/selinux 2024-09-19T04:14:56.723 INFO:teuthology.orchestra.run.smithi007.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T04:14:56.723 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/debug 2024-09-19T04:14:56.723 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/hugepages 2024-09-19T04:14:56.723 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/mqueue 2024-09-19T04:14:56.723 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/tracing 2024-09-19T04:14:56.723 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T04:14:56.724 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/fuse/connections 2024-09-19T04:14:56.724 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T04:14:56.724 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/config 2024-09-19T04:14:56.724 INFO:teuthology.orchestra.run.smithi007.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T04:14:56.724 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T04:14:56.724 INFO:teuthology.orchestra.run.smithi007.stdout:/run/user/1000 2024-09-19T04:14:56.724 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/ceph 2024-09-19T04:14:56.724 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay 2024-09-19T04:14:56.724 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/1f4266b5c0180644153b26053a5cde1d670633da925bd6302fd9754127790034/merged 2024-09-19T04:14:56.724 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/4b8c1fc9dda745ff2afea2d89dae9cf6cff02db6895d575be136b3b3606dfd07/merged 2024-09-19T04:14:56.724 INFO:teuthology.orchestra.run.smithi007.stdout:/run/user/0 2024-09-19T04:14:56.725 INFO:teuthology.orchestra.run.smithi007.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T04:14:56.725 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/8d9cb3c3148be641109bf4d3f5961720de1c04000a883a0d13fa8473d3a71a21/merged 2024-09-19T04:14:56.725 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/69d5f3b41c6d42ce8a73eeeb0e6ec7426bfec044ff1655de9489473c146ab6d8/merged 2024-09-19T04:14:56.725 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/4b6f8e36e18f3e11bc6f1d8ec69df7322fb8f70c18af576d064ca19da60115d6/merged 2024-09-19T04:14:56.725 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/7a81566264088ae8ef0f342c0a2b63b39e4b7904d0a3b78a01578d7913dc3667/merged 2024-09-19T04:14:56.725 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/5872f99c7b5cbaa56136286465a9ae1dd8b608d3deff53e8a022fd639fa30358/merged 2024-09-19T04:14:56.725 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/c23b1500f472c6dc4332b5159038ab34fb82db46f6c81fc3dbaf5ade9b9e1029/merged 2024-09-19T04:14:56.725 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/227acbc4a6daabf095fb37a3bcef336749335a1b8c5631cca4f2051dbb0e99b8/merged 2024-09-19T04:14:56.725 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/containers/storage/overlay/88f0af576062ef01991c55dd7d5bf4c3bcc2a84c0f4257c99297279b158929da/merged 2024-09-19T04:14:56.725 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns 2024-09-19T04:14:56.725 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T04:14:56.725 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T04:14:56.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:14:56.726 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2024-09-19T04:14:56.750 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi007.stderr:2024-09-19T04:14:56.748+0000 7f54b1921480 -1 init, newargv = 0x560b88e97b30 newargc=15 2024-09-19T04:14:56.750 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi007.stderr:ceph-fuse[75015]: starting ceph client 2024-09-19T04:14:56.756 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi007.stderr:ceph-fuse[75015]: starting fuse 2024-09-19T04:14:56.766 INFO:teuthology.orchestra.run.smithi007.stdout:120 2024-09-19T04:14:56.766 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-19T04:14:56.766 DEBUG:teuthology.orchestra.run.smithi007:> sudo stdin-killer -- python3 -c ' 2024-09-19T04:14:56.766 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2024-09-19T04:14:56.766 DEBUG:teuthology.orchestra.run.smithi007:> import re 2024-09-19T04:14:56.766 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-09-19T04:14:56.767 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2024-09-19T04:14:56.767 DEBUG:teuthology.orchestra.run.smithi007:> 2024-09-19T04:14:56.767 DEBUG:teuthology.orchestra.run.smithi007:> def _find_admin_socket(client_name): 2024-09-19T04:14:56.767 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-19T04:14:56.767 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2024-09-19T04:14:56.767 DEBUG:teuthology.orchestra.run.smithi007:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-19T04:14:56.767 DEBUG:teuthology.orchestra.run.smithi007:> 2024-09-19T04:14:56.767 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2024-09-19T04:14:56.767 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2024-09-19T04:14:56.767 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2024-09-19T04:14:56.767 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2024-09-19T04:14:56.767 DEBUG:teuthology.orchestra.run.smithi007:> 2024-09-19T04:14:56.768 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2024-09-19T04:14:56.768 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T04:14:56.768 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T04:14:56.768 DEBUG:teuthology.orchestra.run.smithi007:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T04:14:56.768 DEBUG:teuthology.orchestra.run.smithi007:> contents = proc_f.read() 2024-09-19T04:14:56.768 DEBUG:teuthology.orchestra.run.smithi007:> if mountpoint in contents: 2024-09-19T04:14:56.768 DEBUG:teuthology.orchestra.run.smithi007:> return f 2024-09-19T04:14:56.768 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T04:14:56.768 DEBUG:teuthology.orchestra.run.smithi007:> 2024-09-19T04:14:56.768 DEBUG:teuthology.orchestra.run.smithi007:> print(_find_admin_socket("client.admin")) 2024-09-19T04:14:56.768 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-09-19T04:14:56.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:56 smithi092 ceph-mon[34940]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:56.887 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.admin.75015.asok 2024-09-19T04:14:56.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T04:14:56.897 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.75015.asok 2024-09-19T04:14:56.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:14:56.898 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.75015.asok status 2024-09-19T04:14:57.035 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:14:57.035 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2024-09-19T04:14:57.035 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T04:14:57.035 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T04:14:57.035 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "admin", 2024-09-19T04:14:57.035 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2024-09-19T04:14:57.035 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-19T04:14:57.035 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "75015", 2024-09-19T04:14:57.035 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2024-09-19T04:14:57.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:14:57.035 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2024-09-19T04:14:57.036 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2024-09-19T04:14:57.036 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 14718, 2024-09-19T04:14:57.036 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2024-09-19T04:14:57.036 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2024-09-19T04:14:57.036 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2024-09-19T04:14:57.036 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 14718 2024-09-19T04:14:57.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:14:57.036 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2024-09-19T04:14:57.036 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2024-09-19T04:14:57.036 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.1:0", 2024-09-19T04:14:57.036 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 194285973 2024-09-19T04:14:57.036 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:14:57.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:14:57.037 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2024-09-19T04:14:57.037 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2024-09-19T04:14:57.037 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.1:0", 2024-09-19T04:14:57.037 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 194285973 2024-09-19T04:14:57.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:14:57.037 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.14718 192.168.0.1:0/194285973", 2024-09-19T04:14:57.037 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "192.168.0.1:0/194285973", 2024-09-19T04:14:57.037 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2024-09-19T04:14:57.037 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 17, 2024-09-19T04:14:57.037 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 86, 2024-09-19T04:14:57.037 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2024-09-19T04:14:57.037 INFO:teuthology.orchestra.run.smithi007.stdout: "blocklisted": false, 2024-09-19T04:14:57.038 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2024-09-19T04:14:57.038 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:14:57.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:14:57.043 DEBUG:teuthology.orchestra.run.smithi007:> stat --file-system '--printf=%T 2024-09-19T04:14:57.043 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-19T04:14:57.059 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2024-09-19T04:14:57.059 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-19T04:14:57.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:14:57.060 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-19T04:14:57.127 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-19T04:14:57.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T04:14:57.236 INFO:teuthology.orchestra.run.smithi007.stdout:# file: . 2024-09-19T04:14:57.236 INFO:teuthology.orchestra.run.smithi007.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-19T04:14:57.236 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:14:57.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T04:14:57.242 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T04:14:57.242 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T04:14:57.260 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T04:14:57.561 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:14:58.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.015+0000 7fc3e83e5640 1 -- 172.21.15.7:0/3388515755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3e0101de0 msgr2=0x7fc3e01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:58.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.015+0000 7fc3e83e5640 1 --2- 172.21.15.7:0/3388515755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3e0101de0 0x7fc3e01021c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc009900 tx=0x7fc3dc02a410 comp rx=0 tx=0).stop 2024-09-19T04:14:58.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.015+0000 7fc3e83e5640 1 -- 172.21.15.7:0/3388515755 shutdown_connections 2024-09-19T04:14:58.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.015+0000 7fc3e83e5640 1 --2- 172.21.15.7:0/3388515755 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3e0106f10 0x7fc3e010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:58.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.015+0000 7fc3e83e5640 1 --2- 172.21.15.7:0/3388515755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3e0102790 0x7fc3e01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:58.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.015+0000 7fc3e83e5640 1 --2- 172.21.15.7:0/3388515755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3e0101de0 0x7fc3e01021c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:58.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.015+0000 7fc3e83e5640 1 -- 172.21.15.7:0/3388515755 >> 172.21.15.7:0/3388515755 conn(0x7fc3e00fd8c0 msgr2=0x7fc3e00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:58.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.015+0000 7fc3e83e5640 1 -- 172.21.15.7:0/3388515755 shutdown_connections 2024-09-19T04:14:58.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.015+0000 7fc3e83e5640 1 -- 172.21.15.7:0/3388515755 wait complete. 2024-09-19T04:14:58.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.016+0000 7fc3e83e5640 1 Processor -- start 2024-09-19T04:14:58.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.016+0000 7fc3e83e5640 1 -- start start 2024-09-19T04:14:58.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.016+0000 7fc3e83e5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3e0101de0 0x7fc3e0198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:58.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.016+0000 7fc3e83e5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3e0102790 0x7fc3e0198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:58.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.016+0000 7fc3e83e5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3e0106f10 0x7fc3e019ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:58.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.016+0000 7fc3e83e5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e0111f70 con 0x7fc3e0101de0 2024-09-19T04:14:58.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.016+0000 7fc3e83e5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e0111df0 con 0x7fc3e0102790 2024-09-19T04:14:58.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.016+0000 7fc3e83e5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e01120f0 con 0x7fc3e0106f10 2024-09-19T04:14:58.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.017+0000 7fc3e6181640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3e0101de0 0x7fc3e0198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:58.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.017+0000 7fc3e6181640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3e0101de0 0x7fc3e0198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58232/0 (socket says 172.21.15.7:58232) 2024-09-19T04:14:58.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.017+0000 7fc3e6181640 1 -- 172.21.15.7:0/3173982636 learned_addr learned my addr 172.21.15.7:0/3173982636 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:14:58.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.017+0000 7fc3e6982640 1 --2- 172.21.15.7:0/3173982636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3e0106f10 0x7fc3e019ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:58.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.017+0000 7fc3e5980640 1 --2- 172.21.15.7:0/3173982636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3e0102790 0x7fc3e0198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:58.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.017+0000 7fc3e6181640 1 -- 172.21.15.7:0/3173982636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3e0106f10 msgr2=0x7fc3e019ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:58.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.017+0000 7fc3e6181640 1 --2- 172.21.15.7:0/3173982636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3e0106f10 0x7fc3e019ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:58.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.017+0000 7fc3e6181640 1 -- 172.21.15.7:0/3173982636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3e0102790 msgr2=0x7fc3e0198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:58.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.017+0000 7fc3e6181640 1 --2- 172.21.15.7:0/3173982636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3e0102790 0x7fc3e0198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:58.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.017+0000 7fc3e6181640 1 -- 172.21.15.7:0/3173982636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e019d3d0 con 0x7fc3e0101de0 2024-09-19T04:14:58.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.017+0000 7fc3e6181640 1 --2- 172.21.15.7:0/3173982636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3e0101de0 0x7fc3e0198420 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc006010 tx=0x7fc3dc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:58.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.017+0000 7fc3d77fe640 1 -- 172.21.15.7:0/3173982636 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc03f030 con 0x7fc3e0101de0 2024-09-19T04:14:58.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.017+0000 7fc3d77fe640 1 -- 172.21.15.7:0/3173982636 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3dc003ce0 con 0x7fc3e0101de0 2024-09-19T04:14:58.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.017+0000 7fc3e83e5640 1 -- 172.21.15.7:0/3173982636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3e019d660 con 0x7fc3e0101de0 2024-09-19T04:14:58.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.017+0000 7fc3d77fe640 1 -- 172.21.15.7:0/3173982636 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc035070 con 0x7fc3e0101de0 2024-09-19T04:14:58.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.017+0000 7fc3e83e5640 1 -- 172.21.15.7:0/3173982636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3e01a4fa0 con 0x7fc3e0101de0 2024-09-19T04:14:58.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.018+0000 7fc3e83e5640 1 -- 172.21.15.7:0/3173982636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3e01032c0 con 0x7fc3e0101de0 2024-09-19T04:14:58.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.019+0000 7fc3d77fe640 1 -- 172.21.15.7:0/3173982636 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fc3dc042030 con 0x7fc3e0101de0 2024-09-19T04:14:58.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.020+0000 7fc3d77fe640 1 --2- 172.21.15.7:0/3173982636 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc3cc0a3240 0x7fc3cc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:58.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.020+0000 7fc3e5980640 1 --2- 172.21.15.7:0/3173982636 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc3cc0a3240 0x7fc3cc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:58.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.020+0000 7fc3d77fe640 1 -- 172.21.15.7:0/3173982636 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fc3dc0efc80 con 0x7fc3e0101de0 2024-09-19T04:14:58.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.021+0000 7fc3e5980640 1 --2- 172.21.15.7:0/3173982636 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc3cc0a3240 0x7fc3cc0a5700 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc3e00fdce0 tx=0x7fc3d000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:58.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.024+0000 7fc3d77fe640 1 -- 172.21.15.7:0/3173982636 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc3dc0bc1d0 con 0x7fc3e0101de0 2024-09-19T04:14:58.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.211+0000 7fc3e83e5640 1 -- 172.21.15.7:0/3173982636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc3e010a0f0 con 0x7fc3e0101de0 2024-09-19T04:14:58.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.212+0000 7fc3d77fe640 1 -- 172.21.15.7:0/3173982636 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v86) ==== 81+0+578 (secure 0 0 0) 0x7fc3dc0c04d0 con 0x7fc3e0101de0 2024-09-19T04:14:58.213 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/2883028938 2024-09-20T04:07:45.039922+0000 2024-09-19T04:14:58.213 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/1186412739 2024-09-20T04:07:45.039922+0000 2024-09-19T04:14:58.214 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6800/751091002 2024-09-20T04:07:45.039922+0000 2024-09-19T04:14:58.214 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6801/751091002 2024-09-20T04:07:45.039922+0000 2024-09-19T04:14:58.214 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6801/940106179 2024-09-20T04:07:20.364033+0000 2024-09-19T04:14:58.214 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6800/940106179 2024-09-20T04:07:20.364033+0000 2024-09-19T04:14:58.214 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/1450115700 2024-09-20T04:07:20.364033+0000 2024-09-19T04:14:58.214 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/2954294373 2024-09-20T04:07:20.364033+0000 2024-09-19T04:14:58.214 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/1996930242 2024-09-20T04:07:45.039922+0000 2024-09-19T04:14:58.214 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/3562231347 2024-09-20T04:07:20.364033+0000 2024-09-19T04:14:58.214 INFO:teuthology.orchestra.run.smithi007.stderr:listed 10 entries 2024-09-19T04:14:58.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.214+0000 7fc3e83e5640 1 -- 172.21.15.7:0/3173982636 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc3cc0a3240 msgr2=0x7fc3cc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:58.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.214+0000 7fc3e83e5640 1 --2- 172.21.15.7:0/3173982636 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc3cc0a3240 0x7fc3cc0a5700 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc3e00fdce0 tx=0x7fc3d000b390 comp rx=0 tx=0).stop 2024-09-19T04:14:58.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.214+0000 7fc3e83e5640 1 -- 172.21.15.7:0/3173982636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3e0101de0 msgr2=0x7fc3e0198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:58.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.214+0000 7fc3e83e5640 1 --2- 172.21.15.7:0/3173982636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3e0101de0 0x7fc3e0198420 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc006010 tx=0x7fc3dc0042f0 comp rx=0 tx=0).stop 2024-09-19T04:14:58.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.214+0000 7fc3e83e5640 1 -- 172.21.15.7:0/3173982636 shutdown_connections 2024-09-19T04:14:58.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.214+0000 7fc3e83e5640 1 --2- 172.21.15.7:0/3173982636 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc3cc0a3240 0x7fc3cc0a5700 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:58.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.214+0000 7fc3e83e5640 1 --2- 172.21.15.7:0/3173982636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3e0106f10 0x7fc3e019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:58.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.214+0000 7fc3e83e5640 1 --2- 172.21.15.7:0/3173982636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3e0102790 0x7fc3e0198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:58.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.214+0000 7fc3e83e5640 1 --2- 172.21.15.7:0/3173982636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3e0101de0 0x7fc3e0198420 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:58.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.214+0000 7fc3e83e5640 1 -- 172.21.15.7:0/3173982636 >> 172.21.15.7:0/3173982636 conn(0x7fc3e00fd8c0 msgr2=0x7fc3e00fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:58.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.215+0000 7fc3e83e5640 1 -- 172.21.15.7:0/3173982636 shutdown_connections 2024-09-19T04:14:58.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:58.215+0000 7fc3e83e5640 1 -- 172.21.15.7:0/3173982636 wait complete. 2024-09-19T04:14:58.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:58 smithi007 ceph-mon[31360]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:58.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:14:58 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3173982636' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T04:14:58.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:58 smithi102 ceph-mon[35446]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:58.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:14:58 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3173982636' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T04:14:58.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:58 smithi092 ceph-mon[34940]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:14:58.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:14:58 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3173982636' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T04:14:58.963 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T04:14:58.963 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T04:14:58.982 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T04:14:59.279 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:14:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.763+0000 7f0881055640 1 -- 172.21.15.7:0/4248820787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f087c101df0 msgr2=0x7f087c1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.763+0000 7f0881055640 1 --2- 172.21.15.7:0/4248820787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f087c101df0 0x7f087c1021d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f086c009900 tx=0x7f086c02a410 comp rx=0 tx=0).stop 2024-09-19T04:14:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.763+0000 7f0881055640 1 -- 172.21.15.7:0/4248820787 shutdown_connections 2024-09-19T04:14:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.763+0000 7f0881055640 1 --2- 172.21.15.7:0/4248820787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f087c106f20 0x7f087c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.763+0000 7f0881055640 1 --2- 172.21.15.7:0/4248820787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f087c1027a0 0x7f087c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.763+0000 7f0881055640 1 --2- 172.21.15.7:0/4248820787 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f087c101df0 0x7f087c1021d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.763+0000 7f0881055640 1 -- 172.21.15.7:0/4248820787 >> 172.21.15.7:0/4248820787 conn(0x7f087c0fd8f0 msgr2=0x7f087c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.763+0000 7f0881055640 1 -- 172.21.15.7:0/4248820787 shutdown_connections 2024-09-19T04:14:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.763+0000 7f0881055640 1 -- 172.21.15.7:0/4248820787 wait complete. 2024-09-19T04:14:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.763+0000 7f0881055640 1 Processor -- start 2024-09-19T04:14:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.764+0000 7f0881055640 1 -- start start 2024-09-19T04:14:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.764+0000 7f0881055640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f087c101df0 0x7f087c1983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.764+0000 7f0881055640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f087c1027a0 0x7f087c1988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.764+0000 7f0881055640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f087c106f20 0x7f087c19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.764+0000 7f0881055640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f087c111f40 con 0x7f087c106f20 2024-09-19T04:14:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.764+0000 7f0881055640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f087c111dc0 con 0x7f087c1027a0 2024-09-19T04:14:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.764+0000 7f0881055640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f087c1120c0 con 0x7f087c101df0 2024-09-19T04:14:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.764+0000 7f087b59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f087c106f20 0x7f087c19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.764+0000 7f087b59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f087c106f20 0x7f087c19cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58238/0 (socket says 172.21.15.7:58238) 2024-09-19T04:14:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.764+0000 7f087a59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f087c1027a0 0x7f087c1988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.764+0000 7f087ad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f087c101df0 0x7f087c1983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.764+0000 7f087b59e640 1 -- 172.21.15.7:0/3099406635 learned_addr learned my addr 172.21.15.7:0/3099406635 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:14:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.764+0000 7f087b59e640 1 -- 172.21.15.7:0/3099406635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f087c101df0 msgr2=0x7f087c1983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.764+0000 7f087b59e640 1 --2- 172.21.15.7:0/3099406635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f087c101df0 0x7f087c1983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.764+0000 7f087b59e640 1 -- 172.21.15.7:0/3099406635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f087c1027a0 msgr2=0x7f087c1988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.764+0000 7f087b59e640 1 --2- 172.21.15.7:0/3099406635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f087c1027a0 0x7f087c1988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.764+0000 7f087b59e640 1 -- 172.21.15.7:0/3099406635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f087c19d350 con 0x7f087c106f20 2024-09-19T04:14:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.764+0000 7f087a59c640 1 --2- 172.21.15.7:0/3099406635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f087c1027a0 0x7f087c1988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:14:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.765+0000 7f087b59e640 1 --2- 172.21.15.7:0/3099406635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f087c106f20 0x7f087c19cc70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f087400eb10 tx=0x7f087400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.765+0000 7f0863fff640 1 -- 172.21.15.7:0/3099406635 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087400ce20 con 0x7f087c106f20 2024-09-19T04:14:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.765+0000 7f0881055640 1 -- 172.21.15.7:0/3099406635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f087c19d640 con 0x7f087c106f20 2024-09-19T04:14:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.765+0000 7f0863fff640 1 -- 172.21.15.7:0/3099406635 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0874005020 con 0x7f087c106f20 2024-09-19T04:14:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.765+0000 7f0863fff640 1 -- 172.21.15.7:0/3099406635 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0874010690 con 0x7f087c106f20 2024-09-19T04:14:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.765+0000 7f0881055640 1 -- 172.21.15.7:0/3099406635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f087c1a4f20 con 0x7f087c106f20 2024-09-19T04:14:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.766+0000 7f0881055640 1 -- 172.21.15.7:0/3099406635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f087c1021d0 con 0x7f087c106f20 2024-09-19T04:14:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.768+0000 7f0863fff640 1 -- 172.21.15.7:0/3099406635 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f0874005540 con 0x7f087c106f20 2024-09-19T04:14:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.769+0000 7f0863fff640 1 --2- 172.21.15.7:0/3099406635 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f08640a3240 0x7f08640a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:14:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.769+0000 7f087ad9d640 1 --2- 172.21.15.7:0/3099406635 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f08640a3240 0x7f08640a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:14:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.769+0000 7f0863fff640 1 -- 172.21.15.7:0/3099406635 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f08740d0280 con 0x7f087c106f20 2024-09-19T04:14:59.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.769+0000 7f087ad9d640 1 --2- 172.21.15.7:0/3099406635 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f08640a3240 0x7f08640a5700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f086c009230 tx=0x7f086c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:14:59.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.772+0000 7f0863fff640 1 -- 172.21.15.7:0/3099406635 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0874054210 con 0x7f087c106f20 2024-09-19T04:14:59.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.960+0000 7f0881055640 1 -- 172.21.15.7:0/3099406635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f087c02d7c0 con 0x7f087c106f20 2024-09-19T04:14:59.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.961+0000 7f0863fff640 1 -- 172.21.15.7:0/3099406635 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v86) ==== 81+0+578 (secure 0 0 0) 0x7f087409cd00 con 0x7f087c106f20 2024-09-19T04:14:59.963 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/2883028938 2024-09-20T04:07:45.039922+0000 2024-09-19T04:14:59.963 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/1186412739 2024-09-20T04:07:45.039922+0000 2024-09-19T04:14:59.963 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6800/751091002 2024-09-20T04:07:45.039922+0000 2024-09-19T04:14:59.963 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6801/751091002 2024-09-20T04:07:45.039922+0000 2024-09-19T04:14:59.963 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6801/940106179 2024-09-20T04:07:20.364033+0000 2024-09-19T04:14:59.963 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6800/940106179 2024-09-20T04:07:20.364033+0000 2024-09-19T04:14:59.963 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/1450115700 2024-09-20T04:07:20.364033+0000 2024-09-19T04:14:59.963 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/2954294373 2024-09-20T04:07:20.364033+0000 2024-09-19T04:14:59.963 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/1996930242 2024-09-20T04:07:45.039922+0000 2024-09-19T04:14:59.964 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/3562231347 2024-09-20T04:07:20.364033+0000 2024-09-19T04:14:59.964 INFO:teuthology.orchestra.run.smithi007.stderr:listed 10 entries 2024-09-19T04:14:59.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.963+0000 7f0881055640 1 -- 172.21.15.7:0/3099406635 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f08640a3240 msgr2=0x7f08640a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:59.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.963+0000 7f0881055640 1 --2- 172.21.15.7:0/3099406635 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f08640a3240 0x7f08640a5700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f086c009230 tx=0x7f086c0058d0 comp rx=0 tx=0).stop 2024-09-19T04:14:59.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.963+0000 7f0881055640 1 -- 172.21.15.7:0/3099406635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f087c106f20 msgr2=0x7f087c19cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:14:59.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.963+0000 7f0881055640 1 --2- 172.21.15.7:0/3099406635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f087c106f20 0x7f087c19cc70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f087400eb10 tx=0x7f087400ef10 comp rx=0 tx=0).stop 2024-09-19T04:14:59.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.963+0000 7f0881055640 1 -- 172.21.15.7:0/3099406635 shutdown_connections 2024-09-19T04:14:59.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.963+0000 7f0881055640 1 --2- 172.21.15.7:0/3099406635 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f08640a3240 0x7f08640a5700 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:59.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.963+0000 7f0881055640 1 --2- 172.21.15.7:0/3099406635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f087c106f20 0x7f087c19cc70 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:59.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.963+0000 7f0881055640 1 --2- 172.21.15.7:0/3099406635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f087c1027a0 0x7f087c1988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:59.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.963+0000 7f0881055640 1 --2- 172.21.15.7:0/3099406635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f087c101df0 0x7f087c1983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:14:59.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.963+0000 7f0881055640 1 -- 172.21.15.7:0/3099406635 >> 172.21.15.7:0/3099406635 conn(0x7f087c0fd8f0 msgr2=0x7f087c0fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:14:59.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.964+0000 7f0881055640 1 -- 172.21.15.7:0/3099406635 shutdown_connections 2024-09-19T04:14:59.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:14:59.964+0000 7f0881055640 1 -- 172.21.15.7:0/3099406635 wait complete. 2024-09-19T04:15:00.577 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2024-09-19T04:15:00.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:15:00.577 DEBUG:teuthology.orchestra.run.smithi007:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-19T04:15:00.603 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi007.stderr:ceph-fuse[75015]: fuse finished with error 0 and tester_r 0 2024-09-19T04:15:00.605 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T04:15:00.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:00 smithi007 ceph-mon[31360]: pgmap v293: 129 pgs: 129 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-19T04:15:00.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:00 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3099406635' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T04:15:01.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:00 smithi092 ceph-mon[34940]: pgmap v293: 129 pgs: 129 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-19T04:15:01.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:00 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3099406635' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T04:15:01.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:00 smithi102 ceph-mon[35446]: pgmap v293: 129 pgs: 129 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-19T04:15:01.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:00 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3099406635' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T04:15:03.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:02 smithi092 ceph-mon[34940]: pgmap v294: 129 pgs: 129 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-19T04:15:03.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:02 smithi007 ceph-mon[31360]: pgmap v294: 129 pgs: 129 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-19T04:15:03.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:02 smithi102 ceph-mon[35446]: pgmap v294: 129 pgs: 129 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-19T04:15:05.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:04 smithi007 ceph-mon[31360]: pgmap v295: 129 pgs: 129 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T04:15:05.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:04 smithi102 ceph-mon[35446]: pgmap v295: 129 pgs: 129 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T04:15:05.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:04 smithi092 ceph-mon[34940]: pgmap v295: 129 pgs: 129 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T04:15:06.706 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-09-19T04:15:06.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:15:06.707 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-19T04:15:06.732 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:15:07.044 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:07.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:06 smithi007 ceph-mon[31360]: pgmap v296: 129 pgs: 129 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T04:15:07.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:06 smithi102 ceph-mon[35446]: pgmap v296: 129 pgs: 129 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T04:15:07.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:06 smithi092 ceph-mon[34940]: pgmap v296: 129 pgs: 129 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T04:15:07.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.529+0000 7fc471eec640 1 -- 172.21.15.7:0/1242215289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc46c102570 msgr2=0x7fc46c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:07.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.529+0000 7fc471eec640 1 --2- 172.21.15.7:0/1242215289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc46c102570 0x7fc46c1029b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc454009900 tx=0x7fc45402a480 comp rx=0 tx=0).stop 2024-09-19T04:15:07.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.529+0000 7fc471eec640 1 -- 172.21.15.7:0/1242215289 shutdown_connections 2024-09-19T04:15:07.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.529+0000 7fc471eec640 1 --2- 172.21.15.7:0/1242215289 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc46c102ef0 0x7fc46c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:07.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.529+0000 7fc471eec640 1 --2- 172.21.15.7:0/1242215289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc46c102570 0x7fc46c1029b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:07.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.529+0000 7fc471eec640 1 --2- 172.21.15.7:0/1242215289 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc46c100e20 0x7fc46c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.529+0000 7fc471eec640 1 -- 172.21.15.7:0/1242215289 >> 172.21.15.7:0/1242215289 conn(0x7fc46c0fc7d0 msgr2=0x7fc46c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.529+0000 7fc471eec640 1 -- 172.21.15.7:0/1242215289 shutdown_connections 2024-09-19T04:15:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.529+0000 7fc471eec640 1 -- 172.21.15.7:0/1242215289 wait complete. 2024-09-19T04:15:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.530+0000 7fc471eec640 1 Processor -- start 2024-09-19T04:15:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.530+0000 7fc471eec640 1 -- start start 2024-09-19T04:15:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.530+0000 7fc471eec640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc46c100e20 0x7fc46c1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.530+0000 7fc471eec640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc46c102570 0x7fc46c198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.530+0000 7fc471eec640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc46c102ef0 0x7fc46c19cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.530+0000 7fc471eec640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc46c1120a0 con 0x7fc46c102ef0 2024-09-19T04:15:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.530+0000 7fc471eec640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc46c111f20 con 0x7fc46c102570 2024-09-19T04:15:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.530+0000 7fc471eec640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc46c112220 con 0x7fc46c100e20 2024-09-19T04:15:07.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.530+0000 7fc46bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc46c102ef0 0x7fc46c19cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:07.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.530+0000 7fc46bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc46c102ef0 0x7fc46c19cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42936/0 (socket says 172.21.15.7:42936) 2024-09-19T04:15:07.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.530+0000 7fc46bfff640 1 -- 172.21.15.7:0/2939438618 learned_addr learned my addr 172.21.15.7:0/2939438618 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:07.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.530+0000 7fc46b7fe640 1 --2- 172.21.15.7:0/2939438618 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc46c100e20 0x7fc46c1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:07.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.530+0000 7fc46affd640 1 --2- 172.21.15.7:0/2939438618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc46c102570 0x7fc46c198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:07.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.530+0000 7fc46bfff640 1 -- 172.21.15.7:0/2939438618 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc46c100e20 msgr2=0x7fc46c1984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:07.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.530+0000 7fc46bfff640 1 --2- 172.21.15.7:0/2939438618 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc46c100e20 0x7fc46c1984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:07.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.530+0000 7fc46bfff640 1 -- 172.21.15.7:0/2939438618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc46c102570 msgr2=0x7fc46c198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:07.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.530+0000 7fc46bfff640 1 --2- 172.21.15.7:0/2939438618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc46c102570 0x7fc46c198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:07.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.530+0000 7fc46bfff640 1 -- 172.21.15.7:0/2939438618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc46c19d4a0 con 0x7fc46c102ef0 2024-09-19T04:15:07.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.531+0000 7fc46bfff640 1 --2- 172.21.15.7:0/2939438618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc46c102ef0 0x7fc46c19cdc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc45c00d950 tx=0x7fc45c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:07.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.531+0000 7fc468ff9640 1 -- 172.21.15.7:0/2939438618 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45c017030 con 0x7fc46c102ef0 2024-09-19T04:15:07.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.531+0000 7fc468ff9640 1 -- 172.21.15.7:0/2939438618 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc45c004020 con 0x7fc46c102ef0 2024-09-19T04:15:07.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.531+0000 7fc471eec640 1 -- 172.21.15.7:0/2939438618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc46c19d790 con 0x7fc46c102ef0 2024-09-19T04:15:07.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.531+0000 7fc468ff9640 1 -- 172.21.15.7:0/2939438618 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45c003c00 con 0x7fc46c102ef0 2024-09-19T04:15:07.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.531+0000 7fc471eec640 1 -- 172.21.15.7:0/2939438618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc46c1a5070 con 0x7fc46c102ef0 2024-09-19T04:15:07.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.532+0000 7fc471eec640 1 -- 172.21.15.7:0/2939438618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc46c101200 con 0x7fc46c102ef0 2024-09-19T04:15:07.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.533+0000 7fc468ff9640 1 -- 172.21.15.7:0/2939438618 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fc45c01a070 con 0x7fc46c102ef0 2024-09-19T04:15:07.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.534+0000 7fc468ff9640 1 --2- 172.21.15.7:0/2939438618 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc4580a3240 0x7fc4580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:07.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.534+0000 7fc46b7fe640 1 --2- 172.21.15.7:0/2939438618 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc4580a3240 0x7fc4580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:07.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.534+0000 7fc468ff9640 1 -- 172.21.15.7:0/2939438618 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fc45c0cf7a0 con 0x7fc46c102ef0 2024-09-19T04:15:07.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.534+0000 7fc46b7fe640 1 --2- 172.21.15.7:0/2939438618 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc4580a3240 0x7fc4580a5700 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc464005fd0 tx=0x7fc464009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:07.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.538+0000 7fc468ff9640 1 -- 172.21.15.7:0/2939438618 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc45c09c220 con 0x7fc46c102ef0 2024-09-19T04:15:07.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.714+0000 7fc471eec640 1 -- 172.21.15.7:0/2939438618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc46c108b00 con 0x7fc46c102ef0 2024-09-19T04:15:07.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.715+0000 7fc468ff9640 1 -- 172.21.15.7:0/2939438618 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24128 (secure 0 0 0) 0x7fc45c09bb20 con 0x7fc46c102ef0 2024-09-19T04:15:07.717 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:15:07.717 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":86,"fsid":"77957c0a-763c-11ef-bceb-c7b262605968","created":"2024-09-19T04:06:58.337394+0000","modified":"2024-09-19T04:14:43.113323+0000","last_up_change":"2024-09-19T04:13:42.312137+0000","last_in_change":"2024-09-19T04:13:18.757925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:09:59.544984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:14:30.225637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:14:32.252497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T04:14:38.781821+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d9b93bd5-ee22-4fb0-ba29-bfa208430a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6803","nonce":240599233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6805","nonce":240599233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6809","nonce":240599233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6807","nonce":240599233}]},"public_addr":"172.21.15.7:6803/240599233","cluster_addr":"172.21.15.7:6805/240599233","heartbeat_back_addr":"172.21.15.7:6809/240599233","heartbeat_front_addr":"172.21.15.7:6807/240599233","state":["exists","up"]},{"osd":1,"uuid":"db5793e6-f3ad-4075-a02b-206bf7f1e59a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6801","nonce":902403333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6803","nonce":902403333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6807","nonce":902403333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6805","nonce":902403333}]},"public_addr":"172.21.15.92:6801/902403333","cluster_addr":"172.21.15.92:6803/902403333","heartbeat_back_addr":"172.21.15.92:6807/902403333","heartbeat_front_addr":"172.21.15.92:6805/902403333","state":["exists","up"]},{"osd":2,"uuid":"1eb83a1b-82d8-4983-bae3-b161adb3a33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6801","nonce":2078441772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6803","nonce":2078441772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6807","nonce":2078441772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6805","nonce":2078441772}]},"public_addr":"172.21.15.102:6801/2078441772","cluster_addr":"172.21.15.102:6803/2078441772","heartbeat_back_addr":"172.21.15.102:6807/2078441772","heartbeat_front_addr":"172.21.15.102:6805/2078441772","state":["exists","up"]},{"osd":3,"uuid":"68ba79e5-bcf0-4349-9e14-42f2fa9c11b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6811","nonce":2729561132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6813","nonce":2729561132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6817","nonce":2729561132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6815","nonce":2729561132}]},"public_addr":"172.21.15.7:6811/2729561132","cluster_addr":"172.21.15.7:6813/2729561132","heartbeat_back_addr":"172.21.15.7:6817/2729561132","heartbeat_front_addr":"172.21.15.7:6815/2729561132","state":["exists","up"]},{"osd":4,"uuid":"f20d4a51-121f-4ac8-afeb-5962d83bd697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6809","nonce":2799734294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6811","nonce":2799734294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6815","nonce":2799734294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6813","nonce":2799734294}]},"public_addr":"172.21.15.92:6809/2799734294","cluster_addr":"172.21.15.92:6811/2799734294","heartbeat_back_addr":"172.21.15.92:6815/2799734294","heartbeat_front_addr":"172.21.15.92:6813/2799734294","state":["exists","up"]},{"osd":5,"uuid":"aac02b0a-99dc-4457-8898-c68dc196517a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6809","nonce":3099678146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6811","nonce":3099678146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6815","nonce":3099678146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6813","nonce":3099678146}]},"public_addr":"172.21.15.102:6809/3099678146","cluster_addr":"172.21.15.102:6811/3099678146","heartbeat_back_addr":"172.21.15.102:6815/3099678146","heartbeat_front_addr":"172.21.15.102:6813/3099678146","state":["exists","up"]},{"osd":6,"uuid":"7e5a8b30-8406-486c-ace5-79158a3757a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6819","nonce":1569704304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6821","nonce":1569704304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6825","nonce":1569704304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6823","nonce":1569704304}]},"public_addr":"172.21.15.7:6819/1569704304","cluster_addr":"172.21.15.7:6821/1569704304","heartbeat_back_addr":"172.21.15.7:6825/1569704304","heartbeat_front_addr":"172.21.15.7:6823/1569704304","state":["exists","up"]},{"osd":7,"uuid":"e6a7049a-17a1-43b2-8ecd-5f4ca7c337be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6817","nonce":3411102480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6819","nonce":3411102480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6823","nonce":3411102480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6821","nonce":3411102480}]},"public_addr":"172.21.15.92:6817/3411102480","cluster_addr":"172.21.15.92:6819/3411102480","heartbeat_back_addr":"172.21.15.92:6823/3411102480","heartbeat_front_addr":"172.21.15.92:6821/3411102480","state":["exists","up"]},{"osd":8,"uuid":"31879baa-861d-4322-990f-0b9a42b8b610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6817","nonce":2990859925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6819","nonce":2990859925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6823","nonce":2990859925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6821","nonce":2990859925}]},"public_addr":"172.21.15.102:6817/2990859925","cluster_addr":"172.21.15.102:6819/2990859925","heartbeat_back_addr":"172.21.15.102:6823/2990859925","heartbeat_front_addr":"172.21.15.102:6821/2990859925","state":["exists","up"]},{"osd":9,"uuid":"6d65db33-926c-4a6e-a072-707e9c9de92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6827","nonce":1710319475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6829","nonce":1710319475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6833","nonce":1710319475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6831","nonce":1710319475}]},"public_addr":"172.21.15.7:6827/1710319475","cluster_addr":"172.21.15.7:6829/1710319475","heartbeat_back_addr":"172.21.15.7:6833/1710319475","heartbeat_front_addr":"172.21.15.7:6831/1710319475","state":["exists","up"]},{"osd":10,"uuid":"9ab681ee-0bef-47bd-bf3d-20b17c6b870c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6825","nonce":1063265541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6827","nonce":1063265541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6831","nonce":1063265541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6829","nonce":1063265541}]},"public_addr":"172.21.15.92:6825/1063265541","cluster_addr":"172.21.15.92:6827/1063265541","heartbeat_back_addr":"172.21.15.92:6831/1063265541","heartbeat_front_addr":"172.21.15.92:6829/1063265541","state":["exists","up"]},{"osd":11,"uuid":"dc398e14-5f9e-4f0a-b158-35cbc1f73a83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6825","nonce":1175425599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6827","nonce":1175425599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6831","nonce":1175425599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6829","nonce":1175425599}]},"public_addr":"172.21.15.102:6825/1175425599","cluster_addr":"172.21.15.102:6827/1175425599","heartbeat_back_addr":"172.21.15.102:6831/1175425599","heartbeat_front_addr":"172.21.15.102:6829/1175425599","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:07.857319+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:31.430120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:56.892301+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:10:22.011884+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:10:46.326025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:11:10.339084+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:11:35.365906+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:01.104309+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:25.717295+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:51.387644+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:13:15.076355+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:13:40.253150+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/2883028938":"2024-09-20T04:07:45.039922+0000","172.21.15.7:0/1186412739":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6800/751091002":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6801/751091002":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6801/940106179":"2024-09-20T04:07:20.364033+0000","172.21.15.7:6800/940106179":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/1450115700":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/2954294373":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/1996930242":"2024-09-20T04:07:45.039922+0000","172.21.15.7:0/3562231347":"2024-09-20T04:07:20.364033+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:15:07.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.717+0000 7fc471eec640 1 -- 172.21.15.7:0/2939438618 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc4580a3240 msgr2=0x7fc4580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:07.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.717+0000 7fc471eec640 1 --2- 172.21.15.7:0/2939438618 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc4580a3240 0x7fc4580a5700 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc464005fd0 tx=0x7fc464009680 comp rx=0 tx=0).stop 2024-09-19T04:15:07.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.717+0000 7fc471eec640 1 -- 172.21.15.7:0/2939438618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc46c102ef0 msgr2=0x7fc46c19cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:07.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.717+0000 7fc471eec640 1 --2- 172.21.15.7:0/2939438618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc46c102ef0 0x7fc46c19cdc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc45c00d950 tx=0x7fc45c00de10 comp rx=0 tx=0).stop 2024-09-19T04:15:07.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.718+0000 7fc471eec640 1 -- 172.21.15.7:0/2939438618 shutdown_connections 2024-09-19T04:15:07.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.718+0000 7fc471eec640 1 --2- 172.21.15.7:0/2939438618 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc4580a3240 0x7fc4580a5700 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:07.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.718+0000 7fc471eec640 1 --2- 172.21.15.7:0/2939438618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc46c102ef0 0x7fc46c19cdc0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:07.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.718+0000 7fc471eec640 1 --2- 172.21.15.7:0/2939438618 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc46c102570 0x7fc46c198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:07.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.718+0000 7fc471eec640 1 --2- 172.21.15.7:0/2939438618 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc46c100e20 0x7fc46c1984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:07.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.718+0000 7fc471eec640 1 -- 172.21.15.7:0/2939438618 >> 172.21.15.7:0/2939438618 conn(0x7fc46c0fc7d0 msgr2=0x7fc46c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:07.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.718+0000 7fc471eec640 1 -- 172.21.15.7:0/2939438618 shutdown_connections 2024-09-19T04:15:07.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:07.718+0000 7fc471eec640 1 -- 172.21.15.7:0/2939438618 wait complete. 2024-09-19T04:15:08.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:07 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2939438618' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:15:08.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:07 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2939438618' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:15:08.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:07 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2939438618' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:15:08.445 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:15:08.706 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:09.099 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:08 smithi007 ceph-mon[31360]: pgmap v297: 129 pgs: 129 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T04:15:09.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:08 smithi102 ceph-mon[35446]: pgmap v297: 129 pgs: 129 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T04:15:09.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.180+0000 7f6db0654640 1 -- 172.21.15.7:0/3489893906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6da8103660 msgr2=0x7f6da810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:09.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.180+0000 7f6db0654640 1 --2- 172.21.15.7:0/3489893906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6da8103660 0x7f6da810bb50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6d98009900 tx=0x7f6d9802a480 comp rx=0 tx=0).stop 2024-09-19T04:15:09.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.180+0000 7f6db0654640 1 -- 172.21.15.7:0/3489893906 shutdown_connections 2024-09-19T04:15:09.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.180+0000 7f6db0654640 1 --2- 172.21.15.7:0/3489893906 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6da810c170 0x7f6da810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:09.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.180+0000 7f6db0654640 1 --2- 172.21.15.7:0/3489893906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6da8103660 0x7f6da810bb50 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:09.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.180+0000 7f6db0654640 1 --2- 172.21.15.7:0/3489893906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6da8102d40 0x7f6da8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:09.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.180+0000 7f6db0654640 1 -- 172.21.15.7:0/3489893906 >> 172.21.15.7:0/3489893906 conn(0x7f6da80fc7a0 msgr2=0x7f6da80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:09.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.180+0000 7f6db0654640 1 -- 172.21.15.7:0/3489893906 shutdown_connections 2024-09-19T04:15:09.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.180+0000 7f6db0654640 1 -- 172.21.15.7:0/3489893906 wait complete. 2024-09-19T04:15:09.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.181+0000 7f6db0654640 1 Processor -- start 2024-09-19T04:15:09.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.181+0000 7f6db0654640 1 -- start start 2024-09-19T04:15:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.181+0000 7f6db0654640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6da8102d40 0x7f6da81009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.181+0000 7f6db0654640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6da8103660 0x7f6da8100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.181+0000 7f6db0654640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6da810c170 0x7f6da8101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.181+0000 7f6db0654640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6da8111fb0 con 0x7f6da810c170 2024-09-19T04:15:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.181+0000 7f6db0654640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6da8111e30 con 0x7f6da8103660 2024-09-19T04:15:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.181+0000 7f6db0654640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6da8112130 con 0x7f6da8102d40 2024-09-19T04:15:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.181+0000 7f6daebf1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6da810c170 0x7f6da8101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.181+0000 7f6daebf1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6da810c170 0x7f6da8101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42940/0 (socket says 172.21.15.7:42940) 2024-09-19T04:15:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.181+0000 7f6daebf1640 1 -- 172.21.15.7:0/530840169 learned_addr learned my addr 172.21.15.7:0/530840169 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.182+0000 7f6dae3f0640 1 --2- 172.21.15.7:0/530840169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6da8102d40 0x7f6da81009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.182+0000 7f6dadbef640 1 --2- 172.21.15.7:0/530840169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6da8103660 0x7f6da8100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.182+0000 7f6daebf1640 1 -- 172.21.15.7:0/530840169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6da8102d40 msgr2=0x7f6da81009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:09.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.182+0000 7f6daebf1640 1 --2- 172.21.15.7:0/530840169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6da8102d40 0x7f6da81009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:09.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.182+0000 7f6daebf1640 1 -- 172.21.15.7:0/530840169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6da8103660 msgr2=0x7f6da8100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:09.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.182+0000 7f6daebf1640 1 --2- 172.21.15.7:0/530840169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6da8103660 0x7f6da8100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:09.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.182+0000 7f6daebf1640 1 -- 172.21.15.7:0/530840169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da81a68d0 con 0x7f6da810c170 2024-09-19T04:15:09.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.182+0000 7f6dadbef640 1 --2- 172.21.15.7:0/530840169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6da8103660 0x7f6da8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:15:09.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.182+0000 7f6daebf1640 1 --2- 172.21.15.7:0/530840169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6da810c170 0x7f6da8101420 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6da000b970 tx=0x7f6da000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:09.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.182+0000 7f6d9f7fe640 1 -- 172.21.15.7:0/530840169 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da0019070 con 0x7f6da810c170 2024-09-19T04:15:09.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.182+0000 7f6d9f7fe640 1 -- 172.21.15.7:0/530840169 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6da0014440 con 0x7f6da810c170 2024-09-19T04:15:09.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.182+0000 7f6db0654640 1 -- 172.21.15.7:0/530840169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6da81a6bc0 con 0x7f6da810c170 2024-09-19T04:15:09.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.182+0000 7f6d9f7fe640 1 -- 172.21.15.7:0/530840169 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da00075d0 con 0x7f6da810c170 2024-09-19T04:15:09.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.183+0000 7f6db0654640 1 -- 172.21.15.7:0/530840169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6da81a70b0 con 0x7f6da810c170 2024-09-19T04:15:09.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.183+0000 7f6db0654640 1 -- 172.21.15.7:0/530840169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6da8103120 con 0x7f6da810c170 2024-09-19T04:15:09.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.185+0000 7f6d9f7fe640 1 -- 172.21.15.7:0/530840169 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f6da001c070 con 0x7f6da810c170 2024-09-19T04:15:09.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.185+0000 7f6d9f7fe640 1 --2- 172.21.15.7:0/530840169 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6d940a3240 0x7f6d940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:09.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.186+0000 7f6dae3f0640 1 --2- 172.21.15.7:0/530840169 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6d940a3240 0x7f6d940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:09.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.186+0000 7f6d9f7fe640 1 -- 172.21.15.7:0/530840169 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f6da00cf1e0 con 0x7f6da810c170 2024-09-19T04:15:09.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.186+0000 7f6dae3f0640 1 --2- 172.21.15.7:0/530840169 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6d940a3240 0x7f6d940a5700 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6da400abe0 tx=0x7f6da400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:09.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.190+0000 7f6d9f7fe640 1 -- 172.21.15.7:0/530840169 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6da009bc60 con 0x7f6da810c170 2024-09-19T04:15:09.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:08 smithi092 ceph-mon[34940]: pgmap v297: 129 pgs: 129 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T04:15:09.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.366+0000 7f6db0654640 1 -- 172.21.15.7:0/530840169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6da81a7340 con 0x7f6da810c170 2024-09-19T04:15:09.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.367+0000 7f6d9f7fe640 1 -- 172.21.15.7:0/530840169 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24128 (secure 0 0 0) 0x7f6da009b560 con 0x7f6da810c170 2024-09-19T04:15:09.369 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:15:09.369 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":86,"fsid":"77957c0a-763c-11ef-bceb-c7b262605968","created":"2024-09-19T04:06:58.337394+0000","modified":"2024-09-19T04:14:43.113323+0000","last_up_change":"2024-09-19T04:13:42.312137+0000","last_in_change":"2024-09-19T04:13:18.757925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:09:59.544984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:14:30.225637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:14:32.252497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T04:14:38.781821+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d9b93bd5-ee22-4fb0-ba29-bfa208430a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6803","nonce":240599233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6805","nonce":240599233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6809","nonce":240599233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6807","nonce":240599233}]},"public_addr":"172.21.15.7:6803/240599233","cluster_addr":"172.21.15.7:6805/240599233","heartbeat_back_addr":"172.21.15.7:6809/240599233","heartbeat_front_addr":"172.21.15.7:6807/240599233","state":["exists","up"]},{"osd":1,"uuid":"db5793e6-f3ad-4075-a02b-206bf7f1e59a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6801","nonce":902403333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6803","nonce":902403333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6807","nonce":902403333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6805","nonce":902403333}]},"public_addr":"172.21.15.92:6801/902403333","cluster_addr":"172.21.15.92:6803/902403333","heartbeat_back_addr":"172.21.15.92:6807/902403333","heartbeat_front_addr":"172.21.15.92:6805/902403333","state":["exists","up"]},{"osd":2,"uuid":"1eb83a1b-82d8-4983-bae3-b161adb3a33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6801","nonce":2078441772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6803","nonce":2078441772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6807","nonce":2078441772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6805","nonce":2078441772}]},"public_addr":"172.21.15.102:6801/2078441772","cluster_addr":"172.21.15.102:6803/2078441772","heartbeat_back_addr":"172.21.15.102:6807/2078441772","heartbeat_front_addr":"172.21.15.102:6805/2078441772","state":["exists","up"]},{"osd":3,"uuid":"68ba79e5-bcf0-4349-9e14-42f2fa9c11b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6811","nonce":2729561132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6813","nonce":2729561132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6817","nonce":2729561132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6815","nonce":2729561132}]},"public_addr":"172.21.15.7:6811/2729561132","cluster_addr":"172.21.15.7:6813/2729561132","heartbeat_back_addr":"172.21.15.7:6817/2729561132","heartbeat_front_addr":"172.21.15.7:6815/2729561132","state":["exists","up"]},{"osd":4,"uuid":"f20d4a51-121f-4ac8-afeb-5962d83bd697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6809","nonce":2799734294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6811","nonce":2799734294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6815","nonce":2799734294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6813","nonce":2799734294}]},"public_addr":"172.21.15.92:6809/2799734294","cluster_addr":"172.21.15.92:6811/2799734294","heartbeat_back_addr":"172.21.15.92:6815/2799734294","heartbeat_front_addr":"172.21.15.92:6813/2799734294","state":["exists","up"]},{"osd":5,"uuid":"aac02b0a-99dc-4457-8898-c68dc196517a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6809","nonce":3099678146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6811","nonce":3099678146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6815","nonce":3099678146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6813","nonce":3099678146}]},"public_addr":"172.21.15.102:6809/3099678146","cluster_addr":"172.21.15.102:6811/3099678146","heartbeat_back_addr":"172.21.15.102:6815/3099678146","heartbeat_front_addr":"172.21.15.102:6813/3099678146","state":["exists","up"]},{"osd":6,"uuid":"7e5a8b30-8406-486c-ace5-79158a3757a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6819","nonce":1569704304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6821","nonce":1569704304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6825","nonce":1569704304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6823","nonce":1569704304}]},"public_addr":"172.21.15.7:6819/1569704304","cluster_addr":"172.21.15.7:6821/1569704304","heartbeat_back_addr":"172.21.15.7:6825/1569704304","heartbeat_front_addr":"172.21.15.7:6823/1569704304","state":["exists","up"]},{"osd":7,"uuid":"e6a7049a-17a1-43b2-8ecd-5f4ca7c337be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6817","nonce":3411102480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6819","nonce":3411102480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6823","nonce":3411102480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6821","nonce":3411102480}]},"public_addr":"172.21.15.92:6817/3411102480","cluster_addr":"172.21.15.92:6819/3411102480","heartbeat_back_addr":"172.21.15.92:6823/3411102480","heartbeat_front_addr":"172.21.15.92:6821/3411102480","state":["exists","up"]},{"osd":8,"uuid":"31879baa-861d-4322-990f-0b9a42b8b610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6817","nonce":2990859925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6819","nonce":2990859925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6823","nonce":2990859925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6821","nonce":2990859925}]},"public_addr":"172.21.15.102:6817/2990859925","cluster_addr":"172.21.15.102:6819/2990859925","heartbeat_back_addr":"172.21.15.102:6823/2990859925","heartbeat_front_addr":"172.21.15.102:6821/2990859925","state":["exists","up"]},{"osd":9,"uuid":"6d65db33-926c-4a6e-a072-707e9c9de92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6827","nonce":1710319475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6829","nonce":1710319475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6833","nonce":1710319475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6831","nonce":1710319475}]},"public_addr":"172.21.15.7:6827/1710319475","cluster_addr":"172.21.15.7:6829/1710319475","heartbeat_back_addr":"172.21.15.7:6833/1710319475","heartbeat_front_addr":"172.21.15.7:6831/1710319475","state":["exists","up"]},{"osd":10,"uuid":"9ab681ee-0bef-47bd-bf3d-20b17c6b870c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6825","nonce":1063265541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6827","nonce":1063265541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6831","nonce":1063265541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6829","nonce":1063265541}]},"public_addr":"172.21.15.92:6825/1063265541","cluster_addr":"172.21.15.92:6827/1063265541","heartbeat_back_addr":"172.21.15.92:6831/1063265541","heartbeat_front_addr":"172.21.15.92:6829/1063265541","state":["exists","up"]},{"osd":11,"uuid":"dc398e14-5f9e-4f0a-b158-35cbc1f73a83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6825","nonce":1175425599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6827","nonce":1175425599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6831","nonce":1175425599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6829","nonce":1175425599}]},"public_addr":"172.21.15.102:6825/1175425599","cluster_addr":"172.21.15.102:6827/1175425599","heartbeat_back_addr":"172.21.15.102:6831/1175425599","heartbeat_front_addr":"172.21.15.102:6829/1175425599","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:07.857319+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:31.430120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:56.892301+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:10:22.011884+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:10:46.326025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:11:10.339084+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:11:35.365906+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:01.104309+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:25.717295+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:51.387644+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:13:15.076355+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:13:40.253150+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/2883028938":"2024-09-20T04:07:45.039922+0000","172.21.15.7:0/1186412739":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6800/751091002":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6801/751091002":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6801/940106179":"2024-09-20T04:07:20.364033+0000","172.21.15.7:6800/940106179":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/1450115700":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/2954294373":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/1996930242":"2024-09-20T04:07:45.039922+0000","172.21.15.7:0/3562231347":"2024-09-20T04:07:20.364033+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:15:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.369+0000 7f6db0654640 1 -- 172.21.15.7:0/530840169 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6d940a3240 msgr2=0x7f6d940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.369+0000 7f6db0654640 1 --2- 172.21.15.7:0/530840169 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6d940a3240 0x7f6d940a5700 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6da400abe0 tx=0x7f6da400a2d0 comp rx=0 tx=0).stop 2024-09-19T04:15:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.369+0000 7f6db0654640 1 -- 172.21.15.7:0/530840169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6da810c170 msgr2=0x7f6da8101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.369+0000 7f6db0654640 1 --2- 172.21.15.7:0/530840169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6da810c170 0x7f6da8101420 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6da000b970 tx=0x7f6da000bd70 comp rx=0 tx=0).stop 2024-09-19T04:15:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.369+0000 7f6db0654640 1 -- 172.21.15.7:0/530840169 shutdown_connections 2024-09-19T04:15:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.369+0000 7f6db0654640 1 --2- 172.21.15.7:0/530840169 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6d940a3240 0x7f6d940a5700 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:09.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.369+0000 7f6db0654640 1 --2- 172.21.15.7:0/530840169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6da810c170 0x7f6da8101420 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:09.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.369+0000 7f6db0654640 1 --2- 172.21.15.7:0/530840169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6da8103660 0x7f6da8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:09.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.369+0000 7f6db0654640 1 --2- 172.21.15.7:0/530840169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6da8102d40 0x7f6da81009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:09.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.369+0000 7f6db0654640 1 -- 172.21.15.7:0/530840169 >> 172.21.15.7:0/530840169 conn(0x7f6da80fc7a0 msgr2=0x7f6da80fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:09.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.370+0000 7f6db0654640 1 -- 172.21.15.7:0/530840169 shutdown_connections 2024-09-19T04:15:09.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:09.370+0000 7f6db0654640 1 -- 172.21.15.7:0/530840169 wait complete. 2024-09-19T04:15:10.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:09 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/530840169' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:15:10.128 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-19T04:15:10.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:09 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/530840169' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:15:10.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:09 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/530840169' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:15:10.389 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:10.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.879+0000 7f7cca346640 1 -- 172.21.15.7:0/803016794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cc4102d30 msgr2=0x7f7cc4103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:10.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.879+0000 7f7cca346640 1 --2- 172.21.15.7:0/803016794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cc4102d30 0x7f7cc4103110 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4009930 tx=0x7f7cb402a420 comp rx=0 tx=0).stop 2024-09-19T04:15:10.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.879+0000 7f7cca346640 1 -- 172.21.15.7:0/803016794 shutdown_connections 2024-09-19T04:15:10.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.879+0000 7f7cca346640 1 --2- 172.21.15.7:0/803016794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cc41082a0 0x7f7cc410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:10.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.879+0000 7f7cca346640 1 --2- 172.21.15.7:0/803016794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7cc41036e0 0x7f7cc4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:10.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.879+0000 7f7cca346640 1 --2- 172.21.15.7:0/803016794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cc4102d30 0x7f7cc4103110 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:10.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.879+0000 7f7cca346640 1 -- 172.21.15.7:0/803016794 >> 172.21.15.7:0/803016794 conn(0x7f7cc40fc7d0 msgr2=0x7f7cc40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:10.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.879+0000 7f7cca346640 1 -- 172.21.15.7:0/803016794 shutdown_connections 2024-09-19T04:15:10.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.879+0000 7f7cca346640 1 -- 172.21.15.7:0/803016794 wait complete. 2024-09-19T04:15:10.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.880+0000 7f7cca346640 1 Processor -- start 2024-09-19T04:15:10.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.880+0000 7f7cca346640 1 -- start start 2024-09-19T04:15:10.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.880+0000 7f7cca346640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cc4102d30 0x7f7cc4198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:10.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.880+0000 7f7cca346640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7cc41036e0 0x7f7cc4198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:10.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.880+0000 7f7cca346640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cc41082a0 0x7f7cc419cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:10.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.880+0000 7f7cca346640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc4112150 con 0x7f7cc4102d30 2024-09-19T04:15:10.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.880+0000 7f7cca346640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc4111fd0 con 0x7f7cc41036e0 2024-09-19T04:15:10.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.880+0000 7f7cca346640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc41122d0 con 0x7f7cc41082a0 2024-09-19T04:15:10.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.880+0000 7f7cc3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cc4102d30 0x7f7cc4198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:10.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.880+0000 7f7cc3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cc4102d30 0x7f7cc4198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42960/0 (socket says 172.21.15.7:42960) 2024-09-19T04:15:10.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.880+0000 7f7cc3fff640 1 -- 172.21.15.7:0/1819309460 learned_addr learned my addr 172.21.15.7:0/1819309460 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:10.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.880+0000 7f7cc88e3640 1 --2- 172.21.15.7:0/1819309460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cc41082a0 0x7f7cc419cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:10.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.880+0000 7f7cc37fe640 1 --2- 172.21.15.7:0/1819309460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7cc41036e0 0x7f7cc4198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:10.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.880+0000 7f7cc3fff640 1 -- 172.21.15.7:0/1819309460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cc41082a0 msgr2=0x7f7cc419cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:10.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.880+0000 7f7cc3fff640 1 --2- 172.21.15.7:0/1819309460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cc41082a0 0x7f7cc419cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:10.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.880+0000 7f7cc3fff640 1 -- 172.21.15.7:0/1819309460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7cc41036e0 msgr2=0x7f7cc4198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:10.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.880+0000 7f7cc3fff640 1 --2- 172.21.15.7:0/1819309460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7cc41036e0 0x7f7cc4198b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:10.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.880+0000 7f7cc3fff640 1 -- 172.21.15.7:0/1819309460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc419d5c0 con 0x7f7cc4102d30 2024-09-19T04:15:10.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.881+0000 7f7cc3fff640 1 --2- 172.21.15.7:0/1819309460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cc4102d30 0x7f7cc4198610 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7cb402a940 tx=0x7f7cb4003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:10.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.881+0000 7f7cc17fa640 1 -- 172.21.15.7:0/1819309460 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb403f070 con 0x7f7cc4102d30 2024-09-19T04:15:10.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.881+0000 7f7cc17fa640 1 -- 172.21.15.7:0/1819309460 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7cb403b460 con 0x7f7cc4102d30 2024-09-19T04:15:10.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.881+0000 7f7cc17fa640 1 -- 172.21.15.7:0/1819309460 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4035030 con 0x7f7cc4102d30 2024-09-19T04:15:10.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.881+0000 7f7cca346640 1 -- 172.21.15.7:0/1819309460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cc419d850 con 0x7f7cc4102d30 2024-09-19T04:15:10.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.881+0000 7f7cca346640 1 -- 172.21.15.7:0/1819309460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cc41a5190 con 0x7f7cc4102d30 2024-09-19T04:15:10.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.882+0000 7f7cca346640 1 -- 172.21.15.7:0/1819309460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cc406a850 con 0x7f7cc4102d30 2024-09-19T04:15:10.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.883+0000 7f7cc17fa640 1 -- 172.21.15.7:0/1819309460 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f7cb4042070 con 0x7f7cc4102d30 2024-09-19T04:15:10.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.884+0000 7f7cc17fa640 1 --2- 172.21.15.7:0/1819309460 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f7cac0a3240 0x7f7cac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:10.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.884+0000 7f7cc37fe640 1 --2- 172.21.15.7:0/1819309460 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f7cac0a3240 0x7f7cac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:10.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.884+0000 7f7cc17fa640 1 -- 172.21.15.7:0/1819309460 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f7cb40f0100 con 0x7f7cc4102d30 2024-09-19T04:15:10.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.885+0000 7f7cc37fe640 1 --2- 172.21.15.7:0/1819309460 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f7cac0a3240 0x7f7cac0a5700 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7cc40fdbd0 tx=0x7f7cb8005cc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:10.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:10.888+0000 7f7cc17fa640 1 -- 172.21.15.7:0/1819309460 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7cb40bcbe0 con 0x7f7cc4102d30 2024-09-19T04:15:11.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:11.101+0000 7f7cca346640 1 -- 172.21.15.7:0/1819309460 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f7cc410a2b0 con 0x7f7cc4102d30 2024-09-19T04:15:11.103 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:10 smithi007 ceph-mon[31360]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T04:15:11.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:10 smithi102 ceph-mon[35446]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T04:15:11.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:10 smithi092 ceph-mon[34940]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-19T04:15:11.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:11.817+0000 7f7cc17fa640 1 -- 172.21.15.7:0/1819309460 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f7cb40bc4e0 con 0x7f7cc4102d30 2024-09-19T04:15:11.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:11.820+0000 7f7cca346640 1 -- 172.21.15.7:0/1819309460 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f7cac0a3240 msgr2=0x7f7cac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:11.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:11.820+0000 7f7cca346640 1 --2- 172.21.15.7:0/1819309460 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f7cac0a3240 0x7f7cac0a5700 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7cc40fdbd0 tx=0x7f7cb8005cc0 comp rx=0 tx=0).stop 2024-09-19T04:15:11.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:11.820+0000 7f7cca346640 1 -- 172.21.15.7:0/1819309460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cc4102d30 msgr2=0x7f7cc4198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:11.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:11.820+0000 7f7cca346640 1 --2- 172.21.15.7:0/1819309460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cc4102d30 0x7f7cc4198610 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7cb402a940 tx=0x7f7cb4003c00 comp rx=0 tx=0).stop 2024-09-19T04:15:11.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:11.821+0000 7f7cca346640 1 -- 172.21.15.7:0/1819309460 shutdown_connections 2024-09-19T04:15:11.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:11.821+0000 7f7cca346640 1 --2- 172.21.15.7:0/1819309460 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f7cac0a3240 0x7f7cac0a5700 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:11.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:11.821+0000 7f7cca346640 1 --2- 172.21.15.7:0/1819309460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cc41082a0 0x7f7cc419cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:11.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:11.821+0000 7f7cca346640 1 --2- 172.21.15.7:0/1819309460 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7cc41036e0 0x7f7cc4198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:11.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:11.821+0000 7f7cca346640 1 --2- 172.21.15.7:0/1819309460 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7cc4102d30 0x7f7cc4198610 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:11.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:11.821+0000 7f7cca346640 1 -- 172.21.15.7:0/1819309460 >> 172.21.15.7:0/1819309460 conn(0x7f7cc40fc7d0 msgr2=0x7f7cc40fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:11.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:11.821+0000 7f7cca346640 1 -- 172.21.15.7:0/1819309460 shutdown_connections 2024-09-19T04:15:11.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:11.821+0000 7f7cca346640 1 -- 172.21.15.7:0/1819309460 wait complete. 2024-09-19T04:15:12.079 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:11 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1819309460' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T04:15:12.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:11 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1819309460' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T04:15:12.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:11 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1819309460' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T04:15:12.638 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-19T04:15:12.639 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-19T04:15:12.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:12 smithi007 ceph-mon[31360]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-19T04:15:12.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:12 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1819309460' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T04:15:12.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:12 smithi007 ceph-mon[31360]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T04:15:12.909 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:13.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:12 smithi102 ceph-mon[35446]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-19T04:15:13.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:12 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1819309460' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T04:15:13.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:12 smithi102 ceph-mon[35446]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T04:15:13.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:12 smithi092 ceph-mon[34940]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-19T04:15:13.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:12 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1819309460' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T04:15:13.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:12 smithi092 ceph-mon[34940]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T04:15:13.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.385+0000 7fd5e6ab9640 1 -- 172.21.15.7:0/400450279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5e01082a0 msgr2=0x7fd5e010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:13.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.385+0000 7fd5e6ab9640 1 --2- 172.21.15.7:0/400450279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5e01082a0 0x7fd5e010ec40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0009930 tx=0x7fd5d002a440 comp rx=0 tx=0).stop 2024-09-19T04:15:13.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.385+0000 7fd5e6ab9640 1 -- 172.21.15.7:0/400450279 shutdown_connections 2024-09-19T04:15:13.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.385+0000 7fd5e6ab9640 1 --2- 172.21.15.7:0/400450279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5e01082a0 0x7fd5e010ec40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:13.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.385+0000 7fd5e6ab9640 1 --2- 172.21.15.7:0/400450279 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5e01036e0 0x7fd5e0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:13.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.385+0000 7fd5e6ab9640 1 --2- 172.21.15.7:0/400450279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5e0102d30 0x7fd5e0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:13.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.385+0000 7fd5e6ab9640 1 -- 172.21.15.7:0/400450279 >> 172.21.15.7:0/400450279 conn(0x7fd5e00fc7d0 msgr2=0x7fd5e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:13.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.385+0000 7fd5e6ab9640 1 -- 172.21.15.7:0/400450279 shutdown_connections 2024-09-19T04:15:13.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.385+0000 7fd5e6ab9640 1 -- 172.21.15.7:0/400450279 wait complete. 2024-09-19T04:15:13.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.385+0000 7fd5e6ab9640 1 Processor -- start 2024-09-19T04:15:13.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.385+0000 7fd5e6ab9640 1 -- start start 2024-09-19T04:15:13.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.386+0000 7fd5e6ab9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5e0102d30 0x7fd5e0198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:13.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.386+0000 7fd5e6ab9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5e01036e0 0x7fd5e0198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:13.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.386+0000 7fd5e6ab9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5e01082a0 0x7fd5e019d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:13.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.386+0000 7fd5e6ab9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e0112160 con 0x7fd5e0102d30 2024-09-19T04:15:13.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.386+0000 7fd5e6ab9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e0111fe0 con 0x7fd5e01036e0 2024-09-19T04:15:13.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.386+0000 7fd5e6ab9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e01122e0 con 0x7fd5e01082a0 2024-09-19T04:15:13.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.386+0000 7fd5e4855640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5e0102d30 0x7fd5e0198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:13.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.386+0000 7fd5e4855640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5e0102d30 0x7fd5e0198740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42978/0 (socket says 172.21.15.7:42978) 2024-09-19T04:15:13.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.386+0000 7fd5e4855640 1 -- 172.21.15.7:0/2858903386 learned_addr learned my addr 172.21.15.7:0/2858903386 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:13.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.386+0000 7fd5dffff640 1 --2- 172.21.15.7:0/2858903386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5e01036e0 0x7fd5e0198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:13.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.386+0000 7fd5e5056640 1 --2- 172.21.15.7:0/2858903386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5e01082a0 0x7fd5e019d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:13.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.386+0000 7fd5e4855640 1 -- 172.21.15.7:0/2858903386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5e01082a0 msgr2=0x7fd5e019d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:13.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.386+0000 7fd5e4855640 1 --2- 172.21.15.7:0/2858903386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5e01082a0 0x7fd5e019d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:13.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.386+0000 7fd5e4855640 1 -- 172.21.15.7:0/2858903386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5e01036e0 msgr2=0x7fd5e0198c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:13.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.386+0000 7fd5e4855640 1 --2- 172.21.15.7:0/2858903386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5e01036e0 0x7fd5e0198c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:13.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.386+0000 7fd5e4855640 1 -- 172.21.15.7:0/2858903386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e019d6f0 con 0x7fd5e0102d30 2024-09-19T04:15:13.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.386+0000 7fd5e5056640 1 --2- 172.21.15.7:0/2858903386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5e01082a0 0x7fd5e019d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:15:13.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.386+0000 7fd5e4855640 1 --2- 172.21.15.7:0/2858903386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5e0102d30 0x7fd5e0198740 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800ba50 tx=0x7fd5d800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:13.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.386+0000 7fd5ddffb640 1 -- 172.21.15.7:0/2858903386 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8019070 con 0x7fd5e0102d30 2024-09-19T04:15:13.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.386+0000 7fd5ddffb640 1 -- 172.21.15.7:0/2858903386 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5d8014440 con 0x7fd5e0102d30 2024-09-19T04:15:13.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.387+0000 7fd5e6ab9640 1 -- 172.21.15.7:0/2858903386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e019d9e0 con 0x7fd5e0102d30 2024-09-19T04:15:13.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.387+0000 7fd5ddffb640 1 -- 172.21.15.7:0/2858903386 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d80075d0 con 0x7fd5e0102d30 2024-09-19T04:15:13.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.387+0000 7fd5e6ab9640 1 -- 172.21.15.7:0/2858903386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e01a52c0 con 0x7fd5e0102d30 2024-09-19T04:15:13.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.388+0000 7fd5e6ab9640 1 -- 172.21.15.7:0/2858903386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5e006a850 con 0x7fd5e0102d30 2024-09-19T04:15:13.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.389+0000 7fd5ddffb640 1 -- 172.21.15.7:0/2858903386 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fd5d801c070 con 0x7fd5e0102d30 2024-09-19T04:15:13.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.389+0000 7fd5ddffb640 1 --2- 172.21.15.7:0/2858903386 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd5c80a32c0 0x7fd5c80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:13.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.390+0000 7fd5dffff640 1 --2- 172.21.15.7:0/2858903386 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd5c80a32c0 0x7fd5c80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:13.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.390+0000 7fd5ddffb640 1 -- 172.21.15.7:0/2858903386 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fd5d80cf0c0 con 0x7fd5e0102d30 2024-09-19T04:15:13.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.390+0000 7fd5dffff640 1 --2- 172.21.15.7:0/2858903386 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd5c80a32c0 0x7fd5c80a5780 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd5e00fedc0 tx=0x7fd5d4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:13.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.394+0000 7fd5ddffb640 1 -- 172.21.15.7:0/2858903386 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd5d809bba0 con 0x7fd5e0102d30 2024-09-19T04:15:13.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.609+0000 7fd5e6ab9640 1 -- 172.21.15.7:0/2858903386 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7fd5e010a2b0 con 0x7fd5e0102d30 2024-09-19T04:15:13.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.791+0000 7fd5ddffb640 1 -- 172.21.15.7:0/2858903386 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7fd5d809b4a0 con 0x7fd5e0102d30 2024-09-19T04:15:13.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.793+0000 7fd5e6ab9640 1 -- 172.21.15.7:0/2858903386 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd5c80a32c0 msgr2=0x7fd5c80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:13.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.793+0000 7fd5e6ab9640 1 --2- 172.21.15.7:0/2858903386 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd5c80a32c0 0x7fd5c80a5780 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd5e00fedc0 tx=0x7fd5d4009110 comp rx=0 tx=0).stop 2024-09-19T04:15:13.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.793+0000 7fd5e6ab9640 1 -- 172.21.15.7:0/2858903386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5e0102d30 msgr2=0x7fd5e0198740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:13.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.793+0000 7fd5e6ab9640 1 --2- 172.21.15.7:0/2858903386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5e0102d30 0x7fd5e0198740 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800ba50 tx=0x7fd5d800be50 comp rx=0 tx=0).stop 2024-09-19T04:15:13.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.793+0000 7fd5e6ab9640 1 -- 172.21.15.7:0/2858903386 shutdown_connections 2024-09-19T04:15:13.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.793+0000 7fd5e6ab9640 1 --2- 172.21.15.7:0/2858903386 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd5c80a32c0 0x7fd5c80a5780 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:13.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.793+0000 7fd5e6ab9640 1 --2- 172.21.15.7:0/2858903386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5e01082a0 0x7fd5e019d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:13.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.793+0000 7fd5e6ab9640 1 --2- 172.21.15.7:0/2858903386 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5e01036e0 0x7fd5e0198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:13.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.793+0000 7fd5e6ab9640 1 --2- 172.21.15.7:0/2858903386 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5e0102d30 0x7fd5e0198740 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:13.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.793+0000 7fd5e6ab9640 1 -- 172.21.15.7:0/2858903386 >> 172.21.15.7:0/2858903386 conn(0x7fd5e00fc7d0 msgr2=0x7fd5e0106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:13.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.794+0000 7fd5e6ab9640 1 -- 172.21.15.7:0/2858903386 shutdown_connections 2024-09-19T04:15:13.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:13.794+0000 7fd5e6ab9640 1 -- 172.21.15.7:0/2858903386 wait complete. 2024-09-19T04:15:13.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:13 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2858903386' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-19T04:15:13.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:13 smithi007 ceph-mon[31360]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T04:15:13.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:13 smithi007 ceph-mon[31360]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T04:15:13.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:13 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2858903386' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-19T04:15:13.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:13 smithi007 ceph-mon[31360]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T04:15:13.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:13 smithi007 ceph-mon[31360]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T04:15:14.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:13 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2858903386' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-19T04:15:14.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:13 smithi102 ceph-mon[35446]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T04:15:14.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:13 smithi102 ceph-mon[35446]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T04:15:14.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:13 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2858903386' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-19T04:15:14.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:13 smithi102 ceph-mon[35446]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T04:15:14.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:13 smithi102 ceph-mon[35446]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T04:15:14.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:13 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2858903386' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-19T04:15:14.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:13 smithi092 ceph-mon[34940]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T04:15:14.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:13 smithi092 ceph-mon[34940]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T04:15:14.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:13 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2858903386' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-19T04:15:14.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:13 smithi092 ceph-mon[34940]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T04:15:14.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:13 smithi092 ceph-mon[34940]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T04:15:14.557 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-19T04:15:14.829 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:15.096 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:14 smithi007 ceph-mon[31360]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-19T04:15:15.096 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:14 smithi007 ceph-mon[31360]: mds.? [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] up:active 2024-09-19T04:15:15.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:14 smithi007 ceph-mon[31360]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T04:15:15.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:14 smithi007 ceph-mon[31360]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T04:15:15.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:14 smithi007 ceph-mon[31360]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-19T04:15:15.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:14 smithi007 ceph-mon[31360]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-19T04:15:15.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:14 smithi102 ceph-mon[35446]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-19T04:15:15.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:14 smithi102 ceph-mon[35446]: mds.? [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] up:active 2024-09-19T04:15:15.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:14 smithi102 ceph-mon[35446]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T04:15:15.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:14 smithi102 ceph-mon[35446]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T04:15:15.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:14 smithi102 ceph-mon[35446]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-19T04:15:15.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:14 smithi102 ceph-mon[35446]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-19T04:15:15.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:14 smithi092 ceph-mon[34940]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-19T04:15:15.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:14 smithi092 ceph-mon[34940]: mds.? [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] up:active 2024-09-19T04:15:15.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:14 smithi092 ceph-mon[34940]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T04:15:15.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:14 smithi092 ceph-mon[34940]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T04:15:15.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:14 smithi092 ceph-mon[34940]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-19T04:15:15.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:14 smithi092 ceph-mon[34940]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-19T04:15:15.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.325+0000 7fcbede7c640 1 -- 172.21.15.7:0/2143821811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbe8103660 msgr2=0x7fcbe810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:15.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.325+0000 7fcbede7c640 1 --2- 172.21.15.7:0/2143821811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbe8103660 0x7fcbe810bb50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009900 tx=0x7fcbdc02a480 comp rx=0 tx=0).stop 2024-09-19T04:15:15.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.325+0000 7fcbede7c640 1 -- 172.21.15.7:0/2143821811 shutdown_connections 2024-09-19T04:15:15.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.326+0000 7fcbede7c640 1 --2- 172.21.15.7:0/2143821811 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbe810c170 0x7fcbe810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:15.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.326+0000 7fcbede7c640 1 --2- 172.21.15.7:0/2143821811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbe8103660 0x7fcbe810bb50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:15.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.326+0000 7fcbede7c640 1 --2- 172.21.15.7:0/2143821811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbe8102d40 0x7fcbe8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:15.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.326+0000 7fcbede7c640 1 -- 172.21.15.7:0/2143821811 >> 172.21.15.7:0/2143821811 conn(0x7fcbe80fc7a0 msgr2=0x7fcbe80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:15.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.326+0000 7fcbede7c640 1 -- 172.21.15.7:0/2143821811 shutdown_connections 2024-09-19T04:15:15.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.326+0000 7fcbede7c640 1 -- 172.21.15.7:0/2143821811 wait complete. 2024-09-19T04:15:15.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.326+0000 7fcbede7c640 1 Processor -- start 2024-09-19T04:15:15.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.326+0000 7fcbede7c640 1 -- start start 2024-09-19T04:15:15.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.327+0000 7fcbede7c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbe8102d40 0x7fcbe81009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:15.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.327+0000 7fcbede7c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbe8103660 0x7fcbe8100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:15.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.327+0000 7fcbede7c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbe810c170 0x7fcbe8101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:15.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.327+0000 7fcbede7c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe8111f70 con 0x7fcbe810c170 2024-09-19T04:15:15.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.327+0000 7fcbede7c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe8111df0 con 0x7fcbe8102d40 2024-09-19T04:15:15.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.327+0000 7fcbede7c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe81120f0 con 0x7fcbe8103660 2024-09-19T04:15:15.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.327+0000 7fcbe7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbe810c170 0x7fcbe8101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:15.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.327+0000 7fcbe7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbe810c170 0x7fcbe8101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42996/0 (socket says 172.21.15.7:42996) 2024-09-19T04:15:15.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.327+0000 7fcbe7fff640 1 -- 172.21.15.7:0/1911226007 learned_addr learned my addr 172.21.15.7:0/1911226007 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:15.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.327+0000 7fcbe77fe640 1 --2- 172.21.15.7:0/1911226007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbe8102d40 0x7fcbe81009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:15.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.327+0000 7fcbe6ffd640 1 --2- 172.21.15.7:0/1911226007 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbe8103660 0x7fcbe8100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:15.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.327+0000 7fcbe7fff640 1 -- 172.21.15.7:0/1911226007 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbe8103660 msgr2=0x7fcbe8100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:15.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.327+0000 7fcbe7fff640 1 --2- 172.21.15.7:0/1911226007 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbe8103660 0x7fcbe8100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:15.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.327+0000 7fcbe7fff640 1 -- 172.21.15.7:0/1911226007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbe8102d40 msgr2=0x7fcbe81009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:15.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.327+0000 7fcbe7fff640 1 --2- 172.21.15.7:0/1911226007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbe8102d40 0x7fcbe81009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:15.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.327+0000 7fcbe7fff640 1 -- 172.21.15.7:0/1911226007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe81aadc0 con 0x7fcbe810c170 2024-09-19T04:15:15.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.327+0000 7fcbe7fff640 1 --2- 172.21.15.7:0/1911226007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbe810c170 0x7fcbe8101420 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcbe000cad0 tx=0x7fcbe000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:15.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.327+0000 7fcbe4ff9640 1 -- 172.21.15.7:0/1911226007 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe000ad60 con 0x7fcbe810c170 2024-09-19T04:15:15.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.327+0000 7fcbe4ff9640 1 -- 172.21.15.7:0/1911226007 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbe0005020 con 0x7fcbe810c170 2024-09-19T04:15:15.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.327+0000 7fcbede7c640 1 -- 172.21.15.7:0/1911226007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe81aaff0 con 0x7fcbe810c170 2024-09-19T04:15:15.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.328+0000 7fcbe4ff9640 1 -- 172.21.15.7:0/1911226007 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe000f6b0 con 0x7fcbe810c170 2024-09-19T04:15:15.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.328+0000 7fcbede7c640 1 -- 172.21.15.7:0/1911226007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe81ab450 con 0x7fcbe810c170 2024-09-19T04:15:15.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.329+0000 7fcbede7c640 1 -- 172.21.15.7:0/1911226007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbe806b070 con 0x7fcbe810c170 2024-09-19T04:15:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.331+0000 7fcbe4ff9640 1 -- 172.21.15.7:0/1911226007 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fcbe0005560 con 0x7fcbe810c170 2024-09-19T04:15:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.331+0000 7fcbe4ff9640 1 --2- 172.21.15.7:0/1911226007 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fcbd00a3240 0x7fcbd00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.331+0000 7fcbe77fe640 1 --2- 172.21.15.7:0/1911226007 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fcbd00a3240 0x7fcbd00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.332+0000 7fcbe4ff9640 1 -- 172.21.15.7:0/1911226007 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fcbe00cfe10 con 0x7fcbe810c170 2024-09-19T04:15:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.332+0000 7fcbe77fe640 1 --2- 172.21.15.7:0/1911226007 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fcbd00a3240 0x7fcbd00a5700 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcbd800abe0 tx=0x7fcbd800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:15.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.335+0000 7fcbe4ff9640 1 -- 172.21.15.7:0/1911226007 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcbe0014030 con 0x7fcbe810c170 2024-09-19T04:15:15.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.549+0000 7fcbede7c640 1 -- 172.21.15.7:0/1911226007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fcbe8103120 con 0x7fcbe810c170 2024-09-19T04:15:15.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.798+0000 7fcbe4ff9640 1 -- 172.21.15.7:0/1911226007 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7fcbe8103120 con 0x7fcbe810c170 2024-09-19T04:15:15.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.801+0000 7fcbede7c640 1 -- 172.21.15.7:0/1911226007 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fcbd00a3240 msgr2=0x7fcbd00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:15.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.801+0000 7fcbede7c640 1 --2- 172.21.15.7:0/1911226007 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fcbd00a3240 0x7fcbd00a5700 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcbd800abe0 tx=0x7fcbd800a2d0 comp rx=0 tx=0).stop 2024-09-19T04:15:15.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.801+0000 7fcbede7c640 1 -- 172.21.15.7:0/1911226007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbe810c170 msgr2=0x7fcbe8101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:15.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.801+0000 7fcbede7c640 1 --2- 172.21.15.7:0/1911226007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbe810c170 0x7fcbe8101420 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcbe000cad0 tx=0x7fcbe000ced0 comp rx=0 tx=0).stop 2024-09-19T04:15:15.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.801+0000 7fcbede7c640 1 -- 172.21.15.7:0/1911226007 shutdown_connections 2024-09-19T04:15:15.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.801+0000 7fcbede7c640 1 --2- 172.21.15.7:0/1911226007 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fcbd00a3240 0x7fcbd00a5700 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:15.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.801+0000 7fcbede7c640 1 --2- 172.21.15.7:0/1911226007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbe810c170 0x7fcbe8101420 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:15.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.801+0000 7fcbede7c640 1 --2- 172.21.15.7:0/1911226007 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbe8103660 0x7fcbe8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:15.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.801+0000 7fcbede7c640 1 --2- 172.21.15.7:0/1911226007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbe8102d40 0x7fcbe81009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:15.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.801+0000 7fcbede7c640 1 -- 172.21.15.7:0/1911226007 >> 172.21.15.7:0/1911226007 conn(0x7fcbe80fc7a0 msgr2=0x7fcbe80fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:15.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.801+0000 7fcbede7c640 1 -- 172.21.15.7:0/1911226007 shutdown_connections 2024-09-19T04:15:15.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:15.801+0000 7fcbede7c640 1 -- 172.21.15.7:0/1911226007 wait complete. 2024-09-19T04:15:16.121 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:15 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1911226007' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T04:15:16.121 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:15 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1911226007' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T04:15:16.121 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:15 smithi007 ceph-mon[31360]: mds.? [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] up:active 2024-09-19T04:15:16.122 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:15 smithi007 ceph-mon[31360]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-19T04:15:16.122 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:15 smithi007 ceph-mon[31360]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-19T04:15:16.122 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:15 smithi007 ceph-mon[31360]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-19T04:15:16.122 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:15 smithi007 ceph-mon[31360]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-19T04:15:16.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:15 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1911226007' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T04:15:16.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:15 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1911226007' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T04:15:16.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:15 smithi102 ceph-mon[35446]: mds.? [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] up:active 2024-09-19T04:15:16.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:15 smithi102 ceph-mon[35446]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-19T04:15:16.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:15 smithi102 ceph-mon[35446]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-19T04:15:16.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:15 smithi102 ceph-mon[35446]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-19T04:15:16.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:15 smithi102 ceph-mon[35446]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-19T04:15:16.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:15 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1911226007' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T04:15:16.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:15 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1911226007' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T04:15:16.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:15 smithi092 ceph-mon[34940]: mds.? [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] up:active 2024-09-19T04:15:16.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:15 smithi092 ceph-mon[34940]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-19T04:15:16.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:15 smithi092 ceph-mon[34940]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-19T04:15:16.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:15 smithi092 ceph-mon[34940]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-19T04:15:16.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:15 smithi092 ceph-mon[34940]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-19T04:15:16.562 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-19T04:15:16.831 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:17.096 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:16 smithi007 ceph-mon[31360]: pgmap v301: 129 pgs: 129 active+clean; 582 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 1 op/s 2024-09-19T04:15:17.096 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:16 smithi007 ceph-mon[31360]: mds.? [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] up:active 2024-09-19T04:15:17.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:16 smithi007 ceph-mon[31360]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-19T04:15:17.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:16 smithi007 ceph-mon[31360]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T04:15:17.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:16 smithi007 ceph-mon[31360]: Cluster is now healthy 2024-09-19T04:15:17.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:16 smithi007 ceph-mon[31360]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-19T04:15:17.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:16 smithi007 ceph-mon[31360]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-19T04:15:17.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:16 smithi007 ceph-mon[31360]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-19T04:15:17.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:16 smithi102 ceph-mon[35446]: pgmap v301: 129 pgs: 129 active+clean; 582 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 1 op/s 2024-09-19T04:15:17.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:16 smithi102 ceph-mon[35446]: mds.? [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] up:active 2024-09-19T04:15:17.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:16 smithi102 ceph-mon[35446]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-19T04:15:17.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:16 smithi102 ceph-mon[35446]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T04:15:17.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:16 smithi102 ceph-mon[35446]: Cluster is now healthy 2024-09-19T04:15:17.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:16 smithi102 ceph-mon[35446]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-19T04:15:17.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:16 smithi102 ceph-mon[35446]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-19T04:15:17.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:16 smithi102 ceph-mon[35446]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-19T04:15:17.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.287+0000 7fd1c49a2640 1 -- 172.21.15.7:0/4251767366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1c010c170 msgr2=0x7fd1c010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:17.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.287+0000 7fd1c49a2640 1 --2- 172.21.15.7:0/4251767366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1c010c170 0x7fd1c010e610 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8009ca0 tx=0x7fd1b802a950 comp rx=0 tx=0).stop 2024-09-19T04:15:17.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.287+0000 7fd1c49a2640 1 -- 172.21.15.7:0/4251767366 shutdown_connections 2024-09-19T04:15:17.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.287+0000 7fd1c49a2640 1 --2- 172.21.15.7:0/4251767366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1c010c170 0x7fd1c010e610 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:17.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.287+0000 7fd1c49a2640 1 --2- 172.21.15.7:0/4251767366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1c0103660 0x7fd1c010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:17.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.287+0000 7fd1c49a2640 1 --2- 172.21.15.7:0/4251767366 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1c0102d40 0x7fd1c0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:17.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.287+0000 7fd1c49a2640 1 -- 172.21.15.7:0/4251767366 >> 172.21.15.7:0/4251767366 conn(0x7fd1c00fc7a0 msgr2=0x7fd1c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:17.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.287+0000 7fd1c49a2640 1 -- 172.21.15.7:0/4251767366 shutdown_connections 2024-09-19T04:15:17.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.288+0000 7fd1c49a2640 1 -- 172.21.15.7:0/4251767366 wait complete. 2024-09-19T04:15:17.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.288+0000 7fd1c49a2640 1 Processor -- start 2024-09-19T04:15:17.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.288+0000 7fd1c49a2640 1 -- start start 2024-09-19T04:15:17.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.288+0000 7fd1c49a2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1c0102d40 0x7fd1c01009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:17.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.288+0000 7fd1c49a2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1c0103660 0x7fd1c0100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:17.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.289+0000 7fd1c49a2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1c010c170 0x7fd1c0101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:17.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.289+0000 7fd1c49a2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c0111f30 con 0x7fd1c010c170 2024-09-19T04:15:17.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.289+0000 7fd1c49a2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c0111db0 con 0x7fd1c0103660 2024-09-19T04:15:17.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.289+0000 7fd1c49a2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c01120b0 con 0x7fd1c0102d40 2024-09-19T04:15:17.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.289+0000 7fd1bed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1c010c170 0x7fd1c0101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:17.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.289+0000 7fd1bdd9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1c0103660 0x7fd1c0100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:17.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.289+0000 7fd1bed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1c010c170 0x7fd1c0101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43018/0 (socket says 172.21.15.7:43018) 2024-09-19T04:15:17.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.289+0000 7fd1bed9d640 1 -- 172.21.15.7:0/2471062052 learned_addr learned my addr 172.21.15.7:0/2471062052 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:17.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.289+0000 7fd1be59c640 1 --2- 172.21.15.7:0/2471062052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1c0102d40 0x7fd1c01009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:17.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.289+0000 7fd1bed9d640 1 -- 172.21.15.7:0/2471062052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1c0102d40 msgr2=0x7fd1c01009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:17.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.289+0000 7fd1bed9d640 1 --2- 172.21.15.7:0/2471062052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1c0102d40 0x7fd1c01009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:17.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.289+0000 7fd1bed9d640 1 -- 172.21.15.7:0/2471062052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1c0103660 msgr2=0x7fd1c0100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:17.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.289+0000 7fd1bed9d640 1 --2- 172.21.15.7:0/2471062052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1c0103660 0x7fd1c0100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:17.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.289+0000 7fd1bed9d640 1 -- 172.21.15.7:0/2471062052 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1c01a68b0 con 0x7fd1c010c170 2024-09-19T04:15:17.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.289+0000 7fd1be59c640 1 --2- 172.21.15.7:0/2471062052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1c0102d40 0x7fd1c01009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:15:17.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.289+0000 7fd1bed9d640 1 --2- 172.21.15.7:0/2471062052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1c010c170 0x7fd1c0101420 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8006010 tx=0x7fd1b802f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:17.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.289+0000 7fd1af7fe640 1 -- 172.21.15.7:0/2471062052 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b8034040 con 0x7fd1c010c170 2024-09-19T04:15:17.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.289+0000 7fd1af7fe640 1 -- 172.21.15.7:0/2471062052 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1b8003e00 con 0x7fd1c010c170 2024-09-19T04:15:17.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.289+0000 7fd1c49a2640 1 -- 172.21.15.7:0/2471062052 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1c01a6b40 con 0x7fd1c010c170 2024-09-19T04:15:17.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.290+0000 7fd1af7fe640 1 -- 172.21.15.7:0/2471062052 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b80456e0 con 0x7fd1c010c170 2024-09-19T04:15:17.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.290+0000 7fd1c49a2640 1 -- 172.21.15.7:0/2471062052 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1c01a7020 con 0x7fd1c010c170 2024-09-19T04:15:17.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.291+0000 7fd1c49a2640 1 -- 172.21.15.7:0/2471062052 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1c0103120 con 0x7fd1c010c170 2024-09-19T04:15:17.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.292+0000 7fd1af7fe640 1 -- 172.21.15.7:0/2471062052 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fd1b8037020 con 0x7fd1c010c170 2024-09-19T04:15:17.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.293+0000 7fd1af7fe640 1 --2- 172.21.15.7:0/2471062052 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd1a80a3240 0x7fd1a80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:17.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.293+0000 7fd1be59c640 1 --2- 172.21.15.7:0/2471062052 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd1a80a3240 0x7fd1a80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:17.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.293+0000 7fd1af7fe640 1 -- 172.21.15.7:0/2471062052 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fd1b80f0c70 con 0x7fd1c010c170 2024-09-19T04:15:17.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.293+0000 7fd1be59c640 1 --2- 172.21.15.7:0/2471062052 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd1a80a3240 0x7fd1a80a5700 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd1b00058c0 tx=0x7fd1b0005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:17.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:16 smithi092 ceph-mon[34940]: pgmap v301: 129 pgs: 129 active+clean; 582 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 1 op/s 2024-09-19T04:15:17.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:16 smithi092 ceph-mon[34940]: mds.? [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] up:active 2024-09-19T04:15:17.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:16 smithi092 ceph-mon[34940]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-19T04:15:17.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:16 smithi092 ceph-mon[34940]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T04:15:17.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:16 smithi092 ceph-mon[34940]: Cluster is now healthy 2024-09-19T04:15:17.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:16 smithi092 ceph-mon[34940]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-19T04:15:17.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:16 smithi092 ceph-mon[34940]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-19T04:15:17.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:16 smithi092 ceph-mon[34940]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-19T04:15:17.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.297+0000 7fd1af7fe640 1 -- 172.21.15.7:0/2471062052 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd1b80bd750 con 0x7fd1c010c170 2024-09-19T04:15:17.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.509+0000 7fd1c49a2640 1 -- 172.21.15.7:0/2471062052 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fd1c01a72a0 con 0x7fd1c010c170 2024-09-19T04:15:17.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.812+0000 7fd1af7fe640 1 -- 172.21.15.7:0/2471062052 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7fd1b80bd050 con 0x7fd1c010c170 2024-09-19T04:15:17.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.815+0000 7fd1c49a2640 1 -- 172.21.15.7:0/2471062052 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd1a80a3240 msgr2=0x7fd1a80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:17.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.815+0000 7fd1c49a2640 1 --2- 172.21.15.7:0/2471062052 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd1a80a3240 0x7fd1a80a5700 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd1b00058c0 tx=0x7fd1b0005ec0 comp rx=0 tx=0).stop 2024-09-19T04:15:17.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.815+0000 7fd1c49a2640 1 -- 172.21.15.7:0/2471062052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1c010c170 msgr2=0x7fd1c0101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:17.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.815+0000 7fd1c49a2640 1 --2- 172.21.15.7:0/2471062052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1c010c170 0x7fd1c0101420 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8006010 tx=0x7fd1b802f710 comp rx=0 tx=0).stop 2024-09-19T04:15:17.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.815+0000 7fd1c49a2640 1 -- 172.21.15.7:0/2471062052 shutdown_connections 2024-09-19T04:15:17.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.815+0000 7fd1c49a2640 1 --2- 172.21.15.7:0/2471062052 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd1a80a3240 0x7fd1a80a5700 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:17.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.815+0000 7fd1c49a2640 1 --2- 172.21.15.7:0/2471062052 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd1c010c170 0x7fd1c0101420 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:17.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.815+0000 7fd1c49a2640 1 --2- 172.21.15.7:0/2471062052 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1c0103660 0x7fd1c0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:17.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.815+0000 7fd1c49a2640 1 --2- 172.21.15.7:0/2471062052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1c0102d40 0x7fd1c01009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:17.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.815+0000 7fd1c49a2640 1 -- 172.21.15.7:0/2471062052 >> 172.21.15.7:0/2471062052 conn(0x7fd1c00fc7a0 msgr2=0x7fd1c00fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:17.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.815+0000 7fd1c49a2640 1 -- 172.21.15.7:0/2471062052 shutdown_connections 2024-09-19T04:15:17.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:17.815+0000 7fd1c49a2640 1 -- 172.21.15.7:0/2471062052 wait complete. 2024-09-19T04:15:18.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:17 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2471062052' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T04:15:18.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:17 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2471062052' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T04:15:18.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:17 smithi007 ceph-mon[31360]: mds.? [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] up:active 2024-09-19T04:15:18.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:17 smithi007 ceph-mon[31360]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-19T04:15:18.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:17 smithi007 ceph-mon[31360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:15:18.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:17 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2471062052' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T04:15:18.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:17 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2471062052' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T04:15:18.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:17 smithi102 ceph-mon[35446]: mds.? [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] up:active 2024-09-19T04:15:18.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:17 smithi102 ceph-mon[35446]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-19T04:15:18.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:17 smithi102 ceph-mon[35446]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:15:18.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:17 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2471062052' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T04:15:18.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:17 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2471062052' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T04:15:18.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:17 smithi092 ceph-mon[34940]: mds.? [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] up:active 2024-09-19T04:15:18.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:17 smithi092 ceph-mon[34940]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-19T04:15:18.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:17 smithi092 ceph-mon[34940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:15:18.655 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-19T04:15:18.655 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-19T04:15:18.797 INFO:journalctl@ceph.mds.b.smithi092.stdout:Sep 19 04:15:18 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-b[65433]: 2024-09-19T04:15:18.324+0000 7f43567f6640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-19T04:15:18.797 INFO:journalctl@ceph.mds.b.smithi092.stdout:Sep 19 04:15:18 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-b[65433]: 2024-09-19T04:15:18.324+0000 7f43567f6640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-19T04:15:18.797 INFO:journalctl@ceph.mds.b.smithi092.stdout:Sep 19 04:15:18 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-b[65433]: 2024-09-19T04:15:18.324+0000 7f43567f6640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-19T04:15:18.876 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:18 smithi007 ceph-mon[31360]: pgmap v302: 129 pgs: 129 active+clean; 582 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 1 op/s 2024-09-19T04:15:18.921 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:19.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:18 smithi102 ceph-mon[35446]: pgmap v302: 129 pgs: 129 active+clean; 582 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 1 op/s 2024-09-19T04:15:19.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:18 smithi092 ceph-mon[34940]: pgmap v302: 129 pgs: 129 active+clean; 582 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 1 op/s 2024-09-19T04:15:19.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.416+0000 7f6ddacbb640 1 -- 172.21.15.7:0/4217463179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6dd4106f10 msgr2=0x7f6dd410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:19.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.416+0000 7f6ddacbb640 1 --2- 172.21.15.7:0/4217463179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6dd4106f10 0x7f6dd410ea90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc009ca0 tx=0x7f6dcc02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:15:19.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.416+0000 7f6ddacbb640 1 -- 172.21.15.7:0/4217463179 shutdown_connections 2024-09-19T04:15:19.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.416+0000 7f6ddacbb640 1 --2- 172.21.15.7:0/4217463179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6dd4106f10 0x7f6dd410ea90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:19.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.416+0000 7f6ddacbb640 1 --2- 172.21.15.7:0/4217463179 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dd4102790 0x7f6dd41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:19.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.416+0000 7f6ddacbb640 1 --2- 172.21.15.7:0/4217463179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dd4101de0 0x7f6dd41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:19.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.416+0000 7f6ddacbb640 1 -- 172.21.15.7:0/4217463179 >> 172.21.15.7:0/4217463179 conn(0x7f6dd40fd8c0 msgr2=0x7f6dd40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:19.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.416+0000 7f6ddacbb640 1 -- 172.21.15.7:0/4217463179 shutdown_connections 2024-09-19T04:15:19.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.416+0000 7f6ddacbb640 1 -- 172.21.15.7:0/4217463179 wait complete. 2024-09-19T04:15:19.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.417+0000 7f6ddacbb640 1 Processor -- start 2024-09-19T04:15:19.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.417+0000 7f6ddacbb640 1 -- start start 2024-09-19T04:15:19.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.417+0000 7f6ddacbb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6dd4101de0 0x7f6dd40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:19.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.417+0000 7f6ddacbb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dd4102790 0x7f6dd4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:19.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.417+0000 7f6ddacbb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dd4106f10 0x7f6dd4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:19.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.417+0000 7f6ddacbb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd4111f70 con 0x7f6dd4101de0 2024-09-19T04:15:19.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.417+0000 7f6ddacbb640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd4111df0 con 0x7f6dd4106f10 2024-09-19T04:15:19.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.417+0000 7f6ddacbb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd41120f0 con 0x7f6dd4102790 2024-09-19T04:15:19.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.417+0000 7f6dd8a57640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6dd4101de0 0x7f6dd40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:19.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.417+0000 7f6dd8a57640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6dd4101de0 0x7f6dd40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43710/0 (socket says 172.21.15.7:43710) 2024-09-19T04:15:19.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.417+0000 7f6dd8a57640 1 -- 172.21.15.7:0/4037063666 learned_addr learned my addr 172.21.15.7:0/4037063666 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:19.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.417+0000 7f6dd3fff640 1 --2- 172.21.15.7:0/4037063666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dd4102790 0x7f6dd4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:19.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.417+0000 7f6dd8a57640 1 -- 172.21.15.7:0/4037063666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dd4102790 msgr2=0x7f6dd4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:19.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.417+0000 7f6dd8a57640 1 --2- 172.21.15.7:0/4037063666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dd4102790 0x7f6dd4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:19.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.417+0000 7f6dd9258640 1 --2- 172.21.15.7:0/4037063666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dd4106f10 0x7f6dd4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:19.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.418+0000 7f6dd8a57640 1 -- 172.21.15.7:0/4037063666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dd4106f10 msgr2=0x7f6dd4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:19.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.418+0000 7f6dd8a57640 1 --2- 172.21.15.7:0/4037063666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dd4106f10 0x7f6dd4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:19.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.418+0000 7f6dd8a57640 1 -- 172.21.15.7:0/4037063666 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd41a6800 con 0x7f6dd4101de0 2024-09-19T04:15:19.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.418+0000 7f6dd8a57640 1 --2- 172.21.15.7:0/4037063666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6dd4101de0 0x7f6dd40744f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800c890 tx=0x7f6dc800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:19.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.418+0000 7f6dd1ffb640 1 -- 172.21.15.7:0/4037063666 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8004220 con 0x7f6dd4101de0 2024-09-19T04:15:19.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.418+0000 7f6dd1ffb640 1 -- 172.21.15.7:0/4037063666 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6dc80043c0 con 0x7f6dd4101de0 2024-09-19T04:15:19.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.418+0000 7f6ddacbb640 1 -- 172.21.15.7:0/4037063666 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dd41a6af0 con 0x7f6dd4101de0 2024-09-19T04:15:19.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.418+0000 7f6dd1ffb640 1 -- 172.21.15.7:0/4037063666 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc80049e0 con 0x7f6dd4101de0 2024-09-19T04:15:19.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.418+0000 7f6ddacbb640 1 -- 172.21.15.7:0/4037063666 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dd41a7080 con 0x7f6dd4101de0 2024-09-19T04:15:19.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.419+0000 7f6ddacbb640 1 -- 172.21.15.7:0/4037063666 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dd41021c0 con 0x7f6dd4101de0 2024-09-19T04:15:19.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.420+0000 7f6dd1ffb640 1 -- 172.21.15.7:0/4037063666 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f6dc80079b0 con 0x7f6dd4101de0 2024-09-19T04:15:19.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.421+0000 7f6dd1ffb640 1 --2- 172.21.15.7:0/4037063666 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6dc40a32c0 0x7f6dc40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:19.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.421+0000 7f6dd3fff640 1 --2- 172.21.15.7:0/4037063666 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6dc40a32c0 0x7f6dc40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:19.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.421+0000 7f6dd1ffb640 1 -- 172.21.15.7:0/4037063666 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f6dc80cfc40 con 0x7f6dd4101de0 2024-09-19T04:15:19.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.422+0000 7f6dd3fff640 1 --2- 172.21.15.7:0/4037063666 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6dc40a32c0 0x7f6dc40a5780 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4075f80 tx=0x7f6dc000c4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:19.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.426+0000 7f6dd1ffb640 1 -- 172.21.15.7:0/4037063666 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6dc8014030 con 0x7f6dd4101de0 2024-09-19T04:15:19.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.630+0000 7f6ddacbb640 1 -- 172.21.15.7:0/4037063666 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f6dd4062630 con 0x7f6dc40a32c0 2024-09-19T04:15:19.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.658+0000 7f6dd1ffb640 1 -- 172.21.15.7:0/4037063666 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6dd4062630 con 0x7f6dc40a32c0 2024-09-19T04:15:19.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.660+0000 7f6ddacbb640 1 -- 172.21.15.7:0/4037063666 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6dc40a32c0 msgr2=0x7f6dc40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:19.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.660+0000 7f6ddacbb640 1 --2- 172.21.15.7:0/4037063666 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6dc40a32c0 0x7f6dc40a5780 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4075f80 tx=0x7f6dc000c4a0 comp rx=0 tx=0).stop 2024-09-19T04:15:19.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.660+0000 7f6ddacbb640 1 -- 172.21.15.7:0/4037063666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6dd4101de0 msgr2=0x7f6dd40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:19.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.660+0000 7f6ddacbb640 1 --2- 172.21.15.7:0/4037063666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6dd4101de0 0x7f6dd40744f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800c890 tx=0x7f6dc800cd50 comp rx=0 tx=0).stop 2024-09-19T04:15:19.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.660+0000 7f6ddacbb640 1 -- 172.21.15.7:0/4037063666 shutdown_connections 2024-09-19T04:15:19.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.660+0000 7f6ddacbb640 1 --2- 172.21.15.7:0/4037063666 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6dc40a32c0 0x7f6dc40a5780 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:19.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.660+0000 7f6ddacbb640 1 --2- 172.21.15.7:0/4037063666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6dd4106f10 0x7f6dd4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:19.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.660+0000 7f6ddacbb640 1 --2- 172.21.15.7:0/4037063666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dd4102790 0x7f6dd4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:19.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.660+0000 7f6ddacbb640 1 --2- 172.21.15.7:0/4037063666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6dd4101de0 0x7f6dd40744f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:19.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.660+0000 7f6ddacbb640 1 -- 172.21.15.7:0/4037063666 >> 172.21.15.7:0/4037063666 conn(0x7f6dd40fd8c0 msgr2=0x7f6dd40febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:19.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.660+0000 7f6ddacbb640 1 -- 172.21.15.7:0/4037063666 shutdown_connections 2024-09-19T04:15:19.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:19.660+0000 7f6ddacbb640 1 -- 172.21.15.7:0/4037063666 wait complete. 2024-09-19T04:15:20.127 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:15:19 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:15:19.635+0000 7fd27aea6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:15:20.127 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:15:19 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:15:19.635+0000 7fd27aea6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:15:20.127 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:15:19 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:15:19.635+0000 7fd27aea6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:15:20.127 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:15:19 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:15:19.635+0000 7fd27aea6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:15:20.128 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:15:19 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:15:19.635+0000 7fd27aea6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:15:20.389 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-19T04:15:20.650 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:21.059 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:20 smithi007 ceph-mon[31360]: pgmap v303: 129 pgs: 129 active+clean; 586 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3.8 KiB/s wr, 14 op/s 2024-09-19T04:15:21.059 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:20 smithi007 ceph-mon[31360]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:15:21.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.145+0000 7f46befdd640 1 -- 172.21.15.7:0/1930987436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46b8103660 msgr2=0x7f46b810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:21.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.145+0000 7f46befdd640 1 --2- 172.21.15.7:0/1930987436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46b8103660 0x7f46b810bb50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f46a4009900 tx=0x7f46a402a480 comp rx=0 tx=0).stop 2024-09-19T04:15:21.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.145+0000 7f46befdd640 1 -- 172.21.15.7:0/1930987436 shutdown_connections 2024-09-19T04:15:21.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.145+0000 7f46befdd640 1 --2- 172.21.15.7:0/1930987436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46b810c170 0x7f46b810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:21.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.145+0000 7f46befdd640 1 --2- 172.21.15.7:0/1930987436 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46b8103660 0x7f46b810bb50 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:21.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.145+0000 7f46befdd640 1 --2- 172.21.15.7:0/1930987436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46b8102d40 0x7f46b8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:21.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.145+0000 7f46befdd640 1 -- 172.21.15.7:0/1930987436 >> 172.21.15.7:0/1930987436 conn(0x7f46b80fc7a0 msgr2=0x7f46b80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:21.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.145+0000 7f46befdd640 1 -- 172.21.15.7:0/1930987436 shutdown_connections 2024-09-19T04:15:21.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.145+0000 7f46befdd640 1 -- 172.21.15.7:0/1930987436 wait complete. 2024-09-19T04:15:21.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.146+0000 7f46befdd640 1 Processor -- start 2024-09-19T04:15:21.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.146+0000 7f46befdd640 1 -- start start 2024-09-19T04:15:21.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.146+0000 7f46befdd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46b8102d40 0x7f46b8198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:21.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.146+0000 7f46befdd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46b8103660 0x7f46b8198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:21.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.146+0000 7f46befdd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46b810c170 0x7f46b819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:21.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.146+0000 7f46befdd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f46b8111f70 con 0x7f46b8102d40 2024-09-19T04:15:21.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.146+0000 7f46befdd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f46b8111df0 con 0x7f46b8103660 2024-09-19T04:15:21.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.146+0000 7f46befdd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f46b81120f0 con 0x7f46b810c170 2024-09-19T04:15:21.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.146+0000 7f46bcd79640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46b8102d40 0x7f46b8198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:21.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.146+0000 7f46bcd79640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46b8102d40 0x7f46b8198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43764/0 (socket says 172.21.15.7:43764) 2024-09-19T04:15:21.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.146+0000 7f46bcd79640 1 -- 172.21.15.7:0/797078143 learned_addr learned my addr 172.21.15.7:0/797078143 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:21.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.146+0000 7f46b7fff640 1 --2- 172.21.15.7:0/797078143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46b8103660 0x7f46b8198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:21.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.146+0000 7f46bd57a640 1 --2- 172.21.15.7:0/797078143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46b810c170 0x7f46b819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:21.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.146+0000 7f46bcd79640 1 -- 172.21.15.7:0/797078143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46b810c170 msgr2=0x7f46b819cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.146+0000 7f46bcd79640 1 --2- 172.21.15.7:0/797078143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46b810c170 0x7f46b819cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.146+0000 7f46bcd79640 1 -- 172.21.15.7:0/797078143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46b8103660 msgr2=0x7f46b8198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.146+0000 7f46bcd79640 1 --2- 172.21.15.7:0/797078143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46b8103660 0x7f46b8198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.146+0000 7f46bcd79640 1 -- 172.21.15.7:0/797078143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b819d3e0 con 0x7f46b8102d40 2024-09-19T04:15:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.147+0000 7f46bd57a640 1 --2- 172.21.15.7:0/797078143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46b810c170 0x7f46b819cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:15:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.147+0000 7f46bcd79640 1 --2- 172.21.15.7:0/797078143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46b8102d40 0x7f46b8198430 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f46ac00d950 tx=0x7f46ac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.147+0000 7f46b5ffb640 1 -- 172.21.15.7:0/797078143 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ac017070 con 0x7f46b8102d40 2024-09-19T04:15:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.147+0000 7f46b5ffb640 1 -- 172.21.15.7:0/797078143 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46ac009c30 con 0x7f46b8102d40 2024-09-19T04:15:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.147+0000 7f46befdd640 1 -- 172.21.15.7:0/797078143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b819d6d0 con 0x7f46b8102d40 2024-09-19T04:15:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.147+0000 7f46b5ffb640 1 -- 172.21.15.7:0/797078143 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ac00f6b0 con 0x7f46b8102d40 2024-09-19T04:15:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.147+0000 7f46befdd640 1 -- 172.21.15.7:0/797078143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b81a4fb0 con 0x7f46b8102d40 2024-09-19T04:15:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.148+0000 7f46befdd640 1 -- 172.21.15.7:0/797078143 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46b8103120 con 0x7f46b8102d40 2024-09-19T04:15:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.149+0000 7f46b5ffb640 1 -- 172.21.15.7:0/797078143 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f46ac0109d0 con 0x7f46b8102d40 2024-09-19T04:15:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.150+0000 7f46b5ffb640 1 --2- 172.21.15.7:0/797078143 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f46a80a3240 0x7f46a80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:21.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.150+0000 7f46b7fff640 1 --2- 172.21.15.7:0/797078143 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f46a80a3240 0x7f46a80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:21.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.150+0000 7f46b5ffb640 1 -- 172.21.15.7:0/797078143 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f46ac0cf800 con 0x7f46b8102d40 2024-09-19T04:15:21.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.151+0000 7f46b7fff640 1 --2- 172.21.15.7:0/797078143 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f46a80a3240 0x7f46a80a5700 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f46a4009230 tx=0x7f46a40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:21.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.154+0000 7f46b5ffb640 1 -- 172.21.15.7:0/797078143 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f46ac009de0 con 0x7f46b8102d40 2024-09-19T04:15:21.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:20 smithi102 ceph-mon[35446]: pgmap v303: 129 pgs: 129 active+clean; 586 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3.8 KiB/s wr, 14 op/s 2024-09-19T04:15:21.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:20 smithi102 ceph-mon[35446]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:15:21.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:20 smithi092 ceph-mon[34940]: pgmap v303: 129 pgs: 129 active+clean; 586 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3.8 KiB/s wr, 14 op/s 2024-09-19T04:15:21.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:20 smithi092 ceph-mon[34940]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:15:21.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.361+0000 7f46befdd640 1 -- 172.21.15.7:0/797078143 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f46b8062630 con 0x7f46a80a3240 2024-09-19T04:15:21.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.387+0000 7f46b5ffb640 1 -- 172.21.15.7:0/797078143 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f46b8062630 con 0x7f46a80a3240 2024-09-19T04:15:21.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.389+0000 7f46befdd640 1 -- 172.21.15.7:0/797078143 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f46a80a3240 msgr2=0x7f46a80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:21.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.389+0000 7f46befdd640 1 --2- 172.21.15.7:0/797078143 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f46a80a3240 0x7f46a80a5700 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f46a4009230 tx=0x7f46a40058d0 comp rx=0 tx=0).stop 2024-09-19T04:15:21.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.389+0000 7f46befdd640 1 -- 172.21.15.7:0/797078143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46b8102d40 msgr2=0x7f46b8198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:21.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.389+0000 7f46befdd640 1 --2- 172.21.15.7:0/797078143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46b8102d40 0x7f46b8198430 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f46ac00d950 tx=0x7f46ac00de10 comp rx=0 tx=0).stop 2024-09-19T04:15:21.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.389+0000 7f46befdd640 1 -- 172.21.15.7:0/797078143 shutdown_connections 2024-09-19T04:15:21.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.389+0000 7f46befdd640 1 --2- 172.21.15.7:0/797078143 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f46a80a3240 0x7f46a80a5700 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:21.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.389+0000 7f46befdd640 1 --2- 172.21.15.7:0/797078143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46b810c170 0x7f46b819cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:21.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.389+0000 7f46befdd640 1 --2- 172.21.15.7:0/797078143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46b8103660 0x7f46b8198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:21.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.389+0000 7f46befdd640 1 --2- 172.21.15.7:0/797078143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f46b8102d40 0x7f46b8198430 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:21.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.389+0000 7f46befdd640 1 -- 172.21.15.7:0/797078143 >> 172.21.15.7:0/797078143 conn(0x7f46b80fc7a0 msgr2=0x7f46b80fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:21.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.389+0000 7f46befdd640 1 -- 172.21.15.7:0/797078143 shutdown_connections 2024-09-19T04:15:21.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:21.389+0000 7f46befdd640 1 -- 172.21.15.7:0/797078143 wait complete. 2024-09-19T04:15:22.113 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-19T04:15:22.373 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:22.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.818+0000 7fe969922640 1 -- 172.21.15.7:0/3171970635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe964102790 msgr2=0x7fe9641067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:22.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.818+0000 7fe969922640 1 --2- 172.21.15.7:0/3171970635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe964102790 0x7fe9641067e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe94c009900 tx=0x7fe94c02a410 comp rx=0 tx=0).stop 2024-09-19T04:15:22.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.818+0000 7fe969922640 1 -- 172.21.15.7:0/3171970635 shutdown_connections 2024-09-19T04:15:22.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.818+0000 7fe969922640 1 --2- 172.21.15.7:0/3171970635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe964106f10 0x7fe96410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:22.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.818+0000 7fe969922640 1 --2- 172.21.15.7:0/3171970635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe964102790 0x7fe9641067e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:22.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.818+0000 7fe969922640 1 --2- 172.21.15.7:0/3171970635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe964101de0 0x7fe9641021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.818+0000 7fe969922640 1 -- 172.21.15.7:0/3171970635 >> 172.21.15.7:0/3171970635 conn(0x7fe9640fd8c0 msgr2=0x7fe9640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.818+0000 7fe969922640 1 -- 172.21.15.7:0/3171970635 shutdown_connections 2024-09-19T04:15:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.818+0000 7fe969922640 1 -- 172.21.15.7:0/3171970635 wait complete. 2024-09-19T04:15:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.819+0000 7fe969922640 1 Processor -- start 2024-09-19T04:15:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.819+0000 7fe969922640 1 -- start start 2024-09-19T04:15:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.819+0000 7fe969922640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe964101de0 0x7fe9640744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.819+0000 7fe969922640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe964102790 0x7fe964074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.819+0000 7fe969922640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe964106f10 0x7fe964074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.819+0000 7fe969922640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe964111fb0 con 0x7fe964101de0 2024-09-19T04:15:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.819+0000 7fe969922640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe964111e30 con 0x7fe964102790 2024-09-19T04:15:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.819+0000 7fe969922640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe964112130 con 0x7fe964106f10 2024-09-19T04:15:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.819+0000 7fe962ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe964101de0 0x7fe9640744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:22.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.819+0000 7fe962ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe964101de0 0x7fe9640744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43782/0 (socket says 172.21.15.7:43782) 2024-09-19T04:15:22.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.819+0000 7fe962ffd640 1 -- 172.21.15.7:0/779798313 learned_addr learned my addr 172.21.15.7:0/779798313 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:22.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.819+0000 7fe9637fe640 1 --2- 172.21.15.7:0/779798313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe964106f10 0x7fe964074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:22.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.819+0000 7fe95bfff640 1 --2- 172.21.15.7:0/779798313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe964102790 0x7fe964074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:22.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.819+0000 7fe962ffd640 1 -- 172.21.15.7:0/779798313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe964106f10 msgr2=0x7fe964074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:22.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.819+0000 7fe962ffd640 1 --2- 172.21.15.7:0/779798313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe964106f10 0x7fe964074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:22.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.819+0000 7fe962ffd640 1 -- 172.21.15.7:0/779798313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe964102790 msgr2=0x7fe964074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:22.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.819+0000 7fe962ffd640 1 --2- 172.21.15.7:0/779798313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe964102790 0x7fe964074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:22.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.819+0000 7fe962ffd640 1 -- 172.21.15.7:0/779798313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9641a6950 con 0x7fe964101de0 2024-09-19T04:15:22.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.819+0000 7fe95bfff640 1 --2- 172.21.15.7:0/779798313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe964102790 0x7fe964074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:15:22.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.819+0000 7fe9637fe640 1 --2- 172.21.15.7:0/779798313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe964106f10 0x7fe964074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:15:22.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.819+0000 7fe962ffd640 1 --2- 172.21.15.7:0/779798313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe964101de0 0x7fe9640744f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe95400d770 tx=0x7fe95400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:22.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.820+0000 7fe968920640 1 -- 172.21.15.7:0/779798313 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe954017070 con 0x7fe964101de0 2024-09-19T04:15:22.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.820+0000 7fe968920640 1 -- 172.21.15.7:0/779798313 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe954005500 con 0x7fe964101de0 2024-09-19T04:15:22.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.820+0000 7fe969922640 1 -- 172.21.15.7:0/779798313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9641a6c40 con 0x7fe964101de0 2024-09-19T04:15:22.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.820+0000 7fe968920640 1 -- 172.21.15.7:0/779798313 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe954004e00 con 0x7fe964101de0 2024-09-19T04:15:22.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.820+0000 7fe969922640 1 -- 172.21.15.7:0/779798313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9641a7130 con 0x7fe964101de0 2024-09-19T04:15:22.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.821+0000 7fe969922640 1 -- 172.21.15.7:0/779798313 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9641021c0 con 0x7fe964101de0 2024-09-19T04:15:22.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.822+0000 7fe968920640 1 -- 172.21.15.7:0/779798313 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fe954004fa0 con 0x7fe964101de0 2024-09-19T04:15:22.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.823+0000 7fe968920640 1 --2- 172.21.15.7:0/779798313 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe9500a32d0 0x7fe9500a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:22.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.823+0000 7fe95bfff640 1 --2- 172.21.15.7:0/779798313 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe9500a32d0 0x7fe9500a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:22.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.823+0000 7fe968920640 1 -- 172.21.15.7:0/779798313 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fe9540cf820 con 0x7fe964101de0 2024-09-19T04:15:22.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.823+0000 7fe95bfff640 1 --2- 172.21.15.7:0/779798313 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe9500a32d0 0x7fe9500a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe94c000c00 tx=0x7fe94c032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:22.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:22.827+0000 7fe968920640 1 -- 172.21.15.7:0/779798313 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe95409c140 con 0x7fe964101de0 2024-09-19T04:15:23.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:23.032+0000 7fe969922640 1 -- 172.21.15.7:0/779798313 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fe964062630 con 0x7fe9500a32d0 2024-09-19T04:15:23.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:22 smithi007 ceph-mon[31360]: pgmap v304: 129 pgs: 129 active+clean; 587 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4.0 KiB/s wr, 15 op/s 2024-09-19T04:15:23.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:22 smithi007 ceph-mon[31360]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:15:23.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:22 smithi007 ceph-mon[31360]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T04:15:23.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:23.037+0000 7fe968920640 1 -- 172.21.15.7:0/779798313 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fe964062630 con 0x7fe9500a32d0 2024-09-19T04:15:23.039 INFO:teuthology.orchestra.run.smithi007.stdout:/volumes/qa/sv_0/63121211-772f-4d5a-a041-bd7ff970e217 2024-09-19T04:15:23.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:23.039+0000 7fe969922640 1 -- 172.21.15.7:0/779798313 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe9500a32d0 msgr2=0x7fe9500a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:23.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:23.039+0000 7fe969922640 1 --2- 172.21.15.7:0/779798313 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe9500a32d0 0x7fe9500a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe94c000c00 tx=0x7fe94c032c70 comp rx=0 tx=0).stop 2024-09-19T04:15:23.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:23.039+0000 7fe969922640 1 -- 172.21.15.7:0/779798313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe964101de0 msgr2=0x7fe9640744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:23.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:23.039+0000 7fe969922640 1 --2- 172.21.15.7:0/779798313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe964101de0 0x7fe9640744f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe95400d770 tx=0x7fe95400dc30 comp rx=0 tx=0).stop 2024-09-19T04:15:23.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:23.040+0000 7fe969922640 1 -- 172.21.15.7:0/779798313 shutdown_connections 2024-09-19T04:15:23.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:23.040+0000 7fe969922640 1 --2- 172.21.15.7:0/779798313 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe9500a32d0 0x7fe9500a5790 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:23.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:23.040+0000 7fe969922640 1 --2- 172.21.15.7:0/779798313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe964106f10 0x7fe964074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:23.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:23.040+0000 7fe969922640 1 --2- 172.21.15.7:0/779798313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe964102790 0x7fe964074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:23.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:23.040+0000 7fe969922640 1 --2- 172.21.15.7:0/779798313 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe964101de0 0x7fe9640744f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:23.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:23.040+0000 7fe969922640 1 -- 172.21.15.7:0/779798313 >> 172.21.15.7:0/779798313 conn(0x7fe9640fd8c0 msgr2=0x7fe9640fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:23.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:23.040+0000 7fe969922640 1 -- 172.21.15.7:0/779798313 shutdown_connections 2024-09-19T04:15:23.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:23.040+0000 7fe969922640 1 -- 172.21.15.7:0/779798313 wait complete. 2024-09-19T04:15:23.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:22 smithi102 ceph-mon[35446]: pgmap v304: 129 pgs: 129 active+clean; 587 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4.0 KiB/s wr, 15 op/s 2024-09-19T04:15:23.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:22 smithi102 ceph-mon[35446]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:15:23.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:22 smithi102 ceph-mon[35446]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T04:15:23.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:22 smithi092 ceph-mon[34940]: pgmap v304: 129 pgs: 129 active+clean; 587 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4.0 KiB/s wr, 15 op/s 2024-09-19T04:15:23.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:22 smithi092 ceph-mon[34940]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:15:23.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:22 smithi092 ceph-mon[34940]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T04:15:23.701 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-19T04:15:23.962 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:24.083 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:23 smithi007 ceph-mon[31360]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:15:24.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:23 smithi102 ceph-mon[35446]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:15:24.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:23 smithi092 ceph-mon[34940]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:15:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.467+0000 7f6a4ddc1640 1 -- 172.21.15.7:0/712740556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a48100a70 msgr2=0x7f6a4810ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.467+0000 7f6a4ddc1640 1 --2- 172.21.15.7:0/712740556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a48100a70 0x7f6a4810ea60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009ca0 tx=0x7f6a4002a8c0 comp rx=0 tx=0).stop 2024-09-19T04:15:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.467+0000 7f6a4ddc1640 1 -- 172.21.15.7:0/712740556 shutdown_connections 2024-09-19T04:15:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.467+0000 7f6a4ddc1640 1 --2- 172.21.15.7:0/712740556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a48100a70 0x7f6a4810ea60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.467+0000 7f6a4ddc1640 1 --2- 172.21.15.7:0/712740556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a481000d0 0x7f6a48100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.467+0000 7f6a4ddc1640 1 --2- 172.21.15.7:0/712740556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a48106ba0 0x7f6a48106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.467+0000 7f6a4ddc1640 1 -- 172.21.15.7:0/712740556 >> 172.21.15.7:0/712740556 conn(0x7f6a48077210 msgr2=0x7f6a480fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.467+0000 7f6a4ddc1640 1 -- 172.21.15.7:0/712740556 shutdown_connections 2024-09-19T04:15:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.467+0000 7f6a4ddc1640 1 -- 172.21.15.7:0/712740556 wait complete. 2024-09-19T04:15:24.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.468+0000 7f6a4ddc1640 1 Processor -- start 2024-09-19T04:15:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.468+0000 7f6a4ddc1640 1 -- start start 2024-09-19T04:15:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.468+0000 7f6a4ddc1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a481000d0 0x7f6a481984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.468+0000 7f6a4ddc1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a48100a70 0x7f6a48198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.468+0000 7f6a4ddc1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a48106ba0 0x7f6a4819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.468+0000 7f6a4ddc1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6a48112090 con 0x7f6a481000d0 2024-09-19T04:15:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.468+0000 7f6a4ddc1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6a48111f10 con 0x7f6a48100a70 2024-09-19T04:15:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.468+0000 7f6a4ddc1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6a48112210 con 0x7f6a48106ba0 2024-09-19T04:15:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.468+0000 7f6a477fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a481000d0 0x7f6a481984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.468+0000 7f6a477fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a481000d0 0x7f6a481984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43792/0 (socket says 172.21.15.7:43792) 2024-09-19T04:15:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.468+0000 7f6a477fe640 1 -- 172.21.15.7:0/1888438306 learned_addr learned my addr 172.21.15.7:0/1888438306 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.468+0000 7f6a46ffd640 1 --2- 172.21.15.7:0/1888438306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a48100a70 0x7f6a48198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:24.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.468+0000 7f6a47fff640 1 --2- 172.21.15.7:0/1888438306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a48106ba0 0x7f6a4819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.469+0000 7f6a477fe640 1 -- 172.21.15.7:0/1888438306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a48106ba0 msgr2=0x7f6a4819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.469+0000 7f6a477fe640 1 --2- 172.21.15.7:0/1888438306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a48106ba0 0x7f6a4819cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.469+0000 7f6a477fe640 1 -- 172.21.15.7:0/1888438306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a48100a70 msgr2=0x7f6a48198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.469+0000 7f6a477fe640 1 --2- 172.21.15.7:0/1888438306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a48100a70 0x7f6a48198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.469+0000 7f6a477fe640 1 -- 172.21.15.7:0/1888438306 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a4819d480 con 0x7f6a481000d0 2024-09-19T04:15:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.469+0000 7f6a46ffd640 1 --2- 172.21.15.7:0/1888438306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a48100a70 0x7f6a48198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:15:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.469+0000 7f6a47fff640 1 --2- 172.21.15.7:0/1888438306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a48106ba0 0x7f6a4819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:15:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.469+0000 7f6a477fe640 1 --2- 172.21.15.7:0/1888438306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a481000d0 0x7f6a481984d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6a3800e9f0 tx=0x7f6a3800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.469+0000 7f6a44ff9640 1 -- 172.21.15.7:0/1888438306 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3800cd80 con 0x7f6a481000d0 2024-09-19T04:15:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.469+0000 7f6a44ff9640 1 -- 172.21.15.7:0/1888438306 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a38010910 con 0x7f6a481000d0 2024-09-19T04:15:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.469+0000 7f6a4ddc1640 1 -- 172.21.15.7:0/1888438306 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a4819d770 con 0x7f6a481000d0 2024-09-19T04:15:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.469+0000 7f6a44ff9640 1 -- 172.21.15.7:0/1888438306 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a38018990 con 0x7f6a481000d0 2024-09-19T04:15:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.469+0000 7f6a4ddc1640 1 -- 172.21.15.7:0/1888438306 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a481a5050 con 0x7f6a481000d0 2024-09-19T04:15:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.470+0000 7f6a4ddc1640 1 -- 172.21.15.7:0/1888438306 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a48100530 con 0x7f6a481000d0 2024-09-19T04:15:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.471+0000 7f6a44ff9640 1 -- 172.21.15.7:0/1888438306 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f6a38010ac0 con 0x7f6a481000d0 2024-09-19T04:15:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.472+0000 7f6a44ff9640 1 --2- 172.21.15.7:0/1888438306 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6a300a32d0 0x7f6a300a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.472+0000 7f6a44ff9640 1 -- 172.21.15.7:0/1888438306 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f6a380d00d0 con 0x7f6a481000d0 2024-09-19T04:15:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.472+0000 7f6a46ffd640 1 --2- 172.21.15.7:0/1888438306 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6a300a32d0 0x7f6a300a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.472+0000 7f6a46ffd640 1 --2- 172.21.15.7:0/1888438306 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6a300a32d0 0x7f6a300a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6a480ff7a0 tx=0x7f6a3c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:24.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.476+0000 7f6a44ff9640 1 -- 172.21.15.7:0/1888438306 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6a3809ca50 con 0x7f6a481000d0 2024-09-19T04:15:24.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.681+0000 7f6a4ddc1640 1 -- 172.21.15.7:0/1888438306 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f6a4810a110 con 0x7f6a300a32d0 2024-09-19T04:15:24.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.706+0000 7f6a44ff9640 1 -- 172.21.15.7:0/1888438306 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6a4810a110 con 0x7f6a300a32d0 2024-09-19T04:15:24.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.708+0000 7f6a4ddc1640 1 -- 172.21.15.7:0/1888438306 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6a300a32d0 msgr2=0x7f6a300a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:24.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.708+0000 7f6a4ddc1640 1 --2- 172.21.15.7:0/1888438306 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6a300a32d0 0x7f6a300a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6a480ff7a0 tx=0x7f6a3c005f90 comp rx=0 tx=0).stop 2024-09-19T04:15:24.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.708+0000 7f6a4ddc1640 1 -- 172.21.15.7:0/1888438306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a481000d0 msgr2=0x7f6a481984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:24.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.708+0000 7f6a4ddc1640 1 --2- 172.21.15.7:0/1888438306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a481000d0 0x7f6a481984d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6a3800e9f0 tx=0x7f6a3800eeb0 comp rx=0 tx=0).stop 2024-09-19T04:15:24.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.708+0000 7f6a4ddc1640 1 -- 172.21.15.7:0/1888438306 shutdown_connections 2024-09-19T04:15:24.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.708+0000 7f6a4ddc1640 1 --2- 172.21.15.7:0/1888438306 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6a300a32d0 0x7f6a300a5790 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:24.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.708+0000 7f6a4ddc1640 1 --2- 172.21.15.7:0/1888438306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a48106ba0 0x7f6a4819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:24.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.708+0000 7f6a4ddc1640 1 --2- 172.21.15.7:0/1888438306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a48100a70 0x7f6a48198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:24.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.708+0000 7f6a4ddc1640 1 --2- 172.21.15.7:0/1888438306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a481000d0 0x7f6a481984d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:24.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.708+0000 7f6a4ddc1640 1 -- 172.21.15.7:0/1888438306 >> 172.21.15.7:0/1888438306 conn(0x7f6a48077210 msgr2=0x7f6a48104c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:24.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.708+0000 7f6a4ddc1640 1 -- 172.21.15.7:0/1888438306 shutdown_connections 2024-09-19T04:15:24.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:24.708+0000 7f6a4ddc1640 1 -- 172.21.15.7:0/1888438306 wait complete. 2024-09-19T04:15:25.107 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:24 smithi007 ceph-mon[31360]: pgmap v305: 129 pgs: 129 active+clean; 611 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 6.4 KiB/s wr, 20 op/s 2024-09-19T04:15:25.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:24 smithi102 ceph-mon[35446]: pgmap v305: 129 pgs: 129 active+clean; 611 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 6.4 KiB/s wr, 20 op/s 2024-09-19T04:15:25.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:24 smithi092 ceph-mon[34940]: pgmap v305: 129 pgs: 129 active+clean; 611 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 6.4 KiB/s wr, 20 op/s 2024-09-19T04:15:25.319 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-19T04:15:25.577 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:25.958 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:25 smithi007 ceph-mon[31360]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:15:26.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.044+0000 7fa630fa8640 1 -- 172.21.15.7:0/851532411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa62c108160 msgr2=0x7fa62c10eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:26.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.044+0000 7fa630fa8640 1 --2- 172.21.15.7:0/851532411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa62c108160 0x7fa62c10eb00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa624009cd0 tx=0x7fa62402a910 comp rx=0 tx=0).stop 2024-09-19T04:15:26.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.044+0000 7fa630fa8640 1 -- 172.21.15.7:0/851532411 shutdown_connections 2024-09-19T04:15:26.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.044+0000 7fa630fa8640 1 --2- 172.21.15.7:0/851532411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa62c108160 0x7fa62c10eb00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:26.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.044+0000 7fa630fa8640 1 --2- 172.21.15.7:0/851532411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa62c101290 0x7fa62c107a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:26.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.044+0000 7fa630fa8640 1 --2- 172.21.15.7:0/851532411 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa62c1008e0 0x7fa62c100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:26.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.044+0000 7fa630fa8640 1 -- 172.21.15.7:0/851532411 >> 172.21.15.7:0/851532411 conn(0x7fa62c077210 msgr2=0x7fa62c077620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:26.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.044+0000 7fa630fa8640 1 -- 172.21.15.7:0/851532411 shutdown_connections 2024-09-19T04:15:26.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.044+0000 7fa630fa8640 1 -- 172.21.15.7:0/851532411 wait complete. 2024-09-19T04:15:26.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.045+0000 7fa630fa8640 1 Processor -- start 2024-09-19T04:15:26.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.045+0000 7fa630fa8640 1 -- start start 2024-09-19T04:15:26.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.045+0000 7fa630fa8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa62c1008e0 0x7fa62c19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:26.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.045+0000 7fa630fa8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa62c101290 0x7fa62c19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:26.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.045+0000 7fa630fa8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa62c108160 0x7fa62c19ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:26.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.045+0000 7fa630fa8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa62c112010 con 0x7fa62c101290 2024-09-19T04:15:26.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.045+0000 7fa630fa8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa62c111e90 con 0x7fa62c1008e0 2024-09-19T04:15:26.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.045+0000 7fa630fa8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa62c112190 con 0x7fa62c108160 2024-09-19T04:15:26.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.045+0000 7fa629d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa62c101290 0x7fa62c19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:26.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.045+0000 7fa629d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa62c101290 0x7fa62c19abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43804/0 (socket says 172.21.15.7:43804) 2024-09-19T04:15:26.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.045+0000 7fa629d9b640 1 -- 172.21.15.7:0/4188235795 learned_addr learned my addr 172.21.15.7:0/4188235795 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:26.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.045+0000 7fa62ad9d640 1 --2- 172.21.15.7:0/4188235795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa62c108160 0x7fa62c19ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:26.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.046+0000 7fa62a59c640 1 --2- 172.21.15.7:0/4188235795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa62c1008e0 0x7fa62c19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:26.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.046+0000 7fa629d9b640 1 -- 172.21.15.7:0/4188235795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa62c108160 msgr2=0x7fa62c19ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:26.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.046+0000 7fa629d9b640 1 --2- 172.21.15.7:0/4188235795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa62c108160 0x7fa62c19ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:26.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.046+0000 7fa629d9b640 1 -- 172.21.15.7:0/4188235795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa62c1008e0 msgr2=0x7fa62c19a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:26.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.046+0000 7fa629d9b640 1 --2- 172.21.15.7:0/4188235795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa62c1008e0 0x7fa62c19a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:26.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.046+0000 7fa629d9b640 1 -- 172.21.15.7:0/4188235795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa62c19f660 con 0x7fa62c101290 2024-09-19T04:15:26.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.046+0000 7fa62a59c640 1 --2- 172.21.15.7:0/4188235795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa62c1008e0 0x7fa62c19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:15:26.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.046+0000 7fa629d9b640 1 --2- 172.21.15.7:0/4188235795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa62c101290 0x7fa62c19abf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa62000b430 tx=0x7fa62000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:26.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.046+0000 7fa61b7fe640 1 -- 172.21.15.7:0/4188235795 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa620015020 con 0x7fa62c101290 2024-09-19T04:15:26.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.046+0000 7fa61b7fe640 1 -- 172.21.15.7:0/4188235795 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa620011d10 con 0x7fa62c101290 2024-09-19T04:15:26.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.046+0000 7fa630fa8640 1 -- 172.21.15.7:0/4188235795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa62c19f950 con 0x7fa62c101290 2024-09-19T04:15:26.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.046+0000 7fa61b7fe640 1 -- 172.21.15.7:0/4188235795 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa62000f2e0 con 0x7fa62c101290 2024-09-19T04:15:26.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.046+0000 7fa630fa8640 1 -- 172.21.15.7:0/4188235795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa62c1a7230 con 0x7fa62c101290 2024-09-19T04:15:26.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.047+0000 7fa630fa8640 1 -- 172.21.15.7:0/4188235795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa62c100cc0 con 0x7fa62c101290 2024-09-19T04:15:26.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.048+0000 7fa61b7fe640 1 -- 172.21.15.7:0/4188235795 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fa620018020 con 0x7fa62c101290 2024-09-19T04:15:26.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.049+0000 7fa61b7fe640 1 --2- 172.21.15.7:0/4188235795 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa6140a32d0 0x7fa6140a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:26.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.049+0000 7fa61b7fe640 1 -- 172.21.15.7:0/4188235795 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fa6200cf440 con 0x7fa62c101290 2024-09-19T04:15:26.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.049+0000 7fa62a59c640 1 --2- 172.21.15.7:0/4188235795 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa6140a32d0 0x7fa6140a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:26.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.049+0000 7fa62a59c640 1 --2- 172.21.15.7:0/4188235795 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa6140a32d0 0x7fa6140a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0058c0 tx=0x7fa61c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:26.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.053+0000 7fa61b7fe640 1 -- 172.21.15.7:0/4188235795 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa62001f020 con 0x7fa62c101290 2024-09-19T04:15:26.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:25 smithi102 ceph-mon[35446]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:15:26.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.259+0000 7fa630fa8640 1 -- 172.21.15.7:0/4188235795 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fa62c062630 con 0x7fa6140a32d0 2024-09-19T04:15:26.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.264+0000 7fa61b7fe640 1 -- 172.21.15.7:0/4188235795 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fa62c062630 con 0x7fa6140a32d0 2024-09-19T04:15:26.265 INFO:teuthology.orchestra.run.smithi007.stdout:/volumes/qa/sv_1/011e04cb-6eb6-42d8-ad92-600be877f3e7 2024-09-19T04:15:26.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.266+0000 7fa630fa8640 1 -- 172.21.15.7:0/4188235795 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa6140a32d0 msgr2=0x7fa6140a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:26.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.266+0000 7fa630fa8640 1 --2- 172.21.15.7:0/4188235795 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa6140a32d0 0x7fa6140a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0058c0 tx=0x7fa61c005850 comp rx=0 tx=0).stop 2024-09-19T04:15:26.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.266+0000 7fa630fa8640 1 -- 172.21.15.7:0/4188235795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa62c101290 msgr2=0x7fa62c19abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:26.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.266+0000 7fa630fa8640 1 --2- 172.21.15.7:0/4188235795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa62c101290 0x7fa62c19abf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa62000b430 tx=0x7fa62000b8f0 comp rx=0 tx=0).stop 2024-09-19T04:15:26.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.266+0000 7fa630fa8640 1 -- 172.21.15.7:0/4188235795 shutdown_connections 2024-09-19T04:15:26.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.266+0000 7fa630fa8640 1 --2- 172.21.15.7:0/4188235795 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa6140a32d0 0x7fa6140a5790 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:26.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.266+0000 7fa630fa8640 1 --2- 172.21.15.7:0/4188235795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa62c108160 0x7fa62c19ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:26.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.266+0000 7fa630fa8640 1 --2- 172.21.15.7:0/4188235795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa62c101290 0x7fa62c19abf0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:26.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.266+0000 7fa630fa8640 1 --2- 172.21.15.7:0/4188235795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa62c1008e0 0x7fa62c19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:26.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.266+0000 7fa630fa8640 1 -- 172.21.15.7:0/4188235795 >> 172.21.15.7:0/4188235795 conn(0x7fa62c077210 msgr2=0x7fa62c0ff9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:26.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.266+0000 7fa630fa8640 1 -- 172.21.15.7:0/4188235795 shutdown_connections 2024-09-19T04:15:26.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:26.266+0000 7fa630fa8640 1 -- 172.21.15.7:0/4188235795 wait complete. 2024-09-19T04:15:26.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:25 smithi092 ceph-mon[34940]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:15:26.938 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:26 smithi007 ceph-mon[31360]: pgmap v306: 129 pgs: 129 active+clean; 612 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.9 KiB/s wr, 22 op/s 2024-09-19T04:15:26.970 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:15:27.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:26 smithi102 ceph-mon[35446]: pgmap v306: 129 pgs: 129 active+clean; 612 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.9 KiB/s wr, 22 op/s 2024-09-19T04:15:27.236 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:27.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:26 smithi092 ceph-mon[34940]: pgmap v306: 129 pgs: 129 active+clean; 612 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.9 KiB/s wr, 22 op/s 2024-09-19T04:15:27.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.741+0000 7f05929e4640 1 -- 172.21.15.7:0/264901036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f058c106f10 msgr2=0x7f058c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:27.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.741+0000 7f05929e4640 1 --2- 172.21.15.7:0/264901036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f058c106f10 0x7f058c10ea90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0584009ca0 tx=0x7f058402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:15:27.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.741+0000 7f05929e4640 1 -- 172.21.15.7:0/264901036 shutdown_connections 2024-09-19T04:15:27.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.741+0000 7f05929e4640 1 --2- 172.21.15.7:0/264901036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f058c106f10 0x7f058c10ea90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:27.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.741+0000 7f05929e4640 1 --2- 172.21.15.7:0/264901036 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f058c102790 0x7f058c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:27.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.741+0000 7f05929e4640 1 --2- 172.21.15.7:0/264901036 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f058c101de0 0x7f058c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:27.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.741+0000 7f05929e4640 1 -- 172.21.15.7:0/264901036 >> 172.21.15.7:0/264901036 conn(0x7f058c0fd8c0 msgr2=0x7f058c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:27.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.741+0000 7f05929e4640 1 -- 172.21.15.7:0/264901036 shutdown_connections 2024-09-19T04:15:27.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.741+0000 7f05929e4640 1 -- 172.21.15.7:0/264901036 wait complete. 2024-09-19T04:15:27.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.741+0000 7f05929e4640 1 Processor -- start 2024-09-19T04:15:27.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.741+0000 7f05929e4640 1 -- start start 2024-09-19T04:15:27.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.742+0000 7f05929e4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f058c101de0 0x7f058c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:27.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.742+0000 7f05929e4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f058c102790 0x7f058c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:27.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.742+0000 7f05929e4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f058c106f10 0x7f058c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:27.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.742+0000 7f05929e4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f058c111f70 con 0x7f058c101de0 2024-09-19T04:15:27.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.742+0000 7f05929e4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f058c111df0 con 0x7f058c102790 2024-09-19T04:15:27.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.742+0000 7f05929e4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f058c1120f0 con 0x7f058c106f10 2024-09-19T04:15:27.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.742+0000 7f058bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f058c101de0 0x7f058c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:27.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.742+0000 7f058bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f058c101de0 0x7f058c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43630/0 (socket says 172.21.15.7:43630) 2024-09-19T04:15:27.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.742+0000 7f058bfff640 1 -- 172.21.15.7:0/1838525598 learned_addr learned my addr 172.21.15.7:0/1838525598 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:27.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.742+0000 7f0590f81640 1 --2- 172.21.15.7:0/1838525598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f058c106f10 0x7f058c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:27.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.742+0000 7f0583fff640 1 --2- 172.21.15.7:0/1838525598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f058c102790 0x7f058c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:27.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.742+0000 7f058bfff640 1 -- 172.21.15.7:0/1838525598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f058c106f10 msgr2=0x7f058c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:27.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.742+0000 7f058bfff640 1 --2- 172.21.15.7:0/1838525598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f058c106f10 0x7f058c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:27.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.742+0000 7f058bfff640 1 -- 172.21.15.7:0/1838525598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f058c102790 msgr2=0x7f058c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:27.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.742+0000 7f058bfff640 1 --2- 172.21.15.7:0/1838525598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f058c102790 0x7f058c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:27.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.742+0000 7f058bfff640 1 -- 172.21.15.7:0/1838525598 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f058c1a68b0 con 0x7f058c101de0 2024-09-19T04:15:27.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.742+0000 7f058bfff640 1 --2- 172.21.15.7:0/1838525598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f058c101de0 0x7f058c0744f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f057c00d770 tx=0x7f057c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:27.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.742+0000 7f0589ffb640 1 -- 172.21.15.7:0/1838525598 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c017070 con 0x7f058c101de0 2024-09-19T04:15:27.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.742+0000 7f05929e4640 1 -- 172.21.15.7:0/1838525598 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f058c1a6ba0 con 0x7f058c101de0 2024-09-19T04:15:27.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.742+0000 7f0589ffb640 1 -- 172.21.15.7:0/1838525598 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f057c005500 con 0x7f058c101de0 2024-09-19T04:15:27.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.742+0000 7f0589ffb640 1 -- 172.21.15.7:0/1838525598 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057c004e00 con 0x7f058c101de0 2024-09-19T04:15:27.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.743+0000 7f05929e4640 1 -- 172.21.15.7:0/1838525598 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f058c1a70e0 con 0x7f058c101de0 2024-09-19T04:15:27.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.743+0000 7f05929e4640 1 -- 172.21.15.7:0/1838525598 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f058c1021c0 con 0x7f058c101de0 2024-09-19T04:15:27.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.745+0000 7f0589ffb640 1 -- 172.21.15.7:0/1838525598 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f057c004fa0 con 0x7f058c101de0 2024-09-19T04:15:27.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.745+0000 7f0589ffb640 1 --2- 172.21.15.7:0/1838525598 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f05780a32d0 0x7f05780a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:27.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.746+0000 7f0583fff640 1 --2- 172.21.15.7:0/1838525598 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f05780a32d0 0x7f05780a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:27.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.746+0000 7f0589ffb640 1 -- 172.21.15.7:0/1838525598 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f057c0cfbd0 con 0x7f058c101de0 2024-09-19T04:15:27.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.746+0000 7f0583fff640 1 --2- 172.21.15.7:0/1838525598 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f05780a32d0 0x7f05780a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0574005d80 tx=0x7f0574005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:27.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.748+0000 7f0589ffb640 1 -- 172.21.15.7:0/1838525598 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f057c09c4f0 con 0x7f058c101de0 2024-09-19T04:15:27.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.961+0000 7f05929e4640 1 -- 172.21.15.7:0/1838525598 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f058c075a20 con 0x7f058c101de0 2024-09-19T04:15:27.962 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:27 smithi007 ceph-mon[31360]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:15:27.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.962+0000 7f0589ffb640 1 -- 172.21.15.7:0/1838525598 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11962 (secure 0 0 0) 0x7f057c09bdf0 con 0x7f058c101de0 2024-09-19T04:15:27.963 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:15:27.963 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"btime":"2024-09-19T04:15:17:816953+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:15:17.816938+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24496,"mds_2":24482,"mds_3":24478,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24506,24496,24482,24478,24472]},"id":1}]} 2024-09-19T04:15:27.964 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 27 2024-09-19T04:15:27.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.964+0000 7f05929e4640 1 -- 172.21.15.7:0/1838525598 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f05780a32d0 msgr2=0x7f05780a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:27.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.964+0000 7f05929e4640 1 --2- 172.21.15.7:0/1838525598 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f05780a32d0 0x7f05780a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0574005d80 tx=0x7f0574005c90 comp rx=0 tx=0).stop 2024-09-19T04:15:27.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.964+0000 7f05929e4640 1 -- 172.21.15.7:0/1838525598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f058c101de0 msgr2=0x7f058c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:27.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.964+0000 7f05929e4640 1 --2- 172.21.15.7:0/1838525598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f058c101de0 0x7f058c0744f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f057c00d770 tx=0x7f057c00dc30 comp rx=0 tx=0).stop 2024-09-19T04:15:27.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.964+0000 7f05929e4640 1 -- 172.21.15.7:0/1838525598 shutdown_connections 2024-09-19T04:15:27.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.964+0000 7f05929e4640 1 --2- 172.21.15.7:0/1838525598 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f05780a32d0 0x7f05780a5790 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:27.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.964+0000 7f05929e4640 1 --2- 172.21.15.7:0/1838525598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f058c106f10 0x7f058c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:27.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.964+0000 7f05929e4640 1 --2- 172.21.15.7:0/1838525598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f058c102790 0x7f058c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:27.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.964+0000 7f05929e4640 1 --2- 172.21.15.7:0/1838525598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f058c101de0 0x7f058c0744f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:27.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.964+0000 7f05929e4640 1 -- 172.21.15.7:0/1838525598 >> 172.21.15.7:0/1838525598 conn(0x7f058c0fd8c0 msgr2=0x7f058c0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:27.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.964+0000 7f05929e4640 1 -- 172.21.15.7:0/1838525598 shutdown_connections 2024-09-19T04:15:27.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:27.964+0000 7f05929e4640 1 -- 172.21.15.7:0/1838525598 wait complete. 2024-09-19T04:15:28.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:27 smithi102 ceph-mon[35446]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:15:28.198 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:27 smithi092 ceph-mon[34940]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:15:28.578 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:15:28.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:28 smithi102 ceph-mon[35446]: pgmap v307: 129 pgs: 129 active+clean; 612 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.2 KiB/s wr, 20 op/s 2024-09-19T04:15:28.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:28 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1838525598' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:15:28.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:28 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:15:29.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:28 smithi092 ceph-mon[34940]: pgmap v307: 129 pgs: 129 active+clean; 612 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.2 KiB/s wr, 20 op/s 2024-09-19T04:15:29.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:28 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1838525598' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:15:29.047 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:28 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:15:29.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:28 smithi007 ceph-mon[31360]: pgmap v307: 129 pgs: 129 active+clean; 612 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.2 KiB/s wr, 20 op/s 2024-09-19T04:15:29.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:28 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1838525598' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:15:29.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:28 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:15:29.400 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:29.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.872+0000 7fe135efa640 1 -- 172.21.15.7:0/1106872273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe130101de0 msgr2=0x7fe1301021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:29.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.872+0000 7fe135efa640 1 --2- 172.21.15.7:0/1106872273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe130101de0 0x7fe1301021c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe120009900 tx=0x7fe12002a410 comp rx=0 tx=0).stop 2024-09-19T04:15:29.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.872+0000 7fe135efa640 1 -- 172.21.15.7:0/1106872273 shutdown_connections 2024-09-19T04:15:29.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.872+0000 7fe135efa640 1 --2- 172.21.15.7:0/1106872273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe130106f10 0x7fe13010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:29.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.872+0000 7fe135efa640 1 --2- 172.21.15.7:0/1106872273 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe130102790 0x7fe1301067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:29.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.872+0000 7fe135efa640 1 --2- 172.21.15.7:0/1106872273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe130101de0 0x7fe1301021c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:29.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.872+0000 7fe135efa640 1 -- 172.21.15.7:0/1106872273 >> 172.21.15.7:0/1106872273 conn(0x7fe1300fd8c0 msgr2=0x7fe1300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:29.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.872+0000 7fe135efa640 1 -- 172.21.15.7:0/1106872273 shutdown_connections 2024-09-19T04:15:29.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.872+0000 7fe135efa640 1 -- 172.21.15.7:0/1106872273 wait complete. 2024-09-19T04:15:29.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.872+0000 7fe135efa640 1 Processor -- start 2024-09-19T04:15:29.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.872+0000 7fe135efa640 1 -- start start 2024-09-19T04:15:29.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.873+0000 7fe135efa640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe130101de0 0x7fe130198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:29.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.873+0000 7fe135efa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe130102790 0x7fe130198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:29.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.873+0000 7fe135efa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe130106f10 0x7fe13019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:29.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.873+0000 7fe135efa640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe130111f30 con 0x7fe130106f10 2024-09-19T04:15:29.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.873+0000 7fe135efa640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe130111db0 con 0x7fe130101de0 2024-09-19T04:15:29.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.873+0000 7fe135efa640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe1301120b0 con 0x7fe130102790 2024-09-19T04:15:29.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.873+0000 7fe12ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe130106f10 0x7fe13019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:29.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.873+0000 7fe12ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe130106f10 0x7fe13019cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43642/0 (socket says 172.21.15.7:43642) 2024-09-19T04:15:29.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.873+0000 7fe12effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe130102790 0x7fe130198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:29.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.873+0000 7fe12ffff640 1 -- 172.21.15.7:0/3534853844 learned_addr learned my addr 172.21.15.7:0/3534853844 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:29.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.873+0000 7fe12f7fe640 1 --2- 172.21.15.7:0/3534853844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe130101de0 0x7fe130198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:29.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.873+0000 7fe12ffff640 1 -- 172.21.15.7:0/3534853844 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe130102790 msgr2=0x7fe130198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:29.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.873+0000 7fe12ffff640 1 --2- 172.21.15.7:0/3534853844 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe130102790 0x7fe130198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:29.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.873+0000 7fe12ffff640 1 -- 172.21.15.7:0/3534853844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe130101de0 msgr2=0x7fe130198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:29.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.873+0000 7fe12ffff640 1 --2- 172.21.15.7:0/3534853844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe130101de0 0x7fe130198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:29.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.873+0000 7fe12ffff640 1 -- 172.21.15.7:0/3534853844 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe13019d4c0 con 0x7fe130106f10 2024-09-19T04:15:29.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.873+0000 7fe12ffff640 1 --2- 172.21.15.7:0/3534853844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe130106f10 0x7fe13019cde0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe12800eaa0 tx=0x7fe12800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:29.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.873+0000 7fe12cff9640 1 -- 172.21.15.7:0/3534853844 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12800cdb0 con 0x7fe130106f10 2024-09-19T04:15:29.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.874+0000 7fe135efa640 1 -- 172.21.15.7:0/3534853844 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe13019d7b0 con 0x7fe130106f10 2024-09-19T04:15:29.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.874+0000 7fe12cff9640 1 -- 172.21.15.7:0/3534853844 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe128005020 con 0x7fe130106f10 2024-09-19T04:15:29.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.874+0000 7fe12cff9640 1 -- 172.21.15.7:0/3534853844 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1280116b0 con 0x7fe130106f10 2024-09-19T04:15:29.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.874+0000 7fe135efa640 1 -- 172.21.15.7:0/3534853844 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1301a5090 con 0x7fe130106f10 2024-09-19T04:15:29.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.875+0000 7fe135efa640 1 -- 172.21.15.7:0/3534853844 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1301021c0 con 0x7fe130106f10 2024-09-19T04:15:29.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.876+0000 7fe12cff9640 1 -- 172.21.15.7:0/3534853844 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fe128005560 con 0x7fe130106f10 2024-09-19T04:15:29.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.877+0000 7fe12cff9640 1 --2- 172.21.15.7:0/3534853844 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe1180a32d0 0x7fe1180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:29.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.877+0000 7fe12f7fe640 1 --2- 172.21.15.7:0/3534853844 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe1180a32d0 0x7fe1180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:29.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.877+0000 7fe12cff9640 1 -- 172.21.15.7:0/3534853844 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fe1280d0250 con 0x7fe130106f10 2024-09-19T04:15:29.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.877+0000 7fe12f7fe640 1 --2- 172.21.15.7:0/3534853844 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe1180a32d0 0x7fe1180a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe120009230 tx=0x7fe1200058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:29.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:29.880+0000 7fe12cff9640 1 -- 172.21.15.7:0/3534853844 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe128016030 con 0x7fe130106f10 2024-09-19T04:15:30.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:30.100+0000 7fe135efa640 1 -- 172.21.15.7:0/3534853844 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe130199870 con 0x7fe130106f10 2024-09-19T04:15:30.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:30.103+0000 7fe12cff9640 1 -- 172.21.15.7:0/3534853844 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24128 (secure 0 0 0) 0x7fe130199870 con 0x7fe130106f10 2024-09-19T04:15:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:15:30.105 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":86,"fsid":"77957c0a-763c-11ef-bceb-c7b262605968","created":"2024-09-19T04:06:58.337394+0000","modified":"2024-09-19T04:14:43.113323+0000","last_up_change":"2024-09-19T04:13:42.312137+0000","last_in_change":"2024-09-19T04:13:18.757925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:09:59.544984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:14:30.225637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:14:32.252497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T04:14:38.781821+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d9b93bd5-ee22-4fb0-ba29-bfa208430a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6803","nonce":240599233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6805","nonce":240599233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6809","nonce":240599233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6807","nonce":240599233}]},"public_addr":"172.21.15.7:6803/240599233","cluster_addr":"172.21.15.7:6805/240599233","heartbeat_back_addr":"172.21.15.7:6809/240599233","heartbeat_front_addr":"172.21.15.7:6807/240599233","state":["exists","up"]},{"osd":1,"uuid":"db5793e6-f3ad-4075-a02b-206bf7f1e59a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6801","nonce":902403333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6803","nonce":902403333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6807","nonce":902403333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6805","nonce":902403333}]},"public_addr":"172.21.15.92:6801/902403333","cluster_addr":"172.21.15.92:6803/902403333","heartbeat_back_addr":"172.21.15.92:6807/902403333","heartbeat_front_addr":"172.21.15.92:6805/902403333","state":["exists","up"]},{"osd":2,"uuid":"1eb83a1b-82d8-4983-bae3-b161adb3a33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6801","nonce":2078441772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6803","nonce":2078441772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6807","nonce":2078441772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6805","nonce":2078441772}]},"public_addr":"172.21.15.102:6801/2078441772","cluster_addr":"172.21.15.102:6803/2078441772","heartbeat_back_addr":"172.21.15.102:6807/2078441772","heartbeat_front_addr":"172.21.15.102:6805/2078441772","state":["exists","up"]},{"osd":3,"uuid":"68ba79e5-bcf0-4349-9e14-42f2fa9c11b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6811","nonce":2729561132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6813","nonce":2729561132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6817","nonce":2729561132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6815","nonce":2729561132}]},"public_addr":"172.21.15.7:6811/2729561132","cluster_addr":"172.21.15.7:6813/2729561132","heartbeat_back_addr":"172.21.15.7:6817/2729561132","heartbeat_front_addr":"172.21.15.7:6815/2729561132","state":["exists","up"]},{"osd":4,"uuid":"f20d4a51-121f-4ac8-afeb-5962d83bd697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6809","nonce":2799734294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6811","nonce":2799734294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6815","nonce":2799734294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6813","nonce":2799734294}]},"public_addr":"172.21.15.92:6809/2799734294","cluster_addr":"172.21.15.92:6811/2799734294","heartbeat_back_addr":"172.21.15.92:6815/2799734294","heartbeat_front_addr":"172.21.15.92:6813/2799734294","state":["exists","up"]},{"osd":5,"uuid":"aac02b0a-99dc-4457-8898-c68dc196517a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6809","nonce":3099678146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6811","nonce":3099678146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6815","nonce":3099678146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6813","nonce":3099678146}]},"public_addr":"172.21.15.102:6809/3099678146","cluster_addr":"172.21.15.102:6811/3099678146","heartbeat_back_addr":"172.21.15.102:6815/3099678146","heartbeat_front_addr":"172.21.15.102:6813/3099678146","state":["exists","up"]},{"osd":6,"uuid":"7e5a8b30-8406-486c-ace5-79158a3757a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6819","nonce":1569704304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6821","nonce":1569704304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6825","nonce":1569704304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6823","nonce":1569704304}]},"public_addr":"172.21.15.7:6819/1569704304","cluster_addr":"172.21.15.7:6821/1569704304","heartbeat_back_addr":"172.21.15.7:6825/1569704304","heartbeat_front_addr":"172.21.15.7:6823/1569704304","state":["exists","up"]},{"osd":7,"uuid":"e6a7049a-17a1-43b2-8ecd-5f4ca7c337be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6817","nonce":3411102480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6819","nonce":3411102480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6823","nonce":3411102480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6821","nonce":3411102480}]},"public_addr":"172.21.15.92:6817/3411102480","cluster_addr":"172.21.15.92:6819/3411102480","heartbeat_back_addr":"172.21.15.92:6823/3411102480","heartbeat_front_addr":"172.21.15.92:6821/3411102480","state":["exists","up"]},{"osd":8,"uuid":"31879baa-861d-4322-990f-0b9a42b8b610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6817","nonce":2990859925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6819","nonce":2990859925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6823","nonce":2990859925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6821","nonce":2990859925}]},"public_addr":"172.21.15.102:6817/2990859925","cluster_addr":"172.21.15.102:6819/2990859925","heartbeat_back_addr":"172.21.15.102:6823/2990859925","heartbeat_front_addr":"172.21.15.102:6821/2990859925","state":["exists","up"]},{"osd":9,"uuid":"6d65db33-926c-4a6e-a072-707e9c9de92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6827","nonce":1710319475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6829","nonce":1710319475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6833","nonce":1710319475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6831","nonce":1710319475}]},"public_addr":"172.21.15.7:6827/1710319475","cluster_addr":"172.21.15.7:6829/1710319475","heartbeat_back_addr":"172.21.15.7:6833/1710319475","heartbeat_front_addr":"172.21.15.7:6831/1710319475","state":["exists","up"]},{"osd":10,"uuid":"9ab681ee-0bef-47bd-bf3d-20b17c6b870c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6825","nonce":1063265541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6827","nonce":1063265541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6831","nonce":1063265541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6829","nonce":1063265541}]},"public_addr":"172.21.15.92:6825/1063265541","cluster_addr":"172.21.15.92:6827/1063265541","heartbeat_back_addr":"172.21.15.92:6831/1063265541","heartbeat_front_addr":"172.21.15.92:6829/1063265541","state":["exists","up"]},{"osd":11,"uuid":"dc398e14-5f9e-4f0a-b158-35cbc1f73a83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6825","nonce":1175425599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6827","nonce":1175425599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6831","nonce":1175425599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6829","nonce":1175425599}]},"public_addr":"172.21.15.102:6825/1175425599","cluster_addr":"172.21.15.102:6827/1175425599","heartbeat_back_addr":"172.21.15.102:6831/1175425599","heartbeat_front_addr":"172.21.15.102:6829/1175425599","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:07.857319+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:31.430120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:56.892301+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:10:22.011884+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:10:46.326025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:11:10.339084+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:11:35.365906+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:01.104309+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:25.717295+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:51.387644+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:13:15.076355+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:13:40.253150+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/2883028938":"2024-09-20T04:07:45.039922+0000","172.21.15.7:0/1186412739":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6800/751091002":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6801/751091002":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6801/940106179":"2024-09-20T04:07:20.364033+0000","172.21.15.7:6800/940106179":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/1450115700":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/2954294373":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/1996930242":"2024-09-20T04:07:45.039922+0000","172.21.15.7:0/3562231347":"2024-09-20T04:07:20.364033+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:15:30.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:30.105+0000 7fe135efa640 1 -- 172.21.15.7:0/3534853844 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe1180a32d0 msgr2=0x7fe1180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:30.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:30.105+0000 7fe135efa640 1 --2- 172.21.15.7:0/3534853844 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe1180a32d0 0x7fe1180a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe120009230 tx=0x7fe1200058d0 comp rx=0 tx=0).stop 2024-09-19T04:15:30.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:30.105+0000 7fe135efa640 1 -- 172.21.15.7:0/3534853844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe130106f10 msgr2=0x7fe13019cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:30.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:30.105+0000 7fe135efa640 1 --2- 172.21.15.7:0/3534853844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe130106f10 0x7fe13019cde0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe12800eaa0 tx=0x7fe12800ef60 comp rx=0 tx=0).stop 2024-09-19T04:15:30.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:30.105+0000 7fe135efa640 1 -- 172.21.15.7:0/3534853844 shutdown_connections 2024-09-19T04:15:30.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:30.105+0000 7fe135efa640 1 --2- 172.21.15.7:0/3534853844 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe1180a32d0 0x7fe1180a5790 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:30.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:30.105+0000 7fe135efa640 1 --2- 172.21.15.7:0/3534853844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe130106f10 0x7fe13019cde0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:30.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:30.105+0000 7fe135efa640 1 --2- 172.21.15.7:0/3534853844 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe130102790 0x7fe130198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:30.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:30.105+0000 7fe135efa640 1 --2- 172.21.15.7:0/3534853844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe130101de0 0x7fe130198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:30.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:30.105+0000 7fe135efa640 1 -- 172.21.15.7:0/3534853844 >> 172.21.15.7:0/3534853844 conn(0x7fe1300fd8c0 msgr2=0x7fe1300fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:30.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:30.106+0000 7fe135efa640 1 -- 172.21.15.7:0/3534853844 shutdown_connections 2024-09-19T04:15:30.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:30.106+0000 7fe135efa640 1 -- 172.21.15.7:0/3534853844 wait complete. 2024-09-19T04:15:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:30 smithi007 ceph-mon[31360]: pgmap v308: 129 pgs: 129 active+clean; 634 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 25 op/s 2024-09-19T04:15:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:30 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:15:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:30 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:15:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:30 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:15:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:30 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:15:30.704 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:30 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3534853844' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:15:30.736 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T04:15:30.736 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T04:15:30.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:30 smithi092 ceph-mon[34940]: pgmap v308: 129 pgs: 129 active+clean; 634 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 25 op/s 2024-09-19T04:15:30.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:30 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:15:30.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:30 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:15:30.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:30 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:15:30.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:30 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:15:30.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:30 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3534853844' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:15:30.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:30 smithi102 ceph-mon[35446]: pgmap v308: 129 pgs: 129 active+clean; 634 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 25 op/s 2024-09-19T04:15:30.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:30 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:15:30.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:30 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:15:30.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:30 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:15:30.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:30 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:15:30.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:30 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3534853844' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:15:31.009 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:31.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.532+0000 7f6456b1c640 1 -- 172.21.15.7:0/132538113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6450103660 msgr2=0x7f645010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:31.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.532+0000 7f6456b1c640 1 --2- 172.21.15.7:0/132538113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6450103660 0x7f645010bb50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6440009900 tx=0x7f644002a480 comp rx=0 tx=0).stop 2024-09-19T04:15:31.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.532+0000 7f6456b1c640 1 -- 172.21.15.7:0/132538113 shutdown_connections 2024-09-19T04:15:31.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.532+0000 7f6456b1c640 1 --2- 172.21.15.7:0/132538113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f645010c170 0x7f645010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:31.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.532+0000 7f6456b1c640 1 --2- 172.21.15.7:0/132538113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6450103660 0x7f645010bb50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:31.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.532+0000 7f6456b1c640 1 --2- 172.21.15.7:0/132538113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6450102d40 0x7f6450103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:31.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.532+0000 7f6456b1c640 1 -- 172.21.15.7:0/132538113 >> 172.21.15.7:0/132538113 conn(0x7f64500fc7a0 msgr2=0x7f64500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:31.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.532+0000 7f6456b1c640 1 -- 172.21.15.7:0/132538113 shutdown_connections 2024-09-19T04:15:31.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.532+0000 7f6456b1c640 1 -- 172.21.15.7:0/132538113 wait complete. 2024-09-19T04:15:31.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.533+0000 7f6456b1c640 1 Processor -- start 2024-09-19T04:15:31.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.533+0000 7f6456b1c640 1 -- start start 2024-09-19T04:15:31.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.533+0000 7f6456b1c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6450102d40 0x7f6450198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:31.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.533+0000 7f6456b1c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6450103660 0x7f64501989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:31.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.533+0000 7f6456b1c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f645010c170 0x7f645019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:31.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.533+0000 7f6456b1c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6450111f70 con 0x7f6450102d40 2024-09-19T04:15:31.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.533+0000 7f6456b1c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6450111df0 con 0x7f645010c170 2024-09-19T04:15:31.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.533+0000 7f6456b1c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f64501120f0 con 0x7f6450103660 2024-09-19T04:15:31.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.534+0000 7f64548b8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6450102d40 0x7f6450198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:31.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.534+0000 7f64548b8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6450102d40 0x7f6450198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43662/0 (socket says 172.21.15.7:43662) 2024-09-19T04:15:31.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.534+0000 7f64548b8640 1 -- 172.21.15.7:0/92029967 learned_addr learned my addr 172.21.15.7:0/92029967 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:31.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.534+0000 7f644ffff640 1 --2- 172.21.15.7:0/92029967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6450103660 0x7f64501989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:31.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.534+0000 7f64550b9640 1 --2- 172.21.15.7:0/92029967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f645010c170 0x7f645019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:31.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.534+0000 7f64548b8640 1 -- 172.21.15.7:0/92029967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6450103660 msgr2=0x7f64501989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:31.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.534+0000 7f64548b8640 1 --2- 172.21.15.7:0/92029967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6450103660 0x7f64501989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:31.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.534+0000 7f64548b8640 1 -- 172.21.15.7:0/92029967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f645010c170 msgr2=0x7f645019cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:31.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.534+0000 7f64548b8640 1 --2- 172.21.15.7:0/92029967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f645010c170 0x7f645019cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:31.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.534+0000 7f64548b8640 1 -- 172.21.15.7:0/92029967 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f645019d420 con 0x7f6450102d40 2024-09-19T04:15:31.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.534+0000 7f64548b8640 1 --2- 172.21.15.7:0/92029967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6450102d40 0x7f6450198470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f643800e9f0 tx=0x7f643800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:31.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.534+0000 7f644dffb640 1 -- 172.21.15.7:0/92029967 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643800cd80 con 0x7f6450102d40 2024-09-19T04:15:31.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.534+0000 7f644dffb640 1 -- 172.21.15.7:0/92029967 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6438010910 con 0x7f6450102d40 2024-09-19T04:15:31.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.534+0000 7f644dffb640 1 -- 172.21.15.7:0/92029967 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6438018990 con 0x7f6450102d40 2024-09-19T04:15:31.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.534+0000 7f6456b1c640 1 -- 172.21.15.7:0/92029967 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f645019d710 con 0x7f6450102d40 2024-09-19T04:15:31.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.535+0000 7f6456b1c640 1 -- 172.21.15.7:0/92029967 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64501a4ff0 con 0x7f6450102d40 2024-09-19T04:15:31.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.536+0000 7f6456b1c640 1 -- 172.21.15.7:0/92029967 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6450103120 con 0x7f6450102d40 2024-09-19T04:15:31.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.537+0000 7f644dffb640 1 -- 172.21.15.7:0/92029967 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f6438010ac0 con 0x7f6450102d40 2024-09-19T04:15:31.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.538+0000 7f644dffb640 1 --2- 172.21.15.7:0/92029967 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f643c0a3350 0x7f643c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:31.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.538+0000 7f644ffff640 1 --2- 172.21.15.7:0/92029967 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f643c0a3350 0x7f643c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:31.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.538+0000 7f644dffb640 1 -- 172.21.15.7:0/92029967 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f64380d0060 con 0x7f6450102d40 2024-09-19T04:15:31.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.538+0000 7f644ffff640 1 --2- 172.21.15.7:0/92029967 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f643c0a3350 0x7f643c0a5810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6440009230 tx=0x7f64400058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:31.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.542+0000 7f644dffb640 1 -- 172.21.15.7:0/92029967 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f643809c980 con 0x7f6450102d40 2024-09-19T04:15:31.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.715+0000 7f6456b1c640 1 -- 172.21.15.7:0/92029967 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6450062630 con 0x7f643c0a3350 2024-09-19T04:15:31.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.724+0000 7f644dffb640 1 -- 172.21.15.7:0/92029967 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340657 (secure 0 0 0) 0x7f6450062630 con 0x7f643c0a3350 2024-09-19T04:15:31.730 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:15:31.732 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-19T04:15:31.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.728+0000 7f6456b1c640 1 -- 172.21.15.7:0/92029967 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f643c0a3350 msgr2=0x7f643c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:31.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.728+0000 7f6456b1c640 1 --2- 172.21.15.7:0/92029967 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f643c0a3350 0x7f643c0a5810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6440009230 tx=0x7f64400058d0 comp rx=0 tx=0).stop 2024-09-19T04:15:31.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.728+0000 7f6456b1c640 1 -- 172.21.15.7:0/92029967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6450102d40 msgr2=0x7f6450198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:31.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.728+0000 7f6456b1c640 1 --2- 172.21.15.7:0/92029967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6450102d40 0x7f6450198470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f643800e9f0 tx=0x7f643800eeb0 comp rx=0 tx=0).stop 2024-09-19T04:15:31.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.728+0000 7f6456b1c640 1 -- 172.21.15.7:0/92029967 shutdown_connections 2024-09-19T04:15:31.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.728+0000 7f6456b1c640 1 --2- 172.21.15.7:0/92029967 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f643c0a3350 0x7f643c0a5810 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:31.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.728+0000 7f6456b1c640 1 --2- 172.21.15.7:0/92029967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f645010c170 0x7f645019cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:31.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.728+0000 7f6456b1c640 1 --2- 172.21.15.7:0/92029967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6450103660 0x7f64501989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:31.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.728+0000 7f6456b1c640 1 --2- 172.21.15.7:0/92029967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6450102d40 0x7f6450198470 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:31.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.728+0000 7f6456b1c640 1 -- 172.21.15.7:0/92029967 >> 172.21.15.7:0/92029967 conn(0x7f64500fc7a0 msgr2=0x7f64500fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:31.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.728+0000 7f6456b1c640 1 -- 172.21.15.7:0/92029967 shutdown_connections 2024-09-19T04:15:31.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:31.728+0000 7f6456b1c640 1 -- 172.21.15.7:0/92029967 wait complete. 2024-09-19T04:15:32.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:31 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:15:32.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:31 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:15:32.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:31 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:15:32.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:31 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:15:32.021 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:31 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:15:32.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:31 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:15:32.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:31 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:15:32.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:31 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:15:32.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:31 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:15:32.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:31 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:15:32.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:31 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:15:32.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:31 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:15:32.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:31 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:15:32.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:31 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:15:32.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:31 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:15:32.346 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2024-09-19T04:15:31.133438+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":649709,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":271,"num_read_kb":237,"num_write":423,"num_write_kb":3069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":347,"ondisk_log_size":347,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356720,"kb_used_data":11632,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585104,"statfs":{"total":1151940427776,"available":1151575146496,"internally_reserved":0,"allocated":11911168,"data_stored":7632753,"data_compressed":321468,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":19141,"internal_metadata":353154363},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49697,"num_objects":7,"num_object_clones":0,"num_object_copies":23,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":120,"num_read_kb":108,"num_write":40,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003257"},"pg_stats":[{"pgid":"2.1f","version":"86'13","reported_seq":55,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:26.840247+0000","last_change":"2024-09-19T04:14:31.294836+0000","last_active":"2024-09-19T04:15:26.840247+0000","last_peered":"2024-09-19T04:15:26.840247+0000","last_clean":"2024-09-19T04:15:26.840247+0000","last_became_active":"2024-09-19T04:14:31.294589+0000","last_became_peered":"2024-09-19T04:14:31.294589+0000","last_unstale":"2024-09-19T04:15:26.840247+0000","last_undegraded":"2024-09-19T04:15:26.840247+0000","last_fullsized":"2024-09-19T04:15:26.840247+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:39:54.093519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.368625+0000","last_change":"2024-09-19T04:14:33.316023+0000","last_active":"2024-09-19T04:14:43.368625+0000","last_peered":"2024-09-19T04:14:43.368625+0000","last_clean":"2024-09-19T04:14:43.368625+0000","last_became_active":"2024-09-19T04:14:33.315732+0000","last_became_peered":"2024-09-19T04:14:33.315732+0000","last_unstale":"2024-09-19T04:14:43.368625+0000","last_undegraded":"2024-09-19T04:14:43.368625+0000","last_fullsized":"2024-09-19T04:14:43.368625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:00.782788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.370689+0000","last_change":"2024-09-19T04:14:40.368540+0000","last_active":"2024-09-19T04:14:43.370689+0000","last_peered":"2024-09-19T04:14:43.370689+0000","last_clean":"2024-09-19T04:14:43.370689+0000","last_became_active":"2024-09-19T04:14:40.367906+0000","last_became_peered":"2024-09-19T04:14:40.367906+0000","last_unstale":"2024-09-19T04:14:43.370689+0000","last_undegraded":"2024-09-19T04:14:43.370689+0000","last_fullsized":"2024-09-19T04:14:43.370689+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:35.660297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.368848+0000","last_change":"2024-09-19T04:14:31.321870+0000","last_active":"2024-09-19T04:14:43.368848+0000","last_peered":"2024-09-19T04:14:43.368848+0000","last_clean":"2024-09-19T04:14:43.368848+0000","last_became_active":"2024-09-19T04:14:31.321495+0000","last_became_peered":"2024-09-19T04:14:31.321495+0000","last_unstale":"2024-09-19T04:14:43.368848+0000","last_undegraded":"2024-09-19T04:14:43.368848+0000","last_fullsized":"2024-09-19T04:14:43.368848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:58.063748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.948907+0000","last_change":"2024-09-19T04:14:33.307451+0000","last_active":"2024-09-19T04:14:43.948907+0000","last_peered":"2024-09-19T04:14:43.948907+0000","last_clean":"2024-09-19T04:14:43.948907+0000","last_became_active":"2024-09-19T04:14:33.307129+0000","last_became_peered":"2024-09-19T04:14:33.307129+0000","last_unstale":"2024-09-19T04:14:43.948907+0000","last_undegraded":"2024-09-19T04:14:43.948907+0000","last_fullsized":"2024-09-19T04:14:43.948907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:28.851012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.710564+0000","last_change":"2024-09-19T04:14:40.367946+0000","last_active":"2024-09-19T04:14:43.710564+0000","last_peered":"2024-09-19T04:14:43.710564+0000","last_clean":"2024-09-19T04:14:43.710564+0000","last_became_active":"2024-09-19T04:14:40.367567+0000","last_became_peered":"2024-09-19T04:14:40.367567+0000","last_unstale":"2024-09-19T04:14:43.710564+0000","last_undegraded":"2024-09-19T04:14:43.710564+0000","last_fullsized":"2024-09-19T04:14:43.710564+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:14:29.244838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:17.817265+0000","last_change":"2024-09-19T04:14:31.298497+0000","last_active":"2024-09-19T04:15:17.817265+0000","last_peered":"2024-09-19T04:15:17.817265+0000","last_clean":"2024-09-19T04:15:17.817265+0000","last_became_active":"2024-09-19T04:14:31.298185+0000","last_became_peered":"2024-09-19T04:14:31.298185+0000","last_unstale":"2024-09-19T04:15:17.817265+0000","last_undegraded":"2024-09-19T04:15:17.817265+0000","last_fullsized":"2024-09-19T04:15:17.817265+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:56:12.701718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711621+0000","last_change":"2024-09-19T04:14:33.316922+0000","last_active":"2024-09-19T04:14:43.711621+0000","last_peered":"2024-09-19T04:14:43.711621+0000","last_clean":"2024-09-19T04:14:43.711621+0000","last_became_active":"2024-09-19T04:14:33.316613+0000","last_became_peered":"2024-09-19T04:14:33.316613+0000","last_unstale":"2024-09-19T04:14:43.711621+0000","last_undegraded":"2024-09-19T04:14:43.711621+0000","last_fullsized":"2024-09-19T04:14:43.711621+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:22.237900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711475+0000","last_change":"2024-09-19T04:14:40.368946+0000","last_active":"2024-09-19T04:14:43.711475+0000","last_peered":"2024-09-19T04:14:43.711475+0000","last_clean":"2024-09-19T04:14:43.711475+0000","last_became_active":"2024-09-19T04:14:40.368473+0000","last_became_peered":"2024-09-19T04:14:40.368473+0000","last_unstale":"2024-09-19T04:14:43.711475+0000","last_undegraded":"2024-09-19T04:14:43.711475+0000","last_fullsized":"2024-09-19T04:14:43.711475+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:52.199524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:16.822660+0000","last_change":"2024-09-19T04:14:31.294330+0000","last_active":"2024-09-19T04:15:16.822660+0000","last_peered":"2024-09-19T04:15:16.822660+0000","last_clean":"2024-09-19T04:15:16.822660+0000","last_became_active":"2024-09-19T04:14:31.293025+0000","last_became_peered":"2024-09-19T04:14:31.293025+0000","last_unstale":"2024-09-19T04:15:16.822660+0000","last_undegraded":"2024-09-19T04:15:16.822660+0000","last_fullsized":"2024-09-19T04:15:16.822660+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:48.276096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712554+0000","last_change":"2024-09-19T04:14:33.313560+0000","last_active":"2024-09-19T04:14:43.712554+0000","last_peered":"2024-09-19T04:14:43.712554+0000","last_clean":"2024-09-19T04:14:43.712554+0000","last_became_active":"2024-09-19T04:14:33.313200+0000","last_became_peered":"2024-09-19T04:14:33.313200+0000","last_unstale":"2024-09-19T04:14:43.712554+0000","last_undegraded":"2024-09-19T04:14:43.712554+0000","last_fullsized":"2024-09-19T04:14:43.712554+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:33.807866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711318+0000","last_change":"2024-09-19T04:14:40.368125+0000","last_active":"2024-09-19T04:14:43.711318+0000","last_peered":"2024-09-19T04:14:43.711318+0000","last_clean":"2024-09-19T04:14:43.711318+0000","last_became_active":"2024-09-19T04:14:40.367772+0000","last_became_peered":"2024-09-19T04:14:40.367772+0000","last_unstale":"2024-09-19T04:14:43.711318+0000","last_undegraded":"2024-09-19T04:14:43.711318+0000","last_fullsized":"2024-09-19T04:14:43.711318+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:07:19.740391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.369526+0000","last_change":"2024-09-19T04:14:33.307489+0000","last_active":"2024-09-19T04:14:43.369526+0000","last_peered":"2024-09-19T04:14:43.369526+0000","last_clean":"2024-09-19T04:14:43.369526+0000","last_became_active":"2024-09-19T04:14:33.307143+0000","last_became_peered":"2024-09-19T04:14:33.307143+0000","last_unstale":"2024-09-19T04:14:43.369526+0000","last_undegraded":"2024-09-19T04:14:43.369526+0000","last_fullsized":"2024-09-19T04:14:43.369526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:51:14.018972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:13.801550+0000","last_change":"2024-09-19T04:14:31.299342+0000","last_active":"2024-09-19T04:15:13.801550+0000","last_peered":"2024-09-19T04:15:13.801550+0000","last_clean":"2024-09-19T04:15:13.801550+0000","last_became_active":"2024-09-19T04:14:31.298927+0000","last_became_peered":"2024-09-19T04:14:31.298927+0000","last_unstale":"2024-09-19T04:15:13.801550+0000","last_undegraded":"2024-09-19T04:15:13.801550+0000","last_fullsized":"2024-09-19T04:15:13.801550+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:38.483077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712102+0000","last_change":"2024-09-19T04:14:40.405762+0000","last_active":"2024-09-19T04:14:43.712102+0000","last_peered":"2024-09-19T04:14:43.712102+0000","last_clean":"2024-09-19T04:14:43.712102+0000","last_became_active":"2024-09-19T04:14:40.405379+0000","last_became_peered":"2024-09-19T04:14:40.405379+0000","last_unstale":"2024-09-19T04:14:43.712102+0000","last_undegraded":"2024-09-19T04:14:43.712102+0000","last_fullsized":"2024-09-19T04:14:43.712102+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:41:36.628112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.368329+0000","last_change":"2024-09-19T04:14:33.318521+0000","last_active":"2024-09-19T04:14:43.368329+0000","last_peered":"2024-09-19T04:14:43.368329+0000","last_clean":"2024-09-19T04:14:43.368329+0000","last_became_active":"2024-09-19T04:14:33.318200+0000","last_became_peered":"2024-09-19T04:14:33.318200+0000","last_unstale":"2024-09-19T04:14:43.368329+0000","last_undegraded":"2024-09-19T04:14:43.368329+0000","last_fullsized":"2024-09-19T04:14:43.368329+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:45.497455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:15.816486+0000","last_change":"2024-09-19T04:14:31.299976+0000","last_active":"2024-09-19T04:15:15.816486+0000","last_peered":"2024-09-19T04:15:15.816486+0000","last_clean":"2024-09-19T04:15:15.816486+0000","last_became_active":"2024-09-19T04:14:31.299630+0000","last_became_peered":"2024-09-19T04:14:31.299630+0000","last_unstale":"2024-09-19T04:15:15.816486+0000","last_undegraded":"2024-09-19T04:15:15.816486+0000","last_fullsized":"2024-09-19T04:15:15.816486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:14:00.834440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.917948+0000","last_change":"2024-09-19T04:14:40.366110+0000","last_active":"2024-09-19T04:14:43.917948+0000","last_peered":"2024-09-19T04:14:43.917948+0000","last_clean":"2024-09-19T04:14:43.917948+0000","last_became_active":"2024-09-19T04:14:40.365558+0000","last_became_peered":"2024-09-19T04:14:40.365558+0000","last_unstale":"2024-09-19T04:14:43.917948+0000","last_undegraded":"2024-09-19T04:14:43.917948+0000","last_fullsized":"2024-09-19T04:14:43.917948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:24.049603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711615+0000","last_change":"2024-09-19T04:14:33.307400+0000","last_active":"2024-09-19T04:14:43.711615+0000","last_peered":"2024-09-19T04:14:43.711615+0000","last_clean":"2024-09-19T04:14:43.711615+0000","last_became_active":"2024-09-19T04:14:33.307095+0000","last_became_peered":"2024-09-19T04:14:33.307095+0000","last_unstale":"2024-09-19T04:14:43.711615+0000","last_undegraded":"2024-09-19T04:14:43.711615+0000","last_fullsized":"2024-09-19T04:14:43.711615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:27.582568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:16.820428+0000","last_change":"2024-09-19T04:14:31.287190+0000","last_active":"2024-09-19T04:15:16.820428+0000","last_peered":"2024-09-19T04:15:16.820428+0000","last_clean":"2024-09-19T04:15:16.820428+0000","last_became_active":"2024-09-19T04:14:31.286817+0000","last_became_peered":"2024-09-19T04:14:31.286817+0000","last_unstale":"2024-09-19T04:15:16.820428+0000","last_undegraded":"2024-09-19T04:15:16.820428+0000","last_fullsized":"2024-09-19T04:15:16.820428+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:44.522615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711686+0000","last_change":"2024-09-19T04:14:40.372153+0000","last_active":"2024-09-19T04:14:43.711686+0000","last_peered":"2024-09-19T04:14:43.711686+0000","last_clean":"2024-09-19T04:14:43.711686+0000","last_became_active":"2024-09-19T04:14:40.371309+0000","last_became_peered":"2024-09-19T04:14:40.371309+0000","last_unstale":"2024-09-19T04:14:43.711686+0000","last_undegraded":"2024-09-19T04:14:43.711686+0000","last_fullsized":"2024-09-19T04:14:43.711686+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:46.608489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711797+0000","last_change":"2024-09-19T04:14:33.310884+0000","last_active":"2024-09-19T04:14:43.711797+0000","last_peered":"2024-09-19T04:14:43.711797+0000","last_clean":"2024-09-19T04:14:43.711797+0000","last_became_active":"2024-09-19T04:14:33.310532+0000","last_became_peered":"2024-09-19T04:14:33.310532+0000","last_unstale":"2024-09-19T04:14:43.711797+0000","last_undegraded":"2024-09-19T04:14:43.711797+0000","last_fullsized":"2024-09-19T04:14:43.711797+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:49:16.565018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:13.804039+0000","last_change":"2024-09-19T04:14:31.322216+0000","last_active":"2024-09-19T04:15:13.804039+0000","last_peered":"2024-09-19T04:15:13.804039+0000","last_clean":"2024-09-19T04:15:13.804039+0000","last_became_active":"2024-09-19T04:14:31.321941+0000","last_became_peered":"2024-09-19T04:14:31.321941+0000","last_unstale":"2024-09-19T04:15:13.804039+0000","last_undegraded":"2024-09-19T04:15:13.804039+0000","last_fullsized":"2024-09-19T04:15:13.804039+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:14.624104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712350+0000","last_change":"2024-09-19T04:14:40.405749+0000","last_active":"2024-09-19T04:14:43.712350+0000","last_peered":"2024-09-19T04:14:43.712350+0000","last_clean":"2024-09-19T04:14:43.712350+0000","last_became_active":"2024-09-19T04:14:40.405353+0000","last_became_peered":"2024-09-19T04:14:40.405353+0000","last_unstale":"2024-09-19T04:14:43.712350+0000","last_undegraded":"2024-09-19T04:14:43.712350+0000","last_fullsized":"2024-09-19T04:14:43.712350+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:13.311989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.948815+0000","last_change":"2024-09-19T04:14:33.312057+0000","last_active":"2024-09-19T04:14:43.948815+0000","last_peered":"2024-09-19T04:14:43.948815+0000","last_clean":"2024-09-19T04:14:43.948815+0000","last_became_active":"2024-09-19T04:14:33.311751+0000","last_became_peered":"2024-09-19T04:14:33.311751+0000","last_unstale":"2024-09-19T04:14:43.948815+0000","last_undegraded":"2024-09-19T04:14:43.948815+0000","last_fullsized":"2024-09-19T04:14:43.948815+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:28.843870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:16.822376+0000","last_change":"2024-09-19T04:14:31.287529+0000","last_active":"2024-09-19T04:15:16.822376+0000","last_peered":"2024-09-19T04:15:16.822376+0000","last_clean":"2024-09-19T04:15:16.822376+0000","last_became_active":"2024-09-19T04:14:31.287172+0000","last_became_peered":"2024-09-19T04:14:31.287172+0000","last_unstale":"2024-09-19T04:15:16.822376+0000","last_undegraded":"2024-09-19T04:15:16.822376+0000","last_fullsized":"2024-09-19T04:15:16.822376+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:32:23.351997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.370677+0000","last_change":"2024-09-19T04:14:40.363772+0000","last_active":"2024-09-19T04:14:43.370677+0000","last_peered":"2024-09-19T04:14:43.370677+0000","last_clean":"2024-09-19T04:14:43.370677+0000","last_became_active":"2024-09-19T04:14:40.363395+0000","last_became_peered":"2024-09-19T04:14:40.363395+0000","last_unstale":"2024-09-19T04:14:43.370677+0000","last_undegraded":"2024-09-19T04:14:43.370677+0000","last_fullsized":"2024-09-19T04:14:43.370677+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:22.090743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.368796+0000","last_change":"2024-09-19T04:14:33.310108+0000","last_active":"2024-09-19T04:14:43.368796+0000","last_peered":"2024-09-19T04:14:43.368796+0000","last_clean":"2024-09-19T04:14:43.368796+0000","last_became_active":"2024-09-19T04:14:33.309812+0000","last_became_peered":"2024-09-19T04:14:33.309812+0000","last_unstale":"2024-09-19T04:14:43.368796+0000","last_undegraded":"2024-09-19T04:14:43.368796+0000","last_fullsized":"2024-09-19T04:14:43.368796+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:48.570530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'13","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:27.334042+0000","last_change":"2024-09-19T04:14:31.293115+0000","last_active":"2024-09-19T04:15:27.334042+0000","last_peered":"2024-09-19T04:15:27.334042+0000","last_clean":"2024-09-19T04:15:27.334042+0000","last_became_active":"2024-09-19T04:14:31.292733+0000","last_became_peered":"2024-09-19T04:14:31.292733+0000","last_unstale":"2024-09-19T04:15:27.334042+0000","last_undegraded":"2024-09-19T04:15:27.334042+0000","last_fullsized":"2024-09-19T04:15:27.334042+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:11.936757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.368286+0000","last_change":"2024-09-19T04:14:40.405241+0000","last_active":"2024-09-19T04:14:43.368286+0000","last_peered":"2024-09-19T04:14:43.368286+0000","last_clean":"2024-09-19T04:14:43.368286+0000","last_became_active":"2024-09-19T04:14:40.404846+0000","last_became_peered":"2024-09-19T04:14:40.404846+0000","last_unstale":"2024-09-19T04:14:43.368286+0000","last_undegraded":"2024-09-19T04:14:43.368286+0000","last_fullsized":"2024-09-19T04:14:43.368286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:49.842644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711133+0000","last_change":"2024-09-19T04:14:33.305796+0000","last_active":"2024-09-19T04:14:43.711133+0000","last_peered":"2024-09-19T04:14:43.711133+0000","last_clean":"2024-09-19T04:14:43.711133+0000","last_became_active":"2024-09-19T04:14:33.305499+0000","last_became_peered":"2024-09-19T04:14:33.305499+0000","last_unstale":"2024-09-19T04:14:43.711133+0000","last_undegraded":"2024-09-19T04:14:43.711133+0000","last_fullsized":"2024-09-19T04:14:43.711133+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:08.357655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:16.822184+0000","last_change":"2024-09-19T04:14:31.322459+0000","last_active":"2024-09-19T04:15:16.822184+0000","last_peered":"2024-09-19T04:15:16.822184+0000","last_clean":"2024-09-19T04:15:16.822184+0000","last_became_active":"2024-09-19T04:14:31.322149+0000","last_became_peered":"2024-09-19T04:14:31.322149+0000","last_unstale":"2024-09-19T04:15:16.822184+0000","last_undegraded":"2024-09-19T04:15:16.822184+0000","last_fullsized":"2024-09-19T04:15:16.822184+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:06:15.208618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711391+0000","last_change":"2024-09-19T04:14:40.372869+0000","last_active":"2024-09-19T04:14:43.711391+0000","last_peered":"2024-09-19T04:14:43.711391+0000","last_clean":"2024-09-19T04:14:43.711391+0000","last_became_active":"2024-09-19T04:14:40.372203+0000","last_became_peered":"2024-09-19T04:14:40.372203+0000","last_unstale":"2024-09-19T04:14:43.711391+0000","last_undegraded":"2024-09-19T04:14:43.711391+0000","last_fullsized":"2024-09-19T04:14:43.711391+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:34.900656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711694+0000","last_change":"2024-09-19T04:14:33.315443+0000","last_active":"2024-09-19T04:14:43.711694+0000","last_peered":"2024-09-19T04:14:43.711694+0000","last_clean":"2024-09-19T04:14:43.711694+0000","last_became_active":"2024-09-19T04:14:33.315067+0000","last_became_peered":"2024-09-19T04:14:33.315067+0000","last_unstale":"2024-09-19T04:14:43.711694+0000","last_undegraded":"2024-09-19T04:14:43.711694+0000","last_fullsized":"2024-09-19T04:14:43.711694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:59.194674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711412+0000","last_change":"2024-09-19T04:14:31.322623+0000","last_active":"2024-09-19T04:14:43.711412+0000","last_peered":"2024-09-19T04:14:43.711412+0000","last_clean":"2024-09-19T04:14:43.711412+0000","last_became_active":"2024-09-19T04:14:31.321838+0000","last_became_peered":"2024-09-19T04:14:31.321838+0000","last_unstale":"2024-09-19T04:14:43.711412+0000","last_undegraded":"2024-09-19T04:14:43.711412+0000","last_fullsized":"2024-09-19T04:14:43.711412+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:30:37.073072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712635+0000","last_change":"2024-09-19T04:14:40.406036+0000","last_active":"2024-09-19T04:14:43.712635+0000","last_peered":"2024-09-19T04:14:43.712635+0000","last_clean":"2024-09-19T04:14:43.712635+0000","last_became_active":"2024-09-19T04:14:40.405602+0000","last_became_peered":"2024-09-19T04:14:40.405602+0000","last_unstale":"2024-09-19T04:14:43.712635+0000","last_undegraded":"2024-09-19T04:14:43.712635+0000","last_fullsized":"2024-09-19T04:14:43.712635+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:09:50.013072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712024+0000","last_change":"2024-09-19T04:14:33.319748+0000","last_active":"2024-09-19T04:14:43.712024+0000","last_peered":"2024-09-19T04:14:43.712024+0000","last_clean":"2024-09-19T04:14:43.712024+0000","last_became_active":"2024-09-19T04:14:33.319173+0000","last_became_peered":"2024-09-19T04:14:33.319173+0000","last_unstale":"2024-09-19T04:14:43.712024+0000","last_undegraded":"2024-09-19T04:14:43.712024+0000","last_fullsized":"2024-09-19T04:14:43.712024+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:24.419811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'6","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:26.840684+0000","last_change":"2024-09-19T04:14:31.292077+0000","last_active":"2024-09-19T04:15:26.840684+0000","last_peered":"2024-09-19T04:15:26.840684+0000","last_clean":"2024-09-19T04:15:26.840684+0000","last_became_active":"2024-09-19T04:14:31.291737+0000","last_became_peered":"2024-09-19T04:14:31.291737+0000","last_unstale":"2024-09-19T04:15:26.840684+0000","last_undegraded":"2024-09-19T04:15:26.840684+0000","last_fullsized":"2024-09-19T04:15:26.840684+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:32.570641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711028+0000","last_change":"2024-09-19T04:14:40.369734+0000","last_active":"2024-09-19T04:14:43.711028+0000","last_peered":"2024-09-19T04:14:43.711028+0000","last_clean":"2024-09-19T04:14:43.711028+0000","last_became_active":"2024-09-19T04:14:40.367563+0000","last_became_peered":"2024-09-19T04:14:40.367563+0000","last_unstale":"2024-09-19T04:14:43.711028+0000","last_undegraded":"2024-09-19T04:14:43.711028+0000","last_fullsized":"2024-09-19T04:14:43.711028+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:47.229115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711047+0000","last_change":"2024-09-19T04:14:33.309687+0000","last_active":"2024-09-19T04:14:43.711047+0000","last_peered":"2024-09-19T04:14:43.711047+0000","last_clean":"2024-09-19T04:14:43.711047+0000","last_became_active":"2024-09-19T04:14:33.308692+0000","last_became_peered":"2024-09-19T04:14:33.308692+0000","last_unstale":"2024-09-19T04:14:43.711047+0000","last_undegraded":"2024-09-19T04:14:43.711047+0000","last_fullsized":"2024-09-19T04:14:43.711047+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:58.716927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:25.839407+0000","last_change":"2024-09-19T04:14:31.322024+0000","last_active":"2024-09-19T04:15:25.839407+0000","last_peered":"2024-09-19T04:15:25.839407+0000","last_clean":"2024-09-19T04:15:25.839407+0000","last_became_active":"2024-09-19T04:14:31.321640+0000","last_became_peered":"2024-09-19T04:14:31.321640+0000","last_unstale":"2024-09-19T04:15:25.839407+0000","last_undegraded":"2024-09-19T04:15:25.839407+0000","last_fullsized":"2024-09-19T04:15:25.839407+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:25:36.159774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.710872+0000","last_change":"2024-09-19T04:14:40.405793+0000","last_active":"2024-09-19T04:14:43.710872+0000","last_peered":"2024-09-19T04:14:43.710872+0000","last_clean":"2024-09-19T04:14:43.710872+0000","last_became_active":"2024-09-19T04:14:40.405354+0000","last_became_peered":"2024-09-19T04:14:40.405354+0000","last_unstale":"2024-09-19T04:14:43.710872+0000","last_undegraded":"2024-09-19T04:14:43.710872+0000","last_fullsized":"2024-09-19T04:14:43.710872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:46:37.893202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.710421+0000","last_change":"2024-09-19T04:14:33.313007+0000","last_active":"2024-09-19T04:14:43.710421+0000","last_peered":"2024-09-19T04:14:43.710421+0000","last_clean":"2024-09-19T04:14:43.710421+0000","last_became_active":"2024-09-19T04:14:33.312665+0000","last_became_peered":"2024-09-19T04:14:33.312665+0000","last_unstale":"2024-09-19T04:14:43.710421+0000","last_undegraded":"2024-09-19T04:14:43.710421+0000","last_fullsized":"2024-09-19T04:14:43.710421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:09.976707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:14.807634+0000","last_change":"2024-09-19T04:14:31.294072+0000","last_active":"2024-09-19T04:15:14.807634+0000","last_peered":"2024-09-19T04:15:14.807634+0000","last_clean":"2024-09-19T04:15:14.807634+0000","last_became_active":"2024-09-19T04:14:31.293648+0000","last_became_peered":"2024-09-19T04:14:31.293648+0000","last_unstale":"2024-09-19T04:15:14.807634+0000","last_undegraded":"2024-09-19T04:15:14.807634+0000","last_fullsized":"2024-09-19T04:15:14.807634+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:14.910714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711885+0000","last_change":"2024-09-19T04:14:40.406327+0000","last_active":"2024-09-19T04:14:43.711885+0000","last_peered":"2024-09-19T04:14:43.711885+0000","last_clean":"2024-09-19T04:14:43.711885+0000","last_became_active":"2024-09-19T04:14:40.405602+0000","last_became_peered":"2024-09-19T04:14:40.405602+0000","last_unstale":"2024-09-19T04:14:43.711885+0000","last_undegraded":"2024-09-19T04:14:43.711885+0000","last_fullsized":"2024-09-19T04:14:43.711885+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:47:23.078480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.368363+0000","last_change":"2024-09-19T04:14:33.317183+0000","last_active":"2024-09-19T04:14:43.368363+0000","last_peered":"2024-09-19T04:14:43.368363+0000","last_clean":"2024-09-19T04:14:43.368363+0000","last_became_active":"2024-09-19T04:14:33.316883+0000","last_became_peered":"2024-09-19T04:14:33.316883+0000","last_unstale":"2024-09-19T04:14:43.368363+0000","last_undegraded":"2024-09-19T04:14:43.368363+0000","last_fullsized":"2024-09-19T04:14:43.368363+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:55.493883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:17.823780+0000","last_change":"2024-09-19T04:14:31.290207+0000","last_active":"2024-09-19T04:15:17.823780+0000","last_peered":"2024-09-19T04:15:17.823780+0000","last_clean":"2024-09-19T04:15:17.823780+0000","last_became_active":"2024-09-19T04:14:31.289863+0000","last_became_peered":"2024-09-19T04:14:31.289863+0000","last_unstale":"2024-09-19T04:15:17.823780+0000","last_undegraded":"2024-09-19T04:15:17.823780+0000","last_fullsized":"2024-09-19T04:15:17.823780+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:39.241894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":342,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.369321+0000","last_change":"2024-09-19T04:13:20.845240+0000","last_active":"2024-09-19T04:14:43.369321+0000","last_peered":"2024-09-19T04:14:43.369321+0000","last_clean":"2024-09-19T04:14:43.369321+0000","last_became_active":"2024-09-19T04:13:20.844771+0000","last_became_peered":"2024-09-19T04:13:20.844771+0000","last_unstale":"2024-09-19T04:14:43.369321+0000","last_undegraded":"2024-09-19T04:14:43.369321+0000","last_fullsized":"2024-09-19T04:14:43.369321+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:09:59.809148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:09:59.809148+0000","last_clean_scrub_stamp":"2024-09-19T04:09:59.809148+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:12:29.694263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.780946+0000","last_change":"2024-09-19T04:14:40.369257+0000","last_active":"2024-09-19T04:14:43.780946+0000","last_peered":"2024-09-19T04:14:43.780946+0000","last_clean":"2024-09-19T04:14:43.780946+0000","last_became_active":"2024-09-19T04:14:40.368865+0000","last_became_peered":"2024-09-19T04:14:40.368865+0000","last_unstale":"2024-09-19T04:14:43.780946+0000","last_undegraded":"2024-09-19T04:14:43.780946+0000","last_fullsized":"2024-09-19T04:14:43.780946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:37:52.120157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.369748+0000","last_change":"2024-09-19T04:14:33.311221+0000","last_active":"2024-09-19T04:14:43.369748+0000","last_peered":"2024-09-19T04:14:43.369748+0000","last_clean":"2024-09-19T04:14:43.369748+0000","last_became_active":"2024-09-19T04:14:33.310886+0000","last_became_peered":"2024-09-19T04:14:33.310886+0000","last_unstale":"2024-09-19T04:14:43.369748+0000","last_undegraded":"2024-09-19T04:14:43.369748+0000","last_fullsized":"2024-09-19T04:14:43.369748+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:04:32.348676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:27.842090+0000","last_change":"2024-09-19T04:14:31.322464+0000","last_active":"2024-09-19T04:15:27.842090+0000","last_peered":"2024-09-19T04:15:27.842090+0000","last_clean":"2024-09-19T04:15:27.842090+0000","last_became_active":"2024-09-19T04:14:31.322115+0000","last_became_peered":"2024-09-19T04:14:31.322115+0000","last_unstale":"2024-09-19T04:15:27.842090+0000","last_undegraded":"2024-09-19T04:15:27.842090+0000","last_fullsized":"2024-09-19T04:15:27.842090+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:24:27.623328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711354+0000","last_change":"2024-09-19T04:14:40.371391+0000","last_active":"2024-09-19T04:14:43.711354+0000","last_peered":"2024-09-19T04:14:43.711354+0000","last_clean":"2024-09-19T04:14:43.711354+0000","last_became_active":"2024-09-19T04:14:40.371091+0000","last_became_peered":"2024-09-19T04:14:40.371091+0000","last_unstale":"2024-09-19T04:14:43.711354+0000","last_undegraded":"2024-09-19T04:14:43.711354+0000","last_fullsized":"2024-09-19T04:14:43.711354+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:39:14.889348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.369408+0000","last_change":"2024-09-19T04:14:33.317833+0000","last_active":"2024-09-19T04:14:43.369408+0000","last_peered":"2024-09-19T04:14:43.369408+0000","last_clean":"2024-09-19T04:14:43.369408+0000","last_became_active":"2024-09-19T04:14:33.317495+0000","last_became_peered":"2024-09-19T04:14:33.317495+0000","last_unstale":"2024-09-19T04:14:43.369408+0000","last_undegraded":"2024-09-19T04:14:43.369408+0000","last_fullsized":"2024-09-19T04:14:43.369408+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:08:05.200360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:16.820361+0000","last_change":"2024-09-19T04:14:31.293156+0000","last_active":"2024-09-19T04:15:16.820361+0000","last_peered":"2024-09-19T04:15:16.820361+0000","last_clean":"2024-09-19T04:15:16.820361+0000","last_became_active":"2024-09-19T04:14:31.292772+0000","last_became_peered":"2024-09-19T04:14:31.292772+0000","last_unstale":"2024-09-19T04:15:16.820361+0000","last_undegraded":"2024-09-19T04:15:16.820361+0000","last_fullsized":"2024-09-19T04:15:16.820361+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:03:18.530662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.948621+0000","last_change":"2024-09-19T04:14:40.371434+0000","last_active":"2024-09-19T04:14:43.948621+0000","last_peered":"2024-09-19T04:14:43.948621+0000","last_clean":"2024-09-19T04:14:43.948621+0000","last_became_active":"2024-09-19T04:14:40.371037+0000","last_became_peered":"2024-09-19T04:14:40.371037+0000","last_unstale":"2024-09-19T04:14:43.948621+0000","last_undegraded":"2024-09-19T04:14:43.948621+0000","last_fullsized":"2024-09-19T04:14:43.948621+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:43:34.787860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.369675+0000","last_change":"2024-09-19T04:14:33.308321+0000","last_active":"2024-09-19T04:14:43.369675+0000","last_peered":"2024-09-19T04:14:43.369675+0000","last_clean":"2024-09-19T04:14:43.369675+0000","last_became_active":"2024-09-19T04:14:33.307983+0000","last_became_peered":"2024-09-19T04:14:33.307983+0000","last_unstale":"2024-09-19T04:14:43.369675+0000","last_undegraded":"2024-09-19T04:14:43.369675+0000","last_fullsized":"2024-09-19T04:14:43.369675+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:46.202123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:16.819698+0000","last_change":"2024-09-19T04:14:31.297326+0000","last_active":"2024-09-19T04:15:16.819698+0000","last_peered":"2024-09-19T04:15:16.819698+0000","last_clean":"2024-09-19T04:15:16.819698+0000","last_became_active":"2024-09-19T04:14:31.297056+0000","last_became_peered":"2024-09-19T04:14:31.297056+0000","last_unstale":"2024-09-19T04:15:16.819698+0000","last_undegraded":"2024-09-19T04:15:16.819698+0000","last_fullsized":"2024-09-19T04:15:16.819698+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:15:26.324855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.710912+0000","last_change":"2024-09-19T04:14:40.370123+0000","last_active":"2024-09-19T04:14:43.710912+0000","last_peered":"2024-09-19T04:14:43.710912+0000","last_clean":"2024-09-19T04:14:43.710912+0000","last_became_active":"2024-09-19T04:14:40.367758+0000","last_became_peered":"2024-09-19T04:14:40.367758+0000","last_unstale":"2024-09-19T04:14:43.710912+0000","last_undegraded":"2024-09-19T04:14:43.710912+0000","last_fullsized":"2024-09-19T04:14:43.710912+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:07.932122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712291+0000","last_change":"2024-09-19T04:14:33.314239+0000","last_active":"2024-09-19T04:14:43.712291+0000","last_peered":"2024-09-19T04:14:43.712291+0000","last_clean":"2024-09-19T04:14:43.712291+0000","last_became_active":"2024-09-19T04:14:33.313918+0000","last_became_peered":"2024-09-19T04:14:33.313918+0000","last_unstale":"2024-09-19T04:14:43.712291+0000","last_undegraded":"2024-09-19T04:14:43.712291+0000","last_fullsized":"2024-09-19T04:14:43.712291+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:00:12.756505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:15.803142+0000","last_change":"2024-09-19T04:14:31.295377+0000","last_active":"2024-09-19T04:15:15.803142+0000","last_peered":"2024-09-19T04:15:15.803142+0000","last_clean":"2024-09-19T04:15:15.803142+0000","last_became_active":"2024-09-19T04:14:31.295042+0000","last_became_peered":"2024-09-19T04:14:31.295042+0000","last_unstale":"2024-09-19T04:15:15.803142+0000","last_undegraded":"2024-09-19T04:15:15.803142+0000","last_fullsized":"2024-09-19T04:15:15.803142+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:35.842847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711078+0000","last_change":"2024-09-19T04:14:40.370790+0000","last_active":"2024-09-19T04:14:43.711078+0000","last_peered":"2024-09-19T04:14:43.711078+0000","last_clean":"2024-09-19T04:14:43.711078+0000","last_became_active":"2024-09-19T04:14:40.370377+0000","last_became_peered":"2024-09-19T04:14:40.370377+0000","last_unstale":"2024-09-19T04:14:43.711078+0000","last_undegraded":"2024-09-19T04:14:43.711078+0000","last_fullsized":"2024-09-19T04:14:43.711078+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:09.331769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711295+0000","last_change":"2024-09-19T04:14:33.318796+0000","last_active":"2024-09-19T04:14:43.711295+0000","last_peered":"2024-09-19T04:14:43.711295+0000","last_clean":"2024-09-19T04:14:43.711295+0000","last_became_active":"2024-09-19T04:14:33.317864+0000","last_became_peered":"2024-09-19T04:14:33.317864+0000","last_unstale":"2024-09-19T04:14:43.711295+0000","last_undegraded":"2024-09-19T04:14:43.711295+0000","last_fullsized":"2024-09-19T04:14:43.711295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:15:19.122715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:16.822138+0000","last_change":"2024-09-19T04:14:31.322413+0000","last_active":"2024-09-19T04:15:16.822138+0000","last_peered":"2024-09-19T04:15:16.822138+0000","last_clean":"2024-09-19T04:15:16.822138+0000","last_became_active":"2024-09-19T04:14:31.322082+0000","last_became_peered":"2024-09-19T04:14:31.322082+0000","last_unstale":"2024-09-19T04:15:16.822138+0000","last_undegraded":"2024-09-19T04:15:16.822138+0000","last_fullsized":"2024-09-19T04:15:16.822138+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:50.010021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.710786+0000","last_change":"2024-09-19T04:14:40.373071+0000","last_active":"2024-09-19T04:14:43.710786+0000","last_peered":"2024-09-19T04:14:43.710786+0000","last_clean":"2024-09-19T04:14:43.710786+0000","last_became_active":"2024-09-19T04:14:40.372679+0000","last_became_peered":"2024-09-19T04:14:40.372679+0000","last_unstale":"2024-09-19T04:14:43.710786+0000","last_undegraded":"2024-09-19T04:14:43.710786+0000","last_fullsized":"2024-09-19T04:14:43.710786+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:23.136807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.369081+0000","last_change":"2024-09-19T04:14:33.319165+0000","last_active":"2024-09-19T04:14:43.369081+0000","last_peered":"2024-09-19T04:14:43.369081+0000","last_clean":"2024-09-19T04:14:43.369081+0000","last_became_active":"2024-09-19T04:14:33.318830+0000","last_became_peered":"2024-09-19T04:14:33.318830+0000","last_unstale":"2024-09-19T04:14:43.369081+0000","last_undegraded":"2024-09-19T04:14:43.369081+0000","last_fullsized":"2024-09-19T04:14:43.369081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:05:43.936069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'6","reported_seq":51,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:27.842228+0000","last_change":"2024-09-19T04:14:31.291564+0000","last_active":"2024-09-19T04:15:27.842228+0000","last_peered":"2024-09-19T04:15:27.842228+0000","last_clean":"2024-09-19T04:15:27.842228+0000","last_became_active":"2024-09-19T04:14:31.291241+0000","last_became_peered":"2024-09-19T04:14:31.291241+0000","last_unstale":"2024-09-19T04:15:27.842228+0000","last_undegraded":"2024-09-19T04:15:27.842228+0000","last_fullsized":"2024-09-19T04:15:27.842228+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:38:09.419140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711681+0000","last_change":"2024-09-19T04:14:40.371707+0000","last_active":"2024-09-19T04:14:43.711681+0000","last_peered":"2024-09-19T04:14:43.711681+0000","last_clean":"2024-09-19T04:14:43.711681+0000","last_became_active":"2024-09-19T04:14:40.370767+0000","last_became_peered":"2024-09-19T04:14:40.370767+0000","last_unstale":"2024-09-19T04:14:43.711681+0000","last_undegraded":"2024-09-19T04:14:43.711681+0000","last_fullsized":"2024-09-19T04:14:43.711681+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:38.022486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.369315+0000","last_change":"2024-09-19T04:14:33.316098+0000","last_active":"2024-09-19T04:14:43.369315+0000","last_peered":"2024-09-19T04:14:43.369315+0000","last_clean":"2024-09-19T04:14:43.369315+0000","last_became_active":"2024-09-19T04:14:33.315755+0000","last_became_peered":"2024-09-19T04:14:33.315755+0000","last_unstale":"2024-09-19T04:14:43.369315+0000","last_undegraded":"2024-09-19T04:14:43.369315+0000","last_fullsized":"2024-09-19T04:14:43.369315+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:45:01.531200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:16.820748+0000","last_change":"2024-09-19T04:14:31.291145+0000","last_active":"2024-09-19T04:15:16.820748+0000","last_peered":"2024-09-19T04:15:16.820748+0000","last_clean":"2024-09-19T04:15:16.820748+0000","last_became_active":"2024-09-19T04:14:31.290763+0000","last_became_peered":"2024-09-19T04:14:31.290763+0000","last_unstale":"2024-09-19T04:15:16.820748+0000","last_undegraded":"2024-09-19T04:15:16.820748+0000","last_fullsized":"2024-09-19T04:15:16.820748+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:37.556544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711990+0000","last_change":"2024-09-19T04:14:40.371371+0000","last_active":"2024-09-19T04:14:43.711990+0000","last_peered":"2024-09-19T04:14:43.711990+0000","last_clean":"2024-09-19T04:14:43.711990+0000","last_became_active":"2024-09-19T04:14:40.370988+0000","last_became_peered":"2024-09-19T04:14:40.370988+0000","last_unstale":"2024-09-19T04:14:43.711990+0000","last_undegraded":"2024-09-19T04:14:43.711990+0000","last_fullsized":"2024-09-19T04:14:43.711990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:57.089953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.710861+0000","last_change":"2024-09-19T04:14:33.310019+0000","last_active":"2024-09-19T04:14:43.710861+0000","last_peered":"2024-09-19T04:14:43.710861+0000","last_clean":"2024-09-19T04:14:43.710861+0000","last_became_active":"2024-09-19T04:14:33.309671+0000","last_became_peered":"2024-09-19T04:14:33.309671+0000","last_unstale":"2024-09-19T04:14:43.710861+0000","last_undegraded":"2024-09-19T04:14:43.710861+0000","last_fullsized":"2024-09-19T04:14:43.710861+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:37.146543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:17.823575+0000","last_change":"2024-09-19T04:14:31.297106+0000","last_active":"2024-09-19T04:15:17.823575+0000","last_peered":"2024-09-19T04:15:17.823575+0000","last_clean":"2024-09-19T04:15:17.823575+0000","last_became_active":"2024-09-19T04:14:31.296688+0000","last_became_peered":"2024-09-19T04:14:31.296688+0000","last_unstale":"2024-09-19T04:15:17.823575+0000","last_undegraded":"2024-09-19T04:15:17.823575+0000","last_fullsized":"2024-09-19T04:15:17.823575+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:18.882219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711395+0000","last_change":"2024-09-19T04:14:40.371641+0000","last_active":"2024-09-19T04:14:43.711395+0000","last_peered":"2024-09-19T04:14:43.711395+0000","last_clean":"2024-09-19T04:14:43.711395+0000","last_became_active":"2024-09-19T04:14:40.370354+0000","last_became_peered":"2024-09-19T04:14:40.370354+0000","last_unstale":"2024-09-19T04:14:43.711395+0000","last_undegraded":"2024-09-19T04:14:43.711395+0000","last_fullsized":"2024-09-19T04:14:43.711395+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:01:11.572011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712002+0000","last_change":"2024-09-19T04:14:33.307767+0000","last_active":"2024-09-19T04:14:43.712002+0000","last_peered":"2024-09-19T04:14:43.712002+0000","last_clean":"2024-09-19T04:14:43.712002+0000","last_became_active":"2024-09-19T04:14:33.307396+0000","last_became_peered":"2024-09-19T04:14:33.307396+0000","last_unstale":"2024-09-19T04:14:43.712002+0000","last_undegraded":"2024-09-19T04:14:43.712002+0000","last_fullsized":"2024-09-19T04:14:43.712002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:21.018641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'31","reported_seq":87,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:27.806145+0000","last_change":"2024-09-19T04:14:31.298106+0000","last_active":"2024-09-19T04:15:27.806145+0000","last_peered":"2024-09-19T04:15:27.806145+0000","last_clean":"2024-09-19T04:15:27.806145+0000","last_became_active":"2024-09-19T04:14:31.297731+0000","last_became_peered":"2024-09-19T04:14:31.297731+0000","last_unstale":"2024-09-19T04:15:27.806145+0000","last_undegraded":"2024-09-19T04:15:27.806145+0000","last_fullsized":"2024-09-19T04:15:27.806145+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:29.127759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51899,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":26,"num_read_kb":55,"num_write":33,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711164+0000","last_change":"2024-09-19T04:14:40.372927+0000","last_active":"2024-09-19T04:14:43.711164+0000","last_peered":"2024-09-19T04:14:43.711164+0000","last_clean":"2024-09-19T04:14:43.711164+0000","last_became_active":"2024-09-19T04:14:40.372521+0000","last_became_peered":"2024-09-19T04:14:40.372521+0000","last_unstale":"2024-09-19T04:14:43.711164+0000","last_undegraded":"2024-09-19T04:14:43.711164+0000","last_fullsized":"2024-09-19T04:14:43.711164+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:15:00.863812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711709+0000","last_change":"2024-09-19T04:14:33.308154+0000","last_active":"2024-09-19T04:14:43.711709+0000","last_peered":"2024-09-19T04:14:43.711709+0000","last_clean":"2024-09-19T04:14:43.711709+0000","last_became_active":"2024-09-19T04:14:33.307831+0000","last_became_peered":"2024-09-19T04:14:33.307831+0000","last_unstale":"2024-09-19T04:14:43.711709+0000","last_undegraded":"2024-09-19T04:14:43.711709+0000","last_fullsized":"2024-09-19T04:14:43.711709+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:16:14.656133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:15.815705+0000","last_change":"2024-09-19T04:14:31.324011+0000","last_active":"2024-09-19T04:15:15.815705+0000","last_peered":"2024-09-19T04:15:15.815705+0000","last_clean":"2024-09-19T04:15:15.815705+0000","last_became_active":"2024-09-19T04:14:31.323622+0000","last_became_peered":"2024-09-19T04:14:31.323622+0000","last_unstale":"2024-09-19T04:15:15.815705+0000","last_undegraded":"2024-09-19T04:15:15.815705+0000","last_fullsized":"2024-09-19T04:15:15.815705+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:39.198602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711943+0000","last_change":"2024-09-19T04:14:40.365938+0000","last_active":"2024-09-19T04:14:43.711943+0000","last_peered":"2024-09-19T04:14:43.711943+0000","last_clean":"2024-09-19T04:14:43.711943+0000","last_became_active":"2024-09-19T04:14:40.365539+0000","last_became_peered":"2024-09-19T04:14:40.365539+0000","last_unstale":"2024-09-19T04:14:43.711943+0000","last_undegraded":"2024-09-19T04:14:43.711943+0000","last_fullsized":"2024-09-19T04:14:43.711943+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:09.723008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.948924+0000","last_change":"2024-09-19T04:14:33.316286+0000","last_active":"2024-09-19T04:14:43.948924+0000","last_peered":"2024-09-19T04:14:43.948924+0000","last_clean":"2024-09-19T04:14:43.948924+0000","last_became_active":"2024-09-19T04:14:33.315980+0000","last_became_peered":"2024-09-19T04:14:33.315980+0000","last_unstale":"2024-09-19T04:14:43.948924+0000","last_undegraded":"2024-09-19T04:14:43.948924+0000","last_fullsized":"2024-09-19T04:14:43.948924+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:58.383139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:16.820581+0000","last_change":"2024-09-19T04:14:31.299111+0000","last_active":"2024-09-19T04:15:16.820581+0000","last_peered":"2024-09-19T04:15:16.820581+0000","last_clean":"2024-09-19T04:15:16.820581+0000","last_became_active":"2024-09-19T04:14:31.298390+0000","last_became_peered":"2024-09-19T04:14:31.298390+0000","last_unstale":"2024-09-19T04:15:16.820581+0000","last_undegraded":"2024-09-19T04:15:16.820581+0000","last_fullsized":"2024-09-19T04:15:16.820581+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:39.710412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711459+0000","last_change":"2024-09-19T04:14:40.371108+0000","last_active":"2024-09-19T04:14:43.711459+0000","last_peered":"2024-09-19T04:14:43.711459+0000","last_clean":"2024-09-19T04:14:43.711459+0000","last_became_active":"2024-09-19T04:14:40.370729+0000","last_became_peered":"2024-09-19T04:14:40.370729+0000","last_unstale":"2024-09-19T04:14:43.711459+0000","last_undegraded":"2024-09-19T04:14:43.711459+0000","last_fullsized":"2024-09-19T04:14:43.711459+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:59.610235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711398+0000","last_change":"2024-09-19T04:14:33.314423+0000","last_active":"2024-09-19T04:14:43.711398+0000","last_peered":"2024-09-19T04:14:43.711398+0000","last_clean":"2024-09-19T04:14:43.711398+0000","last_became_active":"2024-09-19T04:14:33.314123+0000","last_became_peered":"2024-09-19T04:14:33.314123+0000","last_unstale":"2024-09-19T04:14:43.711398+0000","last_undegraded":"2024-09-19T04:14:43.711398+0000","last_fullsized":"2024-09-19T04:14:43.711398+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:29:57.781116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":54,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:26.839157+0000","last_change":"2024-09-19T04:14:31.293267+0000","last_active":"2024-09-19T04:15:26.839157+0000","last_peered":"2024-09-19T04:15:26.839157+0000","last_clean":"2024-09-19T04:15:26.839157+0000","last_became_active":"2024-09-19T04:14:31.292862+0000","last_became_peered":"2024-09-19T04:14:31.292862+0000","last_unstale":"2024-09-19T04:15:26.839157+0000","last_undegraded":"2024-09-19T04:15:26.839157+0000","last_fullsized":"2024-09-19T04:15:26.839157+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:37.876696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.368324+0000","last_change":"2024-09-19T04:14:40.373078+0000","last_active":"2024-09-19T04:14:43.368324+0000","last_peered":"2024-09-19T04:14:43.368324+0000","last_clean":"2024-09-19T04:14:43.368324+0000","last_became_active":"2024-09-19T04:14:40.372468+0000","last_became_peered":"2024-09-19T04:14:40.372468+0000","last_unstale":"2024-09-19T04:14:43.368324+0000","last_undegraded":"2024-09-19T04:14:43.368324+0000","last_fullsized":"2024-09-19T04:14:43.368324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:54.945801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.948696+0000","last_change":"2024-09-19T04:14:40.368946+0000","last_active":"2024-09-19T04:14:43.948696+0000","last_peered":"2024-09-19T04:14:43.948696+0000","last_clean":"2024-09-19T04:14:43.948696+0000","last_became_active":"2024-09-19T04:14:40.368549+0000","last_became_peered":"2024-09-19T04:14:40.368549+0000","last_unstale":"2024-09-19T04:14:43.948696+0000","last_undegraded":"2024-09-19T04:14:43.948696+0000","last_fullsized":"2024-09-19T04:14:43.948696+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:24.563488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711026+0000","last_change":"2024-09-19T04:14:33.307214+0000","last_active":"2024-09-19T04:14:43.711026+0000","last_peered":"2024-09-19T04:14:43.711026+0000","last_clean":"2024-09-19T04:14:43.711026+0000","last_became_active":"2024-09-19T04:14:33.306913+0000","last_became_peered":"2024-09-19T04:14:33.306913+0000","last_unstale":"2024-09-19T04:14:43.711026+0000","last_undegraded":"2024-09-19T04:14:43.711026+0000","last_fullsized":"2024-09-19T04:14:43.711026+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:49.402532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:16.820987+0000","last_change":"2024-09-19T04:14:31.294488+0000","last_active":"2024-09-19T04:15:16.820987+0000","last_peered":"2024-09-19T04:15:16.820987+0000","last_clean":"2024-09-19T04:15:16.820987+0000","last_became_active":"2024-09-19T04:14:31.294145+0000","last_became_peered":"2024-09-19T04:14:31.294145+0000","last_unstale":"2024-09-19T04:15:16.820987+0000","last_undegraded":"2024-09-19T04:15:16.820987+0000","last_fullsized":"2024-09-19T04:15:16.820987+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:28:19.411650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712482+0000","last_change":"2024-09-19T04:14:40.372366+0000","last_active":"2024-09-19T04:14:43.712482+0000","last_peered":"2024-09-19T04:14:43.712482+0000","last_clean":"2024-09-19T04:14:43.712482+0000","last_became_active":"2024-09-19T04:14:40.371922+0000","last_became_peered":"2024-09-19T04:14:40.371922+0000","last_unstale":"2024-09-19T04:14:43.712482+0000","last_undegraded":"2024-09-19T04:14:43.712482+0000","last_fullsized":"2024-09-19T04:14:43.712482+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:55:01.724088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.368109+0000","last_change":"2024-09-19T04:14:33.308351+0000","last_active":"2024-09-19T04:14:43.368109+0000","last_peered":"2024-09-19T04:14:43.368109+0000","last_clean":"2024-09-19T04:14:43.368109+0000","last_became_active":"2024-09-19T04:14:33.308052+0000","last_became_peered":"2024-09-19T04:14:33.308052+0000","last_unstale":"2024-09-19T04:14:43.368109+0000","last_undegraded":"2024-09-19T04:14:43.368109+0000","last_fullsized":"2024-09-19T04:14:43.368109+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:06:32.056738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:14.807694+0000","last_change":"2024-09-19T04:14:31.291742+0000","last_active":"2024-09-19T04:15:14.807694+0000","last_peered":"2024-09-19T04:15:14.807694+0000","last_clean":"2024-09-19T04:15:14.807694+0000","last_became_active":"2024-09-19T04:14:31.291315+0000","last_became_peered":"2024-09-19T04:14:31.291315+0000","last_unstale":"2024-09-19T04:15:14.807694+0000","last_undegraded":"2024-09-19T04:15:14.807694+0000","last_fullsized":"2024-09-19T04:15:14.807694+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:16.159276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:15.817082+0000","last_change":"2024-09-19T04:14:31.293898+0000","last_active":"2024-09-19T04:15:15.817082+0000","last_peered":"2024-09-19T04:15:15.817082+0000","last_clean":"2024-09-19T04:15:15.817082+0000","last_became_active":"2024-09-19T04:14:31.293499+0000","last_became_peered":"2024-09-19T04:14:31.293499+0000","last_unstale":"2024-09-19T04:15:15.817082+0000","last_undegraded":"2024-09-19T04:15:15.817082+0000","last_fullsized":"2024-09-19T04:15:15.817082+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:25:55.590644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711505+0000","last_change":"2024-09-19T04:14:33.314094+0000","last_active":"2024-09-19T04:14:43.711505+0000","last_peered":"2024-09-19T04:14:43.711505+0000","last_clean":"2024-09-19T04:14:43.711505+0000","last_became_active":"2024-09-19T04:14:33.312782+0000","last_became_peered":"2024-09-19T04:14:33.312782+0000","last_unstale":"2024-09-19T04:14:43.711505+0000","last_undegraded":"2024-09-19T04:14:43.711505+0000","last_fullsized":"2024-09-19T04:14:43.711505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:40.121676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.371218+0000","last_change":"2024-09-19T04:14:40.369159+0000","last_active":"2024-09-19T04:14:43.371218+0000","last_peered":"2024-09-19T04:14:43.371218+0000","last_clean":"2024-09-19T04:14:43.371218+0000","last_became_active":"2024-09-19T04:14:40.368732+0000","last_became_peered":"2024-09-19T04:14:40.368732+0000","last_unstale":"2024-09-19T04:14:43.371218+0000","last_undegraded":"2024-09-19T04:14:43.371218+0000","last_fullsized":"2024-09-19T04:14:43.371218+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:12:29.176834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:26.839901+0000","last_change":"2024-09-19T04:14:31.298260+0000","last_active":"2024-09-19T04:15:26.839901+0000","last_peered":"2024-09-19T04:15:26.839901+0000","last_clean":"2024-09-19T04:15:26.839901+0000","last_became_active":"2024-09-19T04:14:31.297802+0000","last_became_peered":"2024-09-19T04:14:31.297802+0000","last_unstale":"2024-09-19T04:15:26.839901+0000","last_undegraded":"2024-09-19T04:15:26.839901+0000","last_fullsized":"2024-09-19T04:15:26.839901+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:25:52.054848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712807+0000","last_change":"2024-09-19T04:14:33.300555+0000","last_active":"2024-09-19T04:14:43.712807+0000","last_peered":"2024-09-19T04:14:43.712807+0000","last_clean":"2024-09-19T04:14:43.712807+0000","last_became_active":"2024-09-19T04:14:33.300220+0000","last_became_peered":"2024-09-19T04:14:33.300220+0000","last_unstale":"2024-09-19T04:14:43.712807+0000","last_undegraded":"2024-09-19T04:14:43.712807+0000","last_fullsized":"2024-09-19T04:14:43.712807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:32.584140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.371062+0000","last_change":"2024-09-19T04:14:40.369471+0000","last_active":"2024-09-19T04:14:43.371062+0000","last_peered":"2024-09-19T04:14:43.371062+0000","last_clean":"2024-09-19T04:14:43.371062+0000","last_became_active":"2024-09-19T04:14:40.369065+0000","last_became_peered":"2024-09-19T04:14:40.369065+0000","last_unstale":"2024-09-19T04:14:43.371062+0000","last_undegraded":"2024-09-19T04:14:43.371062+0000","last_fullsized":"2024-09-19T04:14:43.371062+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:40:03.888553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711508+0000","last_change":"2024-09-19T04:14:33.312801+0000","last_active":"2024-09-19T04:14:43.711508+0000","last_peered":"2024-09-19T04:14:43.711508+0000","last_clean":"2024-09-19T04:14:43.711508+0000","last_became_active":"2024-09-19T04:14:33.312430+0000","last_became_peered":"2024-09-19T04:14:33.312430+0000","last_unstale":"2024-09-19T04:14:43.711508+0000","last_undegraded":"2024-09-19T04:14:43.711508+0000","last_fullsized":"2024-09-19T04:14:43.711508+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:29.069507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.371003+0000","last_change":"2024-09-19T04:14:33.313076+0000","last_active":"2024-09-19T04:14:43.371003+0000","last_peered":"2024-09-19T04:14:43.371003+0000","last_clean":"2024-09-19T04:14:43.371003+0000","last_became_active":"2024-09-19T04:14:33.312730+0000","last_became_peered":"2024-09-19T04:14:33.312730+0000","last_unstale":"2024-09-19T04:14:43.371003+0000","last_undegraded":"2024-09-19T04:14:43.371003+0000","last_fullsized":"2024-09-19T04:14:43.371003+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:33.397309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.370673+0000","last_change":"2024-09-19T04:14:33.314724+0000","last_active":"2024-09-19T04:14:43.370673+0000","last_peered":"2024-09-19T04:14:43.370673+0000","last_clean":"2024-09-19T04:14:43.370673+0000","last_became_active":"2024-09-19T04:14:33.314359+0000","last_became_peered":"2024-09-19T04:14:33.314359+0000","last_unstale":"2024-09-19T04:14:43.370673+0000","last_undegraded":"2024-09-19T04:14:43.370673+0000","last_fullsized":"2024-09-19T04:14:43.370673+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:37:39.357193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.948592+0000","last_change":"2024-09-19T04:14:33.312834+0000","last_active":"2024-09-19T04:14:43.948592+0000","last_peered":"2024-09-19T04:14:43.948592+0000","last_clean":"2024-09-19T04:14:43.948592+0000","last_became_active":"2024-09-19T04:14:33.312538+0000","last_became_peered":"2024-09-19T04:14:33.312538+0000","last_unstale":"2024-09-19T04:14:43.948592+0000","last_undegraded":"2024-09-19T04:14:43.948592+0000","last_fullsized":"2024-09-19T04:14:43.948592+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:25:37.694910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711069+0000","last_change":"2024-09-19T04:14:33.305735+0000","last_active":"2024-09-19T04:14:43.711069+0000","last_peered":"2024-09-19T04:14:43.711069+0000","last_clean":"2024-09-19T04:14:43.711069+0000","last_became_active":"2024-09-19T04:14:33.305415+0000","last_became_peered":"2024-09-19T04:14:33.305415+0000","last_unstale":"2024-09-19T04:14:43.711069+0000","last_undegraded":"2024-09-19T04:14:43.711069+0000","last_fullsized":"2024-09-19T04:14:43.711069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:20.160211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712411+0000","last_change":"2024-09-19T04:14:33.313379+0000","last_active":"2024-09-19T04:14:43.712411+0000","last_peered":"2024-09-19T04:14:43.712411+0000","last_clean":"2024-09-19T04:14:43.712411+0000","last_became_active":"2024-09-19T04:14:33.312453+0000","last_became_peered":"2024-09-19T04:14:33.312453+0000","last_unstale":"2024-09-19T04:14:43.712411+0000","last_undegraded":"2024-09-19T04:14:43.712411+0000","last_fullsized":"2024-09-19T04:14:43.712411+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:44.832004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.371295+0000","last_change":"2024-09-19T04:14:33.307371+0000","last_active":"2024-09-19T04:14:43.371295+0000","last_peered":"2024-09-19T04:14:43.371295+0000","last_clean":"2024-09-19T04:14:43.371295+0000","last_became_active":"2024-09-19T04:14:33.307033+0000","last_became_peered":"2024-09-19T04:14:33.307033+0000","last_unstale":"2024-09-19T04:14:43.371295+0000","last_undegraded":"2024-09-19T04:14:43.371295+0000","last_fullsized":"2024-09-19T04:14:43.371295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:12.027213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.368794+0000","last_change":"2024-09-19T04:14:33.313425+0000","last_active":"2024-09-19T04:14:43.368794+0000","last_peered":"2024-09-19T04:14:43.368794+0000","last_clean":"2024-09-19T04:14:43.368794+0000","last_became_active":"2024-09-19T04:14:33.313103+0000","last_became_peered":"2024-09-19T04:14:33.313103+0000","last_unstale":"2024-09-19T04:14:43.368794+0000","last_undegraded":"2024-09-19T04:14:43.368794+0000","last_fullsized":"2024-09-19T04:14:43.368794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:53.699886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.710929+0000","last_change":"2024-09-19T04:14:33.314296+0000","last_active":"2024-09-19T04:14:43.710929+0000","last_peered":"2024-09-19T04:14:43.710929+0000","last_clean":"2024-09-19T04:14:43.710929+0000","last_became_active":"2024-09-19T04:14:33.311230+0000","last_became_peered":"2024-09-19T04:14:33.311230+0000","last_unstale":"2024-09-19T04:14:43.710929+0000","last_undegraded":"2024-09-19T04:14:43.710929+0000","last_fullsized":"2024-09-19T04:14:43.710929+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:37:51.395086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.368295+0000","last_change":"2024-09-19T04:14:33.317125+0000","last_active":"2024-09-19T04:14:43.368295+0000","last_peered":"2024-09-19T04:14:43.368295+0000","last_clean":"2024-09-19T04:14:43.368295+0000","last_became_active":"2024-09-19T04:14:33.316805+0000","last_became_peered":"2024-09-19T04:14:33.316805+0000","last_unstale":"2024-09-19T04:14:43.368295+0000","last_undegraded":"2024-09-19T04:14:43.368295+0000","last_fullsized":"2024-09-19T04:14:43.368295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:27.754882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711406+0000","last_change":"2024-09-19T04:14:33.310081+0000","last_active":"2024-09-19T04:14:43.711406+0000","last_peered":"2024-09-19T04:14:43.711406+0000","last_clean":"2024-09-19T04:14:43.711406+0000","last_became_active":"2024-09-19T04:14:33.308675+0000","last_became_peered":"2024-09-19T04:14:33.308675+0000","last_unstale":"2024-09-19T04:14:43.711406+0000","last_undegraded":"2024-09-19T04:14:43.711406+0000","last_fullsized":"2024-09-19T04:14:43.711406+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:58.187633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711236+0000","last_change":"2024-09-19T04:14:33.308220+0000","last_active":"2024-09-19T04:14:43.711236+0000","last_peered":"2024-09-19T04:14:43.711236+0000","last_clean":"2024-09-19T04:14:43.711236+0000","last_became_active":"2024-09-19T04:14:33.307934+0000","last_became_peered":"2024-09-19T04:14:33.307934+0000","last_unstale":"2024-09-19T04:14:43.711236+0000","last_undegraded":"2024-09-19T04:14:43.711236+0000","last_fullsized":"2024-09-19T04:14:43.711236+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:22.490250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712016+0000","last_change":"2024-09-19T04:14:33.306617+0000","last_active":"2024-09-19T04:14:43.712016+0000","last_peered":"2024-09-19T04:14:43.712016+0000","last_clean":"2024-09-19T04:14:43.712016+0000","last_became_active":"2024-09-19T04:14:33.306244+0000","last_became_peered":"2024-09-19T04:14:33.306244+0000","last_unstale":"2024-09-19T04:14:43.712016+0000","last_undegraded":"2024-09-19T04:14:43.712016+0000","last_fullsized":"2024-09-19T04:14:43.712016+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:22.095989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.371169+0000","last_change":"2024-09-19T04:14:33.314915+0000","last_active":"2024-09-19T04:14:43.371169+0000","last_peered":"2024-09-19T04:14:43.371169+0000","last_clean":"2024-09-19T04:14:43.371169+0000","last_became_active":"2024-09-19T04:14:33.314601+0000","last_became_peered":"2024-09-19T04:14:33.314601+0000","last_unstale":"2024-09-19T04:14:43.371169+0000","last_undegraded":"2024-09-19T04:14:43.371169+0000","last_fullsized":"2024-09-19T04:14:43.371169+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:37.687964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711656+0000","last_change":"2024-09-19T04:14:33.304667+0000","last_active":"2024-09-19T04:14:43.711656+0000","last_peered":"2024-09-19T04:14:43.711656+0000","last_clean":"2024-09-19T04:14:43.711656+0000","last_became_active":"2024-09-19T04:14:33.304356+0000","last_became_peered":"2024-09-19T04:14:33.304356+0000","last_unstale":"2024-09-19T04:14:43.711656+0000","last_undegraded":"2024-09-19T04:14:43.711656+0000","last_fullsized":"2024-09-19T04:14:43.711656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:37.128074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712601+0000","last_change":"2024-09-19T04:14:33.310002+0000","last_active":"2024-09-19T04:14:43.712601+0000","last_peered":"2024-09-19T04:14:43.712601+0000","last_clean":"2024-09-19T04:14:43.712601+0000","last_became_active":"2024-09-19T04:14:33.309639+0000","last_became_peered":"2024-09-19T04:14:33.309639+0000","last_unstale":"2024-09-19T04:14:43.712601+0000","last_undegraded":"2024-09-19T04:14:43.712601+0000","last_fullsized":"2024-09-19T04:14:43.712601+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:21.954435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.710526+0000","last_change":"2024-09-19T04:14:33.307296+0000","last_active":"2024-09-19T04:14:43.710526+0000","last_peered":"2024-09-19T04:14:43.710526+0000","last_clean":"2024-09-19T04:14:43.710526+0000","last_became_active":"2024-09-19T04:14:33.306998+0000","last_became_peered":"2024-09-19T04:14:33.306998+0000","last_unstale":"2024-09-19T04:14:43.710526+0000","last_undegraded":"2024-09-19T04:14:43.710526+0000","last_fullsized":"2024-09-19T04:14:43.710526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:55.833196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.948326+0000","last_change":"2024-09-19T04:14:33.313568+0000","last_active":"2024-09-19T04:14:43.948326+0000","last_peered":"2024-09-19T04:14:43.948326+0000","last_clean":"2024-09-19T04:14:43.948326+0000","last_became_active":"2024-09-19T04:14:33.313228+0000","last_became_peered":"2024-09-19T04:14:33.313228+0000","last_unstale":"2024-09-19T04:14:43.948326+0000","last_undegraded":"2024-09-19T04:14:43.948326+0000","last_fullsized":"2024-09-19T04:14:43.948326+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:31:43.348866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.948320+0000","last_change":"2024-09-19T04:14:33.309745+0000","last_active":"2024-09-19T04:14:43.948320+0000","last_peered":"2024-09-19T04:14:43.948320+0000","last_clean":"2024-09-19T04:14:43.948320+0000","last_became_active":"2024-09-19T04:14:33.309327+0000","last_became_peered":"2024-09-19T04:14:33.309327+0000","last_unstale":"2024-09-19T04:14:43.948320+0000","last_undegraded":"2024-09-19T04:14:43.948320+0000","last_fullsized":"2024-09-19T04:14:43.948320+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:05.081550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711171+0000","last_change":"2024-09-19T04:14:33.306186+0000","last_active":"2024-09-19T04:14:43.711171+0000","last_peered":"2024-09-19T04:14:43.711171+0000","last_clean":"2024-09-19T04:14:43.711171+0000","last_became_active":"2024-09-19T04:14:33.305865+0000","last_became_peered":"2024-09-19T04:14:33.305865+0000","last_unstale":"2024-09-19T04:14:43.711171+0000","last_undegraded":"2024-09-19T04:14:43.711171+0000","last_fullsized":"2024-09-19T04:14:43.711171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:33.054326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712438+0000","last_change":"2024-09-19T04:14:33.307667+0000","last_active":"2024-09-19T04:14:43.712438+0000","last_peered":"2024-09-19T04:14:43.712438+0000","last_clean":"2024-09-19T04:14:43.712438+0000","last_became_active":"2024-09-19T04:14:33.307315+0000","last_became_peered":"2024-09-19T04:14:33.307315+0000","last_unstale":"2024-09-19T04:14:43.712438+0000","last_undegraded":"2024-09-19T04:14:43.712438+0000","last_fullsized":"2024-09-19T04:14:43.712438+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:52.209438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.369692+0000","last_change":"2024-09-19T04:14:33.312430+0000","last_active":"2024-09-19T04:14:43.369692+0000","last_peered":"2024-09-19T04:14:43.369692+0000","last_clean":"2024-09-19T04:14:43.369692+0000","last_became_active":"2024-09-19T04:14:33.311786+0000","last_became_peered":"2024-09-19T04:14:33.311786+0000","last_unstale":"2024-09-19T04:14:43.369692+0000","last_undegraded":"2024-09-19T04:14:43.369692+0000","last_fullsized":"2024-09-19T04:14:43.369692+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:17:25.785612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712369+0000","last_change":"2024-09-19T04:14:33.310478+0000","last_active":"2024-09-19T04:14:43.712369+0000","last_peered":"2024-09-19T04:14:43.712369+0000","last_clean":"2024-09-19T04:14:43.712369+0000","last_became_active":"2024-09-19T04:14:33.309960+0000","last_became_peered":"2024-09-19T04:14:33.309960+0000","last_unstale":"2024-09-19T04:14:43.712369+0000","last_undegraded":"2024-09-19T04:14:43.712369+0000","last_fullsized":"2024-09-19T04:14:43.712369+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:37:43.008022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711761+0000","last_change":"2024-09-19T04:14:33.312449+0000","last_active":"2024-09-19T04:14:43.711761+0000","last_peered":"2024-09-19T04:14:43.711761+0000","last_clean":"2024-09-19T04:14:43.711761+0000","last_became_active":"2024-09-19T04:14:33.312124+0000","last_became_peered":"2024-09-19T04:14:33.312124+0000","last_unstale":"2024-09-19T04:14:43.711761+0000","last_undegraded":"2024-09-19T04:14:43.711761+0000","last_fullsized":"2024-09-19T04:14:43.711761+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:53.556895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.368056+0000","last_change":"2024-09-19T04:14:33.317095+0000","last_active":"2024-09-19T04:14:43.368056+0000","last_peered":"2024-09-19T04:14:43.368056+0000","last_clean":"2024-09-19T04:14:43.368056+0000","last_became_active":"2024-09-19T04:14:33.316763+0000","last_became_peered":"2024-09-19T04:14:33.316763+0000","last_unstale":"2024-09-19T04:14:43.368056+0000","last_undegraded":"2024-09-19T04:14:43.368056+0000","last_fullsized":"2024-09-19T04:14:43.368056+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:14.894679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.369167+0000","last_change":"2024-09-19T04:14:33.316578+0000","last_active":"2024-09-19T04:14:43.369167+0000","last_peered":"2024-09-19T04:14:43.369167+0000","last_clean":"2024-09-19T04:14:43.369167+0000","last_became_active":"2024-09-19T04:14:33.316215+0000","last_became_peered":"2024-09-19T04:14:33.316215+0000","last_unstale":"2024-09-19T04:14:43.369167+0000","last_undegraded":"2024-09-19T04:14:43.369167+0000","last_fullsized":"2024-09-19T04:14:43.369167+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:18.770360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711326+0000","last_change":"2024-09-19T04:14:33.311095+0000","last_active":"2024-09-19T04:14:43.711326+0000","last_peered":"2024-09-19T04:14:43.711326+0000","last_clean":"2024-09-19T04:14:43.711326+0000","last_became_active":"2024-09-19T04:14:33.310738+0000","last_became_peered":"2024-09-19T04:14:33.310738+0000","last_unstale":"2024-09-19T04:14:43.711326+0000","last_undegraded":"2024-09-19T04:14:43.711326+0000","last_fullsized":"2024-09-19T04:14:43.711326+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:09:39.571303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711542+0000","last_change":"2024-09-19T04:14:33.309468+0000","last_active":"2024-09-19T04:14:43.711542+0000","last_peered":"2024-09-19T04:14:43.711542+0000","last_clean":"2024-09-19T04:14:43.711542+0000","last_became_active":"2024-09-19T04:14:33.309164+0000","last_became_peered":"2024-09-19T04:14:33.309164+0000","last_unstale":"2024-09-19T04:14:43.711542+0000","last_undegraded":"2024-09-19T04:14:43.711542+0000","last_fullsized":"2024-09-19T04:14:43.711542+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:05:19.193395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712274+0000","last_change":"2024-09-19T04:14:33.312916+0000","last_active":"2024-09-19T04:14:43.712274+0000","last_peered":"2024-09-19T04:14:43.712274+0000","last_clean":"2024-09-19T04:14:43.712274+0000","last_became_active":"2024-09-19T04:14:33.308283+0000","last_became_peered":"2024-09-19T04:14:33.308283+0000","last_unstale":"2024-09-19T04:14:43.712274+0000","last_undegraded":"2024-09-19T04:14:43.712274+0000","last_fullsized":"2024-09-19T04:14:43.712274+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:52.460487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.948547+0000","last_change":"2024-09-19T04:14:33.308268+0000","last_active":"2024-09-19T04:14:43.948547+0000","last_peered":"2024-09-19T04:14:43.948547+0000","last_clean":"2024-09-19T04:14:43.948547+0000","last_became_active":"2024-09-19T04:14:33.307945+0000","last_became_peered":"2024-09-19T04:14:33.307945+0000","last_unstale":"2024-09-19T04:14:43.948547+0000","last_undegraded":"2024-09-19T04:14:43.948547+0000","last_fullsized":"2024-09-19T04:14:43.948547+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:24.410351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.948687+0000","last_change":"2024-09-19T04:14:33.315522+0000","last_active":"2024-09-19T04:14:43.948687+0000","last_peered":"2024-09-19T04:14:43.948687+0000","last_clean":"2024-09-19T04:14:43.948687+0000","last_became_active":"2024-09-19T04:14:33.315220+0000","last_became_peered":"2024-09-19T04:14:33.315220+0000","last_unstale":"2024-09-19T04:14:43.948687+0000","last_undegraded":"2024-09-19T04:14:43.948687+0000","last_fullsized":"2024-09-19T04:14:43.948687+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:41:40.915933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712482+0000","last_change":"2024-09-19T04:14:33.309450+0000","last_active":"2024-09-19T04:14:43.712482+0000","last_peered":"2024-09-19T04:14:43.712482+0000","last_clean":"2024-09-19T04:14:43.712482+0000","last_became_active":"2024-09-19T04:14:33.309013+0000","last_became_peered":"2024-09-19T04:14:33.309013+0000","last_unstale":"2024-09-19T04:14:43.712482+0000","last_undegraded":"2024-09-19T04:14:43.712482+0000","last_fullsized":"2024-09-19T04:14:43.712482+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:49.523372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":59107,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":145,"num_read_kb":128,"num_write":240,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":168767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285207,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579928,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":950272,"data_stored":477677,"data_compressed":17723,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808861,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1081344,"data_stored":1108231,"data_compressed":53987,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972386,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":481703,"data_compressed":17723,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201318,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":970752,"data_stored":477985,"data_compressed":17723,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430251,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32184,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712968,"statfs":{"total":95995035648,"available":95962079232,"internally_reserved":0,"allocated":1024000,"data_stored":1074877,"data_compressed":53987,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593777,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":473504,"data_compressed":17723,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822710,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":1069673,"data_compressed":53987,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986234,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":477578,"data_compressed":17723,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215167,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":472819,"data_compressed":17723,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411397,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":526260,"data_compressed":17723,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":517879,"data_compressed":17723,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":974848,"data_stored":474567,"data_compressed":17723,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34629,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34629,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34629,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":45490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":53871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":54028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T04:15:32.352 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T04:15:32.613 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:32.992 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:32 smithi007 ceph-mon[31360]: pgmap v309: 129 pgs: 129 active+clean; 634 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.5 KiB/s wr, 13 op/s 2024-09-19T04:15:32.992 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:32 smithi007 ceph-mon[31360]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:15:33.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.074+0000 7f7bd63f7640 1 -- 172.21.15.7:0/3596373691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bd0103660 msgr2=0x7f7bd010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:33.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.074+0000 7f7bd63f7640 1 --2- 172.21.15.7:0/3596373691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bd0103660 0x7f7bd010bb50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8009900 tx=0x7f7bb802a480 comp rx=0 tx=0).stop 2024-09-19T04:15:33.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.074+0000 7f7bd63f7640 1 -- 172.21.15.7:0/3596373691 shutdown_connections 2024-09-19T04:15:33.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.074+0000 7f7bd63f7640 1 --2- 172.21.15.7:0/3596373691 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7bd010c170 0x7f7bd010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:33.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.074+0000 7f7bd63f7640 1 --2- 172.21.15.7:0/3596373691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bd0103660 0x7f7bd010bb50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:33.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.074+0000 7f7bd63f7640 1 --2- 172.21.15.7:0/3596373691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bd0102d40 0x7f7bd0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:33.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.074+0000 7f7bd63f7640 1 -- 172.21.15.7:0/3596373691 >> 172.21.15.7:0/3596373691 conn(0x7f7bd00fc7a0 msgr2=0x7f7bd00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:33.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.074+0000 7f7bd63f7640 1 -- 172.21.15.7:0/3596373691 shutdown_connections 2024-09-19T04:15:33.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.074+0000 7f7bd63f7640 1 -- 172.21.15.7:0/3596373691 wait complete. 2024-09-19T04:15:33.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.074+0000 7f7bd63f7640 1 Processor -- start 2024-09-19T04:15:33.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.074+0000 7f7bd63f7640 1 -- start start 2024-09-19T04:15:33.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.075+0000 7f7bd63f7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bd0102d40 0x7f7bd01984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:33.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.075+0000 7f7bd63f7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bd0103660 0x7f7bd0198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:33.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.075+0000 7f7bd63f7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7bd010c170 0x7f7bd019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:33.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.075+0000 7f7bd63f7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd0111fd0 con 0x7f7bd0102d40 2024-09-19T04:15:33.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.075+0000 7f7bd63f7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd0111e50 con 0x7f7bd0103660 2024-09-19T04:15:33.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.075+0000 7f7bd63f7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd0112150 con 0x7f7bd010c170 2024-09-19T04:15:33.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.075+0000 7f7bcffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bd0102d40 0x7f7bd01984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:33.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.075+0000 7f7bcffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bd0102d40 0x7f7bd01984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43674/0 (socket says 172.21.15.7:43674) 2024-09-19T04:15:33.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.075+0000 7f7bcffff640 1 -- 172.21.15.7:0/1072398755 learned_addr learned my addr 172.21.15.7:0/1072398755 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:33.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.075+0000 7f7bd4994640 1 --2- 172.21.15.7:0/1072398755 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7bd010c170 0x7f7bd019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:33.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.075+0000 7f7bc7fff640 1 --2- 172.21.15.7:0/1072398755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bd0103660 0x7f7bd0198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:33.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.075+0000 7f7bcffff640 1 -- 172.21.15.7:0/1072398755 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7bd010c170 msgr2=0x7f7bd019cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:33.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.075+0000 7f7bcffff640 1 --2- 172.21.15.7:0/1072398755 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7bd010c170 0x7f7bd019cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:33.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.075+0000 7f7bcffff640 1 -- 172.21.15.7:0/1072398755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bd0103660 msgr2=0x7f7bd0198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:33.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.075+0000 7f7bcffff640 1 --2- 172.21.15.7:0/1072398755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bd0103660 0x7f7bd0198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:33.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.075+0000 7f7bcffff640 1 -- 172.21.15.7:0/1072398755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd019d4a0 con 0x7f7bd0102d40 2024-09-19T04:15:33.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.075+0000 7f7bcffff640 1 --2- 172.21.15.7:0/1072398755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bd0102d40 0x7f7bd01984f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7bc000b4a0 tx=0x7f7bc000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:33.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.075+0000 7f7bcdffb640 1 -- 172.21.15.7:0/1072398755 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0014070 con 0x7f7bd0102d40 2024-09-19T04:15:33.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.075+0000 7f7bcdffb640 1 -- 172.21.15.7:0/1072398755 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bc0010af0 con 0x7f7bd0102d40 2024-09-19T04:15:33.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.075+0000 7f7bd63f7640 1 -- 172.21.15.7:0/1072398755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd019d790 con 0x7f7bd0102d40 2024-09-19T04:15:33.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.075+0000 7f7bcdffb640 1 -- 172.21.15.7:0/1072398755 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0017d10 con 0x7f7bd0102d40 2024-09-19T04:15:33.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.076+0000 7f7bd63f7640 1 -- 172.21.15.7:0/1072398755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd01a5070 con 0x7f7bd0102d40 2024-09-19T04:15:33.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.076+0000 7f7bd63f7640 1 -- 172.21.15.7:0/1072398755 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bd0103120 con 0x7f7bd0102d40 2024-09-19T04:15:33.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.078+0000 7f7bcdffb640 1 -- 172.21.15.7:0/1072398755 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f7bc0017070 con 0x7f7bd0102d40 2024-09-19T04:15:33.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.078+0000 7f7bcdffb640 1 --2- 172.21.15.7:0/1072398755 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f7bbc0a3350 0x7f7bbc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:33.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.079+0000 7f7bc7fff640 1 --2- 172.21.15.7:0/1072398755 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f7bbc0a3350 0x7f7bbc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:33.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.079+0000 7f7bcdffb640 1 -- 172.21.15.7:0/1072398755 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f7bc00cf2e0 con 0x7f7bd0102d40 2024-09-19T04:15:33.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.079+0000 7f7bc7fff640 1 --2- 172.21.15.7:0/1072398755 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f7bbc0a3350 0x7f7bbc0a5810 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7bd010d5b0 tx=0x7f7bb8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:33.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.082+0000 7f7bcdffb640 1 -- 172.21.15.7:0/1072398755 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7bc009bd70 con 0x7f7bd0102d40 2024-09-19T04:15:33.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:32 smithi102 ceph-mon[35446]: pgmap v309: 129 pgs: 129 active+clean; 634 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.5 KiB/s wr, 13 op/s 2024-09-19T04:15:33.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:32 smithi102 ceph-mon[35446]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:15:33.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.254+0000 7f7bd63f7640 1 -- 172.21.15.7:0/1072398755 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7bd0062630 con 0x7f7bbc0a3350 2024-09-19T04:15:33.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.262+0000 7f7bcdffb640 1 -- 172.21.15.7:0/1072398755 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340658 (secure 0 0 0) 0x7f7bd0062630 con 0x7f7bbc0a3350 2024-09-19T04:15:33.266 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:15:33.268 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-19T04:15:33.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.265+0000 7f7bd63f7640 1 -- 172.21.15.7:0/1072398755 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f7bbc0a3350 msgr2=0x7f7bbc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:33.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.265+0000 7f7bd63f7640 1 --2- 172.21.15.7:0/1072398755 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f7bbc0a3350 0x7f7bbc0a5810 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7bd010d5b0 tx=0x7f7bb8005a20 comp rx=0 tx=0).stop 2024-09-19T04:15:33.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.265+0000 7f7bd63f7640 1 -- 172.21.15.7:0/1072398755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bd0102d40 msgr2=0x7f7bd01984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:33.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.265+0000 7f7bd63f7640 1 --2- 172.21.15.7:0/1072398755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bd0102d40 0x7f7bd01984f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7bc000b4a0 tx=0x7f7bc000b960 comp rx=0 tx=0).stop 2024-09-19T04:15:33.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.265+0000 7f7bd63f7640 1 -- 172.21.15.7:0/1072398755 shutdown_connections 2024-09-19T04:15:33.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.265+0000 7f7bd63f7640 1 --2- 172.21.15.7:0/1072398755 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f7bbc0a3350 0x7f7bbc0a5810 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:33.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.265+0000 7f7bd63f7640 1 --2- 172.21.15.7:0/1072398755 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7bd010c170 0x7f7bd019cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:33.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.265+0000 7f7bd63f7640 1 --2- 172.21.15.7:0/1072398755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7bd0103660 0x7f7bd0198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:33.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.265+0000 7f7bd63f7640 1 --2- 172.21.15.7:0/1072398755 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7bd0102d40 0x7f7bd01984f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:33.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.265+0000 7f7bd63f7640 1 -- 172.21.15.7:0/1072398755 >> 172.21.15.7:0/1072398755 conn(0x7f7bd00fc7a0 msgr2=0x7f7bd00fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:33.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.265+0000 7f7bd63f7640 1 -- 172.21.15.7:0/1072398755 shutdown_connections 2024-09-19T04:15:33.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:33.265+0000 7f7bd63f7640 1 -- 172.21.15.7:0/1072398755 wait complete. 2024-09-19T04:15:33.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:32 smithi092 ceph-mon[34940]: pgmap v309: 129 pgs: 129 active+clean; 634 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.5 KiB/s wr, 13 op/s 2024-09-19T04:15:33.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:32 smithi092 ceph-mon[34940]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:15:33.997 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":310,"stamp":"2024-09-19T04:15:33.133836+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658239,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":302,"num_read_kb":266,"num_write":424,"num_write_kb":3078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356736,"kb_used_data":11648,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585088,"statfs":{"total":1151940427776,"available":1151575130112,"internally_reserved":0,"allocated":11927552,"data_stored":7649861,"data_compressed":321468,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":19141,"internal_metadata":353154363},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":57605,"num_objects":3,"num_object_clones":0,"num_object_copies":11,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":144,"num_read_kb":133,"num_write":35,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003023"},"pg_stats":[{"pgid":"2.1f","version":"86'13","reported_seq":55,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:26.840247+0000","last_change":"2024-09-19T04:14:31.294836+0000","last_active":"2024-09-19T04:15:26.840247+0000","last_peered":"2024-09-19T04:15:26.840247+0000","last_clean":"2024-09-19T04:15:26.840247+0000","last_became_active":"2024-09-19T04:14:31.294589+0000","last_became_peered":"2024-09-19T04:14:31.294589+0000","last_unstale":"2024-09-19T04:15:26.840247+0000","last_undegraded":"2024-09-19T04:15:26.840247+0000","last_fullsized":"2024-09-19T04:15:26.840247+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:39:54.093519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.368625+0000","last_change":"2024-09-19T04:14:33.316023+0000","last_active":"2024-09-19T04:14:43.368625+0000","last_peered":"2024-09-19T04:14:43.368625+0000","last_clean":"2024-09-19T04:14:43.368625+0000","last_became_active":"2024-09-19T04:14:33.315732+0000","last_became_peered":"2024-09-19T04:14:33.315732+0000","last_unstale":"2024-09-19T04:14:43.368625+0000","last_undegraded":"2024-09-19T04:14:43.368625+0000","last_fullsized":"2024-09-19T04:14:43.368625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:00.782788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.370689+0000","last_change":"2024-09-19T04:14:40.368540+0000","last_active":"2024-09-19T04:14:43.370689+0000","last_peered":"2024-09-19T04:14:43.370689+0000","last_clean":"2024-09-19T04:14:43.370689+0000","last_became_active":"2024-09-19T04:14:40.367906+0000","last_became_peered":"2024-09-19T04:14:40.367906+0000","last_unstale":"2024-09-19T04:14:43.370689+0000","last_undegraded":"2024-09-19T04:14:43.370689+0000","last_fullsized":"2024-09-19T04:14:43.370689+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:35.660297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.368848+0000","last_change":"2024-09-19T04:14:31.321870+0000","last_active":"2024-09-19T04:14:43.368848+0000","last_peered":"2024-09-19T04:14:43.368848+0000","last_clean":"2024-09-19T04:14:43.368848+0000","last_became_active":"2024-09-19T04:14:31.321495+0000","last_became_peered":"2024-09-19T04:14:31.321495+0000","last_unstale":"2024-09-19T04:14:43.368848+0000","last_undegraded":"2024-09-19T04:14:43.368848+0000","last_fullsized":"2024-09-19T04:14:43.368848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:58.063748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.948907+0000","last_change":"2024-09-19T04:14:33.307451+0000","last_active":"2024-09-19T04:14:43.948907+0000","last_peered":"2024-09-19T04:14:43.948907+0000","last_clean":"2024-09-19T04:14:43.948907+0000","last_became_active":"2024-09-19T04:14:33.307129+0000","last_became_peered":"2024-09-19T04:14:33.307129+0000","last_unstale":"2024-09-19T04:14:43.948907+0000","last_undegraded":"2024-09-19T04:14:43.948907+0000","last_fullsized":"2024-09-19T04:14:43.948907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:28.851012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.710564+0000","last_change":"2024-09-19T04:14:40.367946+0000","last_active":"2024-09-19T04:14:43.710564+0000","last_peered":"2024-09-19T04:14:43.710564+0000","last_clean":"2024-09-19T04:14:43.710564+0000","last_became_active":"2024-09-19T04:14:40.367567+0000","last_became_peered":"2024-09-19T04:14:40.367567+0000","last_unstale":"2024-09-19T04:14:43.710564+0000","last_undegraded":"2024-09-19T04:14:43.710564+0000","last_fullsized":"2024-09-19T04:14:43.710564+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:14:29.244838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:17.817265+0000","last_change":"2024-09-19T04:14:31.298497+0000","last_active":"2024-09-19T04:15:17.817265+0000","last_peered":"2024-09-19T04:15:17.817265+0000","last_clean":"2024-09-19T04:15:17.817265+0000","last_became_active":"2024-09-19T04:14:31.298185+0000","last_became_peered":"2024-09-19T04:14:31.298185+0000","last_unstale":"2024-09-19T04:15:17.817265+0000","last_undegraded":"2024-09-19T04:15:17.817265+0000","last_fullsized":"2024-09-19T04:15:17.817265+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:56:12.701718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711621+0000","last_change":"2024-09-19T04:14:33.316922+0000","last_active":"2024-09-19T04:14:43.711621+0000","last_peered":"2024-09-19T04:14:43.711621+0000","last_clean":"2024-09-19T04:14:43.711621+0000","last_became_active":"2024-09-19T04:14:33.316613+0000","last_became_peered":"2024-09-19T04:14:33.316613+0000","last_unstale":"2024-09-19T04:14:43.711621+0000","last_undegraded":"2024-09-19T04:14:43.711621+0000","last_fullsized":"2024-09-19T04:14:43.711621+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:22.237900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711475+0000","last_change":"2024-09-19T04:14:40.368946+0000","last_active":"2024-09-19T04:14:43.711475+0000","last_peered":"2024-09-19T04:14:43.711475+0000","last_clean":"2024-09-19T04:14:43.711475+0000","last_became_active":"2024-09-19T04:14:40.368473+0000","last_became_peered":"2024-09-19T04:14:40.368473+0000","last_unstale":"2024-09-19T04:14:43.711475+0000","last_undegraded":"2024-09-19T04:14:43.711475+0000","last_fullsized":"2024-09-19T04:14:43.711475+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:52.199524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:16.822660+0000","last_change":"2024-09-19T04:14:31.294330+0000","last_active":"2024-09-19T04:15:16.822660+0000","last_peered":"2024-09-19T04:15:16.822660+0000","last_clean":"2024-09-19T04:15:16.822660+0000","last_became_active":"2024-09-19T04:14:31.293025+0000","last_became_peered":"2024-09-19T04:14:31.293025+0000","last_unstale":"2024-09-19T04:15:16.822660+0000","last_undegraded":"2024-09-19T04:15:16.822660+0000","last_fullsized":"2024-09-19T04:15:16.822660+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:48.276096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712554+0000","last_change":"2024-09-19T04:14:33.313560+0000","last_active":"2024-09-19T04:14:43.712554+0000","last_peered":"2024-09-19T04:14:43.712554+0000","last_clean":"2024-09-19T04:14:43.712554+0000","last_became_active":"2024-09-19T04:14:33.313200+0000","last_became_peered":"2024-09-19T04:14:33.313200+0000","last_unstale":"2024-09-19T04:14:43.712554+0000","last_undegraded":"2024-09-19T04:14:43.712554+0000","last_fullsized":"2024-09-19T04:14:43.712554+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:33.807866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711318+0000","last_change":"2024-09-19T04:14:40.368125+0000","last_active":"2024-09-19T04:14:43.711318+0000","last_peered":"2024-09-19T04:14:43.711318+0000","last_clean":"2024-09-19T04:14:43.711318+0000","last_became_active":"2024-09-19T04:14:40.367772+0000","last_became_peered":"2024-09-19T04:14:40.367772+0000","last_unstale":"2024-09-19T04:14:43.711318+0000","last_undegraded":"2024-09-19T04:14:43.711318+0000","last_fullsized":"2024-09-19T04:14:43.711318+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:07:19.740391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.369526+0000","last_change":"2024-09-19T04:14:33.307489+0000","last_active":"2024-09-19T04:14:43.369526+0000","last_peered":"2024-09-19T04:14:43.369526+0000","last_clean":"2024-09-19T04:14:43.369526+0000","last_became_active":"2024-09-19T04:14:33.307143+0000","last_became_peered":"2024-09-19T04:14:33.307143+0000","last_unstale":"2024-09-19T04:14:43.369526+0000","last_undegraded":"2024-09-19T04:14:43.369526+0000","last_fullsized":"2024-09-19T04:14:43.369526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:51:14.018972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:13.801550+0000","last_change":"2024-09-19T04:14:31.299342+0000","last_active":"2024-09-19T04:15:13.801550+0000","last_peered":"2024-09-19T04:15:13.801550+0000","last_clean":"2024-09-19T04:15:13.801550+0000","last_became_active":"2024-09-19T04:14:31.298927+0000","last_became_peered":"2024-09-19T04:14:31.298927+0000","last_unstale":"2024-09-19T04:15:13.801550+0000","last_undegraded":"2024-09-19T04:15:13.801550+0000","last_fullsized":"2024-09-19T04:15:13.801550+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:38.483077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712102+0000","last_change":"2024-09-19T04:14:40.405762+0000","last_active":"2024-09-19T04:14:43.712102+0000","last_peered":"2024-09-19T04:14:43.712102+0000","last_clean":"2024-09-19T04:14:43.712102+0000","last_became_active":"2024-09-19T04:14:40.405379+0000","last_became_peered":"2024-09-19T04:14:40.405379+0000","last_unstale":"2024-09-19T04:14:43.712102+0000","last_undegraded":"2024-09-19T04:14:43.712102+0000","last_fullsized":"2024-09-19T04:14:43.712102+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:41:36.628112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.368329+0000","last_change":"2024-09-19T04:14:33.318521+0000","last_active":"2024-09-19T04:14:43.368329+0000","last_peered":"2024-09-19T04:14:43.368329+0000","last_clean":"2024-09-19T04:14:43.368329+0000","last_became_active":"2024-09-19T04:14:33.318200+0000","last_became_peered":"2024-09-19T04:14:33.318200+0000","last_unstale":"2024-09-19T04:14:43.368329+0000","last_undegraded":"2024-09-19T04:14:43.368329+0000","last_fullsized":"2024-09-19T04:14:43.368329+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:45.497455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:15.816486+0000","last_change":"2024-09-19T04:14:31.299976+0000","last_active":"2024-09-19T04:15:15.816486+0000","last_peered":"2024-09-19T04:15:15.816486+0000","last_clean":"2024-09-19T04:15:15.816486+0000","last_became_active":"2024-09-19T04:14:31.299630+0000","last_became_peered":"2024-09-19T04:14:31.299630+0000","last_unstale":"2024-09-19T04:15:15.816486+0000","last_undegraded":"2024-09-19T04:15:15.816486+0000","last_fullsized":"2024-09-19T04:15:15.816486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:14:00.834440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.917948+0000","last_change":"2024-09-19T04:14:40.366110+0000","last_active":"2024-09-19T04:14:43.917948+0000","last_peered":"2024-09-19T04:14:43.917948+0000","last_clean":"2024-09-19T04:14:43.917948+0000","last_became_active":"2024-09-19T04:14:40.365558+0000","last_became_peered":"2024-09-19T04:14:40.365558+0000","last_unstale":"2024-09-19T04:14:43.917948+0000","last_undegraded":"2024-09-19T04:14:43.917948+0000","last_fullsized":"2024-09-19T04:14:43.917948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:24.049603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711615+0000","last_change":"2024-09-19T04:14:33.307400+0000","last_active":"2024-09-19T04:14:43.711615+0000","last_peered":"2024-09-19T04:14:43.711615+0000","last_clean":"2024-09-19T04:14:43.711615+0000","last_became_active":"2024-09-19T04:14:33.307095+0000","last_became_peered":"2024-09-19T04:14:33.307095+0000","last_unstale":"2024-09-19T04:14:43.711615+0000","last_undegraded":"2024-09-19T04:14:43.711615+0000","last_fullsized":"2024-09-19T04:14:43.711615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:27.582568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:16.820428+0000","last_change":"2024-09-19T04:14:31.287190+0000","last_active":"2024-09-19T04:15:16.820428+0000","last_peered":"2024-09-19T04:15:16.820428+0000","last_clean":"2024-09-19T04:15:16.820428+0000","last_became_active":"2024-09-19T04:14:31.286817+0000","last_became_peered":"2024-09-19T04:14:31.286817+0000","last_unstale":"2024-09-19T04:15:16.820428+0000","last_undegraded":"2024-09-19T04:15:16.820428+0000","last_fullsized":"2024-09-19T04:15:16.820428+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:44.522615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711686+0000","last_change":"2024-09-19T04:14:40.372153+0000","last_active":"2024-09-19T04:14:43.711686+0000","last_peered":"2024-09-19T04:14:43.711686+0000","last_clean":"2024-09-19T04:14:43.711686+0000","last_became_active":"2024-09-19T04:14:40.371309+0000","last_became_peered":"2024-09-19T04:14:40.371309+0000","last_unstale":"2024-09-19T04:14:43.711686+0000","last_undegraded":"2024-09-19T04:14:43.711686+0000","last_fullsized":"2024-09-19T04:14:43.711686+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:46.608489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711797+0000","last_change":"2024-09-19T04:14:33.310884+0000","last_active":"2024-09-19T04:14:43.711797+0000","last_peered":"2024-09-19T04:14:43.711797+0000","last_clean":"2024-09-19T04:14:43.711797+0000","last_became_active":"2024-09-19T04:14:33.310532+0000","last_became_peered":"2024-09-19T04:14:33.310532+0000","last_unstale":"2024-09-19T04:14:43.711797+0000","last_undegraded":"2024-09-19T04:14:43.711797+0000","last_fullsized":"2024-09-19T04:14:43.711797+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:49:16.565018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:13.804039+0000","last_change":"2024-09-19T04:14:31.322216+0000","last_active":"2024-09-19T04:15:13.804039+0000","last_peered":"2024-09-19T04:15:13.804039+0000","last_clean":"2024-09-19T04:15:13.804039+0000","last_became_active":"2024-09-19T04:14:31.321941+0000","last_became_peered":"2024-09-19T04:14:31.321941+0000","last_unstale":"2024-09-19T04:15:13.804039+0000","last_undegraded":"2024-09-19T04:15:13.804039+0000","last_fullsized":"2024-09-19T04:15:13.804039+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:14.624104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712350+0000","last_change":"2024-09-19T04:14:40.405749+0000","last_active":"2024-09-19T04:14:43.712350+0000","last_peered":"2024-09-19T04:14:43.712350+0000","last_clean":"2024-09-19T04:14:43.712350+0000","last_became_active":"2024-09-19T04:14:40.405353+0000","last_became_peered":"2024-09-19T04:14:40.405353+0000","last_unstale":"2024-09-19T04:14:43.712350+0000","last_undegraded":"2024-09-19T04:14:43.712350+0000","last_fullsized":"2024-09-19T04:14:43.712350+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:13.311989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.948815+0000","last_change":"2024-09-19T04:14:33.312057+0000","last_active":"2024-09-19T04:14:43.948815+0000","last_peered":"2024-09-19T04:14:43.948815+0000","last_clean":"2024-09-19T04:14:43.948815+0000","last_became_active":"2024-09-19T04:14:33.311751+0000","last_became_peered":"2024-09-19T04:14:33.311751+0000","last_unstale":"2024-09-19T04:14:43.948815+0000","last_undegraded":"2024-09-19T04:14:43.948815+0000","last_fullsized":"2024-09-19T04:14:43.948815+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:28.843870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:16.822376+0000","last_change":"2024-09-19T04:14:31.287529+0000","last_active":"2024-09-19T04:15:16.822376+0000","last_peered":"2024-09-19T04:15:16.822376+0000","last_clean":"2024-09-19T04:15:16.822376+0000","last_became_active":"2024-09-19T04:14:31.287172+0000","last_became_peered":"2024-09-19T04:14:31.287172+0000","last_unstale":"2024-09-19T04:15:16.822376+0000","last_undegraded":"2024-09-19T04:15:16.822376+0000","last_fullsized":"2024-09-19T04:15:16.822376+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:32:23.351997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.370677+0000","last_change":"2024-09-19T04:14:40.363772+0000","last_active":"2024-09-19T04:14:43.370677+0000","last_peered":"2024-09-19T04:14:43.370677+0000","last_clean":"2024-09-19T04:14:43.370677+0000","last_became_active":"2024-09-19T04:14:40.363395+0000","last_became_peered":"2024-09-19T04:14:40.363395+0000","last_unstale":"2024-09-19T04:14:43.370677+0000","last_undegraded":"2024-09-19T04:14:43.370677+0000","last_fullsized":"2024-09-19T04:14:43.370677+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:22.090743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.368796+0000","last_change":"2024-09-19T04:14:33.310108+0000","last_active":"2024-09-19T04:14:43.368796+0000","last_peered":"2024-09-19T04:14:43.368796+0000","last_clean":"2024-09-19T04:14:43.368796+0000","last_became_active":"2024-09-19T04:14:33.309812+0000","last_became_peered":"2024-09-19T04:14:33.309812+0000","last_unstale":"2024-09-19T04:14:43.368796+0000","last_undegraded":"2024-09-19T04:14:43.368796+0000","last_fullsized":"2024-09-19T04:14:43.368796+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:48.570530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'13","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:27.334042+0000","last_change":"2024-09-19T04:14:31.293115+0000","last_active":"2024-09-19T04:15:27.334042+0000","last_peered":"2024-09-19T04:15:27.334042+0000","last_clean":"2024-09-19T04:15:27.334042+0000","last_became_active":"2024-09-19T04:14:31.292733+0000","last_became_peered":"2024-09-19T04:14:31.292733+0000","last_unstale":"2024-09-19T04:15:27.334042+0000","last_undegraded":"2024-09-19T04:15:27.334042+0000","last_fullsized":"2024-09-19T04:15:27.334042+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:11.936757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.368286+0000","last_change":"2024-09-19T04:14:40.405241+0000","last_active":"2024-09-19T04:14:43.368286+0000","last_peered":"2024-09-19T04:14:43.368286+0000","last_clean":"2024-09-19T04:14:43.368286+0000","last_became_active":"2024-09-19T04:14:40.404846+0000","last_became_peered":"2024-09-19T04:14:40.404846+0000","last_unstale":"2024-09-19T04:14:43.368286+0000","last_undegraded":"2024-09-19T04:14:43.368286+0000","last_fullsized":"2024-09-19T04:14:43.368286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:49.842644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711133+0000","last_change":"2024-09-19T04:14:33.305796+0000","last_active":"2024-09-19T04:14:43.711133+0000","last_peered":"2024-09-19T04:14:43.711133+0000","last_clean":"2024-09-19T04:14:43.711133+0000","last_became_active":"2024-09-19T04:14:33.305499+0000","last_became_peered":"2024-09-19T04:14:33.305499+0000","last_unstale":"2024-09-19T04:14:43.711133+0000","last_undegraded":"2024-09-19T04:14:43.711133+0000","last_fullsized":"2024-09-19T04:14:43.711133+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:08.357655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:16.822184+0000","last_change":"2024-09-19T04:14:31.322459+0000","last_active":"2024-09-19T04:15:16.822184+0000","last_peered":"2024-09-19T04:15:16.822184+0000","last_clean":"2024-09-19T04:15:16.822184+0000","last_became_active":"2024-09-19T04:14:31.322149+0000","last_became_peered":"2024-09-19T04:14:31.322149+0000","last_unstale":"2024-09-19T04:15:16.822184+0000","last_undegraded":"2024-09-19T04:15:16.822184+0000","last_fullsized":"2024-09-19T04:15:16.822184+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:06:15.208618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711391+0000","last_change":"2024-09-19T04:14:40.372869+0000","last_active":"2024-09-19T04:14:43.711391+0000","last_peered":"2024-09-19T04:14:43.711391+0000","last_clean":"2024-09-19T04:14:43.711391+0000","last_became_active":"2024-09-19T04:14:40.372203+0000","last_became_peered":"2024-09-19T04:14:40.372203+0000","last_unstale":"2024-09-19T04:14:43.711391+0000","last_undegraded":"2024-09-19T04:14:43.711391+0000","last_fullsized":"2024-09-19T04:14:43.711391+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:34.900656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711694+0000","last_change":"2024-09-19T04:14:33.315443+0000","last_active":"2024-09-19T04:14:43.711694+0000","last_peered":"2024-09-19T04:14:43.711694+0000","last_clean":"2024-09-19T04:14:43.711694+0000","last_became_active":"2024-09-19T04:14:33.315067+0000","last_became_peered":"2024-09-19T04:14:33.315067+0000","last_unstale":"2024-09-19T04:14:43.711694+0000","last_undegraded":"2024-09-19T04:14:43.711694+0000","last_fullsized":"2024-09-19T04:14:43.711694+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:59.194674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711412+0000","last_change":"2024-09-19T04:14:31.322623+0000","last_active":"2024-09-19T04:14:43.711412+0000","last_peered":"2024-09-19T04:14:43.711412+0000","last_clean":"2024-09-19T04:14:43.711412+0000","last_became_active":"2024-09-19T04:14:31.321838+0000","last_became_peered":"2024-09-19T04:14:31.321838+0000","last_unstale":"2024-09-19T04:14:43.711412+0000","last_undegraded":"2024-09-19T04:14:43.711412+0000","last_fullsized":"2024-09-19T04:14:43.711412+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:30:37.073072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712635+0000","last_change":"2024-09-19T04:14:40.406036+0000","last_active":"2024-09-19T04:14:43.712635+0000","last_peered":"2024-09-19T04:14:43.712635+0000","last_clean":"2024-09-19T04:14:43.712635+0000","last_became_active":"2024-09-19T04:14:40.405602+0000","last_became_peered":"2024-09-19T04:14:40.405602+0000","last_unstale":"2024-09-19T04:14:43.712635+0000","last_undegraded":"2024-09-19T04:14:43.712635+0000","last_fullsized":"2024-09-19T04:14:43.712635+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:09:50.013072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712024+0000","last_change":"2024-09-19T04:14:33.319748+0000","last_active":"2024-09-19T04:14:43.712024+0000","last_peered":"2024-09-19T04:14:43.712024+0000","last_clean":"2024-09-19T04:14:43.712024+0000","last_became_active":"2024-09-19T04:14:33.319173+0000","last_became_peered":"2024-09-19T04:14:33.319173+0000","last_unstale":"2024-09-19T04:14:43.712024+0000","last_undegraded":"2024-09-19T04:14:43.712024+0000","last_fullsized":"2024-09-19T04:14:43.712024+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:24.419811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'6","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:26.840684+0000","last_change":"2024-09-19T04:14:31.292077+0000","last_active":"2024-09-19T04:15:26.840684+0000","last_peered":"2024-09-19T04:15:26.840684+0000","last_clean":"2024-09-19T04:15:26.840684+0000","last_became_active":"2024-09-19T04:14:31.291737+0000","last_became_peered":"2024-09-19T04:14:31.291737+0000","last_unstale":"2024-09-19T04:15:26.840684+0000","last_undegraded":"2024-09-19T04:15:26.840684+0000","last_fullsized":"2024-09-19T04:15:26.840684+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:32.570641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711028+0000","last_change":"2024-09-19T04:14:40.369734+0000","last_active":"2024-09-19T04:14:43.711028+0000","last_peered":"2024-09-19T04:14:43.711028+0000","last_clean":"2024-09-19T04:14:43.711028+0000","last_became_active":"2024-09-19T04:14:40.367563+0000","last_became_peered":"2024-09-19T04:14:40.367563+0000","last_unstale":"2024-09-19T04:14:43.711028+0000","last_undegraded":"2024-09-19T04:14:43.711028+0000","last_fullsized":"2024-09-19T04:14:43.711028+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:47.229115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711047+0000","last_change":"2024-09-19T04:14:33.309687+0000","last_active":"2024-09-19T04:14:43.711047+0000","last_peered":"2024-09-19T04:14:43.711047+0000","last_clean":"2024-09-19T04:14:43.711047+0000","last_became_active":"2024-09-19T04:14:33.308692+0000","last_became_peered":"2024-09-19T04:14:33.308692+0000","last_unstale":"2024-09-19T04:14:43.711047+0000","last_undegraded":"2024-09-19T04:14:43.711047+0000","last_fullsized":"2024-09-19T04:14:43.711047+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:58.716927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":51,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:30.845006+0000","last_change":"2024-09-19T04:14:31.322024+0000","last_active":"2024-09-19T04:15:30.845006+0000","last_peered":"2024-09-19T04:15:30.845006+0000","last_clean":"2024-09-19T04:15:30.845006+0000","last_became_active":"2024-09-19T04:14:31.321640+0000","last_became_peered":"2024-09-19T04:14:31.321640+0000","last_unstale":"2024-09-19T04:15:30.845006+0000","last_undegraded":"2024-09-19T04:15:30.845006+0000","last_fullsized":"2024-09-19T04:15:30.845006+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:25:36.159774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.710872+0000","last_change":"2024-09-19T04:14:40.405793+0000","last_active":"2024-09-19T04:14:43.710872+0000","last_peered":"2024-09-19T04:14:43.710872+0000","last_clean":"2024-09-19T04:14:43.710872+0000","last_became_active":"2024-09-19T04:14:40.405354+0000","last_became_peered":"2024-09-19T04:14:40.405354+0000","last_unstale":"2024-09-19T04:14:43.710872+0000","last_undegraded":"2024-09-19T04:14:43.710872+0000","last_fullsized":"2024-09-19T04:14:43.710872+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:46:37.893202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.710421+0000","last_change":"2024-09-19T04:14:33.313007+0000","last_active":"2024-09-19T04:14:43.710421+0000","last_peered":"2024-09-19T04:14:43.710421+0000","last_clean":"2024-09-19T04:14:43.710421+0000","last_became_active":"2024-09-19T04:14:33.312665+0000","last_became_peered":"2024-09-19T04:14:33.312665+0000","last_unstale":"2024-09-19T04:14:43.710421+0000","last_undegraded":"2024-09-19T04:14:43.710421+0000","last_fullsized":"2024-09-19T04:14:43.710421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:09.976707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:14.807634+0000","last_change":"2024-09-19T04:14:31.294072+0000","last_active":"2024-09-19T04:15:14.807634+0000","last_peered":"2024-09-19T04:15:14.807634+0000","last_clean":"2024-09-19T04:15:14.807634+0000","last_became_active":"2024-09-19T04:14:31.293648+0000","last_became_peered":"2024-09-19T04:14:31.293648+0000","last_unstale":"2024-09-19T04:15:14.807634+0000","last_undegraded":"2024-09-19T04:15:14.807634+0000","last_fullsized":"2024-09-19T04:15:14.807634+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:14.910714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711885+0000","last_change":"2024-09-19T04:14:40.406327+0000","last_active":"2024-09-19T04:14:43.711885+0000","last_peered":"2024-09-19T04:14:43.711885+0000","last_clean":"2024-09-19T04:14:43.711885+0000","last_became_active":"2024-09-19T04:14:40.405602+0000","last_became_peered":"2024-09-19T04:14:40.405602+0000","last_unstale":"2024-09-19T04:14:43.711885+0000","last_undegraded":"2024-09-19T04:14:43.711885+0000","last_fullsized":"2024-09-19T04:14:43.711885+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:47:23.078480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.368363+0000","last_change":"2024-09-19T04:14:33.317183+0000","last_active":"2024-09-19T04:14:43.368363+0000","last_peered":"2024-09-19T04:14:43.368363+0000","last_clean":"2024-09-19T04:14:43.368363+0000","last_became_active":"2024-09-19T04:14:33.316883+0000","last_became_peered":"2024-09-19T04:14:33.316883+0000","last_unstale":"2024-09-19T04:14:43.368363+0000","last_undegraded":"2024-09-19T04:14:43.368363+0000","last_fullsized":"2024-09-19T04:14:43.368363+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:55.493883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:17.823780+0000","last_change":"2024-09-19T04:14:31.290207+0000","last_active":"2024-09-19T04:15:17.823780+0000","last_peered":"2024-09-19T04:15:17.823780+0000","last_clean":"2024-09-19T04:15:17.823780+0000","last_became_active":"2024-09-19T04:14:31.289863+0000","last_became_peered":"2024-09-19T04:14:31.289863+0000","last_unstale":"2024-09-19T04:15:17.823780+0000","last_undegraded":"2024-09-19T04:15:17.823780+0000","last_fullsized":"2024-09-19T04:15:17.823780+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:39.241894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":342,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.369321+0000","last_change":"2024-09-19T04:13:20.845240+0000","last_active":"2024-09-19T04:14:43.369321+0000","last_peered":"2024-09-19T04:14:43.369321+0000","last_clean":"2024-09-19T04:14:43.369321+0000","last_became_active":"2024-09-19T04:13:20.844771+0000","last_became_peered":"2024-09-19T04:13:20.844771+0000","last_unstale":"2024-09-19T04:14:43.369321+0000","last_undegraded":"2024-09-19T04:14:43.369321+0000","last_fullsized":"2024-09-19T04:14:43.369321+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:09:59.809148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:09:59.809148+0000","last_clean_scrub_stamp":"2024-09-19T04:09:59.809148+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:12:29.694263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.780946+0000","last_change":"2024-09-19T04:14:40.369257+0000","last_active":"2024-09-19T04:14:43.780946+0000","last_peered":"2024-09-19T04:14:43.780946+0000","last_clean":"2024-09-19T04:14:43.780946+0000","last_became_active":"2024-09-19T04:14:40.368865+0000","last_became_peered":"2024-09-19T04:14:40.368865+0000","last_unstale":"2024-09-19T04:14:43.780946+0000","last_undegraded":"2024-09-19T04:14:43.780946+0000","last_fullsized":"2024-09-19T04:14:43.780946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:37:52.120157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.369748+0000","last_change":"2024-09-19T04:14:33.311221+0000","last_active":"2024-09-19T04:14:43.369748+0000","last_peered":"2024-09-19T04:14:43.369748+0000","last_clean":"2024-09-19T04:14:43.369748+0000","last_became_active":"2024-09-19T04:14:33.310886+0000","last_became_peered":"2024-09-19T04:14:33.310886+0000","last_unstale":"2024-09-19T04:14:43.369748+0000","last_undegraded":"2024-09-19T04:14:43.369748+0000","last_fullsized":"2024-09-19T04:14:43.369748+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:04:32.348676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:27.842090+0000","last_change":"2024-09-19T04:14:31.322464+0000","last_active":"2024-09-19T04:15:27.842090+0000","last_peered":"2024-09-19T04:15:27.842090+0000","last_clean":"2024-09-19T04:15:27.842090+0000","last_became_active":"2024-09-19T04:14:31.322115+0000","last_became_peered":"2024-09-19T04:14:31.322115+0000","last_unstale":"2024-09-19T04:15:27.842090+0000","last_undegraded":"2024-09-19T04:15:27.842090+0000","last_fullsized":"2024-09-19T04:15:27.842090+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:24:27.623328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711354+0000","last_change":"2024-09-19T04:14:40.371391+0000","last_active":"2024-09-19T04:14:43.711354+0000","last_peered":"2024-09-19T04:14:43.711354+0000","last_clean":"2024-09-19T04:14:43.711354+0000","last_became_active":"2024-09-19T04:14:40.371091+0000","last_became_peered":"2024-09-19T04:14:40.371091+0000","last_unstale":"2024-09-19T04:14:43.711354+0000","last_undegraded":"2024-09-19T04:14:43.711354+0000","last_fullsized":"2024-09-19T04:14:43.711354+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:39:14.889348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.369408+0000","last_change":"2024-09-19T04:14:33.317833+0000","last_active":"2024-09-19T04:14:43.369408+0000","last_peered":"2024-09-19T04:14:43.369408+0000","last_clean":"2024-09-19T04:14:43.369408+0000","last_became_active":"2024-09-19T04:14:33.317495+0000","last_became_peered":"2024-09-19T04:14:33.317495+0000","last_unstale":"2024-09-19T04:14:43.369408+0000","last_undegraded":"2024-09-19T04:14:43.369408+0000","last_fullsized":"2024-09-19T04:14:43.369408+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:08:05.200360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:16.820361+0000","last_change":"2024-09-19T04:14:31.293156+0000","last_active":"2024-09-19T04:15:16.820361+0000","last_peered":"2024-09-19T04:15:16.820361+0000","last_clean":"2024-09-19T04:15:16.820361+0000","last_became_active":"2024-09-19T04:14:31.292772+0000","last_became_peered":"2024-09-19T04:14:31.292772+0000","last_unstale":"2024-09-19T04:15:16.820361+0000","last_undegraded":"2024-09-19T04:15:16.820361+0000","last_fullsized":"2024-09-19T04:15:16.820361+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:03:18.530662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.948621+0000","last_change":"2024-09-19T04:14:40.371434+0000","last_active":"2024-09-19T04:14:43.948621+0000","last_peered":"2024-09-19T04:14:43.948621+0000","last_clean":"2024-09-19T04:14:43.948621+0000","last_became_active":"2024-09-19T04:14:40.371037+0000","last_became_peered":"2024-09-19T04:14:40.371037+0000","last_unstale":"2024-09-19T04:14:43.948621+0000","last_undegraded":"2024-09-19T04:14:43.948621+0000","last_fullsized":"2024-09-19T04:14:43.948621+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:43:34.787860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.369675+0000","last_change":"2024-09-19T04:14:33.308321+0000","last_active":"2024-09-19T04:14:43.369675+0000","last_peered":"2024-09-19T04:14:43.369675+0000","last_clean":"2024-09-19T04:14:43.369675+0000","last_became_active":"2024-09-19T04:14:33.307983+0000","last_became_peered":"2024-09-19T04:14:33.307983+0000","last_unstale":"2024-09-19T04:14:43.369675+0000","last_undegraded":"2024-09-19T04:14:43.369675+0000","last_fullsized":"2024-09-19T04:14:43.369675+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:46.202123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:16.819698+0000","last_change":"2024-09-19T04:14:31.297326+0000","last_active":"2024-09-19T04:15:16.819698+0000","last_peered":"2024-09-19T04:15:16.819698+0000","last_clean":"2024-09-19T04:15:16.819698+0000","last_became_active":"2024-09-19T04:14:31.297056+0000","last_became_peered":"2024-09-19T04:14:31.297056+0000","last_unstale":"2024-09-19T04:15:16.819698+0000","last_undegraded":"2024-09-19T04:15:16.819698+0000","last_fullsized":"2024-09-19T04:15:16.819698+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:15:26.324855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.710912+0000","last_change":"2024-09-19T04:14:40.370123+0000","last_active":"2024-09-19T04:14:43.710912+0000","last_peered":"2024-09-19T04:14:43.710912+0000","last_clean":"2024-09-19T04:14:43.710912+0000","last_became_active":"2024-09-19T04:14:40.367758+0000","last_became_peered":"2024-09-19T04:14:40.367758+0000","last_unstale":"2024-09-19T04:14:43.710912+0000","last_undegraded":"2024-09-19T04:14:43.710912+0000","last_fullsized":"2024-09-19T04:14:43.710912+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:07.932122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712291+0000","last_change":"2024-09-19T04:14:33.314239+0000","last_active":"2024-09-19T04:14:43.712291+0000","last_peered":"2024-09-19T04:14:43.712291+0000","last_clean":"2024-09-19T04:14:43.712291+0000","last_became_active":"2024-09-19T04:14:33.313918+0000","last_became_peered":"2024-09-19T04:14:33.313918+0000","last_unstale":"2024-09-19T04:14:43.712291+0000","last_undegraded":"2024-09-19T04:14:43.712291+0000","last_fullsized":"2024-09-19T04:14:43.712291+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:00:12.756505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:15.803142+0000","last_change":"2024-09-19T04:14:31.295377+0000","last_active":"2024-09-19T04:15:15.803142+0000","last_peered":"2024-09-19T04:15:15.803142+0000","last_clean":"2024-09-19T04:15:15.803142+0000","last_became_active":"2024-09-19T04:14:31.295042+0000","last_became_peered":"2024-09-19T04:14:31.295042+0000","last_unstale":"2024-09-19T04:15:15.803142+0000","last_undegraded":"2024-09-19T04:15:15.803142+0000","last_fullsized":"2024-09-19T04:15:15.803142+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:35.842847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711078+0000","last_change":"2024-09-19T04:14:40.370790+0000","last_active":"2024-09-19T04:14:43.711078+0000","last_peered":"2024-09-19T04:14:43.711078+0000","last_clean":"2024-09-19T04:14:43.711078+0000","last_became_active":"2024-09-19T04:14:40.370377+0000","last_became_peered":"2024-09-19T04:14:40.370377+0000","last_unstale":"2024-09-19T04:14:43.711078+0000","last_undegraded":"2024-09-19T04:14:43.711078+0000","last_fullsized":"2024-09-19T04:14:43.711078+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:09.331769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711295+0000","last_change":"2024-09-19T04:14:33.318796+0000","last_active":"2024-09-19T04:14:43.711295+0000","last_peered":"2024-09-19T04:14:43.711295+0000","last_clean":"2024-09-19T04:14:43.711295+0000","last_became_active":"2024-09-19T04:14:33.317864+0000","last_became_peered":"2024-09-19T04:14:33.317864+0000","last_unstale":"2024-09-19T04:14:43.711295+0000","last_undegraded":"2024-09-19T04:14:43.711295+0000","last_fullsized":"2024-09-19T04:14:43.711295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:15:19.122715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:16.822138+0000","last_change":"2024-09-19T04:14:31.322413+0000","last_active":"2024-09-19T04:15:16.822138+0000","last_peered":"2024-09-19T04:15:16.822138+0000","last_clean":"2024-09-19T04:15:16.822138+0000","last_became_active":"2024-09-19T04:14:31.322082+0000","last_became_peered":"2024-09-19T04:14:31.322082+0000","last_unstale":"2024-09-19T04:15:16.822138+0000","last_undegraded":"2024-09-19T04:15:16.822138+0000","last_fullsized":"2024-09-19T04:15:16.822138+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:50.010021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.710786+0000","last_change":"2024-09-19T04:14:40.373071+0000","last_active":"2024-09-19T04:14:43.710786+0000","last_peered":"2024-09-19T04:14:43.710786+0000","last_clean":"2024-09-19T04:14:43.710786+0000","last_became_active":"2024-09-19T04:14:40.372679+0000","last_became_peered":"2024-09-19T04:14:40.372679+0000","last_unstale":"2024-09-19T04:14:43.710786+0000","last_undegraded":"2024-09-19T04:14:43.710786+0000","last_fullsized":"2024-09-19T04:14:43.710786+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:23.136807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.369081+0000","last_change":"2024-09-19T04:14:33.319165+0000","last_active":"2024-09-19T04:14:43.369081+0000","last_peered":"2024-09-19T04:14:43.369081+0000","last_clean":"2024-09-19T04:14:43.369081+0000","last_became_active":"2024-09-19T04:14:33.318830+0000","last_became_peered":"2024-09-19T04:14:33.318830+0000","last_unstale":"2024-09-19T04:14:43.369081+0000","last_undegraded":"2024-09-19T04:14:43.369081+0000","last_fullsized":"2024-09-19T04:14:43.369081+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:05:43.936069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'6","reported_seq":51,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:27.842228+0000","last_change":"2024-09-19T04:14:31.291564+0000","last_active":"2024-09-19T04:15:27.842228+0000","last_peered":"2024-09-19T04:15:27.842228+0000","last_clean":"2024-09-19T04:15:27.842228+0000","last_became_active":"2024-09-19T04:14:31.291241+0000","last_became_peered":"2024-09-19T04:14:31.291241+0000","last_unstale":"2024-09-19T04:15:27.842228+0000","last_undegraded":"2024-09-19T04:15:27.842228+0000","last_fullsized":"2024-09-19T04:15:27.842228+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:38:09.419140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711681+0000","last_change":"2024-09-19T04:14:40.371707+0000","last_active":"2024-09-19T04:14:43.711681+0000","last_peered":"2024-09-19T04:14:43.711681+0000","last_clean":"2024-09-19T04:14:43.711681+0000","last_became_active":"2024-09-19T04:14:40.370767+0000","last_became_peered":"2024-09-19T04:14:40.370767+0000","last_unstale":"2024-09-19T04:14:43.711681+0000","last_undegraded":"2024-09-19T04:14:43.711681+0000","last_fullsized":"2024-09-19T04:14:43.711681+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:38.022486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.369315+0000","last_change":"2024-09-19T04:14:33.316098+0000","last_active":"2024-09-19T04:14:43.369315+0000","last_peered":"2024-09-19T04:14:43.369315+0000","last_clean":"2024-09-19T04:14:43.369315+0000","last_became_active":"2024-09-19T04:14:33.315755+0000","last_became_peered":"2024-09-19T04:14:33.315755+0000","last_unstale":"2024-09-19T04:14:43.369315+0000","last_undegraded":"2024-09-19T04:14:43.369315+0000","last_fullsized":"2024-09-19T04:14:43.369315+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:45:01.531200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:16.820748+0000","last_change":"2024-09-19T04:14:31.291145+0000","last_active":"2024-09-19T04:15:16.820748+0000","last_peered":"2024-09-19T04:15:16.820748+0000","last_clean":"2024-09-19T04:15:16.820748+0000","last_became_active":"2024-09-19T04:14:31.290763+0000","last_became_peered":"2024-09-19T04:14:31.290763+0000","last_unstale":"2024-09-19T04:15:16.820748+0000","last_undegraded":"2024-09-19T04:15:16.820748+0000","last_fullsized":"2024-09-19T04:15:16.820748+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:37.556544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711990+0000","last_change":"2024-09-19T04:14:40.371371+0000","last_active":"2024-09-19T04:14:43.711990+0000","last_peered":"2024-09-19T04:14:43.711990+0000","last_clean":"2024-09-19T04:14:43.711990+0000","last_became_active":"2024-09-19T04:14:40.370988+0000","last_became_peered":"2024-09-19T04:14:40.370988+0000","last_unstale":"2024-09-19T04:14:43.711990+0000","last_undegraded":"2024-09-19T04:14:43.711990+0000","last_fullsized":"2024-09-19T04:14:43.711990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:57.089953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.710861+0000","last_change":"2024-09-19T04:14:33.310019+0000","last_active":"2024-09-19T04:14:43.710861+0000","last_peered":"2024-09-19T04:14:43.710861+0000","last_clean":"2024-09-19T04:14:43.710861+0000","last_became_active":"2024-09-19T04:14:33.309671+0000","last_became_peered":"2024-09-19T04:14:33.309671+0000","last_unstale":"2024-09-19T04:14:43.710861+0000","last_undegraded":"2024-09-19T04:14:43.710861+0000","last_fullsized":"2024-09-19T04:14:43.710861+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:37.146543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":41,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:17.823575+0000","last_change":"2024-09-19T04:14:31.297106+0000","last_active":"2024-09-19T04:15:17.823575+0000","last_peered":"2024-09-19T04:15:17.823575+0000","last_clean":"2024-09-19T04:15:17.823575+0000","last_became_active":"2024-09-19T04:14:31.296688+0000","last_became_peered":"2024-09-19T04:14:31.296688+0000","last_unstale":"2024-09-19T04:15:17.823575+0000","last_undegraded":"2024-09-19T04:15:17.823575+0000","last_fullsized":"2024-09-19T04:15:17.823575+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:18.882219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711395+0000","last_change":"2024-09-19T04:14:40.371641+0000","last_active":"2024-09-19T04:14:43.711395+0000","last_peered":"2024-09-19T04:14:43.711395+0000","last_clean":"2024-09-19T04:14:43.711395+0000","last_became_active":"2024-09-19T04:14:40.370354+0000","last_became_peered":"2024-09-19T04:14:40.370354+0000","last_unstale":"2024-09-19T04:14:43.711395+0000","last_undegraded":"2024-09-19T04:14:43.711395+0000","last_fullsized":"2024-09-19T04:14:43.711395+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:01:11.572011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712002+0000","last_change":"2024-09-19T04:14:33.307767+0000","last_active":"2024-09-19T04:14:43.712002+0000","last_peered":"2024-09-19T04:14:43.712002+0000","last_clean":"2024-09-19T04:14:43.712002+0000","last_became_active":"2024-09-19T04:14:33.307396+0000","last_became_peered":"2024-09-19T04:14:33.307396+0000","last_unstale":"2024-09-19T04:14:43.712002+0000","last_undegraded":"2024-09-19T04:14:43.712002+0000","last_fullsized":"2024-09-19T04:14:43.712002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:21.018641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"86'32","reported_seq":99,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:31.850010+0000","last_change":"2024-09-19T04:14:31.298106+0000","last_active":"2024-09-19T04:15:31.850010+0000","last_peered":"2024-09-19T04:15:31.850010+0000","last_clean":"2024-09-19T04:15:31.850010+0000","last_became_active":"2024-09-19T04:14:31.297731+0000","last_became_peered":"2024-09-19T04:14:31.297731+0000","last_unstale":"2024-09-19T04:15:31.850010+0000","last_undegraded":"2024-09-19T04:15:31.850010+0000","last_fullsized":"2024-09-19T04:15:31.850010+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:29.127759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60429,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":69,"num_write":34,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711164+0000","last_change":"2024-09-19T04:14:40.372927+0000","last_active":"2024-09-19T04:14:43.711164+0000","last_peered":"2024-09-19T04:14:43.711164+0000","last_clean":"2024-09-19T04:14:43.711164+0000","last_became_active":"2024-09-19T04:14:40.372521+0000","last_became_peered":"2024-09-19T04:14:40.372521+0000","last_unstale":"2024-09-19T04:14:43.711164+0000","last_undegraded":"2024-09-19T04:14:43.711164+0000","last_fullsized":"2024-09-19T04:14:43.711164+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:15:00.863812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711709+0000","last_change":"2024-09-19T04:14:33.308154+0000","last_active":"2024-09-19T04:14:43.711709+0000","last_peered":"2024-09-19T04:14:43.711709+0000","last_clean":"2024-09-19T04:14:43.711709+0000","last_became_active":"2024-09-19T04:14:33.307831+0000","last_became_peered":"2024-09-19T04:14:33.307831+0000","last_unstale":"2024-09-19T04:14:43.711709+0000","last_undegraded":"2024-09-19T04:14:43.711709+0000","last_fullsized":"2024-09-19T04:14:43.711709+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:16:14.656133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:15.815705+0000","last_change":"2024-09-19T04:14:31.324011+0000","last_active":"2024-09-19T04:15:15.815705+0000","last_peered":"2024-09-19T04:15:15.815705+0000","last_clean":"2024-09-19T04:15:15.815705+0000","last_became_active":"2024-09-19T04:14:31.323622+0000","last_became_peered":"2024-09-19T04:14:31.323622+0000","last_unstale":"2024-09-19T04:15:15.815705+0000","last_undegraded":"2024-09-19T04:15:15.815705+0000","last_fullsized":"2024-09-19T04:15:15.815705+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:39.198602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711943+0000","last_change":"2024-09-19T04:14:40.365938+0000","last_active":"2024-09-19T04:14:43.711943+0000","last_peered":"2024-09-19T04:14:43.711943+0000","last_clean":"2024-09-19T04:14:43.711943+0000","last_became_active":"2024-09-19T04:14:40.365539+0000","last_became_peered":"2024-09-19T04:14:40.365539+0000","last_unstale":"2024-09-19T04:14:43.711943+0000","last_undegraded":"2024-09-19T04:14:43.711943+0000","last_fullsized":"2024-09-19T04:14:43.711943+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:09.723008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.948924+0000","last_change":"2024-09-19T04:14:33.316286+0000","last_active":"2024-09-19T04:14:43.948924+0000","last_peered":"2024-09-19T04:14:43.948924+0000","last_clean":"2024-09-19T04:14:43.948924+0000","last_became_active":"2024-09-19T04:14:33.315980+0000","last_became_peered":"2024-09-19T04:14:33.315980+0000","last_unstale":"2024-09-19T04:14:43.948924+0000","last_undegraded":"2024-09-19T04:14:43.948924+0000","last_fullsized":"2024-09-19T04:14:43.948924+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:58.383139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:16.820581+0000","last_change":"2024-09-19T04:14:31.299111+0000","last_active":"2024-09-19T04:15:16.820581+0000","last_peered":"2024-09-19T04:15:16.820581+0000","last_clean":"2024-09-19T04:15:16.820581+0000","last_became_active":"2024-09-19T04:14:31.298390+0000","last_became_peered":"2024-09-19T04:14:31.298390+0000","last_unstale":"2024-09-19T04:15:16.820581+0000","last_undegraded":"2024-09-19T04:15:16.820581+0000","last_fullsized":"2024-09-19T04:15:16.820581+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:39.710412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711459+0000","last_change":"2024-09-19T04:14:40.371108+0000","last_active":"2024-09-19T04:14:43.711459+0000","last_peered":"2024-09-19T04:14:43.711459+0000","last_clean":"2024-09-19T04:14:43.711459+0000","last_became_active":"2024-09-19T04:14:40.370729+0000","last_became_peered":"2024-09-19T04:14:40.370729+0000","last_unstale":"2024-09-19T04:14:43.711459+0000","last_undegraded":"2024-09-19T04:14:43.711459+0000","last_fullsized":"2024-09-19T04:14:43.711459+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:59.610235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711398+0000","last_change":"2024-09-19T04:14:33.314423+0000","last_active":"2024-09-19T04:14:43.711398+0000","last_peered":"2024-09-19T04:14:43.711398+0000","last_clean":"2024-09-19T04:14:43.711398+0000","last_became_active":"2024-09-19T04:14:33.314123+0000","last_became_peered":"2024-09-19T04:14:33.314123+0000","last_unstale":"2024-09-19T04:14:43.711398+0000","last_undegraded":"2024-09-19T04:14:43.711398+0000","last_fullsized":"2024-09-19T04:14:43.711398+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:29:57.781116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":64,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:31.846145+0000","last_change":"2024-09-19T04:14:31.293267+0000","last_active":"2024-09-19T04:15:31.846145+0000","last_peered":"2024-09-19T04:15:31.846145+0000","last_clean":"2024-09-19T04:15:31.846145+0000","last_became_active":"2024-09-19T04:14:31.292862+0000","last_became_peered":"2024-09-19T04:14:31.292862+0000","last_unstale":"2024-09-19T04:15:31.846145+0000","last_undegraded":"2024-09-19T04:15:31.846145+0000","last_fullsized":"2024-09-19T04:15:31.846145+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:37.876696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.368324+0000","last_change":"2024-09-19T04:14:40.373078+0000","last_active":"2024-09-19T04:14:43.368324+0000","last_peered":"2024-09-19T04:14:43.368324+0000","last_clean":"2024-09-19T04:14:43.368324+0000","last_became_active":"2024-09-19T04:14:40.372468+0000","last_became_peered":"2024-09-19T04:14:40.372468+0000","last_unstale":"2024-09-19T04:14:43.368324+0000","last_undegraded":"2024-09-19T04:14:43.368324+0000","last_fullsized":"2024-09-19T04:14:43.368324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:54.945801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.948696+0000","last_change":"2024-09-19T04:14:40.368946+0000","last_active":"2024-09-19T04:14:43.948696+0000","last_peered":"2024-09-19T04:14:43.948696+0000","last_clean":"2024-09-19T04:14:43.948696+0000","last_became_active":"2024-09-19T04:14:40.368549+0000","last_became_peered":"2024-09-19T04:14:40.368549+0000","last_unstale":"2024-09-19T04:14:43.948696+0000","last_undegraded":"2024-09-19T04:14:43.948696+0000","last_fullsized":"2024-09-19T04:14:43.948696+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:24.563488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711026+0000","last_change":"2024-09-19T04:14:33.307214+0000","last_active":"2024-09-19T04:14:43.711026+0000","last_peered":"2024-09-19T04:14:43.711026+0000","last_clean":"2024-09-19T04:14:43.711026+0000","last_became_active":"2024-09-19T04:14:33.306913+0000","last_became_peered":"2024-09-19T04:14:33.306913+0000","last_unstale":"2024-09-19T04:14:43.711026+0000","last_undegraded":"2024-09-19T04:14:43.711026+0000","last_fullsized":"2024-09-19T04:14:43.711026+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:49.402532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:16.820987+0000","last_change":"2024-09-19T04:14:31.294488+0000","last_active":"2024-09-19T04:15:16.820987+0000","last_peered":"2024-09-19T04:15:16.820987+0000","last_clean":"2024-09-19T04:15:16.820987+0000","last_became_active":"2024-09-19T04:14:31.294145+0000","last_became_peered":"2024-09-19T04:14:31.294145+0000","last_unstale":"2024-09-19T04:15:16.820987+0000","last_undegraded":"2024-09-19T04:15:16.820987+0000","last_fullsized":"2024-09-19T04:15:16.820987+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:28:19.411650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712482+0000","last_change":"2024-09-19T04:14:40.372366+0000","last_active":"2024-09-19T04:14:43.712482+0000","last_peered":"2024-09-19T04:14:43.712482+0000","last_clean":"2024-09-19T04:14:43.712482+0000","last_became_active":"2024-09-19T04:14:40.371922+0000","last_became_peered":"2024-09-19T04:14:40.371922+0000","last_unstale":"2024-09-19T04:14:43.712482+0000","last_undegraded":"2024-09-19T04:14:43.712482+0000","last_fullsized":"2024-09-19T04:14:43.712482+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:55:01.724088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.368109+0000","last_change":"2024-09-19T04:14:33.308351+0000","last_active":"2024-09-19T04:14:43.368109+0000","last_peered":"2024-09-19T04:14:43.368109+0000","last_clean":"2024-09-19T04:14:43.368109+0000","last_became_active":"2024-09-19T04:14:33.308052+0000","last_became_peered":"2024-09-19T04:14:33.308052+0000","last_unstale":"2024-09-19T04:14:43.368109+0000","last_undegraded":"2024-09-19T04:14:43.368109+0000","last_fullsized":"2024-09-19T04:14:43.368109+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:06:32.056738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:14.807694+0000","last_change":"2024-09-19T04:14:31.291742+0000","last_active":"2024-09-19T04:15:14.807694+0000","last_peered":"2024-09-19T04:15:14.807694+0000","last_clean":"2024-09-19T04:15:14.807694+0000","last_became_active":"2024-09-19T04:14:31.291315+0000","last_became_peered":"2024-09-19T04:14:31.291315+0000","last_unstale":"2024-09-19T04:15:14.807694+0000","last_undegraded":"2024-09-19T04:15:14.807694+0000","last_fullsized":"2024-09-19T04:15:14.807694+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:16.159276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:15.817082+0000","last_change":"2024-09-19T04:14:31.293898+0000","last_active":"2024-09-19T04:15:15.817082+0000","last_peered":"2024-09-19T04:15:15.817082+0000","last_clean":"2024-09-19T04:15:15.817082+0000","last_became_active":"2024-09-19T04:14:31.293499+0000","last_became_peered":"2024-09-19T04:14:31.293499+0000","last_unstale":"2024-09-19T04:15:15.817082+0000","last_undegraded":"2024-09-19T04:15:15.817082+0000","last_fullsized":"2024-09-19T04:15:15.817082+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:25:55.590644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711505+0000","last_change":"2024-09-19T04:14:33.314094+0000","last_active":"2024-09-19T04:14:43.711505+0000","last_peered":"2024-09-19T04:14:43.711505+0000","last_clean":"2024-09-19T04:14:43.711505+0000","last_became_active":"2024-09-19T04:14:33.312782+0000","last_became_peered":"2024-09-19T04:14:33.312782+0000","last_unstale":"2024-09-19T04:14:43.711505+0000","last_undegraded":"2024-09-19T04:14:43.711505+0000","last_fullsized":"2024-09-19T04:14:43.711505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:40.121676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.371218+0000","last_change":"2024-09-19T04:14:40.369159+0000","last_active":"2024-09-19T04:14:43.371218+0000","last_peered":"2024-09-19T04:14:43.371218+0000","last_clean":"2024-09-19T04:14:43.371218+0000","last_became_active":"2024-09-19T04:14:40.368732+0000","last_became_peered":"2024-09-19T04:14:40.368732+0000","last_unstale":"2024-09-19T04:14:43.371218+0000","last_undegraded":"2024-09-19T04:14:43.371218+0000","last_fullsized":"2024-09-19T04:14:43.371218+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:12:29.176834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":53,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:15:31.846827+0000","last_change":"2024-09-19T04:14:31.298260+0000","last_active":"2024-09-19T04:15:31.846827+0000","last_peered":"2024-09-19T04:15:31.846827+0000","last_clean":"2024-09-19T04:15:31.846827+0000","last_became_active":"2024-09-19T04:14:31.297802+0000","last_became_peered":"2024-09-19T04:14:31.297802+0000","last_unstale":"2024-09-19T04:15:31.846827+0000","last_undegraded":"2024-09-19T04:15:31.846827+0000","last_fullsized":"2024-09-19T04:15:31.846827+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:25:52.054848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712807+0000","last_change":"2024-09-19T04:14:33.300555+0000","last_active":"2024-09-19T04:14:43.712807+0000","last_peered":"2024-09-19T04:14:43.712807+0000","last_clean":"2024-09-19T04:14:43.712807+0000","last_became_active":"2024-09-19T04:14:33.300220+0000","last_became_peered":"2024-09-19T04:14:33.300220+0000","last_unstale":"2024-09-19T04:14:43.712807+0000","last_undegraded":"2024-09-19T04:14:43.712807+0000","last_fullsized":"2024-09-19T04:14:43.712807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:32.584140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.371062+0000","last_change":"2024-09-19T04:14:40.369471+0000","last_active":"2024-09-19T04:14:43.371062+0000","last_peered":"2024-09-19T04:14:43.371062+0000","last_clean":"2024-09-19T04:14:43.371062+0000","last_became_active":"2024-09-19T04:14:40.369065+0000","last_became_peered":"2024-09-19T04:14:40.369065+0000","last_unstale":"2024-09-19T04:14:43.371062+0000","last_undegraded":"2024-09-19T04:14:43.371062+0000","last_fullsized":"2024-09-19T04:14:43.371062+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:40:03.888553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711508+0000","last_change":"2024-09-19T04:14:33.312801+0000","last_active":"2024-09-19T04:14:43.711508+0000","last_peered":"2024-09-19T04:14:43.711508+0000","last_clean":"2024-09-19T04:14:43.711508+0000","last_became_active":"2024-09-19T04:14:33.312430+0000","last_became_peered":"2024-09-19T04:14:33.312430+0000","last_unstale":"2024-09-19T04:14:43.711508+0000","last_undegraded":"2024-09-19T04:14:43.711508+0000","last_fullsized":"2024-09-19T04:14:43.711508+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:29.069507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.371003+0000","last_change":"2024-09-19T04:14:33.313076+0000","last_active":"2024-09-19T04:14:43.371003+0000","last_peered":"2024-09-19T04:14:43.371003+0000","last_clean":"2024-09-19T04:14:43.371003+0000","last_became_active":"2024-09-19T04:14:33.312730+0000","last_became_peered":"2024-09-19T04:14:33.312730+0000","last_unstale":"2024-09-19T04:14:43.371003+0000","last_undegraded":"2024-09-19T04:14:43.371003+0000","last_fullsized":"2024-09-19T04:14:43.371003+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:33.397309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.370673+0000","last_change":"2024-09-19T04:14:33.314724+0000","last_active":"2024-09-19T04:14:43.370673+0000","last_peered":"2024-09-19T04:14:43.370673+0000","last_clean":"2024-09-19T04:14:43.370673+0000","last_became_active":"2024-09-19T04:14:33.314359+0000","last_became_peered":"2024-09-19T04:14:33.314359+0000","last_unstale":"2024-09-19T04:14:43.370673+0000","last_undegraded":"2024-09-19T04:14:43.370673+0000","last_fullsized":"2024-09-19T04:14:43.370673+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:37:39.357193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.948592+0000","last_change":"2024-09-19T04:14:33.312834+0000","last_active":"2024-09-19T04:14:43.948592+0000","last_peered":"2024-09-19T04:14:43.948592+0000","last_clean":"2024-09-19T04:14:43.948592+0000","last_became_active":"2024-09-19T04:14:33.312538+0000","last_became_peered":"2024-09-19T04:14:33.312538+0000","last_unstale":"2024-09-19T04:14:43.948592+0000","last_undegraded":"2024-09-19T04:14:43.948592+0000","last_fullsized":"2024-09-19T04:14:43.948592+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:25:37.694910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711069+0000","last_change":"2024-09-19T04:14:33.305735+0000","last_active":"2024-09-19T04:14:43.711069+0000","last_peered":"2024-09-19T04:14:43.711069+0000","last_clean":"2024-09-19T04:14:43.711069+0000","last_became_active":"2024-09-19T04:14:33.305415+0000","last_became_peered":"2024-09-19T04:14:33.305415+0000","last_unstale":"2024-09-19T04:14:43.711069+0000","last_undegraded":"2024-09-19T04:14:43.711069+0000","last_fullsized":"2024-09-19T04:14:43.711069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:20.160211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712411+0000","last_change":"2024-09-19T04:14:33.313379+0000","last_active":"2024-09-19T04:14:43.712411+0000","last_peered":"2024-09-19T04:14:43.712411+0000","last_clean":"2024-09-19T04:14:43.712411+0000","last_became_active":"2024-09-19T04:14:33.312453+0000","last_became_peered":"2024-09-19T04:14:33.312453+0000","last_unstale":"2024-09-19T04:14:43.712411+0000","last_undegraded":"2024-09-19T04:14:43.712411+0000","last_fullsized":"2024-09-19T04:14:43.712411+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:44.832004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.371295+0000","last_change":"2024-09-19T04:14:33.307371+0000","last_active":"2024-09-19T04:14:43.371295+0000","last_peered":"2024-09-19T04:14:43.371295+0000","last_clean":"2024-09-19T04:14:43.371295+0000","last_became_active":"2024-09-19T04:14:33.307033+0000","last_became_peered":"2024-09-19T04:14:33.307033+0000","last_unstale":"2024-09-19T04:14:43.371295+0000","last_undegraded":"2024-09-19T04:14:43.371295+0000","last_fullsized":"2024-09-19T04:14:43.371295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:12.027213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.368794+0000","last_change":"2024-09-19T04:14:33.313425+0000","last_active":"2024-09-19T04:14:43.368794+0000","last_peered":"2024-09-19T04:14:43.368794+0000","last_clean":"2024-09-19T04:14:43.368794+0000","last_became_active":"2024-09-19T04:14:33.313103+0000","last_became_peered":"2024-09-19T04:14:33.313103+0000","last_unstale":"2024-09-19T04:14:43.368794+0000","last_undegraded":"2024-09-19T04:14:43.368794+0000","last_fullsized":"2024-09-19T04:14:43.368794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:53.699886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.710929+0000","last_change":"2024-09-19T04:14:33.314296+0000","last_active":"2024-09-19T04:14:43.710929+0000","last_peered":"2024-09-19T04:14:43.710929+0000","last_clean":"2024-09-19T04:14:43.710929+0000","last_became_active":"2024-09-19T04:14:33.311230+0000","last_became_peered":"2024-09-19T04:14:33.311230+0000","last_unstale":"2024-09-19T04:14:43.710929+0000","last_undegraded":"2024-09-19T04:14:43.710929+0000","last_fullsized":"2024-09-19T04:14:43.710929+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:37:51.395086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.368295+0000","last_change":"2024-09-19T04:14:33.317125+0000","last_active":"2024-09-19T04:14:43.368295+0000","last_peered":"2024-09-19T04:14:43.368295+0000","last_clean":"2024-09-19T04:14:43.368295+0000","last_became_active":"2024-09-19T04:14:33.316805+0000","last_became_peered":"2024-09-19T04:14:33.316805+0000","last_unstale":"2024-09-19T04:14:43.368295+0000","last_undegraded":"2024-09-19T04:14:43.368295+0000","last_fullsized":"2024-09-19T04:14:43.368295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:27.754882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711406+0000","last_change":"2024-09-19T04:14:33.310081+0000","last_active":"2024-09-19T04:14:43.711406+0000","last_peered":"2024-09-19T04:14:43.711406+0000","last_clean":"2024-09-19T04:14:43.711406+0000","last_became_active":"2024-09-19T04:14:33.308675+0000","last_became_peered":"2024-09-19T04:14:33.308675+0000","last_unstale":"2024-09-19T04:14:43.711406+0000","last_undegraded":"2024-09-19T04:14:43.711406+0000","last_fullsized":"2024-09-19T04:14:43.711406+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:58.187633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711236+0000","last_change":"2024-09-19T04:14:33.308220+0000","last_active":"2024-09-19T04:14:43.711236+0000","last_peered":"2024-09-19T04:14:43.711236+0000","last_clean":"2024-09-19T04:14:43.711236+0000","last_became_active":"2024-09-19T04:14:33.307934+0000","last_became_peered":"2024-09-19T04:14:33.307934+0000","last_unstale":"2024-09-19T04:14:43.711236+0000","last_undegraded":"2024-09-19T04:14:43.711236+0000","last_fullsized":"2024-09-19T04:14:43.711236+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:22.490250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712016+0000","last_change":"2024-09-19T04:14:33.306617+0000","last_active":"2024-09-19T04:14:43.712016+0000","last_peered":"2024-09-19T04:14:43.712016+0000","last_clean":"2024-09-19T04:14:43.712016+0000","last_became_active":"2024-09-19T04:14:33.306244+0000","last_became_peered":"2024-09-19T04:14:33.306244+0000","last_unstale":"2024-09-19T04:14:43.712016+0000","last_undegraded":"2024-09-19T04:14:43.712016+0000","last_fullsized":"2024-09-19T04:14:43.712016+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:22.095989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.371169+0000","last_change":"2024-09-19T04:14:33.314915+0000","last_active":"2024-09-19T04:14:43.371169+0000","last_peered":"2024-09-19T04:14:43.371169+0000","last_clean":"2024-09-19T04:14:43.371169+0000","last_became_active":"2024-09-19T04:14:33.314601+0000","last_became_peered":"2024-09-19T04:14:33.314601+0000","last_unstale":"2024-09-19T04:14:43.371169+0000","last_undegraded":"2024-09-19T04:14:43.371169+0000","last_fullsized":"2024-09-19T04:14:43.371169+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:37.687964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711656+0000","last_change":"2024-09-19T04:14:33.304667+0000","last_active":"2024-09-19T04:14:43.711656+0000","last_peered":"2024-09-19T04:14:43.711656+0000","last_clean":"2024-09-19T04:14:43.711656+0000","last_became_active":"2024-09-19T04:14:33.304356+0000","last_became_peered":"2024-09-19T04:14:33.304356+0000","last_unstale":"2024-09-19T04:14:43.711656+0000","last_undegraded":"2024-09-19T04:14:43.711656+0000","last_fullsized":"2024-09-19T04:14:43.711656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:37.128074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712601+0000","last_change":"2024-09-19T04:14:33.310002+0000","last_active":"2024-09-19T04:14:43.712601+0000","last_peered":"2024-09-19T04:14:43.712601+0000","last_clean":"2024-09-19T04:14:43.712601+0000","last_became_active":"2024-09-19T04:14:33.309639+0000","last_became_peered":"2024-09-19T04:14:33.309639+0000","last_unstale":"2024-09-19T04:14:43.712601+0000","last_undegraded":"2024-09-19T04:14:43.712601+0000","last_fullsized":"2024-09-19T04:14:43.712601+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:21.954435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.710526+0000","last_change":"2024-09-19T04:14:33.307296+0000","last_active":"2024-09-19T04:14:43.710526+0000","last_peered":"2024-09-19T04:14:43.710526+0000","last_clean":"2024-09-19T04:14:43.710526+0000","last_became_active":"2024-09-19T04:14:33.306998+0000","last_became_peered":"2024-09-19T04:14:33.306998+0000","last_unstale":"2024-09-19T04:14:43.710526+0000","last_undegraded":"2024-09-19T04:14:43.710526+0000","last_fullsized":"2024-09-19T04:14:43.710526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:55.833196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.948326+0000","last_change":"2024-09-19T04:14:33.313568+0000","last_active":"2024-09-19T04:14:43.948326+0000","last_peered":"2024-09-19T04:14:43.948326+0000","last_clean":"2024-09-19T04:14:43.948326+0000","last_became_active":"2024-09-19T04:14:33.313228+0000","last_became_peered":"2024-09-19T04:14:33.313228+0000","last_unstale":"2024-09-19T04:14:43.948326+0000","last_undegraded":"2024-09-19T04:14:43.948326+0000","last_fullsized":"2024-09-19T04:14:43.948326+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:31:43.348866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.948320+0000","last_change":"2024-09-19T04:14:33.309745+0000","last_active":"2024-09-19T04:14:43.948320+0000","last_peered":"2024-09-19T04:14:43.948320+0000","last_clean":"2024-09-19T04:14:43.948320+0000","last_became_active":"2024-09-19T04:14:33.309327+0000","last_became_peered":"2024-09-19T04:14:33.309327+0000","last_unstale":"2024-09-19T04:14:43.948320+0000","last_undegraded":"2024-09-19T04:14:43.948320+0000","last_fullsized":"2024-09-19T04:14:43.948320+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:05.081550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711171+0000","last_change":"2024-09-19T04:14:33.306186+0000","last_active":"2024-09-19T04:14:43.711171+0000","last_peered":"2024-09-19T04:14:43.711171+0000","last_clean":"2024-09-19T04:14:43.711171+0000","last_became_active":"2024-09-19T04:14:33.305865+0000","last_became_peered":"2024-09-19T04:14:33.305865+0000","last_unstale":"2024-09-19T04:14:43.711171+0000","last_undegraded":"2024-09-19T04:14:43.711171+0000","last_fullsized":"2024-09-19T04:14:43.711171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:33.054326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712438+0000","last_change":"2024-09-19T04:14:33.307667+0000","last_active":"2024-09-19T04:14:43.712438+0000","last_peered":"2024-09-19T04:14:43.712438+0000","last_clean":"2024-09-19T04:14:43.712438+0000","last_became_active":"2024-09-19T04:14:33.307315+0000","last_became_peered":"2024-09-19T04:14:33.307315+0000","last_unstale":"2024-09-19T04:14:43.712438+0000","last_undegraded":"2024-09-19T04:14:43.712438+0000","last_fullsized":"2024-09-19T04:14:43.712438+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:52.209438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.369692+0000","last_change":"2024-09-19T04:14:33.312430+0000","last_active":"2024-09-19T04:14:43.369692+0000","last_peered":"2024-09-19T04:14:43.369692+0000","last_clean":"2024-09-19T04:14:43.369692+0000","last_became_active":"2024-09-19T04:14:33.311786+0000","last_became_peered":"2024-09-19T04:14:33.311786+0000","last_unstale":"2024-09-19T04:14:43.369692+0000","last_undegraded":"2024-09-19T04:14:43.369692+0000","last_fullsized":"2024-09-19T04:14:43.369692+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:17:25.785612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712369+0000","last_change":"2024-09-19T04:14:33.310478+0000","last_active":"2024-09-19T04:14:43.712369+0000","last_peered":"2024-09-19T04:14:43.712369+0000","last_clean":"2024-09-19T04:14:43.712369+0000","last_became_active":"2024-09-19T04:14:33.309960+0000","last_became_peered":"2024-09-19T04:14:33.309960+0000","last_unstale":"2024-09-19T04:14:43.712369+0000","last_undegraded":"2024-09-19T04:14:43.712369+0000","last_fullsized":"2024-09-19T04:14:43.712369+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:37:43.008022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711761+0000","last_change":"2024-09-19T04:14:33.312449+0000","last_active":"2024-09-19T04:14:43.711761+0000","last_peered":"2024-09-19T04:14:43.711761+0000","last_clean":"2024-09-19T04:14:43.711761+0000","last_became_active":"2024-09-19T04:14:33.312124+0000","last_became_peered":"2024-09-19T04:14:33.312124+0000","last_unstale":"2024-09-19T04:14:43.711761+0000","last_undegraded":"2024-09-19T04:14:43.711761+0000","last_fullsized":"2024-09-19T04:14:43.711761+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:53.556895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.368056+0000","last_change":"2024-09-19T04:14:33.317095+0000","last_active":"2024-09-19T04:14:43.368056+0000","last_peered":"2024-09-19T04:14:43.368056+0000","last_clean":"2024-09-19T04:14:43.368056+0000","last_became_active":"2024-09-19T04:14:33.316763+0000","last_became_peered":"2024-09-19T04:14:33.316763+0000","last_unstale":"2024-09-19T04:14:43.368056+0000","last_undegraded":"2024-09-19T04:14:43.368056+0000","last_fullsized":"2024-09-19T04:14:43.368056+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:14.894679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.369167+0000","last_change":"2024-09-19T04:14:33.316578+0000","last_active":"2024-09-19T04:14:43.369167+0000","last_peered":"2024-09-19T04:14:43.369167+0000","last_clean":"2024-09-19T04:14:43.369167+0000","last_became_active":"2024-09-19T04:14:33.316215+0000","last_became_peered":"2024-09-19T04:14:33.316215+0000","last_unstale":"2024-09-19T04:14:43.369167+0000","last_undegraded":"2024-09-19T04:14:43.369167+0000","last_fullsized":"2024-09-19T04:14:43.369167+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:18.770360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711326+0000","last_change":"2024-09-19T04:14:33.311095+0000","last_active":"2024-09-19T04:14:43.711326+0000","last_peered":"2024-09-19T04:14:43.711326+0000","last_clean":"2024-09-19T04:14:43.711326+0000","last_became_active":"2024-09-19T04:14:33.310738+0000","last_became_peered":"2024-09-19T04:14:33.310738+0000","last_unstale":"2024-09-19T04:14:43.711326+0000","last_undegraded":"2024-09-19T04:14:43.711326+0000","last_fullsized":"2024-09-19T04:14:43.711326+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:09:39.571303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.711542+0000","last_change":"2024-09-19T04:14:33.309468+0000","last_active":"2024-09-19T04:14:43.711542+0000","last_peered":"2024-09-19T04:14:43.711542+0000","last_clean":"2024-09-19T04:14:43.711542+0000","last_became_active":"2024-09-19T04:14:33.309164+0000","last_became_peered":"2024-09-19T04:14:33.309164+0000","last_unstale":"2024-09-19T04:14:43.711542+0000","last_undegraded":"2024-09-19T04:14:43.711542+0000","last_fullsized":"2024-09-19T04:14:43.711542+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:05:19.193395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712274+0000","last_change":"2024-09-19T04:14:33.312916+0000","last_active":"2024-09-19T04:14:43.712274+0000","last_peered":"2024-09-19T04:14:43.712274+0000","last_clean":"2024-09-19T04:14:43.712274+0000","last_became_active":"2024-09-19T04:14:33.308283+0000","last_became_peered":"2024-09-19T04:14:33.308283+0000","last_unstale":"2024-09-19T04:14:43.712274+0000","last_undegraded":"2024-09-19T04:14:43.712274+0000","last_fullsized":"2024-09-19T04:14:43.712274+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:52.460487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.948547+0000","last_change":"2024-09-19T04:14:33.308268+0000","last_active":"2024-09-19T04:14:43.948547+0000","last_peered":"2024-09-19T04:14:43.948547+0000","last_clean":"2024-09-19T04:14:43.948547+0000","last_became_active":"2024-09-19T04:14:33.307945+0000","last_became_peered":"2024-09-19T04:14:33.307945+0000","last_unstale":"2024-09-19T04:14:43.948547+0000","last_undegraded":"2024-09-19T04:14:43.948547+0000","last_fullsized":"2024-09-19T04:14:43.948547+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:24.410351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.948687+0000","last_change":"2024-09-19T04:14:33.315522+0000","last_active":"2024-09-19T04:14:43.948687+0000","last_peered":"2024-09-19T04:14:43.948687+0000","last_clean":"2024-09-19T04:14:43.948687+0000","last_became_active":"2024-09-19T04:14:33.315220+0000","last_became_peered":"2024-09-19T04:14:33.315220+0000","last_unstale":"2024-09-19T04:14:43.948687+0000","last_undegraded":"2024-09-19T04:14:43.948687+0000","last_fullsized":"2024-09-19T04:14:43.948687+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:41:40.915933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-19T04:14:43.712482+0000","last_change":"2024-09-19T04:14:33.309450+0000","last_active":"2024-09-19T04:14:43.712482+0000","last_peered":"2024-09-19T04:14:43.712482+0000","last_clean":"2024-09-19T04:14:43.712482+0000","last_became_active":"2024-09-19T04:14:33.309013+0000","last_became_peered":"2024-09-19T04:14:33.309013+0000","last_unstale":"2024-09-19T04:14:43.712482+0000","last_undegraded":"2024-09-19T04:14:43.712482+0000","last_fullsized":"2024-09-19T04:14:43.712482+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:49.523372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67637,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":176,"num_read_kb":157,"num_write":241,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":185851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285207,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579929,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":950272,"data_stored":477677,"data_compressed":17723,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808862,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":1116785,"data_compressed":53987,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972386,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":481703,"data_compressed":17723,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201319,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":970752,"data_stored":477985,"data_compressed":17723,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430251,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32184,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712968,"statfs":{"total":95995035648,"available":95962079232,"internally_reserved":0,"allocated":1024000,"data_stored":1074877,"data_compressed":53987,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593778,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":473504,"data_compressed":17723,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822711,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1032192,"data_stored":1069673,"data_compressed":53987,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986234,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":477578,"data_compressed":17723,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215167,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":472819,"data_compressed":17723,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411397,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":526260,"data_compressed":17723,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":526433,"data_compressed":17723,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":974848,"data_stored":474567,"data_compressed":17723,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34629,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34629,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34629,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":54044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":53871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T04:15:34.002 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T04:15:34.003 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T04:15:34.003 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T04:15:34.264 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:34.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.716+0000 7f605cce8640 1 -- 172.21.15.7:0/2139085046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60581037c0 msgr2=0x7f605810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:34.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.716+0000 7f605cce8640 1 --2- 172.21.15.7:0/2139085046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60581037c0 0x7f605810a050 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6050009ca0 tx=0x7f605002a8c0 comp rx=0 tx=0).stop 2024-09-19T04:15:34.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.716+0000 7f605cce8640 1 -- 172.21.15.7:0/2139085046 shutdown_connections 2024-09-19T04:15:34.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.716+0000 7f605cce8640 1 --2- 172.21.15.7:0/2139085046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60581037c0 0x7f605810a050 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:34.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.716+0000 7f605cce8640 1 --2- 172.21.15.7:0/2139085046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6058102e00 0x7f6058103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:34.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.716+0000 7f605cce8640 1 --2- 172.21.15.7:0/2139085046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6058101c00 0x7f6058102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:34.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.716+0000 7f605cce8640 1 -- 172.21.15.7:0/2139085046 >> 172.21.15.7:0/2139085046 conn(0x7f60580fd390 msgr2=0x7f60580ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:34.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.716+0000 7f605cce8640 1 -- 172.21.15.7:0/2139085046 shutdown_connections 2024-09-19T04:15:34.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.716+0000 7f605cce8640 1 -- 172.21.15.7:0/2139085046 wait complete. 2024-09-19T04:15:34.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.717+0000 7f605cce8640 1 Processor -- start 2024-09-19T04:15:34.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.717+0000 7f605cce8640 1 -- start start 2024-09-19T04:15:34.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.717+0000 7f605cce8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6058101c00 0x7f605819a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:34.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.717+0000 7f605cce8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6058102e00 0x7f605819a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:34.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.717+0000 7f605cce8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60581037c0 0x7f60581a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:34.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.717+0000 7f605cce8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f605810d900 con 0x7f6058102e00 2024-09-19T04:15:34.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.717+0000 7f605cce8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f605810d780 con 0x7f60581037c0 2024-09-19T04:15:34.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.717+0000 7f605cce8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f605810da80 con 0x7f6058101c00 2024-09-19T04:15:34.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.718+0000 7f6055d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6058102e00 0x7f605819a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:34.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.718+0000 7f6055d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6058102e00 0x7f605819a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43702/0 (socket says 172.21.15.7:43702) 2024-09-19T04:15:34.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.718+0000 7f6055d9b640 1 -- 172.21.15.7:0/1877323401 learned_addr learned my addr 172.21.15.7:0/1877323401 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:34.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.718+0000 7f605659c640 1 --2- 172.21.15.7:0/1877323401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6058101c00 0x7f605819a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:34.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.718+0000 7f6056d9d640 1 --2- 172.21.15.7:0/1877323401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60581037c0 0x7f60581a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:34.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.718+0000 7f6055d9b640 1 -- 172.21.15.7:0/1877323401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6058101c00 msgr2=0x7f605819a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:34.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.718+0000 7f6055d9b640 1 --2- 172.21.15.7:0/1877323401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6058101c00 0x7f605819a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:34.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.718+0000 7f6055d9b640 1 -- 172.21.15.7:0/1877323401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60581037c0 msgr2=0x7f60581a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:34.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.718+0000 7f6055d9b640 1 --2- 172.21.15.7:0/1877323401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60581037c0 0x7f60581a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:34.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.718+0000 7f6055d9b640 1 -- 172.21.15.7:0/1877323401 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60581a1d50 con 0x7f6058102e00 2024-09-19T04:15:34.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.718+0000 7f6055d9b640 1 --2- 172.21.15.7:0/1877323401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6058102e00 0x7f605819a660 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f604c00d950 tx=0x7f604c00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:34.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.718+0000 7f60477fe640 1 -- 172.21.15.7:0/1877323401 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604c017070 con 0x7f6058102e00 2024-09-19T04:15:34.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.718+0000 7f60477fe640 1 -- 172.21.15.7:0/1877323401 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f604c00de80 con 0x7f6058102e00 2024-09-19T04:15:34.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.718+0000 7f605cce8640 1 -- 172.21.15.7:0/1877323401 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60581a1fe0 con 0x7f6058102e00 2024-09-19T04:15:34.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.718+0000 7f60477fe640 1 -- 172.21.15.7:0/1877323401 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604c00f620 con 0x7f6058102e00 2024-09-19T04:15:34.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.718+0000 7f605cce8640 1 -- 172.21.15.7:0/1877323401 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60581a2570 con 0x7f6058102e00 2024-09-19T04:15:34.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.719+0000 7f605cce8640 1 -- 172.21.15.7:0/1877323401 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60581a27a0 con 0x7f6058102e00 2024-09-19T04:15:34.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.720+0000 7f60477fe640 1 -- 172.21.15.7:0/1877323401 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f604c009c30 con 0x7f6058102e00 2024-09-19T04:15:34.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.721+0000 7f60477fe640 1 --2- 172.21.15.7:0/1877323401 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f60400a3300 0x7f60400a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:34.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.721+0000 7f605659c640 1 --2- 172.21.15.7:0/1877323401 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f60400a3300 0x7f60400a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:34.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.721+0000 7f60477fe640 1 -- 172.21.15.7:0/1877323401 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f604c0cf880 con 0x7f6058102e00 2024-09-19T04:15:34.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.722+0000 7f605659c640 1 --2- 172.21.15.7:0/1877323401 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f60400a3300 0x7f60400a57c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6058102c60 tx=0x7f6048009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:34.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.725+0000 7f60477fe640 1 -- 172.21.15.7:0/1877323401 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f604c09c200 con 0x7f6058102e00 2024-09-19T04:15:34.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.968+0000 7f605cce8640 1 -- 172.21.15.7:0/1877323401 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f60581a2ab0 con 0x7f6058102e00 2024-09-19T04:15:34.970 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:34 smithi007 ceph-mon[31360]: pgmap v310: 129 pgs: 129 active+clean; 643 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 KiB/s wr, 14 op/s 2024-09-19T04:15:34.971 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:34 smithi007 ceph-mon[31360]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:15:34.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.970+0000 7f60477fe640 1 -- 172.21.15.7:0/1877323401 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f604c09bb00 con 0x7f6058102e00 2024-09-19T04:15:34.973 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2024-09-19T04:15:34.973 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBmpetmLmHXORAANjGmUrdip3H86bBTxS3hYw== 2024-09-19T04:15:34.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.973+0000 7f605cce8640 1 -- 172.21.15.7:0/1877323401 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f60400a3300 msgr2=0x7f60400a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:34.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.973+0000 7f605cce8640 1 --2- 172.21.15.7:0/1877323401 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f60400a3300 0x7f60400a57c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6058102c60 tx=0x7f6048009110 comp rx=0 tx=0).stop 2024-09-19T04:15:34.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.973+0000 7f605cce8640 1 -- 172.21.15.7:0/1877323401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6058102e00 msgr2=0x7f605819a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:34.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.973+0000 7f605cce8640 1 --2- 172.21.15.7:0/1877323401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6058102e00 0x7f605819a660 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f604c00d950 tx=0x7f604c00dd50 comp rx=0 tx=0).stop 2024-09-19T04:15:34.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.973+0000 7f605cce8640 1 -- 172.21.15.7:0/1877323401 shutdown_connections 2024-09-19T04:15:34.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.973+0000 7f605cce8640 1 --2- 172.21.15.7:0/1877323401 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f60400a3300 0x7f60400a57c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:34.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.973+0000 7f605cce8640 1 --2- 172.21.15.7:0/1877323401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60581037c0 0x7f60581a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:34.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.973+0000 7f605cce8640 1 --2- 172.21.15.7:0/1877323401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6058102e00 0x7f605819a660 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:34.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.973+0000 7f605cce8640 1 --2- 172.21.15.7:0/1877323401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6058101c00 0x7f605819a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:34.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.973+0000 7f605cce8640 1 -- 172.21.15.7:0/1877323401 >> 172.21.15.7:0/1877323401 conn(0x7f60580fd390 msgr2=0x7f6058074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:34.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.973+0000 7f605cce8640 1 -- 172.21.15.7:0/1877323401 shutdown_connections 2024-09-19T04:15:34.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:34.973+0000 7f605cce8640 1 -- 172.21.15.7:0/1877323401 wait complete. 2024-09-19T04:15:35.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:34 smithi102 ceph-mon[35446]: pgmap v310: 129 pgs: 129 active+clean; 643 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 KiB/s wr, 14 op/s 2024-09-19T04:15:35.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:34 smithi102 ceph-mon[35446]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:15:35.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:34 smithi092 ceph-mon[34940]: pgmap v310: 129 pgs: 129 active+clean; 643 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 KiB/s wr, 14 op/s 2024-09-19T04:15:35.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:34 smithi092 ceph-mon[34940]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:15:35.688 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T04:15:35.689 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T04:15:35.689 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T04:15:35.728 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T04:15:35.728 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T04:15:35.728 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T04:15:36.027 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:36.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:35 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1877323401' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T04:15:36.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:35 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1877323401' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T04:15:36.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:35 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1877323401' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T04:15:36.160 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:35 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1877323401' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T04:15:36.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:35 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1877323401' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T04:15:36.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:35 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1877323401' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T04:15:36.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.548+0000 7f776620b640 1 -- 172.21.15.7:0/2743739693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7760103660 msgr2=0x7f776010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:36.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.548+0000 7f776620b640 1 --2- 172.21.15.7:0/2743739693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7760103660 0x7f776010bb50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7748009900 tx=0x7f774802a480 comp rx=0 tx=0).stop 2024-09-19T04:15:36.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.548+0000 7f776620b640 1 -- 172.21.15.7:0/2743739693 shutdown_connections 2024-09-19T04:15:36.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.548+0000 7f776620b640 1 --2- 172.21.15.7:0/2743739693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f776010c170 0x7f776010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:36.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.548+0000 7f776620b640 1 --2- 172.21.15.7:0/2743739693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7760103660 0x7f776010bb50 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:36.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.548+0000 7f776620b640 1 --2- 172.21.15.7:0/2743739693 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7760102d40 0x7f7760103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:36.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.548+0000 7f776620b640 1 -- 172.21.15.7:0/2743739693 >> 172.21.15.7:0/2743739693 conn(0x7f77600fc7a0 msgr2=0x7f77600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:36.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.548+0000 7f776620b640 1 -- 172.21.15.7:0/2743739693 shutdown_connections 2024-09-19T04:15:36.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.548+0000 7f776620b640 1 -- 172.21.15.7:0/2743739693 wait complete. 2024-09-19T04:15:36.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.549+0000 7f776620b640 1 Processor -- start 2024-09-19T04:15:36.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.549+0000 7f776620b640 1 -- start start 2024-09-19T04:15:36.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.549+0000 7f776620b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7760102d40 0x7f7760198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:36.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.549+0000 7f776620b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7760103660 0x7f7760198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:36.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.549+0000 7f776620b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f776010c170 0x7f776019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:36.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.549+0000 7f776620b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7760111f70 con 0x7f7760103660 2024-09-19T04:15:36.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.549+0000 7f776620b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7760111df0 con 0x7f776010c170 2024-09-19T04:15:36.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.549+0000 7f776620b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f77601120f0 con 0x7f7760102d40 2024-09-19T04:15:36.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.549+0000 7f7757fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7760103660 0x7f7760198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:36.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.549+0000 7f7757fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7760103660 0x7f7760198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43716/0 (socket says 172.21.15.7:43716) 2024-09-19T04:15:36.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.549+0000 7f7757fff640 1 -- 172.21.15.7:0/3562420690 learned_addr learned my addr 172.21.15.7:0/3562420690 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:36.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.549+0000 7f775f7fe640 1 --2- 172.21.15.7:0/3562420690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7760102d40 0x7f7760198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:36.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.549+0000 7f775ffff640 1 --2- 172.21.15.7:0/3562420690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f776010c170 0x7f776019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:36.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.550+0000 7f7757fff640 1 -- 172.21.15.7:0/3562420690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7760102d40 msgr2=0x7f7760198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:36.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.550+0000 7f7757fff640 1 --2- 172.21.15.7:0/3562420690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7760102d40 0x7f7760198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:36.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.550+0000 7f7757fff640 1 -- 172.21.15.7:0/3562420690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f776010c170 msgr2=0x7f776019cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:36.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.550+0000 7f7757fff640 1 --2- 172.21.15.7:0/3562420690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f776010c170 0x7f776019cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:36.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.550+0000 7f7757fff640 1 -- 172.21.15.7:0/3562420690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f776019d3c0 con 0x7f7760103660 2024-09-19T04:15:36.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.550+0000 7f7757fff640 1 --2- 172.21.15.7:0/3562420690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7760103660 0x7f7760198950 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7748005ab0 tx=0x7f77480042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:36.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.550+0000 7f775d7fa640 1 -- 172.21.15.7:0/3562420690 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774803f030 con 0x7f7760103660 2024-09-19T04:15:36.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.550+0000 7f775d7fa640 1 -- 172.21.15.7:0/3562420690 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7748003ce0 con 0x7f7760103660 2024-09-19T04:15:36.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.550+0000 7f776620b640 1 -- 172.21.15.7:0/3562420690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f776019d650 con 0x7f7760103660 2024-09-19T04:15:36.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.550+0000 7f775d7fa640 1 -- 172.21.15.7:0/3562420690 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7748035070 con 0x7f7760103660 2024-09-19T04:15:36.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.550+0000 7f776620b640 1 -- 172.21.15.7:0/3562420690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77601a4f90 con 0x7f7760103660 2024-09-19T04:15:36.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.551+0000 7f776620b640 1 -- 172.21.15.7:0/3562420690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7760103120 con 0x7f7760103660 2024-09-19T04:15:36.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.552+0000 7f775d7fa640 1 -- 172.21.15.7:0/3562420690 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f7748042030 con 0x7f7760103660 2024-09-19T04:15:36.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.553+0000 7f775d7fa640 1 --2- 172.21.15.7:0/3562420690 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f774c0a32d0 0x7f774c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:36.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.554+0000 7f775f7fe640 1 --2- 172.21.15.7:0/3562420690 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f774c0a32d0 0x7f774c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:36.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.554+0000 7f775d7fa640 1 -- 172.21.15.7:0/3562420690 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f77480f0490 con 0x7f7760103660 2024-09-19T04:15:36.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.554+0000 7f775f7fe640 1 --2- 172.21.15.7:0/3562420690 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f774c0a32d0 0x7f774c0a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f77500058c0 tx=0x7f775000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:36.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.558+0000 7f775d7fa640 1 -- 172.21.15.7:0/3562420690 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f77480bc7c0 con 0x7f7760103660 2024-09-19T04:15:36.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.779+0000 7f776620b640 1 -- 172.21.15.7:0/3562420690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f77601071e0 con 0x7f7760103660 2024-09-19T04:15:36.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.784+0000 7f775d7fa640 1 -- 172.21.15.7:0/3562420690 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264040 (secure 0 0 0) 0x7f77480c0ac0 con 0x7f7760103660 2024-09-19T04:15:36.789 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:15:36.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.787+0000 7f776620b640 1 -- 172.21.15.7:0/3562420690 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f774c0a32d0 msgr2=0x7f774c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:36.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.787+0000 7f776620b640 1 --2- 172.21.15.7:0/3562420690 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f774c0a32d0 0x7f774c0a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f77500058c0 tx=0x7f775000a2d0 comp rx=0 tx=0).stop 2024-09-19T04:15:36.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.787+0000 7f776620b640 1 -- 172.21.15.7:0/3562420690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7760103660 msgr2=0x7f7760198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:36.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.787+0000 7f776620b640 1 --2- 172.21.15.7:0/3562420690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7760103660 0x7f7760198950 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7748005ab0 tx=0x7f77480042f0 comp rx=0 tx=0).stop 2024-09-19T04:15:36.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.787+0000 7f776620b640 1 -- 172.21.15.7:0/3562420690 shutdown_connections 2024-09-19T04:15:36.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.787+0000 7f776620b640 1 --2- 172.21.15.7:0/3562420690 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f774c0a32d0 0x7f774c0a5790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:36.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.787+0000 7f776620b640 1 --2- 172.21.15.7:0/3562420690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f776010c170 0x7f776019cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:36.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.787+0000 7f776620b640 1 --2- 172.21.15.7:0/3562420690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7760103660 0x7f7760198950 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:36.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.787+0000 7f776620b640 1 --2- 172.21.15.7:0/3562420690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7760102d40 0x7f7760198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:36.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.787+0000 7f776620b640 1 -- 172.21.15.7:0/3562420690 >> 172.21.15.7:0/3562420690 conn(0x7f77600fc7a0 msgr2=0x7f77600fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:36.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.787+0000 7f776620b640 1 -- 172.21.15.7:0/3562420690 shutdown_connections 2024-09-19T04:15:36.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:36.787+0000 7f776620b640 1 -- 172.21.15.7:0/3562420690 wait complete. 2024-09-19T04:15:37.099 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:36 smithi007 ceph-mon[31360]: pgmap v311: 129 pgs: 129 active+clean; 643 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.7 KiB/s wr, 12 op/s 2024-09-19T04:15:37.099 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:36 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3562420690' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T04:15:37.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:36 smithi092 ceph-mon[34940]: pgmap v311: 129 pgs: 129 active+clean; 643 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.7 KiB/s wr, 12 op/s 2024-09-19T04:15:37.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:36 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3562420690' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T04:15:37.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:36 smithi102 ceph-mon[35446]: pgmap v311: 129 pgs: 129 active+clean; 643 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.7 KiB/s wr, 12 op/s 2024-09-19T04:15:37.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:36 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3562420690' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T04:15:37.448 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":1262394163},{"type":"v1","addr":"172.21.15.7:6801","nonce":1262394163}]},"active_addr":"172.21.15.7:6801/1262394163","active_change":"2024-09-19T04:07:45.040027+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24106,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.7:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":3801191595}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":3096790698}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":2466865693}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":628032641}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":3165308735}]}]} 2024-09-19T04:15:37.454 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T04:15:37.454 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T04:15:37.454 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:15:37.714 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.250+0000 7f922300a640 1 -- 172.21.15.7:0/1730320683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f921c102570 msgr2=0x7f921c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.250+0000 7f922300a640 1 --2- 172.21.15.7:0/1730320683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f921c102570 0x7f921c1029b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9208009900 tx=0x7f920802a480 comp rx=0 tx=0).stop 2024-09-19T04:15:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.250+0000 7f922300a640 1 -- 172.21.15.7:0/1730320683 shutdown_connections 2024-09-19T04:15:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.250+0000 7f922300a640 1 --2- 172.21.15.7:0/1730320683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f921c102ef0 0x7f921c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:38.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.250+0000 7f922300a640 1 --2- 172.21.15.7:0/1730320683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f921c102570 0x7f921c1029b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.250+0000 7f922300a640 1 --2- 172.21.15.7:0/1730320683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f921c100e20 0x7f921c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.250+0000 7f922300a640 1 -- 172.21.15.7:0/1730320683 >> 172.21.15.7:0/1730320683 conn(0x7f921c0fc7d0 msgr2=0x7f921c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.250+0000 7f922300a640 1 -- 172.21.15.7:0/1730320683 shutdown_connections 2024-09-19T04:15:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.250+0000 7f922300a640 1 -- 172.21.15.7:0/1730320683 wait complete. 2024-09-19T04:15:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.251+0000 7f922300a640 1 Processor -- start 2024-09-19T04:15:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.251+0000 7f922300a640 1 -- start start 2024-09-19T04:15:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.251+0000 7f922300a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f921c100e20 0x7f921c1994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.251+0000 7f922300a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f921c102570 0x7f921c1999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.251+0000 7f922300a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f921c102ef0 0x7f921c1a4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.251+0000 7f922300a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f921c111020 con 0x7f921c100e20 2024-09-19T04:15:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.251+0000 7f922300a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f921c110ea0 con 0x7f921c102ef0 2024-09-19T04:15:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.251+0000 7f922300a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f921c1111a0 con 0x7f921c102570 2024-09-19T04:15:38.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.251+0000 7f9220da6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f921c100e20 0x7f921c1994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:38.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.252+0000 7f9220da6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f921c100e20 0x7f921c1994b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38932/0 (socket says 172.21.15.7:38932) 2024-09-19T04:15:38.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.252+0000 7f9220da6640 1 -- 172.21.15.7:0/1910632736 learned_addr learned my addr 172.21.15.7:0/1910632736 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:38.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.252+0000 7f921bfff640 1 --2- 172.21.15.7:0/1910632736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f921c102570 0x7f921c1999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:38.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.252+0000 7f92215a7640 1 --2- 172.21.15.7:0/1910632736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f921c102ef0 0x7f921c1a4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:38.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.252+0000 7f9220da6640 1 -- 172.21.15.7:0/1910632736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f921c102570 msgr2=0x7f921c1999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:38.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.252+0000 7f9220da6640 1 --2- 172.21.15.7:0/1910632736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f921c102570 0x7f921c1999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:38.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.252+0000 7f9220da6640 1 -- 172.21.15.7:0/1910632736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f921c102ef0 msgr2=0x7f921c1a4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:38.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.252+0000 7f9220da6640 1 --2- 172.21.15.7:0/1910632736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f921c102ef0 0x7f921c1a4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:38.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.252+0000 7f9220da6640 1 -- 172.21.15.7:0/1910632736 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f921c1a4a70 con 0x7f921c100e20 2024-09-19T04:15:38.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.252+0000 7f92215a7640 1 --2- 172.21.15.7:0/1910632736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f921c102ef0 0x7f921c1a4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:15:38.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.252+0000 7f9220da6640 1 --2- 172.21.15.7:0/1910632736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f921c100e20 0x7f921c1994b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f921000b4a0 tx=0x7f921000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:38.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.252+0000 7f9219ffb640 1 -- 172.21.15.7:0/1910632736 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9210014070 con 0x7f921c100e20 2024-09-19T04:15:38.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.252+0000 7f922300a640 1 -- 172.21.15.7:0/1910632736 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f921c1a4c40 con 0x7f921c100e20 2024-09-19T04:15:38.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.252+0000 7f9219ffb640 1 -- 172.21.15.7:0/1910632736 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9210010af0 con 0x7f921c100e20 2024-09-19T04:15:38.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.252+0000 7f9219ffb640 1 -- 172.21.15.7:0/1910632736 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9210017d10 con 0x7f921c100e20 2024-09-19T04:15:38.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.252+0000 7f922300a640 1 -- 172.21.15.7:0/1910632736 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f921c1a5100 con 0x7f921c100e20 2024-09-19T04:15:38.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.253+0000 7f922300a640 1 -- 172.21.15.7:0/1910632736 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f921c101280 con 0x7f921c100e20 2024-09-19T04:15:38.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.254+0000 7f9219ffb640 1 -- 172.21.15.7:0/1910632736 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f9210017070 con 0x7f921c100e20 2024-09-19T04:15:38.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.255+0000 7f9219ffb640 1 --2- 172.21.15.7:0/1910632736 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f920c0a32d0 0x7f920c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:38.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.255+0000 7f921bfff640 1 --2- 172.21.15.7:0/1910632736 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f920c0a32d0 0x7f920c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:38.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.255+0000 7f9219ffb640 1 -- 172.21.15.7:0/1910632736 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f92100cefa0 con 0x7f921c100e20 2024-09-19T04:15:38.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.256+0000 7f921bfff640 1 --2- 172.21.15.7:0/1910632736 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f920c0a32d0 0x7f920c0a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9208000c00 tx=0x7f92080058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:38.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.259+0000 7f9219ffb640 1 -- 172.21.15.7:0/1910632736 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f921009ba30 con 0x7f921c100e20 2024-09-19T04:15:38.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.434+0000 7f922300a640 1 -- 172.21.15.7:0/1910632736 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f921c109090 con 0x7f921c100e20 2024-09-19T04:15:38.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.436+0000 7f9219ffb640 1 -- 172.21.15.7:0/1910632736 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24128 (secure 0 0 0) 0x7f921009b330 con 0x7f921c100e20 2024-09-19T04:15:38.439 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:15:38.439 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":86,"fsid":"77957c0a-763c-11ef-bceb-c7b262605968","created":"2024-09-19T04:06:58.337394+0000","modified":"2024-09-19T04:14:43.113323+0000","last_up_change":"2024-09-19T04:13:42.312137+0000","last_in_change":"2024-09-19T04:13:18.757925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:09:59.544984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:14:30.225637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:14:32.252497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T04:14:38.781821+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d9b93bd5-ee22-4fb0-ba29-bfa208430a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6803","nonce":240599233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6805","nonce":240599233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6809","nonce":240599233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6807","nonce":240599233}]},"public_addr":"172.21.15.7:6803/240599233","cluster_addr":"172.21.15.7:6805/240599233","heartbeat_back_addr":"172.21.15.7:6809/240599233","heartbeat_front_addr":"172.21.15.7:6807/240599233","state":["exists","up"]},{"osd":1,"uuid":"db5793e6-f3ad-4075-a02b-206bf7f1e59a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6801","nonce":902403333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6803","nonce":902403333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6807","nonce":902403333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6805","nonce":902403333}]},"public_addr":"172.21.15.92:6801/902403333","cluster_addr":"172.21.15.92:6803/902403333","heartbeat_back_addr":"172.21.15.92:6807/902403333","heartbeat_front_addr":"172.21.15.92:6805/902403333","state":["exists","up"]},{"osd":2,"uuid":"1eb83a1b-82d8-4983-bae3-b161adb3a33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6801","nonce":2078441772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6803","nonce":2078441772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6807","nonce":2078441772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6805","nonce":2078441772}]},"public_addr":"172.21.15.102:6801/2078441772","cluster_addr":"172.21.15.102:6803/2078441772","heartbeat_back_addr":"172.21.15.102:6807/2078441772","heartbeat_front_addr":"172.21.15.102:6805/2078441772","state":["exists","up"]},{"osd":3,"uuid":"68ba79e5-bcf0-4349-9e14-42f2fa9c11b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6811","nonce":2729561132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6813","nonce":2729561132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6817","nonce":2729561132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6815","nonce":2729561132}]},"public_addr":"172.21.15.7:6811/2729561132","cluster_addr":"172.21.15.7:6813/2729561132","heartbeat_back_addr":"172.21.15.7:6817/2729561132","heartbeat_front_addr":"172.21.15.7:6815/2729561132","state":["exists","up"]},{"osd":4,"uuid":"f20d4a51-121f-4ac8-afeb-5962d83bd697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6809","nonce":2799734294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6811","nonce":2799734294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6815","nonce":2799734294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6813","nonce":2799734294}]},"public_addr":"172.21.15.92:6809/2799734294","cluster_addr":"172.21.15.92:6811/2799734294","heartbeat_back_addr":"172.21.15.92:6815/2799734294","heartbeat_front_addr":"172.21.15.92:6813/2799734294","state":["exists","up"]},{"osd":5,"uuid":"aac02b0a-99dc-4457-8898-c68dc196517a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6809","nonce":3099678146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6811","nonce":3099678146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6815","nonce":3099678146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6813","nonce":3099678146}]},"public_addr":"172.21.15.102:6809/3099678146","cluster_addr":"172.21.15.102:6811/3099678146","heartbeat_back_addr":"172.21.15.102:6815/3099678146","heartbeat_front_addr":"172.21.15.102:6813/3099678146","state":["exists","up"]},{"osd":6,"uuid":"7e5a8b30-8406-486c-ace5-79158a3757a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6819","nonce":1569704304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6821","nonce":1569704304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6825","nonce":1569704304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6823","nonce":1569704304}]},"public_addr":"172.21.15.7:6819/1569704304","cluster_addr":"172.21.15.7:6821/1569704304","heartbeat_back_addr":"172.21.15.7:6825/1569704304","heartbeat_front_addr":"172.21.15.7:6823/1569704304","state":["exists","up"]},{"osd":7,"uuid":"e6a7049a-17a1-43b2-8ecd-5f4ca7c337be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6817","nonce":3411102480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6819","nonce":3411102480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6823","nonce":3411102480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6821","nonce":3411102480}]},"public_addr":"172.21.15.92:6817/3411102480","cluster_addr":"172.21.15.92:6819/3411102480","heartbeat_back_addr":"172.21.15.92:6823/3411102480","heartbeat_front_addr":"172.21.15.92:6821/3411102480","state":["exists","up"]},{"osd":8,"uuid":"31879baa-861d-4322-990f-0b9a42b8b610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6817","nonce":2990859925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6819","nonce":2990859925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6823","nonce":2990859925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6821","nonce":2990859925}]},"public_addr":"172.21.15.102:6817/2990859925","cluster_addr":"172.21.15.102:6819/2990859925","heartbeat_back_addr":"172.21.15.102:6823/2990859925","heartbeat_front_addr":"172.21.15.102:6821/2990859925","state":["exists","up"]},{"osd":9,"uuid":"6d65db33-926c-4a6e-a072-707e9c9de92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6827","nonce":1710319475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6829","nonce":1710319475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6833","nonce":1710319475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6831","nonce":1710319475}]},"public_addr":"172.21.15.7:6827/1710319475","cluster_addr":"172.21.15.7:6829/1710319475","heartbeat_back_addr":"172.21.15.7:6833/1710319475","heartbeat_front_addr":"172.21.15.7:6831/1710319475","state":["exists","up"]},{"osd":10,"uuid":"9ab681ee-0bef-47bd-bf3d-20b17c6b870c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6825","nonce":1063265541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6827","nonce":1063265541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6831","nonce":1063265541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6829","nonce":1063265541}]},"public_addr":"172.21.15.92:6825/1063265541","cluster_addr":"172.21.15.92:6827/1063265541","heartbeat_back_addr":"172.21.15.92:6831/1063265541","heartbeat_front_addr":"172.21.15.92:6829/1063265541","state":["exists","up"]},{"osd":11,"uuid":"dc398e14-5f9e-4f0a-b158-35cbc1f73a83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6825","nonce":1175425599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6827","nonce":1175425599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6831","nonce":1175425599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6829","nonce":1175425599}]},"public_addr":"172.21.15.102:6825/1175425599","cluster_addr":"172.21.15.102:6827/1175425599","heartbeat_back_addr":"172.21.15.102:6831/1175425599","heartbeat_front_addr":"172.21.15.102:6829/1175425599","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:07.857319+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:31.430120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:56.892301+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:10:22.011884+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:10:46.326025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:11:10.339084+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:11:35.365906+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:01.104309+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:25.717295+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:51.387644+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:13:15.076355+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:13:40.253150+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/2883028938":"2024-09-20T04:07:45.039922+0000","172.21.15.7:0/1186412739":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6800/751091002":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6801/751091002":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6801/940106179":"2024-09-20T04:07:20.364033+0000","172.21.15.7:6800/940106179":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/1450115700":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/2954294373":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/1996930242":"2024-09-20T04:07:45.039922+0000","172.21.15.7:0/3562231347":"2024-09-20T04:07:20.364033+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:15:38.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.438+0000 7f922300a640 1 -- 172.21.15.7:0/1910632736 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f920c0a32d0 msgr2=0x7f920c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:38.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.438+0000 7f922300a640 1 --2- 172.21.15.7:0/1910632736 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f920c0a32d0 0x7f920c0a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9208000c00 tx=0x7f92080058d0 comp rx=0 tx=0).stop 2024-09-19T04:15:38.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.438+0000 7f922300a640 1 -- 172.21.15.7:0/1910632736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f921c100e20 msgr2=0x7f921c1994b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:38.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.438+0000 7f922300a640 1 --2- 172.21.15.7:0/1910632736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f921c100e20 0x7f921c1994b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f921000b4a0 tx=0x7f921000b960 comp rx=0 tx=0).stop 2024-09-19T04:15:38.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.438+0000 7f922300a640 1 -- 172.21.15.7:0/1910632736 shutdown_connections 2024-09-19T04:15:38.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.438+0000 7f922300a640 1 --2- 172.21.15.7:0/1910632736 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f920c0a32d0 0x7f920c0a5790 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:38.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.438+0000 7f922300a640 1 --2- 172.21.15.7:0/1910632736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f921c102ef0 0x7f921c1a4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:38.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.438+0000 7f922300a640 1 --2- 172.21.15.7:0/1910632736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f921c102570 0x7f921c1999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:38.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.438+0000 7f922300a640 1 --2- 172.21.15.7:0/1910632736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f921c100e20 0x7f921c1994b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:38.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.438+0000 7f922300a640 1 -- 172.21.15.7:0/1910632736 >> 172.21.15.7:0/1910632736 conn(0x7f921c0fc7d0 msgr2=0x7f921c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:38.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.438+0000 7f922300a640 1 -- 172.21.15.7:0/1910632736 shutdown_connections 2024-09-19T04:15:38.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:38.438+0000 7f922300a640 1 -- 172.21.15.7:0/1910632736 wait complete. 2024-09-19T04:15:39.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:38 smithi007 ceph-mon[31360]: pgmap v312: 129 pgs: 129 active+clean; 643 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-19T04:15:39.185 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:38 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1910632736' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:15:39.216 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T04:15:39.217 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:15:39.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:38 smithi092 ceph-mon[34940]: pgmap v312: 129 pgs: 129 active+clean; 643 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-19T04:15:39.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:38 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1910632736' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:15:39.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:38 smithi102 ceph-mon[35446]: pgmap v312: 129 pgs: 129 active+clean; 643 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-19T04:15:39.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:38 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1910632736' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:15:39.476 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:39.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.976+0000 7fc1770eb640 1 -- 172.21.15.7:0/3856619031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1701037a0 msgr2=0x7fc17010bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:39.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.976+0000 7fc1770eb640 1 --2- 172.21.15.7:0/3856619031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1701037a0 0x7fc17010bc00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc15c009900 tx=0x7fc15c02a410 comp rx=0 tx=0).stop 2024-09-19T04:15:39.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.977+0000 7fc1770eb640 1 -- 172.21.15.7:0/3856619031 shutdown_connections 2024-09-19T04:15:39.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.977+0000 7fc1770eb640 1 --2- 172.21.15.7:0/3856619031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc17010c2f0 0x7fc17010e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:39.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.977+0000 7fc1770eb640 1 --2- 172.21.15.7:0/3856619031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1701037a0 0x7fc17010bc00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:39.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.977+0000 7fc1770eb640 1 --2- 172.21.15.7:0/3856619031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc170102df0 0x7fc1701031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:39.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.977+0000 7fc1770eb640 1 -- 172.21.15.7:0/3856619031 >> 172.21.15.7:0/3856619031 conn(0x7fc1700fc7d0 msgr2=0x7fc1700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:39.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.977+0000 7fc1770eb640 1 -- 172.21.15.7:0/3856619031 shutdown_connections 2024-09-19T04:15:39.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.977+0000 7fc1770eb640 1 -- 172.21.15.7:0/3856619031 wait complete. 2024-09-19T04:15:39.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.977+0000 7fc1770eb640 1 Processor -- start 2024-09-19T04:15:39.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.977+0000 7fc1770eb640 1 -- start start 2024-09-19T04:15:39.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.978+0000 7fc1770eb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc170102df0 0x7fc170100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:39.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.978+0000 7fc1770eb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1701037a0 0x7fc170100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:39.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.978+0000 7fc1770eb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc17010c2f0 0x7fc1701014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:39.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.978+0000 7fc1770eb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc1701120d0 con 0x7fc170102df0 2024-09-19T04:15:39.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.978+0000 7fc1770eb640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc170111f50 con 0x7fc1701037a0 2024-09-19T04:15:39.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.978+0000 7fc1770eb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc170112250 con 0x7fc17010c2f0 2024-09-19T04:15:39.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.978+0000 7fc174e87640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc170102df0 0x7fc170100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:39.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.978+0000 7fc174e87640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc170102df0 0x7fc170100a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38954/0 (socket says 172.21.15.7:38954) 2024-09-19T04:15:39.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.978+0000 7fc174e87640 1 -- 172.21.15.7:0/934129557 learned_addr learned my addr 172.21.15.7:0/934129557 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:39.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.978+0000 7fc16ffff640 1 --2- 172.21.15.7:0/934129557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1701037a0 0x7fc170100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:39.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.978+0000 7fc175688640 1 --2- 172.21.15.7:0/934129557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc17010c2f0 0x7fc1701014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:39.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.978+0000 7fc174e87640 1 -- 172.21.15.7:0/934129557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc17010c2f0 msgr2=0x7fc1701014d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:39.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.978+0000 7fc174e87640 1 --2- 172.21.15.7:0/934129557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc17010c2f0 0x7fc1701014d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:39.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.978+0000 7fc174e87640 1 -- 172.21.15.7:0/934129557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1701037a0 msgr2=0x7fc170100f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:39.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.978+0000 7fc174e87640 1 --2- 172.21.15.7:0/934129557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1701037a0 0x7fc170100f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:39.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.978+0000 7fc174e87640 1 -- 172.21.15.7:0/934129557 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1701a6ad0 con 0x7fc170102df0 2024-09-19T04:15:39.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.978+0000 7fc174e87640 1 --2- 172.21.15.7:0/934129557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc170102df0 0x7fc170100a50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc16400d950 tx=0x7fc16400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:39.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.979+0000 7fc16dffb640 1 -- 172.21.15.7:0/934129557 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc164017030 con 0x7fc170102df0 2024-09-19T04:15:39.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.979+0000 7fc16dffb640 1 -- 172.21.15.7:0/934129557 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc164004020 con 0x7fc170102df0 2024-09-19T04:15:39.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.979+0000 7fc1770eb640 1 -- 172.21.15.7:0/934129557 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1701a6dc0 con 0x7fc170102df0 2024-09-19T04:15:39.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.979+0000 7fc16dffb640 1 -- 172.21.15.7:0/934129557 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1640047a0 con 0x7fc170102df0 2024-09-19T04:15:39.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.980+0000 7fc1770eb640 1 -- 172.21.15.7:0/934129557 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1701a7270 con 0x7fc170102df0 2024-09-19T04:15:39.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.981+0000 7fc1770eb640 1 -- 172.21.15.7:0/934129557 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1701031d0 con 0x7fc170102df0 2024-09-19T04:15:39.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.982+0000 7fc16dffb640 1 -- 172.21.15.7:0/934129557 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fc1640041d0 con 0x7fc170102df0 2024-09-19T04:15:39.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.982+0000 7fc16dffb640 1 --2- 172.21.15.7:0/934129557 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc1600a32d0 0x7fc1600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:39.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.982+0000 7fc16ffff640 1 --2- 172.21.15.7:0/934129557 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc1600a32d0 0x7fc1600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:39.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.982+0000 7fc16dffb640 1 -- 172.21.15.7:0/934129557 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fc1640cf630 con 0x7fc170102df0 2024-09-19T04:15:39.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.983+0000 7fc16ffff640 1 --2- 172.21.15.7:0/934129557 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc1600a32d0 0x7fc1600a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc15c005940 tx=0x7fc15c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:39.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:39.987+0000 7fc16dffb640 1 -- 172.21.15.7:0/934129557 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc16409bfb0 con 0x7fc170102df0 2024-09-19T04:15:40.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:40.163+0000 7fc1770eb640 1 -- 172.21.15.7:0/934129557 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc1701072c0 con 0x7fc170102df0 2024-09-19T04:15:40.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:40.165+0000 7fc16dffb640 1 -- 172.21.15.7:0/934129557 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24128 (secure 0 0 0) 0x7fc16409b8b0 con 0x7fc170102df0 2024-09-19T04:15:40.167 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:15:40.167 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":86,"fsid":"77957c0a-763c-11ef-bceb-c7b262605968","created":"2024-09-19T04:06:58.337394+0000","modified":"2024-09-19T04:14:43.113323+0000","last_up_change":"2024-09-19T04:13:42.312137+0000","last_in_change":"2024-09-19T04:13:18.757925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:09:59.544984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:14:30.225637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:14:32.252497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T04:14:38.781821+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d9b93bd5-ee22-4fb0-ba29-bfa208430a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6803","nonce":240599233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6805","nonce":240599233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6809","nonce":240599233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6807","nonce":240599233}]},"public_addr":"172.21.15.7:6803/240599233","cluster_addr":"172.21.15.7:6805/240599233","heartbeat_back_addr":"172.21.15.7:6809/240599233","heartbeat_front_addr":"172.21.15.7:6807/240599233","state":["exists","up"]},{"osd":1,"uuid":"db5793e6-f3ad-4075-a02b-206bf7f1e59a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6801","nonce":902403333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6803","nonce":902403333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6807","nonce":902403333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6805","nonce":902403333}]},"public_addr":"172.21.15.92:6801/902403333","cluster_addr":"172.21.15.92:6803/902403333","heartbeat_back_addr":"172.21.15.92:6807/902403333","heartbeat_front_addr":"172.21.15.92:6805/902403333","state":["exists","up"]},{"osd":2,"uuid":"1eb83a1b-82d8-4983-bae3-b161adb3a33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6801","nonce":2078441772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6803","nonce":2078441772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6807","nonce":2078441772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6805","nonce":2078441772}]},"public_addr":"172.21.15.102:6801/2078441772","cluster_addr":"172.21.15.102:6803/2078441772","heartbeat_back_addr":"172.21.15.102:6807/2078441772","heartbeat_front_addr":"172.21.15.102:6805/2078441772","state":["exists","up"]},{"osd":3,"uuid":"68ba79e5-bcf0-4349-9e14-42f2fa9c11b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6811","nonce":2729561132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6813","nonce":2729561132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6817","nonce":2729561132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6815","nonce":2729561132}]},"public_addr":"172.21.15.7:6811/2729561132","cluster_addr":"172.21.15.7:6813/2729561132","heartbeat_back_addr":"172.21.15.7:6817/2729561132","heartbeat_front_addr":"172.21.15.7:6815/2729561132","state":["exists","up"]},{"osd":4,"uuid":"f20d4a51-121f-4ac8-afeb-5962d83bd697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6809","nonce":2799734294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6811","nonce":2799734294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6815","nonce":2799734294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6813","nonce":2799734294}]},"public_addr":"172.21.15.92:6809/2799734294","cluster_addr":"172.21.15.92:6811/2799734294","heartbeat_back_addr":"172.21.15.92:6815/2799734294","heartbeat_front_addr":"172.21.15.92:6813/2799734294","state":["exists","up"]},{"osd":5,"uuid":"aac02b0a-99dc-4457-8898-c68dc196517a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6809","nonce":3099678146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6811","nonce":3099678146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6815","nonce":3099678146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6813","nonce":3099678146}]},"public_addr":"172.21.15.102:6809/3099678146","cluster_addr":"172.21.15.102:6811/3099678146","heartbeat_back_addr":"172.21.15.102:6815/3099678146","heartbeat_front_addr":"172.21.15.102:6813/3099678146","state":["exists","up"]},{"osd":6,"uuid":"7e5a8b30-8406-486c-ace5-79158a3757a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6819","nonce":1569704304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6821","nonce":1569704304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6825","nonce":1569704304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6823","nonce":1569704304}]},"public_addr":"172.21.15.7:6819/1569704304","cluster_addr":"172.21.15.7:6821/1569704304","heartbeat_back_addr":"172.21.15.7:6825/1569704304","heartbeat_front_addr":"172.21.15.7:6823/1569704304","state":["exists","up"]},{"osd":7,"uuid":"e6a7049a-17a1-43b2-8ecd-5f4ca7c337be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6817","nonce":3411102480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6819","nonce":3411102480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6823","nonce":3411102480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6821","nonce":3411102480}]},"public_addr":"172.21.15.92:6817/3411102480","cluster_addr":"172.21.15.92:6819/3411102480","heartbeat_back_addr":"172.21.15.92:6823/3411102480","heartbeat_front_addr":"172.21.15.92:6821/3411102480","state":["exists","up"]},{"osd":8,"uuid":"31879baa-861d-4322-990f-0b9a42b8b610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6817","nonce":2990859925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6819","nonce":2990859925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6823","nonce":2990859925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6821","nonce":2990859925}]},"public_addr":"172.21.15.102:6817/2990859925","cluster_addr":"172.21.15.102:6819/2990859925","heartbeat_back_addr":"172.21.15.102:6823/2990859925","heartbeat_front_addr":"172.21.15.102:6821/2990859925","state":["exists","up"]},{"osd":9,"uuid":"6d65db33-926c-4a6e-a072-707e9c9de92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6827","nonce":1710319475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6829","nonce":1710319475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6833","nonce":1710319475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6831","nonce":1710319475}]},"public_addr":"172.21.15.7:6827/1710319475","cluster_addr":"172.21.15.7:6829/1710319475","heartbeat_back_addr":"172.21.15.7:6833/1710319475","heartbeat_front_addr":"172.21.15.7:6831/1710319475","state":["exists","up"]},{"osd":10,"uuid":"9ab681ee-0bef-47bd-bf3d-20b17c6b870c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6825","nonce":1063265541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6827","nonce":1063265541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6831","nonce":1063265541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6829","nonce":1063265541}]},"public_addr":"172.21.15.92:6825/1063265541","cluster_addr":"172.21.15.92:6827/1063265541","heartbeat_back_addr":"172.21.15.92:6831/1063265541","heartbeat_front_addr":"172.21.15.92:6829/1063265541","state":["exists","up"]},{"osd":11,"uuid":"dc398e14-5f9e-4f0a-b158-35cbc1f73a83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6825","nonce":1175425599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6827","nonce":1175425599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6831","nonce":1175425599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6829","nonce":1175425599}]},"public_addr":"172.21.15.102:6825/1175425599","cluster_addr":"172.21.15.102:6827/1175425599","heartbeat_back_addr":"172.21.15.102:6831/1175425599","heartbeat_front_addr":"172.21.15.102:6829/1175425599","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:07.857319+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:31.430120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:56.892301+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:10:22.011884+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:10:46.326025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:11:10.339084+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:11:35.365906+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:01.104309+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:25.717295+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:51.387644+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:13:15.076355+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:13:40.253150+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/2883028938":"2024-09-20T04:07:45.039922+0000","172.21.15.7:0/1186412739":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6800/751091002":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6801/751091002":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6801/940106179":"2024-09-20T04:07:20.364033+0000","172.21.15.7:6800/940106179":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/1450115700":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/2954294373":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/1996930242":"2024-09-20T04:07:45.039922+0000","172.21.15.7:0/3562231347":"2024-09-20T04:07:20.364033+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:15:40.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:40.167+0000 7fc1770eb640 1 -- 172.21.15.7:0/934129557 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc1600a32d0 msgr2=0x7fc1600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:40.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:40.167+0000 7fc1770eb640 1 --2- 172.21.15.7:0/934129557 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc1600a32d0 0x7fc1600a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc15c005940 tx=0x7fc15c0058d0 comp rx=0 tx=0).stop 2024-09-19T04:15:40.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:40.167+0000 7fc1770eb640 1 -- 172.21.15.7:0/934129557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc170102df0 msgr2=0x7fc170100a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:40.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:40.167+0000 7fc1770eb640 1 --2- 172.21.15.7:0/934129557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc170102df0 0x7fc170100a50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc16400d950 tx=0x7fc16400de10 comp rx=0 tx=0).stop 2024-09-19T04:15:40.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:40.167+0000 7fc1770eb640 1 -- 172.21.15.7:0/934129557 shutdown_connections 2024-09-19T04:15:40.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:40.167+0000 7fc1770eb640 1 --2- 172.21.15.7:0/934129557 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc1600a32d0 0x7fc1600a5790 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:40.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:40.167+0000 7fc1770eb640 1 --2- 172.21.15.7:0/934129557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc17010c2f0 0x7fc1701014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:40.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:40.167+0000 7fc1770eb640 1 --2- 172.21.15.7:0/934129557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1701037a0 0x7fc170100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:40.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:40.167+0000 7fc1770eb640 1 --2- 172.21.15.7:0/934129557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc170102df0 0x7fc170100a50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:40.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:40.167+0000 7fc1770eb640 1 -- 172.21.15.7:0/934129557 >> 172.21.15.7:0/934129557 conn(0x7fc1700fc7d0 msgr2=0x7fc1700fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:40.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:40.167+0000 7fc1770eb640 1 -- 172.21.15.7:0/934129557 shutdown_connections 2024-09-19T04:15:40.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:40.167+0000 7fc1770eb640 1 -- 172.21.15.7:0/934129557 wait complete. 2024-09-19T04:15:40.845 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T04:15:40.845 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T04:15:40.846 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T04:15:40.846 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T04:15:40.847 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T04:15:40.847 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T04:15:40.847 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-19T04:15:40.848 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-19T04:15:40.848 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-19T04:15:40.849 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-19T04:15:40.849 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-19T04:15:40.849 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-19T04:15:41.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:40 smithi007 ceph-mon[31360]: pgmap v313: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 3.6 KiB/s wr, 14 op/s 2024-09-19T04:15:41.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:40 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/934129557' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:15:41.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:40 smithi092 ceph-mon[34940]: pgmap v313: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 3.6 KiB/s wr, 14 op/s 2024-09-19T04:15:41.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:40 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/934129557' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:15:41.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:40 smithi102 ceph-mon[35446]: pgmap v313: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 3.6 KiB/s wr, 14 op/s 2024-09-19T04:15:41.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:40 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/934129557' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:15:41.556 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:41.572 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:41.576 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:41.576 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:41.583 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:41.592 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:43.010 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:43.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:42 smithi007 ceph-mon[31360]: pgmap v314: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-19T04:15:43.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.088+0000 7f231fabb640 1 -- 172.21.15.7:0/2269900992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2318102ef0 msgr2=0x7f231810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:43.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.088+0000 7f231fabb640 1 --2- 172.21.15.7:0/2269900992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2318102ef0 0x7f231810da40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2310009900 tx=0x7f231002a480 comp rx=0 tx=0).stop 2024-09-19T04:15:43.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.089+0000 7f231fabb640 1 -- 172.21.15.7:0/2269900992 shutdown_connections 2024-09-19T04:15:43.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.089+0000 7f231fabb640 1 --2- 172.21.15.7:0/2269900992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2318102ef0 0x7f231810da40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:43.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.089+0000 7f231fabb640 1 --2- 172.21.15.7:0/2269900992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2318102570 0x7f23181029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:43.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.089+0000 7f231fabb640 1 --2- 172.21.15.7:0/2269900992 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2318100e20 0x7f2318101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:43.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.089+0000 7f231fabb640 1 -- 172.21.15.7:0/2269900992 >> 172.21.15.7:0/2269900992 conn(0x7f23180fc7d0 msgr2=0x7f23180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:43.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.089+0000 7f231fabb640 1 -- 172.21.15.7:0/2269900992 shutdown_connections 2024-09-19T04:15:43.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.089+0000 7f231fabb640 1 -- 172.21.15.7:0/2269900992 wait complete. 2024-09-19T04:15:43.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.089+0000 7f231fabb640 1 Processor -- start 2024-09-19T04:15:43.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.090+0000 7f231fabb640 1 -- start start 2024-09-19T04:15:43.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.090+0000 7f231fabb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2318100e20 0x7f2318198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:43.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.090+0000 7f231fabb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2318102570 0x7f2318198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:43.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.090+0000 7f231fabb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2318102ef0 0x7f231819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:43.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.090+0000 7f231fabb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2318110f80 con 0x7f2318102ef0 2024-09-19T04:15:43.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.090+0000 7f231fabb640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2318110e00 con 0x7f2318100e20 2024-09-19T04:15:43.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.090+0000 7f231fabb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2318111100 con 0x7f2318102570 2024-09-19T04:15:43.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.090+0000 7f231e058640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2318102ef0 0x7f231819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:43.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.090+0000 7f231e058640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2318102ef0 0x7f231819cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38972/0 (socket says 172.21.15.7:38972) 2024-09-19T04:15:43.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.090+0000 7f231e058640 1 -- 172.21.15.7:0/4031586177 learned_addr learned my addr 172.21.15.7:0/4031586177 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:43.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.090+0000 7f231d857640 1 --2- 172.21.15.7:0/4031586177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2318100e20 0x7f2318198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:43.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.090+0000 7f231d056640 1 --2- 172.21.15.7:0/4031586177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2318102570 0x7f2318198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:43.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.090+0000 7f231e058640 1 -- 172.21.15.7:0/4031586177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2318102570 msgr2=0x7f2318198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:43.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.090+0000 7f231e058640 1 --2- 172.21.15.7:0/4031586177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2318102570 0x7f2318198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:43.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.090+0000 7f231e058640 1 -- 172.21.15.7:0/4031586177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2318100e20 msgr2=0x7f2318198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:43.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.090+0000 7f231e058640 1 --2- 172.21.15.7:0/4031586177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2318100e20 0x7f2318198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:43.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.090+0000 7f231e058640 1 -- 172.21.15.7:0/4031586177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231819d4b0 con 0x7f2318102ef0 2024-09-19T04:15:43.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.091+0000 7f231e058640 1 --2- 172.21.15.7:0/4031586177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2318102ef0 0x7f231819cdd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2310004770 tx=0x7f2310003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:43.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.091+0000 7f230effd640 1 -- 172.21.15.7:0/4031586177 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231003f070 con 0x7f2318102ef0 2024-09-19T04:15:43.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.091+0000 7f231fabb640 1 -- 172.21.15.7:0/4031586177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f231819d740 con 0x7f2318102ef0 2024-09-19T04:15:43.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.091+0000 7f231fabb640 1 -- 172.21.15.7:0/4031586177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23181a5080 con 0x7f2318102ef0 2024-09-19T04:15:43.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.091+0000 7f230effd640 1 -- 172.21.15.7:0/4031586177 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2310031c30 con 0x7f2318102ef0 2024-09-19T04:15:43.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.091+0000 7f230effd640 1 -- 172.21.15.7:0/4031586177 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2310035030 con 0x7f2318102ef0 2024-09-19T04:15:43.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.092+0000 7f231fabb640 1 -- 172.21.15.7:0/4031586177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2318062980 con 0x7f2318102ef0 2024-09-19T04:15:43.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.093+0000 7f230effd640 1 -- 172.21.15.7:0/4031586177 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f2310042070 con 0x7f2318102ef0 2024-09-19T04:15:43.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.094+0000 7f230effd640 1 --2- 172.21.15.7:0/4031586177 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f23040a7760 0x7f23040a9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:43.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.094+0000 7f231d857640 1 --2- 172.21.15.7:0/4031586177 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f23040a7760 0x7f23040a9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:43.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.094+0000 7f230effd640 1 -- 172.21.15.7:0/4031586177 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f23100f0bd0 con 0x7f2318102ef0 2024-09-19T04:15:43.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.094+0000 7f230effd640 1 --2- 172.21.15.7:0/4031586177 >> [v2:172.21.15.102:6808/3099678146,v1:172.21.15.102:6809/3099678146] conn(0x7f23040b2490 0x7f23040b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:43.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.094+0000 7f230effd640 1 -- 172.21.15.7:0/4031586177 --> [v2:172.21.15.102:6808/3099678146,v1:172.21.15.102:6809/3099678146] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2310038e90 con 0x7f23040b2490 2024-09-19T04:15:43.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.094+0000 7f230effd640 1 -- 172.21.15.7:0/4031586177 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f23100f1020 con 0x7f2318102ef0 2024-09-19T04:15:43.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.094+0000 7f231d857640 1 --2- 172.21.15.7:0/4031586177 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f23040a7760 0x7f23040a9c20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2314005c40 tx=0x7f231400a570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:43.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.095+0000 7f231d056640 1 --2- 172.21.15.7:0/4031586177 >> [v2:172.21.15.102:6808/3099678146,v1:172.21.15.102:6809/3099678146] conn(0x7f23040b2490 0x7f23040b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:43.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.095+0000 7f231d056640 1 --2- 172.21.15.7:0/4031586177 >> [v2:172.21.15.102:6808/3099678146,v1:172.21.15.102:6809/3099678146] conn(0x7f23040b2490 0x7f23040b48d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:43.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.096+0000 7f230effd640 1 -- 172.21.15.7:0/4031586177 <== osd.5 v2:172.21.15.102:6808/3099678146 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2310038e90 con 0x7f23040b2490 2024-09-19T04:15:43.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.109+0000 7f231fabb640 1 -- 172.21.15.7:0/4031586177 --> [v2:172.21.15.102:6808/3099678146,v1:172.21.15.102:6809/3099678146] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2318062db0 con 0x7f23040b2490 2024-09-19T04:15:43.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.110+0000 7f230effd640 1 -- 172.21.15.7:0/4031586177 <== osd.5 v2:172.21.15.102:6808/3099678146 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2318062db0 con 0x7f23040b2490 2024-09-19T04:15:43.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.110+0000 7f231fabb640 1 -- 172.21.15.7:0/4031586177 >> [v2:172.21.15.102:6808/3099678146,v1:172.21.15.102:6809/3099678146] conn(0x7f23040b2490 msgr2=0x7f23040b48d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:43.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.110+0000 7f231fabb640 1 --2- 172.21.15.7:0/4031586177 >> [v2:172.21.15.102:6808/3099678146,v1:172.21.15.102:6809/3099678146] conn(0x7f23040b2490 0x7f23040b48d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:43.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.110+0000 7f231fabb640 1 -- 172.21.15.7:0/4031586177 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f23040a7760 msgr2=0x7f23040a9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:43.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.110+0000 7f231fabb640 1 --2- 172.21.15.7:0/4031586177 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f23040a7760 0x7f23040a9c20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2314005c40 tx=0x7f231400a570 comp rx=0 tx=0).stop 2024-09-19T04:15:43.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.110+0000 7f231fabb640 1 -- 172.21.15.7:0/4031586177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2318102ef0 msgr2=0x7f231819cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:43.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.110+0000 7f231fabb640 1 --2- 172.21.15.7:0/4031586177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2318102ef0 0x7f231819cdd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2310004770 tx=0x7f2310003c10 comp rx=0 tx=0).stop 2024-09-19T04:15:43.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.110+0000 7f231e058640 1 -- 172.21.15.7:0/4031586177 reap_dead start 2024-09-19T04:15:43.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.111+0000 7f231fabb640 1 -- 172.21.15.7:0/4031586177 shutdown_connections 2024-09-19T04:15:43.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.111+0000 7f231fabb640 1 -- 172.21.15.7:0/4031586177 >> 172.21.15.7:0/4031586177 conn(0x7f23180fc7d0 msgr2=0x7f231806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:43.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.111+0000 7f231fabb640 1 -- 172.21.15.7:0/4031586177 shutdown_connections 2024-09-19T04:15:43.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.111+0000 7f231fabb640 1 -- 172.21.15.7:0/4031586177 wait complete. 2024-09-19T04:15:43.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:42 smithi092 ceph-mon[34940]: pgmap v314: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-19T04:15:43.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:42 smithi102 ceph-mon[35446]: pgmap v314: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-19T04:15:43.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.626+0000 7f322dcf5640 1 -- 172.21.15.7:0/4105531440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f322810c180 msgr2=0x7f322810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:43.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.626+0000 7f322dcf5640 1 --2- 172.21.15.7:0/4105531440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f322810c180 0x7f322810e610 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3220009ca0 tx=0x7f322002a950 comp rx=0 tx=0).stop 2024-09-19T04:15:43.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.626+0000 7f322dcf5640 1 -- 172.21.15.7:0/4105531440 shutdown_connections 2024-09-19T04:15:43.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.626+0000 7f322dcf5640 1 --2- 172.21.15.7:0/4105531440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f322810c180 0x7f322810e610 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:43.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.626+0000 7f322dcf5640 1 --2- 172.21.15.7:0/4105531440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3228103700 0x7f322810bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:43.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.626+0000 7f322dcf5640 1 --2- 172.21.15.7:0/4105531440 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3228102de0 0x7f32281031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:43.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.626+0000 7f322dcf5640 1 -- 172.21.15.7:0/4105531440 >> 172.21.15.7:0/4105531440 conn(0x7f32280fc7c0 msgr2=0x7f32280febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:43.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.626+0000 7f322dcf5640 1 -- 172.21.15.7:0/4105531440 shutdown_connections 2024-09-19T04:15:43.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.626+0000 7f322dcf5640 1 -- 172.21.15.7:0/4105531440 wait complete. 2024-09-19T04:15:43.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.626+0000 7f322dcf5640 1 Processor -- start 2024-09-19T04:15:43.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.626+0000 7f322dcf5640 1 -- start start 2024-09-19T04:15:43.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.626+0000 7f322dcf5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3228102de0 0x7f3228100a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:43.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.626+0000 7f322dcf5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3228103700 0x7f3228100f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:43.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.626+0000 7f322dcf5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f322810c180 0x7f32281014c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:43.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.626+0000 7f322dcf5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3228111fc0 con 0x7f3228103700 2024-09-19T04:15:43.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.626+0000 7f322dcf5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3228111e40 con 0x7f322810c180 2024-09-19T04:15:43.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.626+0000 7f322dcf5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3228112140 con 0x7f3228102de0 2024-09-19T04:15:43.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.626+0000 7f321effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3228103700 0x7f3228100f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:43.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.626+0000 7f321effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3228103700 0x7f3228100f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38990/0 (socket says 172.21.15.7:38990) 2024-09-19T04:15:43.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.626+0000 7f321effd640 1 -- 172.21.15.7:0/887670049 learned_addr learned my addr 172.21.15.7:0/887670049 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:43.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.626+0000 7f32277fe640 1 --2- 172.21.15.7:0/887670049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3228102de0 0x7f3228100a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:43.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.626+0000 7f3227fff640 1 --2- 172.21.15.7:0/887670049 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f322810c180 0x7f32281014c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:43.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.626+0000 7f321effd640 1 -- 172.21.15.7:0/887670049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3228102de0 msgr2=0x7f3228100a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:43.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.626+0000 7f321effd640 1 --2- 172.21.15.7:0/887670049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3228102de0 0x7f3228100a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:43.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.626+0000 7f321effd640 1 -- 172.21.15.7:0/887670049 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f322810c180 msgr2=0x7f32281014c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:43.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.626+0000 7f321effd640 1 --2- 172.21.15.7:0/887670049 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f322810c180 0x7f32281014c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:43.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.626+0000 7f321effd640 1 -- 172.21.15.7:0/887670049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32281a68a0 con 0x7f3228103700 2024-09-19T04:15:43.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.626+0000 7f3227fff640 1 --2- 172.21.15.7:0/887670049 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f322810c180 0x7f32281014c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:15:43.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.626+0000 7f321effd640 1 --2- 172.21.15.7:0/887670049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3228103700 0x7f3228100f80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f321000c890 tx=0x7f321000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:43.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.627+0000 7f32257fa640 1 -- 172.21.15.7:0/887670049 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3210004220 con 0x7f3228103700 2024-09-19T04:15:43.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.627+0000 7f322dcf5640 1 -- 172.21.15.7:0/887670049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32281a6b90 con 0x7f3228103700 2024-09-19T04:15:43.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.627+0000 7f32257fa640 1 -- 172.21.15.7:0/887670049 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32100043c0 con 0x7f3228103700 2024-09-19T04:15:43.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.627+0000 7f32257fa640 1 -- 172.21.15.7:0/887670049 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3210004a00 con 0x7f3228103700 2024-09-19T04:15:43.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.627+0000 7f322dcf5640 1 -- 172.21.15.7:0/887670049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32281a7120 con 0x7f3228103700 2024-09-19T04:15:43.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.628+0000 7f322dcf5640 1 -- 172.21.15.7:0/887670049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f32280fe770 con 0x7f3228103700 2024-09-19T04:15:43.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.629+0000 7f32257fa640 1 -- 172.21.15.7:0/887670049 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f32100079b0 con 0x7f3228103700 2024-09-19T04:15:43.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.630+0000 7f32257fa640 1 --2- 172.21.15.7:0/887670049 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f32140a32d0 0x7f32140a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:43.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.630+0000 7f32277fe640 1 --2- 172.21.15.7:0/887670049 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f32140a32d0 0x7f32140a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:43.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.630+0000 7f32257fa640 1 -- 172.21.15.7:0/887670049 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f32100cfd70 con 0x7f3228103700 2024-09-19T04:15:43.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.630+0000 7f32257fa640 1 --2- 172.21.15.7:0/887670049 >> [v2:172.21.15.92:6824/1063265541,v1:172.21.15.92:6825/1063265541] conn(0x7f32140ae000 0x7f32140b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:43.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.630+0000 7f32257fa640 1 -- 172.21.15.7:0/887670049 --> [v2:172.21.15.92:6824/1063265541,v1:172.21.15.92:6825/1063265541] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3210001d30 con 0x7f32140ae000 2024-09-19T04:15:43.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.630+0000 7f32257fa640 1 -- 172.21.15.7:0/887670049 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f32100d01c0 con 0x7f3228103700 2024-09-19T04:15:43.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.630+0000 7f32277fe640 1 --2- 172.21.15.7:0/887670049 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f32140a32d0 0x7f32140a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f321800bbe0 tx=0x7f321800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:43.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.631+0000 7f3227fff640 1 --2- 172.21.15.7:0/887670049 >> [v2:172.21.15.92:6824/1063265541,v1:172.21.15.92:6825/1063265541] conn(0x7f32140ae000 0x7f32140b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:43.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.631+0000 7f3227fff640 1 --2- 172.21.15.7:0/887670049 >> [v2:172.21.15.92:6824/1063265541,v1:172.21.15.92:6825/1063265541] conn(0x7f32140ae000 0x7f32140b0440 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:43.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.632+0000 7f32257fa640 1 -- 172.21.15.7:0/887670049 <== osd.10 v2:172.21.15.92:6824/1063265541 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3210001d30 con 0x7f32140ae000 2024-09-19T04:15:43.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.646+0000 7f322dcf5640 1 -- 172.21.15.7:0/887670049 --> [v2:172.21.15.92:6824/1063265541,v1:172.21.15.92:6825/1063265541] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f322806afd0 con 0x7f32140ae000 2024-09-19T04:15:43.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.648+0000 7f32257fa640 1 -- 172.21.15.7:0/887670049 <== osd.10 v2:172.21.15.92:6824/1063265541 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f322806afd0 con 0x7f32140ae000 2024-09-19T04:15:43.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.648+0000 7f322dcf5640 1 -- 172.21.15.7:0/887670049 >> [v2:172.21.15.92:6824/1063265541,v1:172.21.15.92:6825/1063265541] conn(0x7f32140ae000 msgr2=0x7f32140b0440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:43.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.648+0000 7f322dcf5640 1 --2- 172.21.15.7:0/887670049 >> [v2:172.21.15.92:6824/1063265541,v1:172.21.15.92:6825/1063265541] conn(0x7f32140ae000 0x7f32140b0440 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:43.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.648+0000 7f322dcf5640 1 -- 172.21.15.7:0/887670049 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f32140a32d0 msgr2=0x7f32140a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:43.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.648+0000 7f322dcf5640 1 --2- 172.21.15.7:0/887670049 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f32140a32d0 0x7f32140a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f321800bbe0 tx=0x7f321800b390 comp rx=0 tx=0).stop 2024-09-19T04:15:43.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.648+0000 7f322dcf5640 1 -- 172.21.15.7:0/887670049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3228103700 msgr2=0x7f3228100f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:43.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.648+0000 7f322dcf5640 1 --2- 172.21.15.7:0/887670049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3228103700 0x7f3228100f80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f321000c890 tx=0x7f321000cd50 comp rx=0 tx=0).stop 2024-09-19T04:15:43.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.648+0000 7f3227fff640 1 -- 172.21.15.7:0/887670049 reap_dead start 2024-09-19T04:15:43.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.648+0000 7f322dcf5640 1 -- 172.21.15.7:0/887670049 shutdown_connections 2024-09-19T04:15:43.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.648+0000 7f322dcf5640 1 -- 172.21.15.7:0/887670049 >> 172.21.15.7:0/887670049 conn(0x7f32280fc7c0 msgr2=0x7f32280fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:43.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.648+0000 7f322dcf5640 1 -- 172.21.15.7:0/887670049 shutdown_connections 2024-09-19T04:15:43.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.648+0000 7f322dcf5640 1 -- 172.21.15.7:0/887670049 wait complete. 2024-09-19T04:15:43.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.836+0000 7f35e45ce640 1 -- 172.21.15.7:0/4187927301 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35dc1036e0 msgr2=0x7f35dc107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:43.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.836+0000 7f35e45ce640 1 --2- 172.21.15.7:0/4187927301 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35dc1036e0 0x7f35dc107b90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009930 tx=0x7f35cc02a420 comp rx=0 tx=0).stop 2024-09-19T04:15:43.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.836+0000 7f35e45ce640 1 -- 172.21.15.7:0/4187927301 shutdown_connections 2024-09-19T04:15:43.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.836+0000 7f35e45ce640 1 --2- 172.21.15.7:0/4187927301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35dc1082a0 0x7f35dc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:43.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.836+0000 7f35e45ce640 1 --2- 172.21.15.7:0/4187927301 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35dc1036e0 0x7f35dc107b90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:43.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.836+0000 7f35e45ce640 1 --2- 172.21.15.7:0/4187927301 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35dc102d30 0x7f35dc103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:43.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.836+0000 7f35e45ce640 1 -- 172.21.15.7:0/4187927301 >> 172.21.15.7:0/4187927301 conn(0x7f35dc0fc7d0 msgr2=0x7f35dc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:43.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.836+0000 7f35e45ce640 1 -- 172.21.15.7:0/4187927301 shutdown_connections 2024-09-19T04:15:43.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.836+0000 7f35e45ce640 1 -- 172.21.15.7:0/4187927301 wait complete. 2024-09-19T04:15:43.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.837+0000 7f35e45ce640 1 Processor -- start 2024-09-19T04:15:43.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.837+0000 7f35e45ce640 1 -- start start 2024-09-19T04:15:43.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.837+0000 7f35e45ce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35dc102d30 0x7f35dc198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:43.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.837+0000 7f35e45ce640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35dc1036e0 0x7f35dc198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:43.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.837+0000 7f35e45ce640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35dc1082a0 0x7f35dc19cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:43.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.837+0000 7f35e45ce640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc1120a0 con 0x7f35dc1036e0 2024-09-19T04:15:43.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.837+0000 7f35e45ce640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc111f20 con 0x7f35dc102d30 2024-09-19T04:15:43.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.837+0000 7f35e45ce640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc112220 con 0x7f35dc1082a0 2024-09-19T04:15:43.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.838+0000 7f35e1b69640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35dc1036e0 0x7f35dc198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:43.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.838+0000 7f35e1b69640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35dc1036e0 0x7f35dc198b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39018/0 (socket says 172.21.15.7:39018) 2024-09-19T04:15:43.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.838+0000 7f35e1b69640 1 -- 172.21.15.7:0/574239425 learned_addr learned my addr 172.21.15.7:0/574239425 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:43.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.838+0000 7f35e2b6b640 1 --2- 172.21.15.7:0/574239425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35dc1082a0 0x7f35dc19cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:43.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.838+0000 7f35e236a640 1 --2- 172.21.15.7:0/574239425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35dc102d30 0x7f35dc198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:43.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.838+0000 7f35e1b69640 1 -- 172.21.15.7:0/574239425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35dc1082a0 msgr2=0x7f35dc19cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:43.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.838+0000 7f35e1b69640 1 --2- 172.21.15.7:0/574239425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35dc1082a0 0x7f35dc19cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:43.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.838+0000 7f35e1b69640 1 -- 172.21.15.7:0/574239425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35dc102d30 msgr2=0x7f35dc198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:43.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.838+0000 7f35e1b69640 1 --2- 172.21.15.7:0/574239425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35dc102d30 0x7f35dc198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:43.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.838+0000 7f35e1b69640 1 -- 172.21.15.7:0/574239425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35dc19d5d0 con 0x7f35dc1036e0 2024-09-19T04:15:43.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.838+0000 7f35e1b69640 1 --2- 172.21.15.7:0/574239425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35dc1036e0 0x7f35dc198b60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f35cc005940 tx=0x7f35cc0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:43.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.838+0000 7f35d37fe640 1 -- 172.21.15.7:0/574239425 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35cc03f030 con 0x7f35dc1036e0 2024-09-19T04:15:43.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.838+0000 7f35d37fe640 1 -- 172.21.15.7:0/574239425 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35cc0044c0 con 0x7f35dc1036e0 2024-09-19T04:15:43.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.838+0000 7f35e45ce640 1 -- 172.21.15.7:0/574239425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35dc19d860 con 0x7f35dc1036e0 2024-09-19T04:15:43.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.838+0000 7f35d37fe640 1 -- 172.21.15.7:0/574239425 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35cc035070 con 0x7f35dc1036e0 2024-09-19T04:15:43.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.838+0000 7f35e45ce640 1 -- 172.21.15.7:0/574239425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35dc1a51a0 con 0x7f35dc1036e0 2024-09-19T04:15:43.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.839+0000 7f35e45ce640 1 -- 172.21.15.7:0/574239425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f35dc062980 con 0x7f35dc1036e0 2024-09-19T04:15:43.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.841+0000 7f35d37fe640 1 -- 172.21.15.7:0/574239425 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f35cc042030 con 0x7f35dc1036e0 2024-09-19T04:15:43.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.841+0000 7f35d37fe640 1 --2- 172.21.15.7:0/574239425 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f35c80a32d0 0x7f35c80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:43.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.841+0000 7f35e236a640 1 --2- 172.21.15.7:0/574239425 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f35c80a32d0 0x7f35c80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:43.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.841+0000 7f35d37fe640 1 -- 172.21.15.7:0/574239425 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7f35cc0f0740 con 0x7f35dc1036e0 2024-09-19T04:15:43.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.842+0000 7f35d37fe640 1 --2- 172.21.15.7:0/574239425 >> [v2:172.21.15.7:6826/1710319475,v1:172.21.15.7:6827/1710319475] conn(0x7f35c80aded0 0x7f35c80b0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:43.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.842+0000 7f35d37fe640 1 -- 172.21.15.7:0/574239425 --> [v2:172.21.15.7:6826/1710319475,v1:172.21.15.7:6827/1710319475] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f35c80b09e0 con 0x7f35c80aded0 2024-09-19T04:15:43.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.842+0000 7f35d37fe640 1 -- 172.21.15.7:0/574239425 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f35cc0f0b90 con 0x7f35dc1036e0 2024-09-19T04:15:43.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.842+0000 7f35e2b6b640 1 --2- 172.21.15.7:0/574239425 >> [v2:172.21.15.7:6826/1710319475,v1:172.21.15.7:6827/1710319475] conn(0x7f35c80aded0 0x7f35c80b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:43.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.842+0000 7f35e236a640 1 --2- 172.21.15.7:0/574239425 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f35c80a32d0 0x7f35c80a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f35d8005fd0 tx=0x7f35d8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:43.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.842+0000 7f35e2b6b640 1 --2- 172.21.15.7:0/574239425 >> [v2:172.21.15.7:6826/1710319475,v1:172.21.15.7:6827/1710319475] conn(0x7f35c80aded0 0x7f35c80b0310 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:43.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.843+0000 7f35d37fe640 1 -- 172.21.15.7:0/574239425 <== osd.9 v2:172.21.15.7:6826/1710319475 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f35c80b09e0 con 0x7f35c80aded0 2024-09-19T04:15:43.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.857+0000 7f35e45ce640 1 -- 172.21.15.7:0/574239425 --> [v2:172.21.15.7:6826/1710319475,v1:172.21.15.7:6827/1710319475] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f35dc062d80 con 0x7f35c80aded0 2024-09-19T04:15:43.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.857+0000 7f35d37fe640 1 -- 172.21.15.7:0/574239425 <== osd.9 v2:172.21.15.7:6826/1710319475 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f35dc062d80 con 0x7f35c80aded0 2024-09-19T04:15:43.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.857+0000 7f35e45ce640 1 -- 172.21.15.7:0/574239425 >> [v2:172.21.15.7:6826/1710319475,v1:172.21.15.7:6827/1710319475] conn(0x7f35c80aded0 msgr2=0x7f35c80b0310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:43.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.857+0000 7f35e45ce640 1 --2- 172.21.15.7:0/574239425 >> [v2:172.21.15.7:6826/1710319475,v1:172.21.15.7:6827/1710319475] conn(0x7f35c80aded0 0x7f35c80b0310 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:43.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.857+0000 7f35e45ce640 1 -- 172.21.15.7:0/574239425 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f35c80a32d0 msgr2=0x7f35c80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:43.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.857+0000 7f35e45ce640 1 --2- 172.21.15.7:0/574239425 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f35c80a32d0 0x7f35c80a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f35d8005fd0 tx=0x7f35d8005850 comp rx=0 tx=0).stop 2024-09-19T04:15:43.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.857+0000 7f35e45ce640 1 -- 172.21.15.7:0/574239425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35dc1036e0 msgr2=0x7f35dc198b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:43.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.857+0000 7f35e45ce640 1 --2- 172.21.15.7:0/574239425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f35dc1036e0 0x7f35dc198b60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f35cc005940 tx=0x7f35cc0040c0 comp rx=0 tx=0).stop 2024-09-19T04:15:43.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.857+0000 7f35e2b6b640 1 -- 172.21.15.7:0/574239425 reap_dead start 2024-09-19T04:15:43.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.858+0000 7f35e45ce640 1 -- 172.21.15.7:0/574239425 shutdown_connections 2024-09-19T04:15:43.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.858+0000 7f35e45ce640 1 -- 172.21.15.7:0/574239425 >> 172.21.15.7:0/574239425 conn(0x7f35dc0fc7d0 msgr2=0x7f35dc105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:43.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.858+0000 7f35e45ce640 1 -- 172.21.15.7:0/574239425 shutdown_connections 2024-09-19T04:15:43.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:43.858+0000 7f35e45ce640 1 -- 172.21.15.7:0/574239425 wait complete. 2024-09-19T04:15:44.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.385+0000 7fd2ee251640 1 -- 172.21.15.7:0/328420168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e8101de0 msgr2=0x7fd2e81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:44.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.385+0000 7fd2ee251640 1 --2- 172.21.15.7:0/328420168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e8101de0 0x7fd2e81021c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8009900 tx=0x7fd2d802a410 comp rx=0 tx=0).stop 2024-09-19T04:15:44.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.385+0000 7fd2ee251640 1 -- 172.21.15.7:0/328420168 shutdown_connections 2024-09-19T04:15:44.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.385+0000 7fd2ee251640 1 --2- 172.21.15.7:0/328420168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2e8106f10 0x7fd2e810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:44.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.385+0000 7fd2ee251640 1 --2- 172.21.15.7:0/328420168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2e8102790 0x7fd2e81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:44.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.385+0000 7fd2ee251640 1 --2- 172.21.15.7:0/328420168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e8101de0 0x7fd2e81021c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:44.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.385+0000 7fd2ee251640 1 -- 172.21.15.7:0/328420168 >> 172.21.15.7:0/328420168 conn(0x7fd2e80fd8c0 msgr2=0x7fd2e80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:44.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.385+0000 7fd2ee251640 1 -- 172.21.15.7:0/328420168 shutdown_connections 2024-09-19T04:15:44.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.385+0000 7fd2ee251640 1 -- 172.21.15.7:0/328420168 wait complete. 2024-09-19T04:15:44.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.385+0000 7fd2ee251640 1 Processor -- start 2024-09-19T04:15:44.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.386+0000 7fd2ee251640 1 -- start start 2024-09-19T04:15:44.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.386+0000 7fd2ee251640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e8101de0 0x7fd2e80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:44.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.386+0000 7fd2ee251640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2e8102790 0x7fd2e8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:44.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.386+0000 7fd2ee251640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2e8106f10 0x7fd2e8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:44.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.386+0000 7fd2ee251640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e8111f70 con 0x7fd2e8101de0 2024-09-19T04:15:44.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.386+0000 7fd2ee251640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e8111df0 con 0x7fd2e8106f10 2024-09-19T04:15:44.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.386+0000 7fd2ee251640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e81120f0 con 0x7fd2e8102790 2024-09-19T04:15:44.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.386+0000 7fd2e77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e8101de0 0x7fd2e80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:44.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.386+0000 7fd2e77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e8101de0 0x7fd2e80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39030/0 (socket says 172.21.15.7:39030) 2024-09-19T04:15:44.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.386+0000 7fd2e77fe640 1 -- 172.21.15.7:0/2745584541 learned_addr learned my addr 172.21.15.7:0/2745584541 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:44.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.386+0000 7fd2deffd640 1 --2- 172.21.15.7:0/2745584541 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2e8102790 0x7fd2e8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:44.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.386+0000 7fd2e7fff640 1 --2- 172.21.15.7:0/2745584541 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2e8106f10 0x7fd2e8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:44.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.386+0000 7fd2e77fe640 1 -- 172.21.15.7:0/2745584541 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2e8102790 msgr2=0x7fd2e8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:44.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.386+0000 7fd2e77fe640 1 --2- 172.21.15.7:0/2745584541 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2e8102790 0x7fd2e8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:44.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.386+0000 7fd2e77fe640 1 -- 172.21.15.7:0/2745584541 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2e8106f10 msgr2=0x7fd2e8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:44.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.386+0000 7fd2e77fe640 1 --2- 172.21.15.7:0/2745584541 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd2e8106f10 0x7fd2e8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:44.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.386+0000 7fd2e77fe640 1 -- 172.21.15.7:0/2745584541 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e81a68e0 con 0x7fd2e8101de0 2024-09-19T04:15:44.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.387+0000 7fd2deffd640 1 --2- 172.21.15.7:0/2745584541 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2e8102790 0x7fd2e8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:15:44.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.387+0000 7fd2e77fe640 1 --2- 172.21.15.7:0/2745584541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e8101de0 0x7fd2e80744f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8006010 tx=0x7fd2d80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:44.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.387+0000 7fd2e57fa640 1 -- 172.21.15.7:0/2745584541 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d803f030 con 0x7fd2e8101de0 2024-09-19T04:15:44.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.387+0000 7fd2ee251640 1 -- 172.21.15.7:0/2745584541 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e81a6b70 con 0x7fd2e8101de0 2024-09-19T04:15:44.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.387+0000 7fd2e57fa640 1 -- 172.21.15.7:0/2745584541 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2d8003ce0 con 0x7fd2e8101de0 2024-09-19T04:15:44.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.387+0000 7fd2e57fa640 1 -- 172.21.15.7:0/2745584541 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8035070 con 0x7fd2e8101de0 2024-09-19T04:15:44.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.387+0000 7fd2ee251640 1 -- 172.21.15.7:0/2745584541 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e81a7050 con 0x7fd2e8101de0 2024-09-19T04:15:44.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.388+0000 7fd2ee251640 1 -- 172.21.15.7:0/2745584541 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd2e80628c0 con 0x7fd2e8101de0 2024-09-19T04:15:44.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.389+0000 7fd2e57fa640 1 -- 172.21.15.7:0/2745584541 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fd2d8042030 con 0x7fd2e8101de0 2024-09-19T04:15:44.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.390+0000 7fd2e57fa640 1 --2- 172.21.15.7:0/2745584541 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd2d40a32d0 0x7fd2d40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:44.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.390+0000 7fd2e57fa640 1 -- 172.21.15.7:0/2745584541 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fd2d80f08f0 con 0x7fd2e8101de0 2024-09-19T04:15:44.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.390+0000 7fd2deffd640 1 --2- 172.21.15.7:0/2745584541 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd2d40a32d0 0x7fd2d40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:44.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.390+0000 7fd2e57fa640 1 --2- 172.21.15.7:0/2745584541 >> [v2:172.21.15.102:6800/2078441772,v1:172.21.15.102:6801/2078441772] conn(0x7fd2d40ae000 0x7fd2d40b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:44.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.390+0000 7fd2e57fa640 1 -- 172.21.15.7:0/2745584541 --> [v2:172.21.15.102:6800/2078441772,v1:172.21.15.102:6801/2078441772] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd2d8036e90 con 0x7fd2d40ae000 2024-09-19T04:15:44.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.390+0000 7fd2e57fa640 1 -- 172.21.15.7:0/2745584541 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fd2d80f0d40 con 0x7fd2e8101de0 2024-09-19T04:15:44.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.391+0000 7fd2deffd640 1 --2- 172.21.15.7:0/2745584541 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd2d40a32d0 0x7fd2d40a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd2d00058c0 tx=0x7fd2d0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:44.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.391+0000 7fd2e7fff640 1 --2- 172.21.15.7:0/2745584541 >> [v2:172.21.15.102:6800/2078441772,v1:172.21.15.102:6801/2078441772] conn(0x7fd2d40ae000 0x7fd2d40b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:44.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.391+0000 7fd2e7fff640 1 --2- 172.21.15.7:0/2745584541 >> [v2:172.21.15.102:6800/2078441772,v1:172.21.15.102:6801/2078441772] conn(0x7fd2d40ae000 0x7fd2d40b0440 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:44.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.392+0000 7fd2e57fa640 1 -- 172.21.15.7:0/2745584541 <== osd.2 v2:172.21.15.102:6800/2078441772 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd2d8036e90 con 0x7fd2d40ae000 2024-09-19T04:15:44.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.406+0000 7fd2ee251640 1 -- 172.21.15.7:0/2745584541 --> [v2:172.21.15.102:6800/2078441772,v1:172.21.15.102:6801/2078441772] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd2e8062d40 con 0x7fd2d40ae000 2024-09-19T04:15:44.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.407+0000 7fd2e57fa640 1 -- 172.21.15.7:0/2745584541 <== osd.2 v2:172.21.15.102:6800/2078441772 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd2e8062d40 con 0x7fd2d40ae000 2024-09-19T04:15:44.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.407+0000 7fd2ee251640 1 -- 172.21.15.7:0/2745584541 >> [v2:172.21.15.102:6800/2078441772,v1:172.21.15.102:6801/2078441772] conn(0x7fd2d40ae000 msgr2=0x7fd2d40b0440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:44.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.407+0000 7fd2ee251640 1 --2- 172.21.15.7:0/2745584541 >> [v2:172.21.15.102:6800/2078441772,v1:172.21.15.102:6801/2078441772] conn(0x7fd2d40ae000 0x7fd2d40b0440 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:44.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.407+0000 7fd2ee251640 1 -- 172.21.15.7:0/2745584541 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd2d40a32d0 msgr2=0x7fd2d40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:44.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.407+0000 7fd2ee251640 1 --2- 172.21.15.7:0/2745584541 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd2d40a32d0 0x7fd2d40a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd2d00058c0 tx=0x7fd2d0005850 comp rx=0 tx=0).stop 2024-09-19T04:15:44.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.407+0000 7fd2ee251640 1 -- 172.21.15.7:0/2745584541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e8101de0 msgr2=0x7fd2e80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:44.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.407+0000 7fd2ee251640 1 --2- 172.21.15.7:0/2745584541 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2e8101de0 0x7fd2e80744f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8006010 tx=0x7fd2d80042f0 comp rx=0 tx=0).stop 2024-09-19T04:15:44.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.407+0000 7fd2e7fff640 1 -- 172.21.15.7:0/2745584541 reap_dead start 2024-09-19T04:15:44.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.408+0000 7fd2ee251640 1 -- 172.21.15.7:0/2745584541 shutdown_connections 2024-09-19T04:15:44.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.408+0000 7fd2ee251640 1 -- 172.21.15.7:0/2745584541 >> 172.21.15.7:0/2745584541 conn(0x7fd2e80fd8c0 msgr2=0x7fd2e80fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:44.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.408+0000 7fd2ee251640 1 -- 172.21.15.7:0/2745584541 shutdown_connections 2024-09-19T04:15:44.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:44.408+0000 7fd2ee251640 1 -- 172.21.15.7:0/2745584541 wait complete. 2024-09-19T04:15:45.066 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:44 smithi007 ceph-mon[31360]: pgmap v315: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T04:15:45.098 INFO:teuthology.orchestra.run.smithi007.stdout:77309411400 2024-09-19T04:15:45.098 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T04:15:45.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:44 smithi092 ceph-mon[34940]: pgmap v315: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T04:15:45.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.363+0000 7fca24e65640 1 -- 172.21.15.7:0/1187813720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca20106a80 msgr2=0x7fca20106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:45.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.363+0000 7fca24e65640 1 --2- 172.21.15.7:0/1187813720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca20106a80 0x7fca20106e60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fca10009930 tx=0x7fca1002a420 comp rx=0 tx=0).stop 2024-09-19T04:15:45.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.363+0000 7fca24e65640 1 -- 172.21.15.7:0/1187813720 shutdown_connections 2024-09-19T04:15:45.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.363+0000 7fca24e65640 1 --2- 172.21.15.7:0/1187813720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca20101420 0x7fca2010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:45.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.363+0000 7fca24e65640 1 --2- 172.21.15.7:0/1187813720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca20100a80 0x7fca20100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:45.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.363+0000 7fca24e65640 1 --2- 172.21.15.7:0/1187813720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca20106a80 0x7fca20106e60 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:45.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.363+0000 7fca24e65640 1 -- 172.21.15.7:0/1187813720 >> 172.21.15.7:0/1187813720 conn(0x7fca200fc7a0 msgr2=0x7fca200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:45.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.364+0000 7fca24e65640 1 -- 172.21.15.7:0/1187813720 shutdown_connections 2024-09-19T04:15:45.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.364+0000 7fca24e65640 1 -- 172.21.15.7:0/1187813720 wait complete. 2024-09-19T04:15:45.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.364+0000 7fca24e65640 1 Processor -- start 2024-09-19T04:15:45.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.364+0000 7fca24e65640 1 -- start start 2024-09-19T04:15:45.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.365+0000 7fca24e65640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca20100a80 0x7fca20199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:45.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.365+0000 7fca24e65640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca20101420 0x7fca20199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:45.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.365+0000 7fca24e65640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca20106a80 0x7fca201a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:45.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.365+0000 7fca24e65640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fca20110ea0 con 0x7fca20101420 2024-09-19T04:15:45.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.365+0000 7fca24e65640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fca20110d20 con 0x7fca20106a80 2024-09-19T04:15:45.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.365+0000 7fca24e65640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fca20111020 con 0x7fca20100a80 2024-09-19T04:15:45.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.365+0000 7fca1dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca20101420 0x7fca20199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:45.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.365+0000 7fca1e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca20100a80 0x7fca20199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:45.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.365+0000 7fca1dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca20101420 0x7fca20199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39044/0 (socket says 172.21.15.7:39044) 2024-09-19T04:15:45.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.365+0000 7fca1dd9b640 1 -- 172.21.15.7:0/3882291986 learned_addr learned my addr 172.21.15.7:0/3882291986 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:45.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.365+0000 7fca1ed9d640 1 --2- 172.21.15.7:0/3882291986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca20106a80 0x7fca201a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:45.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.365+0000 7fca1dd9b640 1 -- 172.21.15.7:0/3882291986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca20100a80 msgr2=0x7fca20199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:45.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.365+0000 7fca1dd9b640 1 --2- 172.21.15.7:0/3882291986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca20100a80 0x7fca20199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:45.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.365+0000 7fca1dd9b640 1 -- 172.21.15.7:0/3882291986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca20106a80 msgr2=0x7fca201a43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:45.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.365+0000 7fca1dd9b640 1 --2- 172.21.15.7:0/3882291986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca20106a80 0x7fca201a43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:45.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.365+0000 7fca1dd9b640 1 -- 172.21.15.7:0/3882291986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca201a48f0 con 0x7fca20101420 2024-09-19T04:15:45.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.365+0000 7fca1ed9d640 1 --2- 172.21.15.7:0/3882291986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca20106a80 0x7fca201a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:15:45.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.365+0000 7fca1dd9b640 1 --2- 172.21.15.7:0/3882291986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca20101420 0x7fca20199870 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fca1400f9e0 tx=0x7fca1400fea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:45.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.365+0000 7fca0f7fe640 1 -- 172.21.15.7:0/3882291986 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca14010810 con 0x7fca20101420 2024-09-19T04:15:45.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.366+0000 7fca24e65640 1 -- 172.21.15.7:0/3882291986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca20197120 con 0x7fca20101420 2024-09-19T04:15:45.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.366+0000 7fca0f7fe640 1 -- 172.21.15.7:0/3882291986 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca1400b450 con 0x7fca20101420 2024-09-19T04:15:45.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.366+0000 7fca0f7fe640 1 -- 172.21.15.7:0/3882291986 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca14018650 con 0x7fca20101420 2024-09-19T04:15:45.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.366+0000 7fca24e65640 1 -- 172.21.15.7:0/3882291986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca201976b0 con 0x7fca20101420 2024-09-19T04:15:45.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.367+0000 7fca24e65640 1 -- 172.21.15.7:0/3882291986 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fca20062900 con 0x7fca20101420 2024-09-19T04:15:45.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.368+0000 7fca0f7fe640 1 -- 172.21.15.7:0/3882291986 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fca1400b600 con 0x7fca20101420 2024-09-19T04:15:45.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.369+0000 7fca0f7fe640 1 --2- 172.21.15.7:0/3882291986 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fca080a32d0 0x7fca080a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:45.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.369+0000 7fca1e59c640 1 --2- 172.21.15.7:0/3882291986 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fca080a32d0 0x7fca080a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:45.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.369+0000 7fca0f7fe640 1 -- 172.21.15.7:0/3882291986 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8802+0+0 (secure 0 0 0) 0x7fca140d2f70 con 0x7fca20101420 2024-09-19T04:15:45.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.369+0000 7fca0f7fe640 1 --2- 172.21.15.7:0/3882291986 >> [v2:172.21.15.92:6800/902403333,v1:172.21.15.92:6801/902403333] conn(0x7fca080ae000 0x7fca080b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:45.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.369+0000 7fca0f7fe640 1 -- 172.21.15.7:0/3882291986 --> [v2:172.21.15.92:6800/902403333,v1:172.21.15.92:6801/902403333] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca14022e50 con 0x7fca080ae000 2024-09-19T04:15:45.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.369+0000 7fca0f7fe640 1 -- 172.21.15.7:0/3882291986 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fca140d5590 con 0x7fca20101420 2024-09-19T04:15:45.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.370+0000 7fca1e59c640 1 --2- 172.21.15.7:0/3882291986 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fca080a32d0 0x7fca080a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fca10009900 tx=0x7fca100058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:45.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.370+0000 7fca1ed9d640 1 --2- 172.21.15.7:0/3882291986 >> [v2:172.21.15.92:6800/902403333,v1:172.21.15.92:6801/902403333] conn(0x7fca080ae000 0x7fca080b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:45.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.370+0000 7fca1ed9d640 1 --2- 172.21.15.7:0/3882291986 >> [v2:172.21.15.92:6800/902403333,v1:172.21.15.92:6801/902403333] conn(0x7fca080ae000 0x7fca080b0440 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:45.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.371+0000 7fca0f7fe640 1 -- 172.21.15.7:0/3882291986 <== osd.1 v2:172.21.15.92:6800/902403333 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca14022e50 con 0x7fca080ae000 2024-09-19T04:15:45.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.385+0000 7fca24e65640 1 -- 172.21.15.7:0/3882291986 --> [v2:172.21.15.92:6800/902403333,v1:172.21.15.92:6801/902403333] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fca20062d30 con 0x7fca080ae000 2024-09-19T04:15:45.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.386+0000 7fca0f7fe640 1 -- 172.21.15.7:0/3882291986 <== osd.1 v2:172.21.15.92:6800/902403333 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fca20062d30 con 0x7fca080ae000 2024-09-19T04:15:45.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.386+0000 7fca24e65640 1 -- 172.21.15.7:0/3882291986 >> [v2:172.21.15.92:6800/902403333,v1:172.21.15.92:6801/902403333] conn(0x7fca080ae000 msgr2=0x7fca080b0440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:45.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.386+0000 7fca24e65640 1 --2- 172.21.15.7:0/3882291986 >> [v2:172.21.15.92:6800/902403333,v1:172.21.15.92:6801/902403333] conn(0x7fca080ae000 0x7fca080b0440 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:45.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.386+0000 7fca24e65640 1 -- 172.21.15.7:0/3882291986 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fca080a32d0 msgr2=0x7fca080a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:45.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.386+0000 7fca24e65640 1 --2- 172.21.15.7:0/3882291986 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fca080a32d0 0x7fca080a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fca10009900 tx=0x7fca100058d0 comp rx=0 tx=0).stop 2024-09-19T04:15:45.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.386+0000 7fca24e65640 1 -- 172.21.15.7:0/3882291986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca20101420 msgr2=0x7fca20199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:45.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.386+0000 7fca24e65640 1 --2- 172.21.15.7:0/3882291986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca20101420 0x7fca20199870 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fca1400f9e0 tx=0x7fca1400fea0 comp rx=0 tx=0).stop 2024-09-19T04:15:45.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.386+0000 7fca1ed9d640 1 -- 172.21.15.7:0/3882291986 reap_dead start 2024-09-19T04:15:45.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.386+0000 7fca24e65640 1 -- 172.21.15.7:0/3882291986 shutdown_connections 2024-09-19T04:15:45.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.386+0000 7fca24e65640 1 -- 172.21.15.7:0/3882291986 >> 172.21.15.7:0/3882291986 conn(0x7fca200fc7a0 msgr2=0x7fca200fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:45.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.386+0000 7fca24e65640 1 -- 172.21.15.7:0/3882291986 shutdown_connections 2024-09-19T04:15:45.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:45.386+0000 7fca24e65640 1 -- 172.21.15.7:0/3882291986 wait complete. 2024-09-19T04:15:45.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:44 smithi102 ceph-mon[35446]: pgmap v315: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T04:15:46.027 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:45 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9, 5, 8]}]: dispatch 2024-09-19T04:15:46.027 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:45 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [5, 6]}]: dispatch 2024-09-19T04:15:46.027 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:45 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]: dispatch 2024-09-19T04:15:46.027 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:45 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2024-09-19T04:15:46.027 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:45 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 7]}]: dispatch 2024-09-19T04:15:46.027 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:45 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-09-19T04:15:46.027 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:45 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-19T04:15:46.027 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:45 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-09-19T04:15:46.028 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:45 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-09-19T04:15:46.028 INFO:teuthology.orchestra.run.smithi007.stdout:266287972390 2024-09-19T04:15:46.029 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-19T04:15:46.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:45 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9, 5, 8]}]: dispatch 2024-09-19T04:15:46.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:45 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [5, 6]}]: dispatch 2024-09-19T04:15:46.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:45 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]: dispatch 2024-09-19T04:15:46.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:45 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2024-09-19T04:15:46.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:45 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 7]}]: dispatch 2024-09-19T04:15:46.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:45 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-09-19T04:15:46.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:45 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-19T04:15:46.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:45 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-09-19T04:15:46.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:45 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-09-19T04:15:46.407 INFO:teuthology.orchestra.run.smithi007.stdout:154618822714 2024-09-19T04:15:46.407 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T04:15:46.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:45 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9, 5, 8]}]: dispatch 2024-09-19T04:15:46.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:45 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [5, 6]}]: dispatch 2024-09-19T04:15:46.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:45 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]: dispatch 2024-09-19T04:15:46.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:45 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2024-09-19T04:15:46.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:45 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 7]}]: dispatch 2024-09-19T04:15:46.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:45 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-09-19T04:15:46.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:45 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-19T04:15:46.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:45 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-09-19T04:15:46.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:45 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-09-19T04:15:47.000 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:46 smithi007 ceph-mon[31360]: pgmap v316: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-19T04:15:47.000 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9, 5, 8]}]': finished 2024-09-19T04:15:47.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [5, 6]}]': finished 2024-09-19T04:15:47.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]': finished 2024-09-19T04:15:47.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-09-19T04:15:47.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 7]}]': finished 2024-09-19T04:15:47.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-09-19T04:15:47.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-19T04:15:47.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-19T04:15:47.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-09-19T04:15:47.001 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:46 smithi007 ceph-mon[31360]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T04:15:47.037 INFO:teuthology.orchestra.run.smithi007.stdout:287762808865 2024-09-19T04:15:47.037 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-19T04:15:47.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.219+0000 7f2a5e5c7640 1 -- 172.21.15.7:0/3544538914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a58102790 msgr2=0x7f2a581067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:47.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.219+0000 7f2a5e5c7640 1 --2- 172.21.15.7:0/3544538914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a58102790 0x7f2a581067e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009900 tx=0x7f2a4c02a410 comp rx=0 tx=0).stop 2024-09-19T04:15:47.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.219+0000 7f2a5e5c7640 1 -- 172.21.15.7:0/3544538914 shutdown_connections 2024-09-19T04:15:47.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.219+0000 7f2a5e5c7640 1 --2- 172.21.15.7:0/3544538914 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a58106f10 0x7f2a5810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:47.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.219+0000 7f2a5e5c7640 1 --2- 172.21.15.7:0/3544538914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a58102790 0x7f2a581067e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:47.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.219+0000 7f2a5e5c7640 1 --2- 172.21.15.7:0/3544538914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a58101de0 0x7f2a581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:47.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.219+0000 7f2a5e5c7640 1 -- 172.21.15.7:0/3544538914 >> 172.21.15.7:0/3544538914 conn(0x7f2a580fd8c0 msgr2=0x7f2a580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:47.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.220+0000 7f2a5e5c7640 1 -- 172.21.15.7:0/3544538914 shutdown_connections 2024-09-19T04:15:47.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.220+0000 7f2a5e5c7640 1 -- 172.21.15.7:0/3544538914 wait complete. 2024-09-19T04:15:47.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.220+0000 7f2a5e5c7640 1 Processor -- start 2024-09-19T04:15:47.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.220+0000 7f2a5e5c7640 1 -- start start 2024-09-19T04:15:47.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.221+0000 7f2a5e5c7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a58101de0 0x7f2a5819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:47.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.221+0000 7f2a5e5c7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a58102790 0x7f2a5819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:47.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.221+0000 7f2a5e5c7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a58106f10 0x7f2a5819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:47.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.221+0000 7f2a5e5c7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2a58111f30 con 0x7f2a58101de0 2024-09-19T04:15:47.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.221+0000 7f2a5e5c7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2a58111db0 con 0x7f2a58102790 2024-09-19T04:15:47.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.221+0000 7f2a5e5c7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2a581120b0 con 0x7f2a58106f10 2024-09-19T04:15:47.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.221+0000 7f2a57fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a58101de0 0x7f2a5819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:47.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.221+0000 7f2a57fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a58101de0 0x7f2a5819a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39064/0 (socket says 172.21.15.7:39064) 2024-09-19T04:15:47.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.221+0000 7f2a57fff640 1 -- 172.21.15.7:0/2412444237 learned_addr learned my addr 172.21.15.7:0/2412444237 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:47.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.221+0000 7f2a577fe640 1 --2- 172.21.15.7:0/2412444237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a58102790 0x7f2a5819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:47.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.221+0000 7f2a5cb64640 1 --2- 172.21.15.7:0/2412444237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a58106f10 0x7f2a5819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:47.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.221+0000 7f2a57fff640 1 -- 172.21.15.7:0/2412444237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a58106f10 msgr2=0x7f2a5819ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:47.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.221+0000 7f2a57fff640 1 --2- 172.21.15.7:0/2412444237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a58106f10 0x7f2a5819ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:47.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.221+0000 7f2a57fff640 1 -- 172.21.15.7:0/2412444237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a58102790 msgr2=0x7f2a5819abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:47.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.221+0000 7f2a57fff640 1 --2- 172.21.15.7:0/2412444237 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a58102790 0x7f2a5819abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:47.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.221+0000 7f2a57fff640 1 -- 172.21.15.7:0/2412444237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a5819f650 con 0x7f2a58101de0 2024-09-19T04:15:47.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.221+0000 7f2a57fff640 1 --2- 172.21.15.7:0/2412444237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a58101de0 0x7f2a5819a6a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800d950 tx=0x7f2a4800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:47.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.222+0000 7f2a557fa640 1 -- 172.21.15.7:0/2412444237 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a48017070 con 0x7f2a58101de0 2024-09-19T04:15:47.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.222+0000 7f2a5e5c7640 1 -- 172.21.15.7:0/2412444237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a5819f940 con 0x7f2a58101de0 2024-09-19T04:15:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.222+0000 7f2a557fa640 1 -- 172.21.15.7:0/2412444237 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a48009c30 con 0x7f2a58101de0 2024-09-19T04:15:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.222+0000 7f2a557fa640 1 -- 172.21.15.7:0/2412444237 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4800f6b0 con 0x7f2a58101de0 2024-09-19T04:15:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.222+0000 7f2a5e5c7640 1 -- 172.21.15.7:0/2412444237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a581a7220 con 0x7f2a58101de0 2024-09-19T04:15:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.222+0000 7f2a5e5c7640 1 -- 172.21.15.7:0/2412444237 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2a58075780 con 0x7f2a58101de0 2024-09-19T04:15:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.224+0000 7f2a557fa640 1 -- 172.21.15.7:0/2412444237 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f2a480109d0 con 0x7f2a58101de0 2024-09-19T04:15:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.225+0000 7f2a557fa640 1 --2- 172.21.15.7:0/2412444237 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2a400a32d0 0x7f2a400a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.225+0000 7f2a577fe640 1 --2- 172.21.15.7:0/2412444237 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2a400a32d0 0x7f2a400a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.225+0000 7f2a557fa640 1 -- 172.21.15.7:0/2412444237 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f2a480cff10 con 0x7f2a58101de0 2024-09-19T04:15:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.225+0000 7f2a557fa640 1 --2- 172.21.15.7:0/2412444237 >> [v2:172.21.15.92:6808/2799734294,v1:172.21.15.92:6809/2799734294] conn(0x7f2a400ae420 0x7f2a400b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.225+0000 7f2a557fa640 1 -- 172.21.15.7:0/2412444237 --> [v2:172.21.15.92:6808/2799734294,v1:172.21.15.92:6809/2799734294] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2a48026e50 con 0x7f2a400ae420 2024-09-19T04:15:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.225+0000 7f2a557fa640 1 -- 172.21.15.7:0/2412444237 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f2a480d0360 con 0x7f2a58101de0 2024-09-19T04:15:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.225+0000 7f2a577fe640 1 --2- 172.21.15.7:0/2412444237 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2a400a32d0 0x7f2a400a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009230 tx=0x7f2a4c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.225+0000 7f2a5cb64640 1 --2- 172.21.15.7:0/2412444237 >> [v2:172.21.15.92:6808/2799734294,v1:172.21.15.92:6809/2799734294] conn(0x7f2a400ae420 0x7f2a400b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.226+0000 7f2a5cb64640 1 --2- 172.21.15.7:0/2412444237 >> [v2:172.21.15.92:6808/2799734294,v1:172.21.15.92:6809/2799734294] conn(0x7f2a400ae420 0x7f2a400b08c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.227+0000 7f2a557fa640 1 -- 172.21.15.7:0/2412444237 <== osd.4 v2:172.21.15.92:6808/2799734294 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2a48026e50 con 0x7f2a400ae420 2024-09-19T04:15:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.244+0000 7f2a5e5c7640 1 -- 172.21.15.7:0/2412444237 --> [v2:172.21.15.92:6808/2799734294,v1:172.21.15.92:6809/2799734294] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2a581032c0 con 0x7f2a400ae420 2024-09-19T04:15:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.244+0000 7f2a557fa640 1 -- 172.21.15.7:0/2412444237 <== osd.4 v2:172.21.15.92:6808/2799734294 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2a581032c0 con 0x7f2a400ae420 2024-09-19T04:15:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.245+0000 7f2a5e5c7640 1 -- 172.21.15.7:0/2412444237 >> [v2:172.21.15.92:6808/2799734294,v1:172.21.15.92:6809/2799734294] conn(0x7f2a400ae420 msgr2=0x7f2a400b08c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.245+0000 7f2a5e5c7640 1 --2- 172.21.15.7:0/2412444237 >> [v2:172.21.15.92:6808/2799734294,v1:172.21.15.92:6809/2799734294] conn(0x7f2a400ae420 0x7f2a400b08c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.245+0000 7f2a5e5c7640 1 -- 172.21.15.7:0/2412444237 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2a400a32d0 msgr2=0x7f2a400a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.245+0000 7f2a5e5c7640 1 --2- 172.21.15.7:0/2412444237 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2a400a32d0 0x7f2a400a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009230 tx=0x7f2a4c0058d0 comp rx=0 tx=0).stop 2024-09-19T04:15:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.245+0000 7f2a5e5c7640 1 -- 172.21.15.7:0/2412444237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a58101de0 msgr2=0x7f2a5819a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.245+0000 7f2a5e5c7640 1 --2- 172.21.15.7:0/2412444237 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a58101de0 0x7f2a5819a6a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800d950 tx=0x7f2a4800de10 comp rx=0 tx=0).stop 2024-09-19T04:15:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.245+0000 7f2a5cb64640 1 -- 172.21.15.7:0/2412444237 reap_dead start 2024-09-19T04:15:47.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.245+0000 7f2a5e5c7640 1 -- 172.21.15.7:0/2412444237 shutdown_connections 2024-09-19T04:15:47.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.245+0000 7f2a5e5c7640 1 -- 172.21.15.7:0/2412444237 >> 172.21.15.7:0/2412444237 conn(0x7f2a580fd8c0 msgr2=0x7f2a580fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:47.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.245+0000 7f2a5e5c7640 1 -- 172.21.15.7:0/2412444237 shutdown_connections 2024-09-19T04:15:47.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:47.245+0000 7f2a5e5c7640 1 -- 172.21.15.7:0/2412444237 wait complete. 2024-09-19T04:15:47.261 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:47.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:47 smithi092 ceph-mon[34940]: pgmap v316: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-19T04:15:47.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:47 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9, 5, 8]}]': finished 2024-09-19T04:15:47.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:47 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [5, 6]}]': finished 2024-09-19T04:15:47.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:47 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]': finished 2024-09-19T04:15:47.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:47 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-09-19T04:15:47.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:47 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 7]}]': finished 2024-09-19T04:15:47.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:47 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-09-19T04:15:47.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:47 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-19T04:15:47.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:47 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-19T04:15:47.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:47 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-09-19T04:15:47.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:47 smithi092 ceph-mon[34940]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T04:15:47.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:46 smithi102 ceph-mon[35446]: pgmap v316: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-19T04:15:47.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9, 5, 8]}]': finished 2024-09-19T04:15:47.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [5, 6]}]': finished 2024-09-19T04:15:47.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]': finished 2024-09-19T04:15:47.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-09-19T04:15:47.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 7]}]': finished 2024-09-19T04:15:47.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-09-19T04:15:47.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-19T04:15:47.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-19T04:15:47.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-09-19T04:15:47.410 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:46 smithi102 ceph-mon[35446]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T04:15:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:47.495 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:47.498 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:47.498 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:47.910 INFO:teuthology.orchestra.run.smithi007.stdout:55834574925 2024-09-19T04:15:47.910 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T04:15:47.918 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:48.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:48 smithi007 ceph-mon[31360]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T04:15:48.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:48 smithi092 ceph-mon[34940]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T04:15:48.320 INFO:teuthology.orchestra.run.smithi007.stdout:133143986238 2024-09-19T04:15:48.320 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T04:15:48.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:48 smithi102 ceph-mon[35446]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T04:15:49.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:49 smithi092 ceph-mon[34940]: pgmap v319: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:15:49.313 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:49 smithi007 ceph-mon[31360]: pgmap v319: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:15:49.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:49 smithi102 ceph-mon[35446]: pgmap v319: 129 pgs: 129 active+clean; 645 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:15:49.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.393+0000 7fdf307d3640 1 -- 172.21.15.7:0/1587568775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf28106f10 msgr2=0x7fdf2810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:49.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.393+0000 7fdf307d3640 1 --2- 172.21.15.7:0/1587568775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf28106f10 0x7fdf2810ea90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdf20009ca0 tx=0x7fdf2002a8c0 comp rx=0 tx=0).stop 2024-09-19T04:15:49.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.394+0000 7fdf307d3640 1 -- 172.21.15.7:0/1587568775 shutdown_connections 2024-09-19T04:15:49.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.394+0000 7fdf307d3640 1 --2- 172.21.15.7:0/1587568775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf28106f10 0x7fdf2810ea90 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:49.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.394+0000 7fdf307d3640 1 --2- 172.21.15.7:0/1587568775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf28102790 0x7fdf281067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:49.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.394+0000 7fdf307d3640 1 --2- 172.21.15.7:0/1587568775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf28101de0 0x7fdf281021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:49.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.394+0000 7fdf307d3640 1 -- 172.21.15.7:0/1587568775 >> 172.21.15.7:0/1587568775 conn(0x7fdf280fd8c0 msgr2=0x7fdf280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:49.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.394+0000 7fdf307d3640 1 -- 172.21.15.7:0/1587568775 shutdown_connections 2024-09-19T04:15:49.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.394+0000 7fdf307d3640 1 -- 172.21.15.7:0/1587568775 wait complete. 2024-09-19T04:15:49.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.394+0000 7fdf307d3640 1 Processor -- start 2024-09-19T04:15:49.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.394+0000 7fdf307d3640 1 -- start start 2024-09-19T04:15:49.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.394+0000 7fdf307d3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf28101de0 0x7fdf280744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:49.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.394+0000 7fdf307d3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf28102790 0x7fdf28074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:49.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.394+0000 7fdf307d3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf28106f10 0x7fdf28074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:49.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.395+0000 7fdf307d3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdf28112010 con 0x7fdf28101de0 2024-09-19T04:15:49.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.395+0000 7fdf307d3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdf28111e90 con 0x7fdf28106f10 2024-09-19T04:15:49.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.395+0000 7fdf307d3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdf28112190 con 0x7fdf28102790 2024-09-19T04:15:49.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.395+0000 7fdf2e56f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf28101de0 0x7fdf280744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:49.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.395+0000 7fdf2e56f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf28101de0 0x7fdf280744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56080/0 (socket says 172.21.15.7:56080) 2024-09-19T04:15:49.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.395+0000 7fdf2e56f640 1 -- 172.21.15.7:0/2495751180 learned_addr learned my addr 172.21.15.7:0/2495751180 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:49.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.395+0000 7fdf2ed70640 1 --2- 172.21.15.7:0/2495751180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf28106f10 0x7fdf28074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:49.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.395+0000 7fdf2dd6e640 1 --2- 172.21.15.7:0/2495751180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf28102790 0x7fdf28074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:49.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.395+0000 7fdf2e56f640 1 -- 172.21.15.7:0/2495751180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf28102790 msgr2=0x7fdf28074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:49.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.395+0000 7fdf2e56f640 1 --2- 172.21.15.7:0/2495751180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf28102790 0x7fdf28074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:49.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.395+0000 7fdf2e56f640 1 -- 172.21.15.7:0/2495751180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf28106f10 msgr2=0x7fdf28074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:49.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.395+0000 7fdf2e56f640 1 --2- 172.21.15.7:0/2495751180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf28106f10 0x7fdf28074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:49.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.395+0000 7fdf2e56f640 1 -- 172.21.15.7:0/2495751180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf281a6a50 con 0x7fdf28101de0 2024-09-19T04:15:49.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.395+0000 7fdf2ed70640 1 --2- 172.21.15.7:0/2495751180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdf28106f10 0x7fdf28074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:15:49.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.395+0000 7fdf2e56f640 1 --2- 172.21.15.7:0/2495751180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf28101de0 0x7fdf280744f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdf2400b4a0 tx=0x7fdf2400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:49.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.395+0000 7fdf1f7fe640 1 -- 172.21.15.7:0/2495751180 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf24015020 con 0x7fdf28101de0 2024-09-19T04:15:49.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.395+0000 7fdf1f7fe640 1 -- 172.21.15.7:0/2495751180 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf24011d10 con 0x7fdf28101de0 2024-09-19T04:15:49.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.395+0000 7fdf307d3640 1 -- 172.21.15.7:0/2495751180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf281a6d40 con 0x7fdf28101de0 2024-09-19T04:15:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.395+0000 7fdf1f7fe640 1 -- 172.21.15.7:0/2495751180 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2400f2e0 con 0x7fdf28101de0 2024-09-19T04:15:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.395+0000 7fdf307d3640 1 -- 172.21.15.7:0/2495751180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf281a7270 con 0x7fdf28101de0 2024-09-19T04:15:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.396+0000 7fdf307d3640 1 -- 172.21.15.7:0/2495751180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdf28062880 con 0x7fdf28101de0 2024-09-19T04:15:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.398+0000 7fdf1f7fe640 1 -- 172.21.15.7:0/2495751180 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fdf24018020 con 0x7fdf28101de0 2024-09-19T04:15:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.398+0000 7fdf1f7fe640 1 --2- 172.21.15.7:0/2495751180 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fdf140a3350 0x7fdf140a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.398+0000 7fdf2dd6e640 1 --2- 172.21.15.7:0/2495751180 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fdf140a3350 0x7fdf140a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.398+0000 7fdf1f7fe640 1 -- 172.21.15.7:0/2495751180 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7fdf240cfae0 con 0x7fdf28101de0 2024-09-19T04:15:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.399+0000 7fdf1f7fe640 1 --2- 172.21.15.7:0/2495751180 >> [v2:172.21.15.7:6818/1569704304,v1:172.21.15.7:6819/1569704304] conn(0x7fdf140ae4a0 0x7fdf140b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.399+0000 7fdf1f7fe640 1 -- 172.21.15.7:0/2495751180 --> [v2:172.21.15.7:6818/1569704304,v1:172.21.15.7:6819/1569704304] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdf24004450 con 0x7fdf140ae4a0 2024-09-19T04:15:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.399+0000 7fdf1f7fe640 1 -- 172.21.15.7:0/2495751180 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7fdf240cff30 con 0x7fdf28101de0 2024-09-19T04:15:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.399+0000 7fdf2dd6e640 1 --2- 172.21.15.7:0/2495751180 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fdf140a3350 0x7fdf140a5810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdf28075f80 tx=0x7fdf18009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.399+0000 7fdf2ed70640 1 --2- 172.21.15.7:0/2495751180 >> [v2:172.21.15.7:6818/1569704304,v1:172.21.15.7:6819/1569704304] conn(0x7fdf140ae4a0 0x7fdf140b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.399+0000 7fdf2ed70640 1 --2- 172.21.15.7:0/2495751180 >> [v2:172.21.15.7:6818/1569704304,v1:172.21.15.7:6819/1569704304] conn(0x7fdf140ae4a0 0x7fdf140b0940 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.400+0000 7fdf1f7fe640 1 -- 172.21.15.7:0/2495751180 <== osd.6 v2:172.21.15.7:6818/1569704304 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdf24004450 con 0x7fdf140ae4a0 2024-09-19T04:15:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.413+0000 7fdf307d3640 1 -- 172.21.15.7:0/2495751180 --> [v2:172.21.15.7:6818/1569704304,v1:172.21.15.7:6819/1569704304] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdf28062c80 con 0x7fdf140ae4a0 2024-09-19T04:15:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.414+0000 7fdf1f7fe640 1 -- 172.21.15.7:0/2495751180 <== osd.6 v2:172.21.15.7:6818/1569704304 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdf28062c80 con 0x7fdf140ae4a0 2024-09-19T04:15:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.414+0000 7fdf307d3640 1 -- 172.21.15.7:0/2495751180 >> [v2:172.21.15.7:6818/1569704304,v1:172.21.15.7:6819/1569704304] conn(0x7fdf140ae4a0 msgr2=0x7fdf140b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.414+0000 7fdf307d3640 1 --2- 172.21.15.7:0/2495751180 >> [v2:172.21.15.7:6818/1569704304,v1:172.21.15.7:6819/1569704304] conn(0x7fdf140ae4a0 0x7fdf140b0940 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.414+0000 7fdf307d3640 1 -- 172.21.15.7:0/2495751180 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fdf140a3350 msgr2=0x7fdf140a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.414+0000 7fdf307d3640 1 --2- 172.21.15.7:0/2495751180 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fdf140a3350 0x7fdf140a5810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdf28075f80 tx=0x7fdf18009110 comp rx=0 tx=0).stop 2024-09-19T04:15:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.414+0000 7fdf307d3640 1 -- 172.21.15.7:0/2495751180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf28101de0 msgr2=0x7fdf280744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.414+0000 7fdf307d3640 1 --2- 172.21.15.7:0/2495751180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf28101de0 0x7fdf280744f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdf2400b4a0 tx=0x7fdf2400b8a0 comp rx=0 tx=0).stop 2024-09-19T04:15:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.414+0000 7fdf2ed70640 1 -- 172.21.15.7:0/2495751180 reap_dead start 2024-09-19T04:15:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.414+0000 7fdf307d3640 1 -- 172.21.15.7:0/2495751180 shutdown_connections 2024-09-19T04:15:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.414+0000 7fdf307d3640 1 -- 172.21.15.7:0/2495751180 >> 172.21.15.7:0/2495751180 conn(0x7fdf280fd8c0 msgr2=0x7fdf280fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:49.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.414+0000 7fdf307d3640 1 -- 172.21.15.7:0/2495751180 shutdown_connections 2024-09-19T04:15:49.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:49.414+0000 7fdf307d3640 1 -- 172.21.15.7:0/2495751180 wait complete. 2024-09-19T04:15:50.010 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:50.012 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:50.054 INFO:teuthology.orchestra.run.smithi007.stdout:184683593782 2024-09-19T04:15:50.055 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-19T04:15:50.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.288+0000 7f3150b35640 1 -- 172.21.15.7:0/77869497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f314c102d40 msgr2=0x7f314c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:50.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.288+0000 7f3150b35640 1 --2- 172.21.15.7:0/77869497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f314c102d40 0x7f314c103120 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f313c009900 tx=0x7f313c02a480 comp rx=0 tx=0).stop 2024-09-19T04:15:50.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.288+0000 7f3150b35640 1 -- 172.21.15.7:0/77869497 shutdown_connections 2024-09-19T04:15:50.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.288+0000 7f3150b35640 1 --2- 172.21.15.7:0/77869497 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f314c10c170 0x7f314c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:50.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.289+0000 7f3150b35640 1 --2- 172.21.15.7:0/77869497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f314c103660 0x7f314c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:50.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.289+0000 7f3150b35640 1 --2- 172.21.15.7:0/77869497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f314c102d40 0x7f314c103120 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:50.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.289+0000 7f3150b35640 1 -- 172.21.15.7:0/77869497 >> 172.21.15.7:0/77869497 conn(0x7f314c0fc7a0 msgr2=0x7f314c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:50.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.289+0000 7f3150b35640 1 -- 172.21.15.7:0/77869497 shutdown_connections 2024-09-19T04:15:50.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.289+0000 7f3150b35640 1 -- 172.21.15.7:0/77869497 wait complete. 2024-09-19T04:15:50.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.289+0000 7f3150b35640 1 Processor -- start 2024-09-19T04:15:50.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.289+0000 7f3150b35640 1 -- start start 2024-09-19T04:15:50.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.290+0000 7f3150b35640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f314c102d40 0x7f314c19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:50.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.290+0000 7f3150b35640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f314c103660 0x7f314c19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:50.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.290+0000 7f3150b35640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f314c10c170 0x7f314c19ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:50.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.290+0000 7f3150b35640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f314c111f70 con 0x7f314c102d40 2024-09-19T04:15:50.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.290+0000 7f3150b35640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f314c111df0 con 0x7f314c10c170 2024-09-19T04:15:50.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.290+0000 7f3150b35640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f314c1120f0 con 0x7f314c103660 2024-09-19T04:15:50.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.290+0000 7f314a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f314c102d40 0x7f314c19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:50.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.290+0000 7f314a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f314c102d40 0x7f314c19a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56098/0 (socket says 172.21.15.7:56098) 2024-09-19T04:15:50.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.290+0000 7f314a59c640 1 -- 172.21.15.7:0/3895099308 learned_addr learned my addr 172.21.15.7:0/3895099308 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:50.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.290+0000 7f3149d9b640 1 --2- 172.21.15.7:0/3895099308 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f314c103660 0x7f314c19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:50.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.290+0000 7f314ad9d640 1 --2- 172.21.15.7:0/3895099308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f314c10c170 0x7f314c19ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:50.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.290+0000 7f314a59c640 1 -- 172.21.15.7:0/3895099308 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f314c103660 msgr2=0x7f314c19aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:50.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.290+0000 7f314a59c640 1 --2- 172.21.15.7:0/3895099308 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f314c103660 0x7f314c19aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:50.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.290+0000 7f314a59c640 1 -- 172.21.15.7:0/3895099308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f314c10c170 msgr2=0x7f314c19ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:50.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.290+0000 7f314a59c640 1 --2- 172.21.15.7:0/3895099308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f314c10c170 0x7f314c19ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:50.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.290+0000 7f314a59c640 1 -- 172.21.15.7:0/3895099308 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f314c19f610 con 0x7f314c102d40 2024-09-19T04:15:50.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.290+0000 7f314ad9d640 1 --2- 172.21.15.7:0/3895099308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f314c10c170 0x7f314c19ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:15:50.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.290+0000 7f314a59c640 1 --2- 172.21.15.7:0/3895099308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f314c102d40 0x7f314c19a660 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f313c006010 tx=0x7f313c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.290+0000 7f313b7fe640 1 -- 172.21.15.7:0/3895099308 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313c03f030 con 0x7f314c102d40 2024-09-19T04:15:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.290+0000 7f313b7fe640 1 -- 172.21.15.7:0/3895099308 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f313c003ce0 con 0x7f314c102d40 2024-09-19T04:15:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.290+0000 7f3150b35640 1 -- 172.21.15.7:0/3895099308 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f314c19f8a0 con 0x7f314c102d40 2024-09-19T04:15:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.290+0000 7f313b7fe640 1 -- 172.21.15.7:0/3895099308 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313c035070 con 0x7f314c102d40 2024-09-19T04:15:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.291+0000 7f3150b35640 1 -- 172.21.15.7:0/3895099308 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f314c1a71e0 con 0x7f314c102d40 2024-09-19T04:15:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.291+0000 7f3150b35640 1 -- 172.21.15.7:0/3895099308 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f314c0fee10 con 0x7f314c102d40 2024-09-19T04:15:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.293+0000 7f313b7fe640 1 -- 172.21.15.7:0/3895099308 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f313c042030 con 0x7f314c102d40 2024-09-19T04:15:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.293+0000 7f313b7fe640 1 --2- 172.21.15.7:0/3895099308 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f31340a32d0 0x7f31340a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.293+0000 7f3149d9b640 1 --2- 172.21.15.7:0/3895099308 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f31340a32d0 0x7f31340a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.294+0000 7f313b7fe640 1 -- 172.21.15.7:0/3895099308 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f313c0f0ac0 con 0x7f314c102d40 2024-09-19T04:15:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.294+0000 7f313b7fe640 1 --2- 172.21.15.7:0/3895099308 >> [v2:172.21.15.102:6816/2990859925,v1:172.21.15.102:6817/2990859925] conn(0x7f31340ae420 0x7f31340b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:50.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.294+0000 7f313b7fe640 1 -- 172.21.15.7:0/3895099308 --> [v2:172.21.15.102:6816/2990859925,v1:172.21.15.102:6817/2990859925] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f313c03be50 con 0x7f31340ae420 2024-09-19T04:15:50.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.294+0000 7f313b7fe640 1 -- 172.21.15.7:0/3895099308 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f313c0f0f10 con 0x7f314c102d40 2024-09-19T04:15:50.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.294+0000 7f3149d9b640 1 --2- 172.21.15.7:0/3895099308 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f31340a32d0 0x7f31340a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f31400058c0 tx=0x7f3140005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:50.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.294+0000 7f314ad9d640 1 --2- 172.21.15.7:0/3895099308 >> [v2:172.21.15.102:6816/2990859925,v1:172.21.15.102:6817/2990859925] conn(0x7f31340ae420 0x7f31340b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:50.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.294+0000 7f314ad9d640 1 --2- 172.21.15.7:0/3895099308 >> [v2:172.21.15.102:6816/2990859925,v1:172.21.15.102:6817/2990859925] conn(0x7f31340ae420 0x7f31340b08c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:50.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.295+0000 7f313b7fe640 1 -- 172.21.15.7:0/3895099308 <== osd.8 v2:172.21.15.102:6816/2990859925 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f313c03be50 con 0x7f31340ae420 2024-09-19T04:15:50.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.309+0000 7f3150b35640 1 -- 172.21.15.7:0/3895099308 --> [v2:172.21.15.102:6816/2990859925,v1:172.21.15.102:6817/2990859925] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f314c06b070 con 0x7f31340ae420 2024-09-19T04:15:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.310+0000 7f313b7fe640 1 -- 172.21.15.7:0/3895099308 <== osd.8 v2:172.21.15.102:6816/2990859925 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f314c06b070 con 0x7f31340ae420 2024-09-19T04:15:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.310+0000 7f3150b35640 1 -- 172.21.15.7:0/3895099308 >> [v2:172.21.15.102:6816/2990859925,v1:172.21.15.102:6817/2990859925] conn(0x7f31340ae420 msgr2=0x7f31340b08c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.310+0000 7f3150b35640 1 --2- 172.21.15.7:0/3895099308 >> [v2:172.21.15.102:6816/2990859925,v1:172.21.15.102:6817/2990859925] conn(0x7f31340ae420 0x7f31340b08c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.310+0000 7f3150b35640 1 -- 172.21.15.7:0/3895099308 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f31340a32d0 msgr2=0x7f31340a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.310+0000 7f3150b35640 1 --2- 172.21.15.7:0/3895099308 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f31340a32d0 0x7f31340a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f31400058c0 tx=0x7f3140005850 comp rx=0 tx=0).stop 2024-09-19T04:15:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.310+0000 7f3150b35640 1 -- 172.21.15.7:0/3895099308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f314c102d40 msgr2=0x7f314c19a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.310+0000 7f3150b35640 1 --2- 172.21.15.7:0/3895099308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f314c102d40 0x7f314c19a660 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f313c006010 tx=0x7f313c0042f0 comp rx=0 tx=0).stop 2024-09-19T04:15:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.310+0000 7f314ad9d640 1 -- 172.21.15.7:0/3895099308 reap_dead start 2024-09-19T04:15:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.311+0000 7f3150b35640 1 -- 172.21.15.7:0/3895099308 shutdown_connections 2024-09-19T04:15:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.311+0000 7f3150b35640 1 -- 172.21.15.7:0/3895099308 >> 172.21.15.7:0/3895099308 conn(0x7f314c0fc7a0 msgr2=0x7f314c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.311+0000 7f3150b35640 1 -- 172.21.15.7:0/3895099308 shutdown_connections 2024-09-19T04:15:50.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.311+0000 7f3150b35640 1 -- 172.21.15.7:0/3895099308 wait complete. 2024-09-19T04:15:50.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.948+0000 7f5c7b57c640 1 -- 172.21.15.7:0/349828111 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c7410c170 msgr2=0x7f5c7410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:50.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.948+0000 7f5c7b57c640 1 --2- 172.21.15.7:0/349828111 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c7410c170 0x7f5c7410e610 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c009900 tx=0x7f5c6c02a480 comp rx=0 tx=0).stop 2024-09-19T04:15:50.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.948+0000 7f5c7b57c640 1 -- 172.21.15.7:0/349828111 shutdown_connections 2024-09-19T04:15:50.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.948+0000 7f5c7b57c640 1 --2- 172.21.15.7:0/349828111 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c7410c170 0x7f5c7410e610 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:50.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.948+0000 7f5c7b57c640 1 --2- 172.21.15.7:0/349828111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c74103660 0x7f5c7410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:50.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.948+0000 7f5c7b57c640 1 --2- 172.21.15.7:0/349828111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c74102d40 0x7f5c74103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:50.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.948+0000 7f5c7b57c640 1 -- 172.21.15.7:0/349828111 >> 172.21.15.7:0/349828111 conn(0x7f5c740fc7a0 msgr2=0x7f5c740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:50.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.948+0000 7f5c7b57c640 1 -- 172.21.15.7:0/349828111 shutdown_connections 2024-09-19T04:15:50.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.948+0000 7f5c7b57c640 1 -- 172.21.15.7:0/349828111 wait complete. 2024-09-19T04:15:50.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.948+0000 7f5c7b57c640 1 Processor -- start 2024-09-19T04:15:50.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.949+0000 7f5c7b57c640 1 -- start start 2024-09-19T04:15:50.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.949+0000 7f5c7b57c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c74102d40 0x7f5c741984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:50.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.949+0000 7f5c7b57c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c74103660 0x7f5c74198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:50.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.949+0000 7f5c7b57c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c7410c170 0x7f5c7419cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:50.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.949+0000 7f5c7b57c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5c74111fb0 con 0x7f5c74102d40 2024-09-19T04:15:50.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.949+0000 7f5c7b57c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5c74111e30 con 0x7f5c74103660 2024-09-19T04:15:50.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.949+0000 7f5c7b57c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5c74112130 con 0x7f5c7410c170 2024-09-19T04:15:50.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.949+0000 7f5c79318640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c74102d40 0x7f5c741984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:50.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.949+0000 7f5c79318640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c74102d40 0x7f5c741984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56120/0 (socket says 172.21.15.7:56120) 2024-09-19T04:15:50.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.949+0000 7f5c79318640 1 -- 172.21.15.7:0/4163788931 learned_addr learned my addr 172.21.15.7:0/4163788931 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:50.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.949+0000 7f5c78b17640 1 --2- 172.21.15.7:0/4163788931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c74103660 0x7f5c74198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:50.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.949+0000 7f5c79b19640 1 --2- 172.21.15.7:0/4163788931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c7410c170 0x7f5c7419cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:50.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.949+0000 7f5c79318640 1 -- 172.21.15.7:0/4163788931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c7410c170 msgr2=0x7f5c7419cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:50.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.949+0000 7f5c79318640 1 --2- 172.21.15.7:0/4163788931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c7410c170 0x7f5c7419cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:50.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.949+0000 7f5c79318640 1 -- 172.21.15.7:0/4163788931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c74103660 msgr2=0x7f5c74198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:50.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.949+0000 7f5c79318640 1 --2- 172.21.15.7:0/4163788931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5c74103660 0x7f5c74198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:50.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.949+0000 7f5c79318640 1 -- 172.21.15.7:0/4163788931 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c7419d490 con 0x7f5c74102d40 2024-09-19T04:15:50.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.949+0000 7f5c79b19640 1 --2- 172.21.15.7:0/4163788931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c7410c170 0x7f5c7419cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:15:50.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.949+0000 7f5c79318640 1 --2- 172.21.15.7:0/4163788931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c74102d40 0x7f5c741984e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5c6400ba50 tx=0x7f5c6400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:50.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.949+0000 7f5c727fc640 1 -- 172.21.15.7:0/4163788931 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c64019070 con 0x7f5c74102d40 2024-09-19T04:15:50.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.950+0000 7f5c7b57c640 1 -- 172.21.15.7:0/4163788931 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c7419d780 con 0x7f5c74102d40 2024-09-19T04:15:50.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.950+0000 7f5c727fc640 1 -- 172.21.15.7:0/4163788931 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c6400cbe0 con 0x7f5c74102d40 2024-09-19T04:15:50.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.950+0000 7f5c727fc640 1 -- 172.21.15.7:0/4163788931 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c640076e0 con 0x7f5c74102d40 2024-09-19T04:15:50.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.950+0000 7f5c7b57c640 1 -- 172.21.15.7:0/4163788931 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c741a5060 con 0x7f5c74102d40 2024-09-19T04:15:50.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.950+0000 7f5c7b57c640 1 -- 172.21.15.7:0/4163788931 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5c74062900 con 0x7f5c74102d40 2024-09-19T04:15:50.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.952+0000 7f5c727fc640 1 -- 172.21.15.7:0/4163788931 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f5c6401c070 con 0x7f5c74102d40 2024-09-19T04:15:50.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.952+0000 7f5c727fc640 1 --2- 172.21.15.7:0/4163788931 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f5c5c0a32d0 0x7f5c5c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:50.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.952+0000 7f5c78b17640 1 --2- 172.21.15.7:0/4163788931 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f5c5c0a32d0 0x7f5c5c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:50.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.952+0000 7f5c727fc640 1 -- 172.21.15.7:0/4163788931 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f5c640cfbb0 con 0x7f5c74102d40 2024-09-19T04:15:50.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.953+0000 7f5c727fc640 1 --2- 172.21.15.7:0/4163788931 >> [v2:172.21.15.92:6816/3411102480,v1:172.21.15.92:6817/3411102480] conn(0x7f5c5c0ae420 0x7f5c5c0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:50.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.953+0000 7f5c727fc640 1 -- 172.21.15.7:0/4163788931 --> [v2:172.21.15.92:6816/3411102480,v1:172.21.15.92:6817/3411102480] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5c64016ec0 con 0x7f5c5c0ae420 2024-09-19T04:15:50.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.953+0000 7f5c727fc640 1 -- 172.21.15.7:0/4163788931 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f5c640d0000 con 0x7f5c74102d40 2024-09-19T04:15:50.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.953+0000 7f5c78b17640 1 --2- 172.21.15.7:0/4163788931 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f5c5c0a32d0 0x7f5c5c0a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5c680058c0 tx=0x7f5c68005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:50.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.953+0000 7f5c79b19640 1 --2- 172.21.15.7:0/4163788931 >> [v2:172.21.15.92:6816/3411102480,v1:172.21.15.92:6817/3411102480] conn(0x7f5c5c0ae420 0x7f5c5c0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:50.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.953+0000 7f5c79b19640 1 --2- 172.21.15.7:0/4163788931 >> [v2:172.21.15.92:6816/3411102480,v1:172.21.15.92:6817/3411102480] conn(0x7f5c5c0ae420 0x7f5c5c0b08c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:50.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.954+0000 7f5c727fc640 1 -- 172.21.15.7:0/4163788931 <== osd.7 v2:172.21.15.92:6816/3411102480 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5c64016ec0 con 0x7f5c5c0ae420 2024-09-19T04:15:50.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.969+0000 7f5c7b57c640 1 -- 172.21.15.7:0/4163788931 --> [v2:172.21.15.92:6816/3411102480,v1:172.21.15.92:6817/3411102480] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5c74062d00 con 0x7f5c5c0ae420 2024-09-19T04:15:50.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.969+0000 7f5c727fc640 1 -- 172.21.15.7:0/4163788931 <== osd.7 v2:172.21.15.92:6816/3411102480 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5c74062d00 con 0x7f5c5c0ae420 2024-09-19T04:15:50.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.970+0000 7f5c7b57c640 1 -- 172.21.15.7:0/4163788931 >> [v2:172.21.15.92:6816/3411102480,v1:172.21.15.92:6817/3411102480] conn(0x7f5c5c0ae420 msgr2=0x7f5c5c0b08c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:50.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.970+0000 7f5c7b57c640 1 --2- 172.21.15.7:0/4163788931 >> [v2:172.21.15.92:6816/3411102480,v1:172.21.15.92:6817/3411102480] conn(0x7f5c5c0ae420 0x7f5c5c0b08c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:50.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.970+0000 7f5c7b57c640 1 -- 172.21.15.7:0/4163788931 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f5c5c0a32d0 msgr2=0x7f5c5c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:50.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.970+0000 7f5c7b57c640 1 --2- 172.21.15.7:0/4163788931 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f5c5c0a32d0 0x7f5c5c0a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5c680058c0 tx=0x7f5c68005850 comp rx=0 tx=0).stop 2024-09-19T04:15:50.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.970+0000 7f5c7b57c640 1 -- 172.21.15.7:0/4163788931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c74102d40 msgr2=0x7f5c741984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:50.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.970+0000 7f5c7b57c640 1 --2- 172.21.15.7:0/4163788931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c74102d40 0x7f5c741984e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5c6400ba50 tx=0x7f5c6400bf10 comp rx=0 tx=0).stop 2024-09-19T04:15:50.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.970+0000 7f5c79b19640 1 -- 172.21.15.7:0/4163788931 reap_dead start 2024-09-19T04:15:50.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.970+0000 7f5c7b57c640 1 -- 172.21.15.7:0/4163788931 shutdown_connections 2024-09-19T04:15:50.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.970+0000 7f5c7b57c640 1 -- 172.21.15.7:0/4163788931 >> 172.21.15.7:0/4163788931 conn(0x7f5c740fc7a0 msgr2=0x7f5c740fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:50.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.970+0000 7f5c7b57c640 1 -- 172.21.15.7:0/4163788931 shutdown_connections 2024-09-19T04:15:50.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:50.970+0000 7f5c7b57c640 1 -- 172.21.15.7:0/4163788931 wait complete. 2024-09-19T04:15:51.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:51 smithi007 ceph-mon[31360]: pgmap v320: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-19T04:15:51.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.149+0000 7efc0961d640 1 -- 172.21.15.7:0/2137238800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc0410c1a0 msgr2=0x7efc0410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:51.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.149+0000 7efc0961d640 1 --2- 172.21.15.7:0/2137238800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc0410c1a0 0x7efc0410e610 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efbfc009ca0 tx=0x7efbfc02a950 comp rx=0 tx=0).stop 2024-09-19T04:15:51.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.149+0000 7efc0961d640 1 -- 172.21.15.7:0/2137238800 shutdown_connections 2024-09-19T04:15:51.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.149+0000 7efc0961d640 1 --2- 172.21.15.7:0/2137238800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc0410c1a0 0x7efc0410e610 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:51.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.149+0000 7efc0961d640 1 --2- 172.21.15.7:0/2137238800 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc04103720 0x7efc0410bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:51.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.149+0000 7efc0961d640 1 --2- 172.21.15.7:0/2137238800 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc04102e00 0x7efc041031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:51.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.149+0000 7efc0961d640 1 -- 172.21.15.7:0/2137238800 >> 172.21.15.7:0/2137238800 conn(0x7efc040fc7a0 msgr2=0x7efc040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:51.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.149+0000 7efc0961d640 1 -- 172.21.15.7:0/2137238800 shutdown_connections 2024-09-19T04:15:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.149+0000 7efc0961d640 1 -- 172.21.15.7:0/2137238800 wait complete. 2024-09-19T04:15:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.149+0000 7efc0961d640 1 Processor -- start 2024-09-19T04:15:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.150+0000 7efc0961d640 1 -- start start 2024-09-19T04:15:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.150+0000 7efc0961d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc04102e00 0x7efc041983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.150+0000 7efc0961d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc04103720 0x7efc04198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.150+0000 7efc0961d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc0410c1a0 0x7efc0419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.150+0000 7efc0961d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efc04111f70 con 0x7efc0410c1a0 2024-09-19T04:15:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.150+0000 7efc0961d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efc04111df0 con 0x7efc04103720 2024-09-19T04:15:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.150+0000 7efc0961d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efc041120f0 con 0x7efc04102e00 2024-09-19T04:15:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.150+0000 7efc037fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc0410c1a0 0x7efc0419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.150+0000 7efc037fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc0410c1a0 0x7efc0419cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56142/0 (socket says 172.21.15.7:56142) 2024-09-19T04:15:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.150+0000 7efc037fe640 1 -- 172.21.15.7:0/3849340668 learned_addr learned my addr 172.21.15.7:0/3849340668 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.150+0000 7efc027fc640 1 --2- 172.21.15.7:0/3849340668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc04103720 0x7efc04198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:51.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.150+0000 7efc02ffd640 1 --2- 172.21.15.7:0/3849340668 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc04102e00 0x7efc041983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:51.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.150+0000 7efc037fe640 1 -- 172.21.15.7:0/3849340668 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc04102e00 msgr2=0x7efc041983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:51.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.150+0000 7efc037fe640 1 --2- 172.21.15.7:0/3849340668 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc04102e00 0x7efc041983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:51.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.150+0000 7efc037fe640 1 -- 172.21.15.7:0/3849340668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc04103720 msgr2=0x7efc04198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:51.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.150+0000 7efc037fe640 1 --2- 172.21.15.7:0/3849340668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc04103720 0x7efc04198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:51.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.150+0000 7efc037fe640 1 -- 172.21.15.7:0/3849340668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc0419d380 con 0x7efc0410c1a0 2024-09-19T04:15:51.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.151+0000 7efc037fe640 1 --2- 172.21.15.7:0/3849340668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc0410c1a0 0x7efc0419cca0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efbfc02ae70 tx=0x7efbfc02f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:51.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.151+0000 7efbebfff640 1 -- 172.21.15.7:0/3849340668 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbfc034040 con 0x7efc0410c1a0 2024-09-19T04:15:51.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.151+0000 7efc0961d640 1 -- 172.21.15.7:0/3849340668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc0419d610 con 0x7efc0410c1a0 2024-09-19T04:15:51.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.151+0000 7efbebfff640 1 -- 172.21.15.7:0/3849340668 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efbfc030920 con 0x7efc0410c1a0 2024-09-19T04:15:51.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.151+0000 7efbebfff640 1 -- 172.21.15.7:0/3849340668 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbfc045480 con 0x7efc0410c1a0 2024-09-19T04:15:51.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.151+0000 7efc0961d640 1 -- 172.21.15.7:0/3849340668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc041a4f50 con 0x7efc0410c1a0 2024-09-19T04:15:51.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.152+0000 7efc0961d640 1 -- 172.21.15.7:0/3849340668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc041031e0 con 0x7efc0410c1a0 2024-09-19T04:15:51.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.153+0000 7efbebfff640 1 -- 172.21.15.7:0/3849340668 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7efbfc037020 con 0x7efc0410c1a0 2024-09-19T04:15:51.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.154+0000 7efbebfff640 1 --2- 172.21.15.7:0/3849340668 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7efbec0a32d0 0x7efbec0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:51.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.154+0000 7efbebfff640 1 -- 172.21.15.7:0/3849340668 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7efbfc0f0b80 con 0x7efc0410c1a0 2024-09-19T04:15:51.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.154+0000 7efc02ffd640 1 --2- 172.21.15.7:0/3849340668 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7efbec0a32d0 0x7efbec0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:51.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.154+0000 7efc02ffd640 1 --2- 172.21.15.7:0/3849340668 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7efbec0a32d0 0x7efbec0a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efbf4005fd0 tx=0x7efbf400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:51.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.158+0000 7efbebfff640 1 -- 172.21.15.7:0/3849340668 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efbfc0bd510 con 0x7efc0410c1a0 2024-09-19T04:15:51.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:51 smithi092 ceph-mon[34940]: pgmap v320: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-19T04:15:51.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.339+0000 7efc0961d640 1 -- 172.21.15.7:0/3849340668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7efc04107280 con 0x7efc0410c1a0 2024-09-19T04:15:51.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.339+0000 7efbebfff640 1 -- 172.21.15.7:0/3849340668 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7efbfc0bce10 con 0x7efc0410c1a0 2024-09-19T04:15:51.341 INFO:teuthology.orchestra.run.smithi007.stdout:154618822715 2024-09-19T04:15:51.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.341+0000 7efc0961d640 1 -- 172.21.15.7:0/3849340668 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7efbec0a32d0 msgr2=0x7efbec0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:51.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.341+0000 7efc0961d640 1 --2- 172.21.15.7:0/3849340668 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7efbec0a32d0 0x7efbec0a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efbf4005fd0 tx=0x7efbf400b390 comp rx=0 tx=0).stop 2024-09-19T04:15:51.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.341+0000 7efc0961d640 1 -- 172.21.15.7:0/3849340668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc0410c1a0 msgr2=0x7efc0419cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:51.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.341+0000 7efc0961d640 1 --2- 172.21.15.7:0/3849340668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc0410c1a0 0x7efc0419cca0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efbfc02ae70 tx=0x7efbfc02f5b0 comp rx=0 tx=0).stop 2024-09-19T04:15:51.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.342+0000 7efc0961d640 1 -- 172.21.15.7:0/3849340668 shutdown_connections 2024-09-19T04:15:51.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.342+0000 7efc0961d640 1 --2- 172.21.15.7:0/3849340668 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7efbec0a32d0 0x7efbec0a5790 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:51.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.342+0000 7efc0961d640 1 --2- 172.21.15.7:0/3849340668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc0410c1a0 0x7efc0419cca0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:51.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.342+0000 7efc0961d640 1 --2- 172.21.15.7:0/3849340668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc04103720 0x7efc04198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:51.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.342+0000 7efc0961d640 1 --2- 172.21.15.7:0/3849340668 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc04102e00 0x7efc041983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:51.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.342+0000 7efc0961d640 1 -- 172.21.15.7:0/3849340668 >> 172.21.15.7:0/3849340668 conn(0x7efc040fc7a0 msgr2=0x7efc040fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:51.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.342+0000 7efc0961d640 1 -- 172.21.15.7:0/3849340668 shutdown_connections 2024-09-19T04:15:51.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:51.342+0000 7efc0961d640 1 -- 172.21.15.7:0/3849340668 wait complete. 2024-09-19T04:15:51.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:51 smithi102 ceph-mon[35446]: pgmap v320: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-19T04:15:52.040 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822714 got 154618822715 for osd.5 2024-09-19T04:15:52.040 DEBUG:teuthology.parallel:result is None 2024-09-19T04:15:52.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:52 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3849340668' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T04:15:52.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:52 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3849340668' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T04:15:52.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:52 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3849340668' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T04:15:52.463 INFO:teuthology.orchestra.run.smithi007.stdout:236223201323 2024-09-19T04:15:52.463 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-19T04:15:53.075 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:53 smithi007 ceph-mon[31360]: pgmap v321: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T04:15:53.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:53 smithi092 ceph-mon[34940]: pgmap v321: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T04:15:53.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:53 smithi102 ceph-mon[35446]: pgmap v321: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T04:15:53.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.409+0000 7f9fb836f640 1 -- 172.21.15.7:0/2724313181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fb0100a80 msgr2=0x7f9fb0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:53.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.409+0000 7f9fb836f640 1 --2- 172.21.15.7:0/2724313181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fb0100a80 0x7f9fb0100ee0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0009930 tx=0x7f9fa002a420 comp rx=0 tx=0).stop 2024-09-19T04:15:53.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.409+0000 7f9fb836f640 1 -- 172.21.15.7:0/2724313181 shutdown_connections 2024-09-19T04:15:53.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.409+0000 7f9fb836f640 1 --2- 172.21.15.7:0/2724313181 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fb0101420 0x7f9fb010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:53.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.409+0000 7f9fb836f640 1 --2- 172.21.15.7:0/2724313181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fb0100a80 0x7f9fb0100ee0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:53.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.409+0000 7f9fb836f640 1 --2- 172.21.15.7:0/2724313181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fb0106a80 0x7f9fb0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:53.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.409+0000 7f9fb836f640 1 -- 172.21.15.7:0/2724313181 >> 172.21.15.7:0/2724313181 conn(0x7f9fb00fc7a0 msgr2=0x7f9fb00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:53.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.409+0000 7f9fb836f640 1 -- 172.21.15.7:0/2724313181 shutdown_connections 2024-09-19T04:15:53.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.409+0000 7f9fb836f640 1 -- 172.21.15.7:0/2724313181 wait complete. 2024-09-19T04:15:53.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.410+0000 7f9fb836f640 1 Processor -- start 2024-09-19T04:15:53.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.410+0000 7f9fb836f640 1 -- start start 2024-09-19T04:15:53.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.410+0000 7f9fb836f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fb0100a80 0x7f9fb0198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:53.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.410+0000 7f9fb836f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fb0101420 0x7f9fb01989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:53.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.410+0000 7f9fb836f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fb0106a80 0x7f9fb019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:53.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.410+0000 7f9fb836f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb0110e80 con 0x7f9fb0100a80 2024-09-19T04:15:53.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.410+0000 7f9fb836f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb0110d00 con 0x7f9fb0106a80 2024-09-19T04:15:53.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.410+0000 7f9fb836f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb0111000 con 0x7f9fb0101420 2024-09-19T04:15:53.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.410+0000 7f9fb610b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fb0100a80 0x7f9fb0198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:53.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.410+0000 7f9fb610b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fb0100a80 0x7f9fb0198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56168/0 (socket says 172.21.15.7:56168) 2024-09-19T04:15:53.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.410+0000 7f9fb610b640 1 -- 172.21.15.7:0/3340627808 learned_addr learned my addr 172.21.15.7:0/3340627808 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:53.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.411+0000 7f9fb590a640 1 --2- 172.21.15.7:0/3340627808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fb0101420 0x7f9fb01989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:53.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.411+0000 7f9fb690c640 1 --2- 172.21.15.7:0/3340627808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fb0106a80 0x7f9fb019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:53.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.411+0000 7f9fb610b640 1 -- 172.21.15.7:0/3340627808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fb0101420 msgr2=0x7f9fb01989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:53.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.411+0000 7f9fb610b640 1 --2- 172.21.15.7:0/3340627808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fb0101420 0x7f9fb01989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:53.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.411+0000 7f9fb610b640 1 -- 172.21.15.7:0/3340627808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fb0106a80 msgr2=0x7f9fb019cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:53.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.411+0000 7f9fb610b640 1 --2- 172.21.15.7:0/3340627808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fb0106a80 0x7f9fb019cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:53.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.411+0000 7f9fb610b640 1 -- 172.21.15.7:0/3340627808 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb019d430 con 0x7f9fb0100a80 2024-09-19T04:15:53.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.411+0000 7f9fb590a640 1 --2- 172.21.15.7:0/3340627808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fb0101420 0x7f9fb01989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:15:53.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.411+0000 7f9fb610b640 1 --2- 172.21.15.7:0/3340627808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fb0100a80 0x7f9fb0198480 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00d950 tx=0x7f9fac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:53.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.411+0000 7f9fa77fe640 1 -- 172.21.15.7:0/3340627808 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fac017030 con 0x7f9fb0100a80 2024-09-19T04:15:53.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.411+0000 7f9fa77fe640 1 -- 172.21.15.7:0/3340627808 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fac004020 con 0x7f9fb0100a80 2024-09-19T04:15:53.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.411+0000 7f9fb836f640 1 -- 172.21.15.7:0/3340627808 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fb019d720 con 0x7f9fb0100a80 2024-09-19T04:15:53.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.411+0000 7f9fa77fe640 1 -- 172.21.15.7:0/3340627808 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fac0047a0 con 0x7f9fb0100a80 2024-09-19T04:15:53.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.411+0000 7f9fb836f640 1 -- 172.21.15.7:0/3340627808 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fb01a5000 con 0x7f9fb0100a80 2024-09-19T04:15:53.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.412+0000 7f9fb836f640 1 -- 172.21.15.7:0/3340627808 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9fb0062980 con 0x7f9fb0100a80 2024-09-19T04:15:53.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.413+0000 7f9fa77fe640 1 -- 172.21.15.7:0/3340627808 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f9fac0041d0 con 0x7f9fb0100a80 2024-09-19T04:15:53.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.414+0000 7f9fa77fe640 1 --2- 172.21.15.7:0/3340627808 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9f9c0a32d0 0x7f9f9c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:53.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.414+0000 7f9fa77fe640 1 -- 172.21.15.7:0/3340627808 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f9fac0cfe90 con 0x7f9fb0100a80 2024-09-19T04:15:53.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.414+0000 7f9fb590a640 1 --2- 172.21.15.7:0/3340627808 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9f9c0a32d0 0x7f9f9c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:53.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.414+0000 7f9fa77fe640 1 --2- 172.21.15.7:0/3340627808 >> [v2:172.21.15.102:6824/1175425599,v1:172.21.15.102:6825/1175425599] conn(0x7f9f9c0ae420 0x7f9f9c0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:53.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.414+0000 7f9fa77fe640 1 -- 172.21.15.7:0/3340627808 --> [v2:172.21.15.102:6824/1175425599,v1:172.21.15.102:6825/1175425599] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9f9c0b0f90 con 0x7f9f9c0ae420 2024-09-19T04:15:53.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.414+0000 7f9fa77fe640 1 -- 172.21.15.7:0/3340627808 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f9fac0d02e0 con 0x7f9fb0100a80 2024-09-19T04:15:53.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.415+0000 7f9fb690c640 1 --2- 172.21.15.7:0/3340627808 >> [v2:172.21.15.102:6824/1175425599,v1:172.21.15.102:6825/1175425599] conn(0x7f9f9c0ae420 0x7f9f9c0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:53.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.415+0000 7f9fb590a640 1 --2- 172.21.15.7:0/3340627808 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9f9c0a32d0 0x7f9f9c0a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0000c00 tx=0x7f9fa0032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:53.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.415+0000 7f9fb690c640 1 --2- 172.21.15.7:0/3340627808 >> [v2:172.21.15.102:6824/1175425599,v1:172.21.15.102:6825/1175425599] conn(0x7f9f9c0ae420 0x7f9f9c0b08c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:53.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.416+0000 7f9fa77fe640 1 -- 172.21.15.7:0/3340627808 <== osd.11 v2:172.21.15.102:6824/1175425599 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9f9c0b0f90 con 0x7f9f9c0ae420 2024-09-19T04:15:53.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.430+0000 7f9fb836f640 1 -- 172.21.15.7:0/3340627808 --> [v2:172.21.15.102:6824/1175425599,v1:172.21.15.102:6825/1175425599] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9fb0062d80 con 0x7f9f9c0ae420 2024-09-19T04:15:53.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.430+0000 7f9fa77fe640 1 -- 172.21.15.7:0/3340627808 <== osd.11 v2:172.21.15.102:6824/1175425599 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9fb0062d80 con 0x7f9f9c0ae420 2024-09-19T04:15:53.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.431+0000 7f9fb836f640 1 -- 172.21.15.7:0/3340627808 >> [v2:172.21.15.102:6824/1175425599,v1:172.21.15.102:6825/1175425599] conn(0x7f9f9c0ae420 msgr2=0x7f9f9c0b08c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:53.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.431+0000 7f9fb836f640 1 --2- 172.21.15.7:0/3340627808 >> [v2:172.21.15.102:6824/1175425599,v1:172.21.15.102:6825/1175425599] conn(0x7f9f9c0ae420 0x7f9f9c0b08c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:53.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.431+0000 7f9fb836f640 1 -- 172.21.15.7:0/3340627808 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9f9c0a32d0 msgr2=0x7f9f9c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:53.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.431+0000 7f9fb836f640 1 --2- 172.21.15.7:0/3340627808 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9f9c0a32d0 0x7f9f9c0a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0000c00 tx=0x7f9fa0032c70 comp rx=0 tx=0).stop 2024-09-19T04:15:53.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.431+0000 7f9fb836f640 1 -- 172.21.15.7:0/3340627808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fb0100a80 msgr2=0x7f9fb0198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:53.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.431+0000 7f9fb836f640 1 --2- 172.21.15.7:0/3340627808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fb0100a80 0x7f9fb0198480 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00d950 tx=0x7f9fac00de10 comp rx=0 tx=0).stop 2024-09-19T04:15:53.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.431+0000 7f9fb690c640 1 -- 172.21.15.7:0/3340627808 reap_dead start 2024-09-19T04:15:53.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.431+0000 7f9fb836f640 1 -- 172.21.15.7:0/3340627808 shutdown_connections 2024-09-19T04:15:53.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.431+0000 7f9fb836f640 1 -- 172.21.15.7:0/3340627808 >> 172.21.15.7:0/3340627808 conn(0x7f9fb00fc7a0 msgr2=0x7f9fb006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:53.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.431+0000 7f9fb836f640 1 -- 172.21.15.7:0/3340627808 shutdown_connections 2024-09-19T04:15:53.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.431+0000 7f9fb836f640 1 -- 172.21.15.7:0/3340627808 wait complete. 2024-09-19T04:15:54.100 INFO:teuthology.orchestra.run.smithi007.stdout:317827579934 2024-09-19T04:15:54.101 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-19T04:15:54.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.276+0000 7f493e1dc640 1 -- 172.21.15.7:0/2646043522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4938100e20 msgr2=0x7f4938101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:54.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.276+0000 7f493e1dc640 1 --2- 172.21.15.7:0/2646043522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4938100e20 0x7f4938101200 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4928009900 tx=0x7f492802a480 comp rx=0 tx=0).stop 2024-09-19T04:15:54.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.276+0000 7f493e1dc640 1 -- 172.21.15.7:0/2646043522 shutdown_connections 2024-09-19T04:15:54.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.276+0000 7f493e1dc640 1 --2- 172.21.15.7:0/2646043522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4938102ef0 0x7f493810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:54.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.276+0000 7f493e1dc640 1 --2- 172.21.15.7:0/2646043522 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4938102570 0x7f49381029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:54.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.276+0000 7f493e1dc640 1 --2- 172.21.15.7:0/2646043522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4938100e20 0x7f4938101200 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:54.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.276+0000 7f493e1dc640 1 -- 172.21.15.7:0/2646043522 >> 172.21.15.7:0/2646043522 conn(0x7f49380fc7d0 msgr2=0x7f49380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:54.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.276+0000 7f493e1dc640 1 -- 172.21.15.7:0/2646043522 shutdown_connections 2024-09-19T04:15:54.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.276+0000 7f493e1dc640 1 -- 172.21.15.7:0/2646043522 wait complete. 2024-09-19T04:15:54.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.276+0000 7f493e1dc640 1 Processor -- start 2024-09-19T04:15:54.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.277+0000 7f493e1dc640 1 -- start start 2024-09-19T04:15:54.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.277+0000 7f493e1dc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4938100e20 0x7f49381993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:54.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.277+0000 7f493e1dc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4938102570 0x7f4938199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:54.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.277+0000 7f493e1dc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4938102ef0 0x7f49381a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:54.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.277+0000 7f493e1dc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4938110f80 con 0x7f4938102ef0 2024-09-19T04:15:54.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.277+0000 7f493e1dc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4938110e00 con 0x7f4938102570 2024-09-19T04:15:54.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.277+0000 7f493e1dc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4938111100 con 0x7f4938100e20 2024-09-19T04:15:54.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.277+0000 7f4937fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4938102ef0 0x7f49381a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:54.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.277+0000 7f4937fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4938102ef0 0x7f49381a4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56190/0 (socket says 172.21.15.7:56190) 2024-09-19T04:15:54.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.277+0000 7f4937fff640 1 -- 172.21.15.7:0/1012924764 learned_addr learned my addr 172.21.15.7:0/1012924764 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:54.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.277+0000 7f49377fe640 1 --2- 172.21.15.7:0/1012924764 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4938100e20 0x7f49381993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:54.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.277+0000 7f4936ffd640 1 --2- 172.21.15.7:0/1012924764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4938102570 0x7f4938199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:54.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.277+0000 7f4937fff640 1 -- 172.21.15.7:0/1012924764 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4938100e20 msgr2=0x7f49381993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:54.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.277+0000 7f4937fff640 1 --2- 172.21.15.7:0/1012924764 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4938100e20 0x7f49381993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:54.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.277+0000 7f4937fff640 1 -- 172.21.15.7:0/1012924764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4938102570 msgr2=0x7f4938199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:54.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.277+0000 7f4937fff640 1 --2- 172.21.15.7:0/1012924764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4938102570 0x7f4938199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:54.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.277+0000 7f4937fff640 1 -- 172.21.15.7:0/1012924764 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49381a4990 con 0x7f4938102ef0 2024-09-19T04:15:54.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.277+0000 7f4936ffd640 1 --2- 172.21.15.7:0/1012924764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4938102570 0x7f4938199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:15:54.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.278+0000 7f4937fff640 1 --2- 172.21.15.7:0/1012924764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4938102ef0 0x7f49381a4450 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4930009fd0 tx=0x7f493000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:54.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.278+0000 7f4934ff9640 1 -- 172.21.15.7:0/1012924764 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4930017070 con 0x7f4938102ef0 2024-09-19T04:15:54.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.278+0000 7f4934ff9640 1 -- 172.21.15.7:0/1012924764 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4930003e50 con 0x7f4938102ef0 2024-09-19T04:15:54.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.278+0000 7f493e1dc640 1 -- 172.21.15.7:0/1012924764 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49381a4b60 con 0x7f4938102ef0 2024-09-19T04:15:54.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.278+0000 7f4934ff9640 1 -- 172.21.15.7:0/1012924764 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49300106c0 con 0x7f4938102ef0 2024-09-19T04:15:54.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.278+0000 7f493e1dc640 1 -- 172.21.15.7:0/1012924764 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49381a5020 con 0x7f4938102ef0 2024-09-19T04:15:54.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.279+0000 7f493e1dc640 1 -- 172.21.15.7:0/1012924764 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4938101200 con 0x7f4938102ef0 2024-09-19T04:15:54.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.280+0000 7f4934ff9640 1 -- 172.21.15.7:0/1012924764 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f4930003970 con 0x7f4938102ef0 2024-09-19T04:15:54.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.281+0000 7f4934ff9640 1 --2- 172.21.15.7:0/1012924764 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f49200a32d0 0x7f49200a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:54.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.281+0000 7f4934ff9640 1 -- 172.21.15.7:0/1012924764 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f49300cfb10 con 0x7f4938102ef0 2024-09-19T04:15:54.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.281+0000 7f49377fe640 1 --2- 172.21.15.7:0/1012924764 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f49200a32d0 0x7f49200a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:54.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.281+0000 7f49377fe640 1 --2- 172.21.15.7:0/1012924764 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f49200a32d0 0x7f49200a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4928009230 tx=0x7f49280058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:54.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.286+0000 7f4934ff9640 1 -- 172.21.15.7:0/1012924764 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f493009c390 con 0x7f4938102ef0 2024-09-19T04:15:54.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.464+0000 7f493e1dc640 1 -- 172.21.15.7:0/1012924764 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f4938109090 con 0x7f4938102ef0 2024-09-19T04:15:54.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.465+0000 7f4934ff9640 1 -- 172.21.15.7:0/1012924764 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f493009bc90 con 0x7f4938102ef0 2024-09-19T04:15:54.466 INFO:teuthology.orchestra.run.smithi007.stdout:266287972391 2024-09-19T04:15:54.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.467+0000 7f493e1dc640 1 -- 172.21.15.7:0/1012924764 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f49200a32d0 msgr2=0x7f49200a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:54.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.467+0000 7f493e1dc640 1 --2- 172.21.15.7:0/1012924764 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f49200a32d0 0x7f49200a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4928009230 tx=0x7f49280058d0 comp rx=0 tx=0).stop 2024-09-19T04:15:54.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.467+0000 7f493e1dc640 1 -- 172.21.15.7:0/1012924764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4938102ef0 msgr2=0x7f49381a4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:54.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.467+0000 7f493e1dc640 1 --2- 172.21.15.7:0/1012924764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4938102ef0 0x7f49381a4450 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4930009fd0 tx=0x7f493000b260 comp rx=0 tx=0).stop 2024-09-19T04:15:54.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.467+0000 7f493e1dc640 1 -- 172.21.15.7:0/1012924764 shutdown_connections 2024-09-19T04:15:54.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.467+0000 7f493e1dc640 1 --2- 172.21.15.7:0/1012924764 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f49200a32d0 0x7f49200a5790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:54.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.467+0000 7f493e1dc640 1 --2- 172.21.15.7:0/1012924764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4938102ef0 0x7f49381a4450 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:54.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.467+0000 7f493e1dc640 1 --2- 172.21.15.7:0/1012924764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4938102570 0x7f4938199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:54.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.467+0000 7f493e1dc640 1 --2- 172.21.15.7:0/1012924764 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4938100e20 0x7f49381993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:54.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.467+0000 7f493e1dc640 1 -- 172.21.15.7:0/1012924764 >> 172.21.15.7:0/1012924764 conn(0x7f49380fc7d0 msgr2=0x7f49380fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:54.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.467+0000 7f493e1dc640 1 -- 172.21.15.7:0/1012924764 shutdown_connections 2024-09-19T04:15:54.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:54.467+0000 7f493e1dc640 1 -- 172.21.15.7:0/1012924764 wait complete. 2024-09-19T04:15:54.560 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:54.561 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:54.996 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:15:55.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:55 smithi007 ceph-mon[31360]: pgmap v322: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T04:15:55.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:55 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1012924764' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T04:15:55.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:55 smithi092 ceph-mon[34940]: pgmap v322: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T04:15:55.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:55 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1012924764' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T04:15:55.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:55 smithi102 ceph-mon[35446]: pgmap v322: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T04:15:55.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:55 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1012924764' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T04:15:55.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.073+0000 7ff2b5e76640 1 -- 172.21.15.7:0/3954352921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2b0106a80 msgr2=0x7ff2b0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:55.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.073+0000 7ff2b5e76640 1 --2- 172.21.15.7:0/3954352921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2b0106a80 0x7ff2b0106e60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0009930 tx=0x7ff2a002a420 comp rx=0 tx=0).stop 2024-09-19T04:15:55.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.073+0000 7ff2b5e76640 1 -- 172.21.15.7:0/3954352921 shutdown_connections 2024-09-19T04:15:55.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.073+0000 7ff2b5e76640 1 --2- 172.21.15.7:0/3954352921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2b0101420 0x7ff2b010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:55.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.073+0000 7ff2b5e76640 1 --2- 172.21.15.7:0/3954352921 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2b0100a80 0x7ff2b0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:55.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.073+0000 7ff2b5e76640 1 --2- 172.21.15.7:0/3954352921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2b0106a80 0x7ff2b0106e60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:55.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.073+0000 7ff2b5e76640 1 -- 172.21.15.7:0/3954352921 >> 172.21.15.7:0/3954352921 conn(0x7ff2b00fc7a0 msgr2=0x7ff2b00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:55.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.074+0000 7ff2b5e76640 1 -- 172.21.15.7:0/3954352921 shutdown_connections 2024-09-19T04:15:55.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.074+0000 7ff2b5e76640 1 -- 172.21.15.7:0/3954352921 wait complete. 2024-09-19T04:15:55.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.074+0000 7ff2b5e76640 1 Processor -- start 2024-09-19T04:15:55.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.074+0000 7ff2b5e76640 1 -- start start 2024-09-19T04:15:55.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.075+0000 7ff2b5e76640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2b0100a80 0x7ff2b0102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:55.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.075+0000 7ff2b5e76640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2b0101420 0x7ff2b0102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:55.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.075+0000 7ff2b5e76640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2b0106a80 0x7ff2b01030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:55.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.075+0000 7ff2b5e76640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b0110e40 con 0x7ff2b0106a80 2024-09-19T04:15:55.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.075+0000 7ff2b5e76640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b0110cc0 con 0x7ff2b0101420 2024-09-19T04:15:55.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.075+0000 7ff2b5e76640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b0110fc0 con 0x7ff2b0100a80 2024-09-19T04:15:55.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.075+0000 7ff2affff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2b0106a80 0x7ff2b01030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:55.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.075+0000 7ff2affff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2b0106a80 0x7ff2b01030d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56146/0 (socket says 172.21.15.7:56146) 2024-09-19T04:15:55.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.075+0000 7ff2affff640 1 -- 172.21.15.7:0/1408402499 learned_addr learned my addr 172.21.15.7:0/1408402499 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:55.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.075+0000 7ff2af7fe640 1 --2- 172.21.15.7:0/1408402499 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2b0100a80 0x7ff2b0102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:55.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.075+0000 7ff2aeffd640 1 --2- 172.21.15.7:0/1408402499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2b0101420 0x7ff2b0102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:55.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.075+0000 7ff2affff640 1 -- 172.21.15.7:0/1408402499 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2b0100a80 msgr2=0x7ff2b0102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:55.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.075+0000 7ff2affff640 1 --2- 172.21.15.7:0/1408402499 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2b0100a80 0x7ff2b0102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:55.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.075+0000 7ff2affff640 1 -- 172.21.15.7:0/1408402499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2b0101420 msgr2=0x7ff2b0102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:55.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.075+0000 7ff2affff640 1 --2- 172.21.15.7:0/1408402499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2b0101420 0x7ff2b0102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:55.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.075+0000 7ff2affff640 1 -- 172.21.15.7:0/1408402499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b01a6990 con 0x7ff2b0106a80 2024-09-19T04:15:55.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.075+0000 7ff2aeffd640 1 --2- 172.21.15.7:0/1408402499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2b0101420 0x7ff2b0102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:15:55.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.075+0000 7ff2affff640 1 --2- 172.21.15.7:0/1408402499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2b0106a80 0x7ff2b01030d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff2a800cad0 tx=0x7ff2a800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:55.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.076+0000 7ff2acff9640 1 -- 172.21.15.7:0/1408402499 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a800ae20 con 0x7ff2b0106a80 2024-09-19T04:15:55.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.076+0000 7ff2acff9640 1 -- 172.21.15.7:0/1408402499 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2a8005020 con 0x7ff2b0106a80 2024-09-19T04:15:55.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.076+0000 7ff2b5e76640 1 -- 172.21.15.7:0/1408402499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2b01a6c80 con 0x7ff2b0106a80 2024-09-19T04:15:55.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.076+0000 7ff2acff9640 1 -- 172.21.15.7:0/1408402499 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a800f6f0 con 0x7ff2b0106a80 2024-09-19T04:15:55.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.076+0000 7ff2b5e76640 1 -- 172.21.15.7:0/1408402499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2b01a7170 con 0x7ff2b0106a80 2024-09-19T04:15:55.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.077+0000 7ff2b5e76640 1 -- 172.21.15.7:0/1408402499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff2b006aa20 con 0x7ff2b0106a80 2024-09-19T04:15:55.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.078+0000 7ff2acff9640 1 -- 172.21.15.7:0/1408402499 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7ff2a80051d0 con 0x7ff2b0106a80 2024-09-19T04:15:55.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.079+0000 7ff2acff9640 1 --2- 172.21.15.7:0/1408402499 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff29c0a32d0 0x7ff29c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:55.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.079+0000 7ff2acff9640 1 -- 172.21.15.7:0/1408402499 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7ff2a80d01f0 con 0x7ff2b0106a80 2024-09-19T04:15:55.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.079+0000 7ff2af7fe640 1 --2- 172.21.15.7:0/1408402499 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff29c0a32d0 0x7ff29c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:55.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.079+0000 7ff2acff9640 1 --2- 172.21.15.7:0/1408402499 >> [v2:172.21.15.7:6810/2729561132,v1:172.21.15.7:6811/2729561132] conn(0x7ff29c0ae420 0x7ff29c0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:55.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.079+0000 7ff2acff9640 1 -- 172.21.15.7:0/1408402499 --> [v2:172.21.15.7:6810/2729561132,v1:172.21.15.7:6811/2729561132] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff29c0b0f90 con 0x7ff29c0ae420 2024-09-19T04:15:55.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.079+0000 7ff2acff9640 1 -- 172.21.15.7:0/1408402499 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7ff2a80d05a0 con 0x7ff2b0106a80 2024-09-19T04:15:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.079+0000 7ff2aeffd640 1 --2- 172.21.15.7:0/1408402499 >> [v2:172.21.15.7:6810/2729561132,v1:172.21.15.7:6811/2729561132] conn(0x7ff29c0ae420 0x7ff29c0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.080+0000 7ff2af7fe640 1 --2- 172.21.15.7:0/1408402499 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff29c0a32d0 0x7ff29c0a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0009900 tx=0x7ff2a00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.080+0000 7ff2aeffd640 1 --2- 172.21.15.7:0/1408402499 >> [v2:172.21.15.7:6810/2729561132,v1:172.21.15.7:6811/2729561132] conn(0x7ff29c0ae420 0x7ff29c0b08c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.080+0000 7ff2acff9640 1 -- 172.21.15.7:0/1408402499 <== osd.3 v2:172.21.15.7:6810/2729561132 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff29c0b0f90 con 0x7ff29c0ae420 2024-09-19T04:15:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.094+0000 7ff2b5e76640 1 -- 172.21.15.7:0/1408402499 --> [v2:172.21.15.7:6810/2729561132,v1:172.21.15.7:6811/2729561132] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff2b01021c0 con 0x7ff29c0ae420 2024-09-19T04:15:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.094+0000 7ff2acff9640 1 -- 172.21.15.7:0/1408402499 <== osd.3 v2:172.21.15.7:6810/2729561132 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff2b01021c0 con 0x7ff29c0ae420 2024-09-19T04:15:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.095+0000 7ff2b5e76640 1 -- 172.21.15.7:0/1408402499 >> [v2:172.21.15.7:6810/2729561132,v1:172.21.15.7:6811/2729561132] conn(0x7ff29c0ae420 msgr2=0x7ff29c0b08c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.095+0000 7ff2b5e76640 1 --2- 172.21.15.7:0/1408402499 >> [v2:172.21.15.7:6810/2729561132,v1:172.21.15.7:6811/2729561132] conn(0x7ff29c0ae420 0x7ff29c0b08c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:55.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.095+0000 7ff2b5e76640 1 -- 172.21.15.7:0/1408402499 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff29c0a32d0 msgr2=0x7ff29c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:55.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.095+0000 7ff2b5e76640 1 --2- 172.21.15.7:0/1408402499 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff29c0a32d0 0x7ff29c0a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0009900 tx=0x7ff2a00058d0 comp rx=0 tx=0).stop 2024-09-19T04:15:55.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.095+0000 7ff2b5e76640 1 -- 172.21.15.7:0/1408402499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2b0106a80 msgr2=0x7ff2b01030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:55.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.095+0000 7ff2b5e76640 1 --2- 172.21.15.7:0/1408402499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2b0106a80 0x7ff2b01030d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff2a800cad0 tx=0x7ff2a800cf90 comp rx=0 tx=0).stop 2024-09-19T04:15:55.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.095+0000 7ff2affff640 1 -- 172.21.15.7:0/1408402499 reap_dead start 2024-09-19T04:15:55.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.095+0000 7ff2b5e76640 1 -- 172.21.15.7:0/1408402499 shutdown_connections 2024-09-19T04:15:55.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.095+0000 7ff2b5e76640 1 -- 172.21.15.7:0/1408402499 >> 172.21.15.7:0/1408402499 conn(0x7ff2b00fc7a0 msgr2=0x7ff2b0104930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:55.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.095+0000 7ff2b5e76640 1 -- 172.21.15.7:0/1408402499 shutdown_connections 2024-09-19T04:15:55.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:53.095+0000 7ff2b5e76640 1 -- 172.21.15.7:0/1408402499 wait complete. 2024-09-19T04:15:56.110 INFO:teuthology.orchestra.run.smithi007.stdout:103079215172 2024-09-19T04:15:56.111 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T04:15:56.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.653+0000 7f3a29ad1640 1 -- 172.21.15.7:0/1060364105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a24103740 msgr2=0x7f3a24107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:56.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.653+0000 7f3a29ad1640 1 --2- 172.21.15.7:0/1060364105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a24103740 0x7f3a24107b80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009930 tx=0x7f3a1802a420 comp rx=0 tx=0).stop 2024-09-19T04:15:56.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.653+0000 7f3a29ad1640 1 -- 172.21.15.7:0/1060364105 shutdown_connections 2024-09-19T04:15:56.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.653+0000 7f3a29ad1640 1 --2- 172.21.15.7:0/1060364105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a24108290 0x7f3a2410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:56.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.653+0000 7f3a29ad1640 1 --2- 172.21.15.7:0/1060364105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a24103740 0x7f3a24107b80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:56.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.653+0000 7f3a29ad1640 1 --2- 172.21.15.7:0/1060364105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a24102d90 0x7f3a24103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:56.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.653+0000 7f3a29ad1640 1 -- 172.21.15.7:0/1060364105 >> 172.21.15.7:0/1060364105 conn(0x7f3a240fc7d0 msgr2=0x7f3a240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:56.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.653+0000 7f3a29ad1640 1 -- 172.21.15.7:0/1060364105 shutdown_connections 2024-09-19T04:15:56.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.653+0000 7f3a29ad1640 1 -- 172.21.15.7:0/1060364105 wait complete. 2024-09-19T04:15:56.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.654+0000 7f3a29ad1640 1 Processor -- start 2024-09-19T04:15:56.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.654+0000 7f3a29ad1640 1 -- start start 2024-09-19T04:15:56.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.654+0000 7f3a29ad1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a24102d90 0x7f3a241a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:56.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.654+0000 7f3a29ad1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a24103740 0x7f3a241a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:56.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.654+0000 7f3a29ad1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a24108290 0x7f3a2419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:56.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.654+0000 7f3a29ad1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3a24112090 con 0x7f3a24108290 2024-09-19T04:15:56.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.654+0000 7f3a29ad1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3a24111f10 con 0x7f3a24102d90 2024-09-19T04:15:56.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.654+0000 7f3a29ad1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3a24112210 con 0x7f3a24103740 2024-09-19T04:15:56.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.655+0000 7f3a23fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a24108290 0x7f3a2419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:56.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.655+0000 7f3a23fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a24108290 0x7f3a2419a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56206/0 (socket says 172.21.15.7:56206) 2024-09-19T04:15:56.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.655+0000 7f3a23fff640 1 -- 172.21.15.7:0/1340241402 learned_addr learned my addr 172.21.15.7:0/1340241402 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:56.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.655+0000 7f3a22ffd640 1 --2- 172.21.15.7:0/1340241402 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a24103740 0x7f3a241a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:56.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.655+0000 7f3a237fe640 1 --2- 172.21.15.7:0/1340241402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a24102d90 0x7f3a241a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:56.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.655+0000 7f3a23fff640 1 -- 172.21.15.7:0/1340241402 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a24103740 msgr2=0x7f3a241a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:56.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.655+0000 7f3a23fff640 1 --2- 172.21.15.7:0/1340241402 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a24103740 0x7f3a241a0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:56.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.655+0000 7f3a23fff640 1 -- 172.21.15.7:0/1340241402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a24102d90 msgr2=0x7f3a241a0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:56.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.655+0000 7f3a23fff640 1 --2- 172.21.15.7:0/1340241402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a24102d90 0x7f3a241a0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:56.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.655+0000 7f3a23fff640 1 -- 172.21.15.7:0/1340241402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a2419acf0 con 0x7f3a24108290 2024-09-19T04:15:56.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.655+0000 7f3a23fff640 1 --2- 172.21.15.7:0/1340241402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a24108290 0x7f3a2419a5c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00eaa0 tx=0x7f3a1c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:56.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.655+0000 7f3a20ff9640 1 -- 172.21.15.7:0/1340241402 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c00cdb0 con 0x7f3a24108290 2024-09-19T04:15:56.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.655+0000 7f3a29ad1640 1 -- 172.21.15.7:0/1340241402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a2419afe0 con 0x7f3a24108290 2024-09-19T04:15:56.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.655+0000 7f3a20ff9640 1 -- 172.21.15.7:0/1340241402 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a1c005020 con 0x7f3a24108290 2024-09-19T04:15:56.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.655+0000 7f3a20ff9640 1 -- 172.21.15.7:0/1340241402 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c0116b0 con 0x7f3a24108290 2024-09-19T04:15:56.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.655+0000 7f3a29ad1640 1 -- 172.21.15.7:0/1340241402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a241a72d0 con 0x7f3a24108290 2024-09-19T04:15:56.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.656+0000 7f3a29ad1640 1 -- 172.21.15.7:0/1340241402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a24103170 con 0x7f3a24108290 2024-09-19T04:15:56.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.657+0000 7f3a20ff9640 1 -- 172.21.15.7:0/1340241402 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f3a1c005560 con 0x7f3a24108290 2024-09-19T04:15:56.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.658+0000 7f3a20ff9640 1 --2- 172.21.15.7:0/1340241402 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3a0c0a32d0 0x7f3a0c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:56.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.658+0000 7f3a20ff9640 1 -- 172.21.15.7:0/1340241402 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f3a1c0cff10 con 0x7f3a24108290 2024-09-19T04:15:56.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.658+0000 7f3a237fe640 1 --2- 172.21.15.7:0/1340241402 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3a0c0a32d0 0x7f3a0c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:56.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.659+0000 7f3a237fe640 1 --2- 172.21.15.7:0/1340241402 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3a0c0a32d0 0x7f3a0c0a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3a140058c0 tx=0x7f3a1400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:56.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.662+0000 7f3a20ff9640 1 -- 172.21.15.7:0/1340241402 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3a1c016030 con 0x7f3a24108290 2024-09-19T04:15:56.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.830+0000 7fe85139e640 1 -- 172.21.15.7:0/2323393644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe84c102380 msgr2=0x7fe84c10e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:56.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.830+0000 7fe85139e640 1 --2- 172.21.15.7:0/2323393644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe84c102380 0x7fe84c10e9c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe844009cd0 tx=0x7fe84402a8e0 comp rx=0 tx=0).stop 2024-09-19T04:15:56.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.830+0000 7fe85139e640 1 -- 172.21.15.7:0/2323393644 shutdown_connections 2024-09-19T04:15:56.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.830+0000 7fe85139e640 1 --2- 172.21.15.7:0/2323393644 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe84c102380 0x7fe84c10e9c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:56.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.830+0000 7fe85139e640 1 --2- 172.21.15.7:0/2323393644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe84c1019e0 0x7fe84c101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:56.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.830+0000 7fe85139e640 1 --2- 172.21.15.7:0/2323393644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe84c107af0 0x7fe84c107ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:56.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.830+0000 7fe85139e640 1 -- 172.21.15.7:0/2323393644 >> 172.21.15.7:0/2323393644 conn(0x7fe84c0fd700 msgr2=0x7fe84c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:56.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.830+0000 7fe85139e640 1 -- 172.21.15.7:0/2323393644 shutdown_connections 2024-09-19T04:15:56.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.830+0000 7fe85139e640 1 -- 172.21.15.7:0/2323393644 wait complete. 2024-09-19T04:15:56.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.831+0000 7fe85139e640 1 Processor -- start 2024-09-19T04:15:56.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.831+0000 7fe85139e640 1 -- start start 2024-09-19T04:15:56.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.832+0000 7fe85139e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe84c1019e0 0x7fe84c198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:56.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.832+0000 7fe85139e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe84c102380 0x7fe84c198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:56.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.832+0000 7fe85139e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe84c107af0 0x7fe84c19cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:56.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.832+0000 7fe85139e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe84c111f40 con 0x7fe84c102380 2024-09-19T04:15:56.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.832+0000 7fe85139e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe84c111dc0 con 0x7fe84c1019e0 2024-09-19T04:15:56.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.832+0000 7fe85139e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe84c1120c0 con 0x7fe84c107af0 2024-09-19T04:15:56.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.832+0000 7fe850b9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe84c107af0 0x7fe84c19cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:56.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.832+0000 7fe850b9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe84c107af0 0x7fe84c19cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:55052/0 (socket says 172.21.15.7:55052) 2024-09-19T04:15:56.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.832+0000 7fe850b9d640 1 -- 172.21.15.7:0/2583567097 learned_addr learned my addr 172.21.15.7:0/2583567097 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:56.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.832+0000 7fe84bfff640 1 --2- 172.21.15.7:0/2583567097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe84c1019e0 0x7fe84c198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:56.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.832+0000 7fe84b7fe640 1 --2- 172.21.15.7:0/2583567097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe84c102380 0x7fe84c198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:56.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.832+0000 7fe850b9d640 1 -- 172.21.15.7:0/2583567097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe84c1019e0 msgr2=0x7fe84c198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:56.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.832+0000 7fe850b9d640 1 --2- 172.21.15.7:0/2583567097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe84c1019e0 0x7fe84c198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:56.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.832+0000 7fe850b9d640 1 -- 172.21.15.7:0/2583567097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe84c102380 msgr2=0x7fe84c198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:56.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.832+0000 7fe850b9d640 1 --2- 172.21.15.7:0/2583567097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe84c102380 0x7fe84c198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:56.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.832+0000 7fe850b9d640 1 -- 172.21.15.7:0/2583567097 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe84c19d2d0 con 0x7fe84c107af0 2024-09-19T04:15:56.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.832+0000 7fe84b7fe640 1 --2- 172.21.15.7:0/2583567097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe84c102380 0x7fe84c198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:15:56.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.833+0000 7fe850b9d640 1 --2- 172.21.15.7:0/2583567097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe84c107af0 0x7fe84c19cbf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe844033040 tx=0x7fe844003970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:56.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.833+0000 7fe8497fa640 1 -- 172.21.15.7:0/2583567097 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe844004040 con 0x7fe84c107af0 2024-09-19T04:15:56.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.833+0000 7fe85139e640 1 -- 172.21.15.7:0/2583567097 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe84c19d560 con 0x7fe84c107af0 2024-09-19T04:15:56.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.833+0000 7fe8497fa640 1 -- 172.21.15.7:0/2583567097 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8440046c0 con 0x7fe84c107af0 2024-09-19T04:15:56.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.833+0000 7fe8497fa640 1 -- 172.21.15.7:0/2583567097 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe844046480 con 0x7fe84c107af0 2024-09-19T04:15:56.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.833+0000 7fe85139e640 1 -- 172.21.15.7:0/2583567097 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe84c1a4ea0 con 0x7fe84c107af0 2024-09-19T04:15:56.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.834+0000 7fe85139e640 1 -- 172.21.15.7:0/2583567097 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe84c101e40 con 0x7fe84c107af0 2024-09-19T04:15:56.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.837+0000 7fe8497fa640 1 -- 172.21.15.7:0/2583567097 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fe8440305a0 con 0x7fe84c107af0 2024-09-19T04:15:56.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.837+0000 7fe8497fa640 1 --2- 172.21.15.7:0/2583567097 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe8340a32d0 0x7fe8340a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:56.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.837+0000 7fe8497fa640 1 -- 172.21.15.7:0/2583567097 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7fe84402e030 con 0x7fe84c107af0 2024-09-19T04:15:56.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.837+0000 7fe84bfff640 1 --2- 172.21.15.7:0/2583567097 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe8340a32d0 0x7fe8340a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:56.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.838+0000 7fe84bfff640 1 --2- 172.21.15.7:0/2583567097 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe8340a32d0 0x7fe8340a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe83c00bb60 tx=0x7fe83c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:56.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.839+0000 7fe8497fa640 1 -- 172.21.15.7:0/2583567097 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe84404b060 con 0x7fe84c107af0 2024-09-19T04:15:56.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.843+0000 7f3a29ad1640 1 -- 172.21.15.7:0/1340241402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f3a2410c2b0 con 0x7f3a24108290 2024-09-19T04:15:56.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.843+0000 7f3a20ff9640 1 -- 172.21.15.7:0/1340241402 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f3a1c09c140 con 0x7f3a24108290 2024-09-19T04:15:56.844 INFO:teuthology.orchestra.run.smithi007.stdout:287762808867 2024-09-19T04:15:56.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.845+0000 7f3a29ad1640 1 -- 172.21.15.7:0/1340241402 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3a0c0a32d0 msgr2=0x7f3a0c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:56.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.845+0000 7f3a29ad1640 1 --2- 172.21.15.7:0/1340241402 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3a0c0a32d0 0x7f3a0c0a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3a140058c0 tx=0x7f3a1400a2d0 comp rx=0 tx=0).stop 2024-09-19T04:15:56.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.845+0000 7f3a29ad1640 1 -- 172.21.15.7:0/1340241402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a24108290 msgr2=0x7f3a2419a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:56.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.845+0000 7f3a29ad1640 1 --2- 172.21.15.7:0/1340241402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a24108290 0x7f3a2419a5c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00eaa0 tx=0x7f3a1c00ef60 comp rx=0 tx=0).stop 2024-09-19T04:15:56.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.845+0000 7f3a29ad1640 1 -- 172.21.15.7:0/1340241402 shutdown_connections 2024-09-19T04:15:56.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.845+0000 7f3a29ad1640 1 --2- 172.21.15.7:0/1340241402 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3a0c0a32d0 0x7f3a0c0a5790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:56.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.845+0000 7f3a29ad1640 1 --2- 172.21.15.7:0/1340241402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a24108290 0x7f3a2419a5c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:56.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.845+0000 7f3a29ad1640 1 --2- 172.21.15.7:0/1340241402 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a24103740 0x7f3a241a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:56.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.845+0000 7f3a29ad1640 1 --2- 172.21.15.7:0/1340241402 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a24102d90 0x7f3a241a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:56.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.845+0000 7f3a29ad1640 1 -- 172.21.15.7:0/1340241402 >> 172.21.15.7:0/1340241402 conn(0x7f3a240fc7d0 msgr2=0x7f3a24101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:56.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.846+0000 7f3a29ad1640 1 -- 172.21.15.7:0/1340241402 shutdown_connections 2024-09-19T04:15:56.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:56.846+0000 7f3a29ad1640 1 -- 172.21.15.7:0/1340241402 wait complete. 2024-09-19T04:15:57.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:57.022+0000 7fe85139e640 1 -- 172.21.15.7:0/2583567097 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fe84c1a5070 con 0x7fe84c107af0 2024-09-19T04:15:57.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:57.024+0000 7fe8497fa640 1 -- 172.21.15.7:0/2583567097 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe8440be2f0 con 0x7fe84c107af0 2024-09-19T04:15:57.026 INFO:teuthology.orchestra.run.smithi007.stdout:133143986240 2024-09-19T04:15:57.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:57.027+0000 7fe85139e640 1 -- 172.21.15.7:0/2583567097 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe8340a32d0 msgr2=0x7fe8340a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:57.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:57.027+0000 7fe85139e640 1 --2- 172.21.15.7:0/2583567097 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe8340a32d0 0x7fe8340a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe83c00bb60 tx=0x7fe83c00b390 comp rx=0 tx=0).stop 2024-09-19T04:15:57.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:57.027+0000 7fe85139e640 1 -- 172.21.15.7:0/2583567097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe84c107af0 msgr2=0x7fe84c19cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:57.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:57.027+0000 7fe85139e640 1 --2- 172.21.15.7:0/2583567097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe84c107af0 0x7fe84c19cbf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe844033040 tx=0x7fe844003970 comp rx=0 tx=0).stop 2024-09-19T04:15:57.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:57.027+0000 7fe85139e640 1 -- 172.21.15.7:0/2583567097 shutdown_connections 2024-09-19T04:15:57.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:57.027+0000 7fe85139e640 1 --2- 172.21.15.7:0/2583567097 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe8340a32d0 0x7fe8340a5790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:57.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:57.027+0000 7fe85139e640 1 --2- 172.21.15.7:0/2583567097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe84c107af0 0x7fe84c19cbf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:57.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:57.027+0000 7fe85139e640 1 --2- 172.21.15.7:0/2583567097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe84c102380 0x7fe84c198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:57.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:57.027+0000 7fe85139e640 1 --2- 172.21.15.7:0/2583567097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe84c1019e0 0x7fe84c198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:57.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:57.027+0000 7fe85139e640 1 -- 172.21.15.7:0/2583567097 >> 172.21.15.7:0/2583567097 conn(0x7fe84c0fd700 msgr2=0x7fe84c0fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:57.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:57.027+0000 7fe85139e640 1 -- 172.21.15.7:0/2583567097 shutdown_connections 2024-09-19T04:15:57.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:57.027+0000 7fe85139e640 1 -- 172.21.15.7:0/2583567097 wait complete. 2024-09-19T04:15:57.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:57 smithi007 ceph-mon[31360]: pgmap v323: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 223 B/s wr, 10 op/s 2024-09-19T04:15:57.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:57 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1340241402' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T04:15:57.282 INFO:teuthology.orchestra.run.smithi007.stdout:206158430256 2024-09-19T04:15:57.282 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-19T04:15:57.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:57 smithi092 ceph-mon[34940]: pgmap v323: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 223 B/s wr, 10 op/s 2024-09-19T04:15:57.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:57 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1340241402' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T04:15:57.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:57 smithi102 ceph-mon[35446]: pgmap v323: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 223 B/s wr, 10 op/s 2024-09-19T04:15:57.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:57 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1340241402' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T04:15:57.659 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972390 got 266287972391 for osd.9 2024-09-19T04:15:57.660 DEBUG:teuthology.parallel:result is None 2024-09-19T04:15:58.136 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:58 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2583567097' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T04:15:58.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.133+0000 7fc6357b8640 1 -- 172.21.15.7:0/1914417639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc63010c180 msgr2=0x7fc63010e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:58.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.133+0000 7fc6357b8640 1 --2- 172.21.15.7:0/1914417639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc63010c180 0x7fc63010e600 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc628009ca0 tx=0x7fc62802a950 comp rx=0 tx=0).stop 2024-09-19T04:15:58.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.134+0000 7fc6357b8640 1 -- 172.21.15.7:0/1914417639 shutdown_connections 2024-09-19T04:15:58.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.134+0000 7fc6357b8640 1 --2- 172.21.15.7:0/1914417639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc63010c180 0x7fc63010e600 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:58.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.134+0000 7fc6357b8640 1 --2- 172.21.15.7:0/1914417639 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6301036c0 0x7fc63010bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:58.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.134+0000 7fc6357b8640 1 --2- 172.21.15.7:0/1914417639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc630102da0 0x7fc630103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:58.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.134+0000 7fc6357b8640 1 -- 172.21.15.7:0/1914417639 >> 172.21.15.7:0/1914417639 conn(0x7fc6300fc7a0 msgr2=0x7fc6300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:58.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.134+0000 7fc6357b8640 1 -- 172.21.15.7:0/1914417639 shutdown_connections 2024-09-19T04:15:58.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.134+0000 7fc6357b8640 1 -- 172.21.15.7:0/1914417639 wait complete. 2024-09-19T04:15:58.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.134+0000 7fc6357b8640 1 Processor -- start 2024-09-19T04:15:58.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.134+0000 7fc6357b8640 1 -- start start 2024-09-19T04:15:58.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.134+0000 7fc6357b8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc630102da0 0x7fc630100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:58.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.135+0000 7fc6357b8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6301036c0 0x7fc630100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:58.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.135+0000 7fc6357b8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc63010c180 0x7fc630101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:58.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.135+0000 7fc6357b8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc630111f20 con 0x7fc63010c180 2024-09-19T04:15:58.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.135+0000 7fc6357b8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc630111da0 con 0x7fc630102da0 2024-09-19T04:15:58.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.135+0000 7fc6357b8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc6301120a0 con 0x7fc6301036c0 2024-09-19T04:15:58.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.135+0000 7fc62f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc63010c180 0x7fc630101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:58.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.135+0000 7fc62f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc63010c180 0x7fc630101480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59760/0 (socket says 172.21.15.7:59760) 2024-09-19T04:15:58.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.135+0000 7fc62f7fe640 1 -- 172.21.15.7:0/1333139103 learned_addr learned my addr 172.21.15.7:0/1333139103 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:58.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.135+0000 7fc62effd640 1 --2- 172.21.15.7:0/1333139103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc630102da0 0x7fc630100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:58.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.135+0000 7fc62e7fc640 1 --2- 172.21.15.7:0/1333139103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6301036c0 0x7fc630100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:58.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.135+0000 7fc62f7fe640 1 -- 172.21.15.7:0/1333139103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6301036c0 msgr2=0x7fc630100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:58.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.135+0000 7fc62f7fe640 1 --2- 172.21.15.7:0/1333139103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6301036c0 0x7fc630100f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:58.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.135+0000 7fc62f7fe640 1 -- 172.21.15.7:0/1333139103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc630102da0 msgr2=0x7fc630100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:58.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.135+0000 7fc62f7fe640 1 --2- 172.21.15.7:0/1333139103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc630102da0 0x7fc630100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:58.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.135+0000 7fc62f7fe640 1 -- 172.21.15.7:0/1333139103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6301a6860 con 0x7fc63010c180 2024-09-19T04:15:58.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.135+0000 7fc62f7fe640 1 --2- 172.21.15.7:0/1333139103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc63010c180 0x7fc630101480 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc62802ae70 tx=0x7fc62802f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:58.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.135+0000 7fc617fff640 1 -- 172.21.15.7:0/1333139103 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc628034040 con 0x7fc63010c180 2024-09-19T04:15:58.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.135+0000 7fc6357b8640 1 -- 172.21.15.7:0/1333139103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6301a6af0 con 0x7fc63010c180 2024-09-19T04:15:58.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.135+0000 7fc617fff640 1 -- 172.21.15.7:0/1333139103 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc628030920 con 0x7fc63010c180 2024-09-19T04:15:58.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.135+0000 7fc617fff640 1 -- 172.21.15.7:0/1333139103 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc628045480 con 0x7fc63010c180 2024-09-19T04:15:58.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.136+0000 7fc6357b8640 1 -- 172.21.15.7:0/1333139103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6301a7020 con 0x7fc63010c180 2024-09-19T04:15:58.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.136+0000 7fc6357b8640 1 -- 172.21.15.7:0/1333139103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc630062880 con 0x7fc63010c180 2024-09-19T04:15:58.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.138+0000 7fc617fff640 1 -- 172.21.15.7:0/1333139103 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fc628037020 con 0x7fc63010c180 2024-09-19T04:15:58.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.138+0000 7fc617fff640 1 --2- 172.21.15.7:0/1333139103 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc6180a32d0 0x7fc6180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:58.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.139+0000 7fc62effd640 1 --2- 172.21.15.7:0/1333139103 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc6180a32d0 0x7fc6180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:58.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.139+0000 7fc617fff640 1 -- 172.21.15.7:0/1333139103 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7fc6280f1000 con 0x7fc63010c180 2024-09-19T04:15:58.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.139+0000 7fc617fff640 1 --2- 172.21.15.7:0/1333139103 >> [v2:172.21.15.7:6802/240599233,v1:172.21.15.7:6803/240599233] conn(0x7fc6180ae420 0x7fc6180b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:58.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.139+0000 7fc617fff640 1 -- 172.21.15.7:0/1333139103 --> [v2:172.21.15.7:6802/240599233,v1:172.21.15.7:6803/240599233] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc628038e50 con 0x7fc6180ae420 2024-09-19T04:15:58.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.139+0000 7fc617fff640 1 -- 172.21.15.7:0/1333139103 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7fc6280f1450 con 0x7fc63010c180 2024-09-19T04:15:58.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.139+0000 7fc62e7fc640 1 --2- 172.21.15.7:0/1333139103 >> [v2:172.21.15.7:6802/240599233,v1:172.21.15.7:6803/240599233] conn(0x7fc6180ae420 0x7fc6180b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:58.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.139+0000 7fc62effd640 1 --2- 172.21.15.7:0/1333139103 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc6180a32d0 0x7fc6180a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc62400bbe0 tx=0x7fc62400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:58.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.139+0000 7fc62e7fc640 1 --2- 172.21.15.7:0/1333139103 >> [v2:172.21.15.7:6802/240599233,v1:172.21.15.7:6803/240599233] conn(0x7fc6180ae420 0x7fc6180b08c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:58.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.140+0000 7fc617fff640 1 -- 172.21.15.7:0/1333139103 <== osd.0 v2:172.21.15.7:6802/240599233 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc628038e50 con 0x7fc6180ae420 2024-09-19T04:15:58.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.154+0000 7fc6357b8640 1 -- 172.21.15.7:0/1333139103 --> [v2:172.21.15.7:6802/240599233,v1:172.21.15.7:6803/240599233] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc630062cb0 con 0x7fc6180ae420 2024-09-19T04:15:58.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.154+0000 7fc617fff640 1 -- 172.21.15.7:0/1333139103 <== osd.0 v2:172.21.15.7:6802/240599233 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc630062cb0 con 0x7fc6180ae420 2024-09-19T04:15:58.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.154+0000 7fc6357b8640 1 -- 172.21.15.7:0/1333139103 >> [v2:172.21.15.7:6802/240599233,v1:172.21.15.7:6803/240599233] conn(0x7fc6180ae420 msgr2=0x7fc6180b08c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:58.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.154+0000 7fc6357b8640 1 --2- 172.21.15.7:0/1333139103 >> [v2:172.21.15.7:6802/240599233,v1:172.21.15.7:6803/240599233] conn(0x7fc6180ae420 0x7fc6180b08c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:58.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.154+0000 7fc6357b8640 1 -- 172.21.15.7:0/1333139103 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc6180a32d0 msgr2=0x7fc6180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:58.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.154+0000 7fc6357b8640 1 --2- 172.21.15.7:0/1333139103 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc6180a32d0 0x7fc6180a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc62400bbe0 tx=0x7fc62400b390 comp rx=0 tx=0).stop 2024-09-19T04:15:58.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.154+0000 7fc6357b8640 1 -- 172.21.15.7:0/1333139103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc63010c180 msgr2=0x7fc630101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:58.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.154+0000 7fc6357b8640 1 --2- 172.21.15.7:0/1333139103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc63010c180 0x7fc630101480 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc62802ae70 tx=0x7fc62802f5b0 comp rx=0 tx=0).stop 2024-09-19T04:15:58.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.154+0000 7fc62f7fe640 1 -- 172.21.15.7:0/1333139103 reap_dead start 2024-09-19T04:15:58.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.154+0000 7fc6357b8640 1 -- 172.21.15.7:0/1333139103 shutdown_connections 2024-09-19T04:15:58.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.154+0000 7fc6357b8640 1 -- 172.21.15.7:0/1333139103 >> 172.21.15.7:0/1333139103 conn(0x7fc6300fc7a0 msgr2=0x7fc6300fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:58.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.154+0000 7fc6357b8640 1 -- 172.21.15.7:0/1333139103 shutdown_connections 2024-09-19T04:15:58.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.154+0000 7fc6357b8640 1 -- 172.21.15.7:0/1333139103 wait complete. 2024-09-19T04:15:58.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:58 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2583567097' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T04:15:58.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:58 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2583567097' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T04:15:58.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.724+0000 7f9f5f7b0640 1 -- 172.21.15.7:0/2002183018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f58106a80 msgr2=0x7f9f58106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:58.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.724+0000 7f9f5f7b0640 1 --2- 172.21.15.7:0/2002183018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f58106a80 0x7f9f58106e60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9f54009930 tx=0x7f9f5402a420 comp rx=0 tx=0).stop 2024-09-19T04:15:58.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.724+0000 7f9f5f7b0640 1 -- 172.21.15.7:0/2002183018 shutdown_connections 2024-09-19T04:15:58.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.724+0000 7f9f5f7b0640 1 --2- 172.21.15.7:0/2002183018 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f58101420 0x7f9f5810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:58.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.724+0000 7f9f5f7b0640 1 --2- 172.21.15.7:0/2002183018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f58100a80 0x7f9f58100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:58.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.724+0000 7f9f5f7b0640 1 --2- 172.21.15.7:0/2002183018 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f58106a80 0x7f9f58106e60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:58.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.724+0000 7f9f5f7b0640 1 -- 172.21.15.7:0/2002183018 >> 172.21.15.7:0/2002183018 conn(0x7f9f580fc7a0 msgr2=0x7f9f580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:58.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.724+0000 7f9f5f7b0640 1 -- 172.21.15.7:0/2002183018 shutdown_connections 2024-09-19T04:15:58.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.724+0000 7f9f5f7b0640 1 -- 172.21.15.7:0/2002183018 wait complete. 2024-09-19T04:15:58.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.725+0000 7f9f5f7b0640 1 Processor -- start 2024-09-19T04:15:58.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.725+0000 7f9f5f7b0640 1 -- start start 2024-09-19T04:15:58.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.725+0000 7f9f5f7b0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f58100a80 0x7f9f581984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:58.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.725+0000 7f9f5f7b0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f58101420 0x7f9f58198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:58.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.725+0000 7f9f5f7b0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f58106a80 0x7f9f5819cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:58.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.725+0000 7f9f5f7b0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9f58111fa0 con 0x7f9f58100a80 2024-09-19T04:15:58.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.725+0000 7f9f5f7b0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9f58111e20 con 0x7f9f58106a80 2024-09-19T04:15:58.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.725+0000 7f9f5f7b0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9f58112120 con 0x7f9f58101420 2024-09-19T04:15:58.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.725+0000 7f9f5d54c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f58100a80 0x7f9f581984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:58.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.725+0000 7f9f5d54c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f58100a80 0x7f9f581984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59764/0 (socket says 172.21.15.7:59764) 2024-09-19T04:15:58.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.725+0000 7f9f5d54c640 1 -- 172.21.15.7:0/2357197176 learned_addr learned my addr 172.21.15.7:0/2357197176 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:58.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.726+0000 7f9f5cd4b640 1 --2- 172.21.15.7:0/2357197176 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f58101420 0x7f9f58198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:58.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.726+0000 7f9f5dd4d640 1 --2- 172.21.15.7:0/2357197176 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f58106a80 0x7f9f5819cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:58.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.726+0000 7f9f5d54c640 1 -- 172.21.15.7:0/2357197176 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f58101420 msgr2=0x7f9f58198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:58.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.726+0000 7f9f5d54c640 1 --2- 172.21.15.7:0/2357197176 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f58101420 0x7f9f58198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:58.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.726+0000 7f9f5d54c640 1 -- 172.21.15.7:0/2357197176 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f58106a80 msgr2=0x7f9f5819cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:58.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.726+0000 7f9f5d54c640 1 --2- 172.21.15.7:0/2357197176 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f58106a80 0x7f9f5819cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:58.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.726+0000 7f9f5d54c640 1 -- 172.21.15.7:0/2357197176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f5819d470 con 0x7f9f58100a80 2024-09-19T04:15:58.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.726+0000 7f9f5dd4d640 1 --2- 172.21.15.7:0/2357197176 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f58106a80 0x7f9f5819cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:15:58.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.726+0000 7f9f5d54c640 1 --2- 172.21.15.7:0/2357197176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f58100a80 0x7f9f581984c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9f54009230 tx=0x7f9f54004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:58.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.726+0000 7f9f4e7fc640 1 -- 172.21.15.7:0/2357197176 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f5403f030 con 0x7f9f58100a80 2024-09-19T04:15:58.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.726+0000 7f9f4e7fc640 1 -- 172.21.15.7:0/2357197176 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f54004440 con 0x7f9f58100a80 2024-09-19T04:15:58.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.726+0000 7f9f5f7b0640 1 -- 172.21.15.7:0/2357197176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f5819d700 con 0x7f9f58100a80 2024-09-19T04:15:58.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.726+0000 7f9f4e7fc640 1 -- 172.21.15.7:0/2357197176 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f54035070 con 0x7f9f58100a80 2024-09-19T04:15:58.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.726+0000 7f9f5f7b0640 1 -- 172.21.15.7:0/2357197176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f581a5040 con 0x7f9f58100a80 2024-09-19T04:15:58.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.727+0000 7f9f5f7b0640 1 -- 172.21.15.7:0/2357197176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f581021c0 con 0x7f9f58100a80 2024-09-19T04:15:58.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.728+0000 7f9f4e7fc640 1 -- 172.21.15.7:0/2357197176 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f9f54042030 con 0x7f9f58100a80 2024-09-19T04:15:58.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.729+0000 7f9f4e7fc640 1 --2- 172.21.15.7:0/2357197176 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9f440a32d0 0x7f9f440a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:58.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.729+0000 7f9f4e7fc640 1 -- 172.21.15.7:0/2357197176 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f9f540efdf0 con 0x7f9f58100a80 2024-09-19T04:15:58.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.729+0000 7f9f5cd4b640 1 --2- 172.21.15.7:0/2357197176 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9f440a32d0 0x7f9f440a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:58.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.730+0000 7f9f5cd4b640 1 --2- 172.21.15.7:0/2357197176 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9f440a32d0 0x7f9f440a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9f580fedc0 tx=0x7f9f48005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:58.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.733+0000 7f9f4e7fc640 1 -- 172.21.15.7:0/2357197176 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9f540bc670 con 0x7f9f58100a80 2024-09-19T04:15:58.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.911+0000 7f9f5f7b0640 1 -- 172.21.15.7:0/2357197176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f9f58100ee0 con 0x7f9f58100a80 2024-09-19T04:15:58.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.912+0000 7f9f4e7fc640 1 -- 172.21.15.7:0/2357197176 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9f540bbf70 con 0x7f9f58100a80 2024-09-19T04:15:58.913 INFO:teuthology.orchestra.run.smithi007.stdout:77309411403 2024-09-19T04:15:58.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.914+0000 7f9f5f7b0640 1 -- 172.21.15.7:0/2357197176 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9f440a32d0 msgr2=0x7f9f440a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:58.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.914+0000 7f9f5f7b0640 1 --2- 172.21.15.7:0/2357197176 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9f440a32d0 0x7f9f440a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9f580fedc0 tx=0x7f9f48005f90 comp rx=0 tx=0).stop 2024-09-19T04:15:58.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.914+0000 7f9f5f7b0640 1 -- 172.21.15.7:0/2357197176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f58100a80 msgr2=0x7f9f581984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:58.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.914+0000 7f9f5f7b0640 1 --2- 172.21.15.7:0/2357197176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f58100a80 0x7f9f581984c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9f54009230 tx=0x7f9f54004040 comp rx=0 tx=0).stop 2024-09-19T04:15:58.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.914+0000 7f9f5f7b0640 1 -- 172.21.15.7:0/2357197176 shutdown_connections 2024-09-19T04:15:58.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.914+0000 7f9f5f7b0640 1 --2- 172.21.15.7:0/2357197176 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9f440a32d0 0x7f9f440a5790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:58.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.914+0000 7f9f5f7b0640 1 --2- 172.21.15.7:0/2357197176 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f58106a80 0x7f9f5819cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:58.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.914+0000 7f9f5f7b0640 1 --2- 172.21.15.7:0/2357197176 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9f58101420 0x7f9f58198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:58.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.914+0000 7f9f5f7b0640 1 --2- 172.21.15.7:0/2357197176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f58100a80 0x7f9f581984c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:58.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.914+0000 7f9f5f7b0640 1 -- 172.21.15.7:0/2357197176 >> 172.21.15.7:0/2357197176 conn(0x7f9f580fc7a0 msgr2=0x7f9f580fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:58.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.914+0000 7f9f5f7b0640 1 -- 172.21.15.7:0/2357197176 shutdown_connections 2024-09-19T04:15:58.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.914+0000 7f9f5f7b0640 1 -- 172.21.15.7:0/2357197176 wait complete. 2024-09-19T04:15:58.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.959+0000 7f5be5812640 1 -- 172.21.15.7:0/2416105716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5be0106a80 msgr2=0x7f5be0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:58.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.959+0000 7f5be5812640 1 --2- 172.21.15.7:0/2416105716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5be0106a80 0x7f5be0106e60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5bd0009930 tx=0x7f5bd002a420 comp rx=0 tx=0).stop 2024-09-19T04:15:58.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.959+0000 7f5be5812640 1 -- 172.21.15.7:0/2416105716 shutdown_connections 2024-09-19T04:15:58.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.959+0000 7f5be5812640 1 --2- 172.21.15.7:0/2416105716 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5be0101420 0x7f5be010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:58.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.959+0000 7f5be5812640 1 --2- 172.21.15.7:0/2416105716 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5be0100a80 0x7f5be0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:58.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.959+0000 7f5be5812640 1 --2- 172.21.15.7:0/2416105716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5be0106a80 0x7f5be0106e60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:58.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.959+0000 7f5be5812640 1 -- 172.21.15.7:0/2416105716 >> 172.21.15.7:0/2416105716 conn(0x7f5be00fc7a0 msgr2=0x7f5be00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:58.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.959+0000 7f5be5812640 1 -- 172.21.15.7:0/2416105716 shutdown_connections 2024-09-19T04:15:58.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.959+0000 7f5be5812640 1 -- 172.21.15.7:0/2416105716 wait complete. 2024-09-19T04:15:58.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.960+0000 7f5be5812640 1 Processor -- start 2024-09-19T04:15:58.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.960+0000 7f5be5812640 1 -- start start 2024-09-19T04:15:58.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.960+0000 7f5be5812640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5be0100a80 0x7f5be0197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:58.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.960+0000 7f5be5812640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5be0101420 0x7f5be0197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:58.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.960+0000 7f5be5812640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5be0106a80 0x7f5be019bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:58.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.960+0000 7f5be5812640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5be0110ed0 con 0x7f5be0100a80 2024-09-19T04:15:58.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.960+0000 7f5be5812640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5be0110d50 con 0x7f5be0106a80 2024-09-19T04:15:58.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.960+0000 7f5be5812640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5be0111050 con 0x7f5be0101420 2024-09-19T04:15:58.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.960+0000 7f5bdeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5be0100a80 0x7f5be0197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:58.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.960+0000 7f5bdeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5be0100a80 0x7f5be0197350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59780/0 (socket says 172.21.15.7:59780) 2024-09-19T04:15:58.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.960+0000 7f5bdeffd640 1 -- 172.21.15.7:0/943579030 learned_addr learned my addr 172.21.15.7:0/943579030 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:15:58.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.960+0000 7f5bde7fc640 1 --2- 172.21.15.7:0/943579030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5be0101420 0x7f5be0197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:58.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.961+0000 7f5bdf7fe640 1 --2- 172.21.15.7:0/943579030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5be0106a80 0x7f5be019bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:58.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.961+0000 7f5bdeffd640 1 -- 172.21.15.7:0/943579030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5be0101420 msgr2=0x7f5be0197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:58.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.961+0000 7f5bdeffd640 1 --2- 172.21.15.7:0/943579030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5be0101420 0x7f5be0197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:58.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.961+0000 7f5bdeffd640 1 -- 172.21.15.7:0/943579030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5be0106a80 msgr2=0x7f5be019bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:58.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.961+0000 7f5bdeffd640 1 --2- 172.21.15.7:0/943579030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5be0106a80 0x7f5be019bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:58.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.961+0000 7f5bdeffd640 1 -- 172.21.15.7:0/943579030 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be019c300 con 0x7f5be0100a80 2024-09-19T04:15:58.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.961+0000 7f5bdf7fe640 1 --2- 172.21.15.7:0/943579030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5be0106a80 0x7f5be019bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:15:58.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.961+0000 7f5bdeffd640 1 --2- 172.21.15.7:0/943579030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5be0100a80 0x7f5be0197350 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5bd002a940 tx=0x7f5bd0003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:58.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.961+0000 7f5be4810640 1 -- 172.21.15.7:0/943579030 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd003f070 con 0x7f5be0100a80 2024-09-19T04:15:58.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.961+0000 7f5be5812640 1 -- 172.21.15.7:0/943579030 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5be019c590 con 0x7f5be0100a80 2024-09-19T04:15:58.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.961+0000 7f5be4810640 1 -- 172.21.15.7:0/943579030 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bd0031c90 con 0x7f5be0100a80 2024-09-19T04:15:58.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.961+0000 7f5be4810640 1 -- 172.21.15.7:0/943579030 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd0035030 con 0x7f5be0100a80 2024-09-19T04:15:58.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.961+0000 7f5be5812640 1 -- 172.21.15.7:0/943579030 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5be01a3ed0 con 0x7f5be0100a80 2024-09-19T04:15:58.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.962+0000 7f5be5812640 1 -- 172.21.15.7:0/943579030 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5be01021c0 con 0x7f5be0100a80 2024-09-19T04:15:58.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.964+0000 7f5be4810640 1 -- 172.21.15.7:0/943579030 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f5bd0042070 con 0x7f5be0100a80 2024-09-19T04:15:58.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.964+0000 7f5be4810640 1 --2- 172.21.15.7:0/943579030 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f5bc80a32d0 0x7f5bc80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:15:58.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.964+0000 7f5bde7fc640 1 --2- 172.21.15.7:0/943579030 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f5bc80a32d0 0x7f5bc80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:15:58.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.964+0000 7f5be4810640 1 -- 172.21.15.7:0/943579030 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f5bd00f0c00 con 0x7f5be0100a80 2024-09-19T04:15:58.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.965+0000 7f5bde7fc640 1 --2- 172.21.15.7:0/943579030 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f5bc80a32d0 0x7f5bc80a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5be01060c0 tx=0x7f5bd4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:15:58.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:58.968+0000 7f5be4810640 1 -- 172.21.15.7:0/943579030 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5bd00bd480 con 0x7f5be0100a80 2024-09-19T04:15:59.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:59.144+0000 7f5be5812640 1 -- 172.21.15.7:0/943579030 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f5be0108ff0 con 0x7f5be0100a80 2024-09-19T04:15:59.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:59.145+0000 7f5be4810640 1 -- 172.21.15.7:0/943579030 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5bd00bcd80 con 0x7f5be0100a80 2024-09-19T04:15:59.146 INFO:teuthology.orchestra.run.smithi007.stdout:55834574927 2024-09-19T04:15:59.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:59.146+0000 7f5be5812640 1 -- 172.21.15.7:0/943579030 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f5bc80a32d0 msgr2=0x7f5bc80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:59.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:59.146+0000 7f5be5812640 1 --2- 172.21.15.7:0/943579030 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f5bc80a32d0 0x7f5bc80a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5be01060c0 tx=0x7f5bd4005f90 comp rx=0 tx=0).stop 2024-09-19T04:15:59.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:59.146+0000 7f5be5812640 1 -- 172.21.15.7:0/943579030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5be0100a80 msgr2=0x7f5be0197350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:15:59.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:59.146+0000 7f5be5812640 1 --2- 172.21.15.7:0/943579030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5be0100a80 0x7f5be0197350 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5bd002a940 tx=0x7f5bd0003b90 comp rx=0 tx=0).stop 2024-09-19T04:15:59.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:59.147+0000 7f5be5812640 1 -- 172.21.15.7:0/943579030 shutdown_connections 2024-09-19T04:15:59.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:59.147+0000 7f5be5812640 1 --2- 172.21.15.7:0/943579030 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f5bc80a32d0 0x7f5bc80a5790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:59.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:59.147+0000 7f5be5812640 1 --2- 172.21.15.7:0/943579030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5be0106a80 0x7f5be019bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:59.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:59.147+0000 7f5be5812640 1 --2- 172.21.15.7:0/943579030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5be0101420 0x7f5be0197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:59.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:59.147+0000 7f5be5812640 1 --2- 172.21.15.7:0/943579030 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5be0100a80 0x7f5be0197350 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:15:59.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:59.147+0000 7f5be5812640 1 -- 172.21.15.7:0/943579030 >> 172.21.15.7:0/943579030 conn(0x7f5be00fc7a0 msgr2=0x7f5be00fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:15:59.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:59.147+0000 7f5be5812640 1 -- 172.21.15.7:0/943579030 shutdown_connections 2024-09-19T04:15:59.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:15:59.147+0000 7f5be5812640 1 -- 172.21.15.7:0/943579030 wait complete. 2024-09-19T04:15:59.176 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:59 smithi007 ceph-mon[31360]: pgmap v324: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 201 B/s wr, 9 op/s 2024-09-19T04:15:59.176 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:15:59 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2357197176' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T04:15:59.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:59 smithi092 ceph-mon[34940]: pgmap v324: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 201 B/s wr, 9 op/s 2024-09-19T04:15:59.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:15:59 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2357197176' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T04:15:59.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:59 smithi102 ceph-mon[35446]: pgmap v324: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 201 B/s wr, 9 op/s 2024-09-19T04:15:59.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:15:59 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2357197176' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T04:15:59.854 INFO:teuthology.orchestra.run.smithi007.stdout:34359738453 2024-09-19T04:15:59.854 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T04:16:00.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:00 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/943579030' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T04:16:00.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:00 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/943579030' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T04:16:00.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:00 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/943579030' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T04:16:00.465 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411400 got 77309411403 for osd.2 2024-09-19T04:16:00.465 DEBUG:teuthology.parallel:result is None 2024-09-19T04:16:00.933 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986238 got 133143986240 for osd.4 2024-09-19T04:16:00.933 DEBUG:teuthology.parallel:result is None 2024-09-19T04:16:01.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:01 smithi092 ceph-mon[34940]: pgmap v325: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-19T04:16:01.346 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:01 smithi007 ceph-mon[31360]: pgmap v325: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-19T04:16:01.375 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808865 got 287762808867 for osd.10 2024-09-19T04:16:01.376 DEBUG:teuthology.parallel:result is None 2024-09-19T04:16:01.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:01 smithi102 ceph-mon[35446]: pgmap v325: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-19T04:16:01.847 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:01.855 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574925 got 55834574927 for osd.1 2024-09-19T04:16:01.855 DEBUG:teuthology.parallel:result is None 2024-09-19T04:16:01.866 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:01.890 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:02.324 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:02.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.523+0000 7f1e628cd640 1 -- 172.21.15.7:0/3155963177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e5c101400 msgr2=0x7f1e5c10d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:02.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.523+0000 7f1e628cd640 1 --2- 172.21.15.7:0/3155963177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e5c101400 0x7f1e5c10d930 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1e54009cd0 tx=0x7f1e5402a8e0 comp rx=0 tx=0).stop 2024-09-19T04:16:02.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.523+0000 7f1e628cd640 1 -- 172.21.15.7:0/3155963177 shutdown_connections 2024-09-19T04:16:02.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.523+0000 7f1e628cd640 1 --2- 172.21.15.7:0/3155963177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e5c101400 0x7f1e5c10d930 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:02.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.523+0000 7f1e628cd640 1 --2- 172.21.15.7:0/3155963177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e5c100a60 0x7f1e5c100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:02.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.523+0000 7f1e628cd640 1 --2- 172.21.15.7:0/3155963177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e5c106a60 0x7f1e5c106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:02.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.523+0000 7f1e628cd640 1 -- 172.21.15.7:0/3155963177 >> 172.21.15.7:0/3155963177 conn(0x7f1e5c0fc780 msgr2=0x7f1e5c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:02.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.523+0000 7f1e628cd640 1 -- 172.21.15.7:0/3155963177 shutdown_connections 2024-09-19T04:16:02.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.523+0000 7f1e628cd640 1 -- 172.21.15.7:0/3155963177 wait complete. 2024-09-19T04:16:02.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.523+0000 7f1e628cd640 1 Processor -- start 2024-09-19T04:16:02.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.523+0000 7f1e628cd640 1 -- start start 2024-09-19T04:16:02.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.524+0000 7f1e628cd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e5c100a60 0x7f1e5c10e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:02.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.524+0000 7f1e628cd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e5c101400 0x7f1e5c10e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:02.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.524+0000 7f1e628cd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e5c106a60 0x7f1e5c10ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:02.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.524+0000 7f1e628cd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5c111f80 con 0x7f1e5c101400 2024-09-19T04:16:02.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.524+0000 7f1e628cd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5c111e00 con 0x7f1e5c100a60 2024-09-19T04:16:02.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.524+0000 7f1e628cd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5c112100 con 0x7f1e5c106a60 2024-09-19T04:16:02.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.524+0000 7f1e5b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e5c101400 0x7f1e5c10e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:02.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.524+0000 7f1e5b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e5c101400 0x7f1e5c10e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59808/0 (socket says 172.21.15.7:59808) 2024-09-19T04:16:02.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.524+0000 7f1e5b7fe640 1 -- 172.21.15.7:0/3991454518 learned_addr learned my addr 172.21.15.7:0/3991454518 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:02.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.524+0000 7f1e60e6a640 1 --2- 172.21.15.7:0/3991454518 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e5c106a60 0x7f1e5c10ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:02.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.524+0000 7f1e5bfff640 1 --2- 172.21.15.7:0/3991454518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e5c100a60 0x7f1e5c10e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:02.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.524+0000 7f1e5b7fe640 1 -- 172.21.15.7:0/3991454518 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e5c106a60 msgr2=0x7f1e5c10ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:02.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.524+0000 7f1e5b7fe640 1 --2- 172.21.15.7:0/3991454518 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e5c106a60 0x7f1e5c10ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:02.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.524+0000 7f1e5b7fe640 1 -- 172.21.15.7:0/3991454518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e5c100a60 msgr2=0x7f1e5c10e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:02.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.524+0000 7f1e5b7fe640 1 --2- 172.21.15.7:0/3991454518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e5c100a60 0x7f1e5c10e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:02.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.524+0000 7f1e5b7fe640 1 -- 172.21.15.7:0/3991454518 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e5c1a68c0 con 0x7f1e5c101400 2024-09-19T04:16:02.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.524+0000 7f1e5bfff640 1 --2- 172.21.15.7:0/3991454518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e5c100a60 0x7f1e5c10e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:16:02.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.524+0000 7f1e5b7fe640 1 --2- 172.21.15.7:0/3991454518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e5c101400 0x7f1e5c10e900 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1e5000e9f0 tx=0x7f1e5000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:02.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.525+0000 7f1e597fa640 1 -- 172.21.15.7:0/3991454518 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5000cd80 con 0x7f1e5c101400 2024-09-19T04:16:02.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.525+0000 7f1e597fa640 1 -- 172.21.15.7:0/3991454518 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e50010910 con 0x7f1e5c101400 2024-09-19T04:16:02.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.525+0000 7f1e628cd640 1 -- 172.21.15.7:0/3991454518 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e5c1a6bb0 con 0x7f1e5c101400 2024-09-19T04:16:02.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.525+0000 7f1e597fa640 1 -- 172.21.15.7:0/3991454518 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e50018990 con 0x7f1e5c101400 2024-09-19T04:16:02.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.525+0000 7f1e628cd640 1 -- 172.21.15.7:0/3991454518 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e5c1a70f0 con 0x7f1e5c101400 2024-09-19T04:16:02.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.526+0000 7f1e628cd640 1 -- 172.21.15.7:0/3991454518 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e5c100ec0 con 0x7f1e5c101400 2024-09-19T04:16:02.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.527+0000 7f1e597fa640 1 -- 172.21.15.7:0/3991454518 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f1e50010ac0 con 0x7f1e5c101400 2024-09-19T04:16:02.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.527+0000 7f1e597fa640 1 --2- 172.21.15.7:0/3991454518 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1e440a32d0 0x7f1e440a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:02.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.528+0000 7f1e5bfff640 1 --2- 172.21.15.7:0/3991454518 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1e440a32d0 0x7f1e440a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:02.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.528+0000 7f1e597fa640 1 -- 172.21.15.7:0/3991454518 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f1e500d0230 con 0x7f1e5c101400 2024-09-19T04:16:02.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.528+0000 7f1e5bfff640 1 --2- 172.21.15.7:0/3991454518 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1e440a32d0 0x7f1e440a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c005e00 tx=0x7f1e4c005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:02.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.532+0000 7f1e597fa640 1 -- 172.21.15.7:0/3991454518 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1e5009cab0 con 0x7f1e5c101400 2024-09-19T04:16:02.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.710+0000 7f1e628cd640 1 -- 172.21.15.7:0/3991454518 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f1e5c10f8f0 con 0x7f1e5c101400 2024-09-19T04:16:02.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.710+0000 7f1e597fa640 1 -- 172.21.15.7:0/3991454518 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f1e5009c3b0 con 0x7f1e5c101400 2024-09-19T04:16:02.712 INFO:teuthology.orchestra.run.smithi007.stdout:317827579935 2024-09-19T04:16:02.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.714+0000 7f1e628cd640 1 -- 172.21.15.7:0/3991454518 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1e440a32d0 msgr2=0x7f1e440a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:02.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.714+0000 7f1e628cd640 1 --2- 172.21.15.7:0/3991454518 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1e440a32d0 0x7f1e440a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c005e00 tx=0x7f1e4c005c70 comp rx=0 tx=0).stop 2024-09-19T04:16:02.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.714+0000 7f1e628cd640 1 -- 172.21.15.7:0/3991454518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e5c101400 msgr2=0x7f1e5c10e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:02.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.714+0000 7f1e628cd640 1 --2- 172.21.15.7:0/3991454518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e5c101400 0x7f1e5c10e900 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1e5000e9f0 tx=0x7f1e5000eeb0 comp rx=0 tx=0).stop 2024-09-19T04:16:02.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.714+0000 7f1e628cd640 1 -- 172.21.15.7:0/3991454518 shutdown_connections 2024-09-19T04:16:02.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.714+0000 7f1e628cd640 1 --2- 172.21.15.7:0/3991454518 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1e440a32d0 0x7f1e440a5790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:02.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.714+0000 7f1e628cd640 1 --2- 172.21.15.7:0/3991454518 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e5c106a60 0x7f1e5c10ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:02.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.714+0000 7f1e628cd640 1 --2- 172.21.15.7:0/3991454518 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e5c101400 0x7f1e5c10e900 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:02.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.714+0000 7f1e628cd640 1 --2- 172.21.15.7:0/3991454518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e5c100a60 0x7f1e5c10e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:02.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.714+0000 7f1e628cd640 1 -- 172.21.15.7:0/3991454518 >> 172.21.15.7:0/3991454518 conn(0x7f1e5c0fc780 msgr2=0x7f1e5c0fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:02.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.714+0000 7f1e628cd640 1 -- 172.21.15.7:0/3991454518 shutdown_connections 2024-09-19T04:16:02.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.714+0000 7f1e628cd640 1 -- 172.21.15.7:0/3991454518 wait complete. 2024-09-19T04:16:02.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.726+0000 7f9c781f3640 1 -- 172.21.15.7:0/1648736076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c701036e0 msgr2=0x7f9c70107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:02.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.726+0000 7f9c781f3640 1 --2- 172.21.15.7:0/1648736076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c701036e0 0x7f9c70107b90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9c60009930 tx=0x7f9c6002a420 comp rx=0 tx=0).stop 2024-09-19T04:16:02.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.726+0000 7f9c781f3640 1 -- 172.21.15.7:0/1648736076 shutdown_connections 2024-09-19T04:16:02.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.726+0000 7f9c781f3640 1 --2- 172.21.15.7:0/1648736076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c701082a0 0x7f9c7010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:02.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.726+0000 7f9c781f3640 1 --2- 172.21.15.7:0/1648736076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c701036e0 0x7f9c70107b90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:02.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.726+0000 7f9c781f3640 1 --2- 172.21.15.7:0/1648736076 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c70102d30 0x7f9c70103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:02.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.726+0000 7f9c781f3640 1 -- 172.21.15.7:0/1648736076 >> 172.21.15.7:0/1648736076 conn(0x7f9c700fc7d0 msgr2=0x7f9c700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:02.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.726+0000 7f9c781f3640 1 -- 172.21.15.7:0/1648736076 shutdown_connections 2024-09-19T04:16:02.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.726+0000 7f9c781f3640 1 -- 172.21.15.7:0/1648736076 wait complete. 2024-09-19T04:16:02.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.727+0000 7f9c781f3640 1 Processor -- start 2024-09-19T04:16:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.727+0000 7f9c781f3640 1 -- start start 2024-09-19T04:16:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.727+0000 7f9c781f3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c70102d30 0x7f9c70198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.727+0000 7f9c781f3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c701036e0 0x7f9c70198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.727+0000 7f9c781f3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c701082a0 0x7f9c7019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.727+0000 7f9c781f3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9c701120a0 con 0x7f9c701036e0 2024-09-19T04:16:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.727+0000 7f9c781f3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9c70111f20 con 0x7f9c70102d30 2024-09-19T04:16:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.727+0000 7f9c781f3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9c70112220 con 0x7f9c701082a0 2024-09-19T04:16:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.728+0000 7f9c7578e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c701036e0 0x7f9c70198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.728+0000 7f9c7578e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c701036e0 0x7f9c70198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59824/0 (socket says 172.21.15.7:59824) 2024-09-19T04:16:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.728+0000 7f9c7578e640 1 -- 172.21.15.7:0/2882095463 learned_addr learned my addr 172.21.15.7:0/2882095463 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.728+0000 7f9c76790640 1 --2- 172.21.15.7:0/2882095463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c701082a0 0x7f9c7019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.728+0000 7f9c75f8f640 1 --2- 172.21.15.7:0/2882095463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c70102d30 0x7f9c70198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:02.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.728+0000 7f9c7578e640 1 -- 172.21.15.7:0/2882095463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c701082a0 msgr2=0x7f9c7019ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:02.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.728+0000 7f9c7578e640 1 --2- 172.21.15.7:0/2882095463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c701082a0 0x7f9c7019ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:02.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.728+0000 7f9c7578e640 1 -- 172.21.15.7:0/2882095463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c70102d30 msgr2=0x7f9c70198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:02.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.728+0000 7f9c7578e640 1 --2- 172.21.15.7:0/2882095463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c70102d30 0x7f9c70198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:02.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.728+0000 7f9c7578e640 1 -- 172.21.15.7:0/2882095463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c7019d530 con 0x7f9c701036e0 2024-09-19T04:16:02.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.728+0000 7f9c7578e640 1 --2- 172.21.15.7:0/2882095463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c701036e0 0x7f9c70198ac0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9c60005940 tx=0x7f9c600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:02.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.728+0000 7f9c66ffd640 1 -- 172.21.15.7:0/2882095463 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6003f030 con 0x7f9c701036e0 2024-09-19T04:16:02.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.729+0000 7f9c781f3640 1 -- 172.21.15.7:0/2882095463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c7019d7c0 con 0x7f9c701036e0 2024-09-19T04:16:02.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.729+0000 7f9c66ffd640 1 -- 172.21.15.7:0/2882095463 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c60003ce0 con 0x7f9c701036e0 2024-09-19T04:16:02.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.729+0000 7f9c66ffd640 1 -- 172.21.15.7:0/2882095463 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c60035070 con 0x7f9c701036e0 2024-09-19T04:16:02.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.729+0000 7f9c781f3640 1 -- 172.21.15.7:0/2882095463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c701a5100 con 0x7f9c701036e0 2024-09-19T04:16:02.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.730+0000 7f9c781f3640 1 -- 172.21.15.7:0/2882095463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c70103110 con 0x7f9c701036e0 2024-09-19T04:16:02.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.731+0000 7f9c66ffd640 1 -- 172.21.15.7:0/2882095463 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f9c60042030 con 0x7f9c701036e0 2024-09-19T04:16:02.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.732+0000 7f9c66ffd640 1 --2- 172.21.15.7:0/2882095463 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9c5c0a32d0 0x7f9c5c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:02.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.732+0000 7f9c75f8f640 1 --2- 172.21.15.7:0/2882095463 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9c5c0a32d0 0x7f9c5c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:02.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.732+0000 7f9c66ffd640 1 -- 172.21.15.7:0/2882095463 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f9c600f01e0 con 0x7f9c701036e0 2024-09-19T04:16:02.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.733+0000 7f9c75f8f640 1 --2- 172.21.15.7:0/2882095463 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9c5c0a32d0 0x7f9c5c0a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c005fd0 tx=0x7f9c6c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:02.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.736+0000 7f9c66ffd640 1 -- 172.21.15.7:0/2882095463 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9c600bc410 con 0x7f9c701036e0 2024-09-19T04:16:02.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.915+0000 7f9c781f3640 1 -- 172.21.15.7:0/2882095463 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f9c7010a2b0 con 0x7f9c701036e0 2024-09-19T04:16:02.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.915+0000 7f9c66ffd640 1 -- 172.21.15.7:0/2882095463 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9c600c0710 con 0x7f9c701036e0 2024-09-19T04:16:02.917 INFO:teuthology.orchestra.run.smithi007.stdout:236223201325 2024-09-19T04:16:02.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.917+0000 7f9c781f3640 1 -- 172.21.15.7:0/2882095463 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9c5c0a32d0 msgr2=0x7f9c5c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:02.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.917+0000 7f9c781f3640 1 --2- 172.21.15.7:0/2882095463 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9c5c0a32d0 0x7f9c5c0a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c005fd0 tx=0x7f9c6c00b390 comp rx=0 tx=0).stop 2024-09-19T04:16:02.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.917+0000 7f9c781f3640 1 -- 172.21.15.7:0/2882095463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c701036e0 msgr2=0x7f9c70198ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:02.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.917+0000 7f9c781f3640 1 --2- 172.21.15.7:0/2882095463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c701036e0 0x7f9c70198ac0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9c60005940 tx=0x7f9c600042f0 comp rx=0 tx=0).stop 2024-09-19T04:16:02.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.917+0000 7f9c781f3640 1 -- 172.21.15.7:0/2882095463 shutdown_connections 2024-09-19T04:16:02.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.917+0000 7f9c781f3640 1 --2- 172.21.15.7:0/2882095463 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9c5c0a32d0 0x7f9c5c0a5790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:02.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.917+0000 7f9c781f3640 1 --2- 172.21.15.7:0/2882095463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c701082a0 0x7f9c7019ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:02.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.917+0000 7f9c781f3640 1 --2- 172.21.15.7:0/2882095463 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c701036e0 0x7f9c70198ac0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:02.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.917+0000 7f9c781f3640 1 --2- 172.21.15.7:0/2882095463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c70102d30 0x7f9c70198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:02.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.917+0000 7f9c781f3640 1 -- 172.21.15.7:0/2882095463 >> 172.21.15.7:0/2882095463 conn(0x7f9c700fc7d0 msgr2=0x7f9c70105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:02.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.917+0000 7f9c781f3640 1 -- 172.21.15.7:0/2882095463 shutdown_connections 2024-09-19T04:16:02.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:02.917+0000 7f9c781f3640 1 -- 172.21.15.7:0/2882095463 wait complete. 2024-09-19T04:16:03.250 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:03 smithi007 ceph-mon[31360]: pgmap v326: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-19T04:16:03.250 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:03 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3991454518' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T04:16:03.250 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:03 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2882095463' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T04:16:03.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:03 smithi092 ceph-mon[34940]: pgmap v326: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-19T04:16:03.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:03 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3991454518' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T04:16:03.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:03 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2882095463' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T04:16:03.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:03 smithi102 ceph-mon[35446]: pgmap v326: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-19T04:16:03.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:03 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3991454518' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T04:16:03.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:03 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2882095463' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T04:16:03.536 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201323 got 236223201325 for osd.8 2024-09-19T04:16:03.536 DEBUG:teuthology.parallel:result is None 2024-09-19T04:16:03.941 INFO:tasks.cephadm.ceph_manager.ceph:need seq 317827579934 got 317827579935 for osd.11 2024-09-19T04:16:03.941 DEBUG:teuthology.parallel:result is None 2024-09-19T04:16:04.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.323+0000 7f1adad89640 1 -- 172.21.15.7:0/2168831509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ad4106f50 msgr2=0x7f1ad410eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:04.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.323+0000 7f1adad89640 1 --2- 172.21.15.7:0/2168831509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ad4106f50 0x7f1ad410eaf0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1acc009cd0 tx=0x7f1acc02a8e0 comp rx=0 tx=0).stop 2024-09-19T04:16:04.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.323+0000 7f1adad89640 1 -- 172.21.15.7:0/2168831509 shutdown_connections 2024-09-19T04:16:04.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.323+0000 7f1adad89640 1 --2- 172.21.15.7:0/2168831509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ad4106f50 0x7f1ad410eaf0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:04.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.323+0000 7f1adad89640 1 --2- 172.21.15.7:0/2168831509 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ad4100ca0 0x7f1ad4106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:04.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.323+0000 7f1adad89640 1 --2- 172.21.15.7:0/2168831509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ad41002f0 0x7f1ad41006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:04.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.323+0000 7f1adad89640 1 -- 172.21.15.7:0/2168831509 >> 172.21.15.7:0/2168831509 conn(0x7f1ad4077210 msgr2=0x7f1ad40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:04.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.323+0000 7f1adad89640 1 -- 172.21.15.7:0/2168831509 shutdown_connections 2024-09-19T04:16:04.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.323+0000 7f1adad89640 1 -- 172.21.15.7:0/2168831509 wait complete. 2024-09-19T04:16:04.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.324+0000 7f1adad89640 1 Processor -- start 2024-09-19T04:16:04.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.324+0000 7f1adad89640 1 -- start start 2024-09-19T04:16:04.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.324+0000 7f1adad89640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ad41002f0 0x7f1ad4198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:04.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.324+0000 7f1adad89640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ad4100ca0 0x7f1ad4198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:04.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.324+0000 7f1adad89640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ad4106f50 0x7f1ad419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:04.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.324+0000 7f1adad89640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad4111fa0 con 0x7f1ad41002f0 2024-09-19T04:16:04.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.324+0000 7f1adad89640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad4111e20 con 0x7f1ad4106f50 2024-09-19T04:16:04.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.324+0000 7f1adad89640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad4112120 con 0x7f1ad4100ca0 2024-09-19T04:16:04.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.324+0000 7f1ad8b25640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ad41002f0 0x7f1ad4198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:04.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.324+0000 7f1ad8b25640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ad41002f0 0x7f1ad4198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59852/0 (socket says 172.21.15.7:59852) 2024-09-19T04:16:04.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.324+0000 7f1ad8b25640 1 -- 172.21.15.7:0/3888245228 learned_addr learned my addr 172.21.15.7:0/3888245228 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:04.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.324+0000 7f1ad3fff640 1 --2- 172.21.15.7:0/3888245228 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ad4100ca0 0x7f1ad4198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:04.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.324+0000 7f1ad9326640 1 --2- 172.21.15.7:0/3888245228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ad4106f50 0x7f1ad419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:04.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.325+0000 7f1ad8b25640 1 -- 172.21.15.7:0/3888245228 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ad4100ca0 msgr2=0x7f1ad4198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:04.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.325+0000 7f1ad8b25640 1 --2- 172.21.15.7:0/3888245228 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ad4100ca0 0x7f1ad4198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:04.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.325+0000 7f1ad8b25640 1 -- 172.21.15.7:0/3888245228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ad4106f50 msgr2=0x7f1ad419cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:04.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.325+0000 7f1ad8b25640 1 --2- 172.21.15.7:0/3888245228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ad4106f50 0x7f1ad419cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:04.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.325+0000 7f1ad8b25640 1 -- 172.21.15.7:0/3888245228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ad419d3f0 con 0x7f1ad41002f0 2024-09-19T04:16:04.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.325+0000 7f1ad8b25640 1 --2- 172.21.15.7:0/3888245228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ad41002f0 0x7f1ad4198440 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400c890 tx=0x7f1ac400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:04.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.325+0000 7f1ad1ffb640 1 -- 172.21.15.7:0/3888245228 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4004220 con 0x7f1ad41002f0 2024-09-19T04:16:04.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.325+0000 7f1ad1ffb640 1 -- 172.21.15.7:0/3888245228 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ac40043c0 con 0x7f1ad41002f0 2024-09-19T04:16:04.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.325+0000 7f1adad89640 1 -- 172.21.15.7:0/3888245228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ad419d6e0 con 0x7f1ad41002f0 2024-09-19T04:16:04.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.325+0000 7f1ad1ffb640 1 -- 172.21.15.7:0/3888245228 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac40049e0 con 0x7f1ad41002f0 2024-09-19T04:16:04.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.325+0000 7f1adad89640 1 -- 172.21.15.7:0/3888245228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ad41a4fc0 con 0x7f1ad41002f0 2024-09-19T04:16:04.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.326+0000 7f1adad89640 1 -- 172.21.15.7:0/3888245228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ad41006d0 con 0x7f1ad41002f0 2024-09-19T04:16:04.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.327+0000 7f1ad1ffb640 1 -- 172.21.15.7:0/3888245228 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f1ac40079b0 con 0x7f1ad41002f0 2024-09-19T04:16:04.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.328+0000 7f1ad1ffb640 1 --2- 172.21.15.7:0/3888245228 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1abc0a3350 0x7f1abc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:04.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.328+0000 7f1ad3fff640 1 --2- 172.21.15.7:0/3888245228 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1abc0a3350 0x7f1abc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:04.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.328+0000 7f1ad1ffb640 1 -- 172.21.15.7:0/3888245228 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f1ac40cfdb0 con 0x7f1ad41002f0 2024-09-19T04:16:04.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.328+0000 7f1ad3fff640 1 --2- 172.21.15.7:0/3888245228 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1abc0a3350 0x7f1abc0a5810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4104830 tx=0x7f1ac800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:04.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.332+0000 7f1ad1ffb640 1 -- 172.21.15.7:0/3888245228 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1ac40d4070 con 0x7f1ad41002f0 2024-09-19T04:16:04.392 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:04.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.518+0000 7f1adad89640 1 -- 172.21.15.7:0/3888245228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f1ad4109bb0 con 0x7f1ad41002f0 2024-09-19T04:16:04.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.518+0000 7f1ad1ffb640 1 -- 172.21.15.7:0/3888245228 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1ac4014030 con 0x7f1ad41002f0 2024-09-19T04:16:04.520 INFO:teuthology.orchestra.run.smithi007.stdout:184683593785 2024-09-19T04:16:04.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.520+0000 7f1adad89640 1 -- 172.21.15.7:0/3888245228 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1abc0a3350 msgr2=0x7f1abc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:04.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.520+0000 7f1adad89640 1 --2- 172.21.15.7:0/3888245228 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1abc0a3350 0x7f1abc0a5810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4104830 tx=0x7f1ac800b410 comp rx=0 tx=0).stop 2024-09-19T04:16:04.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.521+0000 7f1adad89640 1 -- 172.21.15.7:0/3888245228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ad41002f0 msgr2=0x7f1ad4198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:04.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.521+0000 7f1adad89640 1 --2- 172.21.15.7:0/3888245228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ad41002f0 0x7f1ad4198440 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1ac400c890 tx=0x7f1ac400cd50 comp rx=0 tx=0).stop 2024-09-19T04:16:04.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.521+0000 7f1adad89640 1 -- 172.21.15.7:0/3888245228 shutdown_connections 2024-09-19T04:16:04.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.521+0000 7f1adad89640 1 --2- 172.21.15.7:0/3888245228 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1abc0a3350 0x7f1abc0a5810 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:04.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.521+0000 7f1adad89640 1 --2- 172.21.15.7:0/3888245228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ad4106f50 0x7f1ad419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:04.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.521+0000 7f1adad89640 1 --2- 172.21.15.7:0/3888245228 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ad4100ca0 0x7f1ad4198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:04.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.521+0000 7f1adad89640 1 --2- 172.21.15.7:0/3888245228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ad41002f0 0x7f1ad4198440 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:04.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.521+0000 7f1adad89640 1 -- 172.21.15.7:0/3888245228 >> 172.21.15.7:0/3888245228 conn(0x7f1ad4077210 msgr2=0x7f1ad40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:04.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.521+0000 7f1adad89640 1 -- 172.21.15.7:0/3888245228 shutdown_connections 2024-09-19T04:16:04.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.521+0000 7f1adad89640 1 -- 172.21.15.7:0/3888245228 wait complete. 2024-09-19T04:16:04.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.987+0000 7f84ef83f640 1 -- 172.21.15.7:0/4189578704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84e8102d30 msgr2=0x7f84e8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:04.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.987+0000 7f84ef83f640 1 --2- 172.21.15.7:0/4189578704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84e8102d30 0x7f84e8103110 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009930 tx=0x7f84e002a420 comp rx=0 tx=0).stop 2024-09-19T04:16:04.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.987+0000 7f84ef83f640 1 -- 172.21.15.7:0/4189578704 shutdown_connections 2024-09-19T04:16:04.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.987+0000 7f84ef83f640 1 --2- 172.21.15.7:0/4189578704 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84e81082a0 0x7f84e810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:04.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.987+0000 7f84ef83f640 1 --2- 172.21.15.7:0/4189578704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84e81036e0 0x7f84e8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:04.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.987+0000 7f84ef83f640 1 --2- 172.21.15.7:0/4189578704 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84e8102d30 0x7f84e8103110 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:04.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.987+0000 7f84ef83f640 1 -- 172.21.15.7:0/4189578704 >> 172.21.15.7:0/4189578704 conn(0x7f84e80fc7d0 msgr2=0x7f84e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:04.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.987+0000 7f84ef83f640 1 -- 172.21.15.7:0/4189578704 shutdown_connections 2024-09-19T04:16:04.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.987+0000 7f84ef83f640 1 -- 172.21.15.7:0/4189578704 wait complete. 2024-09-19T04:16:04.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.988+0000 7f84ef83f640 1 Processor -- start 2024-09-19T04:16:04.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.988+0000 7f84ef83f640 1 -- start start 2024-09-19T04:16:04.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.988+0000 7f84ef83f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84e8102d30 0x7f84e81a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:04.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.988+0000 7f84ef83f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84e81036e0 0x7f84e81a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:04.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.988+0000 7f84ef83f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84e81082a0 0x7f84e819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:04.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.988+0000 7f84ef83f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f84e81120a0 con 0x7f84e81036e0 2024-09-19T04:16:04.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.988+0000 7f84ef83f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f84e8111f20 con 0x7f84e81082a0 2024-09-19T04:16:04.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.988+0000 7f84ef83f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f84e8112220 con 0x7f84e8102d30 2024-09-19T04:16:04.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.988+0000 7f84ecdda640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84e81036e0 0x7f84e81a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:04.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.988+0000 7f84ecdda640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84e81036e0 0x7f84e81a0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59878/0 (socket says 172.21.15.7:59878) 2024-09-19T04:16:04.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.988+0000 7f84ecdda640 1 -- 172.21.15.7:0/1019944053 learned_addr learned my addr 172.21.15.7:0/1019944053 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:04.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.988+0000 7f84edddc640 1 --2- 172.21.15.7:0/1019944053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84e81082a0 0x7f84e819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:04.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.988+0000 7f84ed5db640 1 --2- 172.21.15.7:0/1019944053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84e8102d30 0x7f84e81a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:04.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.988+0000 7f84ecdda640 1 -- 172.21.15.7:0/1019944053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84e8102d30 msgr2=0x7f84e81a0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:04.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.988+0000 7f84ecdda640 1 --2- 172.21.15.7:0/1019944053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84e8102d30 0x7f84e81a0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:04.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.988+0000 7f84ecdda640 1 -- 172.21.15.7:0/1019944053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84e81082a0 msgr2=0x7f84e819a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:04.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.988+0000 7f84ecdda640 1 --2- 172.21.15.7:0/1019944053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84e81082a0 0x7f84e819a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:04.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.988+0000 7f84ecdda640 1 -- 172.21.15.7:0/1019944053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e819acf0 con 0x7f84e81036e0 2024-09-19T04:16:04.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.988+0000 7f84ed5db640 1 --2- 172.21.15.7:0/1019944053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84e8102d30 0x7f84e81a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:16:04.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.989+0000 7f84ecdda640 1 --2- 172.21.15.7:0/1019944053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84e81036e0 0x7f84e81a0940 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f84dc00e9f0 tx=0x7f84dc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:04.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.989+0000 7f84e67fc640 1 -- 172.21.15.7:0/1019944053 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc00ccc0 con 0x7f84e81036e0 2024-09-19T04:16:04.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.989+0000 7f84e67fc640 1 -- 172.21.15.7:0/1019944053 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84dc010910 con 0x7f84e81036e0 2024-09-19T04:16:04.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.989+0000 7f84ef83f640 1 -- 172.21.15.7:0/1019944053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e819afe0 con 0x7f84e81036e0 2024-09-19T04:16:04.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.989+0000 7f84e67fc640 1 -- 172.21.15.7:0/1019944053 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc018920 con 0x7f84e81036e0 2024-09-19T04:16:04.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.989+0000 7f84ef83f640 1 -- 172.21.15.7:0/1019944053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e81a72d0 con 0x7f84e81036e0 2024-09-19T04:16:04.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.990+0000 7f84ef83f640 1 -- 172.21.15.7:0/1019944053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84e806a850 con 0x7f84e81036e0 2024-09-19T04:16:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.991+0000 7f84e67fc640 1 -- 172.21.15.7:0/1019944053 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f84dc010ac0 con 0x7f84e81036e0 2024-09-19T04:16:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.992+0000 7f84e67fc640 1 --2- 172.21.15.7:0/1019944053 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f84d00a32d0 0x7f84d00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.992+0000 7f84ed5db640 1 --2- 172.21.15.7:0/1019944053 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f84d00a32d0 0x7f84d00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.992+0000 7f84e67fc640 1 -- 172.21.15.7:0/1019944053 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f84dc0d0180 con 0x7f84e81036e0 2024-09-19T04:16:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.992+0000 7f84ed5db640 1 --2- 172.21.15.7:0/1019944053 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f84d00a32d0 0x7f84d00a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f84e0000c00 tx=0x7f84e0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:04.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:04.996+0000 7f84e67fc640 1 -- 172.21.15.7:0/1019944053 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f84dc09c9a0 con 0x7f84e81036e0 2024-09-19T04:16:05.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:05.175+0000 7f84ef83f640 1 -- 172.21.15.7:0/1019944053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f84e810c2c0 con 0x7f84e81036e0 2024-09-19T04:16:05.177 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:05 smithi007 ceph-mon[31360]: pgmap v327: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T04:16:05.177 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:05 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3888245228' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T04:16:05.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:05.175+0000 7f84e67fc640 1 -- 172.21.15.7:0/1019944053 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f84dc09c2a0 con 0x7f84e81036e0 2024-09-19T04:16:05.177 INFO:teuthology.orchestra.run.smithi007.stdout:206158430258 2024-09-19T04:16:05.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:05.177+0000 7f84ef83f640 1 -- 172.21.15.7:0/1019944053 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f84d00a32d0 msgr2=0x7f84d00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:05.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:05.177+0000 7f84ef83f640 1 --2- 172.21.15.7:0/1019944053 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f84d00a32d0 0x7f84d00a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f84e0000c00 tx=0x7f84e0005a20 comp rx=0 tx=0).stop 2024-09-19T04:16:05.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:05.177+0000 7f84ef83f640 1 -- 172.21.15.7:0/1019944053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84e81036e0 msgr2=0x7f84e81a0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:05.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:05.177+0000 7f84ef83f640 1 --2- 172.21.15.7:0/1019944053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84e81036e0 0x7f84e81a0940 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f84dc00e9f0 tx=0x7f84dc00eeb0 comp rx=0 tx=0).stop 2024-09-19T04:16:05.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:05.177+0000 7f84ef83f640 1 -- 172.21.15.7:0/1019944053 shutdown_connections 2024-09-19T04:16:05.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:05.177+0000 7f84ef83f640 1 --2- 172.21.15.7:0/1019944053 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f84d00a32d0 0x7f84d00a5790 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:05.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:05.177+0000 7f84ef83f640 1 --2- 172.21.15.7:0/1019944053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84e81082a0 0x7f84e819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:05.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:05.177+0000 7f84ef83f640 1 --2- 172.21.15.7:0/1019944053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f84e81036e0 0x7f84e81a0940 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:05.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:05.177+0000 7f84ef83f640 1 --2- 172.21.15.7:0/1019944053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84e8102d30 0x7f84e81a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:05.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:05.177+0000 7f84ef83f640 1 -- 172.21.15.7:0/1019944053 >> 172.21.15.7:0/1019944053 conn(0x7f84e80fc7d0 msgr2=0x7f84e8100ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:05.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:05.177+0000 7f84ef83f640 1 -- 172.21.15.7:0/1019944053 shutdown_connections 2024-09-19T04:16:05.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:05.177+0000 7f84ef83f640 1 -- 172.21.15.7:0/1019944053 wait complete. 2024-09-19T04:16:05.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:05 smithi092 ceph-mon[34940]: pgmap v327: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T04:16:05.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:05 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3888245228' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T04:16:05.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:05 smithi102 ceph-mon[35446]: pgmap v327: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T04:16:05.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:05 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3888245228' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T04:16:05.928 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430256 got 206158430258 for osd.7 2024-09-19T04:16:05.928 DEBUG:teuthology.parallel:result is None 2024-09-19T04:16:06.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.107+0000 7fbab1369640 1 -- 172.21.15.7:0/1318903273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbaac100a80 msgr2=0x7fbaac100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:06.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.107+0000 7fbab1369640 1 --2- 172.21.15.7:0/1318903273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbaac100a80 0x7fbaac100ee0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0009930 tx=0x7fbaa002a420 comp rx=0 tx=0).stop 2024-09-19T04:16:06.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.107+0000 7fbab1369640 1 -- 172.21.15.7:0/1318903273 shutdown_connections 2024-09-19T04:16:06.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.107+0000 7fbab1369640 1 --2- 172.21.15.7:0/1318903273 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbaac101420 0x7fbaac10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:06.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.107+0000 7fbab1369640 1 --2- 172.21.15.7:0/1318903273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbaac100a80 0x7fbaac100ee0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:06.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.107+0000 7fbab1369640 1 --2- 172.21.15.7:0/1318903273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbaac106a80 0x7fbaac106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:06.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.107+0000 7fbab1369640 1 -- 172.21.15.7:0/1318903273 >> 172.21.15.7:0/1318903273 conn(0x7fbaac0fc7a0 msgr2=0x7fbaac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:06.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.107+0000 7fbab1369640 1 -- 172.21.15.7:0/1318903273 shutdown_connections 2024-09-19T04:16:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.107+0000 7fbab1369640 1 -- 172.21.15.7:0/1318903273 wait complete. 2024-09-19T04:16:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.107+0000 7fbab1369640 1 Processor -- start 2024-09-19T04:16:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.108+0000 7fbab1369640 1 -- start start 2024-09-19T04:16:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.108+0000 7fbab1369640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbaac100a80 0x7fbaac0fcd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.108+0000 7fbab1369640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbaac101420 0x7fbaac0fd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.108+0000 7fbab1369640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbaac106a80 0x7fbaac0fd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.108+0000 7fbab1369640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac110ed0 con 0x7fbaac101420 2024-09-19T04:16:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.108+0000 7fbab1369640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac110d50 con 0x7fbaac100a80 2024-09-19T04:16:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.108+0000 7fbab1369640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac111050 con 0x7fbaac106a80 2024-09-19T04:16:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.108+0000 7fbaaa7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbaac101420 0x7fbaac0fd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.108+0000 7fbaaa7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbaac101420 0x7fbaac0fd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59892/0 (socket says 172.21.15.7:59892) 2024-09-19T04:16:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.108+0000 7fbaaa7fc640 1 -- 172.21.15.7:0/2111396578 learned_addr learned my addr 172.21.15.7:0/2111396578 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:06.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.108+0000 7fbaaaffd640 1 --2- 172.21.15.7:0/2111396578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbaac100a80 0x7fbaac0fcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.108+0000 7fbaab7fe640 1 --2- 172.21.15.7:0/2111396578 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbaac106a80 0x7fbaac0fd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.108+0000 7fbaaa7fc640 1 -- 172.21.15.7:0/2111396578 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbaac106a80 msgr2=0x7fbaac0fd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.108+0000 7fbaaa7fc640 1 --2- 172.21.15.7:0/2111396578 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbaac106a80 0x7fbaac0fd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.108+0000 7fbaaa7fc640 1 -- 172.21.15.7:0/2111396578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbaac100a80 msgr2=0x7fbaac0fcd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.108+0000 7fbaaa7fc640 1 --2- 172.21.15.7:0/2111396578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbaac100a80 0x7fbaac0fcd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.108+0000 7fbaaa7fc640 1 -- 172.21.15.7:0/2111396578 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaac1a6860 con 0x7fbaac101420 2024-09-19T04:16:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.108+0000 7fbaaa7fc640 1 --2- 172.21.15.7:0/2111396578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbaac101420 0x7fbaac0fd2a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbaa002a940 tx=0x7fbaa0003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.109+0000 7fba93fff640 1 -- 172.21.15.7:0/2111396578 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa003f070 con 0x7fbaac101420 2024-09-19T04:16:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.109+0000 7fba93fff640 1 -- 172.21.15.7:0/2111396578 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbaa0031c90 con 0x7fbaac101420 2024-09-19T04:16:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.109+0000 7fba93fff640 1 -- 172.21.15.7:0/2111396578 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0035030 con 0x7fbaac101420 2024-09-19T04:16:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.109+0000 7fbab1369640 1 -- 172.21.15.7:0/2111396578 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaac1a6af0 con 0x7fbaac101420 2024-09-19T04:16:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.109+0000 7fbab1369640 1 -- 172.21.15.7:0/2111396578 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaac1a6fd0 con 0x7fbaac101420 2024-09-19T04:16:06.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.110+0000 7fbab1369640 1 -- 172.21.15.7:0/2111396578 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaac100ee0 con 0x7fbaac101420 2024-09-19T04:16:06.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.111+0000 7fba93fff640 1 -- 172.21.15.7:0/2111396578 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fbaa0042070 con 0x7fbaac101420 2024-09-19T04:16:06.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.111+0000 7fba93fff640 1 --2- 172.21.15.7:0/2111396578 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fba940a32d0 0x7fba940a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:06.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.112+0000 7fba93fff640 1 -- 172.21.15.7:0/2111396578 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7fbaa00f05f0 con 0x7fbaac101420 2024-09-19T04:16:06.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.112+0000 7fbaaaffd640 1 --2- 172.21.15.7:0/2111396578 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fba940a32d0 0x7fba940a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:06.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.112+0000 7fbaaaffd640 1 --2- 172.21.15.7:0/2111396578 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fba940a32d0 0x7fba940a5790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fba9c00ab60 tx=0x7fba9c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:06.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.116+0000 7fba93fff640 1 -- 172.21.15.7:0/2111396578 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbaa00bce10 con 0x7fbaac101420 2024-09-19T04:16:06.161 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:06.252 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:06 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1019944053' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T04:16:06.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.304+0000 7fbab1369640 1 -- 172.21.15.7:0/2111396578 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fbaac02d7c0 con 0x7fbaac101420 2024-09-19T04:16:06.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.304+0000 7fba93fff640 1 -- 172.21.15.7:0/2111396578 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbaa00bc710 con 0x7fbaac101420 2024-09-19T04:16:06.306 INFO:teuthology.orchestra.run.smithi007.stdout:103079215175 2024-09-19T04:16:06.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.306+0000 7fbab1369640 1 -- 172.21.15.7:0/2111396578 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fba940a32d0 msgr2=0x7fba940a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:06.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.306+0000 7fbab1369640 1 --2- 172.21.15.7:0/2111396578 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fba940a32d0 0x7fba940a5790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fba9c00ab60 tx=0x7fba9c00a2d0 comp rx=0 tx=0).stop 2024-09-19T04:16:06.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.306+0000 7fbab1369640 1 -- 172.21.15.7:0/2111396578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbaac101420 msgr2=0x7fbaac0fd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:06.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.306+0000 7fbab1369640 1 --2- 172.21.15.7:0/2111396578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbaac101420 0x7fbaac0fd2a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbaa002a940 tx=0x7fbaa0003b90 comp rx=0 tx=0).stop 2024-09-19T04:16:06.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.306+0000 7fbab1369640 1 -- 172.21.15.7:0/2111396578 shutdown_connections 2024-09-19T04:16:06.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.306+0000 7fbab1369640 1 --2- 172.21.15.7:0/2111396578 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fba940a32d0 0x7fba940a5790 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:06.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.306+0000 7fbab1369640 1 --2- 172.21.15.7:0/2111396578 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbaac106a80 0x7fbaac0fd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:06.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.306+0000 7fbab1369640 1 --2- 172.21.15.7:0/2111396578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbaac101420 0x7fbaac0fd2a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:06.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.306+0000 7fbab1369640 1 --2- 172.21.15.7:0/2111396578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbaac100a80 0x7fbaac0fcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:06.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.306+0000 7fbab1369640 1 -- 172.21.15.7:0/2111396578 >> 172.21.15.7:0/2111396578 conn(0x7fbaac0fc7a0 msgr2=0x7fbaac06a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:06.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.306+0000 7fbab1369640 1 -- 172.21.15.7:0/2111396578 shutdown_connections 2024-09-19T04:16:06.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:06.306+0000 7fbab1369640 1 -- 172.21.15.7:0/2111396578 wait complete. 2024-09-19T04:16:06.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:06 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1019944053' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T04:16:06.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:06 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1019944053' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T04:16:06.583 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593782 got 184683593785 for osd.6 2024-09-19T04:16:06.583 DEBUG:teuthology.parallel:result is None 2024-09-19T04:16:07.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:07 smithi007 ceph-mon[31360]: pgmap v328: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T04:16:07.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:07 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2111396578' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T04:16:07.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:07 smithi102 ceph-mon[35446]: pgmap v328: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T04:16:07.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:07 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2111396578' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T04:16:07.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:07 smithi092 ceph-mon[34940]: pgmap v328: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T04:16:07.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:07 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2111396578' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T04:16:07.619 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215172 got 103079215175 for osd.3 2024-09-19T04:16:07.619 DEBUG:teuthology.parallel:result is None 2024-09-19T04:16:07.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.809+0000 7f5cf7caf640 1 -- 172.21.15.7:0/2474346133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cf0102570 msgr2=0x7f5cf01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:07.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.809+0000 7f5cf7caf640 1 --2- 172.21.15.7:0/2474346133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cf0102570 0x7f5cf01029b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4009900 tx=0x7f5ce402a480 comp rx=0 tx=0).stop 2024-09-19T04:16:07.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.809+0000 7f5cf7caf640 1 -- 172.21.15.7:0/2474346133 shutdown_connections 2024-09-19T04:16:07.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.809+0000 7f5cf7caf640 1 --2- 172.21.15.7:0/2474346133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cf0102ef0 0x7f5cf010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:07.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.809+0000 7f5cf7caf640 1 --2- 172.21.15.7:0/2474346133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cf0102570 0x7f5cf01029b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:07.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.809+0000 7f5cf7caf640 1 --2- 172.21.15.7:0/2474346133 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5cf0100e20 0x7f5cf0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:07.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.809+0000 7f5cf7caf640 1 -- 172.21.15.7:0/2474346133 >> 172.21.15.7:0/2474346133 conn(0x7f5cf00fc7d0 msgr2=0x7f5cf00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:07.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.809+0000 7f5cf7caf640 1 -- 172.21.15.7:0/2474346133 shutdown_connections 2024-09-19T04:16:07.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.809+0000 7f5cf7caf640 1 -- 172.21.15.7:0/2474346133 wait complete. 2024-09-19T04:16:07.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.810+0000 7f5cf7caf640 1 Processor -- start 2024-09-19T04:16:07.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.810+0000 7f5cf7caf640 1 -- start start 2024-09-19T04:16:07.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.810+0000 7f5cf7caf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cf0100e20 0x7f5cf0198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:07.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.810+0000 7f5cf7caf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5cf0102570 0x7f5cf0198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:07.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.810+0000 7f5cf7caf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cf0102ef0 0x7f5cf019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:07.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.810+0000 7f5cf7caf640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf0112050 con 0x7f5cf0102ef0 2024-09-19T04:16:07.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.810+0000 7f5cf7caf640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf0111ed0 con 0x7f5cf0100e20 2024-09-19T04:16:07.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.810+0000 7f5cf7caf640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf01121d0 con 0x7f5cf0102570 2024-09-19T04:16:07.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.810+0000 7f5cf624c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cf0102ef0 0x7f5cf019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:07.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.810+0000 7f5cf624c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cf0102ef0 0x7f5cf019cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36642/0 (socket says 172.21.15.7:36642) 2024-09-19T04:16:07.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.810+0000 7f5cf624c640 1 -- 172.21.15.7:0/53855135 learned_addr learned my addr 172.21.15.7:0/53855135 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:07.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.810+0000 7f5cf524a640 1 --2- 172.21.15.7:0/53855135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5cf0102570 0x7f5cf0198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:07.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.810+0000 7f5cf5a4b640 1 --2- 172.21.15.7:0/53855135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cf0100e20 0x7f5cf0198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:07.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.811+0000 7f5cf624c640 1 -- 172.21.15.7:0/53855135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5cf0102570 msgr2=0x7f5cf0198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:07.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.811+0000 7f5cf624c640 1 --2- 172.21.15.7:0/53855135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5cf0102570 0x7f5cf0198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:07.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.811+0000 7f5cf624c640 1 -- 172.21.15.7:0/53855135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cf0100e20 msgr2=0x7f5cf0198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:07.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.811+0000 7f5cf624c640 1 --2- 172.21.15.7:0/53855135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cf0100e20 0x7f5cf0198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:07.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.811+0000 7f5cf624c640 1 -- 172.21.15.7:0/53855135 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf019d4c0 con 0x7f5cf0102ef0 2024-09-19T04:16:07.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.811+0000 7f5cf624c640 1 --2- 172.21.15.7:0/53855135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cf0102ef0 0x7f5cf019cde0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800eb10 tx=0x7f5ce800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:07.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.811+0000 7f5ce2ffd640 1 -- 172.21.15.7:0/53855135 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce800ce20 con 0x7f5cf0102ef0 2024-09-19T04:16:07.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.811+0000 7f5ce2ffd640 1 -- 172.21.15.7:0/53855135 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ce8005020 con 0x7f5cf0102ef0 2024-09-19T04:16:07.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.811+0000 7f5cf7caf640 1 -- 172.21.15.7:0/53855135 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cf019d7b0 con 0x7f5cf0102ef0 2024-09-19T04:16:07.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.811+0000 7f5ce2ffd640 1 -- 172.21.15.7:0/53855135 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8010690 con 0x7f5cf0102ef0 2024-09-19T04:16:07.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.811+0000 7f5cf7caf640 1 -- 172.21.15.7:0/53855135 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cf01a5090 con 0x7f5cf0102ef0 2024-09-19T04:16:07.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.812+0000 7f5cf7caf640 1 -- 172.21.15.7:0/53855135 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cf0101200 con 0x7f5cf0102ef0 2024-09-19T04:16:07.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.814+0000 7f5ce2ffd640 1 -- 172.21.15.7:0/53855135 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f5ce8005540 con 0x7f5cf0102ef0 2024-09-19T04:16:07.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.814+0000 7f5ce2ffd640 1 --2- 172.21.15.7:0/53855135 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f5cdc0a3350 0x7f5cdc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:07.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.814+0000 7f5cf5a4b640 1 --2- 172.21.15.7:0/53855135 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f5cdc0a3350 0x7f5cdc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:07.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.814+0000 7f5ce2ffd640 1 -- 172.21.15.7:0/53855135 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f5ce80d0280 con 0x7f5cf0102ef0 2024-09-19T04:16:07.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.815+0000 7f5cf5a4b640 1 --2- 172.21.15.7:0/53855135 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f5cdc0a3350 0x7f5cdc0a5810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5cec00abe0 tx=0x7f5cec00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:07.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:07.818+0000 7f5ce2ffd640 1 -- 172.21.15.7:0/53855135 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5ce809cb00 con 0x7f5cf0102ef0 2024-09-19T04:16:08.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:08.003+0000 7f5cf7caf640 1 -- 172.21.15.7:0/53855135 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f5cf01090c0 con 0x7f5cf0102ef0 2024-09-19T04:16:08.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:08.003+0000 7f5ce2ffd640 1 -- 172.21.15.7:0/53855135 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5ce809c400 con 0x7f5cf0102ef0 2024-09-19T04:16:08.005 INFO:teuthology.orchestra.run.smithi007.stdout:34359738454 2024-09-19T04:16:08.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:08.006+0000 7f5cf7caf640 1 -- 172.21.15.7:0/53855135 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f5cdc0a3350 msgr2=0x7f5cdc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:08.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:08.006+0000 7f5cf7caf640 1 --2- 172.21.15.7:0/53855135 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f5cdc0a3350 0x7f5cdc0a5810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5cec00abe0 tx=0x7f5cec00a2d0 comp rx=0 tx=0).stop 2024-09-19T04:16:08.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:08.006+0000 7f5cf7caf640 1 -- 172.21.15.7:0/53855135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cf0102ef0 msgr2=0x7f5cf019cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:08.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:08.006+0000 7f5cf7caf640 1 --2- 172.21.15.7:0/53855135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cf0102ef0 0x7f5cf019cde0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800eb10 tx=0x7f5ce800ef10 comp rx=0 tx=0).stop 2024-09-19T04:16:08.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:08.006+0000 7f5cf7caf640 1 -- 172.21.15.7:0/53855135 shutdown_connections 2024-09-19T04:16:08.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:08.006+0000 7f5cf7caf640 1 --2- 172.21.15.7:0/53855135 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f5cdc0a3350 0x7f5cdc0a5810 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:08.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:08.006+0000 7f5cf7caf640 1 --2- 172.21.15.7:0/53855135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5cf0102ef0 0x7f5cf019cde0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:08.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:08.006+0000 7f5cf7caf640 1 --2- 172.21.15.7:0/53855135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5cf0102570 0x7f5cf0198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:08.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:08.006+0000 7f5cf7caf640 1 --2- 172.21.15.7:0/53855135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5cf0100e20 0x7f5cf0198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:08.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:08.006+0000 7f5cf7caf640 1 -- 172.21.15.7:0/53855135 >> 172.21.15.7:0/53855135 conn(0x7f5cf00fc7d0 msgr2=0x7f5cf0105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:08.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:08.006+0000 7f5cf7caf640 1 -- 172.21.15.7:0/53855135 shutdown_connections 2024-09-19T04:16:08.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:08.006+0000 7f5cf7caf640 1 -- 172.21.15.7:0/53855135 wait complete. 2024-09-19T04:16:08.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:08 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/53855135' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T04:16:08.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:08 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/53855135' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T04:16:08.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:08 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/53855135' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T04:16:08.692 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738453 got 34359738454 for osd.0 2024-09-19T04:16:08.692 DEBUG:teuthology.parallel:result is None 2024-09-19T04:16:08.692 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T04:16:08.692 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T04:16:08.953 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:09.323 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:09 smithi007 ceph-mon[31360]: pgmap v329: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T04:16:09.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:09 smithi102 ceph-mon[35446]: pgmap v329: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T04:16:09.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.403+0000 7f115f92f640 1 -- 172.21.15.7:0/4043531763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11581008d0 msgr2=0x7f1158100cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:09.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.403+0000 7f115f92f640 1 --2- 172.21.15.7:0/4043531763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11581008d0 0x7f1158100cb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1154009900 tx=0x7f115402a410 comp rx=0 tx=0).stop 2024-09-19T04:16:09.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.403+0000 7f115f92f640 1 -- 172.21.15.7:0/4043531763 shutdown_connections 2024-09-19T04:16:09.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.403+0000 7f115f92f640 1 --2- 172.21.15.7:0/4043531763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f115810e480 0x7f1158110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:09.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.403+0000 7f115f92f640 1 --2- 172.21.15.7:0/4043531763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1158101280 0x7f115810df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:09.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.403+0000 7f115f92f640 1 --2- 172.21.15.7:0/4043531763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11581008d0 0x7f1158100cb0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:09.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.403+0000 7f115f92f640 1 -- 172.21.15.7:0/4043531763 >> 172.21.15.7:0/4043531763 conn(0x7f11580fc7a0 msgr2=0x7f11580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:09.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.404+0000 7f115f92f640 1 -- 172.21.15.7:0/4043531763 shutdown_connections 2024-09-19T04:16:09.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.404+0000 7f115f92f640 1 -- 172.21.15.7:0/4043531763 wait complete. 2024-09-19T04:16:09.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.404+0000 7f115f92f640 1 Processor -- start 2024-09-19T04:16:09.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.404+0000 7f115f92f640 1 -- start start 2024-09-19T04:16:09.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.404+0000 7f115f92f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11581008d0 0x7f115819a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:09.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.404+0000 7f115f92f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1158101280 0x7f115819abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:09.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.404+0000 7f115f92f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f115810e480 0x7f115819ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:09.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.404+0000 7f115f92f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1158114190 con 0x7f11581008d0 2024-09-19T04:16:09.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.404+0000 7f115f92f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1158114010 con 0x7f115810e480 2024-09-19T04:16:09.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.404+0000 7f115f92f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1158114310 con 0x7f1158101280 2024-09-19T04:16:09.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.405+0000 7f115d6cb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11581008d0 0x7f115819a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:09.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.405+0000 7f115d6cb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11581008d0 0x7f115819a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36650/0 (socket says 172.21.15.7:36650) 2024-09-19T04:16:09.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.405+0000 7f115d6cb640 1 -- 172.21.15.7:0/3360907362 learned_addr learned my addr 172.21.15.7:0/3360907362 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:09.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.405+0000 7f115decc640 1 --2- 172.21.15.7:0/3360907362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f115810e480 0x7f115819ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:09.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.405+0000 7f115ceca640 1 --2- 172.21.15.7:0/3360907362 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1158101280 0x7f115819abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:09.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.405+0000 7f115d6cb640 1 -- 172.21.15.7:0/3360907362 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1158101280 msgr2=0x7f115819abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:09.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.405+0000 7f115d6cb640 1 --2- 172.21.15.7:0/3360907362 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1158101280 0x7f115819abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:09.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.405+0000 7f115d6cb640 1 -- 172.21.15.7:0/3360907362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f115810e480 msgr2=0x7f115819ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:09.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.405+0000 7f115d6cb640 1 --2- 172.21.15.7:0/3360907362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f115810e480 0x7f115819ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:09.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.405+0000 7f115d6cb640 1 -- 172.21.15.7:0/3360907362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115819f640 con 0x7f11581008d0 2024-09-19T04:16:09.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.405+0000 7f115decc640 1 --2- 172.21.15.7:0/3360907362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f115810e480 0x7f115819ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:16:09.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.405+0000 7f115d6cb640 1 --2- 172.21.15.7:0/3360907362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11581008d0 0x7f115819a690 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1154006010 tx=0x7f11540042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:09.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.405+0000 7f114e7fc640 1 -- 172.21.15.7:0/3360907362 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115403f030 con 0x7f11581008d0 2024-09-19T04:16:09.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.405+0000 7f114e7fc640 1 -- 172.21.15.7:0/3360907362 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1154003ce0 con 0x7f11581008d0 2024-09-19T04:16:09.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.405+0000 7f115f92f640 1 -- 172.21.15.7:0/3360907362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f115819f8d0 con 0x7f11581008d0 2024-09-19T04:16:09.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.405+0000 7f114e7fc640 1 -- 172.21.15.7:0/3360907362 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1154035070 con 0x7f11581008d0 2024-09-19T04:16:09.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.405+0000 7f115f92f640 1 -- 172.21.15.7:0/3360907362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11581a7210 con 0x7f11581008d0 2024-09-19T04:16:09.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.406+0000 7f115f92f640 1 -- 172.21.15.7:0/3360907362 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f115806b070 con 0x7f11581008d0 2024-09-19T04:16:09.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.408+0000 7f114e7fc640 1 -- 172.21.15.7:0/3360907362 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f1154042030 con 0x7f11581008d0 2024-09-19T04:16:09.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.409+0000 7f114e7fc640 1 --2- 172.21.15.7:0/3360907362 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f11440a32d0 0x7f11440a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:09.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.409+0000 7f114e7fc640 1 -- 172.21.15.7:0/3360907362 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f11540f0850 con 0x7f11581008d0 2024-09-19T04:16:09.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.409+0000 7f115ceca640 1 --2- 172.21.15.7:0/3360907362 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f11440a32d0 0x7f11440a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:09.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.410+0000 7f115ceca640 1 --2- 172.21.15.7:0/3360907362 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f11440a32d0 0x7f11440a5790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1148005fd0 tx=0x7f1148005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:09.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.412+0000 7f114e7fc640 1 -- 172.21.15.7:0/3360907362 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f11540bd130 con 0x7f11581008d0 2024-09-19T04:16:09.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:09 smithi092 ceph-mon[34940]: pgmap v329: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T04:16:09.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.589+0000 7f115f92f640 1 -- 172.21.15.7:0/3360907362 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1158062630 con 0x7f11440a32d0 2024-09-19T04:16:09.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.599+0000 7f114e7fc640 1 -- 172.21.15.7:0/3360907362 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340659 (secure 0 0 0) 0x7f1158062630 con 0x7f11440a32d0 2024-09-19T04:16:09.604 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:16:09.606 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-19T04:16:09.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.603+0000 7f115f92f640 1 -- 172.21.15.7:0/3360907362 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f11440a32d0 msgr2=0x7f11440a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:09.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.603+0000 7f115f92f640 1 --2- 172.21.15.7:0/3360907362 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f11440a32d0 0x7f11440a5790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1148005fd0 tx=0x7f1148005850 comp rx=0 tx=0).stop 2024-09-19T04:16:09.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.603+0000 7f115f92f640 1 -- 172.21.15.7:0/3360907362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11581008d0 msgr2=0x7f115819a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:09.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.603+0000 7f115f92f640 1 --2- 172.21.15.7:0/3360907362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11581008d0 0x7f115819a690 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1154006010 tx=0x7f11540042f0 comp rx=0 tx=0).stop 2024-09-19T04:16:09.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.603+0000 7f115f92f640 1 -- 172.21.15.7:0/3360907362 shutdown_connections 2024-09-19T04:16:09.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.603+0000 7f115f92f640 1 --2- 172.21.15.7:0/3360907362 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f11440a32d0 0x7f11440a5790 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:09.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.603+0000 7f115f92f640 1 --2- 172.21.15.7:0/3360907362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f115810e480 0x7f115819ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:09.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.603+0000 7f115f92f640 1 --2- 172.21.15.7:0/3360907362 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1158101280 0x7f115819abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:09.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.603+0000 7f115f92f640 1 --2- 172.21.15.7:0/3360907362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11581008d0 0x7f115819a690 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:09.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.603+0000 7f115f92f640 1 -- 172.21.15.7:0/3360907362 >> 172.21.15.7:0/3360907362 conn(0x7f11580fc7a0 msgr2=0x7f11580feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:09.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.603+0000 7f115f92f640 1 -- 172.21.15.7:0/3360907362 shutdown_connections 2024-09-19T04:16:09.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:09.603+0000 7f115f92f640 1 -- 172.21.15.7:0/3360907362 wait complete. 2024-09-19T04:16:10.459 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":330,"stamp":"2024-09-19T04:16:09.142980+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662432,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":670,"num_read_kb":460,"num_write":434,"num_write_kb":3085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":355,"ondisk_log_size":355,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":357136,"kb_used_data":11972,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124584688,"statfs":{"total":1151940427776,"available":1151574720512,"internally_reserved":0,"allocated":12259328,"data_stored":7914530,"data_compressed":393084,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19141,"internal_metadata":353154363},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":75,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002873"},"pg_stats":[{"pgid":"2.1f","version":"86'13","reported_seq":99,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:16:06.892532+0000","last_change":"2024-09-19T04:14:31.294836+0000","last_active":"2024-09-19T04:16:06.892532+0000","last_peered":"2024-09-19T04:16:06.892532+0000","last_clean":"2024-09-19T04:16:06.892532+0000","last_became_active":"2024-09-19T04:14:31.294589+0000","last_became_peered":"2024-09-19T04:14:31.294589+0000","last_unstale":"2024-09-19T04:16:06.892532+0000","last_undegraded":"2024-09-19T04:16:06.892532+0000","last_fullsized":"2024-09-19T04:16:06.892532+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:39:54.093519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.997817+0000","last_change":"2024-09-19T04:14:33.316023+0000","last_active":"2024-09-19T04:15:46.997817+0000","last_peered":"2024-09-19T04:15:46.997817+0000","last_clean":"2024-09-19T04:15:46.997817+0000","last_became_active":"2024-09-19T04:14:33.315732+0000","last_became_peered":"2024-09-19T04:14:33.315732+0000","last_unstale":"2024-09-19T04:15:46.997817+0000","last_undegraded":"2024-09-19T04:15:46.997817+0000","last_fullsized":"2024-09-19T04:15:46.997817+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:00.782788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340546+0000","last_change":"2024-09-19T04:14:40.368540+0000","last_active":"2024-09-19T04:15:47.340546+0000","last_peered":"2024-09-19T04:15:47.340546+0000","last_clean":"2024-09-19T04:15:47.340546+0000","last_became_active":"2024-09-19T04:14:40.367906+0000","last_became_peered":"2024-09-19T04:14:40.367906+0000","last_unstale":"2024-09-19T04:15:47.340546+0000","last_undegraded":"2024-09-19T04:15:47.340546+0000","last_fullsized":"2024-09-19T04:15:47.340546+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:35.660297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999819+0000","last_change":"2024-09-19T04:14:31.321870+0000","last_active":"2024-09-19T04:15:46.999819+0000","last_peered":"2024-09-19T04:15:46.999819+0000","last_clean":"2024-09-19T04:15:46.999819+0000","last_became_active":"2024-09-19T04:14:31.321495+0000","last_became_peered":"2024-09-19T04:14:31.321495+0000","last_unstale":"2024-09-19T04:15:46.999819+0000","last_undegraded":"2024-09-19T04:15:46.999819+0000","last_fullsized":"2024-09-19T04:15:46.999819+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:58.063748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340923+0000","last_change":"2024-09-19T04:14:33.307451+0000","last_active":"2024-09-19T04:15:47.340923+0000","last_peered":"2024-09-19T04:15:47.340923+0000","last_clean":"2024-09-19T04:15:47.340923+0000","last_became_active":"2024-09-19T04:14:33.307129+0000","last_became_peered":"2024-09-19T04:14:33.307129+0000","last_unstale":"2024-09-19T04:15:47.340923+0000","last_undegraded":"2024-09-19T04:15:47.340923+0000","last_fullsized":"2024-09-19T04:15:47.340923+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:28.851012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.995349+0000","last_change":"2024-09-19T04:14:40.367946+0000","last_active":"2024-09-19T04:15:46.995349+0000","last_peered":"2024-09-19T04:15:46.995349+0000","last_clean":"2024-09-19T04:15:46.995349+0000","last_became_active":"2024-09-19T04:14:40.367567+0000","last_became_peered":"2024-09-19T04:14:40.367567+0000","last_unstale":"2024-09-19T04:15:46.995349+0000","last_undegraded":"2024-09-19T04:15:46.995349+0000","last_fullsized":"2024-09-19T04:15:46.995349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:14:29.244838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.998310+0000","last_change":"2024-09-19T04:14:31.298497+0000","last_active":"2024-09-19T04:15:46.998310+0000","last_peered":"2024-09-19T04:15:46.998310+0000","last_clean":"2024-09-19T04:15:46.998310+0000","last_became_active":"2024-09-19T04:14:31.298185+0000","last_became_peered":"2024-09-19T04:14:31.298185+0000","last_unstale":"2024-09-19T04:15:46.998310+0000","last_undegraded":"2024-09-19T04:15:46.998310+0000","last_fullsized":"2024-09-19T04:15:46.998310+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:56:12.701718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.341267+0000","last_change":"2024-09-19T04:14:33.316922+0000","last_active":"2024-09-19T04:15:47.341267+0000","last_peered":"2024-09-19T04:15:47.341267+0000","last_clean":"2024-09-19T04:15:47.341267+0000","last_became_active":"2024-09-19T04:14:33.316613+0000","last_became_peered":"2024-09-19T04:14:33.316613+0000","last_unstale":"2024-09-19T04:15:47.341267+0000","last_undegraded":"2024-09-19T04:15:47.341267+0000","last_fullsized":"2024-09-19T04:15:47.341267+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:22.237900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.000772+0000","last_change":"2024-09-19T04:15:47.000772+0000","last_active":"2024-09-19T04:15:47.000772+0000","last_peered":"2024-09-19T04:15:47.000772+0000","last_clean":"2024-09-19T04:15:47.000772+0000","last_became_active":"2024-09-19T04:15:47.000316+0000","last_became_peered":"2024-09-19T04:15:47.000316+0000","last_unstale":"2024-09-19T04:15:47.000772+0000","last_undegraded":"2024-09-19T04:15:47.000772+0000","last_fullsized":"2024-09-19T04:15:47.000772+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:03.292714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.998710+0000","last_change":"2024-09-19T04:14:31.294330+0000","last_active":"2024-09-19T04:15:46.998710+0000","last_peered":"2024-09-19T04:15:46.998710+0000","last_clean":"2024-09-19T04:15:46.998710+0000","last_became_active":"2024-09-19T04:14:31.293025+0000","last_became_peered":"2024-09-19T04:14:31.293025+0000","last_unstale":"2024-09-19T04:15:46.998710+0000","last_undegraded":"2024-09-19T04:15:46.998710+0000","last_fullsized":"2024-09-19T04:15:46.998710+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:48.276096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.996243+0000","last_change":"2024-09-19T04:14:33.313560+0000","last_active":"2024-09-19T04:15:46.996243+0000","last_peered":"2024-09-19T04:15:46.996243+0000","last_clean":"2024-09-19T04:15:46.996243+0000","last_became_active":"2024-09-19T04:14:33.313200+0000","last_became_peered":"2024-09-19T04:14:33.313200+0000","last_unstale":"2024-09-19T04:15:46.996243+0000","last_undegraded":"2024-09-19T04:15:46.996243+0000","last_fullsized":"2024-09-19T04:15:46.996243+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:33.807866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.995450+0000","last_change":"2024-09-19T04:14:40.368125+0000","last_active":"2024-09-19T04:15:46.995450+0000","last_peered":"2024-09-19T04:15:46.995450+0000","last_clean":"2024-09-19T04:15:46.995450+0000","last_became_active":"2024-09-19T04:14:40.367772+0000","last_became_peered":"2024-09-19T04:14:40.367772+0000","last_unstale":"2024-09-19T04:15:46.995450+0000","last_undegraded":"2024-09-19T04:15:46.995450+0000","last_fullsized":"2024-09-19T04:15:46.995450+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:07:19.740391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999371+0000","last_change":"2024-09-19T04:14:33.307489+0000","last_active":"2024-09-19T04:15:46.999371+0000","last_peered":"2024-09-19T04:15:46.999371+0000","last_clean":"2024-09-19T04:15:46.999371+0000","last_became_active":"2024-09-19T04:14:33.307143+0000","last_became_peered":"2024-09-19T04:14:33.307143+0000","last_unstale":"2024-09-19T04:15:46.999371+0000","last_undegraded":"2024-09-19T04:15:46.999371+0000","last_fullsized":"2024-09-19T04:15:46.999371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:51:14.018972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.998118+0000","last_change":"2024-09-19T04:14:31.299342+0000","last_active":"2024-09-19T04:15:46.998118+0000","last_peered":"2024-09-19T04:15:46.998118+0000","last_clean":"2024-09-19T04:15:46.998118+0000","last_became_active":"2024-09-19T04:14:31.298927+0000","last_became_peered":"2024-09-19T04:14:31.298927+0000","last_unstale":"2024-09-19T04:15:46.998118+0000","last_undegraded":"2024-09-19T04:15:46.998118+0000","last_fullsized":"2024-09-19T04:15:46.998118+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:38.483077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.995552+0000","last_change":"2024-09-19T04:14:40.405762+0000","last_active":"2024-09-19T04:15:46.995552+0000","last_peered":"2024-09-19T04:15:46.995552+0000","last_clean":"2024-09-19T04:15:46.995552+0000","last_became_active":"2024-09-19T04:14:40.405379+0000","last_became_peered":"2024-09-19T04:14:40.405379+0000","last_unstale":"2024-09-19T04:15:46.995552+0000","last_undegraded":"2024-09-19T04:15:46.995552+0000","last_fullsized":"2024-09-19T04:15:46.995552+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:41:36.628112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.997561+0000","last_change":"2024-09-19T04:14:33.318521+0000","last_active":"2024-09-19T04:15:46.997561+0000","last_peered":"2024-09-19T04:15:46.997561+0000","last_clean":"2024-09-19T04:15:46.997561+0000","last_became_active":"2024-09-19T04:14:33.318200+0000","last_became_peered":"2024-09-19T04:14:33.318200+0000","last_unstale":"2024-09-19T04:15:46.997561+0000","last_undegraded":"2024-09-19T04:15:46.997561+0000","last_fullsized":"2024-09-19T04:15:46.997561+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:45.497455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.341147+0000","last_change":"2024-09-19T04:14:31.299976+0000","last_active":"2024-09-19T04:15:47.341147+0000","last_peered":"2024-09-19T04:15:47.341147+0000","last_clean":"2024-09-19T04:15:47.341147+0000","last_became_active":"2024-09-19T04:14:31.299630+0000","last_became_peered":"2024-09-19T04:14:31.299630+0000","last_unstale":"2024-09-19T04:15:47.341147+0000","last_undegraded":"2024-09-19T04:15:47.341147+0000","last_fullsized":"2024-09-19T04:15:47.341147+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:14:00.834440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.995589+0000","last_change":"2024-09-19T04:14:40.366110+0000","last_active":"2024-09-19T04:15:46.995589+0000","last_peered":"2024-09-19T04:15:46.995589+0000","last_clean":"2024-09-19T04:15:46.995589+0000","last_became_active":"2024-09-19T04:14:40.365558+0000","last_became_peered":"2024-09-19T04:14:40.365558+0000","last_unstale":"2024-09-19T04:15:46.995589+0000","last_undegraded":"2024-09-19T04:15:46.995589+0000","last_fullsized":"2024-09-19T04:15:46.995589+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:24.049603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.171098+0000","last_change":"2024-09-19T04:14:33.307400+0000","last_active":"2024-09-19T04:15:47.171098+0000","last_peered":"2024-09-19T04:15:47.171098+0000","last_clean":"2024-09-19T04:15:47.171098+0000","last_became_active":"2024-09-19T04:14:33.307095+0000","last_became_peered":"2024-09-19T04:14:33.307095+0000","last_unstale":"2024-09-19T04:15:47.171098+0000","last_undegraded":"2024-09-19T04:15:47.171098+0000","last_fullsized":"2024-09-19T04:15:47.171098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:27.582568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.997941+0000","last_change":"2024-09-19T04:14:31.287190+0000","last_active":"2024-09-19T04:15:46.997941+0000","last_peered":"2024-09-19T04:15:46.997941+0000","last_clean":"2024-09-19T04:15:46.997941+0000","last_became_active":"2024-09-19T04:14:31.286817+0000","last_became_peered":"2024-09-19T04:14:31.286817+0000","last_unstale":"2024-09-19T04:15:46.997941+0000","last_undegraded":"2024-09-19T04:15:46.997941+0000","last_fullsized":"2024-09-19T04:15:46.997941+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:44.522615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.994771+0000","last_change":"2024-09-19T04:14:40.372153+0000","last_active":"2024-09-19T04:15:46.994771+0000","last_peered":"2024-09-19T04:15:46.994771+0000","last_clean":"2024-09-19T04:15:46.994771+0000","last_became_active":"2024-09-19T04:14:40.371309+0000","last_became_peered":"2024-09-19T04:14:40.371309+0000","last_unstale":"2024-09-19T04:15:46.994771+0000","last_undegraded":"2024-09-19T04:15:46.994771+0000","last_fullsized":"2024-09-19T04:15:46.994771+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:46.608489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.996630+0000","last_change":"2024-09-19T04:14:33.310884+0000","last_active":"2024-09-19T04:15:46.996630+0000","last_peered":"2024-09-19T04:15:46.996630+0000","last_clean":"2024-09-19T04:15:46.996630+0000","last_became_active":"2024-09-19T04:14:33.310532+0000","last_became_peered":"2024-09-19T04:14:33.310532+0000","last_unstale":"2024-09-19T04:15:46.996630+0000","last_undegraded":"2024-09-19T04:15:46.996630+0000","last_fullsized":"2024-09-19T04:15:46.996630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:49:16.565018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.341025+0000","last_change":"2024-09-19T04:14:31.322216+0000","last_active":"2024-09-19T04:15:47.341025+0000","last_peered":"2024-09-19T04:15:47.341025+0000","last_clean":"2024-09-19T04:15:47.341025+0000","last_became_active":"2024-09-19T04:14:31.321941+0000","last_became_peered":"2024-09-19T04:14:31.321941+0000","last_unstale":"2024-09-19T04:15:47.341025+0000","last_undegraded":"2024-09-19T04:15:47.341025+0000","last_fullsized":"2024-09-19T04:15:47.341025+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:14.624104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.995880+0000","last_change":"2024-09-19T04:14:40.405749+0000","last_active":"2024-09-19T04:15:46.995880+0000","last_peered":"2024-09-19T04:15:46.995880+0000","last_clean":"2024-09-19T04:15:46.995880+0000","last_became_active":"2024-09-19T04:14:40.405353+0000","last_became_peered":"2024-09-19T04:14:40.405353+0000","last_unstale":"2024-09-19T04:15:46.995880+0000","last_undegraded":"2024-09-19T04:15:46.995880+0000","last_fullsized":"2024-09-19T04:15:46.995880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:13.311989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340880+0000","last_change":"2024-09-19T04:14:33.312057+0000","last_active":"2024-09-19T04:15:47.340880+0000","last_peered":"2024-09-19T04:15:47.340880+0000","last_clean":"2024-09-19T04:15:47.340880+0000","last_became_active":"2024-09-19T04:14:33.311751+0000","last_became_peered":"2024-09-19T04:14:33.311751+0000","last_unstale":"2024-09-19T04:15:47.340880+0000","last_undegraded":"2024-09-19T04:15:47.340880+0000","last_fullsized":"2024-09-19T04:15:47.340880+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:28.843870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.996373+0000","last_change":"2024-09-19T04:14:31.287529+0000","last_active":"2024-09-19T04:15:46.996373+0000","last_peered":"2024-09-19T04:15:46.996373+0000","last_clean":"2024-09-19T04:15:46.996373+0000","last_became_active":"2024-09-19T04:14:31.287172+0000","last_became_peered":"2024-09-19T04:14:31.287172+0000","last_unstale":"2024-09-19T04:15:46.996373+0000","last_undegraded":"2024-09-19T04:15:46.996373+0000","last_fullsized":"2024-09-19T04:15:46.996373+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:32:23.351997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340559+0000","last_change":"2024-09-19T04:14:40.363772+0000","last_active":"2024-09-19T04:15:47.340559+0000","last_peered":"2024-09-19T04:15:47.340559+0000","last_clean":"2024-09-19T04:15:47.340559+0000","last_became_active":"2024-09-19T04:14:40.363395+0000","last_became_peered":"2024-09-19T04:14:40.363395+0000","last_unstale":"2024-09-19T04:15:47.340559+0000","last_undegraded":"2024-09-19T04:15:47.340559+0000","last_fullsized":"2024-09-19T04:15:47.340559+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:22.090743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.998155+0000","last_change":"2024-09-19T04:14:33.310108+0000","last_active":"2024-09-19T04:15:46.998155+0000","last_peered":"2024-09-19T04:15:46.998155+0000","last_clean":"2024-09-19T04:15:46.998155+0000","last_became_active":"2024-09-19T04:14:33.309812+0000","last_became_peered":"2024-09-19T04:14:33.309812+0000","last_unstale":"2024-09-19T04:15:46.998155+0000","last_undegraded":"2024-09-19T04:15:46.998155+0000","last_fullsized":"2024-09-19T04:15:46.998155+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:48.570530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'16","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.994917+0000","last_change":"2024-09-19T04:14:31.293115+0000","last_active":"2024-09-19T04:15:46.994917+0000","last_peered":"2024-09-19T04:15:46.994917+0000","last_clean":"2024-09-19T04:15:46.994917+0000","last_became_active":"2024-09-19T04:14:31.292733+0000","last_became_peered":"2024-09-19T04:14:31.292733+0000","last_unstale":"2024-09-19T04:15:46.994917+0000","last_undegraded":"2024-09-19T04:15:46.994917+0000","last_fullsized":"2024-09-19T04:15:46.994917+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:11.936757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.997600+0000","last_change":"2024-09-19T04:14:40.405241+0000","last_active":"2024-09-19T04:15:46.997600+0000","last_peered":"2024-09-19T04:15:46.997600+0000","last_clean":"2024-09-19T04:15:46.997600+0000","last_became_active":"2024-09-19T04:14:40.404846+0000","last_became_peered":"2024-09-19T04:14:40.404846+0000","last_unstale":"2024-09-19T04:15:46.997600+0000","last_undegraded":"2024-09-19T04:15:46.997600+0000","last_fullsized":"2024-09-19T04:15:46.997600+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:49.842644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999718+0000","last_change":"2024-09-19T04:14:33.305796+0000","last_active":"2024-09-19T04:15:46.999718+0000","last_peered":"2024-09-19T04:15:46.999718+0000","last_clean":"2024-09-19T04:15:46.999718+0000","last_became_active":"2024-09-19T04:14:33.305499+0000","last_became_peered":"2024-09-19T04:14:33.305499+0000","last_unstale":"2024-09-19T04:15:46.999718+0000","last_undegraded":"2024-09-19T04:15:46.999718+0000","last_fullsized":"2024-09-19T04:15:46.999718+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:08.357655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.998283+0000","last_change":"2024-09-19T04:14:31.322459+0000","last_active":"2024-09-19T04:15:46.998283+0000","last_peered":"2024-09-19T04:15:46.998283+0000","last_clean":"2024-09-19T04:15:46.998283+0000","last_became_active":"2024-09-19T04:14:31.322149+0000","last_became_peered":"2024-09-19T04:14:31.322149+0000","last_unstale":"2024-09-19T04:15:46.998283+0000","last_undegraded":"2024-09-19T04:15:46.998283+0000","last_fullsized":"2024-09-19T04:15:46.998283+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:06:15.208618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.171072+0000","last_change":"2024-09-19T04:14:40.372869+0000","last_active":"2024-09-19T04:15:47.171072+0000","last_peered":"2024-09-19T04:15:47.171072+0000","last_clean":"2024-09-19T04:15:47.171072+0000","last_became_active":"2024-09-19T04:14:40.372203+0000","last_became_peered":"2024-09-19T04:14:40.372203+0000","last_unstale":"2024-09-19T04:15:47.171072+0000","last_undegraded":"2024-09-19T04:15:47.171072+0000","last_fullsized":"2024-09-19T04:15:47.171072+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:34.900656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.996371+0000","last_change":"2024-09-19T04:14:33.315443+0000","last_active":"2024-09-19T04:15:46.996371+0000","last_peered":"2024-09-19T04:15:46.996371+0000","last_clean":"2024-09-19T04:15:46.996371+0000","last_became_active":"2024-09-19T04:14:33.315067+0000","last_became_peered":"2024-09-19T04:14:33.315067+0000","last_unstale":"2024-09-19T04:15:46.996371+0000","last_undegraded":"2024-09-19T04:15:46.996371+0000","last_fullsized":"2024-09-19T04:15:46.996371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:59.194674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.994586+0000","last_change":"2024-09-19T04:14:31.322623+0000","last_active":"2024-09-19T04:15:46.994586+0000","last_peered":"2024-09-19T04:15:46.994586+0000","last_clean":"2024-09-19T04:15:46.994586+0000","last_became_active":"2024-09-19T04:14:31.321838+0000","last_became_peered":"2024-09-19T04:14:31.321838+0000","last_unstale":"2024-09-19T04:15:46.994586+0000","last_undegraded":"2024-09-19T04:15:46.994586+0000","last_fullsized":"2024-09-19T04:15:46.994586+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:30:37.073072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.343430+0000","last_change":"2024-09-19T04:15:47.343430+0000","last_active":"2024-09-19T04:15:47.343430+0000","last_peered":"2024-09-19T04:15:47.343430+0000","last_clean":"2024-09-19T04:15:47.343430+0000","last_became_active":"2024-09-19T04:15:47.342319+0000","last_became_peered":"2024-09-19T04:15:47.342319+0000","last_unstale":"2024-09-19T04:15:47.343430+0000","last_undegraded":"2024-09-19T04:15:47.343430+0000","last_fullsized":"2024-09-19T04:15:47.343430+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:05.641357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.997135+0000","last_change":"2024-09-19T04:14:33.319748+0000","last_active":"2024-09-19T04:15:46.997135+0000","last_peered":"2024-09-19T04:15:46.997135+0000","last_clean":"2024-09-19T04:15:46.997135+0000","last_became_active":"2024-09-19T04:14:33.319173+0000","last_became_peered":"2024-09-19T04:14:33.319173+0000","last_unstale":"2024-09-19T04:15:46.997135+0000","last_undegraded":"2024-09-19T04:15:46.997135+0000","last_fullsized":"2024-09-19T04:15:46.997135+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:24.419811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'6","reported_seq":93,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:16:06.893147+0000","last_change":"2024-09-19T04:14:31.292077+0000","last_active":"2024-09-19T04:16:06.893147+0000","last_peered":"2024-09-19T04:16:06.893147+0000","last_clean":"2024-09-19T04:16:06.893147+0000","last_became_active":"2024-09-19T04:14:31.291737+0000","last_became_peered":"2024-09-19T04:14:31.291737+0000","last_unstale":"2024-09-19T04:16:06.893147+0000","last_undegraded":"2024-09-19T04:16:06.893147+0000","last_fullsized":"2024-09-19T04:16:06.893147+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:32.570641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999346+0000","last_change":"2024-09-19T04:14:40.369734+0000","last_active":"2024-09-19T04:15:46.999346+0000","last_peered":"2024-09-19T04:15:46.999346+0000","last_clean":"2024-09-19T04:15:46.999346+0000","last_became_active":"2024-09-19T04:14:40.367563+0000","last_became_peered":"2024-09-19T04:14:40.367563+0000","last_unstale":"2024-09-19T04:15:46.999346+0000","last_undegraded":"2024-09-19T04:15:46.999346+0000","last_fullsized":"2024-09-19T04:15:46.999346+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:47.229115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.995334+0000","last_change":"2024-09-19T04:14:33.309687+0000","last_active":"2024-09-19T04:15:46.995334+0000","last_peered":"2024-09-19T04:15:46.995334+0000","last_clean":"2024-09-19T04:15:46.995334+0000","last_became_active":"2024-09-19T04:14:33.308692+0000","last_became_peered":"2024-09-19T04:14:33.308692+0000","last_unstale":"2024-09-19T04:15:46.995334+0000","last_undegraded":"2024-09-19T04:15:46.995334+0000","last_fullsized":"2024-09-19T04:15:46.995334+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:58.716927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":90,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:16:05.891627+0000","last_change":"2024-09-19T04:14:31.322024+0000","last_active":"2024-09-19T04:16:05.891627+0000","last_peered":"2024-09-19T04:16:05.891627+0000","last_clean":"2024-09-19T04:16:05.891627+0000","last_became_active":"2024-09-19T04:14:31.321640+0000","last_became_peered":"2024-09-19T04:14:31.321640+0000","last_unstale":"2024-09-19T04:16:05.891627+0000","last_undegraded":"2024-09-19T04:16:05.891627+0000","last_fullsized":"2024-09-19T04:16:05.891627+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:25:36.159774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999770+0000","last_change":"2024-09-19T04:14:40.405793+0000","last_active":"2024-09-19T04:15:46.999770+0000","last_peered":"2024-09-19T04:15:46.999770+0000","last_clean":"2024-09-19T04:15:46.999770+0000","last_became_active":"2024-09-19T04:14:40.405354+0000","last_became_peered":"2024-09-19T04:14:40.405354+0000","last_unstale":"2024-09-19T04:15:46.999770+0000","last_undegraded":"2024-09-19T04:15:46.999770+0000","last_fullsized":"2024-09-19T04:15:46.999770+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:46:37.893202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.998455+0000","last_change":"2024-09-19T04:14:33.313007+0000","last_active":"2024-09-19T04:15:46.998455+0000","last_peered":"2024-09-19T04:15:46.998455+0000","last_clean":"2024-09-19T04:15:46.998455+0000","last_became_active":"2024-09-19T04:14:33.312665+0000","last_became_peered":"2024-09-19T04:14:33.312665+0000","last_unstale":"2024-09-19T04:15:46.998455+0000","last_undegraded":"2024-09-19T04:15:46.998455+0000","last_fullsized":"2024-09-19T04:15:46.998455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:09.976707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999219+0000","last_change":"2024-09-19T04:14:31.294072+0000","last_active":"2024-09-19T04:15:46.999219+0000","last_peered":"2024-09-19T04:15:46.999219+0000","last_clean":"2024-09-19T04:15:46.999219+0000","last_became_active":"2024-09-19T04:14:31.293648+0000","last_became_peered":"2024-09-19T04:14:31.293648+0000","last_unstale":"2024-09-19T04:15:46.999219+0000","last_undegraded":"2024-09-19T04:15:46.999219+0000","last_fullsized":"2024-09-19T04:15:46.999219+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:14.910714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.996363+0000","last_change":"2024-09-19T04:14:40.406327+0000","last_active":"2024-09-19T04:15:46.996363+0000","last_peered":"2024-09-19T04:15:46.996363+0000","last_clean":"2024-09-19T04:15:46.996363+0000","last_became_active":"2024-09-19T04:14:40.405602+0000","last_became_peered":"2024-09-19T04:14:40.405602+0000","last_unstale":"2024-09-19T04:15:46.996363+0000","last_undegraded":"2024-09-19T04:15:46.996363+0000","last_fullsized":"2024-09-19T04:15:46.996363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:47:23.078480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.343123+0000","last_change":"2024-09-19T04:15:47.342605+0000","last_active":"2024-09-19T04:15:47.343123+0000","last_peered":"2024-09-19T04:15:47.343123+0000","last_clean":"2024-09-19T04:15:47.343123+0000","last_became_active":"2024-09-19T04:15:47.342215+0000","last_became_peered":"2024-09-19T04:15:47.342215+0000","last_unstale":"2024-09-19T04:15:47.343123+0000","last_undegraded":"2024-09-19T04:15:47.343123+0000","last_fullsized":"2024-09-19T04:15:47.343123+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:01.315513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,1],"acting":[9,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.997709+0000","last_change":"2024-09-19T04:14:31.290207+0000","last_active":"2024-09-19T04:15:46.997709+0000","last_peered":"2024-09-19T04:15:46.997709+0000","last_clean":"2024-09-19T04:15:46.997709+0000","last_became_active":"2024-09-19T04:14:31.289863+0000","last_became_peered":"2024-09-19T04:14:31.289863+0000","last_unstale":"2024-09-19T04:15:46.997709+0000","last_undegraded":"2024-09-19T04:15:46.997709+0000","last_fullsized":"2024-09-19T04:15:46.997709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:39.241894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":347,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999731+0000","last_change":"2024-09-19T04:13:20.845240+0000","last_active":"2024-09-19T04:15:46.999731+0000","last_peered":"2024-09-19T04:15:46.999731+0000","last_clean":"2024-09-19T04:15:46.999731+0000","last_became_active":"2024-09-19T04:13:20.844771+0000","last_became_peered":"2024-09-19T04:13:20.844771+0000","last_unstale":"2024-09-19T04:15:46.999731+0000","last_undegraded":"2024-09-19T04:15:46.999731+0000","last_fullsized":"2024-09-19T04:15:46.999731+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:09:59.809148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:09:59.809148+0000","last_clean_scrub_stamp":"2024-09-19T04:09:59.809148+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:12:29.694263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999371+0000","last_change":"2024-09-19T04:14:40.369257+0000","last_active":"2024-09-19T04:15:46.999371+0000","last_peered":"2024-09-19T04:15:46.999371+0000","last_clean":"2024-09-19T04:15:46.999371+0000","last_became_active":"2024-09-19T04:14:40.368865+0000","last_became_peered":"2024-09-19T04:14:40.368865+0000","last_unstale":"2024-09-19T04:15:46.999371+0000","last_undegraded":"2024-09-19T04:15:46.999371+0000","last_fullsized":"2024-09-19T04:15:46.999371+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:37:52.120157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999615+0000","last_change":"2024-09-19T04:14:33.311221+0000","last_active":"2024-09-19T04:15:46.999615+0000","last_peered":"2024-09-19T04:15:46.999615+0000","last_clean":"2024-09-19T04:15:46.999615+0000","last_became_active":"2024-09-19T04:14:33.310886+0000","last_became_peered":"2024-09-19T04:14:33.310886+0000","last_unstale":"2024-09-19T04:15:46.999615+0000","last_undegraded":"2024-09-19T04:15:46.999615+0000","last_fullsized":"2024-09-19T04:15:46.999615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:04:32.348676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":88,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:16:02.888358+0000","last_change":"2024-09-19T04:14:31.322464+0000","last_active":"2024-09-19T04:16:02.888358+0000","last_peered":"2024-09-19T04:16:02.888358+0000","last_clean":"2024-09-19T04:16:02.888358+0000","last_became_active":"2024-09-19T04:14:31.322115+0000","last_became_peered":"2024-09-19T04:14:31.322115+0000","last_unstale":"2024-09-19T04:16:02.888358+0000","last_undegraded":"2024-09-19T04:16:02.888358+0000","last_fullsized":"2024-09-19T04:16:02.888358+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:24:27.623328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.341062+0000","last_change":"2024-09-19T04:14:40.371391+0000","last_active":"2024-09-19T04:15:47.341062+0000","last_peered":"2024-09-19T04:15:47.341062+0000","last_clean":"2024-09-19T04:15:47.341062+0000","last_became_active":"2024-09-19T04:14:40.371091+0000","last_became_peered":"2024-09-19T04:14:40.371091+0000","last_unstale":"2024-09-19T04:15:47.341062+0000","last_undegraded":"2024-09-19T04:15:47.341062+0000","last_fullsized":"2024-09-19T04:15:47.341062+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:39:14.889348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.003652+0000","last_change":"2024-09-19T04:15:47.003652+0000","last_active":"2024-09-19T04:15:47.003652+0000","last_peered":"2024-09-19T04:15:47.003652+0000","last_clean":"2024-09-19T04:15:47.003652+0000","last_became_active":"2024-09-19T04:15:47.003226+0000","last_became_peered":"2024-09-19T04:15:47.003226+0000","last_unstale":"2024-09-19T04:15:47.003652+0000","last_undegraded":"2024-09-19T04:15:47.003652+0000","last_fullsized":"2024-09-19T04:15:47.003652+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:38.948427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.996505+0000","last_change":"2024-09-19T04:14:31.293156+0000","last_active":"2024-09-19T04:15:46.996505+0000","last_peered":"2024-09-19T04:15:46.996505+0000","last_clean":"2024-09-19T04:15:46.996505+0000","last_became_active":"2024-09-19T04:14:31.292772+0000","last_became_peered":"2024-09-19T04:14:31.292772+0000","last_unstale":"2024-09-19T04:15:46.996505+0000","last_undegraded":"2024-09-19T04:15:46.996505+0000","last_fullsized":"2024-09-19T04:15:46.996505+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:03:18.530662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340781+0000","last_change":"2024-09-19T04:14:40.371434+0000","last_active":"2024-09-19T04:15:47.340781+0000","last_peered":"2024-09-19T04:15:47.340781+0000","last_clean":"2024-09-19T04:15:47.340781+0000","last_became_active":"2024-09-19T04:14:40.371037+0000","last_became_peered":"2024-09-19T04:14:40.371037+0000","last_unstale":"2024-09-19T04:15:47.340781+0000","last_undegraded":"2024-09-19T04:15:47.340781+0000","last_fullsized":"2024-09-19T04:15:47.340781+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:43:34.787860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999782+0000","last_change":"2024-09-19T04:14:33.308321+0000","last_active":"2024-09-19T04:15:46.999782+0000","last_peered":"2024-09-19T04:15:46.999782+0000","last_clean":"2024-09-19T04:15:46.999782+0000","last_became_active":"2024-09-19T04:14:33.307983+0000","last_became_peered":"2024-09-19T04:14:33.307983+0000","last_unstale":"2024-09-19T04:15:46.999782+0000","last_undegraded":"2024-09-19T04:15:46.999782+0000","last_fullsized":"2024-09-19T04:15:46.999782+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:46.202123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.000028+0000","last_change":"2024-09-19T04:14:31.297326+0000","last_active":"2024-09-19T04:15:47.000028+0000","last_peered":"2024-09-19T04:15:47.000028+0000","last_clean":"2024-09-19T04:15:47.000028+0000","last_became_active":"2024-09-19T04:14:31.297056+0000","last_became_peered":"2024-09-19T04:14:31.297056+0000","last_unstale":"2024-09-19T04:15:47.000028+0000","last_undegraded":"2024-09-19T04:15:47.000028+0000","last_fullsized":"2024-09-19T04:15:47.000028+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:15:26.324855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.995224+0000","last_change":"2024-09-19T04:14:40.370123+0000","last_active":"2024-09-19T04:15:46.995224+0000","last_peered":"2024-09-19T04:15:46.995224+0000","last_clean":"2024-09-19T04:15:46.995224+0000","last_became_active":"2024-09-19T04:14:40.367758+0000","last_became_peered":"2024-09-19T04:14:40.367758+0000","last_unstale":"2024-09-19T04:15:46.995224+0000","last_undegraded":"2024-09-19T04:15:46.995224+0000","last_fullsized":"2024-09-19T04:15:46.995224+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:07.932122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.171290+0000","last_change":"2024-09-19T04:14:33.314239+0000","last_active":"2024-09-19T04:15:47.171290+0000","last_peered":"2024-09-19T04:15:47.171290+0000","last_clean":"2024-09-19T04:15:47.171290+0000","last_became_active":"2024-09-19T04:14:33.313918+0000","last_became_peered":"2024-09-19T04:14:33.313918+0000","last_unstale":"2024-09-19T04:15:47.171290+0000","last_undegraded":"2024-09-19T04:15:47.171290+0000","last_fullsized":"2024-09-19T04:15:47.171290+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:00:12.756505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.998618+0000","last_change":"2024-09-19T04:14:31.295377+0000","last_active":"2024-09-19T04:15:46.998618+0000","last_peered":"2024-09-19T04:15:46.998618+0000","last_clean":"2024-09-19T04:15:46.998618+0000","last_became_active":"2024-09-19T04:14:31.295042+0000","last_became_peered":"2024-09-19T04:14:31.295042+0000","last_unstale":"2024-09-19T04:15:46.998618+0000","last_undegraded":"2024-09-19T04:15:46.998618+0000","last_fullsized":"2024-09-19T04:15:46.998618+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:35.842847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.995402+0000","last_change":"2024-09-19T04:14:40.370790+0000","last_active":"2024-09-19T04:15:46.995402+0000","last_peered":"2024-09-19T04:15:46.995402+0000","last_clean":"2024-09-19T04:15:46.995402+0000","last_became_active":"2024-09-19T04:14:40.370377+0000","last_became_peered":"2024-09-19T04:14:40.370377+0000","last_unstale":"2024-09-19T04:15:46.995402+0000","last_undegraded":"2024-09-19T04:15:46.995402+0000","last_fullsized":"2024-09-19T04:15:46.995402+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:09.331769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.342260+0000","last_change":"2024-09-19T04:15:47.342260+0000","last_active":"2024-09-19T04:15:47.342260+0000","last_peered":"2024-09-19T04:15:47.342260+0000","last_clean":"2024-09-19T04:15:47.342260+0000","last_became_active":"2024-09-19T04:15:47.341713+0000","last_became_peered":"2024-09-19T04:15:47.341713+0000","last_unstale":"2024-09-19T04:15:47.342260+0000","last_undegraded":"2024-09-19T04:15:47.342260+0000","last_fullsized":"2024-09-19T04:15:47.342260+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:25:47.822844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.996625+0000","last_change":"2024-09-19T04:14:31.322413+0000","last_active":"2024-09-19T04:15:46.996625+0000","last_peered":"2024-09-19T04:15:46.996625+0000","last_clean":"2024-09-19T04:15:46.996625+0000","last_became_active":"2024-09-19T04:14:31.322082+0000","last_became_peered":"2024-09-19T04:14:31.322082+0000","last_unstale":"2024-09-19T04:15:46.996625+0000","last_undegraded":"2024-09-19T04:15:46.996625+0000","last_fullsized":"2024-09-19T04:15:46.996625+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:50.010021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999993+0000","last_change":"2024-09-19T04:14:40.373071+0000","last_active":"2024-09-19T04:15:46.999993+0000","last_peered":"2024-09-19T04:15:46.999993+0000","last_clean":"2024-09-19T04:15:46.999993+0000","last_became_active":"2024-09-19T04:14:40.372679+0000","last_became_peered":"2024-09-19T04:14:40.372679+0000","last_unstale":"2024-09-19T04:15:46.999993+0000","last_undegraded":"2024-09-19T04:15:46.999993+0000","last_fullsized":"2024-09-19T04:15:46.999993+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:23.136807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999111+0000","last_change":"2024-09-19T04:14:33.319165+0000","last_active":"2024-09-19T04:15:46.999111+0000","last_peered":"2024-09-19T04:15:46.999111+0000","last_clean":"2024-09-19T04:15:46.999111+0000","last_became_active":"2024-09-19T04:14:33.318830+0000","last_became_peered":"2024-09-19T04:14:33.318830+0000","last_unstale":"2024-09-19T04:15:46.999111+0000","last_undegraded":"2024-09-19T04:15:46.999111+0000","last_fullsized":"2024-09-19T04:15:46.999111+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:05:43.936069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'6","reported_seq":95,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:16:07.904375+0000","last_change":"2024-09-19T04:14:31.291564+0000","last_active":"2024-09-19T04:16:07.904375+0000","last_peered":"2024-09-19T04:16:07.904375+0000","last_clean":"2024-09-19T04:16:07.904375+0000","last_became_active":"2024-09-19T04:14:31.291241+0000","last_became_peered":"2024-09-19T04:14:31.291241+0000","last_unstale":"2024-09-19T04:16:07.904375+0000","last_undegraded":"2024-09-19T04:16:07.904375+0000","last_fullsized":"2024-09-19T04:16:07.904375+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:38:09.419140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.994799+0000","last_change":"2024-09-19T04:14:40.371707+0000","last_active":"2024-09-19T04:15:46.994799+0000","last_peered":"2024-09-19T04:15:46.994799+0000","last_clean":"2024-09-19T04:15:46.994799+0000","last_became_active":"2024-09-19T04:14:40.370767+0000","last_became_peered":"2024-09-19T04:14:40.370767+0000","last_unstale":"2024-09-19T04:15:46.994799+0000","last_undegraded":"2024-09-19T04:15:46.994799+0000","last_fullsized":"2024-09-19T04:15:46.994799+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:38.022486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999437+0000","last_change":"2024-09-19T04:14:33.316098+0000","last_active":"2024-09-19T04:15:46.999437+0000","last_peered":"2024-09-19T04:15:46.999437+0000","last_clean":"2024-09-19T04:15:46.999437+0000","last_became_active":"2024-09-19T04:14:33.315755+0000","last_became_peered":"2024-09-19T04:14:33.315755+0000","last_unstale":"2024-09-19T04:15:46.999437+0000","last_undegraded":"2024-09-19T04:15:46.999437+0000","last_fullsized":"2024-09-19T04:15:46.999437+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:45:01.531200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.996132+0000","last_change":"2024-09-19T04:14:31.291145+0000","last_active":"2024-09-19T04:15:46.996132+0000","last_peered":"2024-09-19T04:15:46.996132+0000","last_clean":"2024-09-19T04:15:46.996132+0000","last_became_active":"2024-09-19T04:14:31.290763+0000","last_became_peered":"2024-09-19T04:14:31.290763+0000","last_unstale":"2024-09-19T04:15:46.996132+0000","last_undegraded":"2024-09-19T04:15:46.996132+0000","last_fullsized":"2024-09-19T04:15:46.996132+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:37.556544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.171167+0000","last_change":"2024-09-19T04:14:40.371371+0000","last_active":"2024-09-19T04:15:47.171167+0000","last_peered":"2024-09-19T04:15:47.171167+0000","last_clean":"2024-09-19T04:15:47.171167+0000","last_became_active":"2024-09-19T04:14:40.370988+0000","last_became_peered":"2024-09-19T04:14:40.370988+0000","last_unstale":"2024-09-19T04:15:47.171167+0000","last_undegraded":"2024-09-19T04:15:47.171167+0000","last_fullsized":"2024-09-19T04:15:47.171167+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:57.089953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.003980+0000","last_change":"2024-09-19T04:15:47.003980+0000","last_active":"2024-09-19T04:15:47.003980+0000","last_peered":"2024-09-19T04:15:47.003980+0000","last_clean":"2024-09-19T04:15:47.003980+0000","last_became_active":"2024-09-19T04:15:47.003573+0000","last_became_peered":"2024-09-19T04:15:47.003573+0000","last_unstale":"2024-09-19T04:15:47.003980+0000","last_undegraded":"2024-09-19T04:15:47.003980+0000","last_fullsized":"2024-09-19T04:15:47.003980+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:35:12.971378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.341051+0000","last_change":"2024-09-19T04:14:31.297106+0000","last_active":"2024-09-19T04:15:47.341051+0000","last_peered":"2024-09-19T04:15:47.341051+0000","last_clean":"2024-09-19T04:15:47.341051+0000","last_became_active":"2024-09-19T04:14:31.296688+0000","last_became_peered":"2024-09-19T04:14:31.296688+0000","last_unstale":"2024-09-19T04:15:47.341051+0000","last_undegraded":"2024-09-19T04:15:47.341051+0000","last_fullsized":"2024-09-19T04:15:47.341051+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:18.882219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.996175+0000","last_change":"2024-09-19T04:14:40.371641+0000","last_active":"2024-09-19T04:15:46.996175+0000","last_peered":"2024-09-19T04:15:46.996175+0000","last_clean":"2024-09-19T04:15:46.996175+0000","last_became_active":"2024-09-19T04:14:40.370354+0000","last_became_peered":"2024-09-19T04:14:40.370354+0000","last_unstale":"2024-09-19T04:15:46.996175+0000","last_undegraded":"2024-09-19T04:15:46.996175+0000","last_fullsized":"2024-09-19T04:15:46.996175+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:01:11.572011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.998083+0000","last_change":"2024-09-19T04:14:33.307767+0000","last_active":"2024-09-19T04:15:46.998083+0000","last_peered":"2024-09-19T04:15:46.998083+0000","last_clean":"2024-09-19T04:15:46.998083+0000","last_became_active":"2024-09-19T04:14:33.307396+0000","last_became_peered":"2024-09-19T04:14:33.307396+0000","last_unstale":"2024-09-19T04:15:46.998083+0000","last_undegraded":"2024-09-19T04:15:46.998083+0000","last_fullsized":"2024-09-19T04:15:46.998083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:21.018641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'36","reported_seq":180,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:16:06.893269+0000","last_change":"2024-09-19T04:14:31.298106+0000","last_active":"2024-09-19T04:16:06.893269+0000","last_peered":"2024-09-19T04:16:06.893269+0000","last_clean":"2024-09-19T04:16:06.893269+0000","last_became_active":"2024-09-19T04:14:31.297731+0000","last_became_peered":"2024-09-19T04:14:31.297731+0000","last_unstale":"2024-09-19T04:16:06.893269+0000","last_undegraded":"2024-09-19T04:16:06.893269+0000","last_fullsized":"2024-09-19T04:16:06.893269+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:29.127759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64622,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":118,"num_write":38,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.994494+0000","last_change":"2024-09-19T04:14:40.372927+0000","last_active":"2024-09-19T04:15:46.994494+0000","last_peered":"2024-09-19T04:15:46.994494+0000","last_clean":"2024-09-19T04:15:46.994494+0000","last_became_active":"2024-09-19T04:14:40.372521+0000","last_became_peered":"2024-09-19T04:14:40.372521+0000","last_unstale":"2024-09-19T04:15:46.994494+0000","last_undegraded":"2024-09-19T04:15:46.994494+0000","last_fullsized":"2024-09-19T04:15:46.994494+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:15:00.863812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.341257+0000","last_change":"2024-09-19T04:14:33.308154+0000","last_active":"2024-09-19T04:15:47.341257+0000","last_peered":"2024-09-19T04:15:47.341257+0000","last_clean":"2024-09-19T04:15:47.341257+0000","last_became_active":"2024-09-19T04:14:33.307831+0000","last_became_peered":"2024-09-19T04:14:33.307831+0000","last_unstale":"2024-09-19T04:15:47.341257+0000","last_undegraded":"2024-09-19T04:15:47.341257+0000","last_fullsized":"2024-09-19T04:15:47.341257+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:16:14.656133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.996398+0000","last_change":"2024-09-19T04:14:31.324011+0000","last_active":"2024-09-19T04:15:46.996398+0000","last_peered":"2024-09-19T04:15:46.996398+0000","last_clean":"2024-09-19T04:15:46.996398+0000","last_became_active":"2024-09-19T04:14:31.323622+0000","last_became_peered":"2024-09-19T04:14:31.323622+0000","last_unstale":"2024-09-19T04:15:46.996398+0000","last_undegraded":"2024-09-19T04:15:46.996398+0000","last_fullsized":"2024-09-19T04:15:46.996398+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:39.198602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.997502+0000","last_change":"2024-09-19T04:14:40.365938+0000","last_active":"2024-09-19T04:15:46.997502+0000","last_peered":"2024-09-19T04:15:46.997502+0000","last_clean":"2024-09-19T04:15:46.997502+0000","last_became_active":"2024-09-19T04:14:40.365539+0000","last_became_peered":"2024-09-19T04:14:40.365539+0000","last_unstale":"2024-09-19T04:15:46.997502+0000","last_undegraded":"2024-09-19T04:15:46.997502+0000","last_fullsized":"2024-09-19T04:15:46.997502+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:09.723008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340994+0000","last_change":"2024-09-19T04:14:33.316286+0000","last_active":"2024-09-19T04:15:47.340994+0000","last_peered":"2024-09-19T04:15:47.340994+0000","last_clean":"2024-09-19T04:15:47.340994+0000","last_became_active":"2024-09-19T04:14:33.315980+0000","last_became_peered":"2024-09-19T04:14:33.315980+0000","last_unstale":"2024-09-19T04:15:47.340994+0000","last_undegraded":"2024-09-19T04:15:47.340994+0000","last_fullsized":"2024-09-19T04:15:47.340994+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:58.383139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999508+0000","last_change":"2024-09-19T04:14:31.299111+0000","last_active":"2024-09-19T04:15:46.999508+0000","last_peered":"2024-09-19T04:15:46.999508+0000","last_clean":"2024-09-19T04:15:46.999508+0000","last_became_active":"2024-09-19T04:14:31.298390+0000","last_became_peered":"2024-09-19T04:14:31.298390+0000","last_unstale":"2024-09-19T04:15:46.999508+0000","last_undegraded":"2024-09-19T04:15:46.999508+0000","last_fullsized":"2024-09-19T04:15:46.999508+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:39.710412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.993971+0000","last_change":"2024-09-19T04:14:40.371108+0000","last_active":"2024-09-19T04:15:46.993971+0000","last_peered":"2024-09-19T04:15:46.993971+0000","last_clean":"2024-09-19T04:15:46.993971+0000","last_became_active":"2024-09-19T04:14:40.370729+0000","last_became_peered":"2024-09-19T04:14:40.370729+0000","last_unstale":"2024-09-19T04:15:46.993971+0000","last_undegraded":"2024-09-19T04:15:46.993971+0000","last_fullsized":"2024-09-19T04:15:46.993971+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:59.610235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.341573+0000","last_change":"2024-09-19T04:14:33.314423+0000","last_active":"2024-09-19T04:15:47.341573+0000","last_peered":"2024-09-19T04:15:47.341573+0000","last_clean":"2024-09-19T04:15:47.341573+0000","last_became_active":"2024-09-19T04:14:33.314123+0000","last_became_peered":"2024-09-19T04:14:33.314123+0000","last_unstale":"2024-09-19T04:15:47.341573+0000","last_undegraded":"2024-09-19T04:15:47.341573+0000","last_fullsized":"2024-09-19T04:15:47.341573+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:29:57.781116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":138,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:16:06.893243+0000","last_change":"2024-09-19T04:14:31.293267+0000","last_active":"2024-09-19T04:16:06.893243+0000","last_peered":"2024-09-19T04:16:06.893243+0000","last_clean":"2024-09-19T04:16:06.893243+0000","last_became_active":"2024-09-19T04:14:31.292862+0000","last_became_peered":"2024-09-19T04:14:31.292862+0000","last_unstale":"2024-09-19T04:16:06.893243+0000","last_undegraded":"2024-09-19T04:16:06.893243+0000","last_fullsized":"2024-09-19T04:16:06.893243+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:37.876696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.997419+0000","last_change":"2024-09-19T04:14:40.373078+0000","last_active":"2024-09-19T04:15:46.997419+0000","last_peered":"2024-09-19T04:15:46.997419+0000","last_clean":"2024-09-19T04:15:46.997419+0000","last_became_active":"2024-09-19T04:14:40.372468+0000","last_became_peered":"2024-09-19T04:14:40.372468+0000","last_unstale":"2024-09-19T04:15:46.997419+0000","last_undegraded":"2024-09-19T04:15:46.997419+0000","last_fullsized":"2024-09-19T04:15:46.997419+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:54.945801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340624+0000","last_change":"2024-09-19T04:14:40.368946+0000","last_active":"2024-09-19T04:15:47.340624+0000","last_peered":"2024-09-19T04:15:47.340624+0000","last_clean":"2024-09-19T04:15:47.340624+0000","last_became_active":"2024-09-19T04:14:40.368549+0000","last_became_peered":"2024-09-19T04:14:40.368549+0000","last_unstale":"2024-09-19T04:15:47.340624+0000","last_undegraded":"2024-09-19T04:15:47.340624+0000","last_fullsized":"2024-09-19T04:15:47.340624+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:24.563488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.994141+0000","last_change":"2024-09-19T04:14:33.307214+0000","last_active":"2024-09-19T04:15:46.994141+0000","last_peered":"2024-09-19T04:15:46.994141+0000","last_clean":"2024-09-19T04:15:46.994141+0000","last_became_active":"2024-09-19T04:14:33.306913+0000","last_became_peered":"2024-09-19T04:14:33.306913+0000","last_unstale":"2024-09-19T04:15:46.994141+0000","last_undegraded":"2024-09-19T04:15:46.994141+0000","last_fullsized":"2024-09-19T04:15:46.994141+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:49.402532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.995450+0000","last_change":"2024-09-19T04:14:31.294488+0000","last_active":"2024-09-19T04:15:46.995450+0000","last_peered":"2024-09-19T04:15:46.995450+0000","last_clean":"2024-09-19T04:15:46.995450+0000","last_became_active":"2024-09-19T04:14:31.294145+0000","last_became_peered":"2024-09-19T04:14:31.294145+0000","last_unstale":"2024-09-19T04:15:46.995450+0000","last_undegraded":"2024-09-19T04:15:46.995450+0000","last_fullsized":"2024-09-19T04:15:46.995450+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:28:19.411650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.171301+0000","last_change":"2024-09-19T04:14:40.372366+0000","last_active":"2024-09-19T04:15:47.171301+0000","last_peered":"2024-09-19T04:15:47.171301+0000","last_clean":"2024-09-19T04:15:47.171301+0000","last_became_active":"2024-09-19T04:14:40.371922+0000","last_became_peered":"2024-09-19T04:14:40.371922+0000","last_unstale":"2024-09-19T04:15:47.171301+0000","last_undegraded":"2024-09-19T04:15:47.171301+0000","last_fullsized":"2024-09-19T04:15:47.171301+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:55:01.724088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.997775+0000","last_change":"2024-09-19T04:14:33.308351+0000","last_active":"2024-09-19T04:15:46.997775+0000","last_peered":"2024-09-19T04:15:46.997775+0000","last_clean":"2024-09-19T04:15:46.997775+0000","last_became_active":"2024-09-19T04:14:33.308052+0000","last_became_peered":"2024-09-19T04:14:33.308052+0000","last_unstale":"2024-09-19T04:15:46.997775+0000","last_undegraded":"2024-09-19T04:15:46.997775+0000","last_fullsized":"2024-09-19T04:15:46.997775+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:06:32.056738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.998564+0000","last_change":"2024-09-19T04:14:31.291742+0000","last_active":"2024-09-19T04:15:46.998564+0000","last_peered":"2024-09-19T04:15:46.998564+0000","last_clean":"2024-09-19T04:15:46.998564+0000","last_became_active":"2024-09-19T04:14:31.291315+0000","last_became_peered":"2024-09-19T04:14:31.291315+0000","last_unstale":"2024-09-19T04:15:46.998564+0000","last_undegraded":"2024-09-19T04:15:46.998564+0000","last_fullsized":"2024-09-19T04:15:46.998564+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:16.159276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.997207+0000","last_change":"2024-09-19T04:14:31.293898+0000","last_active":"2024-09-19T04:15:46.997207+0000","last_peered":"2024-09-19T04:15:46.997207+0000","last_clean":"2024-09-19T04:15:46.997207+0000","last_became_active":"2024-09-19T04:14:31.293499+0000","last_became_peered":"2024-09-19T04:14:31.293499+0000","last_unstale":"2024-09-19T04:15:46.997207+0000","last_undegraded":"2024-09-19T04:15:46.997207+0000","last_fullsized":"2024-09-19T04:15:46.997207+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:25:55.590644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.995929+0000","last_change":"2024-09-19T04:14:33.314094+0000","last_active":"2024-09-19T04:15:46.995929+0000","last_peered":"2024-09-19T04:15:46.995929+0000","last_clean":"2024-09-19T04:15:46.995929+0000","last_became_active":"2024-09-19T04:14:33.312782+0000","last_became_peered":"2024-09-19T04:14:33.312782+0000","last_unstale":"2024-09-19T04:15:46.995929+0000","last_undegraded":"2024-09-19T04:15:46.995929+0000","last_fullsized":"2024-09-19T04:15:46.995929+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:40.121676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.341154+0000","last_change":"2024-09-19T04:14:40.369159+0000","last_active":"2024-09-19T04:15:47.341154+0000","last_peered":"2024-09-19T04:15:47.341154+0000","last_clean":"2024-09-19T04:15:47.341154+0000","last_became_active":"2024-09-19T04:14:40.368732+0000","last_became_peered":"2024-09-19T04:14:40.368732+0000","last_unstale":"2024-09-19T04:15:47.341154+0000","last_undegraded":"2024-09-19T04:15:47.341154+0000","last_fullsized":"2024-09-19T04:15:47.341154+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:12:29.176834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":92,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:16:06.893978+0000","last_change":"2024-09-19T04:14:31.298260+0000","last_active":"2024-09-19T04:16:06.893978+0000","last_peered":"2024-09-19T04:16:06.893978+0000","last_clean":"2024-09-19T04:16:06.893978+0000","last_became_active":"2024-09-19T04:14:31.297802+0000","last_became_peered":"2024-09-19T04:14:31.297802+0000","last_unstale":"2024-09-19T04:16:06.893978+0000","last_undegraded":"2024-09-19T04:16:06.893978+0000","last_fullsized":"2024-09-19T04:16:06.893978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:25:52.054848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.998108+0000","last_change":"2024-09-19T04:14:33.300555+0000","last_active":"2024-09-19T04:15:46.998108+0000","last_peered":"2024-09-19T04:15:46.998108+0000","last_clean":"2024-09-19T04:15:46.998108+0000","last_became_active":"2024-09-19T04:14:33.300220+0000","last_became_peered":"2024-09-19T04:14:33.300220+0000","last_unstale":"2024-09-19T04:15:46.998108+0000","last_undegraded":"2024-09-19T04:15:46.998108+0000","last_fullsized":"2024-09-19T04:15:46.998108+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:32.584140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.341239+0000","last_change":"2024-09-19T04:14:40.369471+0000","last_active":"2024-09-19T04:15:47.341239+0000","last_peered":"2024-09-19T04:15:47.341239+0000","last_clean":"2024-09-19T04:15:47.341239+0000","last_became_active":"2024-09-19T04:14:40.369065+0000","last_became_peered":"2024-09-19T04:14:40.369065+0000","last_unstale":"2024-09-19T04:15:47.341239+0000","last_undegraded":"2024-09-19T04:15:47.341239+0000","last_fullsized":"2024-09-19T04:15:47.341239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:40:03.888553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.170985+0000","last_change":"2024-09-19T04:14:33.312801+0000","last_active":"2024-09-19T04:15:47.170985+0000","last_peered":"2024-09-19T04:15:47.170985+0000","last_clean":"2024-09-19T04:15:47.170985+0000","last_became_active":"2024-09-19T04:14:33.312430+0000","last_became_peered":"2024-09-19T04:14:33.312430+0000","last_unstale":"2024-09-19T04:15:47.170985+0000","last_undegraded":"2024-09-19T04:15:47.170985+0000","last_fullsized":"2024-09-19T04:15:47.170985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:29.069507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.341004+0000","last_change":"2024-09-19T04:14:33.313076+0000","last_active":"2024-09-19T04:15:47.341004+0000","last_peered":"2024-09-19T04:15:47.341004+0000","last_clean":"2024-09-19T04:15:47.341004+0000","last_became_active":"2024-09-19T04:14:33.312730+0000","last_became_peered":"2024-09-19T04:14:33.312730+0000","last_unstale":"2024-09-19T04:15:47.341004+0000","last_undegraded":"2024-09-19T04:15:47.341004+0000","last_fullsized":"2024-09-19T04:15:47.341004+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:33.397309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340631+0000","last_change":"2024-09-19T04:14:33.314724+0000","last_active":"2024-09-19T04:15:47.340631+0000","last_peered":"2024-09-19T04:15:47.340631+0000","last_clean":"2024-09-19T04:15:47.340631+0000","last_became_active":"2024-09-19T04:14:33.314359+0000","last_became_peered":"2024-09-19T04:14:33.314359+0000","last_unstale":"2024-09-19T04:15:47.340631+0000","last_undegraded":"2024-09-19T04:15:47.340631+0000","last_fullsized":"2024-09-19T04:15:47.340631+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:37:39.357193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340817+0000","last_change":"2024-09-19T04:14:33.312834+0000","last_active":"2024-09-19T04:15:47.340817+0000","last_peered":"2024-09-19T04:15:47.340817+0000","last_clean":"2024-09-19T04:15:47.340817+0000","last_became_active":"2024-09-19T04:14:33.312538+0000","last_became_peered":"2024-09-19T04:14:33.312538+0000","last_unstale":"2024-09-19T04:15:47.340817+0000","last_undegraded":"2024-09-19T04:15:47.340817+0000","last_fullsized":"2024-09-19T04:15:47.340817+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:25:37.694910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999613+0000","last_change":"2024-09-19T04:14:33.305735+0000","last_active":"2024-09-19T04:15:46.999613+0000","last_peered":"2024-09-19T04:15:46.999613+0000","last_clean":"2024-09-19T04:15:46.999613+0000","last_became_active":"2024-09-19T04:14:33.305415+0000","last_became_peered":"2024-09-19T04:14:33.305415+0000","last_unstale":"2024-09-19T04:15:46.999613+0000","last_undegraded":"2024-09-19T04:15:46.999613+0000","last_fullsized":"2024-09-19T04:15:46.999613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:20.160211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.171395+0000","last_change":"2024-09-19T04:14:33.313379+0000","last_active":"2024-09-19T04:15:47.171395+0000","last_peered":"2024-09-19T04:15:47.171395+0000","last_clean":"2024-09-19T04:15:47.171395+0000","last_became_active":"2024-09-19T04:14:33.312453+0000","last_became_peered":"2024-09-19T04:14:33.312453+0000","last_unstale":"2024-09-19T04:15:47.171395+0000","last_undegraded":"2024-09-19T04:15:47.171395+0000","last_fullsized":"2024-09-19T04:15:47.171395+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:44.832004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340859+0000","last_change":"2024-09-19T04:14:33.307371+0000","last_active":"2024-09-19T04:15:47.340859+0000","last_peered":"2024-09-19T04:15:47.340859+0000","last_clean":"2024-09-19T04:15:47.340859+0000","last_became_active":"2024-09-19T04:14:33.307033+0000","last_became_peered":"2024-09-19T04:14:33.307033+0000","last_unstale":"2024-09-19T04:15:47.340859+0000","last_undegraded":"2024-09-19T04:15:47.340859+0000","last_fullsized":"2024-09-19T04:15:47.340859+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:12.027213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.342412+0000","last_change":"2024-09-19T04:15:47.342412+0000","last_active":"2024-09-19T04:15:47.342412+0000","last_peered":"2024-09-19T04:15:47.342412+0000","last_clean":"2024-09-19T04:15:47.342412+0000","last_became_active":"2024-09-19T04:15:47.341989+0000","last_became_peered":"2024-09-19T04:15:47.341989+0000","last_unstale":"2024-09-19T04:15:47.342412+0000","last_undegraded":"2024-09-19T04:15:47.342412+0000","last_fullsized":"2024-09-19T04:15:47.342412+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:32.713199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.995296+0000","last_change":"2024-09-19T04:14:33.314296+0000","last_active":"2024-09-19T04:15:46.995296+0000","last_peered":"2024-09-19T04:15:46.995296+0000","last_clean":"2024-09-19T04:15:46.995296+0000","last_became_active":"2024-09-19T04:14:33.311230+0000","last_became_peered":"2024-09-19T04:14:33.311230+0000","last_unstale":"2024-09-19T04:15:46.995296+0000","last_undegraded":"2024-09-19T04:15:46.995296+0000","last_fullsized":"2024-09-19T04:15:46.995296+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:37:51.395086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.997973+0000","last_change":"2024-09-19T04:14:33.317125+0000","last_active":"2024-09-19T04:15:46.997973+0000","last_peered":"2024-09-19T04:15:46.997973+0000","last_clean":"2024-09-19T04:15:46.997973+0000","last_became_active":"2024-09-19T04:14:33.316805+0000","last_became_peered":"2024-09-19T04:14:33.316805+0000","last_unstale":"2024-09-19T04:15:46.997973+0000","last_undegraded":"2024-09-19T04:15:46.997973+0000","last_fullsized":"2024-09-19T04:15:46.997973+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:27.754882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.341370+0000","last_change":"2024-09-19T04:14:33.310081+0000","last_active":"2024-09-19T04:15:47.341370+0000","last_peered":"2024-09-19T04:15:47.341370+0000","last_clean":"2024-09-19T04:15:47.341370+0000","last_became_active":"2024-09-19T04:14:33.308675+0000","last_became_peered":"2024-09-19T04:14:33.308675+0000","last_unstale":"2024-09-19T04:15:47.341370+0000","last_undegraded":"2024-09-19T04:15:47.341370+0000","last_fullsized":"2024-09-19T04:15:47.341370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:58.187633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999445+0000","last_change":"2024-09-19T04:14:33.308220+0000","last_active":"2024-09-19T04:15:46.999445+0000","last_peered":"2024-09-19T04:15:46.999445+0000","last_clean":"2024-09-19T04:15:46.999445+0000","last_became_active":"2024-09-19T04:14:33.307934+0000","last_became_peered":"2024-09-19T04:14:33.307934+0000","last_unstale":"2024-09-19T04:15:46.999445+0000","last_undegraded":"2024-09-19T04:15:46.999445+0000","last_fullsized":"2024-09-19T04:15:46.999445+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:22.490250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.171295+0000","last_change":"2024-09-19T04:14:33.306617+0000","last_active":"2024-09-19T04:15:47.171295+0000","last_peered":"2024-09-19T04:15:47.171295+0000","last_clean":"2024-09-19T04:15:47.171295+0000","last_became_active":"2024-09-19T04:14:33.306244+0000","last_became_peered":"2024-09-19T04:14:33.306244+0000","last_unstale":"2024-09-19T04:15:47.171295+0000","last_undegraded":"2024-09-19T04:15:47.171295+0000","last_fullsized":"2024-09-19T04:15:47.171295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:22.095989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.341222+0000","last_change":"2024-09-19T04:14:33.314915+0000","last_active":"2024-09-19T04:15:47.341222+0000","last_peered":"2024-09-19T04:15:47.341222+0000","last_clean":"2024-09-19T04:15:47.341222+0000","last_became_active":"2024-09-19T04:14:33.314601+0000","last_became_peered":"2024-09-19T04:14:33.314601+0000","last_unstale":"2024-09-19T04:15:47.341222+0000","last_undegraded":"2024-09-19T04:15:47.341222+0000","last_fullsized":"2024-09-19T04:15:47.341222+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:37.687964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.994796+0000","last_change":"2024-09-19T04:14:33.304667+0000","last_active":"2024-09-19T04:15:46.994796+0000","last_peered":"2024-09-19T04:15:46.994796+0000","last_clean":"2024-09-19T04:15:46.994796+0000","last_became_active":"2024-09-19T04:14:33.304356+0000","last_became_peered":"2024-09-19T04:14:33.304356+0000","last_unstale":"2024-09-19T04:15:46.994796+0000","last_undegraded":"2024-09-19T04:15:46.994796+0000","last_fullsized":"2024-09-19T04:15:46.994796+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:37.128074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.171570+0000","last_change":"2024-09-19T04:14:33.310002+0000","last_active":"2024-09-19T04:15:47.171570+0000","last_peered":"2024-09-19T04:15:47.171570+0000","last_clean":"2024-09-19T04:15:47.171570+0000","last_became_active":"2024-09-19T04:14:33.309639+0000","last_became_peered":"2024-09-19T04:14:33.309639+0000","last_unstale":"2024-09-19T04:15:47.171570+0000","last_undegraded":"2024-09-19T04:15:47.171570+0000","last_fullsized":"2024-09-19T04:15:47.171570+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:21.954435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340871+0000","last_change":"2024-09-19T04:14:33.307296+0000","last_active":"2024-09-19T04:15:47.340871+0000","last_peered":"2024-09-19T04:15:47.340871+0000","last_clean":"2024-09-19T04:15:47.340871+0000","last_became_active":"2024-09-19T04:14:33.306998+0000","last_became_peered":"2024-09-19T04:14:33.306998+0000","last_unstale":"2024-09-19T04:15:47.340871+0000","last_undegraded":"2024-09-19T04:15:47.340871+0000","last_fullsized":"2024-09-19T04:15:47.340871+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:55.833196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340613+0000","last_change":"2024-09-19T04:14:33.313568+0000","last_active":"2024-09-19T04:15:47.340613+0000","last_peered":"2024-09-19T04:15:47.340613+0000","last_clean":"2024-09-19T04:15:47.340613+0000","last_became_active":"2024-09-19T04:14:33.313228+0000","last_became_peered":"2024-09-19T04:14:33.313228+0000","last_unstale":"2024-09-19T04:15:47.340613+0000","last_undegraded":"2024-09-19T04:15:47.340613+0000","last_fullsized":"2024-09-19T04:15:47.340613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:31:43.348866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340528+0000","last_change":"2024-09-19T04:14:33.309745+0000","last_active":"2024-09-19T04:15:47.340528+0000","last_peered":"2024-09-19T04:15:47.340528+0000","last_clean":"2024-09-19T04:15:47.340528+0000","last_became_active":"2024-09-19T04:14:33.309327+0000","last_became_peered":"2024-09-19T04:14:33.309327+0000","last_unstale":"2024-09-19T04:15:47.340528+0000","last_undegraded":"2024-09-19T04:15:47.340528+0000","last_fullsized":"2024-09-19T04:15:47.340528+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:05.081550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999345+0000","last_change":"2024-09-19T04:14:33.306186+0000","last_active":"2024-09-19T04:15:46.999345+0000","last_peered":"2024-09-19T04:15:46.999345+0000","last_clean":"2024-09-19T04:15:46.999345+0000","last_became_active":"2024-09-19T04:14:33.305865+0000","last_became_peered":"2024-09-19T04:14:33.305865+0000","last_unstale":"2024-09-19T04:15:46.999345+0000","last_undegraded":"2024-09-19T04:15:46.999345+0000","last_fullsized":"2024-09-19T04:15:46.999345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:33.054326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.995843+0000","last_change":"2024-09-19T04:14:33.307667+0000","last_active":"2024-09-19T04:15:46.995843+0000","last_peered":"2024-09-19T04:15:46.995843+0000","last_clean":"2024-09-19T04:15:46.995843+0000","last_became_active":"2024-09-19T04:14:33.307315+0000","last_became_peered":"2024-09-19T04:14:33.307315+0000","last_unstale":"2024-09-19T04:15:46.995843+0000","last_undegraded":"2024-09-19T04:15:46.995843+0000","last_fullsized":"2024-09-19T04:15:46.995843+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:52.209438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999500+0000","last_change":"2024-09-19T04:14:33.312430+0000","last_active":"2024-09-19T04:15:46.999500+0000","last_peered":"2024-09-19T04:15:46.999500+0000","last_clean":"2024-09-19T04:15:46.999500+0000","last_became_active":"2024-09-19T04:14:33.311786+0000","last_became_peered":"2024-09-19T04:14:33.311786+0000","last_unstale":"2024-09-19T04:15:46.999500+0000","last_undegraded":"2024-09-19T04:15:46.999500+0000","last_fullsized":"2024-09-19T04:15:46.999500+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:17:25.785612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.997972+0000","last_change":"2024-09-19T04:14:33.310478+0000","last_active":"2024-09-19T04:15:46.997972+0000","last_peered":"2024-09-19T04:15:46.997972+0000","last_clean":"2024-09-19T04:15:46.997972+0000","last_became_active":"2024-09-19T04:14:33.309960+0000","last_became_peered":"2024-09-19T04:14:33.309960+0000","last_unstale":"2024-09-19T04:15:46.997972+0000","last_undegraded":"2024-09-19T04:15:46.997972+0000","last_fullsized":"2024-09-19T04:15:46.997972+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:37:43.008022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.341628+0000","last_change":"2024-09-19T04:14:33.312449+0000","last_active":"2024-09-19T04:15:47.341628+0000","last_peered":"2024-09-19T04:15:47.341628+0000","last_clean":"2024-09-19T04:15:47.341628+0000","last_became_active":"2024-09-19T04:14:33.312124+0000","last_became_peered":"2024-09-19T04:14:33.312124+0000","last_unstale":"2024-09-19T04:15:47.341628+0000","last_undegraded":"2024-09-19T04:15:47.341628+0000","last_fullsized":"2024-09-19T04:15:47.341628+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:53.556895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.997298+0000","last_change":"2024-09-19T04:14:33.317095+0000","last_active":"2024-09-19T04:15:46.997298+0000","last_peered":"2024-09-19T04:15:46.997298+0000","last_clean":"2024-09-19T04:15:46.997298+0000","last_became_active":"2024-09-19T04:14:33.316763+0000","last_became_peered":"2024-09-19T04:14:33.316763+0000","last_unstale":"2024-09-19T04:15:46.997298+0000","last_undegraded":"2024-09-19T04:15:46.997298+0000","last_fullsized":"2024-09-19T04:15:46.997298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:14.894679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999193+0000","last_change":"2024-09-19T04:14:33.316578+0000","last_active":"2024-09-19T04:15:46.999193+0000","last_peered":"2024-09-19T04:15:46.999193+0000","last_clean":"2024-09-19T04:15:46.999193+0000","last_became_active":"2024-09-19T04:14:33.316215+0000","last_became_peered":"2024-09-19T04:14:33.316215+0000","last_unstale":"2024-09-19T04:15:46.999193+0000","last_undegraded":"2024-09-19T04:15:46.999193+0000","last_fullsized":"2024-09-19T04:15:46.999193+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:18.770360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.000540+0000","last_change":"2024-09-19T04:15:47.000540+0000","last_active":"2024-09-19T04:15:47.000540+0000","last_peered":"2024-09-19T04:15:47.000540+0000","last_clean":"2024-09-19T04:15:47.000540+0000","last_became_active":"2024-09-19T04:15:47.000155+0000","last_became_peered":"2024-09-19T04:15:47.000155+0000","last_unstale":"2024-09-19T04:15:47.000540+0000","last_undegraded":"2024-09-19T04:15:47.000540+0000","last_fullsized":"2024-09-19T04:15:47.000540+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:19.055366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.997264+0000","last_change":"2024-09-19T04:14:33.309468+0000","last_active":"2024-09-19T04:15:46.997264+0000","last_peered":"2024-09-19T04:15:46.997264+0000","last_clean":"2024-09-19T04:15:46.997264+0000","last_became_active":"2024-09-19T04:14:33.309164+0000","last_became_peered":"2024-09-19T04:14:33.309164+0000","last_unstale":"2024-09-19T04:15:46.997264+0000","last_undegraded":"2024-09-19T04:15:46.997264+0000","last_fullsized":"2024-09-19T04:15:46.997264+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:05:19.193395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.343118+0000","last_change":"2024-09-19T04:15:47.342502+0000","last_active":"2024-09-19T04:15:47.343118+0000","last_peered":"2024-09-19T04:15:47.343118+0000","last_clean":"2024-09-19T04:15:47.343118+0000","last_became_active":"2024-09-19T04:15:47.342127+0000","last_became_peered":"2024-09-19T04:15:47.342127+0000","last_unstale":"2024-09-19T04:15:47.343118+0000","last_undegraded":"2024-09-19T04:15:47.343118+0000","last_fullsized":"2024-09-19T04:15:47.343118+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:47.192614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340733+0000","last_change":"2024-09-19T04:14:33.308268+0000","last_active":"2024-09-19T04:15:47.340733+0000","last_peered":"2024-09-19T04:15:47.340733+0000","last_clean":"2024-09-19T04:15:47.340733+0000","last_became_active":"2024-09-19T04:14:33.307945+0000","last_became_peered":"2024-09-19T04:14:33.307945+0000","last_unstale":"2024-09-19T04:15:47.340733+0000","last_undegraded":"2024-09-19T04:15:47.340733+0000","last_fullsized":"2024-09-19T04:15:47.340733+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:24.410351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340755+0000","last_change":"2024-09-19T04:14:33.315522+0000","last_active":"2024-09-19T04:15:47.340755+0000","last_peered":"2024-09-19T04:15:47.340755+0000","last_clean":"2024-09-19T04:15:47.340755+0000","last_became_active":"2024-09-19T04:14:33.315220+0000","last_became_peered":"2024-09-19T04:14:33.315220+0000","last_unstale":"2024-09-19T04:15:47.340755+0000","last_undegraded":"2024-09-19T04:15:47.340755+0000","last_fullsized":"2024-09-19T04:15:47.340755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:41:40.915933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.171470+0000","last_change":"2024-09-19T04:14:33.309450+0000","last_active":"2024-09-19T04:15:47.171470+0000","last_peered":"2024-09-19T04:15:47.171470+0000","last_clean":"2024-09-19T04:15:47.171470+0000","last_became_active":"2024-09-19T04:14:33.309013+0000","last_became_peered":"2024-09-19T04:14:33.309013+0000","last_unstale":"2024-09-19T04:15:47.171470+0000","last_undegraded":"2024-09-19T04:15:47.171470+0000","last_fullsized":"2024-09-19T04:15:47.171470+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:49.523372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71830,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":544,"num_read_kb":351,"num_write":251,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":215490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285207,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579937,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":974848,"data_stored":496552,"data_compressed":23691,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808870,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28132,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717020,"statfs":{"total":95995035648,"available":95966228480,"internally_reserved":0,"allocated":1126400,"data_stored":1148383,"data_compressed":59955,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972395,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1003520,"data_stored":500578,"data_compressed":23691,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201327,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":995328,"data_stored":496860,"data_compressed":23691,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430260,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1048576,"data_stored":1093752,"data_compressed":59955,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593786,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":492379,"data_compressed":23691,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822719,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1056768,"data_stored":1088548,"data_compressed":59955,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986243,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":496453,"data_compressed":23691,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215176,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":987136,"data_stored":491694,"data_compressed":23691,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411405,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1064960,"data_stored":557858,"data_compressed":23691,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1044480,"data_stored":558031,"data_compressed":23691,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":999424,"data_stored":493442,"data_compressed":23691,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34629,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34629,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34629,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":66767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":66594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":66751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T04:16:10.468 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T04:16:10.731 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:11.105 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:11 smithi007 ceph-mon[31360]: pgmap v330: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T04:16:11.105 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:11 smithi007 ceph-mon[31360]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:16:11.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.181+0000 7fabf5dc6640 1 -- 172.21.15.7:0/2201120708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf0103660 msgr2=0x7fabf010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:11.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.181+0000 7fabf5dc6640 1 --2- 172.21.15.7:0/2201120708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf0103660 0x7fabf010bb50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fabe4009900 tx=0x7fabe402a480 comp rx=0 tx=0).stop 2024-09-19T04:16:11.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.181+0000 7fabf5dc6640 1 -- 172.21.15.7:0/2201120708 shutdown_connections 2024-09-19T04:16:11.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.181+0000 7fabf5dc6640 1 --2- 172.21.15.7:0/2201120708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabf010c170 0x7fabf010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:11.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.181+0000 7fabf5dc6640 1 --2- 172.21.15.7:0/2201120708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf0103660 0x7fabf010bb50 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:11.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.181+0000 7fabf5dc6640 1 --2- 172.21.15.7:0/2201120708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabf0102d40 0x7fabf0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:11.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.181+0000 7fabf5dc6640 1 -- 172.21.15.7:0/2201120708 >> 172.21.15.7:0/2201120708 conn(0x7fabf00fc7a0 msgr2=0x7fabf00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:11.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.181+0000 7fabf5dc6640 1 -- 172.21.15.7:0/2201120708 shutdown_connections 2024-09-19T04:16:11.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.181+0000 7fabf5dc6640 1 -- 172.21.15.7:0/2201120708 wait complete. 2024-09-19T04:16:11.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.182+0000 7fabf5dc6640 1 Processor -- start 2024-09-19T04:16:11.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.182+0000 7fabf5dc6640 1 -- start start 2024-09-19T04:16:11.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.182+0000 7fabf5dc6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabf0102d40 0x7fabf01009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:11.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.182+0000 7fabf5dc6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabf0103660 0x7fabf0100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:11.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.182+0000 7fabf5dc6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf010c170 0x7fabf0101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:11.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.182+0000 7fabf5dc6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fabf0111f70 con 0x7fabf010c170 2024-09-19T04:16:11.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.182+0000 7fabf5dc6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fabf0111df0 con 0x7fabf0103660 2024-09-19T04:16:11.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.182+0000 7fabf5dc6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fabf01120f0 con 0x7fabf0102d40 2024-09-19T04:16:11.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.182+0000 7fabeffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf010c170 0x7fabf0101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:11.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.182+0000 7fabeffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf010c170 0x7fabf0101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36662/0 (socket says 172.21.15.7:36662) 2024-09-19T04:16:11.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.182+0000 7fabeffff640 1 -- 172.21.15.7:0/2534084698 learned_addr learned my addr 172.21.15.7:0/2534084698 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:11.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.182+0000 7fabeeffd640 1 --2- 172.21.15.7:0/2534084698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabf0103660 0x7fabf0100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:11.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.182+0000 7fabef7fe640 1 --2- 172.21.15.7:0/2534084698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabf0102d40 0x7fabf01009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:11.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.183+0000 7fabeffff640 1 -- 172.21.15.7:0/2534084698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabf0102d40 msgr2=0x7fabf01009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:11.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.183+0000 7fabeffff640 1 --2- 172.21.15.7:0/2534084698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabf0102d40 0x7fabf01009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:11.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.183+0000 7fabeffff640 1 -- 172.21.15.7:0/2534084698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabf0103660 msgr2=0x7fabf0100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:11.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.183+0000 7fabeffff640 1 --2- 172.21.15.7:0/2534084698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabf0103660 0x7fabf0100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:11.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.183+0000 7fabeffff640 1 -- 172.21.15.7:0/2534084698 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf01a6890 con 0x7fabf010c170 2024-09-19T04:16:11.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.183+0000 7fabef7fe640 1 --2- 172.21.15.7:0/2534084698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabf0102d40 0x7fabf01009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:16:11.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.183+0000 7fabeffff640 1 --2- 172.21.15.7:0/2534084698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf010c170 0x7fabf0101420 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fabe800eb10 tx=0x7fabe800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:11.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.183+0000 7fabecff9640 1 -- 172.21.15.7:0/2534084698 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe8004b20 con 0x7fabf010c170 2024-09-19T04:16:11.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.183+0000 7fabecff9640 1 -- 172.21.15.7:0/2534084698 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabe8004cc0 con 0x7fabf010c170 2024-09-19T04:16:11.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.183+0000 7fabf5dc6640 1 -- 172.21.15.7:0/2534084698 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabf01a6b80 con 0x7fabf010c170 2024-09-19T04:16:11.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.183+0000 7fabecff9640 1 -- 172.21.15.7:0/2534084698 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe8010760 con 0x7fabf010c170 2024-09-19T04:16:11.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.183+0000 7fabf5dc6640 1 -- 172.21.15.7:0/2534084698 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabf01a70e0 con 0x7fabf010c170 2024-09-19T04:16:11.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.184+0000 7fabf5dc6640 1 -- 172.21.15.7:0/2534084698 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabf0103120 con 0x7fabf010c170 2024-09-19T04:16:11.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.185+0000 7fabecff9640 1 -- 172.21.15.7:0/2534084698 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fabe8005000 con 0x7fabf010c170 2024-09-19T04:16:11.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.186+0000 7fabecff9640 1 --2- 172.21.15.7:0/2534084698 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fabd80a3350 0x7fabd80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:11.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.186+0000 7fabef7fe640 1 --2- 172.21.15.7:0/2534084698 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fabd80a3350 0x7fabd80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:11.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.186+0000 7fabecff9640 1 -- 172.21.15.7:0/2534084698 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7fabe80d0800 con 0x7fabf010c170 2024-09-19T04:16:11.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.187+0000 7fabef7fe640 1 --2- 172.21.15.7:0/2534084698 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fabd80a3350 0x7fabd80a5810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fabe000abe0 tx=0x7fabe000a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:11.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.189+0000 7fabecff9640 1 -- 172.21.15.7:0/2534084698 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fabe809d020 con 0x7fabf010c170 2024-09-19T04:16:11.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.362+0000 7fabf5dc6640 1 -- 172.21.15.7:0/2534084698 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fabf0062630 con 0x7fabd80a3350 2024-09-19T04:16:11.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.373+0000 7fabecff9640 1 -- 172.21.15.7:0/2534084698 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340659 (secure 0 0 0) 0x7fabf0062630 con 0x7fabd80a3350 2024-09-19T04:16:11.377 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:16:11.379 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-19T04:16:11.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.376+0000 7fabf5dc6640 1 -- 172.21.15.7:0/2534084698 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fabd80a3350 msgr2=0x7fabd80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:11.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.376+0000 7fabf5dc6640 1 --2- 172.21.15.7:0/2534084698 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fabd80a3350 0x7fabd80a5810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fabe000abe0 tx=0x7fabe000a5c0 comp rx=0 tx=0).stop 2024-09-19T04:16:11.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.376+0000 7fabf5dc6640 1 -- 172.21.15.7:0/2534084698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf010c170 msgr2=0x7fabf0101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:11.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.376+0000 7fabf5dc6640 1 --2- 172.21.15.7:0/2534084698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf010c170 0x7fabf0101420 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fabe800eb10 tx=0x7fabe800c2d0 comp rx=0 tx=0).stop 2024-09-19T04:16:11.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.376+0000 7fabf5dc6640 1 -- 172.21.15.7:0/2534084698 shutdown_connections 2024-09-19T04:16:11.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.376+0000 7fabf5dc6640 1 --2- 172.21.15.7:0/2534084698 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fabd80a3350 0x7fabd80a5810 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:11.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.376+0000 7fabf5dc6640 1 --2- 172.21.15.7:0/2534084698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf010c170 0x7fabf0101420 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:11.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.376+0000 7fabf5dc6640 1 --2- 172.21.15.7:0/2534084698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabf0103660 0x7fabf0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:11.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.376+0000 7fabf5dc6640 1 --2- 172.21.15.7:0/2534084698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabf0102d40 0x7fabf01009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:11.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.376+0000 7fabf5dc6640 1 -- 172.21.15.7:0/2534084698 >> 172.21.15.7:0/2534084698 conn(0x7fabf00fc7a0 msgr2=0x7fabf00fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:11.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.377+0000 7fabf5dc6640 1 -- 172.21.15.7:0/2534084698 shutdown_connections 2024-09-19T04:16:11.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:11.377+0000 7fabf5dc6640 1 -- 172.21.15.7:0/2534084698 wait complete. 2024-09-19T04:16:11.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:11 smithi102 ceph-mon[35446]: pgmap v330: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T04:16:11.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:11 smithi102 ceph-mon[35446]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:16:11.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:11 smithi092 ceph-mon[34940]: pgmap v330: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T04:16:11.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:11 smithi092 ceph-mon[34940]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:16:11.986 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":331,"stamp":"2024-09-19T04:16:11.143657+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662432,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":675,"num_read_kb":460,"num_write":434,"num_write_kb":3085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":355,"ondisk_log_size":355,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":357136,"kb_used_data":11972,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124584688,"statfs":{"total":1151940427776,"available":1151574720512,"internally_reserved":0,"allocated":12259328,"data_stored":7914530,"data_compressed":393084,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19141,"internal_metadata":353154363},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003203"},"pg_stats":[{"pgid":"2.1f","version":"86'13","reported_seq":99,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:16:06.892532+0000","last_change":"2024-09-19T04:14:31.294836+0000","last_active":"2024-09-19T04:16:06.892532+0000","last_peered":"2024-09-19T04:16:06.892532+0000","last_clean":"2024-09-19T04:16:06.892532+0000","last_became_active":"2024-09-19T04:14:31.294589+0000","last_became_peered":"2024-09-19T04:14:31.294589+0000","last_unstale":"2024-09-19T04:16:06.892532+0000","last_undegraded":"2024-09-19T04:16:06.892532+0000","last_fullsized":"2024-09-19T04:16:06.892532+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:39:54.093519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.997817+0000","last_change":"2024-09-19T04:14:33.316023+0000","last_active":"2024-09-19T04:15:46.997817+0000","last_peered":"2024-09-19T04:15:46.997817+0000","last_clean":"2024-09-19T04:15:46.997817+0000","last_became_active":"2024-09-19T04:14:33.315732+0000","last_became_peered":"2024-09-19T04:14:33.315732+0000","last_unstale":"2024-09-19T04:15:46.997817+0000","last_undegraded":"2024-09-19T04:15:46.997817+0000","last_fullsized":"2024-09-19T04:15:46.997817+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:00.782788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340546+0000","last_change":"2024-09-19T04:14:40.368540+0000","last_active":"2024-09-19T04:15:47.340546+0000","last_peered":"2024-09-19T04:15:47.340546+0000","last_clean":"2024-09-19T04:15:47.340546+0000","last_became_active":"2024-09-19T04:14:40.367906+0000","last_became_peered":"2024-09-19T04:14:40.367906+0000","last_unstale":"2024-09-19T04:15:47.340546+0000","last_undegraded":"2024-09-19T04:15:47.340546+0000","last_fullsized":"2024-09-19T04:15:47.340546+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:35.660297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999819+0000","last_change":"2024-09-19T04:14:31.321870+0000","last_active":"2024-09-19T04:15:46.999819+0000","last_peered":"2024-09-19T04:15:46.999819+0000","last_clean":"2024-09-19T04:15:46.999819+0000","last_became_active":"2024-09-19T04:14:31.321495+0000","last_became_peered":"2024-09-19T04:14:31.321495+0000","last_unstale":"2024-09-19T04:15:46.999819+0000","last_undegraded":"2024-09-19T04:15:46.999819+0000","last_fullsized":"2024-09-19T04:15:46.999819+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:58.063748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340923+0000","last_change":"2024-09-19T04:14:33.307451+0000","last_active":"2024-09-19T04:15:47.340923+0000","last_peered":"2024-09-19T04:15:47.340923+0000","last_clean":"2024-09-19T04:15:47.340923+0000","last_became_active":"2024-09-19T04:14:33.307129+0000","last_became_peered":"2024-09-19T04:14:33.307129+0000","last_unstale":"2024-09-19T04:15:47.340923+0000","last_undegraded":"2024-09-19T04:15:47.340923+0000","last_fullsized":"2024-09-19T04:15:47.340923+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:28.851012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.995349+0000","last_change":"2024-09-19T04:14:40.367946+0000","last_active":"2024-09-19T04:15:46.995349+0000","last_peered":"2024-09-19T04:15:46.995349+0000","last_clean":"2024-09-19T04:15:46.995349+0000","last_became_active":"2024-09-19T04:14:40.367567+0000","last_became_peered":"2024-09-19T04:14:40.367567+0000","last_unstale":"2024-09-19T04:15:46.995349+0000","last_undegraded":"2024-09-19T04:15:46.995349+0000","last_fullsized":"2024-09-19T04:15:46.995349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:14:29.244838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.998310+0000","last_change":"2024-09-19T04:14:31.298497+0000","last_active":"2024-09-19T04:15:46.998310+0000","last_peered":"2024-09-19T04:15:46.998310+0000","last_clean":"2024-09-19T04:15:46.998310+0000","last_became_active":"2024-09-19T04:14:31.298185+0000","last_became_peered":"2024-09-19T04:14:31.298185+0000","last_unstale":"2024-09-19T04:15:46.998310+0000","last_undegraded":"2024-09-19T04:15:46.998310+0000","last_fullsized":"2024-09-19T04:15:46.998310+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:56:12.701718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.341267+0000","last_change":"2024-09-19T04:14:33.316922+0000","last_active":"2024-09-19T04:15:47.341267+0000","last_peered":"2024-09-19T04:15:47.341267+0000","last_clean":"2024-09-19T04:15:47.341267+0000","last_became_active":"2024-09-19T04:14:33.316613+0000","last_became_peered":"2024-09-19T04:14:33.316613+0000","last_unstale":"2024-09-19T04:15:47.341267+0000","last_undegraded":"2024-09-19T04:15:47.341267+0000","last_fullsized":"2024-09-19T04:15:47.341267+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:22.237900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.000772+0000","last_change":"2024-09-19T04:15:47.000772+0000","last_active":"2024-09-19T04:15:47.000772+0000","last_peered":"2024-09-19T04:15:47.000772+0000","last_clean":"2024-09-19T04:15:47.000772+0000","last_became_active":"2024-09-19T04:15:47.000316+0000","last_became_peered":"2024-09-19T04:15:47.000316+0000","last_unstale":"2024-09-19T04:15:47.000772+0000","last_undegraded":"2024-09-19T04:15:47.000772+0000","last_fullsized":"2024-09-19T04:15:47.000772+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:03.292714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.998710+0000","last_change":"2024-09-19T04:14:31.294330+0000","last_active":"2024-09-19T04:15:46.998710+0000","last_peered":"2024-09-19T04:15:46.998710+0000","last_clean":"2024-09-19T04:15:46.998710+0000","last_became_active":"2024-09-19T04:14:31.293025+0000","last_became_peered":"2024-09-19T04:14:31.293025+0000","last_unstale":"2024-09-19T04:15:46.998710+0000","last_undegraded":"2024-09-19T04:15:46.998710+0000","last_fullsized":"2024-09-19T04:15:46.998710+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:48.276096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.996243+0000","last_change":"2024-09-19T04:14:33.313560+0000","last_active":"2024-09-19T04:15:46.996243+0000","last_peered":"2024-09-19T04:15:46.996243+0000","last_clean":"2024-09-19T04:15:46.996243+0000","last_became_active":"2024-09-19T04:14:33.313200+0000","last_became_peered":"2024-09-19T04:14:33.313200+0000","last_unstale":"2024-09-19T04:15:46.996243+0000","last_undegraded":"2024-09-19T04:15:46.996243+0000","last_fullsized":"2024-09-19T04:15:46.996243+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:33.807866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.995450+0000","last_change":"2024-09-19T04:14:40.368125+0000","last_active":"2024-09-19T04:15:46.995450+0000","last_peered":"2024-09-19T04:15:46.995450+0000","last_clean":"2024-09-19T04:15:46.995450+0000","last_became_active":"2024-09-19T04:14:40.367772+0000","last_became_peered":"2024-09-19T04:14:40.367772+0000","last_unstale":"2024-09-19T04:15:46.995450+0000","last_undegraded":"2024-09-19T04:15:46.995450+0000","last_fullsized":"2024-09-19T04:15:46.995450+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:07:19.740391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999371+0000","last_change":"2024-09-19T04:14:33.307489+0000","last_active":"2024-09-19T04:15:46.999371+0000","last_peered":"2024-09-19T04:15:46.999371+0000","last_clean":"2024-09-19T04:15:46.999371+0000","last_became_active":"2024-09-19T04:14:33.307143+0000","last_became_peered":"2024-09-19T04:14:33.307143+0000","last_unstale":"2024-09-19T04:15:46.999371+0000","last_undegraded":"2024-09-19T04:15:46.999371+0000","last_fullsized":"2024-09-19T04:15:46.999371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:51:14.018972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.998118+0000","last_change":"2024-09-19T04:14:31.299342+0000","last_active":"2024-09-19T04:15:46.998118+0000","last_peered":"2024-09-19T04:15:46.998118+0000","last_clean":"2024-09-19T04:15:46.998118+0000","last_became_active":"2024-09-19T04:14:31.298927+0000","last_became_peered":"2024-09-19T04:14:31.298927+0000","last_unstale":"2024-09-19T04:15:46.998118+0000","last_undegraded":"2024-09-19T04:15:46.998118+0000","last_fullsized":"2024-09-19T04:15:46.998118+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:38.483077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.995552+0000","last_change":"2024-09-19T04:14:40.405762+0000","last_active":"2024-09-19T04:15:46.995552+0000","last_peered":"2024-09-19T04:15:46.995552+0000","last_clean":"2024-09-19T04:15:46.995552+0000","last_became_active":"2024-09-19T04:14:40.405379+0000","last_became_peered":"2024-09-19T04:14:40.405379+0000","last_unstale":"2024-09-19T04:15:46.995552+0000","last_undegraded":"2024-09-19T04:15:46.995552+0000","last_fullsized":"2024-09-19T04:15:46.995552+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:41:36.628112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.997561+0000","last_change":"2024-09-19T04:14:33.318521+0000","last_active":"2024-09-19T04:15:46.997561+0000","last_peered":"2024-09-19T04:15:46.997561+0000","last_clean":"2024-09-19T04:15:46.997561+0000","last_became_active":"2024-09-19T04:14:33.318200+0000","last_became_peered":"2024-09-19T04:14:33.318200+0000","last_unstale":"2024-09-19T04:15:46.997561+0000","last_undegraded":"2024-09-19T04:15:46.997561+0000","last_fullsized":"2024-09-19T04:15:46.997561+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:45.497455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.341147+0000","last_change":"2024-09-19T04:14:31.299976+0000","last_active":"2024-09-19T04:15:47.341147+0000","last_peered":"2024-09-19T04:15:47.341147+0000","last_clean":"2024-09-19T04:15:47.341147+0000","last_became_active":"2024-09-19T04:14:31.299630+0000","last_became_peered":"2024-09-19T04:14:31.299630+0000","last_unstale":"2024-09-19T04:15:47.341147+0000","last_undegraded":"2024-09-19T04:15:47.341147+0000","last_fullsized":"2024-09-19T04:15:47.341147+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:14:00.834440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.995589+0000","last_change":"2024-09-19T04:14:40.366110+0000","last_active":"2024-09-19T04:15:46.995589+0000","last_peered":"2024-09-19T04:15:46.995589+0000","last_clean":"2024-09-19T04:15:46.995589+0000","last_became_active":"2024-09-19T04:14:40.365558+0000","last_became_peered":"2024-09-19T04:14:40.365558+0000","last_unstale":"2024-09-19T04:15:46.995589+0000","last_undegraded":"2024-09-19T04:15:46.995589+0000","last_fullsized":"2024-09-19T04:15:46.995589+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:24.049603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.171098+0000","last_change":"2024-09-19T04:14:33.307400+0000","last_active":"2024-09-19T04:15:47.171098+0000","last_peered":"2024-09-19T04:15:47.171098+0000","last_clean":"2024-09-19T04:15:47.171098+0000","last_became_active":"2024-09-19T04:14:33.307095+0000","last_became_peered":"2024-09-19T04:14:33.307095+0000","last_unstale":"2024-09-19T04:15:47.171098+0000","last_undegraded":"2024-09-19T04:15:47.171098+0000","last_fullsized":"2024-09-19T04:15:47.171098+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:27.582568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.997941+0000","last_change":"2024-09-19T04:14:31.287190+0000","last_active":"2024-09-19T04:15:46.997941+0000","last_peered":"2024-09-19T04:15:46.997941+0000","last_clean":"2024-09-19T04:15:46.997941+0000","last_became_active":"2024-09-19T04:14:31.286817+0000","last_became_peered":"2024-09-19T04:14:31.286817+0000","last_unstale":"2024-09-19T04:15:46.997941+0000","last_undegraded":"2024-09-19T04:15:46.997941+0000","last_fullsized":"2024-09-19T04:15:46.997941+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:44.522615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.994771+0000","last_change":"2024-09-19T04:14:40.372153+0000","last_active":"2024-09-19T04:15:46.994771+0000","last_peered":"2024-09-19T04:15:46.994771+0000","last_clean":"2024-09-19T04:15:46.994771+0000","last_became_active":"2024-09-19T04:14:40.371309+0000","last_became_peered":"2024-09-19T04:14:40.371309+0000","last_unstale":"2024-09-19T04:15:46.994771+0000","last_undegraded":"2024-09-19T04:15:46.994771+0000","last_fullsized":"2024-09-19T04:15:46.994771+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:46.608489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.996630+0000","last_change":"2024-09-19T04:14:33.310884+0000","last_active":"2024-09-19T04:15:46.996630+0000","last_peered":"2024-09-19T04:15:46.996630+0000","last_clean":"2024-09-19T04:15:46.996630+0000","last_became_active":"2024-09-19T04:14:33.310532+0000","last_became_peered":"2024-09-19T04:14:33.310532+0000","last_unstale":"2024-09-19T04:15:46.996630+0000","last_undegraded":"2024-09-19T04:15:46.996630+0000","last_fullsized":"2024-09-19T04:15:46.996630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:49:16.565018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":36,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.341025+0000","last_change":"2024-09-19T04:14:31.322216+0000","last_active":"2024-09-19T04:15:47.341025+0000","last_peered":"2024-09-19T04:15:47.341025+0000","last_clean":"2024-09-19T04:15:47.341025+0000","last_became_active":"2024-09-19T04:14:31.321941+0000","last_became_peered":"2024-09-19T04:14:31.321941+0000","last_unstale":"2024-09-19T04:15:47.341025+0000","last_undegraded":"2024-09-19T04:15:47.341025+0000","last_fullsized":"2024-09-19T04:15:47.341025+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:14.624104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.995880+0000","last_change":"2024-09-19T04:14:40.405749+0000","last_active":"2024-09-19T04:15:46.995880+0000","last_peered":"2024-09-19T04:15:46.995880+0000","last_clean":"2024-09-19T04:15:46.995880+0000","last_became_active":"2024-09-19T04:14:40.405353+0000","last_became_peered":"2024-09-19T04:14:40.405353+0000","last_unstale":"2024-09-19T04:15:46.995880+0000","last_undegraded":"2024-09-19T04:15:46.995880+0000","last_fullsized":"2024-09-19T04:15:46.995880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:13.311989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340880+0000","last_change":"2024-09-19T04:14:33.312057+0000","last_active":"2024-09-19T04:15:47.340880+0000","last_peered":"2024-09-19T04:15:47.340880+0000","last_clean":"2024-09-19T04:15:47.340880+0000","last_became_active":"2024-09-19T04:14:33.311751+0000","last_became_peered":"2024-09-19T04:14:33.311751+0000","last_unstale":"2024-09-19T04:15:47.340880+0000","last_undegraded":"2024-09-19T04:15:47.340880+0000","last_fullsized":"2024-09-19T04:15:47.340880+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:28.843870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.996373+0000","last_change":"2024-09-19T04:14:31.287529+0000","last_active":"2024-09-19T04:15:46.996373+0000","last_peered":"2024-09-19T04:15:46.996373+0000","last_clean":"2024-09-19T04:15:46.996373+0000","last_became_active":"2024-09-19T04:14:31.287172+0000","last_became_peered":"2024-09-19T04:14:31.287172+0000","last_unstale":"2024-09-19T04:15:46.996373+0000","last_undegraded":"2024-09-19T04:15:46.996373+0000","last_fullsized":"2024-09-19T04:15:46.996373+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:32:23.351997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340559+0000","last_change":"2024-09-19T04:14:40.363772+0000","last_active":"2024-09-19T04:15:47.340559+0000","last_peered":"2024-09-19T04:15:47.340559+0000","last_clean":"2024-09-19T04:15:47.340559+0000","last_became_active":"2024-09-19T04:14:40.363395+0000","last_became_peered":"2024-09-19T04:14:40.363395+0000","last_unstale":"2024-09-19T04:15:47.340559+0000","last_undegraded":"2024-09-19T04:15:47.340559+0000","last_fullsized":"2024-09-19T04:15:47.340559+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:22.090743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.998155+0000","last_change":"2024-09-19T04:14:33.310108+0000","last_active":"2024-09-19T04:15:46.998155+0000","last_peered":"2024-09-19T04:15:46.998155+0000","last_clean":"2024-09-19T04:15:46.998155+0000","last_became_active":"2024-09-19T04:14:33.309812+0000","last_became_peered":"2024-09-19T04:14:33.309812+0000","last_unstale":"2024-09-19T04:15:46.998155+0000","last_undegraded":"2024-09-19T04:15:46.998155+0000","last_fullsized":"2024-09-19T04:15:46.998155+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:48.570530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'16","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.994917+0000","last_change":"2024-09-19T04:14:31.293115+0000","last_active":"2024-09-19T04:15:46.994917+0000","last_peered":"2024-09-19T04:15:46.994917+0000","last_clean":"2024-09-19T04:15:46.994917+0000","last_became_active":"2024-09-19T04:14:31.292733+0000","last_became_peered":"2024-09-19T04:14:31.292733+0000","last_unstale":"2024-09-19T04:15:46.994917+0000","last_undegraded":"2024-09-19T04:15:46.994917+0000","last_fullsized":"2024-09-19T04:15:46.994917+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:11.936757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.997600+0000","last_change":"2024-09-19T04:14:40.405241+0000","last_active":"2024-09-19T04:15:46.997600+0000","last_peered":"2024-09-19T04:15:46.997600+0000","last_clean":"2024-09-19T04:15:46.997600+0000","last_became_active":"2024-09-19T04:14:40.404846+0000","last_became_peered":"2024-09-19T04:14:40.404846+0000","last_unstale":"2024-09-19T04:15:46.997600+0000","last_undegraded":"2024-09-19T04:15:46.997600+0000","last_fullsized":"2024-09-19T04:15:46.997600+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:49.842644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999718+0000","last_change":"2024-09-19T04:14:33.305796+0000","last_active":"2024-09-19T04:15:46.999718+0000","last_peered":"2024-09-19T04:15:46.999718+0000","last_clean":"2024-09-19T04:15:46.999718+0000","last_became_active":"2024-09-19T04:14:33.305499+0000","last_became_peered":"2024-09-19T04:14:33.305499+0000","last_unstale":"2024-09-19T04:15:46.999718+0000","last_undegraded":"2024-09-19T04:15:46.999718+0000","last_fullsized":"2024-09-19T04:15:46.999718+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:08.357655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.998283+0000","last_change":"2024-09-19T04:14:31.322459+0000","last_active":"2024-09-19T04:15:46.998283+0000","last_peered":"2024-09-19T04:15:46.998283+0000","last_clean":"2024-09-19T04:15:46.998283+0000","last_became_active":"2024-09-19T04:14:31.322149+0000","last_became_peered":"2024-09-19T04:14:31.322149+0000","last_unstale":"2024-09-19T04:15:46.998283+0000","last_undegraded":"2024-09-19T04:15:46.998283+0000","last_fullsized":"2024-09-19T04:15:46.998283+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:06:15.208618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.171072+0000","last_change":"2024-09-19T04:14:40.372869+0000","last_active":"2024-09-19T04:15:47.171072+0000","last_peered":"2024-09-19T04:15:47.171072+0000","last_clean":"2024-09-19T04:15:47.171072+0000","last_became_active":"2024-09-19T04:14:40.372203+0000","last_became_peered":"2024-09-19T04:14:40.372203+0000","last_unstale":"2024-09-19T04:15:47.171072+0000","last_undegraded":"2024-09-19T04:15:47.171072+0000","last_fullsized":"2024-09-19T04:15:47.171072+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:34.900656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.996371+0000","last_change":"2024-09-19T04:14:33.315443+0000","last_active":"2024-09-19T04:15:46.996371+0000","last_peered":"2024-09-19T04:15:46.996371+0000","last_clean":"2024-09-19T04:15:46.996371+0000","last_became_active":"2024-09-19T04:14:33.315067+0000","last_became_peered":"2024-09-19T04:14:33.315067+0000","last_unstale":"2024-09-19T04:15:46.996371+0000","last_undegraded":"2024-09-19T04:15:46.996371+0000","last_fullsized":"2024-09-19T04:15:46.996371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:59.194674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.994586+0000","last_change":"2024-09-19T04:14:31.322623+0000","last_active":"2024-09-19T04:15:46.994586+0000","last_peered":"2024-09-19T04:15:46.994586+0000","last_clean":"2024-09-19T04:15:46.994586+0000","last_became_active":"2024-09-19T04:14:31.321838+0000","last_became_peered":"2024-09-19T04:14:31.321838+0000","last_unstale":"2024-09-19T04:15:46.994586+0000","last_undegraded":"2024-09-19T04:15:46.994586+0000","last_fullsized":"2024-09-19T04:15:46.994586+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:30:37.073072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.343430+0000","last_change":"2024-09-19T04:15:47.343430+0000","last_active":"2024-09-19T04:15:47.343430+0000","last_peered":"2024-09-19T04:15:47.343430+0000","last_clean":"2024-09-19T04:15:47.343430+0000","last_became_active":"2024-09-19T04:15:47.342319+0000","last_became_peered":"2024-09-19T04:15:47.342319+0000","last_unstale":"2024-09-19T04:15:47.343430+0000","last_undegraded":"2024-09-19T04:15:47.343430+0000","last_fullsized":"2024-09-19T04:15:47.343430+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:05.641357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.997135+0000","last_change":"2024-09-19T04:14:33.319748+0000","last_active":"2024-09-19T04:15:46.997135+0000","last_peered":"2024-09-19T04:15:46.997135+0000","last_clean":"2024-09-19T04:15:46.997135+0000","last_became_active":"2024-09-19T04:14:33.319173+0000","last_became_peered":"2024-09-19T04:14:33.319173+0000","last_unstale":"2024-09-19T04:15:46.997135+0000","last_undegraded":"2024-09-19T04:15:46.997135+0000","last_fullsized":"2024-09-19T04:15:46.997135+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:24.419811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'6","reported_seq":93,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:16:06.893147+0000","last_change":"2024-09-19T04:14:31.292077+0000","last_active":"2024-09-19T04:16:06.893147+0000","last_peered":"2024-09-19T04:16:06.893147+0000","last_clean":"2024-09-19T04:16:06.893147+0000","last_became_active":"2024-09-19T04:14:31.291737+0000","last_became_peered":"2024-09-19T04:14:31.291737+0000","last_unstale":"2024-09-19T04:16:06.893147+0000","last_undegraded":"2024-09-19T04:16:06.893147+0000","last_fullsized":"2024-09-19T04:16:06.893147+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:32.570641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999346+0000","last_change":"2024-09-19T04:14:40.369734+0000","last_active":"2024-09-19T04:15:46.999346+0000","last_peered":"2024-09-19T04:15:46.999346+0000","last_clean":"2024-09-19T04:15:46.999346+0000","last_became_active":"2024-09-19T04:14:40.367563+0000","last_became_peered":"2024-09-19T04:14:40.367563+0000","last_unstale":"2024-09-19T04:15:46.999346+0000","last_undegraded":"2024-09-19T04:15:46.999346+0000","last_fullsized":"2024-09-19T04:15:46.999346+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:47.229115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.995334+0000","last_change":"2024-09-19T04:14:33.309687+0000","last_active":"2024-09-19T04:15:46.995334+0000","last_peered":"2024-09-19T04:15:46.995334+0000","last_clean":"2024-09-19T04:15:46.995334+0000","last_became_active":"2024-09-19T04:14:33.308692+0000","last_became_peered":"2024-09-19T04:14:33.308692+0000","last_unstale":"2024-09-19T04:15:46.995334+0000","last_undegraded":"2024-09-19T04:15:46.995334+0000","last_fullsized":"2024-09-19T04:15:46.995334+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:58.716927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":90,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:16:05.891627+0000","last_change":"2024-09-19T04:14:31.322024+0000","last_active":"2024-09-19T04:16:05.891627+0000","last_peered":"2024-09-19T04:16:05.891627+0000","last_clean":"2024-09-19T04:16:05.891627+0000","last_became_active":"2024-09-19T04:14:31.321640+0000","last_became_peered":"2024-09-19T04:14:31.321640+0000","last_unstale":"2024-09-19T04:16:05.891627+0000","last_undegraded":"2024-09-19T04:16:05.891627+0000","last_fullsized":"2024-09-19T04:16:05.891627+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:25:36.159774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999770+0000","last_change":"2024-09-19T04:14:40.405793+0000","last_active":"2024-09-19T04:15:46.999770+0000","last_peered":"2024-09-19T04:15:46.999770+0000","last_clean":"2024-09-19T04:15:46.999770+0000","last_became_active":"2024-09-19T04:14:40.405354+0000","last_became_peered":"2024-09-19T04:14:40.405354+0000","last_unstale":"2024-09-19T04:15:46.999770+0000","last_undegraded":"2024-09-19T04:15:46.999770+0000","last_fullsized":"2024-09-19T04:15:46.999770+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:46:37.893202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.998455+0000","last_change":"2024-09-19T04:14:33.313007+0000","last_active":"2024-09-19T04:15:46.998455+0000","last_peered":"2024-09-19T04:15:46.998455+0000","last_clean":"2024-09-19T04:15:46.998455+0000","last_became_active":"2024-09-19T04:14:33.312665+0000","last_became_peered":"2024-09-19T04:14:33.312665+0000","last_unstale":"2024-09-19T04:15:46.998455+0000","last_undegraded":"2024-09-19T04:15:46.998455+0000","last_fullsized":"2024-09-19T04:15:46.998455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:09.976707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999219+0000","last_change":"2024-09-19T04:14:31.294072+0000","last_active":"2024-09-19T04:15:46.999219+0000","last_peered":"2024-09-19T04:15:46.999219+0000","last_clean":"2024-09-19T04:15:46.999219+0000","last_became_active":"2024-09-19T04:14:31.293648+0000","last_became_peered":"2024-09-19T04:14:31.293648+0000","last_unstale":"2024-09-19T04:15:46.999219+0000","last_undegraded":"2024-09-19T04:15:46.999219+0000","last_fullsized":"2024-09-19T04:15:46.999219+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:14.910714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.996363+0000","last_change":"2024-09-19T04:14:40.406327+0000","last_active":"2024-09-19T04:15:46.996363+0000","last_peered":"2024-09-19T04:15:46.996363+0000","last_clean":"2024-09-19T04:15:46.996363+0000","last_became_active":"2024-09-19T04:14:40.405602+0000","last_became_peered":"2024-09-19T04:14:40.405602+0000","last_unstale":"2024-09-19T04:15:46.996363+0000","last_undegraded":"2024-09-19T04:15:46.996363+0000","last_fullsized":"2024-09-19T04:15:46.996363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:47:23.078480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.343123+0000","last_change":"2024-09-19T04:15:47.342605+0000","last_active":"2024-09-19T04:15:47.343123+0000","last_peered":"2024-09-19T04:15:47.343123+0000","last_clean":"2024-09-19T04:15:47.343123+0000","last_became_active":"2024-09-19T04:15:47.342215+0000","last_became_peered":"2024-09-19T04:15:47.342215+0000","last_unstale":"2024-09-19T04:15:47.343123+0000","last_undegraded":"2024-09-19T04:15:47.343123+0000","last_fullsized":"2024-09-19T04:15:47.343123+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:01.315513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,1],"acting":[9,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.997709+0000","last_change":"2024-09-19T04:14:31.290207+0000","last_active":"2024-09-19T04:15:46.997709+0000","last_peered":"2024-09-19T04:15:46.997709+0000","last_clean":"2024-09-19T04:15:46.997709+0000","last_became_active":"2024-09-19T04:14:31.289863+0000","last_became_peered":"2024-09-19T04:14:31.289863+0000","last_unstale":"2024-09-19T04:15:46.997709+0000","last_undegraded":"2024-09-19T04:15:46.997709+0000","last_fullsized":"2024-09-19T04:15:46.997709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:39.241894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":347,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999731+0000","last_change":"2024-09-19T04:13:20.845240+0000","last_active":"2024-09-19T04:15:46.999731+0000","last_peered":"2024-09-19T04:15:46.999731+0000","last_clean":"2024-09-19T04:15:46.999731+0000","last_became_active":"2024-09-19T04:13:20.844771+0000","last_became_peered":"2024-09-19T04:13:20.844771+0000","last_unstale":"2024-09-19T04:15:46.999731+0000","last_undegraded":"2024-09-19T04:15:46.999731+0000","last_fullsized":"2024-09-19T04:15:46.999731+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:09:59.809148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:09:59.809148+0000","last_clean_scrub_stamp":"2024-09-19T04:09:59.809148+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:12:29.694263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999371+0000","last_change":"2024-09-19T04:14:40.369257+0000","last_active":"2024-09-19T04:15:46.999371+0000","last_peered":"2024-09-19T04:15:46.999371+0000","last_clean":"2024-09-19T04:15:46.999371+0000","last_became_active":"2024-09-19T04:14:40.368865+0000","last_became_peered":"2024-09-19T04:14:40.368865+0000","last_unstale":"2024-09-19T04:15:46.999371+0000","last_undegraded":"2024-09-19T04:15:46.999371+0000","last_fullsized":"2024-09-19T04:15:46.999371+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:37:52.120157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999615+0000","last_change":"2024-09-19T04:14:33.311221+0000","last_active":"2024-09-19T04:15:46.999615+0000","last_peered":"2024-09-19T04:15:46.999615+0000","last_clean":"2024-09-19T04:15:46.999615+0000","last_became_active":"2024-09-19T04:14:33.310886+0000","last_became_peered":"2024-09-19T04:14:33.310886+0000","last_unstale":"2024-09-19T04:15:46.999615+0000","last_undegraded":"2024-09-19T04:15:46.999615+0000","last_fullsized":"2024-09-19T04:15:46.999615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:04:32.348676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":93,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:16:07.922325+0000","last_change":"2024-09-19T04:14:31.322464+0000","last_active":"2024-09-19T04:16:07.922325+0000","last_peered":"2024-09-19T04:16:07.922325+0000","last_clean":"2024-09-19T04:16:07.922325+0000","last_became_active":"2024-09-19T04:14:31.322115+0000","last_became_peered":"2024-09-19T04:14:31.322115+0000","last_unstale":"2024-09-19T04:16:07.922325+0000","last_undegraded":"2024-09-19T04:16:07.922325+0000","last_fullsized":"2024-09-19T04:16:07.922325+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:24:27.623328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.341062+0000","last_change":"2024-09-19T04:14:40.371391+0000","last_active":"2024-09-19T04:15:47.341062+0000","last_peered":"2024-09-19T04:15:47.341062+0000","last_clean":"2024-09-19T04:15:47.341062+0000","last_became_active":"2024-09-19T04:14:40.371091+0000","last_became_peered":"2024-09-19T04:14:40.371091+0000","last_unstale":"2024-09-19T04:15:47.341062+0000","last_undegraded":"2024-09-19T04:15:47.341062+0000","last_fullsized":"2024-09-19T04:15:47.341062+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:39:14.889348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.003652+0000","last_change":"2024-09-19T04:15:47.003652+0000","last_active":"2024-09-19T04:15:47.003652+0000","last_peered":"2024-09-19T04:15:47.003652+0000","last_clean":"2024-09-19T04:15:47.003652+0000","last_became_active":"2024-09-19T04:15:47.003226+0000","last_became_peered":"2024-09-19T04:15:47.003226+0000","last_unstale":"2024-09-19T04:15:47.003652+0000","last_undegraded":"2024-09-19T04:15:47.003652+0000","last_fullsized":"2024-09-19T04:15:47.003652+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:38.948427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.996505+0000","last_change":"2024-09-19T04:14:31.293156+0000","last_active":"2024-09-19T04:15:46.996505+0000","last_peered":"2024-09-19T04:15:46.996505+0000","last_clean":"2024-09-19T04:15:46.996505+0000","last_became_active":"2024-09-19T04:14:31.292772+0000","last_became_peered":"2024-09-19T04:14:31.292772+0000","last_unstale":"2024-09-19T04:15:46.996505+0000","last_undegraded":"2024-09-19T04:15:46.996505+0000","last_fullsized":"2024-09-19T04:15:46.996505+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:03:18.530662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340781+0000","last_change":"2024-09-19T04:14:40.371434+0000","last_active":"2024-09-19T04:15:47.340781+0000","last_peered":"2024-09-19T04:15:47.340781+0000","last_clean":"2024-09-19T04:15:47.340781+0000","last_became_active":"2024-09-19T04:14:40.371037+0000","last_became_peered":"2024-09-19T04:14:40.371037+0000","last_unstale":"2024-09-19T04:15:47.340781+0000","last_undegraded":"2024-09-19T04:15:47.340781+0000","last_fullsized":"2024-09-19T04:15:47.340781+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:43:34.787860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999782+0000","last_change":"2024-09-19T04:14:33.308321+0000","last_active":"2024-09-19T04:15:46.999782+0000","last_peered":"2024-09-19T04:15:46.999782+0000","last_clean":"2024-09-19T04:15:46.999782+0000","last_became_active":"2024-09-19T04:14:33.307983+0000","last_became_peered":"2024-09-19T04:14:33.307983+0000","last_unstale":"2024-09-19T04:15:46.999782+0000","last_undegraded":"2024-09-19T04:15:46.999782+0000","last_fullsized":"2024-09-19T04:15:46.999782+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:46.202123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.000028+0000","last_change":"2024-09-19T04:14:31.297326+0000","last_active":"2024-09-19T04:15:47.000028+0000","last_peered":"2024-09-19T04:15:47.000028+0000","last_clean":"2024-09-19T04:15:47.000028+0000","last_became_active":"2024-09-19T04:14:31.297056+0000","last_became_peered":"2024-09-19T04:14:31.297056+0000","last_unstale":"2024-09-19T04:15:47.000028+0000","last_undegraded":"2024-09-19T04:15:47.000028+0000","last_fullsized":"2024-09-19T04:15:47.000028+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:15:26.324855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.995224+0000","last_change":"2024-09-19T04:14:40.370123+0000","last_active":"2024-09-19T04:15:46.995224+0000","last_peered":"2024-09-19T04:15:46.995224+0000","last_clean":"2024-09-19T04:15:46.995224+0000","last_became_active":"2024-09-19T04:14:40.367758+0000","last_became_peered":"2024-09-19T04:14:40.367758+0000","last_unstale":"2024-09-19T04:15:46.995224+0000","last_undegraded":"2024-09-19T04:15:46.995224+0000","last_fullsized":"2024-09-19T04:15:46.995224+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:07.932122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.171290+0000","last_change":"2024-09-19T04:14:33.314239+0000","last_active":"2024-09-19T04:15:47.171290+0000","last_peered":"2024-09-19T04:15:47.171290+0000","last_clean":"2024-09-19T04:15:47.171290+0000","last_became_active":"2024-09-19T04:14:33.313918+0000","last_became_peered":"2024-09-19T04:14:33.313918+0000","last_unstale":"2024-09-19T04:15:47.171290+0000","last_undegraded":"2024-09-19T04:15:47.171290+0000","last_fullsized":"2024-09-19T04:15:47.171290+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:00:12.756505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.998618+0000","last_change":"2024-09-19T04:14:31.295377+0000","last_active":"2024-09-19T04:15:46.998618+0000","last_peered":"2024-09-19T04:15:46.998618+0000","last_clean":"2024-09-19T04:15:46.998618+0000","last_became_active":"2024-09-19T04:14:31.295042+0000","last_became_peered":"2024-09-19T04:14:31.295042+0000","last_unstale":"2024-09-19T04:15:46.998618+0000","last_undegraded":"2024-09-19T04:15:46.998618+0000","last_fullsized":"2024-09-19T04:15:46.998618+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:35.842847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.995402+0000","last_change":"2024-09-19T04:14:40.370790+0000","last_active":"2024-09-19T04:15:46.995402+0000","last_peered":"2024-09-19T04:15:46.995402+0000","last_clean":"2024-09-19T04:15:46.995402+0000","last_became_active":"2024-09-19T04:14:40.370377+0000","last_became_peered":"2024-09-19T04:14:40.370377+0000","last_unstale":"2024-09-19T04:15:46.995402+0000","last_undegraded":"2024-09-19T04:15:46.995402+0000","last_fullsized":"2024-09-19T04:15:46.995402+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:09.331769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.342260+0000","last_change":"2024-09-19T04:15:47.342260+0000","last_active":"2024-09-19T04:15:47.342260+0000","last_peered":"2024-09-19T04:15:47.342260+0000","last_clean":"2024-09-19T04:15:47.342260+0000","last_became_active":"2024-09-19T04:15:47.341713+0000","last_became_peered":"2024-09-19T04:15:47.341713+0000","last_unstale":"2024-09-19T04:15:47.342260+0000","last_undegraded":"2024-09-19T04:15:47.342260+0000","last_fullsized":"2024-09-19T04:15:47.342260+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:25:47.822844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.996625+0000","last_change":"2024-09-19T04:14:31.322413+0000","last_active":"2024-09-19T04:15:46.996625+0000","last_peered":"2024-09-19T04:15:46.996625+0000","last_clean":"2024-09-19T04:15:46.996625+0000","last_became_active":"2024-09-19T04:14:31.322082+0000","last_became_peered":"2024-09-19T04:14:31.322082+0000","last_unstale":"2024-09-19T04:15:46.996625+0000","last_undegraded":"2024-09-19T04:15:46.996625+0000","last_fullsized":"2024-09-19T04:15:46.996625+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:50.010021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999993+0000","last_change":"2024-09-19T04:14:40.373071+0000","last_active":"2024-09-19T04:15:46.999993+0000","last_peered":"2024-09-19T04:15:46.999993+0000","last_clean":"2024-09-19T04:15:46.999993+0000","last_became_active":"2024-09-19T04:14:40.372679+0000","last_became_peered":"2024-09-19T04:14:40.372679+0000","last_unstale":"2024-09-19T04:15:46.999993+0000","last_undegraded":"2024-09-19T04:15:46.999993+0000","last_fullsized":"2024-09-19T04:15:46.999993+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:23.136807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999111+0000","last_change":"2024-09-19T04:14:33.319165+0000","last_active":"2024-09-19T04:15:46.999111+0000","last_peered":"2024-09-19T04:15:46.999111+0000","last_clean":"2024-09-19T04:15:46.999111+0000","last_became_active":"2024-09-19T04:14:33.318830+0000","last_became_peered":"2024-09-19T04:14:33.318830+0000","last_unstale":"2024-09-19T04:15:46.999111+0000","last_undegraded":"2024-09-19T04:15:46.999111+0000","last_fullsized":"2024-09-19T04:15:46.999111+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:05:43.936069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'6","reported_seq":95,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:16:07.904375+0000","last_change":"2024-09-19T04:14:31.291564+0000","last_active":"2024-09-19T04:16:07.904375+0000","last_peered":"2024-09-19T04:16:07.904375+0000","last_clean":"2024-09-19T04:16:07.904375+0000","last_became_active":"2024-09-19T04:14:31.291241+0000","last_became_peered":"2024-09-19T04:14:31.291241+0000","last_unstale":"2024-09-19T04:16:07.904375+0000","last_undegraded":"2024-09-19T04:16:07.904375+0000","last_fullsized":"2024-09-19T04:16:07.904375+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:38:09.419140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.994799+0000","last_change":"2024-09-19T04:14:40.371707+0000","last_active":"2024-09-19T04:15:46.994799+0000","last_peered":"2024-09-19T04:15:46.994799+0000","last_clean":"2024-09-19T04:15:46.994799+0000","last_became_active":"2024-09-19T04:14:40.370767+0000","last_became_peered":"2024-09-19T04:14:40.370767+0000","last_unstale":"2024-09-19T04:15:46.994799+0000","last_undegraded":"2024-09-19T04:15:46.994799+0000","last_fullsized":"2024-09-19T04:15:46.994799+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:38.022486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999437+0000","last_change":"2024-09-19T04:14:33.316098+0000","last_active":"2024-09-19T04:15:46.999437+0000","last_peered":"2024-09-19T04:15:46.999437+0000","last_clean":"2024-09-19T04:15:46.999437+0000","last_became_active":"2024-09-19T04:14:33.315755+0000","last_became_peered":"2024-09-19T04:14:33.315755+0000","last_unstale":"2024-09-19T04:15:46.999437+0000","last_undegraded":"2024-09-19T04:15:46.999437+0000","last_fullsized":"2024-09-19T04:15:46.999437+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:45:01.531200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.996132+0000","last_change":"2024-09-19T04:14:31.291145+0000","last_active":"2024-09-19T04:15:46.996132+0000","last_peered":"2024-09-19T04:15:46.996132+0000","last_clean":"2024-09-19T04:15:46.996132+0000","last_became_active":"2024-09-19T04:14:31.290763+0000","last_became_peered":"2024-09-19T04:14:31.290763+0000","last_unstale":"2024-09-19T04:15:46.996132+0000","last_undegraded":"2024-09-19T04:15:46.996132+0000","last_fullsized":"2024-09-19T04:15:46.996132+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:37.556544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.171167+0000","last_change":"2024-09-19T04:14:40.371371+0000","last_active":"2024-09-19T04:15:47.171167+0000","last_peered":"2024-09-19T04:15:47.171167+0000","last_clean":"2024-09-19T04:15:47.171167+0000","last_became_active":"2024-09-19T04:14:40.370988+0000","last_became_peered":"2024-09-19T04:14:40.370988+0000","last_unstale":"2024-09-19T04:15:47.171167+0000","last_undegraded":"2024-09-19T04:15:47.171167+0000","last_fullsized":"2024-09-19T04:15:47.171167+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:57.089953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.003980+0000","last_change":"2024-09-19T04:15:47.003980+0000","last_active":"2024-09-19T04:15:47.003980+0000","last_peered":"2024-09-19T04:15:47.003980+0000","last_clean":"2024-09-19T04:15:47.003980+0000","last_became_active":"2024-09-19T04:15:47.003573+0000","last_became_peered":"2024-09-19T04:15:47.003573+0000","last_unstale":"2024-09-19T04:15:47.003980+0000","last_undegraded":"2024-09-19T04:15:47.003980+0000","last_fullsized":"2024-09-19T04:15:47.003980+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:35:12.971378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.341051+0000","last_change":"2024-09-19T04:14:31.297106+0000","last_active":"2024-09-19T04:15:47.341051+0000","last_peered":"2024-09-19T04:15:47.341051+0000","last_clean":"2024-09-19T04:15:47.341051+0000","last_became_active":"2024-09-19T04:14:31.296688+0000","last_became_peered":"2024-09-19T04:14:31.296688+0000","last_unstale":"2024-09-19T04:15:47.341051+0000","last_undegraded":"2024-09-19T04:15:47.341051+0000","last_fullsized":"2024-09-19T04:15:47.341051+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:18.882219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.996175+0000","last_change":"2024-09-19T04:14:40.371641+0000","last_active":"2024-09-19T04:15:46.996175+0000","last_peered":"2024-09-19T04:15:46.996175+0000","last_clean":"2024-09-19T04:15:46.996175+0000","last_became_active":"2024-09-19T04:14:40.370354+0000","last_became_peered":"2024-09-19T04:14:40.370354+0000","last_unstale":"2024-09-19T04:15:46.996175+0000","last_undegraded":"2024-09-19T04:15:46.996175+0000","last_fullsized":"2024-09-19T04:15:46.996175+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:01:11.572011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.998083+0000","last_change":"2024-09-19T04:14:33.307767+0000","last_active":"2024-09-19T04:15:46.998083+0000","last_peered":"2024-09-19T04:15:46.998083+0000","last_clean":"2024-09-19T04:15:46.998083+0000","last_became_active":"2024-09-19T04:14:33.307396+0000","last_became_peered":"2024-09-19T04:14:33.307396+0000","last_unstale":"2024-09-19T04:15:46.998083+0000","last_undegraded":"2024-09-19T04:15:46.998083+0000","last_fullsized":"2024-09-19T04:15:46.998083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:21.018641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'36","reported_seq":180,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:16:06.893269+0000","last_change":"2024-09-19T04:14:31.298106+0000","last_active":"2024-09-19T04:16:06.893269+0000","last_peered":"2024-09-19T04:16:06.893269+0000","last_clean":"2024-09-19T04:16:06.893269+0000","last_became_active":"2024-09-19T04:14:31.297731+0000","last_became_peered":"2024-09-19T04:14:31.297731+0000","last_unstale":"2024-09-19T04:16:06.893269+0000","last_undegraded":"2024-09-19T04:16:06.893269+0000","last_fullsized":"2024-09-19T04:16:06.893269+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:29.127759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64622,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":118,"num_write":38,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.994494+0000","last_change":"2024-09-19T04:14:40.372927+0000","last_active":"2024-09-19T04:15:46.994494+0000","last_peered":"2024-09-19T04:15:46.994494+0000","last_clean":"2024-09-19T04:15:46.994494+0000","last_became_active":"2024-09-19T04:14:40.372521+0000","last_became_peered":"2024-09-19T04:14:40.372521+0000","last_unstale":"2024-09-19T04:15:46.994494+0000","last_undegraded":"2024-09-19T04:15:46.994494+0000","last_fullsized":"2024-09-19T04:15:46.994494+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:15:00.863812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.341257+0000","last_change":"2024-09-19T04:14:33.308154+0000","last_active":"2024-09-19T04:15:47.341257+0000","last_peered":"2024-09-19T04:15:47.341257+0000","last_clean":"2024-09-19T04:15:47.341257+0000","last_became_active":"2024-09-19T04:14:33.307831+0000","last_became_peered":"2024-09-19T04:14:33.307831+0000","last_unstale":"2024-09-19T04:15:47.341257+0000","last_undegraded":"2024-09-19T04:15:47.341257+0000","last_fullsized":"2024-09-19T04:15:47.341257+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:16:14.656133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.996398+0000","last_change":"2024-09-19T04:14:31.324011+0000","last_active":"2024-09-19T04:15:46.996398+0000","last_peered":"2024-09-19T04:15:46.996398+0000","last_clean":"2024-09-19T04:15:46.996398+0000","last_became_active":"2024-09-19T04:14:31.323622+0000","last_became_peered":"2024-09-19T04:14:31.323622+0000","last_unstale":"2024-09-19T04:15:46.996398+0000","last_undegraded":"2024-09-19T04:15:46.996398+0000","last_fullsized":"2024-09-19T04:15:46.996398+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:39.198602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.997502+0000","last_change":"2024-09-19T04:14:40.365938+0000","last_active":"2024-09-19T04:15:46.997502+0000","last_peered":"2024-09-19T04:15:46.997502+0000","last_clean":"2024-09-19T04:15:46.997502+0000","last_became_active":"2024-09-19T04:14:40.365539+0000","last_became_peered":"2024-09-19T04:14:40.365539+0000","last_unstale":"2024-09-19T04:15:46.997502+0000","last_undegraded":"2024-09-19T04:15:46.997502+0000","last_fullsized":"2024-09-19T04:15:46.997502+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:09.723008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340994+0000","last_change":"2024-09-19T04:14:33.316286+0000","last_active":"2024-09-19T04:15:47.340994+0000","last_peered":"2024-09-19T04:15:47.340994+0000","last_clean":"2024-09-19T04:15:47.340994+0000","last_became_active":"2024-09-19T04:14:33.315980+0000","last_became_peered":"2024-09-19T04:14:33.315980+0000","last_unstale":"2024-09-19T04:15:47.340994+0000","last_undegraded":"2024-09-19T04:15:47.340994+0000","last_fullsized":"2024-09-19T04:15:47.340994+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:58.383139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999508+0000","last_change":"2024-09-19T04:14:31.299111+0000","last_active":"2024-09-19T04:15:46.999508+0000","last_peered":"2024-09-19T04:15:46.999508+0000","last_clean":"2024-09-19T04:15:46.999508+0000","last_became_active":"2024-09-19T04:14:31.298390+0000","last_became_peered":"2024-09-19T04:14:31.298390+0000","last_unstale":"2024-09-19T04:15:46.999508+0000","last_undegraded":"2024-09-19T04:15:46.999508+0000","last_fullsized":"2024-09-19T04:15:46.999508+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:39.710412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.993971+0000","last_change":"2024-09-19T04:14:40.371108+0000","last_active":"2024-09-19T04:15:46.993971+0000","last_peered":"2024-09-19T04:15:46.993971+0000","last_clean":"2024-09-19T04:15:46.993971+0000","last_became_active":"2024-09-19T04:14:40.370729+0000","last_became_peered":"2024-09-19T04:14:40.370729+0000","last_unstale":"2024-09-19T04:15:46.993971+0000","last_undegraded":"2024-09-19T04:15:46.993971+0000","last_fullsized":"2024-09-19T04:15:46.993971+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:59.610235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.341573+0000","last_change":"2024-09-19T04:14:33.314423+0000","last_active":"2024-09-19T04:15:47.341573+0000","last_peered":"2024-09-19T04:15:47.341573+0000","last_clean":"2024-09-19T04:15:47.341573+0000","last_became_active":"2024-09-19T04:14:33.314123+0000","last_became_peered":"2024-09-19T04:14:33.314123+0000","last_unstale":"2024-09-19T04:15:47.341573+0000","last_undegraded":"2024-09-19T04:15:47.341573+0000","last_fullsized":"2024-09-19T04:15:47.341573+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:29:57.781116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":138,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:16:06.893243+0000","last_change":"2024-09-19T04:14:31.293267+0000","last_active":"2024-09-19T04:16:06.893243+0000","last_peered":"2024-09-19T04:16:06.893243+0000","last_clean":"2024-09-19T04:16:06.893243+0000","last_became_active":"2024-09-19T04:14:31.292862+0000","last_became_peered":"2024-09-19T04:14:31.292862+0000","last_unstale":"2024-09-19T04:16:06.893243+0000","last_undegraded":"2024-09-19T04:16:06.893243+0000","last_fullsized":"2024-09-19T04:16:06.893243+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:37.876696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.997419+0000","last_change":"2024-09-19T04:14:40.373078+0000","last_active":"2024-09-19T04:15:46.997419+0000","last_peered":"2024-09-19T04:15:46.997419+0000","last_clean":"2024-09-19T04:15:46.997419+0000","last_became_active":"2024-09-19T04:14:40.372468+0000","last_became_peered":"2024-09-19T04:14:40.372468+0000","last_unstale":"2024-09-19T04:15:46.997419+0000","last_undegraded":"2024-09-19T04:15:46.997419+0000","last_fullsized":"2024-09-19T04:15:46.997419+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:54.945801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340624+0000","last_change":"2024-09-19T04:14:40.368946+0000","last_active":"2024-09-19T04:15:47.340624+0000","last_peered":"2024-09-19T04:15:47.340624+0000","last_clean":"2024-09-19T04:15:47.340624+0000","last_became_active":"2024-09-19T04:14:40.368549+0000","last_became_peered":"2024-09-19T04:14:40.368549+0000","last_unstale":"2024-09-19T04:15:47.340624+0000","last_undegraded":"2024-09-19T04:15:47.340624+0000","last_fullsized":"2024-09-19T04:15:47.340624+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:24.563488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.994141+0000","last_change":"2024-09-19T04:14:33.307214+0000","last_active":"2024-09-19T04:15:46.994141+0000","last_peered":"2024-09-19T04:15:46.994141+0000","last_clean":"2024-09-19T04:15:46.994141+0000","last_became_active":"2024-09-19T04:14:33.306913+0000","last_became_peered":"2024-09-19T04:14:33.306913+0000","last_unstale":"2024-09-19T04:15:46.994141+0000","last_undegraded":"2024-09-19T04:15:46.994141+0000","last_fullsized":"2024-09-19T04:15:46.994141+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:49.402532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.995450+0000","last_change":"2024-09-19T04:14:31.294488+0000","last_active":"2024-09-19T04:15:46.995450+0000","last_peered":"2024-09-19T04:15:46.995450+0000","last_clean":"2024-09-19T04:15:46.995450+0000","last_became_active":"2024-09-19T04:14:31.294145+0000","last_became_peered":"2024-09-19T04:14:31.294145+0000","last_unstale":"2024-09-19T04:15:46.995450+0000","last_undegraded":"2024-09-19T04:15:46.995450+0000","last_fullsized":"2024-09-19T04:15:46.995450+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:28:19.411650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.171301+0000","last_change":"2024-09-19T04:14:40.372366+0000","last_active":"2024-09-19T04:15:47.171301+0000","last_peered":"2024-09-19T04:15:47.171301+0000","last_clean":"2024-09-19T04:15:47.171301+0000","last_became_active":"2024-09-19T04:14:40.371922+0000","last_became_peered":"2024-09-19T04:14:40.371922+0000","last_unstale":"2024-09-19T04:15:47.171301+0000","last_undegraded":"2024-09-19T04:15:47.171301+0000","last_fullsized":"2024-09-19T04:15:47.171301+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:55:01.724088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.997775+0000","last_change":"2024-09-19T04:14:33.308351+0000","last_active":"2024-09-19T04:15:46.997775+0000","last_peered":"2024-09-19T04:15:46.997775+0000","last_clean":"2024-09-19T04:15:46.997775+0000","last_became_active":"2024-09-19T04:14:33.308052+0000","last_became_peered":"2024-09-19T04:14:33.308052+0000","last_unstale":"2024-09-19T04:15:46.997775+0000","last_undegraded":"2024-09-19T04:15:46.997775+0000","last_fullsized":"2024-09-19T04:15:46.997775+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:06:32.056738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.998564+0000","last_change":"2024-09-19T04:14:31.291742+0000","last_active":"2024-09-19T04:15:46.998564+0000","last_peered":"2024-09-19T04:15:46.998564+0000","last_clean":"2024-09-19T04:15:46.998564+0000","last_became_active":"2024-09-19T04:14:31.291315+0000","last_became_peered":"2024-09-19T04:14:31.291315+0000","last_unstale":"2024-09-19T04:15:46.998564+0000","last_undegraded":"2024-09-19T04:15:46.998564+0000","last_fullsized":"2024-09-19T04:15:46.998564+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:16.159276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.997207+0000","last_change":"2024-09-19T04:14:31.293898+0000","last_active":"2024-09-19T04:15:46.997207+0000","last_peered":"2024-09-19T04:15:46.997207+0000","last_clean":"2024-09-19T04:15:46.997207+0000","last_became_active":"2024-09-19T04:14:31.293499+0000","last_became_peered":"2024-09-19T04:14:31.293499+0000","last_unstale":"2024-09-19T04:15:46.997207+0000","last_undegraded":"2024-09-19T04:15:46.997207+0000","last_fullsized":"2024-09-19T04:15:46.997207+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:25:55.590644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.995929+0000","last_change":"2024-09-19T04:14:33.314094+0000","last_active":"2024-09-19T04:15:46.995929+0000","last_peered":"2024-09-19T04:15:46.995929+0000","last_clean":"2024-09-19T04:15:46.995929+0000","last_became_active":"2024-09-19T04:14:33.312782+0000","last_became_peered":"2024-09-19T04:14:33.312782+0000","last_unstale":"2024-09-19T04:15:46.995929+0000","last_undegraded":"2024-09-19T04:15:46.995929+0000","last_fullsized":"2024-09-19T04:15:46.995929+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:40.121676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.341154+0000","last_change":"2024-09-19T04:14:40.369159+0000","last_active":"2024-09-19T04:15:47.341154+0000","last_peered":"2024-09-19T04:15:47.341154+0000","last_clean":"2024-09-19T04:15:47.341154+0000","last_became_active":"2024-09-19T04:14:40.368732+0000","last_became_peered":"2024-09-19T04:14:40.368732+0000","last_unstale":"2024-09-19T04:15:47.341154+0000","last_undegraded":"2024-09-19T04:15:47.341154+0000","last_fullsized":"2024-09-19T04:15:47.341154+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:12:29.176834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":92,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:16:06.893978+0000","last_change":"2024-09-19T04:14:31.298260+0000","last_active":"2024-09-19T04:16:06.893978+0000","last_peered":"2024-09-19T04:16:06.893978+0000","last_clean":"2024-09-19T04:16:06.893978+0000","last_became_active":"2024-09-19T04:14:31.297802+0000","last_became_peered":"2024-09-19T04:14:31.297802+0000","last_unstale":"2024-09-19T04:16:06.893978+0000","last_undegraded":"2024-09-19T04:16:06.893978+0000","last_fullsized":"2024-09-19T04:16:06.893978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:25:52.054848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.998108+0000","last_change":"2024-09-19T04:14:33.300555+0000","last_active":"2024-09-19T04:15:46.998108+0000","last_peered":"2024-09-19T04:15:46.998108+0000","last_clean":"2024-09-19T04:15:46.998108+0000","last_became_active":"2024-09-19T04:14:33.300220+0000","last_became_peered":"2024-09-19T04:14:33.300220+0000","last_unstale":"2024-09-19T04:15:46.998108+0000","last_undegraded":"2024-09-19T04:15:46.998108+0000","last_fullsized":"2024-09-19T04:15:46.998108+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:32.584140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.341239+0000","last_change":"2024-09-19T04:14:40.369471+0000","last_active":"2024-09-19T04:15:47.341239+0000","last_peered":"2024-09-19T04:15:47.341239+0000","last_clean":"2024-09-19T04:15:47.341239+0000","last_became_active":"2024-09-19T04:14:40.369065+0000","last_became_peered":"2024-09-19T04:14:40.369065+0000","last_unstale":"2024-09-19T04:15:47.341239+0000","last_undegraded":"2024-09-19T04:15:47.341239+0000","last_fullsized":"2024-09-19T04:15:47.341239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:40:03.888553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.170985+0000","last_change":"2024-09-19T04:14:33.312801+0000","last_active":"2024-09-19T04:15:47.170985+0000","last_peered":"2024-09-19T04:15:47.170985+0000","last_clean":"2024-09-19T04:15:47.170985+0000","last_became_active":"2024-09-19T04:14:33.312430+0000","last_became_peered":"2024-09-19T04:14:33.312430+0000","last_unstale":"2024-09-19T04:15:47.170985+0000","last_undegraded":"2024-09-19T04:15:47.170985+0000","last_fullsized":"2024-09-19T04:15:47.170985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:29.069507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.341004+0000","last_change":"2024-09-19T04:14:33.313076+0000","last_active":"2024-09-19T04:15:47.341004+0000","last_peered":"2024-09-19T04:15:47.341004+0000","last_clean":"2024-09-19T04:15:47.341004+0000","last_became_active":"2024-09-19T04:14:33.312730+0000","last_became_peered":"2024-09-19T04:14:33.312730+0000","last_unstale":"2024-09-19T04:15:47.341004+0000","last_undegraded":"2024-09-19T04:15:47.341004+0000","last_fullsized":"2024-09-19T04:15:47.341004+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:33.397309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340631+0000","last_change":"2024-09-19T04:14:33.314724+0000","last_active":"2024-09-19T04:15:47.340631+0000","last_peered":"2024-09-19T04:15:47.340631+0000","last_clean":"2024-09-19T04:15:47.340631+0000","last_became_active":"2024-09-19T04:14:33.314359+0000","last_became_peered":"2024-09-19T04:14:33.314359+0000","last_unstale":"2024-09-19T04:15:47.340631+0000","last_undegraded":"2024-09-19T04:15:47.340631+0000","last_fullsized":"2024-09-19T04:15:47.340631+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:37:39.357193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340817+0000","last_change":"2024-09-19T04:14:33.312834+0000","last_active":"2024-09-19T04:15:47.340817+0000","last_peered":"2024-09-19T04:15:47.340817+0000","last_clean":"2024-09-19T04:15:47.340817+0000","last_became_active":"2024-09-19T04:14:33.312538+0000","last_became_peered":"2024-09-19T04:14:33.312538+0000","last_unstale":"2024-09-19T04:15:47.340817+0000","last_undegraded":"2024-09-19T04:15:47.340817+0000","last_fullsized":"2024-09-19T04:15:47.340817+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:25:37.694910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999613+0000","last_change":"2024-09-19T04:14:33.305735+0000","last_active":"2024-09-19T04:15:46.999613+0000","last_peered":"2024-09-19T04:15:46.999613+0000","last_clean":"2024-09-19T04:15:46.999613+0000","last_became_active":"2024-09-19T04:14:33.305415+0000","last_became_peered":"2024-09-19T04:14:33.305415+0000","last_unstale":"2024-09-19T04:15:46.999613+0000","last_undegraded":"2024-09-19T04:15:46.999613+0000","last_fullsized":"2024-09-19T04:15:46.999613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:20.160211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.171395+0000","last_change":"2024-09-19T04:14:33.313379+0000","last_active":"2024-09-19T04:15:47.171395+0000","last_peered":"2024-09-19T04:15:47.171395+0000","last_clean":"2024-09-19T04:15:47.171395+0000","last_became_active":"2024-09-19T04:14:33.312453+0000","last_became_peered":"2024-09-19T04:14:33.312453+0000","last_unstale":"2024-09-19T04:15:47.171395+0000","last_undegraded":"2024-09-19T04:15:47.171395+0000","last_fullsized":"2024-09-19T04:15:47.171395+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:44.832004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340859+0000","last_change":"2024-09-19T04:14:33.307371+0000","last_active":"2024-09-19T04:15:47.340859+0000","last_peered":"2024-09-19T04:15:47.340859+0000","last_clean":"2024-09-19T04:15:47.340859+0000","last_became_active":"2024-09-19T04:14:33.307033+0000","last_became_peered":"2024-09-19T04:14:33.307033+0000","last_unstale":"2024-09-19T04:15:47.340859+0000","last_undegraded":"2024-09-19T04:15:47.340859+0000","last_fullsized":"2024-09-19T04:15:47.340859+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:12.027213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.342412+0000","last_change":"2024-09-19T04:15:47.342412+0000","last_active":"2024-09-19T04:15:47.342412+0000","last_peered":"2024-09-19T04:15:47.342412+0000","last_clean":"2024-09-19T04:15:47.342412+0000","last_became_active":"2024-09-19T04:15:47.341989+0000","last_became_peered":"2024-09-19T04:15:47.341989+0000","last_unstale":"2024-09-19T04:15:47.342412+0000","last_undegraded":"2024-09-19T04:15:47.342412+0000","last_fullsized":"2024-09-19T04:15:47.342412+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:32.713199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.995296+0000","last_change":"2024-09-19T04:14:33.314296+0000","last_active":"2024-09-19T04:15:46.995296+0000","last_peered":"2024-09-19T04:15:46.995296+0000","last_clean":"2024-09-19T04:15:46.995296+0000","last_became_active":"2024-09-19T04:14:33.311230+0000","last_became_peered":"2024-09-19T04:14:33.311230+0000","last_unstale":"2024-09-19T04:15:46.995296+0000","last_undegraded":"2024-09-19T04:15:46.995296+0000","last_fullsized":"2024-09-19T04:15:46.995296+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:37:51.395086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.997973+0000","last_change":"2024-09-19T04:14:33.317125+0000","last_active":"2024-09-19T04:15:46.997973+0000","last_peered":"2024-09-19T04:15:46.997973+0000","last_clean":"2024-09-19T04:15:46.997973+0000","last_became_active":"2024-09-19T04:14:33.316805+0000","last_became_peered":"2024-09-19T04:14:33.316805+0000","last_unstale":"2024-09-19T04:15:46.997973+0000","last_undegraded":"2024-09-19T04:15:46.997973+0000","last_fullsized":"2024-09-19T04:15:46.997973+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:27.754882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.341370+0000","last_change":"2024-09-19T04:14:33.310081+0000","last_active":"2024-09-19T04:15:47.341370+0000","last_peered":"2024-09-19T04:15:47.341370+0000","last_clean":"2024-09-19T04:15:47.341370+0000","last_became_active":"2024-09-19T04:14:33.308675+0000","last_became_peered":"2024-09-19T04:14:33.308675+0000","last_unstale":"2024-09-19T04:15:47.341370+0000","last_undegraded":"2024-09-19T04:15:47.341370+0000","last_fullsized":"2024-09-19T04:15:47.341370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:58.187633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999445+0000","last_change":"2024-09-19T04:14:33.308220+0000","last_active":"2024-09-19T04:15:46.999445+0000","last_peered":"2024-09-19T04:15:46.999445+0000","last_clean":"2024-09-19T04:15:46.999445+0000","last_became_active":"2024-09-19T04:14:33.307934+0000","last_became_peered":"2024-09-19T04:14:33.307934+0000","last_unstale":"2024-09-19T04:15:46.999445+0000","last_undegraded":"2024-09-19T04:15:46.999445+0000","last_fullsized":"2024-09-19T04:15:46.999445+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:22.490250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.171295+0000","last_change":"2024-09-19T04:14:33.306617+0000","last_active":"2024-09-19T04:15:47.171295+0000","last_peered":"2024-09-19T04:15:47.171295+0000","last_clean":"2024-09-19T04:15:47.171295+0000","last_became_active":"2024-09-19T04:14:33.306244+0000","last_became_peered":"2024-09-19T04:14:33.306244+0000","last_unstale":"2024-09-19T04:15:47.171295+0000","last_undegraded":"2024-09-19T04:15:47.171295+0000","last_fullsized":"2024-09-19T04:15:47.171295+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:22.095989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.341222+0000","last_change":"2024-09-19T04:14:33.314915+0000","last_active":"2024-09-19T04:15:47.341222+0000","last_peered":"2024-09-19T04:15:47.341222+0000","last_clean":"2024-09-19T04:15:47.341222+0000","last_became_active":"2024-09-19T04:14:33.314601+0000","last_became_peered":"2024-09-19T04:14:33.314601+0000","last_unstale":"2024-09-19T04:15:47.341222+0000","last_undegraded":"2024-09-19T04:15:47.341222+0000","last_fullsized":"2024-09-19T04:15:47.341222+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:37.687964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.994796+0000","last_change":"2024-09-19T04:14:33.304667+0000","last_active":"2024-09-19T04:15:46.994796+0000","last_peered":"2024-09-19T04:15:46.994796+0000","last_clean":"2024-09-19T04:15:46.994796+0000","last_became_active":"2024-09-19T04:14:33.304356+0000","last_became_peered":"2024-09-19T04:14:33.304356+0000","last_unstale":"2024-09-19T04:15:46.994796+0000","last_undegraded":"2024-09-19T04:15:46.994796+0000","last_fullsized":"2024-09-19T04:15:46.994796+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:37.128074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.171570+0000","last_change":"2024-09-19T04:14:33.310002+0000","last_active":"2024-09-19T04:15:47.171570+0000","last_peered":"2024-09-19T04:15:47.171570+0000","last_clean":"2024-09-19T04:15:47.171570+0000","last_became_active":"2024-09-19T04:14:33.309639+0000","last_became_peered":"2024-09-19T04:14:33.309639+0000","last_unstale":"2024-09-19T04:15:47.171570+0000","last_undegraded":"2024-09-19T04:15:47.171570+0000","last_fullsized":"2024-09-19T04:15:47.171570+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:21.954435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340871+0000","last_change":"2024-09-19T04:14:33.307296+0000","last_active":"2024-09-19T04:15:47.340871+0000","last_peered":"2024-09-19T04:15:47.340871+0000","last_clean":"2024-09-19T04:15:47.340871+0000","last_became_active":"2024-09-19T04:14:33.306998+0000","last_became_peered":"2024-09-19T04:14:33.306998+0000","last_unstale":"2024-09-19T04:15:47.340871+0000","last_undegraded":"2024-09-19T04:15:47.340871+0000","last_fullsized":"2024-09-19T04:15:47.340871+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:55.833196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340613+0000","last_change":"2024-09-19T04:14:33.313568+0000","last_active":"2024-09-19T04:15:47.340613+0000","last_peered":"2024-09-19T04:15:47.340613+0000","last_clean":"2024-09-19T04:15:47.340613+0000","last_became_active":"2024-09-19T04:14:33.313228+0000","last_became_peered":"2024-09-19T04:14:33.313228+0000","last_unstale":"2024-09-19T04:15:47.340613+0000","last_undegraded":"2024-09-19T04:15:47.340613+0000","last_fullsized":"2024-09-19T04:15:47.340613+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:31:43.348866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340528+0000","last_change":"2024-09-19T04:14:33.309745+0000","last_active":"2024-09-19T04:15:47.340528+0000","last_peered":"2024-09-19T04:15:47.340528+0000","last_clean":"2024-09-19T04:15:47.340528+0000","last_became_active":"2024-09-19T04:14:33.309327+0000","last_became_peered":"2024-09-19T04:14:33.309327+0000","last_unstale":"2024-09-19T04:15:47.340528+0000","last_undegraded":"2024-09-19T04:15:47.340528+0000","last_fullsized":"2024-09-19T04:15:47.340528+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:05.081550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999345+0000","last_change":"2024-09-19T04:14:33.306186+0000","last_active":"2024-09-19T04:15:46.999345+0000","last_peered":"2024-09-19T04:15:46.999345+0000","last_clean":"2024-09-19T04:15:46.999345+0000","last_became_active":"2024-09-19T04:14:33.305865+0000","last_became_peered":"2024-09-19T04:14:33.305865+0000","last_unstale":"2024-09-19T04:15:46.999345+0000","last_undegraded":"2024-09-19T04:15:46.999345+0000","last_fullsized":"2024-09-19T04:15:46.999345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:33.054326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.995843+0000","last_change":"2024-09-19T04:14:33.307667+0000","last_active":"2024-09-19T04:15:46.995843+0000","last_peered":"2024-09-19T04:15:46.995843+0000","last_clean":"2024-09-19T04:15:46.995843+0000","last_became_active":"2024-09-19T04:14:33.307315+0000","last_became_peered":"2024-09-19T04:14:33.307315+0000","last_unstale":"2024-09-19T04:15:46.995843+0000","last_undegraded":"2024-09-19T04:15:46.995843+0000","last_fullsized":"2024-09-19T04:15:46.995843+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:52.209438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999500+0000","last_change":"2024-09-19T04:14:33.312430+0000","last_active":"2024-09-19T04:15:46.999500+0000","last_peered":"2024-09-19T04:15:46.999500+0000","last_clean":"2024-09-19T04:15:46.999500+0000","last_became_active":"2024-09-19T04:14:33.311786+0000","last_became_peered":"2024-09-19T04:14:33.311786+0000","last_unstale":"2024-09-19T04:15:46.999500+0000","last_undegraded":"2024-09-19T04:15:46.999500+0000","last_fullsized":"2024-09-19T04:15:46.999500+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:17:25.785612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.997972+0000","last_change":"2024-09-19T04:14:33.310478+0000","last_active":"2024-09-19T04:15:46.997972+0000","last_peered":"2024-09-19T04:15:46.997972+0000","last_clean":"2024-09-19T04:15:46.997972+0000","last_became_active":"2024-09-19T04:14:33.309960+0000","last_became_peered":"2024-09-19T04:14:33.309960+0000","last_unstale":"2024-09-19T04:15:46.997972+0000","last_undegraded":"2024-09-19T04:15:46.997972+0000","last_fullsized":"2024-09-19T04:15:46.997972+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:37:43.008022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.341628+0000","last_change":"2024-09-19T04:14:33.312449+0000","last_active":"2024-09-19T04:15:47.341628+0000","last_peered":"2024-09-19T04:15:47.341628+0000","last_clean":"2024-09-19T04:15:47.341628+0000","last_became_active":"2024-09-19T04:14:33.312124+0000","last_became_peered":"2024-09-19T04:14:33.312124+0000","last_unstale":"2024-09-19T04:15:47.341628+0000","last_undegraded":"2024-09-19T04:15:47.341628+0000","last_fullsized":"2024-09-19T04:15:47.341628+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:53.556895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.997298+0000","last_change":"2024-09-19T04:14:33.317095+0000","last_active":"2024-09-19T04:15:46.997298+0000","last_peered":"2024-09-19T04:15:46.997298+0000","last_clean":"2024-09-19T04:15:46.997298+0000","last_became_active":"2024-09-19T04:14:33.316763+0000","last_became_peered":"2024-09-19T04:14:33.316763+0000","last_unstale":"2024-09-19T04:15:46.997298+0000","last_undegraded":"2024-09-19T04:15:46.997298+0000","last_fullsized":"2024-09-19T04:15:46.997298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:14.894679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.999193+0000","last_change":"2024-09-19T04:14:33.316578+0000","last_active":"2024-09-19T04:15:46.999193+0000","last_peered":"2024-09-19T04:15:46.999193+0000","last_clean":"2024-09-19T04:15:46.999193+0000","last_became_active":"2024-09-19T04:14:33.316215+0000","last_became_peered":"2024-09-19T04:14:33.316215+0000","last_unstale":"2024-09-19T04:15:46.999193+0000","last_undegraded":"2024-09-19T04:15:46.999193+0000","last_fullsized":"2024-09-19T04:15:46.999193+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:18.770360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.000540+0000","last_change":"2024-09-19T04:15:47.000540+0000","last_active":"2024-09-19T04:15:47.000540+0000","last_peered":"2024-09-19T04:15:47.000540+0000","last_clean":"2024-09-19T04:15:47.000540+0000","last_became_active":"2024-09-19T04:15:47.000155+0000","last_became_peered":"2024-09-19T04:15:47.000155+0000","last_unstale":"2024-09-19T04:15:47.000540+0000","last_undegraded":"2024-09-19T04:15:47.000540+0000","last_fullsized":"2024-09-19T04:15:47.000540+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:19.055366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:46.997264+0000","last_change":"2024-09-19T04:14:33.309468+0000","last_active":"2024-09-19T04:15:46.997264+0000","last_peered":"2024-09-19T04:15:46.997264+0000","last_clean":"2024-09-19T04:15:46.997264+0000","last_became_active":"2024-09-19T04:14:33.309164+0000","last_became_peered":"2024-09-19T04:14:33.309164+0000","last_unstale":"2024-09-19T04:15:46.997264+0000","last_undegraded":"2024-09-19T04:15:46.997264+0000","last_fullsized":"2024-09-19T04:15:46.997264+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:05:19.193395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.343118+0000","last_change":"2024-09-19T04:15:47.342502+0000","last_active":"2024-09-19T04:15:47.343118+0000","last_peered":"2024-09-19T04:15:47.343118+0000","last_clean":"2024-09-19T04:15:47.343118+0000","last_became_active":"2024-09-19T04:15:47.342127+0000","last_became_peered":"2024-09-19T04:15:47.342127+0000","last_unstale":"2024-09-19T04:15:47.343118+0000","last_undegraded":"2024-09-19T04:15:47.343118+0000","last_fullsized":"2024-09-19T04:15:47.343118+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:47.192614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340733+0000","last_change":"2024-09-19T04:14:33.308268+0000","last_active":"2024-09-19T04:15:47.340733+0000","last_peered":"2024-09-19T04:15:47.340733+0000","last_clean":"2024-09-19T04:15:47.340733+0000","last_became_active":"2024-09-19T04:14:33.307945+0000","last_became_peered":"2024-09-19T04:14:33.307945+0000","last_unstale":"2024-09-19T04:15:47.340733+0000","last_undegraded":"2024-09-19T04:15:47.340733+0000","last_fullsized":"2024-09-19T04:15:47.340733+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:24.410351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.340755+0000","last_change":"2024-09-19T04:14:33.315522+0000","last_active":"2024-09-19T04:15:47.340755+0000","last_peered":"2024-09-19T04:15:47.340755+0000","last_clean":"2024-09-19T04:15:47.340755+0000","last_became_active":"2024-09-19T04:14:33.315220+0000","last_became_peered":"2024-09-19T04:14:33.315220+0000","last_unstale":"2024-09-19T04:15:47.340755+0000","last_undegraded":"2024-09-19T04:15:47.340755+0000","last_fullsized":"2024-09-19T04:15:47.340755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:41:40.915933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T04:15:47.171470+0000","last_change":"2024-09-19T04:14:33.309450+0000","last_active":"2024-09-19T04:15:47.171470+0000","last_peered":"2024-09-19T04:15:47.171470+0000","last_clean":"2024-09-19T04:15:47.171470+0000","last_became_active":"2024-09-19T04:14:33.309013+0000","last_became_peered":"2024-09-19T04:14:33.309013+0000","last_unstale":"2024-09-19T04:15:47.171470+0000","last_undegraded":"2024-09-19T04:15:47.171470+0000","last_fullsized":"2024-09-19T04:15:47.171470+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:49.523372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71830,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":549,"num_read_kb":351,"num_write":251,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":215490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285207,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579937,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":974848,"data_stored":496552,"data_compressed":23691,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808870,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28132,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717020,"statfs":{"total":95995035648,"available":95966228480,"internally_reserved":0,"allocated":1126400,"data_stored":1148383,"data_compressed":59955,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972395,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1003520,"data_stored":500578,"data_compressed":23691,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201327,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":995328,"data_stored":496860,"data_compressed":23691,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430260,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1048576,"data_stored":1093752,"data_compressed":59955,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593786,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":492379,"data_compressed":23691,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822719,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1056768,"data_stored":1088548,"data_compressed":59955,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986243,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":496453,"data_compressed":23691,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215176,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":987136,"data_stored":491694,"data_compressed":23691,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1064960,"data_stored":557858,"data_compressed":23691,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1044480,"data_stored":558031,"data_compressed":23691,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":999424,"data_stored":493442,"data_compressed":23691,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34629,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34629,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34629,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":66767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":66594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":66751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T04:16:11.991 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T04:16:11.991 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T04:16:11.991 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T04:16:11.992 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T04:16:12.250 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:12.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.732+0000 7f01644e9640 1 -- 172.21.15.7:0/3975493687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f015c101de0 msgr2=0x7f015c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:12.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.732+0000 7f01644e9640 1 --2- 172.21.15.7:0/3975493687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f015c101de0 0x7f015c1021c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0158009900 tx=0x7f015802a410 comp rx=0 tx=0).stop 2024-09-19T04:16:12.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.732+0000 7f01644e9640 1 -- 172.21.15.7:0/3975493687 shutdown_connections 2024-09-19T04:16:12.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.732+0000 7f01644e9640 1 --2- 172.21.15.7:0/3975493687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f015c106f10 0x7f015c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:12.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.732+0000 7f01644e9640 1 --2- 172.21.15.7:0/3975493687 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f015c102790 0x7f015c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:12.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.732+0000 7f01644e9640 1 --2- 172.21.15.7:0/3975493687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f015c101de0 0x7f015c1021c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:12.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.732+0000 7f01644e9640 1 -- 172.21.15.7:0/3975493687 >> 172.21.15.7:0/3975493687 conn(0x7f015c0fd8c0 msgr2=0x7f015c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:12.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.732+0000 7f01644e9640 1 -- 172.21.15.7:0/3975493687 shutdown_connections 2024-09-19T04:16:12.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.732+0000 7f01644e9640 1 -- 172.21.15.7:0/3975493687 wait complete. 2024-09-19T04:16:12.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.733+0000 7f01644e9640 1 Processor -- start 2024-09-19T04:16:12.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.733+0000 7f01644e9640 1 -- start start 2024-09-19T04:16:12.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.733+0000 7f01644e9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f015c101de0 0x7f015c1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:12.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.733+0000 7f01644e9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f015c102790 0x7f015c1989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:12.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.733+0000 7f01644e9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f015c106f10 0x7f015c19cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:12.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.733+0000 7f01644e9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f015c111fc0 con 0x7f015c106f10 2024-09-19T04:16:12.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.733+0000 7f01644e9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f015c111e40 con 0x7f015c101de0 2024-09-19T04:16:12.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.733+0000 7f01644e9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f015c112140 con 0x7f015c102790 2024-09-19T04:16:12.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.733+0000 7f0162a86640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f015c106f10 0x7f015c19cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:12.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.733+0000 7f0162a86640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f015c106f10 0x7f015c19cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36686/0 (socket says 172.21.15.7:36686) 2024-09-19T04:16:12.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.733+0000 7f0162a86640 1 -- 172.21.15.7:0/3589478269 learned_addr learned my addr 172.21.15.7:0/3589478269 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:12.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.733+0000 7f0161a84640 1 --2- 172.21.15.7:0/3589478269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f015c102790 0x7f015c1989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:12.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.734+0000 7f0162285640 1 --2- 172.21.15.7:0/3589478269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f015c101de0 0x7f015c1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:12.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.734+0000 7f0162a86640 1 -- 172.21.15.7:0/3589478269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f015c102790 msgr2=0x7f015c1989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:12.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.734+0000 7f0162a86640 1 --2- 172.21.15.7:0/3589478269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f015c102790 0x7f015c1989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:12.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.734+0000 7f0162a86640 1 -- 172.21.15.7:0/3589478269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f015c101de0 msgr2=0x7f015c1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:12.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.734+0000 7f0162a86640 1 --2- 172.21.15.7:0/3589478269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f015c101de0 0x7f015c1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.734+0000 7f0162a86640 1 -- 172.21.15.7:0/3589478269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f015c19d450 con 0x7f015c106f10 2024-09-19T04:16:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.734+0000 7f0162285640 1 --2- 172.21.15.7:0/3589478269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f015c101de0 0x7f015c1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:16:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.734+0000 7f0162a86640 1 --2- 172.21.15.7:0/3589478269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f015c106f10 0x7f015c19cd70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f015400cad0 tx=0x7f015400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.734+0000 7f01537fe640 1 -- 172.21.15.7:0/3589478269 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015400ae20 con 0x7f015c106f10 2024-09-19T04:16:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.734+0000 7f01644e9640 1 -- 172.21.15.7:0/3589478269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f015c19d740 con 0x7f015c106f10 2024-09-19T04:16:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.734+0000 7f01537fe640 1 -- 172.21.15.7:0/3589478269 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0154005020 con 0x7f015c106f10 2024-09-19T04:16:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.734+0000 7f01537fe640 1 -- 172.21.15.7:0/3589478269 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015400f6f0 con 0x7f015c106f10 2024-09-19T04:16:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.734+0000 7f01644e9640 1 -- 172.21.15.7:0/3589478269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f015c1a5020 con 0x7f015c106f10 2024-09-19T04:16:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.735+0000 7f01644e9640 1 -- 172.21.15.7:0/3589478269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f015c1021c0 con 0x7f015c106f10 2024-09-19T04:16:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.736+0000 7f01537fe640 1 -- 172.21.15.7:0/3589478269 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f01540051d0 con 0x7f015c106f10 2024-09-19T04:16:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.737+0000 7f01537fe640 1 --2- 172.21.15.7:0/3589478269 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f01480a32d0 0x7f01480a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.737+0000 7f0162285640 1 --2- 172.21.15.7:0/3589478269 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f01480a32d0 0x7f01480a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.737+0000 7f01537fe640 1 -- 172.21.15.7:0/3589478269 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f01540d0170 con 0x7f015c106f10 2024-09-19T04:16:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.738+0000 7f0162285640 1 --2- 172.21.15.7:0/3589478269 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f01480a32d0 0x7f01480a5790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0158005ab0 tx=0x7f0158000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.740+0000 7f01537fe640 1 -- 172.21.15.7:0/3589478269 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0154014030 con 0x7f015c106f10 2024-09-19T04:16:12.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.956+0000 7f01644e9640 1 -- 172.21.15.7:0/3589478269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f015c199800 con 0x7f015c106f10 2024-09-19T04:16:12.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.956+0000 7f01537fe640 1 -- 172.21.15.7:0/3589478269 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f015c199800 con 0x7f015c106f10 2024-09-19T04:16:12.958 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:16:12.958 INFO:teuthology.orchestra.run.smithi007.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T04:16:12.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.959+0000 7f01644e9640 1 -- 172.21.15.7:0/3589478269 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f01480a32d0 msgr2=0x7f01480a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:12.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.959+0000 7f01644e9640 1 --2- 172.21.15.7:0/3589478269 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f01480a32d0 0x7f01480a5790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0158005ab0 tx=0x7f0158000bc0 comp rx=0 tx=0).stop 2024-09-19T04:16:12.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.959+0000 7f01644e9640 1 -- 172.21.15.7:0/3589478269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f015c106f10 msgr2=0x7f015c19cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:12.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.959+0000 7f01644e9640 1 --2- 172.21.15.7:0/3589478269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f015c106f10 0x7f015c19cd70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f015400cad0 tx=0x7f015400cf90 comp rx=0 tx=0).stop 2024-09-19T04:16:12.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.959+0000 7f01644e9640 1 -- 172.21.15.7:0/3589478269 shutdown_connections 2024-09-19T04:16:12.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.959+0000 7f01644e9640 1 --2- 172.21.15.7:0/3589478269 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f01480a32d0 0x7f01480a5790 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:12.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.959+0000 7f01644e9640 1 --2- 172.21.15.7:0/3589478269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f015c106f10 0x7f015c19cd70 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:12.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.959+0000 7f01644e9640 1 --2- 172.21.15.7:0/3589478269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f015c102790 0x7f015c1989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:12.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.959+0000 7f01644e9640 1 --2- 172.21.15.7:0/3589478269 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f015c101de0 0x7f015c1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:12.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.959+0000 7f01644e9640 1 -- 172.21.15.7:0/3589478269 >> 172.21.15.7:0/3589478269 conn(0x7f015c0fd8c0 msgr2=0x7f015c0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:12.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.959+0000 7f01644e9640 1 -- 172.21.15.7:0/3589478269 shutdown_connections 2024-09-19T04:16:12.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:12.959+0000 7f01644e9640 1 -- 172.21.15.7:0/3589478269 wait complete. 2024-09-19T04:16:13.257 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:13 smithi007 ceph-mon[31360]: pgmap v331: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T04:16:13.258 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:13 smithi007 ceph-mon[31360]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:16:13.258 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:13 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3589478269' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T04:16:13.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:13 smithi102 ceph-mon[35446]: pgmap v331: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T04:16:13.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:13 smithi102 ceph-mon[35446]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:16:13.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:13 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3589478269' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T04:16:13.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:13 smithi092 ceph-mon[34940]: pgmap v331: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T04:16:13.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:13 smithi092 ceph-mon[34940]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:16:13.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:13 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3589478269' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T04:16:13.694 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T04:16:13.695 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:16:13.964 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.413+0000 7f66e16b9640 1 -- 172.21.15.7:0/315827805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66dc106a80 msgr2=0x7f66dc106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.413+0000 7f66e16b9640 1 --2- 172.21.15.7:0/315827805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66dc106a80 0x7f66dc106e60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f66cc009930 tx=0x7f66cc02a420 comp rx=0 tx=0).stop 2024-09-19T04:16:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.413+0000 7f66e16b9640 1 -- 172.21.15.7:0/315827805 shutdown_connections 2024-09-19T04:16:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.413+0000 7f66e16b9640 1 --2- 172.21.15.7:0/315827805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66dc101420 0x7f66dc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.413+0000 7f66e16b9640 1 --2- 172.21.15.7:0/315827805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66dc100a80 0x7f66dc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.413+0000 7f66e16b9640 1 --2- 172.21.15.7:0/315827805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66dc106a80 0x7f66dc106e60 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.413+0000 7f66e16b9640 1 -- 172.21.15.7:0/315827805 >> 172.21.15.7:0/315827805 conn(0x7f66dc0fc7a0 msgr2=0x7f66dc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.413+0000 7f66e16b9640 1 -- 172.21.15.7:0/315827805 shutdown_connections 2024-09-19T04:16:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.413+0000 7f66e16b9640 1 -- 172.21.15.7:0/315827805 wait complete. 2024-09-19T04:16:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.414+0000 7f66e16b9640 1 Processor -- start 2024-09-19T04:16:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.414+0000 7f66e16b9640 1 -- start start 2024-09-19T04:16:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.415+0000 7f66e16b9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66dc100a80 0x7f66dc198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.415+0000 7f66e16b9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66dc101420 0x7f66dc1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.415+0000 7f66e16b9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66dc106a80 0x7f66dc19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.415+0000 7f66e16b9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f66dc110e80 con 0x7f66dc101420 2024-09-19T04:16:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.415+0000 7f66e16b9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f66dc110d00 con 0x7f66dc100a80 2024-09-19T04:16:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.415+0000 7f66e16b9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f66dc111000 con 0x7f66dc106a80 2024-09-19T04:16:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.415+0000 7f66da7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66dc101420 0x7f66dc1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.415+0000 7f66daffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66dc100a80 0x7f66dc198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.415+0000 7f66db7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66dc106a80 0x7f66dc19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.415+0000 7f66daffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66dc100a80 0x7f66dc198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:43174/0 (socket says 172.21.15.7:43174) 2024-09-19T04:16:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.415+0000 7f66da7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66dc101420 0x7f66dc1989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36702/0 (socket says 172.21.15.7:36702) 2024-09-19T04:16:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.415+0000 7f66daffd640 1 -- 172.21.15.7:0/3338751306 learned_addr learned my addr 172.21.15.7:0/3338751306 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.415+0000 7f66daffd640 1 -- 172.21.15.7:0/3338751306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66dc106a80 msgr2=0x7f66dc19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.415+0000 7f66daffd640 1 --2- 172.21.15.7:0/3338751306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66dc106a80 0x7f66dc19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.415+0000 7f66daffd640 1 -- 172.21.15.7:0/3338751306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66dc101420 msgr2=0x7f66dc1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.415+0000 7f66daffd640 1 --2- 172.21.15.7:0/3338751306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66dc101420 0x7f66dc1989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.415+0000 7f66daffd640 1 -- 172.21.15.7:0/3338751306 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66dc19d420 con 0x7f66dc100a80 2024-09-19T04:16:14.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.415+0000 7f66db7fe640 1 --2- 172.21.15.7:0/3338751306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66dc106a80 0x7f66dc19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:16:14.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.415+0000 7f66da7fc640 1 --2- 172.21.15.7:0/3338751306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66dc101420 0x7f66dc1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:16:14.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.415+0000 7f66daffd640 1 --2- 172.21.15.7:0/3338751306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66dc100a80 0x7f66dc198470 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f66cc009230 tx=0x7f66cc004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:14.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.416+0000 7f66d3fff640 1 -- 172.21.15.7:0/3338751306 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66cc03f030 con 0x7f66dc100a80 2024-09-19T04:16:14.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.416+0000 7f66e16b9640 1 -- 172.21.15.7:0/3338751306 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66dc19d6b0 con 0x7f66dc100a80 2024-09-19T04:16:14.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.416+0000 7f66d3fff640 1 -- 172.21.15.7:0/3338751306 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66cc003ad0 con 0x7f66dc100a80 2024-09-19T04:16:14.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.416+0000 7f66d3fff640 1 -- 172.21.15.7:0/3338751306 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66cc035070 con 0x7f66dc100a80 2024-09-19T04:16:14.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.416+0000 7f66e16b9640 1 -- 172.21.15.7:0/3338751306 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66dc1a4ff0 con 0x7f66dc100a80 2024-09-19T04:16:14.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.417+0000 7f66e16b9640 1 -- 172.21.15.7:0/3338751306 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66dc1021c0 con 0x7f66dc100a80 2024-09-19T04:16:14.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.418+0000 7f66d3fff640 1 -- 172.21.15.7:0/3338751306 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f66cc042030 con 0x7f66dc100a80 2024-09-19T04:16:14.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.419+0000 7f66d3fff640 1 --2- 172.21.15.7:0/3338751306 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f66c80a32d0 0x7f66c80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:14.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.419+0000 7f66da7fc640 1 --2- 172.21.15.7:0/3338751306 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f66c80a32d0 0x7f66c80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:14.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.419+0000 7f66d3fff640 1 -- 172.21.15.7:0/3338751306 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f66cc0f0450 con 0x7f66dc100a80 2024-09-19T04:16:14.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.419+0000 7f66da7fc640 1 --2- 172.21.15.7:0/3338751306 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f66c80a32d0 0x7f66c80a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f66dc105270 tx=0x7f66c4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:14.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.422+0000 7f66d3fff640 1 -- 172.21.15.7:0/3338751306 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f66cc0bc680 con 0x7f66dc100a80 2024-09-19T04:16:14.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.634+0000 7f66e16b9640 1 -- 172.21.15.7:0/3338751306 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66dc100ee0 con 0x7f66dc100a80 2024-09-19T04:16:14.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.635+0000 7f66d3fff640 1 -- 172.21.15.7:0/3338751306 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11962 (secure 0 0 0) 0x7f66dc100ee0 con 0x7f66dc100a80 2024-09-19T04:16:14.637 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:16:14.637 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"btime":"2024-09-19T04:15:17:816953+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:15:17.816938+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24496,"mds_2":24482,"mds_3":24478,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24506,24496,24482,24478,24472]},"id":1}]} 2024-09-19T04:16:14.637 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 27 2024-09-19T04:16:14.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.637+0000 7f66e16b9640 1 -- 172.21.15.7:0/3338751306 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f66c80a32d0 msgr2=0x7f66c80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:14.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.637+0000 7f66e16b9640 1 --2- 172.21.15.7:0/3338751306 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f66c80a32d0 0x7f66c80a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f66dc105270 tx=0x7f66c4005f90 comp rx=0 tx=0).stop 2024-09-19T04:16:14.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.637+0000 7f66e16b9640 1 -- 172.21.15.7:0/3338751306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66dc100a80 msgr2=0x7f66dc198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:14.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.638+0000 7f66e16b9640 1 --2- 172.21.15.7:0/3338751306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66dc100a80 0x7f66dc198470 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f66cc009230 tx=0x7f66cc004270 comp rx=0 tx=0).stop 2024-09-19T04:16:14.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.638+0000 7f66e16b9640 1 -- 172.21.15.7:0/3338751306 shutdown_connections 2024-09-19T04:16:14.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.638+0000 7f66e16b9640 1 --2- 172.21.15.7:0/3338751306 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f66c80a32d0 0x7f66c80a5790 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:14.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.638+0000 7f66e16b9640 1 --2- 172.21.15.7:0/3338751306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66dc106a80 0x7f66dc19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:14.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.638+0000 7f66e16b9640 1 --2- 172.21.15.7:0/3338751306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f66dc101420 0x7f66dc1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:14.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.638+0000 7f66e16b9640 1 --2- 172.21.15.7:0/3338751306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f66dc100a80 0x7f66dc198470 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:14.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.638+0000 7f66e16b9640 1 -- 172.21.15.7:0/3338751306 >> 172.21.15.7:0/3338751306 conn(0x7f66dc0fc7a0 msgr2=0x7f66dc06aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:14.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.638+0000 7f66e16b9640 1 -- 172.21.15.7:0/3338751306 shutdown_connections 2024-09-19T04:16:14.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:14.638+0000 7f66e16b9640 1 -- 172.21.15.7:0/3338751306 wait complete. 2024-09-19T04:16:15.277 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:15 smithi007 ceph-mon[31360]: pgmap v332: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T04:16:15.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:15 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3338751306' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:16:15.307 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:16:15.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:15 smithi102 ceph-mon[35446]: pgmap v332: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T04:16:15.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:15 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3338751306' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:16:15.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:15 smithi092 ceph-mon[34940]: pgmap v332: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T04:16:15.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:15 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3338751306' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:16:15.565 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:16.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.048+0000 7fa37623b640 1 -- 172.21.15.7:0/2670769666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa370102d40 msgr2=0x7fa370103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:16.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.048+0000 7fa37623b640 1 --2- 172.21.15.7:0/2670769666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa370102d40 0x7fa370103120 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa360009900 tx=0x7fa36002a480 comp rx=0 tx=0).stop 2024-09-19T04:16:16.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.048+0000 7fa37623b640 1 -- 172.21.15.7:0/2670769666 shutdown_connections 2024-09-19T04:16:16.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.048+0000 7fa37623b640 1 --2- 172.21.15.7:0/2670769666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa37010c170 0x7fa37010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:16.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.048+0000 7fa37623b640 1 --2- 172.21.15.7:0/2670769666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa370103660 0x7fa37010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:16.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.048+0000 7fa37623b640 1 --2- 172.21.15.7:0/2670769666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa370102d40 0x7fa370103120 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:16.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.048+0000 7fa37623b640 1 -- 172.21.15.7:0/2670769666 >> 172.21.15.7:0/2670769666 conn(0x7fa3700fc7a0 msgr2=0x7fa3700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:16.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.048+0000 7fa37623b640 1 -- 172.21.15.7:0/2670769666 shutdown_connections 2024-09-19T04:16:16.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.048+0000 7fa37623b640 1 -- 172.21.15.7:0/2670769666 wait complete. 2024-09-19T04:16:16.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.048+0000 7fa37623b640 1 Processor -- start 2024-09-19T04:16:16.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.048+0000 7fa37623b640 1 -- start start 2024-09-19T04:16:16.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.049+0000 7fa37623b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa370102d40 0x7fa3701984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:16.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.049+0000 7fa37623b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa370103660 0x7fa370198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:16.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.049+0000 7fa37623b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa37010c170 0x7fa37019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:16.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.049+0000 7fa37623b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa370111f70 con 0x7fa370102d40 2024-09-19T04:16:16.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.049+0000 7fa37623b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa370111df0 con 0x7fa37010c170 2024-09-19T04:16:16.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.049+0000 7fa37623b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa3701120f0 con 0x7fa370103660 2024-09-19T04:16:16.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.049+0000 7fa36f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa370102d40 0x7fa3701984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:16.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.049+0000 7fa36f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa370102d40 0x7fa3701984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36732/0 (socket says 172.21.15.7:36732) 2024-09-19T04:16:16.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.049+0000 7fa36f7fe640 1 -- 172.21.15.7:0/3072185943 learned_addr learned my addr 172.21.15.7:0/3072185943 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:16.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.049+0000 7fa36ffff640 1 --2- 172.21.15.7:0/3072185943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa37010c170 0x7fa37019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:16.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.049+0000 7fa36effd640 1 --2- 172.21.15.7:0/3072185943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa370103660 0x7fa370198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:16.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.049+0000 7fa36f7fe640 1 -- 172.21.15.7:0/3072185943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa370103660 msgr2=0x7fa370198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:16.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.049+0000 7fa36f7fe640 1 --2- 172.21.15.7:0/3072185943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa370103660 0x7fa370198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:16.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.049+0000 7fa36f7fe640 1 -- 172.21.15.7:0/3072185943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa37010c170 msgr2=0x7fa37019cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:16.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.049+0000 7fa36f7fe640 1 --2- 172.21.15.7:0/3072185943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa37010c170 0x7fa37019cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:16.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.049+0000 7fa36f7fe640 1 -- 172.21.15.7:0/3072185943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa37019d480 con 0x7fa370102d40 2024-09-19T04:16:16.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.049+0000 7fa36effd640 1 --2- 172.21.15.7:0/3072185943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa370103660 0x7fa370198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:16:16.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.049+0000 7fa36f7fe640 1 --2- 172.21.15.7:0/3072185943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa370102d40 0x7fa3701984d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa360006010 tx=0x7fa3600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:16.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.050+0000 7fa36cff9640 1 -- 172.21.15.7:0/3072185943 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36003f030 con 0x7fa370102d40 2024-09-19T04:16:16.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.050+0000 7fa37623b640 1 -- 172.21.15.7:0/3072185943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa37019d710 con 0x7fa370102d40 2024-09-19T04:16:16.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.050+0000 7fa36cff9640 1 -- 172.21.15.7:0/3072185943 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa360003ce0 con 0x7fa370102d40 2024-09-19T04:16:16.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.050+0000 7fa36cff9640 1 -- 172.21.15.7:0/3072185943 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa360035070 con 0x7fa370102d40 2024-09-19T04:16:16.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.050+0000 7fa37623b640 1 -- 172.21.15.7:0/3072185943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3701a5050 con 0x7fa370102d40 2024-09-19T04:16:16.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.051+0000 7fa37623b640 1 -- 172.21.15.7:0/3072185943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa370103120 con 0x7fa370102d40 2024-09-19T04:16:16.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.052+0000 7fa36cff9640 1 -- 172.21.15.7:0/3072185943 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fa360042030 con 0x7fa370102d40 2024-09-19T04:16:16.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.052+0000 7fa36cff9640 1 --2- 172.21.15.7:0/3072185943 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa3580a32d0 0x7fa3580a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:16.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.053+0000 7fa36effd640 1 --2- 172.21.15.7:0/3072185943 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa3580a32d0 0x7fa3580a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:16.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.053+0000 7fa36cff9640 1 -- 172.21.15.7:0/3072185943 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7fa3600f0500 con 0x7fa370102d40 2024-09-19T04:16:16.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.053+0000 7fa36effd640 1 --2- 172.21.15.7:0/3072185943 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa3580a32d0 0x7fa3580a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa3640058c0 tx=0x7fa364005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:16.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.057+0000 7fa36cff9640 1 -- 172.21.15.7:0/3072185943 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa3600bcde0 con 0x7fa370102d40 2024-09-19T04:16:16.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.268+0000 7fa37623b640 1 -- 172.21.15.7:0/3072185943 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa370107210 con 0x7fa370102d40 2024-09-19T04:16:16.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.269+0000 7fa36cff9640 1 -- 172.21.15.7:0/3072185943 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11962 (secure 0 0 0) 0x7fa3600bc6e0 con 0x7fa370102d40 2024-09-19T04:16:16.271 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:16:16.271 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"btime":"2024-09-19T04:15:17:816953+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:15:17.816938+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24496,"mds_2":24482,"mds_3":24478,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24506,24496,24482,24478,24472]},"id":1}]} 2024-09-19T04:16:16.271 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 27 2024-09-19T04:16:16.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.271+0000 7fa37623b640 1 -- 172.21.15.7:0/3072185943 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa3580a32d0 msgr2=0x7fa3580a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:16.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.271+0000 7fa37623b640 1 --2- 172.21.15.7:0/3072185943 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa3580a32d0 0x7fa3580a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa3640058c0 tx=0x7fa364005850 comp rx=0 tx=0).stop 2024-09-19T04:16:16.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.271+0000 7fa37623b640 1 -- 172.21.15.7:0/3072185943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa370102d40 msgr2=0x7fa3701984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:16.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.271+0000 7fa37623b640 1 --2- 172.21.15.7:0/3072185943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa370102d40 0x7fa3701984d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa360006010 tx=0x7fa3600042f0 comp rx=0 tx=0).stop 2024-09-19T04:16:16.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.271+0000 7fa37623b640 1 -- 172.21.15.7:0/3072185943 shutdown_connections 2024-09-19T04:16:16.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.272+0000 7fa37623b640 1 --2- 172.21.15.7:0/3072185943 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa3580a32d0 0x7fa3580a5790 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:16.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.272+0000 7fa37623b640 1 --2- 172.21.15.7:0/3072185943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa37010c170 0x7fa37019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:16.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.272+0000 7fa37623b640 1 --2- 172.21.15.7:0/3072185943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa370103660 0x7fa370198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:16.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.272+0000 7fa37623b640 1 --2- 172.21.15.7:0/3072185943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa370102d40 0x7fa3701984d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:16.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.272+0000 7fa37623b640 1 -- 172.21.15.7:0/3072185943 >> 172.21.15.7:0/3072185943 conn(0x7fa3700fc7a0 msgr2=0x7fa3700fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:16.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.272+0000 7fa37623b640 1 -- 172.21.15.7:0/3072185943 shutdown_connections 2024-09-19T04:16:16.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:16.272+0000 7fa37623b640 1 -- 172.21.15.7:0/3072185943 wait complete. 2024-09-19T04:16:16.986 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:16:17.247 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:17.369 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:17 smithi007 ceph-mon[31360]: pgmap v333: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T04:16:17.369 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:17 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3072185943' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:16:17.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:17 smithi102 ceph-mon[35446]: pgmap v333: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T04:16:17.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:17 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3072185943' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:16:17.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:17 smithi092 ceph-mon[34940]: pgmap v333: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T04:16:17.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:17 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3072185943' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:16:17.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.663+0000 7f9fc478e640 1 -- 172.21.15.7:0/2019494286 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fbc106a80 msgr2=0x7f9fbc106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:17.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.663+0000 7f9fc478e640 1 --2- 172.21.15.7:0/2019494286 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fbc106a80 0x7f9fbc106e60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8009930 tx=0x7f9fb802a420 comp rx=0 tx=0).stop 2024-09-19T04:16:17.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.663+0000 7f9fc478e640 1 -- 172.21.15.7:0/2019494286 shutdown_connections 2024-09-19T04:16:17.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.663+0000 7f9fc478e640 1 --2- 172.21.15.7:0/2019494286 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fbc101420 0x7f9fbc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:17.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.663+0000 7f9fc478e640 1 --2- 172.21.15.7:0/2019494286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fbc100a80 0x7f9fbc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:17.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.663+0000 7f9fc478e640 1 --2- 172.21.15.7:0/2019494286 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fbc106a80 0x7f9fbc106e60 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:17.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.663+0000 7f9fc478e640 1 -- 172.21.15.7:0/2019494286 >> 172.21.15.7:0/2019494286 conn(0x7f9fbc0fc7a0 msgr2=0x7f9fbc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:17.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.664+0000 7f9fc478e640 1 -- 172.21.15.7:0/2019494286 shutdown_connections 2024-09-19T04:16:17.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.664+0000 7f9fc478e640 1 -- 172.21.15.7:0/2019494286 wait complete. 2024-09-19T04:16:17.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.664+0000 7f9fc478e640 1 Processor -- start 2024-09-19T04:16:17.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.664+0000 7f9fc478e640 1 -- start start 2024-09-19T04:16:17.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.664+0000 7f9fc478e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fbc100a80 0x7f9fbc19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:17.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.664+0000 7f9fc478e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fbc101420 0x7f9fbc19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:17.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.664+0000 7f9fc478e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fbc106a80 0x7f9fbc19ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:17.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.664+0000 7f9fc478e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9fbc110e80 con 0x7f9fbc106a80 2024-09-19T04:16:17.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.664+0000 7f9fc478e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9fbc110d00 con 0x7f9fbc100a80 2024-09-19T04:16:17.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.664+0000 7f9fc478e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9fbc111000 con 0x7f9fbc101420 2024-09-19T04:16:17.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.664+0000 7f9fc2d2b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fbc106a80 0x7f9fbc19ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:17.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.665+0000 7f9fc2d2b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fbc106a80 0x7f9fbc19ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34576/0 (socket says 172.21.15.7:34576) 2024-09-19T04:16:17.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.665+0000 7f9fc2d2b640 1 -- 172.21.15.7:0/140840729 learned_addr learned my addr 172.21.15.7:0/140840729 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:17.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.665+0000 7f9fc252a640 1 --2- 172.21.15.7:0/140840729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fbc100a80 0x7f9fbc19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:17.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.665+0000 7f9fc2d2b640 1 -- 172.21.15.7:0/140840729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fbc101420 msgr2=0x7f9fbc19aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:17.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.665+0000 7f9fc2d2b640 1 --2- 172.21.15.7:0/140840729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fbc101420 0x7f9fbc19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:17.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.665+0000 7f9fc2d2b640 1 -- 172.21.15.7:0/140840729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fbc100a80 msgr2=0x7f9fbc19a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:17.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.665+0000 7f9fc2d2b640 1 --2- 172.21.15.7:0/140840729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fbc100a80 0x7f9fbc19a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:17.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.665+0000 7f9fc2d2b640 1 -- 172.21.15.7:0/140840729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fbc19f610 con 0x7f9fbc106a80 2024-09-19T04:16:17.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.665+0000 7f9fc2d2b640 1 --2- 172.21.15.7:0/140840729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fbc106a80 0x7f9fbc19ef30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9fb400eaa0 tx=0x7f9fb400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:17.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.665+0000 7f9fb37fe640 1 -- 172.21.15.7:0/140840729 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb400cdb0 con 0x7f9fbc106a80 2024-09-19T04:16:17.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.665+0000 7f9fb37fe640 1 -- 172.21.15.7:0/140840729 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fb4005020 con 0x7f9fbc106a80 2024-09-19T04:16:17.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.665+0000 7f9fc478e640 1 -- 172.21.15.7:0/140840729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fbc19f900 con 0x7f9fbc106a80 2024-09-19T04:16:17.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.665+0000 7f9fb37fe640 1 -- 172.21.15.7:0/140840729 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb40116b0 con 0x7f9fbc106a80 2024-09-19T04:16:17.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.665+0000 7f9fc478e640 1 -- 172.21.15.7:0/140840729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fbc1a71e0 con 0x7f9fbc106a80 2024-09-19T04:16:17.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.666+0000 7f9fc478e640 1 -- 172.21.15.7:0/140840729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fbc100ee0 con 0x7f9fbc106a80 2024-09-19T04:16:17.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.667+0000 7f9fb37fe640 1 -- 172.21.15.7:0/140840729 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f9fb4005560 con 0x7f9fbc106a80 2024-09-19T04:16:17.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.668+0000 7f9fb37fe640 1 --2- 172.21.15.7:0/140840729 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9fa80a3350 0x7f9fa80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:17.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.668+0000 7f9fc252a640 1 --2- 172.21.15.7:0/140840729 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9fa80a3350 0x7f9fa80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:17.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.668+0000 7f9fb37fe640 1 -- 172.21.15.7:0/140840729 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f9fb40cff20 con 0x7f9fbc106a80 2024-09-19T04:16:17.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.669+0000 7f9fc252a640 1 --2- 172.21.15.7:0/140840729 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9fa80a3350 0x7f9fa80a5810 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8009900 tx=0x7f9fb80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:17.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.672+0000 7f9fb37fe640 1 -- 172.21.15.7:0/140840729 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9fb4016030 con 0x7f9fbc106a80 2024-09-19T04:16:17.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.853+0000 7f9fc478e640 1 -- 172.21.15.7:0/140840729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9fbc1a74e0 con 0x7f9fbc106a80 2024-09-19T04:16:17.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.854+0000 7f9fb37fe640 1 -- 172.21.15.7:0/140840729 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24568 (secure 0 0 0) 0x7f9fb409c7a0 con 0x7f9fbc106a80 2024-09-19T04:16:17.856 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:16:17.856 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":88,"fsid":"77957c0a-763c-11ef-bceb-c7b262605968","created":"2024-09-19T04:06:58.337394+0000","modified":"2024-09-19T04:15:46.990958+0000","last_up_change":"2024-09-19T04:13:42.312137+0000","last_in_change":"2024-09-19T04:13:18.757925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:09:59.544984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:14:30.225637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:14:32.252497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T04:14:38.781821+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d9b93bd5-ee22-4fb0-ba29-bfa208430a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6803","nonce":240599233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6805","nonce":240599233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6809","nonce":240599233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6807","nonce":240599233}]},"public_addr":"172.21.15.7:6803/240599233","cluster_addr":"172.21.15.7:6805/240599233","heartbeat_back_addr":"172.21.15.7:6809/240599233","heartbeat_front_addr":"172.21.15.7:6807/240599233","state":["exists","up"]},{"osd":1,"uuid":"db5793e6-f3ad-4075-a02b-206bf7f1e59a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6801","nonce":902403333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6803","nonce":902403333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6807","nonce":902403333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6805","nonce":902403333}]},"public_addr":"172.21.15.92:6801/902403333","cluster_addr":"172.21.15.92:6803/902403333","heartbeat_back_addr":"172.21.15.92:6807/902403333","heartbeat_front_addr":"172.21.15.92:6805/902403333","state":["exists","up"]},{"osd":2,"uuid":"1eb83a1b-82d8-4983-bae3-b161adb3a33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6801","nonce":2078441772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6803","nonce":2078441772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6807","nonce":2078441772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6805","nonce":2078441772}]},"public_addr":"172.21.15.102:6801/2078441772","cluster_addr":"172.21.15.102:6803/2078441772","heartbeat_back_addr":"172.21.15.102:6807/2078441772","heartbeat_front_addr":"172.21.15.102:6805/2078441772","state":["exists","up"]},{"osd":3,"uuid":"68ba79e5-bcf0-4349-9e14-42f2fa9c11b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6811","nonce":2729561132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6813","nonce":2729561132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6817","nonce":2729561132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6815","nonce":2729561132}]},"public_addr":"172.21.15.7:6811/2729561132","cluster_addr":"172.21.15.7:6813/2729561132","heartbeat_back_addr":"172.21.15.7:6817/2729561132","heartbeat_front_addr":"172.21.15.7:6815/2729561132","state":["exists","up"]},{"osd":4,"uuid":"f20d4a51-121f-4ac8-afeb-5962d83bd697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6809","nonce":2799734294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6811","nonce":2799734294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6815","nonce":2799734294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6813","nonce":2799734294}]},"public_addr":"172.21.15.92:6809/2799734294","cluster_addr":"172.21.15.92:6811/2799734294","heartbeat_back_addr":"172.21.15.92:6815/2799734294","heartbeat_front_addr":"172.21.15.92:6813/2799734294","state":["exists","up"]},{"osd":5,"uuid":"aac02b0a-99dc-4457-8898-c68dc196517a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6809","nonce":3099678146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6811","nonce":3099678146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6815","nonce":3099678146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6813","nonce":3099678146}]},"public_addr":"172.21.15.102:6809/3099678146","cluster_addr":"172.21.15.102:6811/3099678146","heartbeat_back_addr":"172.21.15.102:6815/3099678146","heartbeat_front_addr":"172.21.15.102:6813/3099678146","state":["exists","up"]},{"osd":6,"uuid":"7e5a8b30-8406-486c-ace5-79158a3757a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6819","nonce":1569704304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6821","nonce":1569704304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6825","nonce":1569704304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6823","nonce":1569704304}]},"public_addr":"172.21.15.7:6819/1569704304","cluster_addr":"172.21.15.7:6821/1569704304","heartbeat_back_addr":"172.21.15.7:6825/1569704304","heartbeat_front_addr":"172.21.15.7:6823/1569704304","state":["exists","up"]},{"osd":7,"uuid":"e6a7049a-17a1-43b2-8ecd-5f4ca7c337be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6817","nonce":3411102480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6819","nonce":3411102480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6823","nonce":3411102480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6821","nonce":3411102480}]},"public_addr":"172.21.15.92:6817/3411102480","cluster_addr":"172.21.15.92:6819/3411102480","heartbeat_back_addr":"172.21.15.92:6823/3411102480","heartbeat_front_addr":"172.21.15.92:6821/3411102480","state":["exists","up"]},{"osd":8,"uuid":"31879baa-861d-4322-990f-0b9a42b8b610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6817","nonce":2990859925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6819","nonce":2990859925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6823","nonce":2990859925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6821","nonce":2990859925}]},"public_addr":"172.21.15.102:6817/2990859925","cluster_addr":"172.21.15.102:6819/2990859925","heartbeat_back_addr":"172.21.15.102:6823/2990859925","heartbeat_front_addr":"172.21.15.102:6821/2990859925","state":["exists","up"]},{"osd":9,"uuid":"6d65db33-926c-4a6e-a072-707e9c9de92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6827","nonce":1710319475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6829","nonce":1710319475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6833","nonce":1710319475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6831","nonce":1710319475}]},"public_addr":"172.21.15.7:6827/1710319475","cluster_addr":"172.21.15.7:6829/1710319475","heartbeat_back_addr":"172.21.15.7:6833/1710319475","heartbeat_front_addr":"172.21.15.7:6831/1710319475","state":["exists","up"]},{"osd":10,"uuid":"9ab681ee-0bef-47bd-bf3d-20b17c6b870c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6825","nonce":1063265541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6827","nonce":1063265541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6831","nonce":1063265541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6829","nonce":1063265541}]},"public_addr":"172.21.15.92:6825/1063265541","cluster_addr":"172.21.15.92:6827/1063265541","heartbeat_back_addr":"172.21.15.92:6831/1063265541","heartbeat_front_addr":"172.21.15.92:6829/1063265541","state":["exists","up"]},{"osd":11,"uuid":"dc398e14-5f9e-4f0a-b158-35cbc1f73a83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6825","nonce":1175425599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6827","nonce":1175425599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6831","nonce":1175425599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6829","nonce":1175425599}]},"public_addr":"172.21.15.102:6825/1175425599","cluster_addr":"172.21.15.102:6827/1175425599","heartbeat_back_addr":"172.21.15.102:6831/1175425599","heartbeat_front_addr":"172.21.15.102:6829/1175425599","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:07.857319+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:31.430120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:56.892301+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:10:22.011884+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:10:46.326025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:11:10.339084+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:11:35.365906+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:01.104309+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:25.717295+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:51.387644+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:13:15.076355+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:13:40.253150+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":9},{"from":5,"to":8}]},{"pgid":"3.c","mappings":[{"from":5,"to":6}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/2883028938":"2024-09-20T04:07:45.039922+0000","172.21.15.7:0/1186412739":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6800/751091002":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6801/751091002":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6801/940106179":"2024-09-20T04:07:20.364033+0000","172.21.15.7:6800/940106179":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/1450115700":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/2954294373":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/1996930242":"2024-09-20T04:07:45.039922+0000","172.21.15.7:0/3562231347":"2024-09-20T04:07:20.364033+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:16:17.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.856+0000 7f9fc478e640 1 -- 172.21.15.7:0/140840729 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9fa80a3350 msgr2=0x7f9fa80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:17.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.856+0000 7f9fc478e640 1 --2- 172.21.15.7:0/140840729 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9fa80a3350 0x7f9fa80a5810 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8009900 tx=0x7f9fb80058d0 comp rx=0 tx=0).stop 2024-09-19T04:16:17.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.856+0000 7f9fc478e640 1 -- 172.21.15.7:0/140840729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fbc106a80 msgr2=0x7f9fbc19ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:17.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.856+0000 7f9fc478e640 1 --2- 172.21.15.7:0/140840729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fbc106a80 0x7f9fbc19ef30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9fb400eaa0 tx=0x7f9fb400ef60 comp rx=0 tx=0).stop 2024-09-19T04:16:17.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.856+0000 7f9fc478e640 1 -- 172.21.15.7:0/140840729 shutdown_connections 2024-09-19T04:16:17.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.856+0000 7f9fc478e640 1 --2- 172.21.15.7:0/140840729 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9fa80a3350 0x7f9fa80a5810 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:17.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.856+0000 7f9fc478e640 1 --2- 172.21.15.7:0/140840729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fbc106a80 0x7f9fbc19ef30 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:17.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.856+0000 7f9fc478e640 1 --2- 172.21.15.7:0/140840729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fbc101420 0x7f9fbc19aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:17.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.856+0000 7f9fc478e640 1 --2- 172.21.15.7:0/140840729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9fbc100a80 0x7f9fbc19a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:17.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.856+0000 7f9fc478e640 1 -- 172.21.15.7:0/140840729 >> 172.21.15.7:0/140840729 conn(0x7f9fbc0fc7a0 msgr2=0x7f9fbc06a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:17.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.856+0000 7f9fc478e640 1 -- 172.21.15.7:0/140840729 shutdown_connections 2024-09-19T04:16:17.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:17.856+0000 7f9fc478e640 1 -- 172.21.15.7:0/140840729 wait complete. 2024-09-19T04:16:18.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:18 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/140840729' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:16:18.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:18 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/140840729' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:16:18.545 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:16:18.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:18 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/140840729' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:16:18.805 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:19.242 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:19 smithi007 ceph-mon[31360]: pgmap v334: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T04:16:19.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.240+0000 7f8a08465640 1 -- 172.21.15.7:0/1592053023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a0010e480 msgr2=0x7f8a00110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:19.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.240+0000 7f8a08465640 1 --2- 172.21.15.7:0/1592053023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a0010e480 0x7f8a00110870 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f89f8009ca0 tx=0x7f89f802a8c0 comp rx=0 tx=0).stop 2024-09-19T04:16:19.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.240+0000 7f8a08465640 1 -- 172.21.15.7:0/1592053023 shutdown_connections 2024-09-19T04:16:19.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.240+0000 7f8a08465640 1 --2- 172.21.15.7:0/1592053023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a0010e480 0x7f8a00110870 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:19.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.240+0000 7f8a08465640 1 --2- 172.21.15.7:0/1592053023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a00101280 0x7f8a0010df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:19.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.240+0000 7f8a08465640 1 --2- 172.21.15.7:0/1592053023 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a001008d0 0x7f8a00100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:19.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.240+0000 7f8a08465640 1 -- 172.21.15.7:0/1592053023 >> 172.21.15.7:0/1592053023 conn(0x7f8a000fc7a0 msgr2=0x7f8a000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:19.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.240+0000 7f8a08465640 1 -- 172.21.15.7:0/1592053023 shutdown_connections 2024-09-19T04:16:19.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.240+0000 7f8a08465640 1 -- 172.21.15.7:0/1592053023 wait complete. 2024-09-19T04:16:19.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.241+0000 7f8a08465640 1 Processor -- start 2024-09-19T04:16:19.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.241+0000 7f8a08465640 1 -- start start 2024-09-19T04:16:19.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.242+0000 7f8a08465640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a001008d0 0x7f8a0019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:19.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.242+0000 7f8a08465640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a00101280 0x7f8a0019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:19.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.242+0000 7f8a08465640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a0010e480 0x7f8a0019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:19.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.242+0000 7f8a08465640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8a00114170 con 0x7f8a0010e480 2024-09-19T04:16:19.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.242+0000 7f8a08465640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8a00113ff0 con 0x7f8a00101280 2024-09-19T04:16:19.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.242+0000 7f8a08465640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8a001142f0 con 0x7f8a001008d0 2024-09-19T04:16:19.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.242+0000 7f8a06a02640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a0010e480 0x7f8a0019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:19.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.242+0000 7f8a06a02640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a0010e480 0x7f8a0019ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34588/0 (socket says 172.21.15.7:34588) 2024-09-19T04:16:19.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.242+0000 7f8a06a02640 1 -- 172.21.15.7:0/2279364516 learned_addr learned my addr 172.21.15.7:0/2279364516 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:19.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.242+0000 7f8a06201640 1 --2- 172.21.15.7:0/2279364516 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a001008d0 0x7f8a0019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:19.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.242+0000 7f8a05a00640 1 --2- 172.21.15.7:0/2279364516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a00101280 0x7f8a0019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:19.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.243+0000 7f8a06a02640 1 -- 172.21.15.7:0/2279364516 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a001008d0 msgr2=0x7f8a0019a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:19.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.243+0000 7f8a06a02640 1 --2- 172.21.15.7:0/2279364516 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a001008d0 0x7f8a0019a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:19.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.243+0000 7f8a06a02640 1 -- 172.21.15.7:0/2279364516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a00101280 msgr2=0x7f8a0019abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:19.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.243+0000 7f8a06a02640 1 --2- 172.21.15.7:0/2279364516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a00101280 0x7f8a0019abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:19.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.243+0000 7f8a06a02640 1 -- 172.21.15.7:0/2279364516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a0019f620 con 0x7f8a0010e480 2024-09-19T04:16:19.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.243+0000 7f8a06a02640 1 --2- 172.21.15.7:0/2279364516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a0010e480 0x7f8a0019ef40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f89f802ade0 tx=0x7f89f80319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.243+0000 7f89f77fe640 1 -- 172.21.15.7:0/2279364516 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f8003b70 con 0x7f8a0010e480 2024-09-19T04:16:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.243+0000 7f89f77fe640 1 -- 172.21.15.7:0/2279364516 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89f8003d10 con 0x7f8a0010e480 2024-09-19T04:16:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.243+0000 7f8a08465640 1 -- 172.21.15.7:0/2279364516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a0019f8b0 con 0x7f8a0010e480 2024-09-19T04:16:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.243+0000 7f89f77fe640 1 -- 172.21.15.7:0/2279364516 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f802fc40 con 0x7f8a0010e480 2024-09-19T04:16:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.243+0000 7f8a08465640 1 -- 172.21.15.7:0/2279364516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a001a71f0 con 0x7f8a0010e480 2024-09-19T04:16:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.244+0000 7f8a08465640 1 -- 172.21.15.7:0/2279364516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a00100cb0 con 0x7f8a0010e480 2024-09-19T04:16:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.246+0000 7f89f77fe640 1 -- 172.21.15.7:0/2279364516 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f89f8004050 con 0x7f8a0010e480 2024-09-19T04:16:19.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.246+0000 7f89f77fe640 1 --2- 172.21.15.7:0/2279364516 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f89ec0a32d0 0x7f89ec0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.246+0000 7f89f77fe640 1 -- 172.21.15.7:0/2279364516 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f89f80f1120 con 0x7f8a0010e480 2024-09-19T04:16:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.246+0000 7f8a06201640 1 --2- 172.21.15.7:0/2279364516 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f89ec0a32d0 0x7f89ec0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:19.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.247+0000 7f8a06201640 1 --2- 172.21.15.7:0/2279364516 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f89ec0a32d0 0x7f89ec0a5790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f89fc009bd0 tx=0x7f89fc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:19.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.250+0000 7f89f77fe640 1 -- 172.21.15.7:0/2279364516 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f89f8080210 con 0x7f8a0010e480 2024-09-19T04:16:19.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:19 smithi102 ceph-mon[35446]: pgmap v334: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T04:16:19.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.463+0000 7f8a08465640 1 -- 172.21.15.7:0/2279364516 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a00109670 con 0x7f8a0010e480 2024-09-19T04:16:19.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.464+0000 7f89f77fe640 1 -- 172.21.15.7:0/2279364516 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11962 (secure 0 0 0) 0x7f89f80bdab0 con 0x7f8a0010e480 2024-09-19T04:16:19.465 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:16:19.466 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"btime":"2024-09-19T04:15:17:816953+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:15:17.816938+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24496,"mds_2":24482,"mds_3":24478,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24506,24496,24482,24478,24472]},"id":1}]} 2024-09-19T04:16:19.466 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 27 2024-09-19T04:16:19.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.466+0000 7f8a08465640 1 -- 172.21.15.7:0/2279364516 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f89ec0a32d0 msgr2=0x7f89ec0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:19.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.466+0000 7f8a08465640 1 --2- 172.21.15.7:0/2279364516 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f89ec0a32d0 0x7f89ec0a5790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f89fc009bd0 tx=0x7f89fc005f90 comp rx=0 tx=0).stop 2024-09-19T04:16:19.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.466+0000 7f8a08465640 1 -- 172.21.15.7:0/2279364516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a0010e480 msgr2=0x7f8a0019ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:19.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.466+0000 7f8a08465640 1 --2- 172.21.15.7:0/2279364516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a0010e480 0x7f8a0019ef40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f89f802ade0 tx=0x7f89f80319f0 comp rx=0 tx=0).stop 2024-09-19T04:16:19.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.466+0000 7f8a08465640 1 -- 172.21.15.7:0/2279364516 shutdown_connections 2024-09-19T04:16:19.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.466+0000 7f8a08465640 1 --2- 172.21.15.7:0/2279364516 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f89ec0a32d0 0x7f89ec0a5790 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:19.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.466+0000 7f8a08465640 1 --2- 172.21.15.7:0/2279364516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a0010e480 0x7f8a0019ef40 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:19.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.466+0000 7f8a08465640 1 --2- 172.21.15.7:0/2279364516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a00101280 0x7f8a0019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:19.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.466+0000 7f8a08465640 1 --2- 172.21.15.7:0/2279364516 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a001008d0 0x7f8a0019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:19.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.466+0000 7f8a08465640 1 -- 172.21.15.7:0/2279364516 >> 172.21.15.7:0/2279364516 conn(0x7f8a000fc7a0 msgr2=0x7f8a000feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:19.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.466+0000 7f8a08465640 1 -- 172.21.15.7:0/2279364516 shutdown_connections 2024-09-19T04:16:19.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:19.466+0000 7f8a08465640 1 -- 172.21.15.7:0/2279364516 wait complete. 2024-09-19T04:16:19.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:19 smithi092 ceph-mon[34940]: pgmap v334: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T04:16:20.212 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:20 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2279364516' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:16:20.214 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T04:14:34.007803+0000', 'modified': '2024-09-19T04:15:17.816938+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24506, 'mds_1': 24496, 'mds_2': 24482, 'mds_3': 24478, 'mds_4': 24472}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14583': {'gid': 14583, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.7:6839/2492396165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6838', 'nonce': 2492396165}, {'type': 'v1', 'addr': '172.21.15.7:6839', 'nonce': 2492396165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14595': {'gid': 14595, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.7:6841/4142126419', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6840', 'nonce': 4142126419}, {'type': 'v1', 'addr': '172.21.15.7:6841', 'nonce': 4142126419}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24424': {'gid': 24424, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.102:6833/3063042931', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6832', 'nonce': 3063042931}, {'type': 'v1', 'addr': '172.21.15.102:6833', 'nonce': 3063042931}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24431': {'gid': 24431, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.92:6833/4006669352', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6832', 'nonce': 4006669352}, {'type': 'v1', 'addr': '172.21.15.92:6833', 'nonce': 4006669352}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.92:6835/4235013488', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6834', 'nonce': 4235013488}, {'type': 'v1', 'addr': '172.21.15.92:6835', 'nonce': 4235013488}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.102:6835/1756454579', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6834', 'nonce': 1756454579}, {'type': 'v1', 'addr': '172.21.15.102:6835', 'nonce': 1756454579}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24478': {'gid': 24478, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.102:6837/618291553', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6836', 'nonce': 618291553}, {'type': 'v1', 'addr': '172.21.15.102:6837', 'nonce': 618291553}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24482': {'gid': 24482, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.92:6837/319779585', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6836', 'nonce': 319779585}, {'type': 'v1', 'addr': '172.21.15.92:6837', 'nonce': 319779585}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24496': {'gid': 24496, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.102:6839/2728093829', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6838', 'nonce': 2728093829}, {'type': 'v1', 'addr': '172.21.15.102:6839', 'nonce': 2728093829}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24506': {'gid': 24506, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.92:6839/3805481296', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6838', 'nonce': 3805481296}, {'type': 'v1', 'addr': '172.21.15.92:6839', 'nonce': 3805481296}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24506, 'qdb_cluster': [24506, 24496, 24482, 24478, 24472]} 2024-09-19T04:16:20.214 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-19T04:16:20.214 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph tell mds.f status 2024-09-19T04:16:20.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:20 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2279364516' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:16:20.474 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:20.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:20 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2279364516' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:16:20.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.919+0000 7f02fa2cc640 1 -- 172.21.15.7:0/1371499429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f4103660 msgr2=0x7f02f410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:20.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.919+0000 7f02fa2cc640 1 --2- 172.21.15.7:0/1371499429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f4103660 0x7f02f410bb50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009900 tx=0x7f02dc02a480 comp rx=0 tx=0).stop 2024-09-19T04:16:20.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.919+0000 7f02fa2cc640 1 -- 172.21.15.7:0/1371499429 shutdown_connections 2024-09-19T04:16:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.919+0000 7f02fa2cc640 1 --2- 172.21.15.7:0/1371499429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02f410c170 0x7f02f410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.919+0000 7f02fa2cc640 1 --2- 172.21.15.7:0/1371499429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f4103660 0x7f02f410bb50 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.919+0000 7f02fa2cc640 1 --2- 172.21.15.7:0/1371499429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02f4102d40 0x7f02f4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.919+0000 7f02fa2cc640 1 -- 172.21.15.7:0/1371499429 >> 172.21.15.7:0/1371499429 conn(0x7f02f40fc7a0 msgr2=0x7f02f40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.919+0000 7f02fa2cc640 1 -- 172.21.15.7:0/1371499429 shutdown_connections 2024-09-19T04:16:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.919+0000 7f02fa2cc640 1 -- 172.21.15.7:0/1371499429 wait complete. 2024-09-19T04:16:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.919+0000 7f02fa2cc640 1 Processor -- start 2024-09-19T04:16:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.919+0000 7f02fa2cc640 1 -- start start 2024-09-19T04:16:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.920+0000 7f02fa2cc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02f4102d40 0x7f02f4198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.920+0000 7f02fa2cc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02f4103660 0x7f02f4198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.920+0000 7f02fa2cc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f410c170 0x7f02f419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:20.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.920+0000 7f02fa2cc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f02f4111f70 con 0x7f02f410c170 2024-09-19T04:16:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.920+0000 7f02fa2cc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f02f4111df0 con 0x7f02f4102d40 2024-09-19T04:16:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.920+0000 7f02fa2cc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f02f41120f0 con 0x7f02f4103660 2024-09-19T04:16:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.920+0000 7f02f8869640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f410c170 0x7f02f419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.920+0000 7f02f8869640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f410c170 0x7f02f419cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34614/0 (socket says 172.21.15.7:34614) 2024-09-19T04:16:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.920+0000 7f02f8869640 1 -- 172.21.15.7:0/3496512603 learned_addr learned my addr 172.21.15.7:0/3496512603 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.920+0000 7f02f3fff640 1 --2- 172.21.15.7:0/3496512603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02f4102d40 0x7f02f4198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.920+0000 7f02ebfff640 1 --2- 172.21.15.7:0/3496512603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02f4103660 0x7f02f4198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.920+0000 7f02f8869640 1 -- 172.21.15.7:0/3496512603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02f4103660 msgr2=0x7f02f4198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.920+0000 7f02f8869640 1 --2- 172.21.15.7:0/3496512603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02f4103660 0x7f02f4198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.920+0000 7f02f8869640 1 -- 172.21.15.7:0/3496512603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02f4102d40 msgr2=0x7f02f4198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.920+0000 7f02f8869640 1 --2- 172.21.15.7:0/3496512603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02f4102d40 0x7f02f4198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.920+0000 7f02f8869640 1 -- 172.21.15.7:0/3496512603 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f419d400 con 0x7f02f410c170 2024-09-19T04:16:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.920+0000 7f02f8869640 1 --2- 172.21.15.7:0/3496512603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f410c170 0x7f02f419cd20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f02ec00eaa0 tx=0x7f02ec00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.920+0000 7f02f1ffb640 1 -- 172.21.15.7:0/3496512603 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec00cdb0 con 0x7f02f410c170 2024-09-19T04:16:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.921+0000 7f02fa2cc640 1 -- 172.21.15.7:0/3496512603 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02f419d6f0 con 0x7f02f410c170 2024-09-19T04:16:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.921+0000 7f02f1ffb640 1 -- 172.21.15.7:0/3496512603 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02ec005020 con 0x7f02f410c170 2024-09-19T04:16:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.921+0000 7f02f1ffb640 1 -- 172.21.15.7:0/3496512603 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec0116b0 con 0x7f02f410c170 2024-09-19T04:16:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.921+0000 7f02fa2cc640 1 -- 172.21.15.7:0/3496512603 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02f41a4fd0 con 0x7f02f410c170 2024-09-19T04:16:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.923+0000 7f02f1ffb640 1 -- 172.21.15.7:0/3496512603 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f02ec005560 con 0x7f02f410c170 2024-09-19T04:16:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.923+0000 7f02fc6a5740 1 Processor -- start 2024-09-19T04:16:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.924+0000 7f02fc6a5740 1 -- start start 2024-09-19T04:16:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.924+0000 7f02fc6a5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f9512d9d0 0x562f9512ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:20.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.924+0000 7f02fc6a5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f9512e2f0 0x562f95138670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.924+0000 7f02fc6a5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f95138bb0 0x562f9513afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.924+0000 7f02fc6a5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562f95094090 con 0x562f9512e2f0 2024-09-19T04:16:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.924+0000 7f02fc6a5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562f9503ba70 con 0x562f9512d9d0 2024-09-19T04:16:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.924+0000 7f02fc6a5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562f95090050 con 0x562f95138bb0 2024-09-19T04:16:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.924+0000 7f02f3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f9512e2f0 0x562f95138670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.924+0000 7f02f3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f9512e2f0 0x562f95138670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34620/0 (socket says 172.21.15.7:34620) 2024-09-19T04:16:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.924+0000 7f02f3fff640 1 -- 172.21.15.7:0/3570361987 learned_addr learned my addr 172.21.15.7:0/3570361987 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.924+0000 7f02f1ffb640 1 --2- 172.21.15.7:0/3496512603 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f02e00a32d0 0x7f02e00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.924+0000 7f02ebfff640 1 --2- 172.21.15.7:0/3570361987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f9512d9d0 0x562f9512ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.924+0000 7f02ebfff640 1 --2- 172.21.15.7:0/3570361987 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f95138bb0 0x562f9513afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.924+0000 7f02f8869640 1 --2- 172.21.15.7:0/3496512603 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f02e00a32d0 0x7f02e00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.924+0000 7f02f3fff640 1 -- 172.21.15.7:0/3570361987 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f95138bb0 msgr2=0x562f9513afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:20.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.924+0000 7f02f3fff640 1 --2- 172.21.15.7:0/3570361987 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f95138bb0 0x562f9513afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.924+0000 7f02f3fff640 1 -- 172.21.15.7:0/3570361987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f9512d9d0 msgr2=0x562f9512ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:20.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.924+0000 7f02f3fff640 1 --2- 172.21.15.7:0/3570361987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f9512d9d0 0x562f9512ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.924+0000 7f02f1ffb640 1 -- 172.21.15.7:0/3496512603 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f02ec0cffe0 con 0x7f02f410c170 2024-09-19T04:16:20.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.924+0000 7f02f3fff640 1 -- 172.21.15.7:0/3570361987 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f95048130 con 0x562f9512e2f0 2024-09-19T04:16:20.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.925+0000 7f02f3fff640 1 --2- 172.21.15.7:0/3570361987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f9512e2f0 0x562f95138670 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f02e400ac20 tx=0x7f02e400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9900b6de17cadea8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:20.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.925+0000 7f02f8869640 1 --2- 172.21.15.7:0/3496512603 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f02e00a32d0 0x7f02e00a5790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f02ec09be60 tx=0x7f02ec067040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:20.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.925+0000 7f02ea7fc640 1 -- 172.21.15.7:0/3570361987 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e401d070 con 0x562f9512e2f0 2024-09-19T04:16:20.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.925+0000 7f02ea7fc640 1 -- 172.21.15.7:0/3570361987 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02e4018b20 con 0x562f9512e2f0 2024-09-19T04:16:20.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.925+0000 7f02ea7fc640 1 -- 172.21.15.7:0/3570361987 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e4010b50 con 0x562f9512e2f0 2024-09-19T04:16:20.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.926+0000 7f02fc6a5740 1 -- 172.21.15.7:0/3570361987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f9512e2f0 msgr2=0x562f95138670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:20.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.926+0000 7f02fc6a5740 1 --2- 172.21.15.7:0/3570361987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f9512e2f0 0x562f95138670 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f02e400ac20 tx=0x7f02e400f790 comp rx=0 tx=0).stop 2024-09-19T04:16:20.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.926+0000 7f02fc6a5740 1 -- 172.21.15.7:0/3570361987 shutdown_connections 2024-09-19T04:16:20.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.926+0000 7f02fc6a5740 1 --2- 172.21.15.7:0/3570361987 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f95138bb0 0x562f9513afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.926+0000 7f02fc6a5740 1 --2- 172.21.15.7:0/3570361987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f9512e2f0 0x562f95138670 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.926+0000 7f02fc6a5740 1 --2- 172.21.15.7:0/3570361987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f9512d9d0 0x562f9512ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.926+0000 7f02fc6a5740 1 -- 172.21.15.7:0/3570361987 >> 172.21.15.7:0/3570361987 conn(0x562f95129f60 msgr2=0x562f9512a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:20.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.926+0000 7f02fc6a5740 1 -- 172.21.15.7:0/3570361987 shutdown_connections 2024-09-19T04:16:20.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.926+0000 7f02fc6a5740 1 -- 172.21.15.7:0/3570361987 wait complete. 2024-09-19T04:16:20.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.926+0000 7f02fc6a5740 1 -- start start 2024-09-19T04:16:20.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.926+0000 7f02fc6a5740 1 Processor -- start 2024-09-19T04:16:20.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.927+0000 7f02fc6a5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f9512d9d0 0x562f95138490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:20.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.927+0000 7f02fc6a5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f9512e2f0 0x562f951357e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:20.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.927+0000 7f02fc6a5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f95138bb0 0x562f95135d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:20.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.927+0000 7f02fc6a5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562f9513b780 con 0x562f9512d9d0 2024-09-19T04:16:20.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.927+0000 7f02fc6a5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562f9504ef20 con 0x562f95138bb0 2024-09-19T04:16:20.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.927+0000 7f02fc6a5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562f9513b900 con 0x562f9512e2f0 2024-09-19T04:16:20.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.927+0000 7f02ebfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f9512d9d0 0x562f95138490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:20.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.927+0000 7f02fc6a5740 10 client.0 _ll_register_callbacks cb 0x562f95018030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:16:20.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.927+0000 7f02ebfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f9512d9d0 0x562f95138490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34632/0 (socket says 172.21.15.7:34632) 2024-09-19T04:16:20.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.927+0000 7f02ebfff640 1 -- 172.21.15.7:0/2686065635 learned_addr learned my addr 172.21.15.7:0/2686065635 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:20.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.927+0000 7f02f3fff640 1 --2- 172.21.15.7:0/2686065635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f9512e2f0 0x562f951357e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:20.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.927+0000 7f02ebfff640 1 --2- 172.21.15.7:0/2686065635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f95138bb0 0x562f95135d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:20.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.927+0000 7f02ebfff640 1 -- 172.21.15.7:0/2686065635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f9512e2f0 msgr2=0x562f951357e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:20.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.927+0000 7f02ebfff640 1 --2- 172.21.15.7:0/2686065635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f9512e2f0 0x562f951357e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.927+0000 7f02ebfff640 1 -- 172.21.15.7:0/2686065635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f95138bb0 msgr2=0x562f95135d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:20.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.927+0000 7f02ebfff640 1 --2- 172.21.15.7:0/2686065635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f95138bb0 0x562f95135d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.927+0000 7f02ebfff640 1 -- 172.21.15.7:0/2686065635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f94e052b0 con 0x562f9512d9d0 2024-09-19T04:16:20.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.927+0000 7f02ebfff640 1 --2- 172.21.15.7:0/2686065635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f9512d9d0 0x562f95138490 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f02dc005760 tx=0x7f02dc0056f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e61e393ffc23e40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:20.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.927+0000 7f02d37fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:16:20.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.927+0000 7f02d37fe640 1 -- 172.21.15.7:0/2686065635 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc035040 con 0x562f9512d9d0 2024-09-19T04:16:20.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.927+0000 7f02d37fe640 1 -- 172.21.15.7:0/2686065635 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f02dc004300 con 0x562f9512d9d0 2024-09-19T04:16:20.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.927+0000 7f02fc6a5740 1 -- 172.21.15.7:0/2686065635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02e4018b20 con 0x562f9512d9d0 2024-09-19T04:16:20.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.927+0000 7f02d37fe640 1 -- 172.21.15.7:0/2686065635 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f02dc052050 con 0x562f9512d9d0 2024-09-19T04:16:20.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.928+0000 7f02fc6a5740 10 client.15048 fetch_fsmap learned FSMap version 27 2024-09-19T04:16:20.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.928+0000 7f02fc6a5740 1 -- 172.21.15.7:0/2686065635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562f951470f0 con 0x562f9512d9d0 2024-09-19T04:16:20.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.928+0000 7f02d37fe640 1 -- 172.21.15.7:0/2686065635 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02e4018b20 con 0x562f9512d9d0 2024-09-19T04:16:20.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.928+0000 7f02d37fe640 1 -- 172.21.15.7:0/2686065635 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f02dc003990 con 0x562f9512d9d0 2024-09-19T04:16:20.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.928+0000 7f02fc6a5740 10 client.15048 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:16:20.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.928+0000 7f02fc6a5740 10 client.15048 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-19T04:16:20.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.928+0000 7f02fc6a5740 20 client.15048 populate_metadata read hostname 'smithi007' 2024-09-19T04:16:20.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.928+0000 7f02fc6a5740 1 --2- 172.21.15.7:0/2686065635 >> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] conn(0x562f95149700 0x562f9514ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:20.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.928+0000 7f02fc6a5740 4 client.15048 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:16:20.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.928+0000 7f02fc6a5740 1 -- 172.21.15.7:0/2686065635 --> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f950a1600 con 0x562f95149700 2024-09-19T04:16:20.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.928+0000 7f02f3fff640 1 --2- 172.21.15.7:0/2686065635 >> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] conn(0x562f95149700 0x562f9514ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:20.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.929+0000 7f02d37fe640 10 client.15048 ms_handle_connect on v2:172.21.15.102:6834/1756454579 2024-09-19T04:16:20.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.929+0000 7f02f3fff640 1 --2- 172.21.15.7:0/2686065635 >> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] conn(0x562f95149700 0x562f9514ab70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=95b9235184994f2e server_cookie=580e71bf586340c7 in_seq=0 out_seq=0 2024-09-19T04:16:20.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.930+0000 7f02d37fe640 1 -- 172.21.15.7:0/2686065635 <== mds.4 v2:172.21.15.102:6834/1756454579 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562f950a1600 con 0x562f95149700 2024-09-19T04:16:20.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.930+0000 7f02d37fe640 10 client.15048 handle_command_reply: tid=0 2024-09-19T04:16:20.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.930+0000 7f02fc6a5740 1 client.15048 shutdown 2024-09-19T04:16:20.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.930+0000 7f02fc6a5740 1 -- 172.21.15.7:0/2686065635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f9512d9d0 msgr2=0x562f95138490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:20.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.930+0000 7f02fc6a5740 1 --2- 172.21.15.7:0/2686065635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f9512d9d0 0x562f95138490 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f02dc005760 tx=0x7f02dc0056f0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.930+0000 7f02fc6a5740 1 -- 172.21.15.7:0/2686065635 shutdown_connections 2024-09-19T04:16:20.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.930+0000 7f02fc6a5740 1 --2- 172.21.15.7:0/2686065635 >> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] conn(0x562f95149700 0x562f9514ab70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.930+0000 7f02fc6a5740 1 --2- 172.21.15.7:0/2686065635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f95138bb0 0x562f95135d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.930+0000 7f02fc6a5740 1 --2- 172.21.15.7:0/2686065635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f9512e2f0 0x562f951357e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.930+0000 7f02fc6a5740 1 --2- 172.21.15.7:0/2686065635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f9512d9d0 0x562f95138490 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.930+0000 7f02d37fe640 0 client.15048 ms_handle_reset on v2:172.21.15.102:6834/1756454579 2024-09-19T04:16:20.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.930+0000 7f02fc6a5740 1 -- 172.21.15.7:0/2686065635 >> 172.21.15.7:0/2686065635 conn(0x562f95129f60 msgr2=0x562f9512fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:20.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.930+0000 7f02fc6a5740 1 -- 172.21.15.7:0/2686065635 shutdown_connections 2024-09-19T04:16:20.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.930+0000 7f02fc6a5740 1 -- 172.21.15.7:0/2686065635 wait complete. 2024-09-19T04:16:20.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.930+0000 7f02fc6a5740 20 client.15048 trim_cache size 0 max 16384 2024-09-19T04:16:20.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.948+0000 7f02fc6a5740 1 Processor -- start 2024-09-19T04:16:20.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.948+0000 7f02fc6a5740 1 -- start start 2024-09-19T04:16:20.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.948+0000 7f02fc6a5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f9512d9d0 0x562f9514ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:20.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.948+0000 7f02fc6a5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f9512e2f0 0x562f9512a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:20.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.948+0000 7f02fc6a5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f95138bb0 0x562f95137640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:20.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.948+0000 7f02fc6a5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562f95148eb0 con 0x562f9512d9d0 2024-09-19T04:16:20.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.948+0000 7f02fc6a5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562f95149580 con 0x562f9512e2f0 2024-09-19T04:16:20.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.948+0000 7f02fc6a5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562f95149c50 con 0x562f95138bb0 2024-09-19T04:16:20.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.948+0000 7f02ebfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f9512d9d0 0x562f9514ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:20.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.948+0000 7f02ebfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f9512d9d0 0x562f9514ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34644/0 (socket says 172.21.15.7:34644) 2024-09-19T04:16:20.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.948+0000 7f02ebfff640 1 -- 172.21.15.7:0/1381320059 learned_addr learned my addr 172.21.15.7:0/1381320059 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:20.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.949+0000 7f02ebfff640 1 -- 172.21.15.7:0/1381320059 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f95138bb0 msgr2=0x562f95137640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:20.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.949+0000 7f02ebfff640 1 --2- 172.21.15.7:0/1381320059 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f95138bb0 0x562f95137640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.949+0000 7f02f3fff640 1 --2- 172.21.15.7:0/1381320059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f9512e2f0 0x562f9512a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:20.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.949+0000 7f02ebfff640 1 -- 172.21.15.7:0/1381320059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f9512e2f0 msgr2=0x562f9512a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:20.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.949+0000 7f02ebfff640 1 --2- 172.21.15.7:0/1381320059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f9512e2f0 0x562f9512a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.949+0000 7f02ebfff640 1 -- 172.21.15.7:0/1381320059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f9512d800 con 0x562f9512d9d0 2024-09-19T04:16:20.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.949+0000 7f02f3fff640 1 --2- 172.21.15.7:0/1381320059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f9512e2f0 0x562f9512a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:16:20.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.949+0000 7f02ebfff640 1 --2- 172.21.15.7:0/1381320059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f9512d9d0 0x562f9514ab70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f02dc000c00 tx=0x7f02dc009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bfa499d6a05a0d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:20.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.949+0000 7f02e9ffb640 1 -- 172.21.15.7:0/1381320059 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc035070 con 0x562f9512d9d0 2024-09-19T04:16:20.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.949+0000 7f02e9ffb640 1 -- 172.21.15.7:0/1381320059 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02dc009520 con 0x562f9512d9d0 2024-09-19T04:16:20.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.949+0000 7f02e9ffb640 1 -- 172.21.15.7:0/1381320059 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc0407f0 con 0x562f9512d9d0 2024-09-19T04:16:20.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.950+0000 7f02fc6a5740 1 -- 172.21.15.7:0/1381320059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f9512d9d0 msgr2=0x562f9514ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:20.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.950+0000 7f02fc6a5740 1 --2- 172.21.15.7:0/1381320059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f9512d9d0 0x562f9514ab70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f02dc000c00 tx=0x7f02dc009290 comp rx=0 tx=0).stop 2024-09-19T04:16:20.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.950+0000 7f02fc6a5740 1 -- 172.21.15.7:0/1381320059 shutdown_connections 2024-09-19T04:16:20.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.950+0000 7f02fc6a5740 1 --2- 172.21.15.7:0/1381320059 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f95138bb0 0x562f95137640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.950+0000 7f02fc6a5740 1 --2- 172.21.15.7:0/1381320059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f9512e2f0 0x562f9512a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.950+0000 7f02fc6a5740 1 --2- 172.21.15.7:0/1381320059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f9512d9d0 0x562f9514ab70 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.950+0000 7f02fc6a5740 1 -- 172.21.15.7:0/1381320059 >> 172.21.15.7:0/1381320059 conn(0x562f95129f60 msgr2=0x562f95136f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.950+0000 7f02fc6a5740 1 -- 172.21.15.7:0/1381320059 shutdown_connections 2024-09-19T04:16:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.950+0000 7f02fc6a5740 1 -- 172.21.15.7:0/1381320059 wait complete. 2024-09-19T04:16:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.950+0000 7f02fc6a5740 1 -- start start 2024-09-19T04:16:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.950+0000 7f02fc6a5740 1 Processor -- start 2024-09-19T04:16:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.951+0000 7f02fc6a5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f9512d9d0 0x562f95153500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.951+0000 7f02fc6a5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f9512e2f0 0x562f9514e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.951+0000 7f02fc6a5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f95138bb0 0x562f9514ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.951+0000 7f02fc6a5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562f9514a9f0 con 0x562f9512d9d0 2024-09-19T04:16:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.951+0000 7f02fc6a5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562f9514a320 con 0x562f9512e2f0 2024-09-19T04:16:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.951+0000 7f02fc6a5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562f9514b0c0 con 0x562f95138bb0 2024-09-19T04:16:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.951+0000 7f02fc6a5740 10 client.0 _ll_register_callbacks cb 0x7f02f406b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:16:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.951+0000 7f02ebfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f9512d9d0 0x562f95153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.951+0000 7f02ebfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f9512d9d0 0x562f95153500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34658/0 (socket says 172.21.15.7:34658) 2024-09-19T04:16:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.951+0000 7f02ebfff640 1 -- 172.21.15.7:0/3129164352 learned_addr learned my addr 172.21.15.7:0/3129164352 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.951+0000 7f02f3fff640 1 --2- 172.21.15.7:0/3129164352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f9512e2f0 0x562f9514e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.951+0000 7f02ebfff640 1 --2- 172.21.15.7:0/3129164352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f95138bb0 0x562f9514ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.951+0000 7f02ebfff640 1 -- 172.21.15.7:0/3129164352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f95138bb0 msgr2=0x562f9514ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.951+0000 7f02ebfff640 1 --2- 172.21.15.7:0/3129164352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f95138bb0 0x562f9514ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.951+0000 7f02ebfff640 1 -- 172.21.15.7:0/3129164352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f9512e2f0 msgr2=0x562f9514e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.951+0000 7f02ebfff640 1 --2- 172.21.15.7:0/3129164352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f9512e2f0 0x562f9514e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.951+0000 7f02ebfff640 1 -- 172.21.15.7:0/3129164352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f95131480 con 0x562f9512d9d0 2024-09-19T04:16:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.951+0000 7f02ebfff640 1 --2- 172.21.15.7:0/3129164352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f9512d9d0 0x562f95153500 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f02dc0059d0 tx=0x7f02dc031900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db137327478ff120 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.951+0000 7f02d37fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:16:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.951+0000 7f02d37fe640 1 -- 172.21.15.7:0/3129164352 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc035070 con 0x562f9512d9d0 2024-09-19T04:16:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.951+0000 7f02d37fe640 1 -- 172.21.15.7:0/3129164352 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f02dc004100 con 0x562f9512d9d0 2024-09-19T04:16:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.951+0000 7f02fc6a5740 1 -- 172.21.15.7:0/3129164352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02dc009520 con 0x562f9512d9d0 2024-09-19T04:16:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.952+0000 7f02d37fe640 1 -- 172.21.15.7:0/3129164352 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f02dc066050 con 0x562f9512d9d0 2024-09-19T04:16:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.952+0000 7f02fc6a5740 10 client.15054 fetch_fsmap learned FSMap version 27 2024-09-19T04:16:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.952+0000 7f02fc6a5740 1 -- 172.21.15.7:0/3129164352 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562f951b3b50 con 0x562f9512d9d0 2024-09-19T04:16:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.952+0000 7f02d37fe640 1 -- 172.21.15.7:0/3129164352 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02dc009520 con 0x562f9512d9d0 2024-09-19T04:16:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.952+0000 7f02d37fe640 1 -- 172.21.15.7:0/3129164352 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f02dc04e5a0 con 0x562f9512d9d0 2024-09-19T04:16:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.952+0000 7f02fc6a5740 10 client.15054 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:16:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.952+0000 7f02fc6a5740 10 client.15054 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-19T04:16:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.952+0000 7f02fc6a5740 20 client.15054 populate_metadata read hostname 'smithi007' 2024-09-19T04:16:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.952+0000 7f02fc6a5740 1 --2- 172.21.15.7:0/3129164352 >> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] conn(0x562f951b8220 0x562f951b6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.952+0000 7f02fc6a5740 4 client.15054 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T04:16:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.952+0000 7f02fc6a5740 1 -- 172.21.15.7:0/3129164352 --> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] -- command(tid 0: {"prefix": "status"}) -- 0x562f9509bb10 con 0x562f951b8220 2024-09-19T04:16:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.952+0000 7f02f3fff640 1 --2- 172.21.15.7:0/3129164352 >> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] conn(0x562f951b8220 0x562f951b6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.953+0000 7f02f3fff640 1 --2- 172.21.15.7:0/3129164352 >> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] conn(0x562f951b8220 0x562f951b6f30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=218080b8f104447e server_cookie=fc881fdea7ac28a2 in_seq=0 out_seq=0 2024-09-19T04:16:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.953+0000 7f02d37fe640 10 client.15054 ms_handle_connect on v2:172.21.15.102:6834/1756454579 2024-09-19T04:16:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.953+0000 7f02d37fe640 1 -- 172.21.15.7:0/3129164352 <== mds.4 v2:172.21.15.102:6834/1756454579 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x562f9509bb10 con 0x562f951b8220 2024-09-19T04:16:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.953+0000 7f02d37fe640 10 client.15054 handle_command_reply: tid=0 2024-09-19T04:16:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.953+0000 7f02fc6a5740 1 client.15054 shutdown 2024-09-19T04:16:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.953+0000 7f02fc6a5740 1 -- 172.21.15.7:0/3129164352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f9512d9d0 msgr2=0x562f95153500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.953+0000 7f02fc6a5740 1 --2- 172.21.15.7:0/3129164352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f9512d9d0 0x562f95153500 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f02dc0059d0 tx=0x7f02dc031900 comp rx=0 tx=0).stop 2024-09-19T04:16:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.953+0000 7f02fc6a5740 1 -- 172.21.15.7:0/3129164352 shutdown_connections 2024-09-19T04:16:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.953+0000 7f02fc6a5740 1 --2- 172.21.15.7:0/3129164352 >> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] conn(0x562f951b8220 0x562f951b6f30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.953+0000 7f02fc6a5740 1 --2- 172.21.15.7:0/3129164352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f95138bb0 0x562f9514ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.953+0000 7f02fc6a5740 1 --2- 172.21.15.7:0/3129164352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562f9512e2f0 0x562f9514e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.953+0000 7f02fc6a5740 1 --2- 172.21.15.7:0/3129164352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562f9512d9d0 0x562f95153500 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.953+0000 7f02fc6a5740 1 -- 172.21.15.7:0/3129164352 >> 172.21.15.7:0/3129164352 conn(0x562f95129f60 msgr2=0x562f95129000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.953+0000 7f02d37fe640 0 client.15054 ms_handle_reset on v2:172.21.15.102:6834/1756454579 2024-09-19T04:16:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.953+0000 7f02fc6a5740 1 -- 172.21.15.7:0/3129164352 shutdown_connections 2024-09-19T04:16:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.953+0000 7f02fc6a5740 1 -- 172.21.15.7:0/3129164352 wait complete. 2024-09-19T04:16:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.953+0000 7f02fc6a5740 20 client.15054 trim_cache size 0 max 16384 2024-09-19T04:16:20.961 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:16:20.962 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "77957c0a-763c-11ef-bceb-c7b262605968", 2024-09-19T04:16:20.962 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 4, 2024-09-19T04:16:20.962 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24472, 2024-09-19T04:16:20.962 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-19T04:16:20.962 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-19T04:16:20.962 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-19T04:16:20.962 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 64.141984201, 2024-09-19T04:16:20.962 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 27, 2024-09-19T04:16:20.962 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 88, 2024-09-19T04:16:20.962 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 86, 2024-09-19T04:16:20.962 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 134.18980849600001 2024-09-19T04:16:20.962 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:16:20.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.954+0000 7f02fa2cc640 1 -- 172.21.15.7:0/3496512603 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f02e00a32d0 msgr2=0x7f02e00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:20.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.954+0000 7f02fa2cc640 1 --2- 172.21.15.7:0/3496512603 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f02e00a32d0 0x7f02e00a5790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f02ec09be60 tx=0x7f02ec067040 comp rx=0 tx=0).stop 2024-09-19T04:16:20.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.954+0000 7f02fa2cc640 1 -- 172.21.15.7:0/3496512603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f410c170 msgr2=0x7f02f419cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:20.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.954+0000 7f02fa2cc640 1 --2- 172.21.15.7:0/3496512603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f410c170 0x7f02f419cd20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f02ec00eaa0 tx=0x7f02ec00ef60 comp rx=0 tx=0).stop 2024-09-19T04:16:20.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.954+0000 7f02fa2cc640 1 -- 172.21.15.7:0/3496512603 shutdown_connections 2024-09-19T04:16:20.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.954+0000 7f02fa2cc640 1 --2- 172.21.15.7:0/3496512603 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f02e00a32d0 0x7f02e00a5790 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.954+0000 7f02fa2cc640 1 --2- 172.21.15.7:0/3496512603 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f02f410c170 0x7f02f419cd20 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.954+0000 7f02fa2cc640 1 --2- 172.21.15.7:0/3496512603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02f4103660 0x7f02f4198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.954+0000 7f02fa2cc640 1 --2- 172.21.15.7:0/3496512603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02f4102d40 0x7f02f4198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:20.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.954+0000 7f02fa2cc640 1 -- 172.21.15.7:0/3496512603 >> 172.21.15.7:0/3496512603 conn(0x7f02f40fc7a0 msgr2=0x7f02f40fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:20.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.954+0000 7f02fa2cc640 1 -- 172.21.15.7:0/3496512603 shutdown_connections 2024-09-19T04:16:20.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:20.954+0000 7f02fa2cc640 1 -- 172.21.15.7:0/3496512603 wait complete. 2024-09-19T04:16:21.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:21 smithi007 ceph-mon[31360]: pgmap v335: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T04:16:21.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:21 smithi102 ceph-mon[35446]: pgmap v335: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T04:16:21.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:21 smithi092 ceph-mon[34940]: pgmap v335: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T04:16:21.698 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-19T04:16:21.956 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:22.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.428+0000 7fa572cf9640 1 -- 172.21.15.7:0/244208224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa56c106a80 msgr2=0x7fa56c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:22.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.428+0000 7fa572cf9640 1 --2- 172.21.15.7:0/244208224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa56c106a80 0x7fa56c106e60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa560009930 tx=0x7fa56002a420 comp rx=0 tx=0).stop 2024-09-19T04:16:22.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.428+0000 7fa572cf9640 1 -- 172.21.15.7:0/244208224 shutdown_connections 2024-09-19T04:16:22.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.428+0000 7fa572cf9640 1 --2- 172.21.15.7:0/244208224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa56c101420 0x7fa56c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.428+0000 7fa572cf9640 1 --2- 172.21.15.7:0/244208224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa56c100a80 0x7fa56c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.428+0000 7fa572cf9640 1 --2- 172.21.15.7:0/244208224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa56c106a80 0x7fa56c106e60 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.428+0000 7fa572cf9640 1 -- 172.21.15.7:0/244208224 >> 172.21.15.7:0/244208224 conn(0x7fa56c0fc7a0 msgr2=0x7fa56c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:22.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.428+0000 7fa572cf9640 1 -- 172.21.15.7:0/244208224 shutdown_connections 2024-09-19T04:16:22.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.428+0000 7fa572cf9640 1 -- 172.21.15.7:0/244208224 wait complete. 2024-09-19T04:16:22.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.429+0000 7fa572cf9640 1 Processor -- start 2024-09-19T04:16:22.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.429+0000 7fa572cf9640 1 -- start start 2024-09-19T04:16:22.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.429+0000 7fa572cf9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa56c100a80 0x7fa56c1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:22.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.429+0000 7fa572cf9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa56c101420 0x7fa56c198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:22.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.429+0000 7fa572cf9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa56c106a80 0x7fa56c19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:22.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.429+0000 7fa572cf9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c110e90 con 0x7fa56c106a80 2024-09-19T04:16:22.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.429+0000 7fa572cf9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c110d10 con 0x7fa56c101420 2024-09-19T04:16:22.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.429+0000 7fa572cf9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c111010 con 0x7fa56c100a80 2024-09-19T04:16:22.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.429+0000 7fa571296640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa56c106a80 0x7fa56c19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:22.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.429+0000 7fa571296640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa56c106a80 0x7fa56c19ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34674/0 (socket says 172.21.15.7:34674) 2024-09-19T04:16:22.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.429+0000 7fa571296640 1 -- 172.21.15.7:0/1050032731 learned_addr learned my addr 172.21.15.7:0/1050032731 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:22.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.430+0000 7fa570a95640 1 --2- 172.21.15.7:0/1050032731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa56c100a80 0x7fa56c1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:22.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.430+0000 7fa56bfff640 1 --2- 172.21.15.7:0/1050032731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa56c101420 0x7fa56c198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:22.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.430+0000 7fa571296640 1 -- 172.21.15.7:0/1050032731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa56c100a80 msgr2=0x7fa56c1983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:22.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.430+0000 7fa571296640 1 --2- 172.21.15.7:0/1050032731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa56c100a80 0x7fa56c1983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.430+0000 7fa571296640 1 -- 172.21.15.7:0/1050032731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa56c101420 msgr2=0x7fa56c198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:22.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.430+0000 7fa571296640 1 --2- 172.21.15.7:0/1050032731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa56c101420 0x7fa56c198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.430+0000 7fa571296640 1 -- 172.21.15.7:0/1050032731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56c19d3a0 con 0x7fa56c106a80 2024-09-19T04:16:22.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.430+0000 7fa56bfff640 1 --2- 172.21.15.7:0/1050032731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa56c101420 0x7fa56c198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:16:22.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.430+0000 7fa571296640 1 --2- 172.21.15.7:0/1050032731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa56c106a80 0x7fa56c19ccc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa56400eaa0 tx=0x7fa56400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:22.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.430+0000 7fa569ffb640 1 -- 172.21.15.7:0/1050032731 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56400cdb0 con 0x7fa56c106a80 2024-09-19T04:16:22.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.430+0000 7fa569ffb640 1 -- 172.21.15.7:0/1050032731 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa564005020 con 0x7fa56c106a80 2024-09-19T04:16:22.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.430+0000 7fa572cf9640 1 -- 172.21.15.7:0/1050032731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa56c19d690 con 0x7fa56c106a80 2024-09-19T04:16:22.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.430+0000 7fa569ffb640 1 -- 172.21.15.7:0/1050032731 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5640116b0 con 0x7fa56c106a80 2024-09-19T04:16:22.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.430+0000 7fa572cf9640 1 -- 172.21.15.7:0/1050032731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa56c1a4f70 con 0x7fa56c106a80 2024-09-19T04:16:22.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.433+0000 7fa569ffb640 1 -- 172.21.15.7:0/1050032731 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fa564005560 con 0x7fa56c106a80 2024-09-19T04:16:22.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.433+0000 7fa5750d2740 1 Processor -- start 2024-09-19T04:16:22.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.433+0000 7fa5750d2740 1 -- start start 2024-09-19T04:16:22.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.433+0000 7fa5750d2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b707a519d0 0x55b707a51db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:22.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.433+0000 7fa5750d2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b707a522f0 0x55b707a5c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:22.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.433+0000 7fa5750d2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b707a5cbb0 0x55b707a5efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:22.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.433+0000 7fa5750d2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b7079b8090 con 0x55b707a522f0 2024-09-19T04:16:22.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.433+0000 7fa5750d2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b70795fa70 con 0x55b707a519d0 2024-09-19T04:16:22.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.433+0000 7fa5750d2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b7079b4050 con 0x55b707a5cbb0 2024-09-19T04:16:22.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.433+0000 7fa570a95640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b707a522f0 0x55b707a5c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:22.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.433+0000 7fa570a95640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b707a522f0 0x55b707a5c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34680/0 (socket says 172.21.15.7:34680) 2024-09-19T04:16:22.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.433+0000 7fa570a95640 1 -- 172.21.15.7:0/4000792204 learned_addr learned my addr 172.21.15.7:0/4000792204 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:22.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.433+0000 7fa56bfff640 1 --2- 172.21.15.7:0/4000792204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b707a519d0 0x55b707a51db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:22.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.433+0000 7fa569ffb640 1 --2- 172.21.15.7:0/1050032731 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa55c0a32d0 0x7fa55c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:22.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.434+0000 7fa56bfff640 1 --2- 172.21.15.7:0/4000792204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b707a5cbb0 0x55b707a5efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:22.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.434+0000 7fa570a95640 1 -- 172.21.15.7:0/4000792204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b707a5cbb0 msgr2=0x55b707a5efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:22.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.434+0000 7fa570a95640 1 --2- 172.21.15.7:0/4000792204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b707a5cbb0 0x55b707a5efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.434+0000 7fa570a95640 1 -- 172.21.15.7:0/4000792204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b707a519d0 msgr2=0x55b707a51db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:22.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.434+0000 7fa570a95640 1 --2- 172.21.15.7:0/4000792204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b707a519d0 0x55b707a51db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.434+0000 7fa570a95640 1 -- 172.21.15.7:0/4000792204 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b70796c130 con 0x55b707a522f0 2024-09-19T04:16:22.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.434+0000 7fa571296640 1 --2- 172.21.15.7:0/1050032731 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa55c0a32d0 0x7fa55c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:22.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.434+0000 7fa56bfff640 1 --2- 172.21.15.7:0/4000792204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b707a519d0 0x55b707a51db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:16:22.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.434+0000 7fa569ffb640 1 -- 172.21.15.7:0/1050032731 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7fa5640cffd0 con 0x7fa56c106a80 2024-09-19T04:16:22.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.434+0000 7fa570a95640 1 --2- 172.21.15.7:0/4000792204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b707a522f0 0x55b707a5c670 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa560009930 tx=0x7fa560009670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc42e04dc41fe0e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:22.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.434+0000 7fa556ffd640 1 -- 172.21.15.7:0/4000792204 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa560035040 con 0x55b707a522f0 2024-09-19T04:16:22.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.434+0000 7fa571296640 1 --2- 172.21.15.7:0/1050032731 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa55c0a32d0 0x7fa55c0a5790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa5640092f0 tx=0x7fa5640bc040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:22.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.434+0000 7fa556ffd640 1 -- 172.21.15.7:0/4000792204 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa560043070 con 0x55b707a522f0 2024-09-19T04:16:22.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.434+0000 7fa556ffd640 1 -- 172.21.15.7:0/4000792204 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5600049a0 con 0x55b707a522f0 2024-09-19T04:16:22.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.435+0000 7fa5750d2740 1 -- 172.21.15.7:0/4000792204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b707a522f0 msgr2=0x55b707a5c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:22.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.435+0000 7fa5750d2740 1 --2- 172.21.15.7:0/4000792204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b707a522f0 0x55b707a5c670 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa560009930 tx=0x7fa560009670 comp rx=0 tx=0).stop 2024-09-19T04:16:22.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.435+0000 7fa5750d2740 1 -- 172.21.15.7:0/4000792204 shutdown_connections 2024-09-19T04:16:22.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.435+0000 7fa5750d2740 1 --2- 172.21.15.7:0/4000792204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b707a5cbb0 0x55b707a5efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.435+0000 7fa5750d2740 1 --2- 172.21.15.7:0/4000792204 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b707a522f0 0x55b707a5c670 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.435+0000 7fa5750d2740 1 --2- 172.21.15.7:0/4000792204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b707a519d0 0x55b707a51db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.435+0000 7fa5750d2740 1 -- 172.21.15.7:0/4000792204 >> 172.21.15.7:0/4000792204 conn(0x55b707a4df60 msgr2=0x55b707a4e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:22.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.435+0000 7fa5750d2740 1 -- 172.21.15.7:0/4000792204 shutdown_connections 2024-09-19T04:16:22.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.435+0000 7fa5750d2740 1 -- 172.21.15.7:0/4000792204 wait complete. 2024-09-19T04:16:22.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.435+0000 7fa5750d2740 1 -- start start 2024-09-19T04:16:22.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.435+0000 7fa5750d2740 1 Processor -- start 2024-09-19T04:16:22.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.436+0000 7fa5750d2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b707a519d0 0x55b707a5c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:22.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.436+0000 7fa5750d2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b707a522f0 0x55b707a597f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:22.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.436+0000 7fa5750d2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b707a5cbb0 0x55b707a59d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:22.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.436+0000 7fa5750d2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b707a5f780 con 0x55b707a519d0 2024-09-19T04:16:22.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.436+0000 7fa5750d2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b707972f20 con 0x55b707a522f0 2024-09-19T04:16:22.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.436+0000 7fa5750d2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b707a5f900 con 0x55b707a5cbb0 2024-09-19T04:16:22.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.436+0000 7fa5750d2740 10 client.0 _ll_register_callbacks cb 0x55b70793c030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:16:22.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.436+0000 7fa56bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b707a519d0 0x55b707a5c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:22.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.436+0000 7fa56bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b707a519d0 0x55b707a5c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34692/0 (socket says 172.21.15.7:34692) 2024-09-19T04:16:22.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.436+0000 7fa56bfff640 1 -- 172.21.15.7:0/631262538 learned_addr learned my addr 172.21.15.7:0/631262538 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:22.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.436+0000 7fa56bfff640 1 -- 172.21.15.7:0/631262538 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b707a5cbb0 msgr2=0x55b707a59d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:22.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.436+0000 7fa56bfff640 1 --2- 172.21.15.7:0/631262538 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b707a5cbb0 0x55b707a59d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.436+0000 7fa56bfff640 1 -- 172.21.15.7:0/631262538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b707a522f0 msgr2=0x55b707a597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:22.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.436+0000 7fa56bfff640 1 --2- 172.21.15.7:0/631262538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b707a522f0 0x55b707a597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.436+0000 7fa56bfff640 1 -- 172.21.15.7:0/631262538 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7077292b0 con 0x55b707a519d0 2024-09-19T04:16:22.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.436+0000 7fa56bfff640 1 --2- 172.21.15.7:0/631262538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b707a519d0 0x55b707a5c4a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa558013b10 tx=0x7fa558010430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158a432e7a588eb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:22.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.436+0000 7fa54bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:16:22.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.436+0000 7fa54bfff640 1 -- 172.21.15.7:0/631262538 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5580130d0 con 0x55b707a519d0 2024-09-19T04:16:22.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.436+0000 7fa54bfff640 1 -- 172.21.15.7:0/631262538 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7fa558004020 con 0x55b707a519d0 2024-09-19T04:16:22.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.436+0000 7fa5750d2740 1 -- 172.21.15.7:0/631262538 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa560043070 con 0x55b707a519d0 2024-09-19T04:16:22.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.437+0000 7fa54bfff640 1 -- 172.21.15.7:0/631262538 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa558013270 con 0x55b707a519d0 2024-09-19T04:16:22.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.437+0000 7fa5750d2740 10 client.15066 fetch_fsmap learned FSMap version 27 2024-09-19T04:16:22.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.437+0000 7fa5750d2740 1 -- 172.21.15.7:0/631262538 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b707a6b150 con 0x55b707a519d0 2024-09-19T04:16:22.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.437+0000 7fa54bfff640 1 -- 172.21.15.7:0/631262538 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa560043070 con 0x55b707a519d0 2024-09-19T04:16:22.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.437+0000 7fa54bfff640 1 -- 172.21.15.7:0/631262538 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fa55801a030 con 0x55b707a519d0 2024-09-19T04:16:22.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.437+0000 7fa5750d2740 10 client.15066 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:16:22.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.437+0000 7fa5750d2740 10 client.15066 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T04:16:22.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.437+0000 7fa5750d2740 20 client.15066 populate_metadata read hostname 'smithi007' 2024-09-19T04:16:22.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.437+0000 7fa5750d2740 1 --2- 172.21.15.7:0/631262538 >> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] conn(0x55b707a6d800 0x55b707a6ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:22.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.437+0000 7fa5750d2740 4 client.15066 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:16:22.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.437+0000 7fa5750d2740 1 -- 172.21.15.7:0/631262538 --> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7079c5600 con 0x55b707a6d800 2024-09-19T04:16:22.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.438+0000 7fa570a95640 1 --2- 172.21.15.7:0/631262538 >> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] conn(0x55b707a6d800 0x55b707a6ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:22.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.438+0000 7fa54bfff640 10 client.15066 ms_handle_connect on v2:172.21.15.102:6836/618291553 2024-09-19T04:16:22.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.438+0000 7fa570a95640 1 --2- 172.21.15.7:0/631262538 >> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] conn(0x55b707a6d800 0x55b707a6ec70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4eee41003c23218f server_cookie=9dda8d9bf7a6308e in_seq=0 out_seq=0 2024-09-19T04:16:22.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.439+0000 7fa54bfff640 1 -- 172.21.15.7:0/631262538 <== mds.3 v2:172.21.15.102:6836/618291553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b7079c5600 con 0x55b707a6d800 2024-09-19T04:16:22.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.439+0000 7fa54bfff640 10 client.15066 handle_command_reply: tid=0 2024-09-19T04:16:22.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.439+0000 7fa5750d2740 1 client.15066 shutdown 2024-09-19T04:16:22.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.439+0000 7fa5750d2740 1 -- 172.21.15.7:0/631262538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b707a519d0 msgr2=0x55b707a5c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:22.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.439+0000 7fa5750d2740 1 --2- 172.21.15.7:0/631262538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b707a519d0 0x55b707a5c4a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa558013b10 tx=0x7fa558010430 comp rx=0 tx=0).stop 2024-09-19T04:16:22.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.439+0000 7fa5750d2740 1 -- 172.21.15.7:0/631262538 shutdown_connections 2024-09-19T04:16:22.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.439+0000 7fa5750d2740 1 --2- 172.21.15.7:0/631262538 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b707a5cbb0 0x55b707a59d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.439+0000 7fa5750d2740 1 --2- 172.21.15.7:0/631262538 >> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] conn(0x55b707a6d800 0x55b707a6ec70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.439+0000 7fa5750d2740 1 --2- 172.21.15.7:0/631262538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b707a522f0 0x55b707a597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.439+0000 7fa5750d2740 1 --2- 172.21.15.7:0/631262538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b707a519d0 0x55b707a5c4a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.439+0000 7fa5750d2740 1 -- 172.21.15.7:0/631262538 >> 172.21.15.7:0/631262538 conn(0x55b707a4df60 msgr2=0x55b707a53c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:22.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.439+0000 7fa54bfff640 0 client.15066 ms_handle_reset on v2:172.21.15.102:6836/618291553 2024-09-19T04:16:22.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.440+0000 7fa5750d2740 1 -- 172.21.15.7:0/631262538 shutdown_connections 2024-09-19T04:16:22.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.440+0000 7fa5750d2740 1 -- 172.21.15.7:0/631262538 wait complete. 2024-09-19T04:16:22.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.440+0000 7fa5750d2740 20 client.15066 trim_cache size 0 max 16384 2024-09-19T04:16:22.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.457+0000 7fa5750d2740 1 Processor -- start 2024-09-19T04:16:22.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.457+0000 7fa5750d2740 1 -- start start 2024-09-19T04:16:22.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.458+0000 7fa5750d2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b707a519d0 0x55b707a6ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:22.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.458+0000 7fa5750d2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b707a522f0 0x55b707a597b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:22.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.458+0000 7fa5750d2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b707a5cbb0 0x55b707a59cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.458+0000 7fa5750d2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b707a6cfb0 con 0x55b707a519d0 2024-09-19T04:16:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.458+0000 7fa5750d2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b707a6d680 con 0x55b707a522f0 2024-09-19T04:16:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.458+0000 7fa5750d2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b707a6dd50 con 0x55b707a5cbb0 2024-09-19T04:16:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.458+0000 7fa56bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b707a519d0 0x55b707a6ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.458+0000 7fa56bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b707a519d0 0x55b707a6ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34702/0 (socket says 172.21.15.7:34702) 2024-09-19T04:16:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.458+0000 7fa56bfff640 1 -- 172.21.15.7:0/1941182974 learned_addr learned my addr 172.21.15.7:0/1941182974 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.458+0000 7fa56bfff640 1 -- 172.21.15.7:0/1941182974 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b707a5cbb0 msgr2=0x55b707a59cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.458+0000 7fa56bfff640 1 --2- 172.21.15.7:0/1941182974 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b707a5cbb0 0x55b707a59cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.458+0000 7fa56bfff640 1 -- 172.21.15.7:0/1941182974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b707a522f0 msgr2=0x55b707a597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.458+0000 7fa56bfff640 1 --2- 172.21.15.7:0/1941182974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b707a522f0 0x55b707a597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.458+0000 7fa56bfff640 1 -- 172.21.15.7:0/1941182974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b707a4eb60 con 0x55b707a519d0 2024-09-19T04:16:22.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.458+0000 7fa56bfff640 1 --2- 172.21.15.7:0/1941182974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b707a519d0 0x55b707a6ded0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa5580114c0 tx=0x7fa5580109e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae11573730cb84c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.458+0000 7fa5567fc640 1 -- 172.21.15.7:0/1941182974 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55800b980 con 0x55b707a519d0 2024-09-19T04:16:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.458+0000 7fa5567fc640 1 -- 172.21.15.7:0/1941182974 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa558011c10 con 0x55b707a519d0 2024-09-19T04:16:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.458+0000 7fa5567fc640 1 -- 172.21.15.7:0/1941182974 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55802ac50 con 0x55b707a519d0 2024-09-19T04:16:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.459+0000 7fa5750d2740 1 -- 172.21.15.7:0/1941182974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b707a519d0 msgr2=0x55b707a6ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.459+0000 7fa5750d2740 1 --2- 172.21.15.7:0/1941182974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b707a519d0 0x55b707a6ded0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa5580114c0 tx=0x7fa5580109e0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.459+0000 7fa5750d2740 1 -- 172.21.15.7:0/1941182974 shutdown_connections 2024-09-19T04:16:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.459+0000 7fa5750d2740 1 --2- 172.21.15.7:0/1941182974 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b707a5cbb0 0x55b707a59cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.459+0000 7fa5750d2740 1 --2- 172.21.15.7:0/1941182974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b707a522f0 0x55b707a597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.459+0000 7fa5750d2740 1 --2- 172.21.15.7:0/1941182974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b707a519d0 0x55b707a6ded0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.459+0000 7fa5750d2740 1 -- 172.21.15.7:0/1941182974 >> 172.21.15.7:0/1941182974 conn(0x55b707a4df60 msgr2=0x55b707a48ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.459+0000 7fa5750d2740 1 -- 172.21.15.7:0/1941182974 shutdown_connections 2024-09-19T04:16:22.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.459+0000 7fa5750d2740 1 -- 172.21.15.7:0/1941182974 wait complete. 2024-09-19T04:16:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.459+0000 7fa5750d2740 1 -- start start 2024-09-19T04:16:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.460+0000 7fa5750d2740 1 Processor -- start 2024-09-19T04:16:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.460+0000 7fa5750d2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b707a519d0 0x55b707a71de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.460+0000 7fa5750d2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b707a522f0 0x55b707a72320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.460+0000 7fa5750d2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b707a5cbb0 0x55b707a72860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.460+0000 7fa5750d2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b707a6eaf0 con 0x55b707a522f0 2024-09-19T04:16:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.460+0000 7fa5750d2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b707a6e420 con 0x55b707a519d0 2024-09-19T04:16:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.460+0000 7fa5750d2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b707a6f1c0 con 0x55b707a5cbb0 2024-09-19T04:16:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.460+0000 7fa5750d2740 10 client.0 _ll_register_callbacks cb 0x7fa558013720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:16:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.460+0000 7fa570a95640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b707a522f0 0x55b707a72320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.460+0000 7fa570a95640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b707a522f0 0x55b707a72320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34714/0 (socket says 172.21.15.7:34714) 2024-09-19T04:16:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.460+0000 7fa570a95640 1 -- 172.21.15.7:0/519619845 learned_addr learned my addr 172.21.15.7:0/519619845 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:22.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.460+0000 7fa56bfff640 1 --2- 172.21.15.7:0/519619845 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b707a5cbb0 0x55b707a72860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.460+0000 7fa56bfff640 1 --2- 172.21.15.7:0/519619845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b707a519d0 0x55b707a71de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.460+0000 7fa570a95640 1 -- 172.21.15.7:0/519619845 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b707a5cbb0 msgr2=0x55b707a72860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.460+0000 7fa570a95640 1 --2- 172.21.15.7:0/519619845 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b707a5cbb0 0x55b707a72860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.460+0000 7fa570a95640 1 -- 172.21.15.7:0/519619845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b707a519d0 msgr2=0x55b707a71de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.460+0000 7fa570a95640 1 --2- 172.21.15.7:0/519619845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b707a519d0 0x55b707a71de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.460+0000 7fa570a95640 1 -- 172.21.15.7:0/519619845 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b707a5a310 con 0x55b707a522f0 2024-09-19T04:16:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.460+0000 7fa56bfff640 1 --2- 172.21.15.7:0/519619845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b707a519d0 0x55b707a71de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:16:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.461+0000 7fa570a95640 1 --2- 172.21.15.7:0/519619845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b707a522f0 0x55b707a72320 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa560009850 tx=0x7fa560005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd2d5dbb861c4d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.461+0000 7fa54bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:16:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.461+0000 7fa54bfff640 1 -- 172.21.15.7:0/519619845 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa560035070 con 0x55b707a522f0 2024-09-19T04:16:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.461+0000 7fa54bfff640 1 -- 172.21.15.7:0/519619845 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7fa56003f9e0 con 0x55b707a522f0 2024-09-19T04:16:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.461+0000 7fa5750d2740 1 -- 172.21.15.7:0/519619845 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa558011c10 con 0x55b707a522f0 2024-09-19T04:16:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.461+0000 7fa54bfff640 1 -- 172.21.15.7:0/519619845 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa560005020 con 0x55b707a522f0 2024-09-19T04:16:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.461+0000 7fa5750d2740 10 client.15072 fetch_fsmap learned FSMap version 27 2024-09-19T04:16:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.461+0000 7fa5750d2740 1 -- 172.21.15.7:0/519619845 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b707ad71e0 con 0x55b707a522f0 2024-09-19T04:16:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.461+0000 7fa54bfff640 1 -- 172.21.15.7:0/519619845 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa558011c10 con 0x55b707a522f0 2024-09-19T04:16:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.461+0000 7fa54bfff640 1 -- 172.21.15.7:0/519619845 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fa5600315b0 con 0x55b707a522f0 2024-09-19T04:16:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.461+0000 7fa5750d2740 10 client.15072 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:16:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.461+0000 7fa5750d2740 10 client.15072 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T04:16:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.461+0000 7fa5750d2740 20 client.15072 populate_metadata read hostname 'smithi007' 2024-09-19T04:16:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.461+0000 7fa5750d2740 1 --2- 172.21.15.7:0/519619845 >> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] conn(0x55b707adb880 0x55b707ada590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.461+0000 7fa5750d2740 4 client.15072 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T04:16:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.461+0000 7fa5750d2740 1 -- 172.21.15.7:0/519619845 --> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] -- command(tid 0: {"prefix": "status"}) -- 0x55b7079bfb10 con 0x55b707adb880 2024-09-19T04:16:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.462+0000 7fa56bfff640 1 --2- 172.21.15.7:0/519619845 >> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] conn(0x55b707adb880 0x55b707ada590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.462+0000 7fa56bfff640 1 --2- 172.21.15.7:0/519619845 >> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] conn(0x55b707adb880 0x55b707ada590 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=304f34e97ef97cd9 server_cookie=69b42408bc8478a0 in_seq=0 out_seq=0 2024-09-19T04:16:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.462+0000 7fa54bfff640 10 client.15072 ms_handle_connect on v2:172.21.15.102:6836/618291553 2024-09-19T04:16:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.462+0000 7fa54bfff640 1 -- 172.21.15.7:0/519619845 <== mds.3 v2:172.21.15.102:6836/618291553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b7079bfb10 con 0x55b707adb880 2024-09-19T04:16:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.462+0000 7fa54bfff640 10 client.15072 handle_command_reply: tid=0 2024-09-19T04:16:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.462+0000 7fa5750d2740 1 client.15072 shutdown 2024-09-19T04:16:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.463+0000 7fa5750d2740 1 -- 172.21.15.7:0/519619845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b707a522f0 msgr2=0x55b707a72320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.463+0000 7fa5750d2740 1 --2- 172.21.15.7:0/519619845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b707a522f0 0x55b707a72320 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa560009850 tx=0x7fa560005a60 comp rx=0 tx=0).stop 2024-09-19T04:16:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.463+0000 7fa5750d2740 1 -- 172.21.15.7:0/519619845 shutdown_connections 2024-09-19T04:16:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.463+0000 7fa5750d2740 1 --2- 172.21.15.7:0/519619845 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b707a5cbb0 0x55b707a72860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.463+0000 7fa5750d2740 1 --2- 172.21.15.7:0/519619845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b707a522f0 0x55b707a72320 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.463+0000 7fa5750d2740 1 --2- 172.21.15.7:0/519619845 >> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] conn(0x55b707adb880 0x55b707ada590 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.463+0000 7fa5750d2740 1 --2- 172.21.15.7:0/519619845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b707a519d0 0x55b707a71de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.463+0000 7fa54bfff640 0 client.15072 ms_handle_reset on v2:172.21.15.102:6836/618291553 2024-09-19T04:16:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.463+0000 7fa5750d2740 1 -- 172.21.15.7:0/519619845 >> 172.21.15.7:0/519619845 conn(0x55b707a4df60 msgr2=0x55b707a597b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.463+0000 7fa5750d2740 1 -- 172.21.15.7:0/519619845 shutdown_connections 2024-09-19T04:16:22.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.463+0000 7fa5750d2740 1 -- 172.21.15.7:0/519619845 wait complete. 2024-09-19T04:16:22.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.463+0000 7fa5750d2740 20 client.15072 trim_cache size 0 max 16384 2024-09-19T04:16:22.471 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:16:22.471 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "77957c0a-763c-11ef-bceb-c7b262605968", 2024-09-19T04:16:22.471 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 3, 2024-09-19T04:16:22.471 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24478, 2024-09-19T04:16:22.471 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-19T04:16:22.471 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-19T04:16:22.471 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-19T04:16:22.471 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 66.656170709999998, 2024-09-19T04:16:22.472 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 27, 2024-09-19T04:16:22.472 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 88, 2024-09-19T04:16:22.472 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 86, 2024-09-19T04:16:22.472 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 133.16868980800001 2024-09-19T04:16:22.472 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:16:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.463+0000 7fa572cf9640 1 -- 172.21.15.7:0/1050032731 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa55c0a32d0 msgr2=0x7fa55c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.463+0000 7fa572cf9640 1 --2- 172.21.15.7:0/1050032731 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa55c0a32d0 0x7fa55c0a5790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa5640092f0 tx=0x7fa5640bc040 comp rx=0 tx=0).stop 2024-09-19T04:16:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.463+0000 7fa572cf9640 1 -- 172.21.15.7:0/1050032731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa56c106a80 msgr2=0x7fa56c19ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.463+0000 7fa572cf9640 1 --2- 172.21.15.7:0/1050032731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa56c106a80 0x7fa56c19ccc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa56400eaa0 tx=0x7fa56400ef60 comp rx=0 tx=0).stop 2024-09-19T04:16:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.463+0000 7fa572cf9640 1 -- 172.21.15.7:0/1050032731 shutdown_connections 2024-09-19T04:16:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.463+0000 7fa572cf9640 1 --2- 172.21.15.7:0/1050032731 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa55c0a32d0 0x7fa55c0a5790 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.463+0000 7fa572cf9640 1 --2- 172.21.15.7:0/1050032731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa56c106a80 0x7fa56c19ccc0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.463+0000 7fa572cf9640 1 --2- 172.21.15.7:0/1050032731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa56c101420 0x7fa56c198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.463+0000 7fa572cf9640 1 --2- 172.21.15.7:0/1050032731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa56c100a80 0x7fa56c1983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.464+0000 7fa572cf9640 1 -- 172.21.15.7:0/1050032731 >> 172.21.15.7:0/1050032731 conn(0x7fa56c0fc7a0 msgr2=0x7fa56c06aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.464+0000 7fa572cf9640 1 -- 172.21.15.7:0/1050032731 shutdown_connections 2024-09-19T04:16:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:22.464+0000 7fa572cf9640 1 -- 172.21.15.7:0/1050032731 wait complete. 2024-09-19T04:16:23.243 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T04:16:23.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:23 smithi007 ceph-mon[31360]: pgmap v336: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T04:16:23.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:23 smithi102 ceph-mon[35446]: pgmap v336: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T04:16:23.499 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:23.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:23 smithi092 ceph-mon[34940]: pgmap v336: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T04:16:23.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.973+0000 7f2039e40640 1 -- 172.21.15.7:0/2384348031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2034100e20 msgr2=0x7f2034101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:23.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.973+0000 7f2039e40640 1 --2- 172.21.15.7:0/2384348031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2034100e20 0x7f2034101200 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2024009900 tx=0x7f202402a480 comp rx=0 tx=0).stop 2024-09-19T04:16:23.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.973+0000 7f2039e40640 1 -- 172.21.15.7:0/2384348031 shutdown_connections 2024-09-19T04:16:23.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.973+0000 7f2039e40640 1 --2- 172.21.15.7:0/2384348031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2034102ef0 0x7f203410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:23.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.973+0000 7f2039e40640 1 --2- 172.21.15.7:0/2384348031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2034102570 0x7f20341029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:23.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.973+0000 7f2039e40640 1 --2- 172.21.15.7:0/2384348031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2034100e20 0x7f2034101200 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:23.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.973+0000 7f2039e40640 1 -- 172.21.15.7:0/2384348031 >> 172.21.15.7:0/2384348031 conn(0x7f20340fc7d0 msgr2=0x7f20340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:23.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.973+0000 7f2039e40640 1 -- 172.21.15.7:0/2384348031 shutdown_connections 2024-09-19T04:16:23.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.973+0000 7f2039e40640 1 -- 172.21.15.7:0/2384348031 wait complete. 2024-09-19T04:16:23.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.974+0000 7f2039e40640 1 Processor -- start 2024-09-19T04:16:23.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.974+0000 7f2039e40640 1 -- start start 2024-09-19T04:16:23.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.974+0000 7f2039e40640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2034100e20 0x7f2034198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:23.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.974+0000 7f2039e40640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2034102570 0x7f2034198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:23.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.974+0000 7f2039e40640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2034102ef0 0x7f203419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:23.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.974+0000 7f2039e40640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2034110f80 con 0x7f2034102ef0 2024-09-19T04:16:23.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.974+0000 7f2039e40640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2034110e00 con 0x7f2034100e20 2024-09-19T04:16:23.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.974+0000 7f2039e40640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2034111100 con 0x7f2034102570 2024-09-19T04:16:23.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.974+0000 7f2033fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2034102ef0 0x7f203419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:23.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.974+0000 7f2033fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2034102ef0 0x7f203419cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34734/0 (socket says 172.21.15.7:34734) 2024-09-19T04:16:23.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.974+0000 7f2033fff640 1 -- 172.21.15.7:0/1358916608 learned_addr learned my addr 172.21.15.7:0/1358916608 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:23.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.974+0000 7f2032ffd640 1 --2- 172.21.15.7:0/1358916608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2034102570 0x7f2034198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:23.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.974+0000 7f20337fe640 1 --2- 172.21.15.7:0/1358916608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2034100e20 0x7f2034198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:23.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.974+0000 7f2033fff640 1 -- 172.21.15.7:0/1358916608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2034102570 msgr2=0x7f2034198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:23.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.974+0000 7f2033fff640 1 --2- 172.21.15.7:0/1358916608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2034102570 0x7f2034198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:23.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.974+0000 7f2033fff640 1 -- 172.21.15.7:0/1358916608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2034100e20 msgr2=0x7f2034198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:23.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.974+0000 7f2033fff640 1 --2- 172.21.15.7:0/1358916608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2034100e20 0x7f2034198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:23.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.974+0000 7f2033fff640 1 -- 172.21.15.7:0/1358916608 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f203419d4d0 con 0x7f2034102ef0 2024-09-19T04:16:23.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.975+0000 7f2033fff640 1 --2- 172.21.15.7:0/1358916608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2034102ef0 0x7f203419cdf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f202c00eaa0 tx=0x7f202c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:23.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.975+0000 7f2030ff9640 1 -- 172.21.15.7:0/1358916608 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c00cdb0 con 0x7f2034102ef0 2024-09-19T04:16:23.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.975+0000 7f2030ff9640 1 -- 172.21.15.7:0/1358916608 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f202c005020 con 0x7f2034102ef0 2024-09-19T04:16:23.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.975+0000 7f2039e40640 1 -- 172.21.15.7:0/1358916608 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f203419d7c0 con 0x7f2034102ef0 2024-09-19T04:16:23.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.975+0000 7f2030ff9640 1 -- 172.21.15.7:0/1358916608 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c0116b0 con 0x7f2034102ef0 2024-09-19T04:16:23.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.975+0000 7f2039e40640 1 -- 172.21.15.7:0/1358916608 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20341a50a0 con 0x7f2034102ef0 2024-09-19T04:16:23.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.978+0000 7f2030ff9640 1 -- 172.21.15.7:0/1358916608 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f202c005560 con 0x7f2034102ef0 2024-09-19T04:16:23.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.978+0000 7f203c219740 1 Processor -- start 2024-09-19T04:16:23.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.978+0000 7f203c219740 1 -- start start 2024-09-19T04:16:23.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.978+0000 7f203c219740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1be0fb9d0 0x55b1be0fbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:23.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.978+0000 7f203c219740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1be0fc2f0 0x55b1be106670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:23.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.978+0000 7f203c219740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1be106bb0 0x55b1be108fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:23.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.978+0000 7f203c219740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b1be062090 con 0x55b1be0fb9d0 2024-09-19T04:16:23.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.978+0000 7f203c219740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b1be009a70 con 0x55b1be106bb0 2024-09-19T04:16:23.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.978+0000 7f203c219740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b1be05e050 con 0x55b1be0fc2f0 2024-09-19T04:16:23.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.978+0000 7f2032ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1be0fb9d0 0x55b1be0fbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:23.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.979+0000 7f2032ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1be0fb9d0 0x55b1be0fbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34746/0 (socket says 172.21.15.7:34746) 2024-09-19T04:16:23.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.979+0000 7f2032ffd640 1 -- 172.21.15.7:0/82351075 learned_addr learned my addr 172.21.15.7:0/82351075 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:23.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.979+0000 7f20337fe640 1 --2- 172.21.15.7:0/82351075 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1be0fc2f0 0x55b1be106670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:23.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.979+0000 7f2030ff9640 1 --2- 172.21.15.7:0/1358916608 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f201c0a32d0 0x7f201c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:23.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.979+0000 7f2032ffd640 1 --2- 172.21.15.7:0/82351075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1be106bb0 0x55b1be108fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:23.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.979+0000 7f2032ffd640 1 -- 172.21.15.7:0/82351075 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1be0fc2f0 msgr2=0x55b1be106670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:23.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.979+0000 7f2032ffd640 1 --2- 172.21.15.7:0/82351075 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1be0fc2f0 0x55b1be106670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:23.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.979+0000 7f2032ffd640 1 -- 172.21.15.7:0/82351075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1be106bb0 msgr2=0x55b1be108fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:23.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.979+0000 7f2032ffd640 1 --2- 172.21.15.7:0/82351075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1be106bb0 0x55b1be108fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:23.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.979+0000 7f2032ffd640 1 -- 172.21.15.7:0/82351075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1be016130 con 0x55b1be0fb9d0 2024-09-19T04:16:23.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.979+0000 7f2033fff640 1 --2- 172.21.15.7:0/1358916608 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f201c0a32d0 0x7f201c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:23.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.979+0000 7f2030ff9640 1 -- 172.21.15.7:0/1358916608 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f202c0d0060 con 0x7f2034102ef0 2024-09-19T04:16:23.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.979+0000 7f2032ffd640 1 --2- 172.21.15.7:0/82351075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1be0fb9d0 0x55b1be0fbdb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f202800b8c0 tx=0x7f2028004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6a91158b0f50d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:23.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.979+0000 7f2019ffb640 1 -- 172.21.15.7:0/82351075 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2028003d70 con 0x55b1be0fb9d0 2024-09-19T04:16:23.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.979+0000 7f2019ffb640 1 -- 172.21.15.7:0/82351075 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2028005500 con 0x55b1be0fb9d0 2024-09-19T04:16:23.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.979+0000 7f2019ffb640 1 -- 172.21.15.7:0/82351075 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20280106c0 con 0x55b1be0fb9d0 2024-09-19T04:16:23.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.980+0000 7f203c219740 1 -- 172.21.15.7:0/82351075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1be0fb9d0 msgr2=0x55b1be0fbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:23.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.980+0000 7f203c219740 1 --2- 172.21.15.7:0/82351075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1be0fb9d0 0x55b1be0fbdb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f202800b8c0 tx=0x7f2028004250 comp rx=0 tx=0).stop 2024-09-19T04:16:23.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.980+0000 7f2033fff640 1 --2- 172.21.15.7:0/1358916608 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f201c0a32d0 0x7f201c0a5790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f202c00efd0 tx=0x7f202c0916c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:23.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.980+0000 7f203c219740 1 -- 172.21.15.7:0/82351075 shutdown_connections 2024-09-19T04:16:23.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.980+0000 7f203c219740 1 --2- 172.21.15.7:0/82351075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1be106bb0 0x55b1be108fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:23.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.980+0000 7f203c219740 1 --2- 172.21.15.7:0/82351075 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1be0fc2f0 0x55b1be106670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:23.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.980+0000 7f203c219740 1 --2- 172.21.15.7:0/82351075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1be0fb9d0 0x55b1be0fbdb0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:23.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.980+0000 7f203c219740 1 -- 172.21.15.7:0/82351075 >> 172.21.15.7:0/82351075 conn(0x55b1be0f7f60 msgr2=0x55b1be0f8340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:23.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.980+0000 7f203c219740 1 -- 172.21.15.7:0/82351075 shutdown_connections 2024-09-19T04:16:23.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.980+0000 7f203c219740 1 -- 172.21.15.7:0/82351075 wait complete. 2024-09-19T04:16:23.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.980+0000 7f203c219740 1 -- start start 2024-09-19T04:16:23.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.981+0000 7f203c219740 1 Processor -- start 2024-09-19T04:16:23.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.981+0000 7f203c219740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1be0fb9d0 0x55b1be1063f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:23.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.981+0000 7f203c219740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1be0fc2f0 0x55b1be103740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:23.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.981+0000 7f203c219740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1be106bb0 0x55b1be103c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:23.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.981+0000 7f203c219740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b1be109780 con 0x55b1be106bb0 2024-09-19T04:16:23.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.981+0000 7f203c219740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b1be01cf20 con 0x55b1be0fb9d0 2024-09-19T04:16:23.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.981+0000 7f203c219740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b1be109900 con 0x55b1be0fc2f0 2024-09-19T04:16:23.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.981+0000 7f203c219740 10 client.0 _ll_register_callbacks cb 0x55b1bdfe6030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:16:23.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.981+0000 7f20337fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1be0fc2f0 0x55b1be103740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:23.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.981+0000 7f2032ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1be0fb9d0 0x55b1be1063f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:23.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.981+0000 7f20337fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1be0fc2f0 0x55b1be103740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:59432/0 (socket says 172.21.15.7:59432) 2024-09-19T04:16:23.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.981+0000 7f20337fe640 1 -- 172.21.15.7:0/3727200887 learned_addr learned my addr 172.21.15.7:0/3727200887 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:23.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.981+0000 7f2032ffd640 1 --2- 172.21.15.7:0/3727200887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1be106bb0 0x55b1be103c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:23.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.982+0000 7f20337fe640 1 -- 172.21.15.7:0/3727200887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1be0fb9d0 msgr2=0x55b1be1063f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:23.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.982+0000 7f20337fe640 1 --2- 172.21.15.7:0/3727200887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1be0fb9d0 0x55b1be1063f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:23.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.982+0000 7f20337fe640 1 -- 172.21.15.7:0/3727200887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1be106bb0 msgr2=0x55b1be103c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:23.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.982+0000 7f20337fe640 1 --2- 172.21.15.7:0/3727200887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1be106bb0 0x55b1be103c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:23.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.982+0000 7f20337fe640 1 -- 172.21.15.7:0/3727200887 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1bddd32b0 con 0x55b1be0fc2f0 2024-09-19T04:16:23.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.982+0000 7f2032ffd640 1 --2- 172.21.15.7:0/3727200887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1be106bb0 0x55b1be103c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:16:23.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.982+0000 7f20337fe640 1 --2- 172.21.15.7:0/3727200887 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1be0fc2f0 0x55b1be103740 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f202402a9a0 tx=0x7f2024005250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f12d870e0383b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:23.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.982+0000 7f2012ffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-19T04:16:23.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.982+0000 7f2012ffd640 1 -- 172.21.15.7:0/3727200887 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2024035040 con 0x55b1be0fc2f0 2024-09-19T04:16:23.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.982+0000 7f203c219740 1 -- 172.21.15.7:0/3727200887 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2028005500 con 0x55b1be0fc2f0 2024-09-19T04:16:23.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.982+0000 7f2012ffd640 1 -- 172.21.15.7:0/3727200887 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f20240048c0 con 0x55b1be0fc2f0 2024-09-19T04:16:23.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.982+0000 7f2012ffd640 1 -- 172.21.15.7:0/3727200887 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f202404e050 con 0x55b1be0fc2f0 2024-09-19T04:16:23.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.982+0000 7f203c219740 10 client.24880 fetch_fsmap learned FSMap version 27 2024-09-19T04:16:23.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.982+0000 7f203c219740 1 -- 172.21.15.7:0/3727200887 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b1be115090 con 0x55b1be0fc2f0 2024-09-19T04:16:23.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.982+0000 7f2012ffd640 1 -- 172.21.15.7:0/3727200887 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2028005500 con 0x55b1be0fc2f0 2024-09-19T04:16:23.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.983+0000 7f2012ffd640 1 -- 172.21.15.7:0/3727200887 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f2024003c00 con 0x55b1be0fc2f0 2024-09-19T04:16:23.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.983+0000 7f203c219740 10 client.24880 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:16:23.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.983+0000 7f203c219740 10 client.24880 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T04:16:23.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.983+0000 7f203c219740 20 client.24880 populate_metadata read hostname 'smithi007' 2024-09-19T04:16:23.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.983+0000 7f203c219740 1 --2- 172.21.15.7:0/3727200887 >> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] conn(0x55b1be117640 0x55b1be118ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:23.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.983+0000 7f203c219740 4 client.24880 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:16:23.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.983+0000 7f203c219740 1 -- 172.21.15.7:0/3727200887 --> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1be06f600 con 0x55b1be117640 2024-09-19T04:16:23.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.983+0000 7f2032ffd640 1 --2- 172.21.15.7:0/3727200887 >> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] conn(0x55b1be117640 0x55b1be118ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:23.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.983+0000 7f2032ffd640 1 --2- 172.21.15.7:0/3727200887 >> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] conn(0x55b1be117640 0x55b1be118ab0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=30b6affc10dd881c server_cookie=7c2b13e6efa4bd62 in_seq=0 out_seq=0 2024-09-19T04:16:23.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.984+0000 7f2012ffd640 10 client.24880 ms_handle_connect on v2:172.21.15.92:6836/319779585 2024-09-19T04:16:23.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.984+0000 7f2012ffd640 1 -- 172.21.15.7:0/3727200887 <== mds.2 v2:172.21.15.92:6836/319779585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b1be06f600 con 0x55b1be117640 2024-09-19T04:16:23.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.984+0000 7f2012ffd640 10 client.24880 handle_command_reply: tid=0 2024-09-19T04:16:23.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.984+0000 7f203c219740 1 client.24880 shutdown 2024-09-19T04:16:23.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.985+0000 7f203c219740 1 -- 172.21.15.7:0/3727200887 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1be0fc2f0 msgr2=0x55b1be103740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:23.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.985+0000 7f203c219740 1 --2- 172.21.15.7:0/3727200887 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1be0fc2f0 0x55b1be103740 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f202402a9a0 tx=0x7f2024005250 comp rx=0 tx=0).stop 2024-09-19T04:16:23.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.985+0000 7f203c219740 1 -- 172.21.15.7:0/3727200887 shutdown_connections 2024-09-19T04:16:23.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.985+0000 7f203c219740 1 --2- 172.21.15.7:0/3727200887 >> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] conn(0x55b1be117640 0x55b1be118ab0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:23.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.985+0000 7f203c219740 1 --2- 172.21.15.7:0/3727200887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1be106bb0 0x55b1be103c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:23.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.985+0000 7f203c219740 1 --2- 172.21.15.7:0/3727200887 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1be0fc2f0 0x55b1be103740 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:23.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.985+0000 7f2012ffd640 0 client.24880 ms_handle_reset on v2:172.21.15.92:6836/319779585 2024-09-19T04:16:23.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.985+0000 7f203c219740 1 --2- 172.21.15.7:0/3727200887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1be0fb9d0 0x55b1be1063f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:23.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.985+0000 7f203c219740 1 -- 172.21.15.7:0/3727200887 >> 172.21.15.7:0/3727200887 conn(0x55b1be0f7f60 msgr2=0x55b1be0fdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:23.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.985+0000 7f203c219740 1 -- 172.21.15.7:0/3727200887 shutdown_connections 2024-09-19T04:16:23.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.985+0000 7f203c219740 1 -- 172.21.15.7:0/3727200887 wait complete. 2024-09-19T04:16:23.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:23.985+0000 7f203c219740 20 client.24880 trim_cache size 0 max 16384 2024-09-19T04:16:24.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.003+0000 7f203c219740 1 Processor -- start 2024-09-19T04:16:24.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.003+0000 7f203c219740 1 -- start start 2024-09-19T04:16:24.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.003+0000 7f203c219740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1be0fb9d0 0x55b1be118ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:24.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.003+0000 7f203c219740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1be0fc2f0 0x55b1be0fe610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:24.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.003+0000 7f203c219740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1be106bb0 0x55b1be0feb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:24.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.003+0000 7f203c219740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b1be116df0 con 0x55b1be0fc2f0 2024-09-19T04:16:24.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.003+0000 7f203c219740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b1be1174c0 con 0x55b1be106bb0 2024-09-19T04:16:24.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.003+0000 7f203c219740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b1be117b90 con 0x55b1be0fb9d0 2024-09-19T04:16:24.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.003+0000 7f20337fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1be0fc2f0 0x55b1be0fe610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:24.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.003+0000 7f20337fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1be0fc2f0 0x55b1be0fe610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34770/0 (socket says 172.21.15.7:34770) 2024-09-19T04:16:24.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.003+0000 7f20337fe640 1 -- 172.21.15.7:0/1135533783 learned_addr learned my addr 172.21.15.7:0/1135533783 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:24.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.003+0000 7f2032ffd640 1 --2- 172.21.15.7:0/1135533783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1be0fb9d0 0x55b1be118ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:24.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.003+0000 7f20337fe640 1 -- 172.21.15.7:0/1135533783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1be0fb9d0 msgr2=0x55b1be118ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:24.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.003+0000 7f20337fe640 1 --2- 172.21.15.7:0/1135533783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1be0fb9d0 0x55b1be118ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:24.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.003+0000 7f20337fe640 1 -- 172.21.15.7:0/1135533783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1be106bb0 msgr2=0x55b1be0feb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:24.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.003+0000 7f20337fe640 1 --2- 172.21.15.7:0/1135533783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1be106bb0 0x55b1be0feb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:24.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.003+0000 7f20337fe640 1 -- 172.21.15.7:0/1135533783 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1be109890 con 0x55b1be0fc2f0 2024-09-19T04:16:24.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.003+0000 7f2032ffd640 1 --2- 172.21.15.7:0/1135533783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1be0fb9d0 0x55b1be118ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:16:24.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.004+0000 7f20337fe640 1 --2- 172.21.15.7:0/1135533783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1be0fc2f0 0x55b1be0fe610 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f202402a4c0 tx=0x7f2024031910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=993aecd7f23d6728 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:24.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.004+0000 7f20197fa640 1 -- 172.21.15.7:0/1135533783 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2024035070 con 0x55b1be0fc2f0 2024-09-19T04:16:24.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.004+0000 7f20197fa640 1 -- 172.21.15.7:0/1135533783 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2024040070 con 0x55b1be0fc2f0 2024-09-19T04:16:24.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.004+0000 7f20197fa640 1 -- 172.21.15.7:0/1135533783 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2024031db0 con 0x55b1be0fc2f0 2024-09-19T04:16:24.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.004+0000 7f203c219740 1 -- 172.21.15.7:0/1135533783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1be0fc2f0 msgr2=0x55b1be0fe610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:24.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.004+0000 7f203c219740 1 --2- 172.21.15.7:0/1135533783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1be0fc2f0 0x55b1be0fe610 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f202402a4c0 tx=0x7f2024031910 comp rx=0 tx=0).stop 2024-09-19T04:16:24.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.004+0000 7f203c219740 1 -- 172.21.15.7:0/1135533783 shutdown_connections 2024-09-19T04:16:24.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.004+0000 7f203c219740 1 --2- 172.21.15.7:0/1135533783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1be106bb0 0x55b1be0feb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:24.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.004+0000 7f203c219740 1 --2- 172.21.15.7:0/1135533783 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1be0fc2f0 0x55b1be0fe610 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:24.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.004+0000 7f203c219740 1 --2- 172.21.15.7:0/1135533783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1be0fb9d0 0x55b1be118ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:24.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.004+0000 7f203c219740 1 -- 172.21.15.7:0/1135533783 >> 172.21.15.7:0/1135533783 conn(0x55b1be0f7f60 msgr2=0x55b1be102010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:24.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.005+0000 7f203c219740 1 -- 172.21.15.7:0/1135533783 shutdown_connections 2024-09-19T04:16:24.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.005+0000 7f203c219740 1 -- 172.21.15.7:0/1135533783 wait complete. 2024-09-19T04:16:24.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.005+0000 7f203c219740 1 -- start start 2024-09-19T04:16:24.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.005+0000 7f203c219740 1 Processor -- start 2024-09-19T04:16:24.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.005+0000 7f203c219740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1be0fb9d0 0x55b1be11a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:24.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.005+0000 7f203c219740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1be0fc2f0 0x55b1be11a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:24.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.005+0000 7f203c219740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1be106bb0 0x55b1be17fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:24.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.005+0000 7f203c219740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b1be118930 con 0x55b1be0fb9d0 2024-09-19T04:16:24.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.005+0000 7f203c219740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b1be118260 con 0x55b1be0fc2f0 2024-09-19T04:16:24.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.005+0000 7f203c219740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b1be119000 con 0x55b1be106bb0 2024-09-19T04:16:24.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.005+0000 7f203c219740 10 client.0 _ll_register_callbacks cb 0x7f2024009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:16:24.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.006+0000 7f2032ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1be0fb9d0 0x55b1be11a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:24.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.006+0000 7f2032ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1be0fb9d0 0x55b1be11a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34774/0 (socket says 172.21.15.7:34774) 2024-09-19T04:16:24.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.006+0000 7f20337fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1be0fc2f0 0x55b1be11a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:24.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.006+0000 7f2032ffd640 1 -- 172.21.15.7:0/3078263224 learned_addr learned my addr 172.21.15.7:0/3078263224 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:24.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.006+0000 7f2032ffd640 1 --2- 172.21.15.7:0/3078263224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1be106bb0 0x55b1be17fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:24.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.006+0000 7f2032ffd640 1 -- 172.21.15.7:0/3078263224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1be106bb0 msgr2=0x55b1be17fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:24.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.006+0000 7f2032ffd640 1 --2- 172.21.15.7:0/3078263224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1be106bb0 0x55b1be17fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:24.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.006+0000 7f2032ffd640 1 -- 172.21.15.7:0/3078263224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1be0fc2f0 msgr2=0x55b1be11a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:24.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.006+0000 7f2032ffd640 1 --2- 172.21.15.7:0/3078263224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1be0fc2f0 0x55b1be11a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:24.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.006+0000 7f2032ffd640 1 -- 172.21.15.7:0/3078263224 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1be1802b0 con 0x55b1be0fb9d0 2024-09-19T04:16:24.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.006+0000 7f2032ffd640 1 --2- 172.21.15.7:0/3078263224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1be0fb9d0 0x55b1be11a430 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2028004d80 tx=0x7f2028004c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd56ae63565eeeb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:24.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.006+0000 7f2012ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:16:24.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.006+0000 7f2012ffd640 1 -- 172.21.15.7:0/3078263224 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2028030060 con 0x55b1be0fb9d0 2024-09-19T04:16:24.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.006+0000 7f2012ffd640 1 -- 172.21.15.7:0/3078263224 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f2028003af0 con 0x55b1be0fb9d0 2024-09-19T04:16:24.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.006+0000 7f203c219740 1 -- 172.21.15.7:0/3078263224 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2024040070 con 0x55b1be0fb9d0 2024-09-19T04:16:24.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.007+0000 7f2012ffd640 1 -- 172.21.15.7:0/3078263224 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2028037050 con 0x55b1be0fb9d0 2024-09-19T04:16:24.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.007+0000 7f203c219740 10 client.15090 fetch_fsmap learned FSMap version 27 2024-09-19T04:16:24.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.007+0000 7f203c219740 1 -- 172.21.15.7:0/3078263224 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b1be181610 con 0x55b1be0fb9d0 2024-09-19T04:16:24.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.007+0000 7f2012ffd640 1 -- 172.21.15.7:0/3078263224 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2024040070 con 0x55b1be0fb9d0 2024-09-19T04:16:24.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.007+0000 7f2012ffd640 1 -- 172.21.15.7:0/3078263224 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f202802b410 con 0x55b1be0fb9d0 2024-09-19T04:16:24.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.007+0000 7f203c219740 10 client.15090 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:16:24.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.007+0000 7f203c219740 10 client.15090 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T04:16:24.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.007+0000 7f203c219740 20 client.15090 populate_metadata read hostname 'smithi007' 2024-09-19T04:16:24.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.007+0000 7f203c219740 1 --2- 172.21.15.7:0/3078263224 >> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] conn(0x55b1be186080 0x55b1be184d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:24.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.007+0000 7f203c219740 4 client.15090 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T04:16:24.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.007+0000 7f203c219740 1 -- 172.21.15.7:0/3078263224 --> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] -- command(tid 0: {"prefix": "status"}) -- 0x55b1be069b10 con 0x55b1be186080 2024-09-19T04:16:24.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.007+0000 7f20337fe640 1 --2- 172.21.15.7:0/3078263224 >> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] conn(0x55b1be186080 0x55b1be184d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:24.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.008+0000 7f20337fe640 1 --2- 172.21.15.7:0/3078263224 >> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] conn(0x55b1be186080 0x55b1be184d90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=946e0ef23978cd65 server_cookie=70f4a42556b85f73 in_seq=0 out_seq=0 2024-09-19T04:16:24.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.008+0000 7f2012ffd640 10 client.15090 ms_handle_connect on v2:172.21.15.92:6836/319779585 2024-09-19T04:16:24.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.008+0000 7f2012ffd640 1 -- 172.21.15.7:0/3078263224 <== mds.2 v2:172.21.15.92:6836/319779585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b1be069b10 con 0x55b1be186080 2024-09-19T04:16:24.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.008+0000 7f2012ffd640 10 client.15090 handle_command_reply: tid=0 2024-09-19T04:16:24.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.008+0000 7f203c219740 1 client.15090 shutdown 2024-09-19T04:16:24.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.008+0000 7f203c219740 1 -- 172.21.15.7:0/3078263224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1be0fb9d0 msgr2=0x55b1be11a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:24.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.008+0000 7f203c219740 1 --2- 172.21.15.7:0/3078263224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1be0fb9d0 0x55b1be11a430 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2028004d80 tx=0x7f2028004c10 comp rx=0 tx=0).stop 2024-09-19T04:16:24.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.008+0000 7f203c219740 1 -- 172.21.15.7:0/3078263224 shutdown_connections 2024-09-19T04:16:24.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.008+0000 7f203c219740 1 --2- 172.21.15.7:0/3078263224 >> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] conn(0x55b1be186080 0x55b1be184d90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:24.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.008+0000 7f203c219740 1 --2- 172.21.15.7:0/3078263224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1be106bb0 0x55b1be17fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:24.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.008+0000 7f203c219740 1 --2- 172.21.15.7:0/3078263224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1be0fc2f0 0x55b1be11a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:24.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.008+0000 7f2012ffd640 0 client.15090 ms_handle_reset on v2:172.21.15.92:6836/319779585 2024-09-19T04:16:24.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.008+0000 7f203c219740 1 --2- 172.21.15.7:0/3078263224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1be0fb9d0 0x55b1be11a430 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:24.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.008+0000 7f203c219740 1 -- 172.21.15.7:0/3078263224 >> 172.21.15.7:0/3078263224 conn(0x55b1be0f7f60 msgr2=0x55b1be102430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:24.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.008+0000 7f203c219740 1 -- 172.21.15.7:0/3078263224 shutdown_connections 2024-09-19T04:16:24.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.008+0000 7f203c219740 1 -- 172.21.15.7:0/3078263224 wait complete. 2024-09-19T04:16:24.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.008+0000 7f203c219740 20 client.15090 trim_cache size 0 max 16384 2024-09-19T04:16:24.015 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:16:24.015 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "77957c0a-763c-11ef-bceb-c7b262605968", 2024-09-19T04:16:24.015 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 2, 2024-09-19T04:16:24.016 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24482, 2024-09-19T04:16:24.016 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-19T04:16:24.016 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-19T04:16:24.016 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-19T04:16:24.016 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 69.210008513999995, 2024-09-19T04:16:24.016 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 27, 2024-09-19T04:16:24.016 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 88, 2024-09-19T04:16:24.016 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 86, 2024-09-19T04:16:24.016 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 132.00388753300001 2024-09-19T04:16:24.017 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:16:24.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.009+0000 7f2039e40640 1 -- 172.21.15.7:0/1358916608 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f201c0a32d0 msgr2=0x7f201c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:24.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.009+0000 7f2039e40640 1 --2- 172.21.15.7:0/1358916608 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f201c0a32d0 0x7f201c0a5790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f202c00efd0 tx=0x7f202c0916c0 comp rx=0 tx=0).stop 2024-09-19T04:16:24.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.009+0000 7f2039e40640 1 -- 172.21.15.7:0/1358916608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2034102ef0 msgr2=0x7f203419cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:24.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.009+0000 7f2039e40640 1 --2- 172.21.15.7:0/1358916608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2034102ef0 0x7f203419cdf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f202c00eaa0 tx=0x7f202c00ef60 comp rx=0 tx=0).stop 2024-09-19T04:16:24.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.009+0000 7f2039e40640 1 -- 172.21.15.7:0/1358916608 shutdown_connections 2024-09-19T04:16:24.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.009+0000 7f2039e40640 1 --2- 172.21.15.7:0/1358916608 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f201c0a32d0 0x7f201c0a5790 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:24.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.009+0000 7f2039e40640 1 --2- 172.21.15.7:0/1358916608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2034102ef0 0x7f203419cdf0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:24.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.009+0000 7f2039e40640 1 --2- 172.21.15.7:0/1358916608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2034102570 0x7f2034198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:24.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.009+0000 7f2039e40640 1 --2- 172.21.15.7:0/1358916608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2034100e20 0x7f2034198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:24.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.009+0000 7f2039e40640 1 -- 172.21.15.7:0/1358916608 >> 172.21.15.7:0/1358916608 conn(0x7f20340fc7d0 msgr2=0x7f203406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:24.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.009+0000 7f2039e40640 1 -- 172.21.15.7:0/1358916608 shutdown_connections 2024-09-19T04:16:24.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:24.009+0000 7f2039e40640 1 -- 172.21.15.7:0/1358916608 wait complete. 2024-09-19T04:16:24.917 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T04:16:25.182 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:25.299 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:25 smithi007 ceph-mon[31360]: pgmap v337: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T04:16:25.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:25 smithi102 ceph-mon[35446]: pgmap v337: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T04:16:25.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:25 smithi092 ceph-mon[34940]: pgmap v337: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T04:16:25.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.651+0000 7ff829ace640 1 -- 172.21.15.7:0/3239139099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff824100e20 msgr2=0x7ff824101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:25.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.651+0000 7ff829ace640 1 --2- 172.21.15.7:0/3239139099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff824100e20 0x7ff824101200 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff814009900 tx=0x7ff81402a480 comp rx=0 tx=0).stop 2024-09-19T04:16:25.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.651+0000 7ff829ace640 1 -- 172.21.15.7:0/3239139099 shutdown_connections 2024-09-19T04:16:25.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.651+0000 7ff829ace640 1 --2- 172.21.15.7:0/3239139099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff824102ef0 0x7ff82410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.651+0000 7ff829ace640 1 --2- 172.21.15.7:0/3239139099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff824102570 0x7ff8241029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.651+0000 7ff829ace640 1 --2- 172.21.15.7:0/3239139099 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff824100e20 0x7ff824101200 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.651+0000 7ff829ace640 1 -- 172.21.15.7:0/3239139099 >> 172.21.15.7:0/3239139099 conn(0x7ff8240fc7d0 msgr2=0x7ff8240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:25.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.651+0000 7ff829ace640 1 -- 172.21.15.7:0/3239139099 shutdown_connections 2024-09-19T04:16:25.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.651+0000 7ff829ace640 1 -- 172.21.15.7:0/3239139099 wait complete. 2024-09-19T04:16:25.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.651+0000 7ff829ace640 1 Processor -- start 2024-09-19T04:16:25.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.651+0000 7ff829ace640 1 -- start start 2024-09-19T04:16:25.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.652+0000 7ff829ace640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff824100e20 0x7ff824197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:25.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.652+0000 7ff829ace640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff824102570 0x7ff824197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:25.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.652+0000 7ff829ace640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff824102ef0 0x7ff82419bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:25.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.652+0000 7ff829ace640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff824110fc0 con 0x7ff824102570 2024-09-19T04:16:25.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.652+0000 7ff829ace640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff824110e40 con 0x7ff824100e20 2024-09-19T04:16:25.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.652+0000 7ff829ace640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff824111140 con 0x7ff824102ef0 2024-09-19T04:16:25.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.652+0000 7ff822ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff824102570 0x7ff824197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:25.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.652+0000 7ff822ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff824102570 0x7ff824197970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34796/0 (socket says 172.21.15.7:34796) 2024-09-19T04:16:25.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.652+0000 7ff822ffd640 1 -- 172.21.15.7:0/2577720836 learned_addr learned my addr 172.21.15.7:0/2577720836 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:25.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.652+0000 7ff823fff640 1 --2- 172.21.15.7:0/2577720836 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff824102ef0 0x7ff82419bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:25.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.652+0000 7ff8237fe640 1 --2- 172.21.15.7:0/2577720836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff824100e20 0x7ff824197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:25.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.652+0000 7ff822ffd640 1 -- 172.21.15.7:0/2577720836 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff824102ef0 msgr2=0x7ff82419bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:25.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.652+0000 7ff822ffd640 1 --2- 172.21.15.7:0/2577720836 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff824102ef0 0x7ff82419bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.652+0000 7ff822ffd640 1 -- 172.21.15.7:0/2577720836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff824100e20 msgr2=0x7ff824197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:25.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.652+0000 7ff822ffd640 1 --2- 172.21.15.7:0/2577720836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff824100e20 0x7ff824197430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.652+0000 7ff822ffd640 1 -- 172.21.15.7:0/2577720836 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff82419c3e0 con 0x7ff824102570 2024-09-19T04:16:25.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.652+0000 7ff8237fe640 1 --2- 172.21.15.7:0/2577720836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff824100e20 0x7ff824197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:16:25.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.652+0000 7ff822ffd640 1 --2- 172.21.15.7:0/2577720836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff824102570 0x7ff824197970 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff81800c970 tx=0x7ff81800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:25.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.653+0000 7ff820ff9640 1 -- 172.21.15.7:0/2577720836 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff818007bb0 con 0x7ff824102570 2024-09-19T04:16:25.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.653+0000 7ff829ace640 1 -- 172.21.15.7:0/2577720836 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff82419c6d0 con 0x7ff824102570 2024-09-19T04:16:25.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.653+0000 7ff820ff9640 1 -- 172.21.15.7:0/2577720836 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff818007d50 con 0x7ff824102570 2024-09-19T04:16:25.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.653+0000 7ff820ff9640 1 -- 172.21.15.7:0/2577720836 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff81800f450 con 0x7ff824102570 2024-09-19T04:16:25.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.653+0000 7ff829ace640 1 -- 172.21.15.7:0/2577720836 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8241a3fb0 con 0x7ff824102570 2024-09-19T04:16:25.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.655+0000 7ff820ff9640 1 -- 172.21.15.7:0/2577720836 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7ff818005020 con 0x7ff824102570 2024-09-19T04:16:25.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.655+0000 7ff82bea7740 1 Processor -- start 2024-09-19T04:16:25.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.655+0000 7ff82bea7740 1 -- start start 2024-09-19T04:16:25.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.656+0000 7ff82bea7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559389b0b850 0x559389b0bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:25.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.656+0000 7ff82bea7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559389b0c170 0x559389b18880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:25.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.656+0000 7ff82bea7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559389b18dc0 0x559389b1b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:25.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.656+0000 7ff82bea7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559389a72090 con 0x559389b0c170 2024-09-19T04:16:25.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.656+0000 7ff82bea7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559389a19a70 con 0x559389b18dc0 2024-09-19T04:16:25.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.656+0000 7ff82bea7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559389a6e050 con 0x559389b0b850 2024-09-19T04:16:25.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.656+0000 7ff8237fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559389b0c170 0x559389b18880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:25.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.656+0000 7ff8237fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559389b0c170 0x559389b18880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34800/0 (socket says 172.21.15.7:34800) 2024-09-19T04:16:25.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.656+0000 7ff8237fe640 1 -- 172.21.15.7:0/2177379429 learned_addr learned my addr 172.21.15.7:0/2177379429 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:25.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.656+0000 7ff820ff9640 1 --2- 172.21.15.7:0/2577720836 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff80c0a32d0 0x7ff80c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:25.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.656+0000 7ff823fff640 1 --2- 172.21.15.7:0/2177379429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559389b0b850 0x559389b0bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:25.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.656+0000 7ff822ffd640 1 --2- 172.21.15.7:0/2177379429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559389b18dc0 0x559389b1b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:25.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.656+0000 7ff823fff640 1 --2- 172.21.15.7:0/2577720836 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff80c0a32d0 0x7ff80c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:25.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.656+0000 7ff8237fe640 1 -- 172.21.15.7:0/2177379429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559389b0b850 msgr2=0x559389b0bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:25.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.656+0000 7ff8237fe640 1 --2- 172.21.15.7:0/2177379429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559389b0b850 0x559389b0bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.656+0000 7ff820ff9640 1 -- 172.21.15.7:0/2577720836 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7ff8180cfc20 con 0x7ff824102570 2024-09-19T04:16:25.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.656+0000 7ff8237fe640 1 -- 172.21.15.7:0/2177379429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559389b18dc0 msgr2=0x559389b1b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:25.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.656+0000 7ff8237fe640 1 --2- 172.21.15.7:0/2177379429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559389b18dc0 0x559389b1b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.656+0000 7ff8237fe640 1 -- 172.21.15.7:0/2177379429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559389a26130 con 0x559389b0c170 2024-09-19T04:16:25.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.656+0000 7ff822ffd640 1 --2- 172.21.15.7:0/2177379429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559389b18dc0 0x559389b1b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:16:25.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.656+0000 7ff8237fe640 1 --2- 172.21.15.7:0/2177379429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559389b0c170 0x559389b18880 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff8140314e0 tx=0x7ff814004200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f9c9807a54c9f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:25.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.657+0000 7ff823fff640 1 --2- 172.21.15.7:0/2577720836 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff80c0a32d0 0x7ff80c0a5790 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff81c009fd0 tx=0x7ff81c004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:25.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.657+0000 7ff809ffb640 1 -- 172.21.15.7:0/2177379429 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff814035030 con 0x559389b0c170 2024-09-19T04:16:25.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.657+0000 7ff809ffb640 1 -- 172.21.15.7:0/2177379429 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff814003ad0 con 0x559389b0c170 2024-09-19T04:16:25.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.657+0000 7ff809ffb640 1 -- 172.21.15.7:0/2177379429 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff814031c70 con 0x559389b0c170 2024-09-19T04:16:25.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.657+0000 7ff82bea7740 1 -- 172.21.15.7:0/2177379429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559389b0c170 msgr2=0x559389b18880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:25.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.657+0000 7ff82bea7740 1 --2- 172.21.15.7:0/2177379429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559389b0c170 0x559389b18880 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff8140314e0 tx=0x7ff814004200 comp rx=0 tx=0).stop 2024-09-19T04:16:25.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.657+0000 7ff82bea7740 1 -- 172.21.15.7:0/2177379429 shutdown_connections 2024-09-19T04:16:25.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.657+0000 7ff82bea7740 1 --2- 172.21.15.7:0/2177379429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559389b18dc0 0x559389b1b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.657+0000 7ff82bea7740 1 --2- 172.21.15.7:0/2177379429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559389b0c170 0x559389b18880 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.657+0000 7ff82bea7740 1 --2- 172.21.15.7:0/2177379429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559389b0b850 0x559389b0bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.657+0000 7ff82bea7740 1 -- 172.21.15.7:0/2177379429 >> 172.21.15.7:0/2177379429 conn(0x559389b07f60 msgr2=0x559389b08340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:25.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.657+0000 7ff82bea7740 1 -- 172.21.15.7:0/2177379429 shutdown_connections 2024-09-19T04:16:25.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.657+0000 7ff82bea7740 1 -- 172.21.15.7:0/2177379429 wait complete. 2024-09-19T04:16:25.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.658+0000 7ff82bea7740 1 -- start start 2024-09-19T04:16:25.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.658+0000 7ff82bea7740 1 Processor -- start 2024-09-19T04:16:25.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.658+0000 7ff82bea7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559389b0b850 0x559389b18660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:25.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.658+0000 7ff82bea7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559389b0c170 0x559389b15a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:25.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.658+0000 7ff82bea7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559389b18dc0 0x559389b15f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:25.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.658+0000 7ff82bea7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559389b1b990 con 0x559389b0b850 2024-09-19T04:16:25.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.658+0000 7ff82bea7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559389a2cf20 con 0x559389b0c170 2024-09-19T04:16:25.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.658+0000 7ff82bea7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559389b1bb10 con 0x559389b18dc0 2024-09-19T04:16:25.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.658+0000 7ff82bea7740 10 client.0 _ll_register_callbacks cb 0x5593899f6030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:16:25.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.658+0000 7ff8237fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559389b0b850 0x559389b18660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:25.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.658+0000 7ff8237fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559389b0b850 0x559389b18660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34808/0 (socket says 172.21.15.7:34808) 2024-09-19T04:16:25.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.658+0000 7ff8237fe640 1 -- 172.21.15.7:0/980864325 learned_addr learned my addr 172.21.15.7:0/980864325 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:25.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.659+0000 7ff822ffd640 1 --2- 172.21.15.7:0/980864325 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559389b0c170 0x559389b15a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:25.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.659+0000 7ff8237fe640 1 -- 172.21.15.7:0/980864325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559389b18dc0 msgr2=0x559389b15f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:25.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.659+0000 7ff8237fe640 1 --2- 172.21.15.7:0/980864325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559389b18dc0 0x559389b15f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.659+0000 7ff8237fe640 1 -- 172.21.15.7:0/980864325 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559389b0c170 msgr2=0x559389b15a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:25.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.659+0000 7ff8237fe640 1 --2- 172.21.15.7:0/980864325 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559389b0c170 0x559389b15a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.659+0000 7ff8237fe640 1 -- 172.21.15.7:0/980864325 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593897e32b0 con 0x559389b0b850 2024-09-19T04:16:25.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.659+0000 7ff822ffd640 1 --2- 172.21.15.7:0/980864325 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559389b0c170 0x559389b15a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:16:25.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.659+0000 7ff8237fe640 1 --2- 172.21.15.7:0/980864325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559389b0b850 0x559389b18660 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff81402a4c0 tx=0x7ff8140316c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea9185ac458b0f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:25.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.659+0000 7ff802ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:16:25.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.659+0000 7ff802ffd640 1 -- 172.21.15.7:0/980864325 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff814035070 con 0x559389b0b850 2024-09-19T04:16:25.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.659+0000 7ff802ffd640 1 -- 172.21.15.7:0/980864325 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7ff814003800 con 0x559389b0b850 2024-09-19T04:16:25.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.659+0000 7ff82bea7740 1 -- 172.21.15.7:0/980864325 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff814003ad0 con 0x559389b0b850 2024-09-19T04:16:25.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.659+0000 7ff802ffd640 1 -- 172.21.15.7:0/980864325 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff8140319f0 con 0x559389b0b850 2024-09-19T04:16:25.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.659+0000 7ff82bea7740 10 client.15102 fetch_fsmap learned FSMap version 27 2024-09-19T04:16:25.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.659+0000 7ff82bea7740 1 -- 172.21.15.7:0/980864325 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559389b272b0 con 0x559389b0b850 2024-09-19T04:16:25.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.660+0000 7ff802ffd640 1 -- 172.21.15.7:0/980864325 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff814003ad0 con 0x559389b0b850 2024-09-19T04:16:25.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.660+0000 7ff802ffd640 1 -- 172.21.15.7:0/980864325 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7ff81403cbe0 con 0x559389b0b850 2024-09-19T04:16:25.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.660+0000 7ff82bea7740 10 client.15102 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:16:25.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.660+0000 7ff82bea7740 10 client.15102 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T04:16:25.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.660+0000 7ff82bea7740 20 client.15102 populate_metadata read hostname 'smithi007' 2024-09-19T04:16:25.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.660+0000 7ff82bea7740 1 --2- 172.21.15.7:0/980864325 >> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] conn(0x559389b29420 0x559389b2a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:25.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.660+0000 7ff82bea7740 4 client.15102 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:16:25.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.660+0000 7ff82bea7740 1 -- 172.21.15.7:0/980864325 --> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559389a7f600 con 0x559389b29420 2024-09-19T04:16:25.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.661+0000 7ff822ffd640 1 --2- 172.21.15.7:0/980864325 >> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] conn(0x559389b29420 0x559389b2a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:25.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.661+0000 7ff822ffd640 1 --2- 172.21.15.7:0/980864325 >> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] conn(0x559389b29420 0x559389b2a890 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fd2a8cddf46627fe server_cookie=e4eba0753f3bfdc5 in_seq=0 out_seq=0 2024-09-19T04:16:25.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.661+0000 7ff802ffd640 10 client.15102 ms_handle_connect on v2:172.21.15.102:6838/2728093829 2024-09-19T04:16:25.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.662+0000 7ff802ffd640 1 -- 172.21.15.7:0/980864325 <== mds.1 v2:172.21.15.102:6838/2728093829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559389a7f600 con 0x559389b29420 2024-09-19T04:16:25.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.662+0000 7ff802ffd640 10 client.15102 handle_command_reply: tid=0 2024-09-19T04:16:25.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.662+0000 7ff82bea7740 1 client.15102 shutdown 2024-09-19T04:16:25.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.662+0000 7ff82bea7740 1 -- 172.21.15.7:0/980864325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559389b0b850 msgr2=0x559389b18660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:25.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.662+0000 7ff82bea7740 1 --2- 172.21.15.7:0/980864325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559389b0b850 0x559389b18660 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff81402a4c0 tx=0x7ff8140316c0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.662+0000 7ff82bea7740 1 -- 172.21.15.7:0/980864325 shutdown_connections 2024-09-19T04:16:25.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.662+0000 7ff82bea7740 1 --2- 172.21.15.7:0/980864325 >> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] conn(0x559389b29420 0x559389b2a890 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.662+0000 7ff82bea7740 1 --2- 172.21.15.7:0/980864325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559389b18dc0 0x559389b15f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.662+0000 7ff82bea7740 1 --2- 172.21.15.7:0/980864325 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559389b0c170 0x559389b15a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.662+0000 7ff82bea7740 1 --2- 172.21.15.7:0/980864325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559389b0b850 0x559389b18660 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.662+0000 7ff802ffd640 0 client.15102 ms_handle_reset on v2:172.21.15.102:6838/2728093829 2024-09-19T04:16:25.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.662+0000 7ff82bea7740 1 -- 172.21.15.7:0/980864325 >> 172.21.15.7:0/980864325 conn(0x559389b07f60 msgr2=0x559389b0dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:25.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.662+0000 7ff82bea7740 1 -- 172.21.15.7:0/980864325 shutdown_connections 2024-09-19T04:16:25.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.662+0000 7ff82bea7740 1 -- 172.21.15.7:0/980864325 wait complete. 2024-09-19T04:16:25.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.663+0000 7ff82bea7740 20 client.15102 trim_cache size 0 max 16384 2024-09-19T04:16:25.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.680+0000 7ff82bea7740 1 Processor -- start 2024-09-19T04:16:25.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.680+0000 7ff82bea7740 1 -- start start 2024-09-19T04:16:25.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.681+0000 7ff82bea7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559389b0b850 0x559389b29af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:25.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.681+0000 7ff82bea7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559389b0c170 0x559389b0ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:25.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.681+0000 7ff82bea7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559389b18dc0 0x559389b02ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:25.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.681+0000 7ff82bea7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559389b28bd0 con 0x559389b0b850 2024-09-19T04:16:25.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.681+0000 7ff82bea7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559389b292a0 con 0x559389b18dc0 2024-09-19T04:16:25.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.681+0000 7ff82bea7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559389b29970 con 0x559389b0c170 2024-09-19T04:16:25.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.681+0000 7ff8237fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559389b0b850 0x559389b29af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:25.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.681+0000 7ff8237fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559389b0b850 0x559389b29af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34820/0 (socket says 172.21.15.7:34820) 2024-09-19T04:16:25.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.681+0000 7ff8237fe640 1 -- 172.21.15.7:0/1691372840 learned_addr learned my addr 172.21.15.7:0/1691372840 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:25.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.681+0000 7ff822ffd640 1 --2- 172.21.15.7:0/1691372840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559389b0c170 0x559389b0ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:25.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.681+0000 7ff823fff640 1 --2- 172.21.15.7:0/1691372840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559389b18dc0 0x559389b02ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:25.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.681+0000 7ff8237fe640 1 -- 172.21.15.7:0/1691372840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559389b0c170 msgr2=0x559389b0ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:25.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.681+0000 7ff8237fe640 1 --2- 172.21.15.7:0/1691372840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559389b0c170 0x559389b0ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.681+0000 7ff8237fe640 1 -- 172.21.15.7:0/1691372840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559389b18dc0 msgr2=0x559389b02ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:25.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.681+0000 7ff8237fe640 1 --2- 172.21.15.7:0/1691372840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559389b18dc0 0x559389b02ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.681+0000 7ff8237fe640 1 -- 172.21.15.7:0/1691372840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559389b0c7e0 con 0x559389b0b850 2024-09-19T04:16:25.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.681+0000 7ff823fff640 1 --2- 172.21.15.7:0/1691372840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559389b18dc0 0x559389b02ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:16:25.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.681+0000 7ff8237fe640 1 --2- 172.21.15.7:0/1691372840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559389b0b850 0x559389b29af0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff814009900 tx=0x7ff8140058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c6494c50d4af11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:25.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.681+0000 7ff8097fa640 1 -- 172.21.15.7:0/1691372840 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff814035040 con 0x559389b0b850 2024-09-19T04:16:25.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.681+0000 7ff8097fa640 1 -- 172.21.15.7:0/1691372840 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8140040d0 con 0x559389b0b850 2024-09-19T04:16:25.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.681+0000 7ff8097fa640 1 -- 172.21.15.7:0/1691372840 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff814050880 con 0x559389b0b850 2024-09-19T04:16:25.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.682+0000 7ff82bea7740 1 -- 172.21.15.7:0/1691372840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559389b0b850 msgr2=0x559389b29af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:25.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.682+0000 7ff82bea7740 1 --2- 172.21.15.7:0/1691372840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559389b0b850 0x559389b29af0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff814009900 tx=0x7ff8140058b0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.682+0000 7ff82bea7740 1 -- 172.21.15.7:0/1691372840 shutdown_connections 2024-09-19T04:16:25.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.682+0000 7ff82bea7740 1 --2- 172.21.15.7:0/1691372840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559389b18dc0 0x559389b02ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.682+0000 7ff82bea7740 1 --2- 172.21.15.7:0/1691372840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559389b0c170 0x559389b0ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.682+0000 7ff82bea7740 1 --2- 172.21.15.7:0/1691372840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559389b0b850 0x559389b29af0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.682+0000 7ff82bea7740 1 -- 172.21.15.7:0/1691372840 >> 172.21.15.7:0/1691372840 conn(0x559389b07f60 msgr2=0x559389b0dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:25.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.682+0000 7ff82bea7740 1 -- 172.21.15.7:0/1691372840 shutdown_connections 2024-09-19T04:16:25.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.682+0000 7ff82bea7740 1 -- 172.21.15.7:0/1691372840 wait complete. 2024-09-19T04:16:25.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.682+0000 7ff82bea7740 1 -- start start 2024-09-19T04:16:25.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.683+0000 7ff82bea7740 1 Processor -- start 2024-09-19T04:16:25.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.683+0000 7ff82bea7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559389b0b850 0x559389b32f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:25.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.683+0000 7ff82bea7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559389b0c170 0x559389b33470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:25.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.683+0000 7ff82bea7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559389b18dc0 0x559389b12680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:25.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.683+0000 7ff82bea7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559389b2a710 con 0x559389b0b850 2024-09-19T04:16:25.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.683+0000 7ff82bea7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559389b2a040 con 0x559389b18dc0 2024-09-19T04:16:25.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.683+0000 7ff82bea7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559389b2ade0 con 0x559389b0c170 2024-09-19T04:16:25.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.683+0000 7ff82bea7740 10 client.0 _ll_register_callbacks cb 0x7ff81c0099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:16:25.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.683+0000 7ff8237fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559389b0b850 0x559389b32f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:25.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.683+0000 7ff8237fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559389b0b850 0x559389b32f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34822/0 (socket says 172.21.15.7:34822) 2024-09-19T04:16:25.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.683+0000 7ff8237fe640 1 -- 172.21.15.7:0/400498091 learned_addr learned my addr 172.21.15.7:0/400498091 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:25.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.683+0000 7ff822ffd640 1 --2- 172.21.15.7:0/400498091 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559389b0c170 0x559389b33470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:25.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.683+0000 7ff8237fe640 1 -- 172.21.15.7:0/400498091 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559389b0c170 msgr2=0x559389b33470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:25.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.683+0000 7ff8237fe640 1 --2- 172.21.15.7:0/400498091 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559389b0c170 0x559389b33470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.683+0000 7ff8237fe640 1 -- 172.21.15.7:0/400498091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559389b18dc0 msgr2=0x559389b12680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:25.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.683+0000 7ff823fff640 1 --2- 172.21.15.7:0/400498091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559389b18dc0 0x559389b12680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:25.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.684+0000 7ff8237fe640 1 --2- 172.21.15.7:0/400498091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559389b18dc0 0x559389b12680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.684+0000 7ff8237fe640 1 -- 172.21.15.7:0/400498091 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559389b12e80 con 0x559389b0b850 2024-09-19T04:16:25.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.684+0000 7ff8237fe640 1 --2- 172.21.15.7:0/400498091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559389b0b850 0x559389b32f30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff81402a4c0 tx=0x7ff8140503a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54dcd1b607261e41 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:25.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.684+0000 7ff802ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:16:25.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.684+0000 7ff802ffd640 1 -- 172.21.15.7:0/400498091 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff814035070 con 0x559389b0b850 2024-09-19T04:16:25.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.684+0000 7ff802ffd640 1 -- 172.21.15.7:0/400498091 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7ff814003a10 con 0x559389b0b850 2024-09-19T04:16:25.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.684+0000 7ff82bea7740 1 -- 172.21.15.7:0/400498091 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8140040d0 con 0x559389b0b850 2024-09-19T04:16:25.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.684+0000 7ff802ffd640 1 -- 172.21.15.7:0/400498091 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff81406b050 con 0x559389b0b850 2024-09-19T04:16:25.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.684+0000 7ff82bea7740 10 client.15108 fetch_fsmap learned FSMap version 27 2024-09-19T04:16:25.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.684+0000 7ff82bea7740 1 -- 172.21.15.7:0/400498091 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559389b316c0 con 0x559389b0b850 2024-09-19T04:16:25.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.684+0000 7ff802ffd640 1 -- 172.21.15.7:0/400498091 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8140040d0 con 0x559389b0b850 2024-09-19T04:16:25.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.684+0000 7ff802ffd640 1 -- 172.21.15.7:0/400498091 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7ff814059040 con 0x559389b0b850 2024-09-19T04:16:25.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.685+0000 7ff82bea7740 10 client.15108 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:16:25.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.685+0000 7ff82bea7740 10 client.15108 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T04:16:25.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.685+0000 7ff82bea7740 20 client.15108 populate_metadata read hostname 'smithi007' 2024-09-19T04:16:25.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.685+0000 7ff82bea7740 1 --2- 172.21.15.7:0/400498091 >> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] conn(0x559389b97f40 0x559389b96c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:25.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.685+0000 7ff82bea7740 4 client.15108 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T04:16:25.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.685+0000 7ff82bea7740 1 -- 172.21.15.7:0/400498091 --> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] -- command(tid 0: {"prefix": "status"}) -- 0x559389a79b10 con 0x559389b97f40 2024-09-19T04:16:25.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.685+0000 7ff822ffd640 1 --2- 172.21.15.7:0/400498091 >> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] conn(0x559389b97f40 0x559389b96c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:25.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.685+0000 7ff802ffd640 10 client.15108 ms_handle_connect on v2:172.21.15.102:6838/2728093829 2024-09-19T04:16:25.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.685+0000 7ff822ffd640 1 --2- 172.21.15.7:0/400498091 >> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] conn(0x559389b97f40 0x559389b96c50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=75a5f933f08165f4 server_cookie=70180c30b53212be in_seq=0 out_seq=0 2024-09-19T04:16:25.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.685+0000 7ff802ffd640 1 -- 172.21.15.7:0/400498091 <== mds.1 v2:172.21.15.102:6838/2728093829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x559389a79b10 con 0x559389b97f40 2024-09-19T04:16:25.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.685+0000 7ff802ffd640 10 client.15108 handle_command_reply: tid=0 2024-09-19T04:16:25.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.685+0000 7ff82bea7740 1 client.15108 shutdown 2024-09-19T04:16:25.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.686+0000 7ff82bea7740 1 -- 172.21.15.7:0/400498091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559389b0b850 msgr2=0x559389b32f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:25.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.686+0000 7ff82bea7740 1 --2- 172.21.15.7:0/400498091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559389b0b850 0x559389b32f30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff81402a4c0 tx=0x7ff8140503a0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.686+0000 7ff82bea7740 1 -- 172.21.15.7:0/400498091 shutdown_connections 2024-09-19T04:16:25.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.686+0000 7ff82bea7740 1 --2- 172.21.15.7:0/400498091 >> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] conn(0x559389b97f40 0x559389b96c50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.686+0000 7ff82bea7740 1 --2- 172.21.15.7:0/400498091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559389b18dc0 0x559389b12680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.686+0000 7ff82bea7740 1 --2- 172.21.15.7:0/400498091 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559389b0c170 0x559389b33470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.686+0000 7ff82bea7740 1 --2- 172.21.15.7:0/400498091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559389b0b850 0x559389b32f30 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.686+0000 7ff82bea7740 1 -- 172.21.15.7:0/400498091 >> 172.21.15.7:0/400498091 conn(0x559389b07f60 msgr2=0x559389b0dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:25.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.686+0000 7ff802ffd640 0 client.15108 ms_handle_reset on v2:172.21.15.102:6838/2728093829 2024-09-19T04:16:25.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.686+0000 7ff82bea7740 1 -- 172.21.15.7:0/400498091 shutdown_connections 2024-09-19T04:16:25.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.686+0000 7ff82bea7740 1 -- 172.21.15.7:0/400498091 wait complete. 2024-09-19T04:16:25.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.686+0000 7ff82bea7740 20 client.15108 trim_cache size 0 max 16384 2024-09-19T04:16:25.695 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:16:25.695 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "77957c0a-763c-11ef-bceb-c7b262605968", 2024-09-19T04:16:25.695 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 1, 2024-09-19T04:16:25.695 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24496, 2024-09-19T04:16:25.695 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-19T04:16:25.695 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-19T04:16:25.695 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-19T04:16:25.695 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 71.892918284000004, 2024-09-19T04:16:25.696 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 27, 2024-09-19T04:16:25.696 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 88, 2024-09-19T04:16:25.696 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 86, 2024-09-19T04:16:25.696 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 131.016952304 2024-09-19T04:16:25.696 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:16:25.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.686+0000 7ff829ace640 1 -- 172.21.15.7:0/2577720836 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff80c0a32d0 msgr2=0x7ff80c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:25.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.686+0000 7ff829ace640 1 --2- 172.21.15.7:0/2577720836 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff80c0a32d0 0x7ff80c0a5790 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff81c009fd0 tx=0x7ff81c004a40 comp rx=0 tx=0).stop 2024-09-19T04:16:25.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.686+0000 7ff829ace640 1 -- 172.21.15.7:0/2577720836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff824102570 msgr2=0x7ff824197970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:25.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.686+0000 7ff829ace640 1 --2- 172.21.15.7:0/2577720836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff824102570 0x7ff824197970 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff81800c970 tx=0x7ff81800ce30 comp rx=0 tx=0).stop 2024-09-19T04:16:25.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.687+0000 7ff829ace640 1 -- 172.21.15.7:0/2577720836 shutdown_connections 2024-09-19T04:16:25.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.687+0000 7ff829ace640 1 --2- 172.21.15.7:0/2577720836 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff80c0a32d0 0x7ff80c0a5790 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.687+0000 7ff829ace640 1 --2- 172.21.15.7:0/2577720836 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff824102ef0 0x7ff82419bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.687+0000 7ff829ace640 1 --2- 172.21.15.7:0/2577720836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff824102570 0x7ff824197970 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.687+0000 7ff829ace640 1 --2- 172.21.15.7:0/2577720836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff824100e20 0x7ff824197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:25.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.687+0000 7ff829ace640 1 -- 172.21.15.7:0/2577720836 >> 172.21.15.7:0/2577720836 conn(0x7ff8240fc7d0 msgr2=0x7ff8240fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:25.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.687+0000 7ff829ace640 1 -- 172.21.15.7:0/2577720836 shutdown_connections 2024-09-19T04:16:25.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:25.687+0000 7ff829ace640 1 -- 172.21.15.7:0/2577720836 wait complete. 2024-09-19T04:16:26.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:26 smithi007 ceph-mon[31360]: pgmap v338: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T04:16:26.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:26 smithi102 ceph-mon[35446]: pgmap v338: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T04:16:26.476 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T04:16:26.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:26 smithi092 ceph-mon[34940]: pgmap v338: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T04:16:26.739 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.214+0000 7f2318682640 1 -- 172.21.15.7:0/733702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f231010c150 msgr2=0x7f231010e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.214+0000 7f2318682640 1 --2- 172.21.15.7:0/733702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f231010c150 0x7f231010e5f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2308009ca0 tx=0x7f230802a950 comp rx=0 tx=0).stop 2024-09-19T04:16:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.214+0000 7f2318682640 1 -- 172.21.15.7:0/733702 shutdown_connections 2024-09-19T04:16:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.214+0000 7f2318682640 1 --2- 172.21.15.7:0/733702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f231010c150 0x7f231010e5f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.214+0000 7f2318682640 1 --2- 172.21.15.7:0/733702 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2310103640 0x7f231010bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.214+0000 7f2318682640 1 --2- 172.21.15.7:0/733702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2310102d20 0x7f2310103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.214+0000 7f2318682640 1 -- 172.21.15.7:0/733702 >> 172.21.15.7:0/733702 conn(0x7f23100fc780 msgr2=0x7f23100feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.214+0000 7f2318682640 1 -- 172.21.15.7:0/733702 shutdown_connections 2024-09-19T04:16:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.214+0000 7f2318682640 1 -- 172.21.15.7:0/733702 wait complete. 2024-09-19T04:16:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.215+0000 7f2318682640 1 Processor -- start 2024-09-19T04:16:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.215+0000 7f2318682640 1 -- start start 2024-09-19T04:16:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.215+0000 7f2318682640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2310102d20 0x7f2310100980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.215+0000 7f2318682640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2310103640 0x7f2310100ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.215+0000 7f2318682640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f231010c150 0x7f2310101400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.215+0000 7f2318682640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2310111f10 con 0x7f2310102d20 2024-09-19T04:16:27.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.215+0000 7f2318682640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2310111d90 con 0x7f231010c150 2024-09-19T04:16:27.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.215+0000 7f2318682640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2310112090 con 0x7f2310103640 2024-09-19T04:16:27.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.215+0000 7f231641e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2310102d20 0x7f2310100980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:27.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.215+0000 7f231641e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2310102d20 0x7f2310100980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34854/0 (socket says 172.21.15.7:34854) 2024-09-19T04:16:27.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.215+0000 7f231641e640 1 -- 172.21.15.7:0/1994759907 learned_addr learned my addr 172.21.15.7:0/1994759907 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:27.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.215+0000 7f2316c1f640 1 --2- 172.21.15.7:0/1994759907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f231010c150 0x7f2310101400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:27.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.215+0000 7f2315c1d640 1 --2- 172.21.15.7:0/1994759907 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2310103640 0x7f2310100ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:27.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.216+0000 7f231641e640 1 -- 172.21.15.7:0/1994759907 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2310103640 msgr2=0x7f2310100ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:27.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.216+0000 7f231641e640 1 --2- 172.21.15.7:0/1994759907 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2310103640 0x7f2310100ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.216+0000 7f231641e640 1 -- 172.21.15.7:0/1994759907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f231010c150 msgr2=0x7f2310101400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:27.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.216+0000 7f231641e640 1 --2- 172.21.15.7:0/1994759907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f231010c150 0x7f2310101400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.216+0000 7f231641e640 1 -- 172.21.15.7:0/1994759907 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23101a68b0 con 0x7f2310102d20 2024-09-19T04:16:27.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.216+0000 7f2315c1d640 1 --2- 172.21.15.7:0/1994759907 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2310103640 0x7f2310100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:16:27.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.216+0000 7f231641e640 1 --2- 172.21.15.7:0/1994759907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2310102d20 0x7f2310100980 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f230c00d950 tx=0x7f230c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:27.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.216+0000 7f23077fe640 1 -- 172.21.15.7:0/1994759907 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230c017070 con 0x7f2310102d20 2024-09-19T04:16:27.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.216+0000 7f23077fe640 1 -- 172.21.15.7:0/1994759907 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f230c009c30 con 0x7f2310102d20 2024-09-19T04:16:27.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.216+0000 7f2318682640 1 -- 172.21.15.7:0/1994759907 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23101a6ba0 con 0x7f2310102d20 2024-09-19T04:16:27.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.216+0000 7f23077fe640 1 -- 172.21.15.7:0/1994759907 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230c00f6b0 con 0x7f2310102d20 2024-09-19T04:16:27.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.216+0000 7f2318682640 1 -- 172.21.15.7:0/1994759907 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23101a70e0 con 0x7f2310102d20 2024-09-19T04:16:27.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.218+0000 7f23077fe640 1 -- 172.21.15.7:0/1994759907 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f230c0109d0 con 0x7f2310102d20 2024-09-19T04:16:27.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.219+0000 7f231aa5b740 1 Processor -- start 2024-09-19T04:16:27.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.219+0000 7f231aa5b740 1 -- start start 2024-09-19T04:16:27.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.219+0000 7f231aa5b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572f30d99d0 0x5572f30d9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:27.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.219+0000 7f231aa5b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f30da2f0 0x5572f30e4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:27.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.219+0000 7f231aa5b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572f30e4bb0 0x5572f30e6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:27.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.219+0000 7f231aa5b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5572f3040090 con 0x5572f30e4bb0 2024-09-19T04:16:27.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.219+0000 7f231aa5b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5572f2fe7a70 con 0x5572f30da2f0 2024-09-19T04:16:27.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.219+0000 7f231aa5b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5572f303c050 con 0x5572f30d99d0 2024-09-19T04:16:27.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.219+0000 7f23077fe640 1 --2- 172.21.15.7:0/1994759907 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f22fc0a32d0 0x7f22fc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:27.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.219+0000 7f2315c1d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572f30e4bb0 0x5572f30e6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:27.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.219+0000 7f2315c1d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572f30e4bb0 0x5572f30e6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34860/0 (socket says 172.21.15.7:34860) 2024-09-19T04:16:27.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.219+0000 7f2315c1d640 1 -- 172.21.15.7:0/350260473 learned_addr learned my addr 172.21.15.7:0/350260473 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:27.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.219+0000 7f2316c1f640 1 --2- 172.21.15.7:0/1994759907 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f22fc0a32d0 0x7f22fc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:27.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.220+0000 7f2316c1f640 1 --2- 172.21.15.7:0/350260473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572f30d99d0 0x5572f30d9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:27.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.220+0000 7f23077fe640 1 -- 172.21.15.7:0/1994759907 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f230c0cfae0 con 0x7f2310102d20 2024-09-19T04:16:27.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.220+0000 7f231641e640 1 --2- 172.21.15.7:0/350260473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f30da2f0 0x5572f30e4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:27.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.220+0000 7f2315c1d640 1 -- 172.21.15.7:0/350260473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572f30d99d0 msgr2=0x5572f30d9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:27.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.220+0000 7f2315c1d640 1 --2- 172.21.15.7:0/350260473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572f30d99d0 0x5572f30d9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.220+0000 7f2315c1d640 1 -- 172.21.15.7:0/350260473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f30da2f0 msgr2=0x5572f30e4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:27.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.220+0000 7f2315c1d640 1 --2- 172.21.15.7:0/350260473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f30da2f0 0x5572f30e4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.220+0000 7f2315c1d640 1 -- 172.21.15.7:0/350260473 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572f2ff4130 con 0x5572f30e4bb0 2024-09-19T04:16:27.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.220+0000 7f2316c1f640 1 --2- 172.21.15.7:0/1994759907 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f22fc0a32d0 0x7f22fc0a5790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2308005e30 tx=0x7f2308005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:27.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.220+0000 7f2315c1d640 1 --2- 172.21.15.7:0/350260473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572f30e4bb0 0x5572f30e6fa0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2300009c10 tx=0x7f230000e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=776d715786a7606 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:27.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.220+0000 7f2304ff9640 1 -- 172.21.15.7:0/350260473 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2300016070 con 0x5572f30e4bb0 2024-09-19T04:16:27.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.220+0000 7f2304ff9640 1 -- 172.21.15.7:0/350260473 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2300011950 con 0x5572f30e4bb0 2024-09-19T04:16:27.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.220+0000 7f2304ff9640 1 -- 172.21.15.7:0/350260473 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2300010890 con 0x5572f30e4bb0 2024-09-19T04:16:27.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.221+0000 7f231aa5b740 1 -- 172.21.15.7:0/350260473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572f30e4bb0 msgr2=0x5572f30e6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:27.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.221+0000 7f231aa5b740 1 --2- 172.21.15.7:0/350260473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572f30e4bb0 0x5572f30e6fa0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2300009c10 tx=0x7f230000e6c0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.221+0000 7f231aa5b740 1 -- 172.21.15.7:0/350260473 shutdown_connections 2024-09-19T04:16:27.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.221+0000 7f231aa5b740 1 --2- 172.21.15.7:0/350260473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572f30e4bb0 0x5572f30e6fa0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.221+0000 7f231aa5b740 1 --2- 172.21.15.7:0/350260473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f30da2f0 0x5572f30e4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.221+0000 7f231aa5b740 1 --2- 172.21.15.7:0/350260473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572f30d99d0 0x5572f30d9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.221+0000 7f231aa5b740 1 -- 172.21.15.7:0/350260473 >> 172.21.15.7:0/350260473 conn(0x5572f30d5f60 msgr2=0x5572f30d6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:27.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.221+0000 7f231aa5b740 1 -- 172.21.15.7:0/350260473 shutdown_connections 2024-09-19T04:16:27.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.221+0000 7f231aa5b740 1 -- 172.21.15.7:0/350260473 wait complete. 2024-09-19T04:16:27.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.221+0000 7f231aa5b740 1 -- start start 2024-09-19T04:16:27.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.221+0000 7f231aa5b740 1 Processor -- start 2024-09-19T04:16:27.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.222+0000 7f231aa5b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572f30d99d0 0x5572f30e43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:27.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.222+0000 7f231aa5b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572f30da2f0 0x5572f30e1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:27.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.222+0000 7f231aa5b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f30e4bb0 0x5572f30e1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:27.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.222+0000 7f231aa5b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5572f30e7780 con 0x5572f30da2f0 2024-09-19T04:16:27.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.222+0000 7f231aa5b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5572f2ffaf20 con 0x5572f30e4bb0 2024-09-19T04:16:27.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.222+0000 7f231aa5b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5572f30e7900 con 0x5572f30d99d0 2024-09-19T04:16:27.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.222+0000 7f231aa5b740 10 client.0 _ll_register_callbacks cb 0x5572f2fc4030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:16:27.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.222+0000 7f2315c1d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572f30da2f0 0x5572f30e1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:27.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.222+0000 7f2315c1d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572f30da2f0 0x5572f30e1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34862/0 (socket says 172.21.15.7:34862) 2024-09-19T04:16:27.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.222+0000 7f2315c1d640 1 -- 172.21.15.7:0/90493016 learned_addr learned my addr 172.21.15.7:0/90493016 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:27.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.222+0000 7f231641e640 1 --2- 172.21.15.7:0/90493016 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572f30d99d0 0x5572f30e43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:27.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.222+0000 7f2316c1f640 1 --2- 172.21.15.7:0/90493016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f30e4bb0 0x5572f30e1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:27.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.222+0000 7f2315c1d640 1 -- 172.21.15.7:0/90493016 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572f30d99d0 msgr2=0x5572f30e43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:27.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.222+0000 7f2315c1d640 1 --2- 172.21.15.7:0/90493016 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572f30d99d0 0x5572f30e43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.222+0000 7f2315c1d640 1 -- 172.21.15.7:0/90493016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f30e4bb0 msgr2=0x5572f30e1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:27.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.222+0000 7f2315c1d640 1 --2- 172.21.15.7:0/90493016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f30e4bb0 0x5572f30e1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.222+0000 7f2315c1d640 1 -- 172.21.15.7:0/90493016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572f2db12b0 con 0x5572f30da2f0 2024-09-19T04:16:27.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.222+0000 7f2315c1d640 1 --2- 172.21.15.7:0/90493016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572f30da2f0 0x5572f30e1730 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2300000c00 tx=0x7f23000116a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c272a8f6e1a7cfb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:27.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.222+0000 7f22f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:16:27.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.223+0000 7f22f9ffb640 1 -- 172.21.15.7:0/90493016 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2300016050 con 0x5572f30da2f0 2024-09-19T04:16:27.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.223+0000 7f22f9ffb640 1 -- 172.21.15.7:0/90493016 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f2300005040 con 0x5572f30da2f0 2024-09-19T04:16:27.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.223+0000 7f231aa5b740 1 -- 172.21.15.7:0/90493016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2300011950 con 0x5572f30da2f0 2024-09-19T04:16:27.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.223+0000 7f22f9ffb640 1 -- 172.21.15.7:0/90493016 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2300030050 con 0x5572f30da2f0 2024-09-19T04:16:27.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.223+0000 7f231aa5b740 10 client.15120 fetch_fsmap learned FSMap version 27 2024-09-19T04:16:27.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.223+0000 7f231aa5b740 1 -- 172.21.15.7:0/90493016 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5572f30f2fa0 con 0x5572f30da2f0 2024-09-19T04:16:27.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.223+0000 7f22f9ffb640 1 -- 172.21.15.7:0/90493016 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2300011950 con 0x5572f30da2f0 2024-09-19T04:16:27.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.223+0000 7f22f9ffb640 1 -- 172.21.15.7:0/90493016 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f230002b030 con 0x5572f30da2f0 2024-09-19T04:16:27.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.223+0000 7f231aa5b740 10 client.15120 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:16:27.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.223+0000 7f231aa5b740 10 client.15120 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T04:16:27.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.223+0000 7f231aa5b740 20 client.15120 populate_metadata read hostname 'smithi007' 2024-09-19T04:16:27.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.223+0000 7f231aa5b740 1 --2- 172.21.15.7:0/90493016 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5572f30f5300 0x5572f30f6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:27.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.223+0000 7f231aa5b740 4 client.15120 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:16:27.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.223+0000 7f231aa5b740 1 -- 172.21.15.7:0/90493016 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572f304d600 con 0x5572f30f5300 2024-09-19T04:16:27.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.224+0000 7f231641e640 1 --2- 172.21.15.7:0/90493016 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5572f30f5300 0x5572f30f6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:27.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.224+0000 7f231641e640 1 --2- 172.21.15.7:0/90493016 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5572f30f5300 0x5572f30f6770 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8297496d2a87747 server_cookie=bc09d514e2e42524 in_seq=0 out_seq=0 2024-09-19T04:16:27.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.224+0000 7f22f9ffb640 10 client.15120 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:16:27.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.225+0000 7f22f9ffb640 1 -- 172.21.15.7:0/90493016 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5572f304d600 con 0x5572f30f5300 2024-09-19T04:16:27.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.225+0000 7f22f9ffb640 10 client.15120 handle_command_reply: tid=0 2024-09-19T04:16:27.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.225+0000 7f231aa5b740 1 client.15120 shutdown 2024-09-19T04:16:27.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.225+0000 7f231aa5b740 1 -- 172.21.15.7:0/90493016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572f30da2f0 msgr2=0x5572f30e1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:27.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.225+0000 7f231aa5b740 1 --2- 172.21.15.7:0/90493016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572f30da2f0 0x5572f30e1730 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2300000c00 tx=0x7f23000116a0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.225+0000 7f231aa5b740 1 -- 172.21.15.7:0/90493016 shutdown_connections 2024-09-19T04:16:27.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.225+0000 7f231aa5b740 1 --2- 172.21.15.7:0/90493016 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5572f30f5300 0x5572f30f6770 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.225+0000 7f231aa5b740 1 --2- 172.21.15.7:0/90493016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f30e4bb0 0x5572f30e1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.225+0000 7f231aa5b740 1 --2- 172.21.15.7:0/90493016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572f30da2f0 0x5572f30e1730 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.225+0000 7f231aa5b740 1 --2- 172.21.15.7:0/90493016 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572f30d99d0 0x5572f30e43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.225+0000 7f22f9ffb640 0 client.15120 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:16:27.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.225+0000 7f231aa5b740 1 -- 172.21.15.7:0/90493016 >> 172.21.15.7:0/90493016 conn(0x5572f30d5f60 msgr2=0x5572f30dbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:27.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.225+0000 7f231aa5b740 1 -- 172.21.15.7:0/90493016 shutdown_connections 2024-09-19T04:16:27.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.225+0000 7f231aa5b740 1 -- 172.21.15.7:0/90493016 wait complete. 2024-09-19T04:16:27.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.225+0000 7f231aa5b740 20 client.15120 trim_cache size 0 max 16384 2024-09-19T04:16:27.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.243+0000 7f231aa5b740 1 Processor -- start 2024-09-19T04:16:27.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.243+0000 7f231aa5b740 1 -- start start 2024-09-19T04:16:27.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.243+0000 7f231aa5b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572f30d99d0 0x5572f30f6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:27.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.243+0000 7f231aa5b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f30da2f0 0x5572f30f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:27.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.243+0000 7f231aa5b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572f30e4bb0 0x5572f30d4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:27.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.243+0000 7f231aa5b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5572f30f4ab0 con 0x5572f30d99d0 2024-09-19T04:16:27.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.243+0000 7f231aa5b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5572f30f5180 con 0x5572f30da2f0 2024-09-19T04:16:27.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.243+0000 7f231aa5b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5572f30f5850 con 0x5572f30e4bb0 2024-09-19T04:16:27.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.243+0000 7f231641e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572f30d99d0 0x5572f30f6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:27.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.243+0000 7f231641e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572f30d99d0 0x5572f30f6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34868/0 (socket says 172.21.15.7:34868) 2024-09-19T04:16:27.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.243+0000 7f231641e640 1 -- 172.21.15.7:0/3721704462 learned_addr learned my addr 172.21.15.7:0/3721704462 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:27.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.243+0000 7f231641e640 1 -- 172.21.15.7:0/3721704462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572f30e4bb0 msgr2=0x5572f30d4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:27.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.243+0000 7f231641e640 1 --2- 172.21.15.7:0/3721704462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572f30e4bb0 0x5572f30d4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.244+0000 7f231641e640 1 -- 172.21.15.7:0/3721704462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f30da2f0 msgr2=0x5572f30f4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:27.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.244+0000 7f231641e640 1 --2- 172.21.15.7:0/3721704462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f30da2f0 0x5572f30f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.244+0000 7f231641e640 1 -- 172.21.15.7:0/3721704462 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572f30da120 con 0x5572f30d99d0 2024-09-19T04:16:27.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.244+0000 7f231641e640 1 --2- 172.21.15.7:0/3721704462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572f30d99d0 0x5572f30f6770 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f230c009f90 tx=0x7f230c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c2d7224068c1b05 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:27.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.244+0000 7f22fbfff640 1 -- 172.21.15.7:0/3721704462 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230c020040 con 0x5572f30d99d0 2024-09-19T04:16:27.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.244+0000 7f22fbfff640 1 -- 172.21.15.7:0/3721704462 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f230c0b1030 con 0x5572f30d99d0 2024-09-19T04:16:27.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.244+0000 7f22fbfff640 1 -- 172.21.15.7:0/3721704462 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230c09b0b0 con 0x5572f30d99d0 2024-09-19T04:16:27.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.244+0000 7f231aa5b740 1 -- 172.21.15.7:0/3721704462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572f30d99d0 msgr2=0x5572f30f6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:27.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.244+0000 7f231aa5b740 1 --2- 172.21.15.7:0/3721704462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572f30d99d0 0x5572f30f6770 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f230c009f90 tx=0x7f230c005880 comp rx=0 tx=0).stop 2024-09-19T04:16:27.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.245+0000 7f231aa5b740 1 -- 172.21.15.7:0/3721704462 shutdown_connections 2024-09-19T04:16:27.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.245+0000 7f231aa5b740 1 --2- 172.21.15.7:0/3721704462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572f30e4bb0 0x5572f30d4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.245+0000 7f231aa5b740 1 --2- 172.21.15.7:0/3721704462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f30da2f0 0x5572f30f4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.245+0000 7f231aa5b740 1 --2- 172.21.15.7:0/3721704462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572f30d99d0 0x5572f30f6770 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.245+0000 7f231aa5b740 1 -- 172.21.15.7:0/3721704462 >> 172.21.15.7:0/3721704462 conn(0x5572f30d5f60 msgr2=0x5572f30d47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:27.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.245+0000 7f231aa5b740 1 -- 172.21.15.7:0/3721704462 shutdown_connections 2024-09-19T04:16:27.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.245+0000 7f231aa5b740 1 -- 172.21.15.7:0/3721704462 wait complete. 2024-09-19T04:16:27.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.245+0000 7f231aa5b740 1 -- start start 2024-09-19T04:16:27.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.245+0000 7f231aa5b740 1 Processor -- start 2024-09-19T04:16:27.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.245+0000 7f231aa5b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572f30d99d0 0x5572f30ff020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:27.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.245+0000 7f231aa5b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f30da2f0 0x5572f30fa350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:27.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.245+0000 7f231aa5b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572f30e4bb0 0x5572f30fa890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:27.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.245+0000 7f231aa5b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5572f30f65f0 con 0x5572f30d99d0 2024-09-19T04:16:27.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.245+0000 7f231aa5b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5572f30f5f20 con 0x5572f30da2f0 2024-09-19T04:16:27.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.245+0000 7f231aa5b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5572f30f6cc0 con 0x5572f30e4bb0 2024-09-19T04:16:27.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.245+0000 7f231641e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572f30d99d0 0x5572f30ff020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:27.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.245+0000 7f231aa5b740 10 client.0 _ll_register_callbacks cb 0x7f2300009a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:16:27.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.245+0000 7f231641e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572f30d99d0 0x5572f30ff020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34878/0 (socket says 172.21.15.7:34878) 2024-09-19T04:16:27.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.245+0000 7f231641e640 1 -- 172.21.15.7:0/122275430 learned_addr learned my addr 172.21.15.7:0/122275430 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:27.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.246+0000 7f2315c1d640 1 --2- 172.21.15.7:0/122275430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f30da2f0 0x5572f30fa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:27.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.246+0000 7f231641e640 1 -- 172.21.15.7:0/122275430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572f30e4bb0 msgr2=0x5572f30fa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:27.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.246+0000 7f231641e640 1 --2- 172.21.15.7:0/122275430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572f30e4bb0 0x5572f30fa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.246+0000 7f231641e640 1 -- 172.21.15.7:0/122275430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f30da2f0 msgr2=0x5572f30fa350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:27.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.246+0000 7f231641e640 1 --2- 172.21.15.7:0/122275430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f30da2f0 0x5572f30fa350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.246+0000 7f231641e640 1 -- 172.21.15.7:0/122275430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572f30faf30 con 0x5572f30d99d0 2024-09-19T04:16:27.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.246+0000 7f2315c1d640 1 --2- 172.21.15.7:0/122275430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f30da2f0 0x5572f30fa350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:16:27.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.246+0000 7f231641e640 1 --2- 172.21.15.7:0/122275430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572f30d99d0 0x5572f30ff020 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f230c010db0 tx=0x7f230c0a48d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93efd7c47efcd4a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:27.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.246+0000 7f22f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:16:27.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.246+0000 7f22f9ffb640 1 -- 172.21.15.7:0/122275430 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f230c0b4e60 con 0x5572f30d99d0 2024-09-19T04:16:27.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.246+0000 7f22f9ffb640 1 -- 172.21.15.7:0/122275430 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f230c0982d0 con 0x5572f30d99d0 2024-09-19T04:16:27.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.246+0000 7f231aa5b740 1 -- 172.21.15.7:0/122275430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f230c0b1030 con 0x5572f30d99d0 2024-09-19T04:16:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.246+0000 7f22f9ffb640 1 -- 172.21.15.7:0/122275430 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f230c09b0b0 con 0x5572f30d99d0 2024-09-19T04:16:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.246+0000 7f231aa5b740 10 client.15126 fetch_fsmap learned FSMap version 27 2024-09-19T04:16:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.246+0000 7f231aa5b740 1 -- 172.21.15.7:0/122275430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5572f315f8a0 con 0x5572f30d99d0 2024-09-19T04:16:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.246+0000 7f22f9ffb640 1 -- 172.21.15.7:0/122275430 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f230c0b1030 con 0x5572f30d99d0 2024-09-19T04:16:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.247+0000 7f22f9ffb640 1 -- 172.21.15.7:0/122275430 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f230c097b70 con 0x5572f30d99d0 2024-09-19T04:16:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.247+0000 7f231aa5b740 10 client.15126 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:16:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.247+0000 7f231aa5b740 10 client.15126 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T04:16:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.247+0000 7f231aa5b740 20 client.15126 populate_metadata read hostname 'smithi007' 2024-09-19T04:16:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.247+0000 7f231aa5b740 1 --2- 172.21.15.7:0/122275430 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5572f3163e80 0x5572f3162b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.247+0000 7f231aa5b740 4 client.15126 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T04:16:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.247+0000 7f231aa5b740 1 -- 172.21.15.7:0/122275430 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "status"}) -- 0x5572f3047b10 con 0x5572f3163e80 2024-09-19T04:16:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.247+0000 7f2315c1d640 1 --2- 172.21.15.7:0/122275430 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5572f3163e80 0x5572f3162b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:27.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.247+0000 7f22f9ffb640 10 client.15126 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:16:27.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.247+0000 7f2315c1d640 1 --2- 172.21.15.7:0/122275430 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5572f3163e80 0x5572f3162b90 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=988b5b9de82cbdb0 server_cookie=276a1ff6b3094e3 in_seq=0 out_seq=0 2024-09-19T04:16:27.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.247+0000 7f22f9ffb640 1 -- 172.21.15.7:0/122275430 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5572f3047b10 con 0x5572f3163e80 2024-09-19T04:16:27.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.247+0000 7f22f9ffb640 10 client.15126 handle_command_reply: tid=0 2024-09-19T04:16:27.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.248+0000 7f231aa5b740 1 client.15126 shutdown 2024-09-19T04:16:27.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.248+0000 7f231aa5b740 1 -- 172.21.15.7:0/122275430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572f30d99d0 msgr2=0x5572f30ff020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:27.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.248+0000 7f231aa5b740 1 --2- 172.21.15.7:0/122275430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572f30d99d0 0x5572f30ff020 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f230c010db0 tx=0x7f230c0a48d0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.248+0000 7f231aa5b740 1 -- 172.21.15.7:0/122275430 shutdown_connections 2024-09-19T04:16:27.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.248+0000 7f231aa5b740 1 --2- 172.21.15.7:0/122275430 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5572f3163e80 0x5572f3162b90 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.248+0000 7f231aa5b740 1 --2- 172.21.15.7:0/122275430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572f30e4bb0 0x5572f30fa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.248+0000 7f231aa5b740 1 --2- 172.21.15.7:0/122275430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572f30da2f0 0x5572f30fa350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.248+0000 7f231aa5b740 1 --2- 172.21.15.7:0/122275430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572f30d99d0 0x5572f30ff020 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.248+0000 7f231aa5b740 1 -- 172.21.15.7:0/122275430 >> 172.21.15.7:0/122275430 conn(0x5572f30d5f60 msgr2=0x5572f30d5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:27.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.248+0000 7f22f9ffb640 0 client.15126 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:16:27.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.248+0000 7f231aa5b740 1 -- 172.21.15.7:0/122275430 shutdown_connections 2024-09-19T04:16:27.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.248+0000 7f231aa5b740 1 -- 172.21.15.7:0/122275430 wait complete. 2024-09-19T04:16:27.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.248+0000 7f231aa5b740 20 client.15126 trim_cache size 0 max 16384 2024-09-19T04:16:27.255 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:16:27.255 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "77957c0a-763c-11ef-bceb-c7b262605968", 2024-09-19T04:16:27.255 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-09-19T04:16:27.255 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24506, 2024-09-19T04:16:27.255 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-19T04:16:27.255 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-19T04:16:27.255 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-19T04:16:27.255 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 112.928762568, 2024-09-19T04:16:27.256 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 27, 2024-09-19T04:16:27.256 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 88, 2024-09-19T04:16:27.256 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 86, 2024-09-19T04:16:27.256 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 124.44838593599999 2024-09-19T04:16:27.256 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:16:27.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.248+0000 7f2318682640 1 -- 172.21.15.7:0/1994759907 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f22fc0a32d0 msgr2=0x7f22fc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:27.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.248+0000 7f2318682640 1 --2- 172.21.15.7:0/1994759907 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f22fc0a32d0 0x7f22fc0a5790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2308005e30 tx=0x7f2308005d80 comp rx=0 tx=0).stop 2024-09-19T04:16:27.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.248+0000 7f2318682640 1 -- 172.21.15.7:0/1994759907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2310102d20 msgr2=0x7f2310100980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:27.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.248+0000 7f2318682640 1 --2- 172.21.15.7:0/1994759907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2310102d20 0x7f2310100980 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f230c00d950 tx=0x7f230c00de10 comp rx=0 tx=0).stop 2024-09-19T04:16:27.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.248+0000 7f2318682640 1 -- 172.21.15.7:0/1994759907 shutdown_connections 2024-09-19T04:16:27.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.248+0000 7f2318682640 1 --2- 172.21.15.7:0/1994759907 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f22fc0a32d0 0x7f22fc0a5790 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.248+0000 7f2318682640 1 --2- 172.21.15.7:0/1994759907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f231010c150 0x7f2310101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.248+0000 7f2318682640 1 --2- 172.21.15.7:0/1994759907 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2310103640 0x7f2310100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.248+0000 7f2318682640 1 --2- 172.21.15.7:0/1994759907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2310102d20 0x7f2310100980 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:27.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.248+0000 7f2318682640 1 -- 172.21.15.7:0/1994759907 >> 172.21.15.7:0/1994759907 conn(0x7f23100fc780 msgr2=0x7f23100fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:27.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.249+0000 7f2318682640 1 -- 172.21.15.7:0/1994759907 shutdown_connections 2024-09-19T04:16:27.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:27.249+0000 7f2318682640 1 -- 172.21.15.7:0/1994759907 wait complete. 2024-09-19T04:16:28.019 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T04:16:28.019 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T04:16:28.030 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-09-19T04:16:28.030 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T04:16:28.289 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:28.411 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:28 smithi007 ceph-mon[31360]: pgmap v339: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T04:16:28.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:28 smithi092 ceph-mon[34940]: pgmap v339: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T04:16:28.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:28 smithi102 ceph-mon[35446]: pgmap v339: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T04:16:28.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.749+0000 7fdc8e8ba640 1 -- 172.21.15.7:0/2799179692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc88100ad0 msgr2=0x7fdc88100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:28.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.749+0000 7fdc8e8ba640 1 --2- 172.21.15.7:0/2799179692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc88100ad0 0x7fdc88100ed0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fdc78009900 tx=0x7fdc7802a410 comp rx=0 tx=0).stop 2024-09-19T04:16:28.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.749+0000 7fdc8e8ba640 1 -- 172.21.15.7:0/2799179692 shutdown_connections 2024-09-19T04:16:28.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.749+0000 7fdc8e8ba640 1 --2- 172.21.15.7:0/2799179692 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc88102690 0x7fdc88108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:28.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.749+0000 7fdc8e8ba640 1 --2- 172.21.15.7:0/2799179692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc88101cd0 0x7fdc88102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:28.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.749+0000 7fdc8e8ba640 1 --2- 172.21.15.7:0/2799179692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc88100ad0 0x7fdc88100ed0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:28.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.749+0000 7fdc8e8ba640 1 -- 172.21.15.7:0/2799179692 >> 172.21.15.7:0/2799179692 conn(0x7fdc880fc280 msgr2=0x7fdc880fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:28.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.749+0000 7fdc8e8ba640 1 -- 172.21.15.7:0/2799179692 shutdown_connections 2024-09-19T04:16:28.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.749+0000 7fdc8e8ba640 1 -- 172.21.15.7:0/2799179692 wait complete. 2024-09-19T04:16:28.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.750+0000 7fdc8e8ba640 1 Processor -- start 2024-09-19T04:16:28.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.750+0000 7fdc8e8ba640 1 -- start start 2024-09-19T04:16:28.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.751+0000 7fdc8e8ba640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc88100ad0 0x7fdc88196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:28.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.751+0000 7fdc8e8ba640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc88101cd0 0x7fdc881972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:28.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.751+0000 7fdc8e8ba640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc88102690 0x7fdc8819e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:28.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.751+0000 7fdc8e8ba640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8810c730 con 0x7fdc88100ad0 2024-09-19T04:16:28.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.751+0000 7fdc8e8ba640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8810c5b0 con 0x7fdc88102690 2024-09-19T04:16:28.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.751+0000 7fdc8e8ba640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8810c8b0 con 0x7fdc88101cd0 2024-09-19T04:16:28.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.751+0000 7fdc87fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc88100ad0 0x7fdc88196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:28.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.751+0000 7fdc87fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc88100ad0 0x7fdc88196db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50580/0 (socket says 172.21.15.7:50580) 2024-09-19T04:16:28.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.751+0000 7fdc87fff640 1 -- 172.21.15.7:0/2170271245 learned_addr learned my addr 172.21.15.7:0/2170271245 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:28.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.751+0000 7fdc877fe640 1 --2- 172.21.15.7:0/2170271245 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc88101cd0 0x7fdc881972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:28.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.751+0000 7fdc8ce57640 1 --2- 172.21.15.7:0/2170271245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc88102690 0x7fdc8819e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:28.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.751+0000 7fdc87fff640 1 -- 172.21.15.7:0/2170271245 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc88101cd0 msgr2=0x7fdc881972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:28.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.751+0000 7fdc87fff640 1 --2- 172.21.15.7:0/2170271245 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc88101cd0 0x7fdc881972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:28.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.751+0000 7fdc87fff640 1 -- 172.21.15.7:0/2170271245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc88102690 msgr2=0x7fdc8819e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:28.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.751+0000 7fdc87fff640 1 --2- 172.21.15.7:0/2170271245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc88102690 0x7fdc8819e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:28.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.751+0000 7fdc87fff640 1 -- 172.21.15.7:0/2170271245 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc8819e9e0 con 0x7fdc88100ad0 2024-09-19T04:16:28.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.751+0000 7fdc87fff640 1 --2- 172.21.15.7:0/2170271245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc88100ad0 0x7fdc88196db0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdc78031610 tx=0x7fdc780043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:28.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.751+0000 7fdc857fa640 1 -- 172.21.15.7:0/2170271245 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7803f030 con 0x7fdc88100ad0 2024-09-19T04:16:28.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.751+0000 7fdc857fa640 1 -- 172.21.15.7:0/2170271245 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc78003ce0 con 0x7fdc88100ad0 2024-09-19T04:16:28.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.751+0000 7fdc8e8ba640 1 -- 172.21.15.7:0/2170271245 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc8819ec70 con 0x7fdc88100ad0 2024-09-19T04:16:28.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.751+0000 7fdc857fa640 1 -- 172.21.15.7:0/2170271245 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc78035070 con 0x7fdc88100ad0 2024-09-19T04:16:28.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.752+0000 7fdc8e8ba640 1 -- 172.21.15.7:0/2170271245 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc8819f150 con 0x7fdc88100ad0 2024-09-19T04:16:28.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.752+0000 7fdc8e8ba640 1 -- 172.21.15.7:0/2170271245 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc88107ea0 con 0x7fdc88100ad0 2024-09-19T04:16:28.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.754+0000 7fdc857fa640 1 -- 172.21.15.7:0/2170271245 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fdc78042030 con 0x7fdc88100ad0 2024-09-19T04:16:28.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.754+0000 7fdc857fa640 1 --2- 172.21.15.7:0/2170271245 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fdc700a3300 0x7fdc700a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:28.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.754+0000 7fdc857fa640 1 -- 172.21.15.7:0/2170271245 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7fdc780f0000 con 0x7fdc88100ad0 2024-09-19T04:16:28.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.754+0000 7fdc877fe640 1 --2- 172.21.15.7:0/2170271245 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fdc700a3300 0x7fdc700a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:28.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.755+0000 7fdc877fe640 1 --2- 172.21.15.7:0/2170271245 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fdc700a3300 0x7fdc700a57c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdc881982d0 tx=0x7fdc7c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:28.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.759+0000 7fdc857fa640 1 -- 172.21.15.7:0/2170271245 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdc780bc880 con 0x7fdc88100ad0 2024-09-19T04:16:28.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.952+0000 7fdc8e8ba640 1 -- 172.21.15.7:0/2170271245 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fdc88062630 con 0x7fdc700a3300 2024-09-19T04:16:28.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.953+0000 7fdc857fa640 1 -- 172.21.15.7:0/2170271245 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fdc88062630 con 0x7fdc700a3300 2024-09-19T04:16:28.954 INFO:teuthology.orchestra.run.smithi007.stdout:Backend: cephadm 2024-09-19T04:16:28.954 INFO:teuthology.orchestra.run.smithi007.stdout:Available: Yes 2024-09-19T04:16:28.955 INFO:teuthology.orchestra.run.smithi007.stdout:Paused: No 2024-09-19T04:16:28.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.955+0000 7fdc8e8ba640 1 -- 172.21.15.7:0/2170271245 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fdc700a3300 msgr2=0x7fdc700a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:28.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.955+0000 7fdc8e8ba640 1 --2- 172.21.15.7:0/2170271245 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fdc700a3300 0x7fdc700a57c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdc881982d0 tx=0x7fdc7c00a2d0 comp rx=0 tx=0).stop 2024-09-19T04:16:28.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.955+0000 7fdc8e8ba640 1 -- 172.21.15.7:0/2170271245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc88100ad0 msgr2=0x7fdc88196db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:28.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.955+0000 7fdc8e8ba640 1 --2- 172.21.15.7:0/2170271245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc88100ad0 0x7fdc88196db0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdc78031610 tx=0x7fdc780043b0 comp rx=0 tx=0).stop 2024-09-19T04:16:28.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.955+0000 7fdc8e8ba640 1 -- 172.21.15.7:0/2170271245 shutdown_connections 2024-09-19T04:16:28.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.955+0000 7fdc8e8ba640 1 --2- 172.21.15.7:0/2170271245 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fdc700a3300 0x7fdc700a57c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:28.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.955+0000 7fdc8e8ba640 1 --2- 172.21.15.7:0/2170271245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdc88102690 0x7fdc8819e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:28.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.955+0000 7fdc8e8ba640 1 --2- 172.21.15.7:0/2170271245 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc88101cd0 0x7fdc881972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:28.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.955+0000 7fdc8e8ba640 1 --2- 172.21.15.7:0/2170271245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc88100ad0 0x7fdc88196db0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:28.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.955+0000 7fdc8e8ba640 1 -- 172.21.15.7:0/2170271245 >> 172.21.15.7:0/2170271245 conn(0x7fdc880fc280 msgr2=0x7fdc88105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:28.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.955+0000 7fdc8e8ba640 1 -- 172.21.15.7:0/2170271245 shutdown_connections 2024-09-19T04:16:28.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:28.955+0000 7fdc8e8ba640 1 -- 172.21.15.7:0/2170271245 wait complete. 2024-09-19T04:16:29.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:29 smithi007 ceph-mon[31360]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:16:29.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:29 smithi092 ceph-mon[34940]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:16:29.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:29 smithi102 ceph-mon[35446]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:16:29.707 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T04:16:29.967 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:30.354 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:30 smithi007 ceph-mon[31360]: pgmap v340: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T04:16:30.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.436+0000 7f2b17d7c640 1 -- 172.21.15.7:0/3561332499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b1010e1e0 msgr2=0x7f2b101105d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:30.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.436+0000 7f2b17d7c640 1 --2- 172.21.15.7:0/3561332499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b1010e1e0 0x7f2b101105d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2b08009ca0 tx=0x7f2b0802a8c0 comp rx=0 tx=0).stop 2024-09-19T04:16:30.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.436+0000 7f2b17d7c640 1 -- 172.21.15.7:0/3561332499 shutdown_connections 2024-09-19T04:16:30.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.436+0000 7f2b17d7c640 1 --2- 172.21.15.7:0/3561332499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b1010e1e0 0x7f2b101105d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:30.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.436+0000 7f2b17d7c640 1 --2- 172.21.15.7:0/3561332499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b10074c50 0x7f2b100750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:30.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.436+0000 7f2b17d7c640 1 --2- 172.21.15.7:0/3561332499 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b10076220 0x7f2b10074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:30.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.436+0000 7f2b17d7c640 1 -- 172.21.15.7:0/3561332499 >> 172.21.15.7:0/3561332499 conn(0x7f2b100fd390 msgr2=0x7f2b100ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:30.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.436+0000 7f2b17d7c640 1 -- 172.21.15.7:0/3561332499 shutdown_connections 2024-09-19T04:16:30.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.436+0000 7f2b17d7c640 1 -- 172.21.15.7:0/3561332499 wait complete. 2024-09-19T04:16:30.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.437+0000 7f2b17d7c640 1 Processor -- start 2024-09-19T04:16:30.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.437+0000 7f2b17d7c640 1 -- start start 2024-09-19T04:16:30.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.437+0000 7f2b17d7c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b10074c50 0x7f2b1019e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:30.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.437+0000 7f2b17d7c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b10076220 0x7f2b1019eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:30.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.437+0000 7f2b17d7c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b1010e1e0 0x7f2b101a5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:30.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.437+0000 7f2b17d7c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2b10113f80 con 0x7f2b10074c50 2024-09-19T04:16:30.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.437+0000 7f2b17d7c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2b10113e00 con 0x7f2b1010e1e0 2024-09-19T04:16:30.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.437+0000 7f2b17d7c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2b10114100 con 0x7f2b10076220 2024-09-19T04:16:30.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.437+0000 7f2b15b18640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b10074c50 0x7f2b1019e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:30.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.437+0000 7f2b15b18640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b10074c50 0x7f2b1019e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50586/0 (socket says 172.21.15.7:50586) 2024-09-19T04:16:30.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.437+0000 7f2b15b18640 1 -- 172.21.15.7:0/608326258 learned_addr learned my addr 172.21.15.7:0/608326258 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:30.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.437+0000 7f2b15317640 1 --2- 172.21.15.7:0/608326258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b10076220 0x7f2b1019eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:30.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.437+0000 7f2b16319640 1 --2- 172.21.15.7:0/608326258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b1010e1e0 0x7f2b101a5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:30.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.437+0000 7f2b15b18640 1 -- 172.21.15.7:0/608326258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b10076220 msgr2=0x7f2b1019eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:30.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.437+0000 7f2b15b18640 1 --2- 172.21.15.7:0/608326258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b10076220 0x7f2b1019eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:30.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.437+0000 7f2b15b18640 1 -- 172.21.15.7:0/608326258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b1010e1e0 msgr2=0x7f2b101a5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:30.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.437+0000 7f2b15b18640 1 --2- 172.21.15.7:0/608326258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b1010e1e0 0x7f2b101a5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:30.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.437+0000 7f2b15b18640 1 -- 172.21.15.7:0/608326258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b101a6230 con 0x7f2b10074c50 2024-09-19T04:16:30.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.437+0000 7f2b16319640 1 --2- 172.21.15.7:0/608326258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b1010e1e0 0x7f2b101a5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:16:30.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.438+0000 7f2b15b18640 1 --2- 172.21.15.7:0/608326258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b10074c50 0x7f2b1019e600 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c00b450 tx=0x7f2b0c00b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:30.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.438+0000 7f2b06ffd640 1 -- 172.21.15.7:0/608326258 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c015020 con 0x7f2b10074c50 2024-09-19T04:16:30.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.438+0000 7f2b06ffd640 1 -- 172.21.15.7:0/608326258 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b0c011d10 con 0x7f2b10074c50 2024-09-19T04:16:30.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.438+0000 7f2b17d7c640 1 -- 172.21.15.7:0/608326258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b101a6520 con 0x7f2b10074c50 2024-09-19T04:16:30.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.438+0000 7f2b06ffd640 1 -- 172.21.15.7:0/608326258 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c00f2e0 con 0x7f2b10074c50 2024-09-19T04:16:30.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.438+0000 7f2b17d7c640 1 -- 172.21.15.7:0/608326258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b101a6b30 con 0x7f2b10074c50 2024-09-19T04:16:30.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.439+0000 7f2b17d7c640 1 -- 172.21.15.7:0/608326258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b101043b0 con 0x7f2b10074c50 2024-09-19T04:16:30.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.440+0000 7f2b06ffd640 1 -- 172.21.15.7:0/608326258 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f2b0c018020 con 0x7f2b10074c50 2024-09-19T04:16:30.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.441+0000 7f2b06ffd640 1 --2- 172.21.15.7:0/608326258 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2afc0a3380 0x7f2afc0a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:30.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.441+0000 7f2b15317640 1 --2- 172.21.15.7:0/608326258 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2afc0a3380 0x7f2afc0a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:30.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.441+0000 7f2b06ffd640 1 -- 172.21.15.7:0/608326258 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f2b0c0cf580 con 0x7f2b10074c50 2024-09-19T04:16:30.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.441+0000 7f2b15317640 1 --2- 172.21.15.7:0/608326258 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2afc0a3380 0x7f2afc0a5840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2b1019fb20 tx=0x7f2b00009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:30.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.445+0000 7f2b06ffd640 1 -- 172.21.15.7:0/608326258 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2b0c01f020 con 0x7f2b10074c50 2024-09-19T04:16:30.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:30 smithi092 ceph-mon[34940]: pgmap v340: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T04:16:30.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.627+0000 7f2b17d7c640 1 -- 172.21.15.7:0/608326258 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f2b10062630 con 0x7f2afc0a3380 2024-09-19T04:16:30.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.639+0000 7f2b06ffd640 1 -- 172.21.15.7:0/608326258 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4061 (secure 0 0 0) 0x7f2b10062630 con 0x7f2afc0a3380 2024-09-19T04:16:30.641 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T04:16:30.641 INFO:teuthology.orchestra.run.smithi007.stdout:mds.a smithi007 running (2m) 59s ago 2m 16.9M - 19.1.1-361-g2f599a46 d2baa855c067 ff8c6b10d2a2 2024-09-19T04:16:30.641 INFO:teuthology.orchestra.run.smithi007.stdout:mds.b smithi092 running (2m) 61s ago 2m 25.8M - 19.1.1-361-g2f599a46 d2baa855c067 b891cc6a0cf3 2024-09-19T04:16:30.641 INFO:teuthology.orchestra.run.smithi007.stdout:mds.c smithi102 running (2m) 61s ago 2m 17.0M - 19.1.1-361-g2f599a46 d2baa855c067 48f4d11d1647 2024-09-19T04:16:30.641 INFO:teuthology.orchestra.run.smithi007.stdout:mds.d smithi007 running (2m) 59s ago 2m 16.9M - 19.1.1-361-g2f599a46 d2baa855c067 e473d1a1fbc5 2024-09-19T04:16:30.641 INFO:teuthology.orchestra.run.smithi007.stdout:mds.e smithi092 running (2m) 61s ago 2m 16.3M - 19.1.1-361-g2f599a46 d2baa855c067 0a8e9ccc06fa 2024-09-19T04:16:30.641 INFO:teuthology.orchestra.run.smithi007.stdout:mds.f smithi102 running (2m) 61s ago 2m 19.5M - 19.1.1-361-g2f599a46 d2baa855c067 4823c4ef1350 2024-09-19T04:16:30.641 INFO:teuthology.orchestra.run.smithi007.stdout:mds.g smithi007 running (2m) 59s ago 2m 14.5M - 19.1.1-361-g2f599a46 d2baa855c067 ca9cf4cc67e4 2024-09-19T04:16:30.642 INFO:teuthology.orchestra.run.smithi007.stdout:mds.h smithi092 running (2m) 61s ago 2m 16.2M - 19.1.1-361-g2f599a46 d2baa855c067 54eeb19aa70d 2024-09-19T04:16:30.642 INFO:teuthology.orchestra.run.smithi007.stdout:mds.i smithi102 running (2m) 61s ago 2m 17.0M - 19.1.1-361-g2f599a46 d2baa855c067 d51a3e24a498 2024-09-19T04:16:30.642 INFO:teuthology.orchestra.run.smithi007.stdout:mds.j smithi007 running (2m) 59s ago 2m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 2a0eb7a3a048 2024-09-19T04:16:30.642 INFO:teuthology.orchestra.run.smithi007.stdout:mds.k smithi092 running (2m) 61s ago 2m 19.9M - 19.1.1-361-g2f599a46 d2baa855c067 7a2e05eebdac 2024-09-19T04:16:30.642 INFO:teuthology.orchestra.run.smithi007.stdout:mds.l smithi102 running (2m) 61s ago 2m 15.6M - 19.1.1-361-g2f599a46 d2baa855c067 bbbdd03af408 2024-09-19T04:16:30.642 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi007 *:9283,8765 running (9m) 59s ago 9m 508M - 19.1.1-361-g2f599a46 d2baa855c067 e39a8610116a 2024-09-19T04:16:30.642 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi092 *:8443,8765 running (7m) 61s ago 7m 442M - 19.1.1-361-g2f599a46 d2baa855c067 e1a350fd8536 2024-09-19T04:16:30.642 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.z smithi102 *:8443,8765 running (7m) 61s ago 7m 441M - 19.1.1-361-g2f599a46 d2baa855c067 812f1a59d708 2024-09-19T04:16:30.642 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (9m) 59s ago 9m 54.3M 2048M 19.1.1-361-g2f599a46 d2baa855c067 7c492ee8493a 2024-09-19T04:16:30.642 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi092 running (8m) 61s ago 8m 40.8M 2048M 19.1.1-361-g2f599a46 d2baa855c067 26442b8e039c 2024-09-19T04:16:30.642 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi102 running (8m) 61s ago 8m 41.2M 2048M 19.1.1-361-g2f599a46 d2baa855c067 2d79ec02c4c4 2024-09-19T04:16:30.642 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (7m) 59s ago 7m 58.4M 4273M 19.1.1-361-g2f599a46 d2baa855c067 29d048d721b2 2024-09-19T04:16:30.643 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi092 running (7m) 61s ago 7m 45.9M 4272M 19.1.1-361-g2f599a46 d2baa855c067 a093b8f545c8 2024-09-19T04:16:30.643 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi102 running (6m) 61s ago 6m 46.7M 4272M 19.1.1-361-g2f599a46 d2baa855c067 a768de96a2bc 2024-09-19T04:16:30.643 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (6m) 59s ago 6m 43.9M 4273M 19.1.1-361-g2f599a46 d2baa855c067 66f7c9c91ecc 2024-09-19T04:16:30.643 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi092 running (5m) 61s ago 5m 42.4M 4272M 19.1.1-361-g2f599a46 d2baa855c067 65c14a0e9775 2024-09-19T04:16:30.643 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi102 running (5m) 61s ago 5m 45.2M 4272M 19.1.1-361-g2f599a46 d2baa855c067 53754f1f9c90 2024-09-19T04:16:30.643 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi007 running (5m) 59s ago 5m 42.4M 4273M 19.1.1-361-g2f599a46 d2baa855c067 d37d7afe6fd1 2024-09-19T04:16:30.643 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi092 running (4m) 61s ago 4m 57.9M 4272M 19.1.1-361-g2f599a46 d2baa855c067 ad0b486fdcc6 2024-09-19T04:16:30.643 INFO:teuthology.orchestra.run.smithi007.stdout:osd.8 smithi102 running (4m) 61s ago 4m 55.5M 4272M 19.1.1-361-g2f599a46 d2baa855c067 e0cbb65b8961 2024-09-19T04:16:30.643 INFO:teuthology.orchestra.run.smithi007.stdout:osd.9 smithi007 running (3m) 59s ago 3m 40.9M 4273M 19.1.1-361-g2f599a46 d2baa855c067 017c4f4e6827 2024-09-19T04:16:30.643 INFO:teuthology.orchestra.run.smithi007.stdout:osd.10 smithi092 running (3m) 61s ago 3m 43.9M 4272M 19.1.1-361-g2f599a46 d2baa855c067 1c59aff5b8de 2024-09-19T04:16:30.643 INFO:teuthology.orchestra.run.smithi007.stdout:osd.11 smithi102 running (2m) 61s ago 2m 52.4M 4272M 19.1.1-361-g2f599a46 d2baa855c067 fbc37f393db9 2024-09-19T04:16:30.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.642+0000 7f2b17d7c640 1 -- 172.21.15.7:0/608326258 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2afc0a3380 msgr2=0x7f2afc0a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:30.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.642+0000 7f2b17d7c640 1 --2- 172.21.15.7:0/608326258 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2afc0a3380 0x7f2afc0a5840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2b1019fb20 tx=0x7f2b00009110 comp rx=0 tx=0).stop 2024-09-19T04:16:30.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.642+0000 7f2b17d7c640 1 -- 172.21.15.7:0/608326258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b10074c50 msgr2=0x7f2b1019e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:30.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.642+0000 7f2b17d7c640 1 --2- 172.21.15.7:0/608326258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b10074c50 0x7f2b1019e600 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c00b450 tx=0x7f2b0c00b850 comp rx=0 tx=0).stop 2024-09-19T04:16:30.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.642+0000 7f2b17d7c640 1 -- 172.21.15.7:0/608326258 shutdown_connections 2024-09-19T04:16:30.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.642+0000 7f2b17d7c640 1 --2- 172.21.15.7:0/608326258 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2afc0a3380 0x7f2afc0a5840 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:30.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.642+0000 7f2b17d7c640 1 --2- 172.21.15.7:0/608326258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b1010e1e0 0x7f2b101a5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:30.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.642+0000 7f2b17d7c640 1 --2- 172.21.15.7:0/608326258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b10076220 0x7f2b1019eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:30.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.642+0000 7f2b17d7c640 1 --2- 172.21.15.7:0/608326258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b10074c50 0x7f2b1019e600 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:30.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.642+0000 7f2b17d7c640 1 -- 172.21.15.7:0/608326258 >> 172.21.15.7:0/608326258 conn(0x7f2b100fd390 msgr2=0x7f2b10101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:30.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.642+0000 7f2b17d7c640 1 -- 172.21.15.7:0/608326258 shutdown_connections 2024-09-19T04:16:30.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:30.642+0000 7f2b17d7c640 1 -- 172.21.15.7:0/608326258 wait complete. 2024-09-19T04:16:30.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:30 smithi102 ceph-mon[35446]: pgmap v340: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-19T04:16:31.319 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:31 smithi007 ceph-mon[31360]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:16:31.351 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T04:16:31.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:31 smithi092 ceph-mon[34940]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:16:31.609 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:31.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:31 smithi102 ceph-mon[35446]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:16:32.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.072+0000 7f2a3cbbc640 1 -- 172.21.15.7:0/483447815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a381037c0 msgr2=0x7f2a3810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:32.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.072+0000 7f2a3cbbc640 1 --2- 172.21.15.7:0/483447815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a381037c0 0x7f2a3810a050 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2a30009ca0 tx=0x7f2a3002a8c0 comp rx=0 tx=0).stop 2024-09-19T04:16:32.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.072+0000 7f2a3cbbc640 1 -- 172.21.15.7:0/483447815 shutdown_connections 2024-09-19T04:16:32.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.072+0000 7f2a3cbbc640 1 --2- 172.21.15.7:0/483447815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a381037c0 0x7f2a3810a050 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:32.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.072+0000 7f2a3cbbc640 1 --2- 172.21.15.7:0/483447815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a38102e00 0x7f2a38103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:32.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.072+0000 7f2a3cbbc640 1 --2- 172.21.15.7:0/483447815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a38101c00 0x7f2a38102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:32.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.072+0000 7f2a3cbbc640 1 -- 172.21.15.7:0/483447815 >> 172.21.15.7:0/483447815 conn(0x7f2a380fd390 msgr2=0x7f2a380ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:32.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.072+0000 7f2a3cbbc640 1 -- 172.21.15.7:0/483447815 shutdown_connections 2024-09-19T04:16:32.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.072+0000 7f2a3cbbc640 1 -- 172.21.15.7:0/483447815 wait complete. 2024-09-19T04:16:32.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.073+0000 7f2a3cbbc640 1 Processor -- start 2024-09-19T04:16:32.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.073+0000 7f2a3cbbc640 1 -- start start 2024-09-19T04:16:32.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.074+0000 7f2a3cbbc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a38101c00 0x7f2a38075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:32.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.074+0000 7f2a3cbbc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a38102e00 0x7f2a380745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:32.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.074+0000 7f2a3cbbc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a381037c0 0x7f2a38074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:32.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.074+0000 7f2a3cbbc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3810d880 con 0x7f2a381037c0 2024-09-19T04:16:32.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.074+0000 7f2a3cbbc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3810d700 con 0x7f2a38101c00 2024-09-19T04:16:32.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.074+0000 7f2a3cbbc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3810da00 con 0x7f2a38102e00 2024-09-19T04:16:32.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.074+0000 7f2a3659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a38101c00 0x7f2a38075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:32.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.074+0000 7f2a36d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a381037c0 0x7f2a38074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:32.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.074+0000 7f2a3659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a38101c00 0x7f2a38075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:56790/0 (socket says 172.21.15.7:56790) 2024-09-19T04:16:32.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.074+0000 7f2a3659c640 1 -- 172.21.15.7:0/1087376583 learned_addr learned my addr 172.21.15.7:0/1087376583 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:32.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.074+0000 7f2a35d9b640 1 --2- 172.21.15.7:0/1087376583 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a38102e00 0x7f2a380745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:32.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.074+0000 7f2a3659c640 1 -- 172.21.15.7:0/1087376583 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a38102e00 msgr2=0x7f2a380745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:32.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.074+0000 7f2a3659c640 1 --2- 172.21.15.7:0/1087376583 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a38102e00 0x7f2a380745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:32.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.074+0000 7f2a3659c640 1 -- 172.21.15.7:0/1087376583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a381037c0 msgr2=0x7f2a38074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:32.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.074+0000 7f2a3659c640 1 --2- 172.21.15.7:0/1087376583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a381037c0 0x7f2a38074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:32.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.074+0000 7f2a3659c640 1 -- 172.21.15.7:0/1087376583 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a380753e0 con 0x7f2a38101c00 2024-09-19T04:16:32.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.074+0000 7f2a36d9d640 1 --2- 172.21.15.7:0/1087376583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a381037c0 0x7f2a38074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:16:32.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.074+0000 7f2a3659c640 1 --2- 172.21.15.7:0/1087376583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a38101c00 0x7f2a38075f90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2a2800d770 tx=0x7f2a2800dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:32.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.075+0000 7f2a277fe640 1 -- 172.21.15.7:0/1087376583 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a28017070 con 0x7f2a38101c00 2024-09-19T04:16:32.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.075+0000 7f2a3cbbc640 1 -- 172.21.15.7:0/1087376583 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a381a1fd0 con 0x7f2a38101c00 2024-09-19T04:16:32.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.075+0000 7f2a277fe640 1 -- 172.21.15.7:0/1087376583 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a28009c30 con 0x7f2a38101c00 2024-09-19T04:16:32.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.075+0000 7f2a277fe640 1 -- 172.21.15.7:0/1087376583 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a28003dd0 con 0x7f2a38101c00 2024-09-19T04:16:32.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.075+0000 7f2a3cbbc640 1 -- 172.21.15.7:0/1087376583 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a381a2480 con 0x7f2a38101c00 2024-09-19T04:16:32.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.076+0000 7f2a3cbbc640 1 -- 172.21.15.7:0/1087376583 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a38108f80 con 0x7f2a38101c00 2024-09-19T04:16:32.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.077+0000 7f2a277fe640 1 -- 172.21.15.7:0/1087376583 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f2a28003f70 con 0x7f2a38101c00 2024-09-19T04:16:32.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.077+0000 7f2a277fe640 1 --2- 172.21.15.7:0/1087376583 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2a200a32d0 0x7f2a200a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:32.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.078+0000 7f2a35d9b640 1 --2- 172.21.15.7:0/1087376583 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2a200a32d0 0x7f2a200a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:32.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.078+0000 7f2a277fe640 1 -- 172.21.15.7:0/1087376583 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f2a280cf7a0 con 0x7f2a38101c00 2024-09-19T04:16:32.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.078+0000 7f2a35d9b640 1 --2- 172.21.15.7:0/1087376583 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2a200a32d0 0x7f2a200a5790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2a38075d10 tx=0x7f2a2c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:32.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.081+0000 7f2a277fe640 1 -- 172.21.15.7:0/1087376583 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2a28009de0 con 0x7f2a38101c00 2024-09-19T04:16:32.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.276+0000 7f2a3cbbc640 1 -- 172.21.15.7:0/1087376583 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f2a38062630 con 0x7f2a200a32d0 2024-09-19T04:16:32.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:32 smithi007 ceph-mon[31360]: pgmap v341: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T04:16:32.278 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:32 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:16:32.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.282+0000 7f2a277fe640 1 -- 172.21.15.7:0/1087376583 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f2a38062630 con 0x7f2a200a32d0 2024-09-19T04:16:32.284 INFO:teuthology.orchestra.run.smithi007.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T04:16:32.284 INFO:teuthology.orchestra.run.smithi007.stdout:mds.all 12/12 62s ago 2m smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi102=c;smithi102=f;smithi102=i;smithi102=l;count:12 2024-09-19T04:16:32.284 INFO:teuthology.orchestra.run.smithi007.stdout:mgr 3/3 62s ago 7m smithi007=x;smithi092=y;smithi102=z;count:3 2024-09-19T04:16:32.284 INFO:teuthology.orchestra.run.smithi007.stdout:mon 3/3 62s ago 8m smithi007:172.21.15.7=a;smithi092:172.21.15.92=b;smithi102:172.21.15.102=c;count:3 2024-09-19T04:16:32.284 INFO:teuthology.orchestra.run.smithi007.stdout:osd 12 62s ago - 2024-09-19T04:16:32.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.284+0000 7f2a3cbbc640 1 -- 172.21.15.7:0/1087376583 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2a200a32d0 msgr2=0x7f2a200a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:32.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.284+0000 7f2a3cbbc640 1 --2- 172.21.15.7:0/1087376583 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2a200a32d0 0x7f2a200a5790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2a38075d10 tx=0x7f2a2c005f90 comp rx=0 tx=0).stop 2024-09-19T04:16:32.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.284+0000 7f2a3cbbc640 1 -- 172.21.15.7:0/1087376583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a38101c00 msgr2=0x7f2a38075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:32.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.284+0000 7f2a3cbbc640 1 --2- 172.21.15.7:0/1087376583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a38101c00 0x7f2a38075f90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2a2800d770 tx=0x7f2a2800dc30 comp rx=0 tx=0).stop 2024-09-19T04:16:32.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.284+0000 7f2a3cbbc640 1 -- 172.21.15.7:0/1087376583 shutdown_connections 2024-09-19T04:16:32.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.284+0000 7f2a3cbbc640 1 --2- 172.21.15.7:0/1087376583 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2a200a32d0 0x7f2a200a5790 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:32.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.284+0000 7f2a3cbbc640 1 --2- 172.21.15.7:0/1087376583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a381037c0 0x7f2a38074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:32.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.284+0000 7f2a3cbbc640 1 --2- 172.21.15.7:0/1087376583 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a38102e00 0x7f2a380745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:32.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.284+0000 7f2a3cbbc640 1 --2- 172.21.15.7:0/1087376583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a38101c00 0x7f2a38075f90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:32.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.284+0000 7f2a3cbbc640 1 -- 172.21.15.7:0/1087376583 >> 172.21.15.7:0/1087376583 conn(0x7f2a380fd390 msgr2=0x7f2a38106150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:32.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.284+0000 7f2a3cbbc640 1 -- 172.21.15.7:0/1087376583 shutdown_connections 2024-09-19T04:16:32.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:32.284+0000 7f2a3cbbc640 1 -- 172.21.15.7:0/1087376583 wait complete. 2024-09-19T04:16:32.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:32 smithi092 ceph-mon[34940]: pgmap v341: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T04:16:32.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:32 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:16:32.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:32 smithi102 ceph-mon[35446]: pgmap v341: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T04:16:32.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:32 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:16:33.685 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T04:16:33.969 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:34.270 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:34 smithi007 ceph-mon[31360]: from='client.24863 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:16:34.270 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:34 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:16:34.270 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:34 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:16:34.271 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:34 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:16:34.271 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:34 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:16:34.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:34 smithi092 ceph-mon[34940]: from='client.24863 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:16:34.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:34 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:16:34.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:34 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:16:34.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:34 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:16:34.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:34 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:16:34.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:34 smithi102 ceph-mon[35446]: from='client.24863 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:16:34.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:34 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:16:34.410 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:34 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:16:34.410 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:34 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:16:34.410 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:34 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:16:34.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.466+0000 7f8c0a82e640 1 -- 172.21.15.7:0/3759089571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c04101cd0 msgr2=0x7f8c04102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:34.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.466+0000 7f8c0a82e640 1 --2- 172.21.15.7:0/3759089571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c04101cd0 0x7f8c04102150 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8009900 tx=0x7f8bf802a410 comp rx=0 tx=0).stop 2024-09-19T04:16:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.466+0000 7f8c0a82e640 1 -- 172.21.15.7:0/3759089571 shutdown_connections 2024-09-19T04:16:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.466+0000 7f8c0a82e640 1 --2- 172.21.15.7:0/3759089571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c04102690 0x7f8c04108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.466+0000 7f8c0a82e640 1 --2- 172.21.15.7:0/3759089571 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c04101cd0 0x7f8c04102150 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.466+0000 7f8c0a82e640 1 --2- 172.21.15.7:0/3759089571 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c04100ad0 0x7f8c04100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.466+0000 7f8c0a82e640 1 -- 172.21.15.7:0/3759089571 >> 172.21.15.7:0/3759089571 conn(0x7f8c040fc280 msgr2=0x7f8c040fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.466+0000 7f8c0a82e640 1 -- 172.21.15.7:0/3759089571 shutdown_connections 2024-09-19T04:16:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.466+0000 7f8c0a82e640 1 -- 172.21.15.7:0/3759089571 wait complete. 2024-09-19T04:16:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.467+0000 7f8c0a82e640 1 Processor -- start 2024-09-19T04:16:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.467+0000 7f8c0a82e640 1 -- start start 2024-09-19T04:16:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.467+0000 7f8c0a82e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c04100ad0 0x7f8c0410b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.467+0000 7f8c0a82e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c04101cd0 0x7f8c04109aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:34.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.467+0000 7f8c0a82e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c04102690 0x7f8c04109fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:34.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.467+0000 7f8c0a82e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0410d880 con 0x7f8c04101cd0 2024-09-19T04:16:34.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.467+0000 7f8c0a82e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0410d700 con 0x7f8c04102690 2024-09-19T04:16:34.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.467+0000 7f8c0a82e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0410da00 con 0x7f8c04100ad0 2024-09-19T04:16:34.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.467+0000 7f8c037fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c04101cd0 0x7f8c04109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:34.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.467+0000 7f8c037fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c04101cd0 0x7f8c04109aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50620/0 (socket says 172.21.15.7:50620) 2024-09-19T04:16:34.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.467+0000 7f8c037fe640 1 -- 172.21.15.7:0/833610989 learned_addr learned my addr 172.21.15.7:0/833610989 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:34.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.467+0000 7f8c08dcb640 1 --2- 172.21.15.7:0/833610989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c04102690 0x7f8c04109fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:34.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.467+0000 7f8c03fff640 1 --2- 172.21.15.7:0/833610989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c04100ad0 0x7f8c0410b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:34.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.467+0000 7f8c037fe640 1 -- 172.21.15.7:0/833610989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c04100ad0 msgr2=0x7f8c0410b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:34.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.467+0000 7f8c037fe640 1 --2- 172.21.15.7:0/833610989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c04100ad0 0x7f8c0410b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:34.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.467+0000 7f8c037fe640 1 -- 172.21.15.7:0/833610989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c04102690 msgr2=0x7f8c04109fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:34.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.467+0000 7f8c037fe640 1 --2- 172.21.15.7:0/833610989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c04102690 0x7f8c04109fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:34.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.467+0000 7f8c037fe640 1 -- 172.21.15.7:0/833610989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c0410a8a0 con 0x7f8c04101cd0 2024-09-19T04:16:34.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.468+0000 7f8c03fff640 1 --2- 172.21.15.7:0/833610989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c04100ad0 0x7f8c0410b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:16:34.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.468+0000 7f8c08dcb640 1 --2- 172.21.15.7:0/833610989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c04102690 0x7f8c04109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:16:34.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.468+0000 7f8c037fe640 1 --2- 172.21.15.7:0/833610989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c04101cd0 0x7f8c04109aa0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8009230 tx=0x7f8bf8004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:34.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.468+0000 7f8c017fa640 1 -- 172.21.15.7:0/833610989 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf803f030 con 0x7f8c04101cd0 2024-09-19T04:16:34.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.468+0000 7f8c0a82e640 1 -- 172.21.15.7:0/833610989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c041a1f90 con 0x7f8c04101cd0 2024-09-19T04:16:34.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.468+0000 7f8c017fa640 1 -- 172.21.15.7:0/833610989 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bf8003ce0 con 0x7f8c04101cd0 2024-09-19T04:16:34.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.468+0000 7f8c017fa640 1 -- 172.21.15.7:0/833610989 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8035070 con 0x7f8c04101cd0 2024-09-19T04:16:34.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.468+0000 7f8c0a82e640 1 -- 172.21.15.7:0/833610989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c041a2380 con 0x7f8c04101cd0 2024-09-19T04:16:34.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.469+0000 7f8c0a82e640 1 -- 172.21.15.7:0/833610989 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c04100ed0 con 0x7f8c04101cd0 2024-09-19T04:16:34.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.471+0000 7f8c017fa640 1 -- 172.21.15.7:0/833610989 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f8bf8042030 con 0x7f8c04101cd0 2024-09-19T04:16:34.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.472+0000 7f8c017fa640 1 --2- 172.21.15.7:0/833610989 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f8bec0a32d0 0x7f8bec0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:34.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.472+0000 7f8c017fa640 1 -- 172.21.15.7:0/833610989 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f8bf80f09c0 con 0x7f8c04101cd0 2024-09-19T04:16:34.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.472+0000 7f8c03fff640 1 --2- 172.21.15.7:0/833610989 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f8bec0a32d0 0x7f8bec0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:34.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.473+0000 7f8c03fff640 1 --2- 172.21.15.7:0/833610989 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f8bec0a32d0 0x7f8bec0a5790 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8c04101b30 tx=0x7f8bf4005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:34.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.475+0000 7f8c017fa640 1 -- 172.21.15.7:0/833610989 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8bf80bd1e0 con 0x7f8c04101cd0 2024-09-19T04:16:34.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.662+0000 7f8c0a82e640 1 -- 172.21.15.7:0/833610989 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f8c040626f0 con 0x7f8bec0a32d0 2024-09-19T04:16:34.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.663+0000 7f8c017fa640 1 -- 172.21.15.7:0/833610989 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f8c040626f0 con 0x7f8bec0a32d0 2024-09-19T04:16:34.665 INFO:teuthology.orchestra.run.smithi007.stdout:HOST ADDR LABELS STATUS 2024-09-19T04:16:34.665 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007 172.21.15.7 2024-09-19T04:16:34.665 INFO:teuthology.orchestra.run.smithi007.stdout:smithi092 172.21.15.92 2024-09-19T04:16:34.665 INFO:teuthology.orchestra.run.smithi007.stdout:smithi102 172.21.15.102 2024-09-19T04:16:34.665 INFO:teuthology.orchestra.run.smithi007.stdout:3 hosts in cluster 2024-09-19T04:16:34.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.665+0000 7f8c0a82e640 1 -- 172.21.15.7:0/833610989 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f8bec0a32d0 msgr2=0x7f8bec0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:34.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.665+0000 7f8c0a82e640 1 --2- 172.21.15.7:0/833610989 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f8bec0a32d0 0x7f8bec0a5790 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8c04101b30 tx=0x7f8bf4005d30 comp rx=0 tx=0).stop 2024-09-19T04:16:34.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.665+0000 7f8c0a82e640 1 -- 172.21.15.7:0/833610989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c04101cd0 msgr2=0x7f8c04109aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:34.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.665+0000 7f8c0a82e640 1 --2- 172.21.15.7:0/833610989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c04101cd0 0x7f8c04109aa0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8009230 tx=0x7f8bf8004430 comp rx=0 tx=0).stop 2024-09-19T04:16:34.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.665+0000 7f8c0a82e640 1 -- 172.21.15.7:0/833610989 shutdown_connections 2024-09-19T04:16:34.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.665+0000 7f8c0a82e640 1 --2- 172.21.15.7:0/833610989 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f8bec0a32d0 0x7f8bec0a5790 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:34.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.665+0000 7f8c0a82e640 1 --2- 172.21.15.7:0/833610989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8c04102690 0x7f8c04109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:34.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.665+0000 7f8c0a82e640 1 --2- 172.21.15.7:0/833610989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c04101cd0 0x7f8c04109aa0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:34.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.665+0000 7f8c0a82e640 1 --2- 172.21.15.7:0/833610989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8c04100ad0 0x7f8c0410b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:34.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.666+0000 7f8c0a82e640 1 -- 172.21.15.7:0/833610989 >> 172.21.15.7:0/833610989 conn(0x7f8c040fc280 msgr2=0x7f8c041050a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:34.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.666+0000 7f8c0a82e640 1 -- 172.21.15.7:0/833610989 shutdown_connections 2024-09-19T04:16:34.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:34.666+0000 7f8c0a82e640 1 -- 172.21.15.7:0/833610989 wait complete. 2024-09-19T04:16:35.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:35 smithi092 ceph-mon[34940]: pgmap v342: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T04:16:35.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:35 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:16:35.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:35 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:16:35.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:35 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:16:35.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:35 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:16:35.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:35 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:16:35.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:35 smithi007 ceph-mon[31360]: pgmap v342: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T04:16:35.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:35 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:16:35.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:35 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:16:35.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:35 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:16:35.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:35 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:16:35.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:35 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:16:35.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:35 smithi102 ceph-mon[35446]: pgmap v342: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T04:16:35.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:35 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:16:35.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:35 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:16:35.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:35 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:16:35.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:35 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:16:35.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:35 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:16:35.484 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T04:16:35.744 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:36.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:36 smithi007 ceph-mon[31360]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:16:36.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.251+0000 7f14bb819640 1 -- 172.21.15.7:0/3597898517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14b4101e50 msgr2=0x7f14b41086e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:36.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.251+0000 7f14bb819640 1 --2- 172.21.15.7:0/3597898517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14b4101e50 0x7f14b41086e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f14ac009ca0 tx=0x7f14ac02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:16:36.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.251+0000 7f14bb819640 1 -- 172.21.15.7:0/3597898517 shutdown_connections 2024-09-19T04:16:36.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.251+0000 7f14bb819640 1 --2- 172.21.15.7:0/3597898517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14b4101e50 0x7f14b41086e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:36.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.251+0000 7f14bb819640 1 --2- 172.21.15.7:0/3597898517 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14b4101490 0x7f14b4101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:36.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.251+0000 7f14bb819640 1 --2- 172.21.15.7:0/3597898517 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b4100290 0x7f14b4100690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:36.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.251+0000 7f14bb819640 1 -- 172.21.15.7:0/3597898517 >> 172.21.15.7:0/3597898517 conn(0x7f14b40fba40 msgr2=0x7f14b40fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:36.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.251+0000 7f14bb819640 1 -- 172.21.15.7:0/3597898517 shutdown_connections 2024-09-19T04:16:36.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.251+0000 7f14bb819640 1 -- 172.21.15.7:0/3597898517 wait complete. 2024-09-19T04:16:36.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.252+0000 7f14bb819640 1 Processor -- start 2024-09-19T04:16:36.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.252+0000 7f14bb819640 1 -- start start 2024-09-19T04:16:36.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.252+0000 7f14bb819640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14b4100290 0x7f14b4197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:36.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.252+0000 7f14bb819640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b4101490 0x7f14b41984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:36.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.252+0000 7f14bb819640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14b4101e50 0x7f14b419f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:36.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.252+0000 7f14bb819640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f14b410bf90 con 0x7f14b4101e50 2024-09-19T04:16:36.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.252+0000 7f14bb819640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f14b410be10 con 0x7f14b4100290 2024-09-19T04:16:36.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.252+0000 7f14bb819640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f14b410c110 con 0x7f14b4101490 2024-09-19T04:16:36.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.252+0000 7f14b9db6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14b4101e50 0x7f14b419f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:36.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.252+0000 7f14b9db6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14b4101e50 0x7f14b419f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50632/0 (socket says 172.21.15.7:50632) 2024-09-19T04:16:36.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.252+0000 7f14b9db6640 1 -- 172.21.15.7:0/205199301 learned_addr learned my addr 172.21.15.7:0/205199301 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:36.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.252+0000 7f14b95b5640 1 --2- 172.21.15.7:0/205199301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14b4100290 0x7f14b4197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:36.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.253+0000 7f14b9db6640 1 -- 172.21.15.7:0/205199301 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b4101490 msgr2=0x7f14b41984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:36.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.253+0000 7f14b9db6640 1 --2- 172.21.15.7:0/205199301 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b4101490 0x7f14b41984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:36.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.253+0000 7f14b9db6640 1 -- 172.21.15.7:0/205199301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14b4100290 msgr2=0x7f14b4197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:36.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.253+0000 7f14b9db6640 1 --2- 172.21.15.7:0/205199301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14b4100290 0x7f14b4197f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:36.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.253+0000 7f14b9db6640 1 -- 172.21.15.7:0/205199301 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14b419fbc0 con 0x7f14b4101e50 2024-09-19T04:16:36.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.253+0000 7f14b95b5640 1 --2- 172.21.15.7:0/205199301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14b4100290 0x7f14b4197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:16:36.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.253+0000 7f14b9db6640 1 --2- 172.21.15.7:0/205199301 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14b4101e50 0x7f14b419f550 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f14ac031ec0 tx=0x7f14ac031ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:36.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.253+0000 7f14aa7fc640 1 -- 172.21.15.7:0/205199301 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ac003c30 con 0x7f14b4101e50 2024-09-19T04:16:36.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.253+0000 7f14aa7fc640 1 -- 172.21.15.7:0/205199301 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14ac003dd0 con 0x7f14b4101e50 2024-09-19T04:16:36.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.253+0000 7f14bb819640 1 -- 172.21.15.7:0/205199301 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14b419fe50 con 0x7f14b4101e50 2024-09-19T04:16:36.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.253+0000 7f14aa7fc640 1 -- 172.21.15.7:0/205199301 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ac004770 con 0x7f14b4101e50 2024-09-19T04:16:36.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.253+0000 7f14bb819640 1 -- 172.21.15.7:0/205199301 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14b41a03e0 con 0x7f14b4101e50 2024-09-19T04:16:36.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.254+0000 7f14bb819640 1 -- 172.21.15.7:0/205199301 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14b41a0610 con 0x7f14b4101e50 2024-09-19T04:16:36.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.255+0000 7f14aa7fc640 1 -- 172.21.15.7:0/205199301 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f14ac02f790 con 0x7f14b4101e50 2024-09-19T04:16:36.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.256+0000 7f14aa7fc640 1 --2- 172.21.15.7:0/205199301 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f14a00a3300 0x7f14a00a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:36.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.256+0000 7f14b95b5640 1 --2- 172.21.15.7:0/205199301 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f14a00a3300 0x7f14a00a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:36.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.256+0000 7f14aa7fc640 1 -- 172.21.15.7:0/205199301 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f14ac0f1140 con 0x7f14b4101e50 2024-09-19T04:16:36.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.256+0000 7f14b95b5640 1 --2- 172.21.15.7:0/205199301 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f14a00a3300 0x7f14a00a57c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f14b41012f0 tx=0x7f14b0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:36.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.261+0000 7f14aa7fc640 1 -- 172.21.15.7:0/205199301 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f14ac0bdad0 con 0x7f14b4101e50 2024-09-19T04:16:36.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:36 smithi092 ceph-mon[34940]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:16:36.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:36 smithi102 ceph-mon[35446]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:16:36.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.445+0000 7f14bb819640 1 -- 172.21.15.7:0/205199301 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f14b41a07e0 con 0x7f14a00a3300 2024-09-19T04:16:36.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.447+0000 7f14aa7fc640 1 -- 172.21.15.7:0/205199301 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f14b41a07e0 con 0x7f14a00a3300 2024-09-19T04:16:36.448 INFO:teuthology.orchestra.run.smithi007.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T04:16:36.448 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300GE480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-19T04:16:36.448 INFO:teuthology.orchestra.run.smithi007.stdout:smithi092 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400QM400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-19T04:16:36.448 INFO:teuthology.orchestra.run.smithi007.stdout:smithi102 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400VK400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T04:16:36.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.449+0000 7f14bb819640 1 -- 172.21.15.7:0/205199301 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f14a00a3300 msgr2=0x7f14a00a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:36.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.449+0000 7f14bb819640 1 --2- 172.21.15.7:0/205199301 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f14a00a3300 0x7f14a00a57c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f14b41012f0 tx=0x7f14b0008040 comp rx=0 tx=0).stop 2024-09-19T04:16:36.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.449+0000 7f14bb819640 1 -- 172.21.15.7:0/205199301 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14b4101e50 msgr2=0x7f14b419f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:36.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.449+0000 7f14bb819640 1 --2- 172.21.15.7:0/205199301 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14b4101e50 0x7f14b419f550 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f14ac031ec0 tx=0x7f14ac031ef0 comp rx=0 tx=0).stop 2024-09-19T04:16:36.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.449+0000 7f14bb819640 1 -- 172.21.15.7:0/205199301 shutdown_connections 2024-09-19T04:16:36.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.449+0000 7f14bb819640 1 --2- 172.21.15.7:0/205199301 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f14a00a3300 0x7f14a00a57c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:36.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.449+0000 7f14bb819640 1 --2- 172.21.15.7:0/205199301 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f14b4101e50 0x7f14b419f550 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:36.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.449+0000 7f14bb819640 1 --2- 172.21.15.7:0/205199301 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b4101490 0x7f14b41984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:36.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.449+0000 7f14bb819640 1 --2- 172.21.15.7:0/205199301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f14b4100290 0x7f14b4197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:36.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.449+0000 7f14bb819640 1 -- 172.21.15.7:0/205199301 >> 172.21.15.7:0/205199301 conn(0x7f14b40fba40 msgr2=0x7f14b40fd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:36.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.449+0000 7f14bb819640 1 -- 172.21.15.7:0/205199301 shutdown_connections 2024-09-19T04:16:36.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:36.449+0000 7f14bb819640 1 -- 172.21.15.7:0/205199301 wait complete. 2024-09-19T04:16:37.084 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T04:16:37.093 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-09-19T04:16:37.093 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T04:16:37.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:37 smithi092 ceph-mon[34940]: pgmap v343: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T04:16:37.357 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:37.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:37 smithi007 ceph-mon[31360]: pgmap v343: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T04:16:37.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:37 smithi102 ceph-mon[35446]: pgmap v343: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T04:16:37.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.819+0000 7f284bf95640 1 -- 172.21.15.7:0/1163537553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2844102e00 msgr2=0x7f2844103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.819+0000 7f284bf95640 1 --2- 172.21.15.7:0/1163537553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2844102e00 0x7f2844103280 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2834009900 tx=0x7f283402a3f0 comp rx=0 tx=0).stop 2024-09-19T04:16:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.819+0000 7f284bf95640 1 -- 172.21.15.7:0/1163537553 shutdown_connections 2024-09-19T04:16:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.819+0000 7f284bf95640 1 --2- 172.21.15.7:0/1163537553 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28441037c0 0x7f284410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.819+0000 7f284bf95640 1 --2- 172.21.15.7:0/1163537553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2844102e00 0x7f2844103280 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.819+0000 7f284bf95640 1 --2- 172.21.15.7:0/1163537553 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2844101c00 0x7f2844102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.819+0000 7f284bf95640 1 -- 172.21.15.7:0/1163537553 >> 172.21.15.7:0/1163537553 conn(0x7f28440fd390 msgr2=0x7f28440ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.819+0000 7f284bf95640 1 -- 172.21.15.7:0/1163537553 shutdown_connections 2024-09-19T04:16:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.819+0000 7f284bf95640 1 -- 172.21.15.7:0/1163537553 wait complete. 2024-09-19T04:16:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.820+0000 7f284bf95640 1 Processor -- start 2024-09-19T04:16:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.820+0000 7f284bf95640 1 -- start start 2024-09-19T04:16:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.820+0000 7f284bf95640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2844101c00 0x7f2844197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.820+0000 7f284bf95640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2844102e00 0x7f2844198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:37.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.820+0000 7f284bf95640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28441037c0 0x7f284419f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:37.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.820+0000 7f284bf95640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f284410d900 con 0x7f28441037c0 2024-09-19T04:16:37.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.820+0000 7f284bf95640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f284410d780 con 0x7f2844101c00 2024-09-19T04:16:37.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.820+0000 7f284bf95640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f284410da80 con 0x7f2844102e00 2024-09-19T04:16:37.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.820+0000 7f284a532640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28441037c0 0x7f284419f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:37.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.820+0000 7f284a532640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28441037c0 0x7f284419f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57384/0 (socket says 172.21.15.7:57384) 2024-09-19T04:16:37.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.820+0000 7f284a532640 1 -- 172.21.15.7:0/3860566492 learned_addr learned my addr 172.21.15.7:0/3860566492 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:37.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.820+0000 7f2849d31640 1 --2- 172.21.15.7:0/3860566492 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2844101c00 0x7f2844197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:37.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.820+0000 7f2849530640 1 --2- 172.21.15.7:0/3860566492 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2844102e00 0x7f2844198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:37.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.821+0000 7f284a532640 1 -- 172.21.15.7:0/3860566492 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2844102e00 msgr2=0x7f2844198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:37.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.821+0000 7f284a532640 1 --2- 172.21.15.7:0/3860566492 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2844102e00 0x7f2844198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:37.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.821+0000 7f284a532640 1 -- 172.21.15.7:0/3860566492 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2844101c00 msgr2=0x7f2844197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:37.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.821+0000 7f284a532640 1 --2- 172.21.15.7:0/3860566492 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2844101c00 0x7f2844197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:37.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.821+0000 7f284a532640 1 -- 172.21.15.7:0/3860566492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f284419fb50 con 0x7f28441037c0 2024-09-19T04:16:37.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.821+0000 7f284a532640 1 --2- 172.21.15.7:0/3860566492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28441037c0 0x7f284419f4e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f283c00cce0 tx=0x7f283c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:37.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.821+0000 7f283affd640 1 -- 172.21.15.7:0/3860566492 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c00f450 con 0x7f28441037c0 2024-09-19T04:16:37.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.821+0000 7f283affd640 1 -- 172.21.15.7:0/3860566492 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f283c00fad0 con 0x7f28441037c0 2024-09-19T04:16:37.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.821+0000 7f284bf95640 1 -- 172.21.15.7:0/3860566492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f284419fe40 con 0x7f28441037c0 2024-09-19T04:16:37.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.821+0000 7f283affd640 1 -- 172.21.15.7:0/3860566492 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f283c018b60 con 0x7f28441037c0 2024-09-19T04:16:37.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.821+0000 7f284bf95640 1 -- 172.21.15.7:0/3860566492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28441a0320 con 0x7f28441037c0 2024-09-19T04:16:37.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.822+0000 7f284bf95640 1 -- 172.21.15.7:0/3860566492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2844108fb0 con 0x7f28441037c0 2024-09-19T04:16:37.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.823+0000 7f283affd640 1 -- 172.21.15.7:0/3860566492 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f283c00fc80 con 0x7f28441037c0 2024-09-19T04:16:37.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.824+0000 7f283affd640 1 --2- 172.21.15.7:0/3860566492 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f28300a3300 0x7f28300a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:37.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.824+0000 7f2849d31640 1 --2- 172.21.15.7:0/3860566492 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f28300a3300 0x7f28300a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:37.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.824+0000 7f283affd640 1 -- 172.21.15.7:0/3860566492 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f283c0d0330 con 0x7f28441037c0 2024-09-19T04:16:37.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.824+0000 7f2849d31640 1 --2- 172.21.15.7:0/3860566492 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f28300a3300 0x7f28300a57c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2844102c60 tx=0x7f2840009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:37.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:37.828+0000 7f283affd640 1 -- 172.21.15.7:0/3860566492 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f283c014030 con 0x7f28441037c0 2024-09-19T04:16:38.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:38.041+0000 7f284bf95640 1 -- 172.21.15.7:0/3860566492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f284402d7c0 con 0x7f28441037c0 2024-09-19T04:16:38.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:38.042+0000 7f283affd640 1 -- 172.21.15.7:0/3860566492 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3122 (secure 0 0 0) 0x7f283c09cb50 con 0x7f28441037c0 2024-09-19T04:16:38.043 INFO:teuthology.orchestra.run.smithi007.stdout:e27 2024-09-19T04:16:38.044 INFO:teuthology.orchestra.run.smithi007.stdout:btime 2024-09-19T04:15:17:816953+0000 2024-09-19T04:16:38.044 INFO:teuthology.orchestra.run.smithi007.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T04:16:38.044 INFO:teuthology.orchestra.run.smithi007.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T04:16:38.044 INFO:teuthology.orchestra.run.smithi007.stdout:legacy client fscid: 1 2024-09-19T04:16:38.044 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:16:38.044 INFO:teuthology.orchestra.run.smithi007.stdout:Filesystem 'cephfs' (1) 2024-09-19T04:16:38.044 INFO:teuthology.orchestra.run.smithi007.stdout:fs_name cephfs 2024-09-19T04:16:38.044 INFO:teuthology.orchestra.run.smithi007.stdout:epoch 27 2024-09-19T04:16:38.044 INFO:teuthology.orchestra.run.smithi007.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T04:16:38.045 INFO:teuthology.orchestra.run.smithi007.stdout:created 2024-09-19T04:14:34.007803+0000 2024-09-19T04:16:38.045 INFO:teuthology.orchestra.run.smithi007.stdout:modified 2024-09-19T04:15:17.816938+0000 2024-09-19T04:16:38.045 INFO:teuthology.orchestra.run.smithi007.stdout:tableserver 0 2024-09-19T04:16:38.045 INFO:teuthology.orchestra.run.smithi007.stdout:root 0 2024-09-19T04:16:38.045 INFO:teuthology.orchestra.run.smithi007.stdout:session_timeout 300 2024-09-19T04:16:38.045 INFO:teuthology.orchestra.run.smithi007.stdout:session_autoclose 300 2024-09-19T04:16:38.045 INFO:teuthology.orchestra.run.smithi007.stdout:max_file_size 1099511627776 2024-09-19T04:16:38.045 INFO:teuthology.orchestra.run.smithi007.stdout:max_xattr_size 65536 2024-09-19T04:16:38.045 INFO:teuthology.orchestra.run.smithi007.stdout:required_client_features {} 2024-09-19T04:16:38.045 INFO:teuthology.orchestra.run.smithi007.stdout:last_failure 0 2024-09-19T04:16:38.045 INFO:teuthology.orchestra.run.smithi007.stdout:last_failure_osd_epoch 0 2024-09-19T04:16:38.045 INFO:teuthology.orchestra.run.smithi007.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T04:16:38.045 INFO:teuthology.orchestra.run.smithi007.stdout:max_mds 5 2024-09-19T04:16:38.046 INFO:teuthology.orchestra.run.smithi007.stdout:in 0,1,2,3,4 2024-09-19T04:16:38.046 INFO:teuthology.orchestra.run.smithi007.stdout:up {0=24506,1=24496,2=24482,3=24478,4=24472} 2024-09-19T04:16:38.046 INFO:teuthology.orchestra.run.smithi007.stdout:failed 2024-09-19T04:16:38.046 INFO:teuthology.orchestra.run.smithi007.stdout:damaged 2024-09-19T04:16:38.046 INFO:teuthology.orchestra.run.smithi007.stdout:stopped 2024-09-19T04:16:38.046 INFO:teuthology.orchestra.run.smithi007.stdout:data_pools [3,4] 2024-09-19T04:16:38.046 INFO:teuthology.orchestra.run.smithi007.stdout:metadata_pool 2 2024-09-19T04:16:38.046 INFO:teuthology.orchestra.run.smithi007.stdout:inline_data disabled 2024-09-19T04:16:38.046 INFO:teuthology.orchestra.run.smithi007.stdout:balancer 2024-09-19T04:16:38.046 INFO:teuthology.orchestra.run.smithi007.stdout:bal_rank_mask -1 2024-09-19T04:16:38.046 INFO:teuthology.orchestra.run.smithi007.stdout:standby_count_wanted 0 2024-09-19T04:16:38.046 INFO:teuthology.orchestra.run.smithi007.stdout:qdb_cluster leader: 24506 members: 24506,24496,24482,24478,24472 2024-09-19T04:16:38.047 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.b{0:24506} state up:active seq 4 addr [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:16:38.047 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.e{0:24461} state up:standby-replay seq 1 addr [v2:172.21.15.92:6834/4235013488,v1:172.21.15.92:6835/4235013488] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:16:38.047 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.i{1:24496} state up:active seq 16 addr [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:16:38.047 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.k{1:24431} state up:standby-replay seq 1 addr [v2:172.21.15.92:6832/4006669352,v1:172.21.15.92:6833/4006669352] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:16:38.047 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.h{2:24482} state up:active seq 17 addr [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:16:38.047 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.l{2:24424} state up:standby-replay seq 1 addr [v2:172.21.15.102:6832/3063042931,v1:172.21.15.102:6833/3063042931] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:16:38.047 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.c{3:24478} state up:active seq 18 addr [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:16:38.047 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.a{3:14595} state up:standby-replay seq 1 addr [v2:172.21.15.7:6840/4142126419,v1:172.21.15.7:6841/4142126419] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:16:38.047 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.f{4:24472} state up:active seq 19 addr [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:16:38.047 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.g{4:14583} state up:standby-replay seq 1 addr [v2:172.21.15.7:6838/2492396165,v1:172.21.15.7:6839/2492396165] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:16:38.047 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:16:38.047 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:16:38.047 INFO:teuthology.orchestra.run.smithi007.stdout:Standby daemons: 2024-09-19T04:16:38.048 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:16:38.048 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.j{-1:14529} state up:standby seq 1 addr [v2:172.21.15.7:6834/2094187873,v1:172.21.15.7:6835/2094187873] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:16:38.048 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.d{-1:14541} state up:standby seq 1 addr [v2:172.21.15.7:6836/1197784412,v1:172.21.15.7:6837/1197784412] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:16:38.048 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 27 2024-09-19T04:16:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:38.044+0000 7f284bf95640 1 -- 172.21.15.7:0/3860566492 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f28300a3300 msgr2=0x7f28300a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:38.044+0000 7f284bf95640 1 --2- 172.21.15.7:0/3860566492 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f28300a3300 0x7f28300a57c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2844102c60 tx=0x7f2840009110 comp rx=0 tx=0).stop 2024-09-19T04:16:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:38.044+0000 7f284bf95640 1 -- 172.21.15.7:0/3860566492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28441037c0 msgr2=0x7f284419f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:38.044+0000 7f284bf95640 1 --2- 172.21.15.7:0/3860566492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28441037c0 0x7f284419f4e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f283c00cce0 tx=0x7f283c00a620 comp rx=0 tx=0).stop 2024-09-19T04:16:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:38.044+0000 7f284bf95640 1 -- 172.21.15.7:0/3860566492 shutdown_connections 2024-09-19T04:16:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:38.044+0000 7f284bf95640 1 --2- 172.21.15.7:0/3860566492 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f28300a3300 0x7f28300a57c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:38.044+0000 7f284bf95640 1 --2- 172.21.15.7:0/3860566492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28441037c0 0x7f284419f4e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:38.044+0000 7f284bf95640 1 --2- 172.21.15.7:0/3860566492 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2844102e00 0x7f2844198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:38.044+0000 7f284bf95640 1 --2- 172.21.15.7:0/3860566492 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2844101c00 0x7f2844197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:38.044+0000 7f284bf95640 1 -- 172.21.15.7:0/3860566492 >> 172.21.15.7:0/3860566492 conn(0x7f28440fd390 msgr2=0x7f2844106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:38.044+0000 7f284bf95640 1 -- 172.21.15.7:0/3860566492 shutdown_connections 2024-09-19T04:16:38.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:38.044+0000 7f284bf95640 1 -- 172.21.15.7:0/3860566492 wait complete. 2024-09-19T04:16:38.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:38 smithi092 ceph-mon[34940]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:16:38.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:38 smithi007 ceph-mon[31360]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:16:38.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:38 smithi102 ceph-mon[35446]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:16:38.686 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-19T04:16:38.946 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:39.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:39 smithi092 ceph-mon[34940]: pgmap v344: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T04:16:39.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:39 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3860566492' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T04:16:39.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:39 smithi007 ceph-mon[31360]: pgmap v344: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T04:16:39.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:39 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3860566492' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T04:16:39.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:39 smithi102 ceph-mon[35446]: pgmap v344: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T04:16:39.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:39 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3860566492' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T04:16:39.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.391+0000 7effd49bd640 1 -- 172.21.15.7:0/2537854580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effd0102690 msgr2=0x7effd0108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:39.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.391+0000 7effd49bd640 1 --2- 172.21.15.7:0/2537854580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effd0102690 0x7effd0108f20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7effc8009ca0 tx=0x7effc802a8c0 comp rx=0 tx=0).stop 2024-09-19T04:16:39.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.391+0000 7effd49bd640 1 -- 172.21.15.7:0/2537854580 shutdown_connections 2024-09-19T04:16:39.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.391+0000 7effd49bd640 1 --2- 172.21.15.7:0/2537854580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effd0102690 0x7effd0108f20 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:39.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.391+0000 7effd49bd640 1 --2- 172.21.15.7:0/2537854580 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effd0101cd0 0x7effd0102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:39.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.391+0000 7effd49bd640 1 --2- 172.21.15.7:0/2537854580 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effd0100ad0 0x7effd0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:39.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.391+0000 7effd49bd640 1 -- 172.21.15.7:0/2537854580 >> 172.21.15.7:0/2537854580 conn(0x7effd00fc280 msgr2=0x7effd00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:39.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.391+0000 7effd49bd640 1 -- 172.21.15.7:0/2537854580 shutdown_connections 2024-09-19T04:16:39.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.391+0000 7effd49bd640 1 -- 172.21.15.7:0/2537854580 wait complete. 2024-09-19T04:16:39.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.392+0000 7effd49bd640 1 Processor -- start 2024-09-19T04:16:39.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.392+0000 7effd49bd640 1 -- start start 2024-09-19T04:16:39.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.392+0000 7effd49bd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effd0100ad0 0x7effd006aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:39.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.392+0000 7effd49bd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effd0101cd0 0x7effd019cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:39.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.392+0000 7effd49bd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effd0102690 0x7effd019f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:39.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.392+0000 7effd49bd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7effd010c730 con 0x7effd0100ad0 2024-09-19T04:16:39.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.392+0000 7effd49bd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7effd010c5b0 con 0x7effd0101cd0 2024-09-19T04:16:39.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.392+0000 7effd49bd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7effd010c8b0 con 0x7effd0102690 2024-09-19T04:16:39.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.392+0000 7effce59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effd0100ad0 0x7effd006aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:39.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.393+0000 7effce59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effd0100ad0 0x7effd006aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57414/0 (socket says 172.21.15.7:57414) 2024-09-19T04:16:39.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.393+0000 7effce59c640 1 -- 172.21.15.7:0/2300832878 learned_addr learned my addr 172.21.15.7:0/2300832878 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:39.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.393+0000 7effcdd9b640 1 --2- 172.21.15.7:0/2300832878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effd0101cd0 0x7effd019cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:39.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.393+0000 7effced9d640 1 --2- 172.21.15.7:0/2300832878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effd0102690 0x7effd019f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:39.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.393+0000 7effce59c640 1 -- 172.21.15.7:0/2300832878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effd0102690 msgr2=0x7effd019f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:39.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.393+0000 7effce59c640 1 --2- 172.21.15.7:0/2300832878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effd0102690 0x7effd019f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:39.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.393+0000 7effce59c640 1 -- 172.21.15.7:0/2300832878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effd0101cd0 msgr2=0x7effd019cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:39.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.393+0000 7effce59c640 1 --2- 172.21.15.7:0/2300832878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effd0101cd0 0x7effd019cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:39.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.393+0000 7effce59c640 1 -- 172.21.15.7:0/2300832878 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd019fb10 con 0x7effd0100ad0 2024-09-19T04:16:39.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.393+0000 7effced9d640 1 --2- 172.21.15.7:0/2300832878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effd0102690 0x7effd019f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:16:39.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.393+0000 7effce59c640 1 --2- 172.21.15.7:0/2300832878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effd0100ad0 0x7effd006aad0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7effc000d770 tx=0x7effc000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:39.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.393+0000 7effbf7fe640 1 -- 172.21.15.7:0/2300832878 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc0017070 con 0x7effd0100ad0 2024-09-19T04:16:39.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.393+0000 7effbf7fe640 1 -- 172.21.15.7:0/2300832878 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effc0009c30 con 0x7effd0100ad0 2024-09-19T04:16:39.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.393+0000 7effd49bd640 1 -- 172.21.15.7:0/2300832878 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effd019fda0 con 0x7effd0100ad0 2024-09-19T04:16:39.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.393+0000 7effbf7fe640 1 -- 172.21.15.7:0/2300832878 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc0003dd0 con 0x7effd0100ad0 2024-09-19T04:16:39.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.393+0000 7effd49bd640 1 -- 172.21.15.7:0/2300832878 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effd01a0250 con 0x7effd0100ad0 2024-09-19T04:16:39.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.394+0000 7effd49bd640 1 -- 172.21.15.7:0/2300832878 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effd0107ef0 con 0x7effd0100ad0 2024-09-19T04:16:39.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.395+0000 7effbf7fe640 1 -- 172.21.15.7:0/2300832878 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7effc0003fb0 con 0x7effd0100ad0 2024-09-19T04:16:39.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.396+0000 7effbf7fe640 1 --2- 172.21.15.7:0/2300832878 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7effb80a32d0 0x7effb80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:39.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.396+0000 7effcdd9b640 1 --2- 172.21.15.7:0/2300832878 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7effb80a32d0 0x7effb80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:39.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.396+0000 7effbf7fe640 1 -- 172.21.15.7:0/2300832878 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7effc00cf800 con 0x7effd0100ad0 2024-09-19T04:16:39.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.397+0000 7effcdd9b640 1 --2- 172.21.15.7:0/2300832878 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7effb80a32d0 0x7effb80a5790 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7effd006b050 tx=0x7effc400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:39.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.400+0000 7effbf7fe640 1 -- 172.21.15.7:0/2300832878 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7effc009c020 con 0x7effd0100ad0 2024-09-19T04:16:39.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.578+0000 7effd49bd640 1 -- 172.21.15.7:0/2300832878 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7effd002da70 con 0x7effd0100ad0 2024-09-19T04:16:39.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.579+0000 7effbf7fe640 1 -- 172.21.15.7:0/2300832878 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v88) ==== 56+0+5538 (secure 0 0 0) 0x7effc0009de0 con 0x7effd0100ad0 2024-09-19T04:16:39.581 INFO:teuthology.orchestra.run.smithi007.stdout:epoch 88 2024-09-19T04:16:39.581 INFO:teuthology.orchestra.run.smithi007.stdout:fsid 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:16:39.581 INFO:teuthology.orchestra.run.smithi007.stdout:created 2024-09-19T04:06:58.337394+0000 2024-09-19T04:16:39.581 INFO:teuthology.orchestra.run.smithi007.stdout:modified 2024-09-19T04:15:46.990958+0000 2024-09-19T04:16:39.581 INFO:teuthology.orchestra.run.smithi007.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-19T04:16:39.581 INFO:teuthology.orchestra.run.smithi007.stdout:crush_version 27 2024-09-19T04:16:39.581 INFO:teuthology.orchestra.run.smithi007.stdout:full_ratio 0.95 2024-09-19T04:16:39.582 INFO:teuthology.orchestra.run.smithi007.stdout:backfillfull_ratio 0.9 2024-09-19T04:16:39.582 INFO:teuthology.orchestra.run.smithi007.stdout:nearfull_ratio 0.85 2024-09-19T04:16:39.582 INFO:teuthology.orchestra.run.smithi007.stdout:require_min_compat_client luminous 2024-09-19T04:16:39.582 INFO:teuthology.orchestra.run.smithi007.stdout:min_compat_client luminous 2024-09-19T04:16:39.582 INFO:teuthology.orchestra.run.smithi007.stdout:require_osd_release squid 2024-09-19T04:16:39.582 INFO:teuthology.orchestra.run.smithi007.stdout:stretch_mode_enabled false 2024-09-19T04:16:39.582 INFO:teuthology.orchestra.run.smithi007.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-19T04:16:39.582 INFO:teuthology.orchestra.run.smithi007.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-19T04:16:39.582 INFO:teuthology.orchestra.run.smithi007.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-19T04:16:39.582 INFO:teuthology.orchestra.run.smithi007.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 86 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-19T04:16:39.582 INFO:teuthology.orchestra.run.smithi007.stdout:max_osd 12 2024-09-19T04:16:39.582 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 up in weight 1 up_from 8 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6802/240599233,v1:172.21.15.7:6803/240599233] [v2:172.21.15.7:6804/240599233,v1:172.21.15.7:6805/240599233] exists,up d9b93bd5-ee22-4fb0-ba29-bfa208430a86 2024-09-19T04:16:39.582 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 up in weight 1 up_from 13 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6800/902403333,v1:172.21.15.92:6801/902403333] [v2:172.21.15.92:6802/902403333,v1:172.21.15.92:6803/902403333] exists,up db5793e6-f3ad-4075-a02b-206bf7f1e59a 2024-09-19T04:16:39.583 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 up in weight 1 up_from 18 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6800/2078441772,v1:172.21.15.102:6801/2078441772] [v2:172.21.15.102:6802/2078441772,v1:172.21.15.102:6803/2078441772] exists,up 1eb83a1b-82d8-4983-bae3-b161adb3a33a 2024-09-19T04:16:39.583 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 up in weight 1 up_from 24 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6810/2729561132,v1:172.21.15.7:6811/2729561132] [v2:172.21.15.7:6812/2729561132,v1:172.21.15.7:6813/2729561132] exists,up 68ba79e5-bcf0-4349-9e14-42f2fa9c11b9 2024-09-19T04:16:39.583 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 up in weight 1 up_from 31 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6808/2799734294,v1:172.21.15.92:6809/2799734294] [v2:172.21.15.92:6810/2799734294,v1:172.21.15.92:6811/2799734294] exists,up f20d4a51-121f-4ac8-afeb-5962d83bd697 2024-09-19T04:16:39.583 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 up in weight 1 up_from 36 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6808/3099678146,v1:172.21.15.102:6809/3099678146] [v2:172.21.15.102:6810/3099678146,v1:172.21.15.102:6811/3099678146] exists,up aac02b0a-99dc-4457-8898-c68dc196517a 2024-09-19T04:16:39.583 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 up in weight 1 up_from 43 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6818/1569704304,v1:172.21.15.7:6819/1569704304] [v2:172.21.15.7:6820/1569704304,v1:172.21.15.7:6821/1569704304] exists,up 7e5a8b30-8406-486c-ace5-79158a3757a2 2024-09-19T04:16:39.583 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 up in weight 1 up_from 48 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6816/3411102480,v1:172.21.15.92:6817/3411102480] [v2:172.21.15.92:6818/3411102480,v1:172.21.15.92:6819/3411102480] exists,up e6a7049a-17a1-43b2-8ecd-5f4ca7c337be 2024-09-19T04:16:39.583 INFO:teuthology.orchestra.run.smithi007.stdout:osd.8 up in weight 1 up_from 55 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6816/2990859925,v1:172.21.15.102:6817/2990859925] [v2:172.21.15.102:6818/2990859925,v1:172.21.15.102:6819/2990859925] exists,up 31879baa-861d-4322-990f-0b9a42b8b610 2024-09-19T04:16:39.583 INFO:teuthology.orchestra.run.smithi007.stdout:osd.9 up in weight 1 up_from 62 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6826/1710319475,v1:172.21.15.7:6827/1710319475] [v2:172.21.15.7:6828/1710319475,v1:172.21.15.7:6829/1710319475] exists,up 6d65db33-926c-4a6e-a072-707e9c9de92a 2024-09-19T04:16:39.583 INFO:teuthology.orchestra.run.smithi007.stdout:osd.10 up in weight 1 up_from 67 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6824/1063265541,v1:172.21.15.92:6825/1063265541] [v2:172.21.15.92:6826/1063265541,v1:172.21.15.92:6827/1063265541] exists,up 9ab681ee-0bef-47bd-bf3d-20b17c6b870c 2024-09-19T04:16:39.583 INFO:teuthology.orchestra.run.smithi007.stdout:osd.11 up in weight 1 up_from 74 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6824/1175425599,v1:172.21.15.102:6825/1175425599] [v2:172.21.15.102:6826/1175425599,v1:172.21.15.102:6827/1175425599] exists,up dc398e14-5f9e-4f0a-b158-35cbc1f73a83 2024-09-19T04:16:39.583 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.2 [3,9,5,8] 2024-09-19T04:16:39.583 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.c [5,6] 2024-09-19T04:16:39.583 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.11 [4,6] 2024-09-19T04:16:39.584 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.12 [3,9] 2024-09-19T04:16:39.584 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.27 [4,7] 2024-09-19T04:16:39.584 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.3a [4,8] 2024-09-19T04:16:39.584 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.3c [4,9] 2024-09-19T04:16:39.584 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 4.2 [9,1] 2024-09-19T04:16:39.584 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 4.1b [9,8] 2024-09-19T04:16:39.584 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/2883028938 expires 2024-09-20T04:07:45.039922+0000 2024-09-19T04:16:39.584 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/1186412739 expires 2024-09-20T04:07:45.039922+0000 2024-09-19T04:16:39.584 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:6800/751091002 expires 2024-09-20T04:07:45.039922+0000 2024-09-19T04:16:39.584 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:6801/751091002 expires 2024-09-20T04:07:45.039922+0000 2024-09-19T04:16:39.584 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:6801/940106179 expires 2024-09-20T04:07:20.364033+0000 2024-09-19T04:16:39.584 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:6800/940106179 expires 2024-09-20T04:07:20.364033+0000 2024-09-19T04:16:39.585 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/1450115700 expires 2024-09-20T04:07:20.364033+0000 2024-09-19T04:16:39.585 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/2954294373 expires 2024-09-20T04:07:20.364033+0000 2024-09-19T04:16:39.585 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/1996930242 expires 2024-09-20T04:07:45.039922+0000 2024-09-19T04:16:39.585 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/3562231347 expires 2024-09-20T04:07:20.364033+0000 2024-09-19T04:16:39.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.582+0000 7effd49bd640 1 -- 172.21.15.7:0/2300832878 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7effb80a32d0 msgr2=0x7effb80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:39.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.582+0000 7effd49bd640 1 --2- 172.21.15.7:0/2300832878 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7effb80a32d0 0x7effb80a5790 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7effd006b050 tx=0x7effc400b410 comp rx=0 tx=0).stop 2024-09-19T04:16:39.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.582+0000 7effd49bd640 1 -- 172.21.15.7:0/2300832878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effd0100ad0 msgr2=0x7effd006aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:39.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.582+0000 7effd49bd640 1 --2- 172.21.15.7:0/2300832878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effd0100ad0 0x7effd006aad0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7effc000d770 tx=0x7effc000dc30 comp rx=0 tx=0).stop 2024-09-19T04:16:39.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.583+0000 7effd49bd640 1 -- 172.21.15.7:0/2300832878 shutdown_connections 2024-09-19T04:16:39.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.583+0000 7effd49bd640 1 --2- 172.21.15.7:0/2300832878 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7effb80a32d0 0x7effb80a5790 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:39.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.583+0000 7effd49bd640 1 --2- 172.21.15.7:0/2300832878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effd0102690 0x7effd019f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:39.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.583+0000 7effd49bd640 1 --2- 172.21.15.7:0/2300832878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effd0101cd0 0x7effd019cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:39.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.583+0000 7effd49bd640 1 --2- 172.21.15.7:0/2300832878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effd0100ad0 0x7effd006aad0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:39.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.583+0000 7effd49bd640 1 -- 172.21.15.7:0/2300832878 >> 172.21.15.7:0/2300832878 conn(0x7effd00fc280 msgr2=0x7effd01050c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:39.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.583+0000 7effd49bd640 1 -- 172.21.15.7:0/2300832878 shutdown_connections 2024-09-19T04:16:39.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:39.583+0000 7effd49bd640 1 -- 172.21.15.7:0/2300832878 wait complete. 2024-09-19T04:16:40.293 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:40 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2300832878' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T04:16:40.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:40 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2300832878' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T04:16:40.324 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-19T04:16:40.337 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:16:40.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:40 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2300832878' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T04:16:40.598 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:41.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.070+0000 7f51b072f640 1 -- 172.21.15.7:0/2108747404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51a8102ef0 msgr2=0x7f51a810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:41.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.070+0000 7f51b072f640 1 --2- 172.21.15.7:0/2108747404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51a8102ef0 0x7f51a810da40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f51a0009ca0 tx=0x7f51a002a950 comp rx=0 tx=0).stop 2024-09-19T04:16:41.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.070+0000 7f51b072f640 1 -- 172.21.15.7:0/2108747404 shutdown_connections 2024-09-19T04:16:41.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.070+0000 7f51b072f640 1 --2- 172.21.15.7:0/2108747404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51a8102ef0 0x7f51a810da40 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:41.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.070+0000 7f51b072f640 1 --2- 172.21.15.7:0/2108747404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51a8102570 0x7f51a81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:41.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.070+0000 7f51b072f640 1 --2- 172.21.15.7:0/2108747404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51a8100e20 0x7f51a8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:41.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.070+0000 7f51b072f640 1 -- 172.21.15.7:0/2108747404 >> 172.21.15.7:0/2108747404 conn(0x7f51a80fc7d0 msgr2=0x7f51a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:41.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.070+0000 7f51b072f640 1 -- 172.21.15.7:0/2108747404 shutdown_connections 2024-09-19T04:16:41.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.070+0000 7f51b072f640 1 -- 172.21.15.7:0/2108747404 wait complete. 2024-09-19T04:16:41.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.070+0000 7f51b072f640 1 Processor -- start 2024-09-19T04:16:41.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.071+0000 7f51b072f640 1 -- start start 2024-09-19T04:16:41.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.071+0000 7f51b072f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51a8100e20 0x7f51a80fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:41.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.071+0000 7f51b072f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51a8102570 0x7f51a80fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:41.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.071+0000 7f51b072f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51a8102ef0 0x7f51a80fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:41.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.071+0000 7f51b072f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f51a8110fa0 con 0x7f51a8102ef0 2024-09-19T04:16:41.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.071+0000 7f51b072f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f51a8110e20 con 0x7f51a8102570 2024-09-19T04:16:41.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.071+0000 7f51b072f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f51a8111120 con 0x7f51a8100e20 2024-09-19T04:16:41.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.071+0000 7f51aeccc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51a8102ef0 0x7f51a80fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:41.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.071+0000 7f51aeccc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51a8102ef0 0x7f51a80fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57420/0 (socket says 172.21.15.7:57420) 2024-09-19T04:16:41.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.071+0000 7f51aeccc640 1 -- 172.21.15.7:0/2252464226 learned_addr learned my addr 172.21.15.7:0/2252464226 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:41.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.071+0000 7f51adcca640 1 --2- 172.21.15.7:0/2252464226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51a8102570 0x7f51a80fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:41.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.071+0000 7f51ae4cb640 1 --2- 172.21.15.7:0/2252464226 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51a8100e20 0x7f51a80fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:41.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.071+0000 7f51aeccc640 1 -- 172.21.15.7:0/2252464226 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51a8100e20 msgr2=0x7f51a80fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:41.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.071+0000 7f51aeccc640 1 --2- 172.21.15.7:0/2252464226 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51a8100e20 0x7f51a80fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:41.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.071+0000 7f51aeccc640 1 -- 172.21.15.7:0/2252464226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51a8102570 msgr2=0x7f51a80fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:41.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.071+0000 7f51aeccc640 1 --2- 172.21.15.7:0/2252464226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51a8102570 0x7f51a80fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:41.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.071+0000 7f51aeccc640 1 -- 172.21.15.7:0/2252464226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a81a69d0 con 0x7f51a8102ef0 2024-09-19T04:16:41.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.071+0000 7f51ae4cb640 1 --2- 172.21.15.7:0/2252464226 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51a8100e20 0x7f51a80fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:16:41.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.071+0000 7f51aeccc640 1 --2- 172.21.15.7:0/2252464226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51a8102ef0 0x7f51a80fd700 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f51a002ae70 tx=0x7f51a002f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:41.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.072+0000 7f519f7fe640 1 -- 172.21.15.7:0/2252464226 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a0034040 con 0x7f51a8102ef0 2024-09-19T04:16:41.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.072+0000 7f519f7fe640 1 -- 172.21.15.7:0/2252464226 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51a0030920 con 0x7f51a8102ef0 2024-09-19T04:16:41.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.072+0000 7f519f7fe640 1 -- 172.21.15.7:0/2252464226 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a0045480 con 0x7f51a8102ef0 2024-09-19T04:16:41.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.072+0000 7f51b072f640 1 -- 172.21.15.7:0/2252464226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51a81a6c60 con 0x7f51a8102ef0 2024-09-19T04:16:41.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.072+0000 7f51b072f640 1 -- 172.21.15.7:0/2252464226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51a81a7190 con 0x7f51a8102ef0 2024-09-19T04:16:41.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.073+0000 7f51b072f640 1 -- 172.21.15.7:0/2252464226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51a8101200 con 0x7f51a8102ef0 2024-09-19T04:16:41.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.074+0000 7f519f7fe640 1 -- 172.21.15.7:0/2252464226 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f51a0037020 con 0x7f51a8102ef0 2024-09-19T04:16:41.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.075+0000 7f519f7fe640 1 --2- 172.21.15.7:0/2252464226 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f51940a3350 0x7f51940a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:41.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.075+0000 7f51ae4cb640 1 --2- 172.21.15.7:0/2252464226 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f51940a3350 0x7f51940a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:41.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.075+0000 7f519f7fe640 1 -- 172.21.15.7:0/2252464226 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f51a00f0b10 con 0x7f51a8102ef0 2024-09-19T04:16:41.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.075+0000 7f51ae4cb640 1 --2- 172.21.15.7:0/2252464226 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f51940a3350 0x7f51940a5810 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f51a4009930 tx=0x7f51a4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:41.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.079+0000 7f519f7fe640 1 -- 172.21.15.7:0/2252464226 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f51a00bd4a0 con 0x7f51a8102ef0 2024-09-19T04:16:41.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:41 smithi092 ceph-mon[34940]: pgmap v345: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T04:16:41.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.295+0000 7f51b072f640 1 -- 172.21.15.7:0/2252464226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51a810a0a0 con 0x7f51a8102ef0 2024-09-19T04:16:41.298 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:41 smithi007 ceph-mon[31360]: pgmap v345: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T04:16:41.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.296+0000 7f519f7fe640 1 -- 172.21.15.7:0/2252464226 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11962 (secure 0 0 0) 0x7f51a00bcda0 con 0x7f51a8102ef0 2024-09-19T04:16:41.299 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:16:41.299 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"btime":"2024-09-19T04:15:17:816953+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:15:17.816938+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24496,"mds_2":24482,"mds_3":24478,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24506,24496,24482,24478,24472]},"id":1}]} 2024-09-19T04:16:41.299 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 27 2024-09-19T04:16:41.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.299+0000 7f51b072f640 1 -- 172.21.15.7:0/2252464226 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f51940a3350 msgr2=0x7f51940a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:41.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.299+0000 7f51b072f640 1 --2- 172.21.15.7:0/2252464226 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f51940a3350 0x7f51940a5810 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f51a4009930 tx=0x7f51a4008040 comp rx=0 tx=0).stop 2024-09-19T04:16:41.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.300+0000 7f51b072f640 1 -- 172.21.15.7:0/2252464226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51a8102ef0 msgr2=0x7f51a80fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:41.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.300+0000 7f51b072f640 1 --2- 172.21.15.7:0/2252464226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51a8102ef0 0x7f51a80fd700 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f51a002ae70 tx=0x7f51a002f5d0 comp rx=0 tx=0).stop 2024-09-19T04:16:41.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.300+0000 7f51b072f640 1 -- 172.21.15.7:0/2252464226 shutdown_connections 2024-09-19T04:16:41.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.300+0000 7f51b072f640 1 --2- 172.21.15.7:0/2252464226 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f51940a3350 0x7f51940a5810 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:41.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.300+0000 7f51b072f640 1 --2- 172.21.15.7:0/2252464226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51a8102ef0 0x7f51a80fd700 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:41.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.300+0000 7f51b072f640 1 --2- 172.21.15.7:0/2252464226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51a8102570 0x7f51a80fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:41.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.300+0000 7f51b072f640 1 --2- 172.21.15.7:0/2252464226 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51a8100e20 0x7f51a80fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:41.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.300+0000 7f51b072f640 1 -- 172.21.15.7:0/2252464226 >> 172.21.15.7:0/2252464226 conn(0x7f51a80fc7d0 msgr2=0x7f51a806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:41.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.300+0000 7f51b072f640 1 -- 172.21.15.7:0/2252464226 shutdown_connections 2024-09-19T04:16:41.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:41.300+0000 7f51b072f640 1 -- 172.21.15.7:0/2252464226 wait complete. 2024-09-19T04:16:41.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:41 smithi102 ceph-mon[35446]: pgmap v345: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T04:16:41.938 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:16:42.200 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:42.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:42 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2252464226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:16:42.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:42 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2252464226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:16:42.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:42 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2252464226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:16:42.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.696+0000 7f4c84537640 1 -- 172.21.15.7:0/2464211085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c7c10c170 msgr2=0x7f4c7c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:42.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.696+0000 7f4c84537640 1 --2- 172.21.15.7:0/2464211085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c7c10c170 0x7f4c7c10e610 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4c74009ca0 tx=0x7f4c7402a950 comp rx=0 tx=0).stop 2024-09-19T04:16:42.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.696+0000 7f4c84537640 1 -- 172.21.15.7:0/2464211085 shutdown_connections 2024-09-19T04:16:42.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.696+0000 7f4c84537640 1 --2- 172.21.15.7:0/2464211085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c7c10c170 0x7f4c7c10e610 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:42.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.696+0000 7f4c84537640 1 --2- 172.21.15.7:0/2464211085 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c7c103660 0x7f4c7c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:42.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.696+0000 7f4c84537640 1 --2- 172.21.15.7:0/2464211085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7c102d40 0x7f4c7c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:42.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.696+0000 7f4c84537640 1 -- 172.21.15.7:0/2464211085 >> 172.21.15.7:0/2464211085 conn(0x7f4c7c0fc7a0 msgr2=0x7f4c7c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:42.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.696+0000 7f4c84537640 1 -- 172.21.15.7:0/2464211085 shutdown_connections 2024-09-19T04:16:42.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.696+0000 7f4c84537640 1 -- 172.21.15.7:0/2464211085 wait complete. 2024-09-19T04:16:42.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.696+0000 7f4c84537640 1 Processor -- start 2024-09-19T04:16:42.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.696+0000 7f4c84537640 1 -- start start 2024-09-19T04:16:42.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.697+0000 7f4c84537640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c7c102d40 0x7f4c7c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:42.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.697+0000 7f4c84537640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c7c103660 0x7f4c7c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:42.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.697+0000 7f4c84537640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7c10c170 0x7f4c7c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:42.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.697+0000 7f4c84537640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c111f70 con 0x7f4c7c103660 2024-09-19T04:16:42.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.697+0000 7f4c84537640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c111df0 con 0x7f4c7c10c170 2024-09-19T04:16:42.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.697+0000 7f4c84537640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1120f0 con 0x7f4c7c102d40 2024-09-19T04:16:42.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.697+0000 7f4c81ad2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c7c103660 0x7f4c7c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:42.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.697+0000 7f4c81ad2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c7c103660 0x7f4c7c100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57440/0 (socket says 172.21.15.7:57440) 2024-09-19T04:16:42.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.697+0000 7f4c81ad2640 1 -- 172.21.15.7:0/1082154760 learned_addr learned my addr 172.21.15.7:0/1082154760 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:42.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.697+0000 7f4c822d3640 1 --2- 172.21.15.7:0/1082154760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c7c102d40 0x7f4c7c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:42.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.697+0000 7f4c82ad4640 1 --2- 172.21.15.7:0/1082154760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7c10c170 0x7f4c7c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:42.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.697+0000 7f4c81ad2640 1 -- 172.21.15.7:0/1082154760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c7c102d40 msgr2=0x7f4c7c1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:42.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.697+0000 7f4c81ad2640 1 --2- 172.21.15.7:0/1082154760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c7c102d40 0x7f4c7c1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:42.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.697+0000 7f4c81ad2640 1 -- 172.21.15.7:0/1082154760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7c10c170 msgr2=0x7f4c7c101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:42.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.697+0000 7f4c81ad2640 1 --2- 172.21.15.7:0/1082154760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7c10c170 0x7f4c7c101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:42.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.697+0000 7f4c81ad2640 1 -- 172.21.15.7:0/1082154760 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7c1a6910 con 0x7f4c7c103660 2024-09-19T04:16:42.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.697+0000 7f4c82ad4640 1 --2- 172.21.15.7:0/1082154760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7c10c170 0x7f4c7c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:16:42.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.697+0000 7f4c81ad2640 1 --2- 172.21.15.7:0/1082154760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c7c103660 0x7f4c7c100ee0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c00d950 tx=0x7f4c6c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:42.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.698+0000 7f4c737fe640 1 -- 172.21.15.7:0/1082154760 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c017030 con 0x7f4c7c103660 2024-09-19T04:16:42.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.698+0000 7f4c84537640 1 -- 172.21.15.7:0/1082154760 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c7c1a6c00 con 0x7f4c7c103660 2024-09-19T04:16:42.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.698+0000 7f4c737fe640 1 -- 172.21.15.7:0/1082154760 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c6c004020 con 0x7f4c7c103660 2024-09-19T04:16:42.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.698+0000 7f4c737fe640 1 -- 172.21.15.7:0/1082154760 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c0047a0 con 0x7f4c7c103660 2024-09-19T04:16:42.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.698+0000 7f4c84537640 1 -- 172.21.15.7:0/1082154760 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c7c1a7190 con 0x7f4c7c103660 2024-09-19T04:16:42.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.699+0000 7f4c84537640 1 -- 172.21.15.7:0/1082154760 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c7c103120 con 0x7f4c7c103660 2024-09-19T04:16:42.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.700+0000 7f4c737fe640 1 -- 172.21.15.7:0/1082154760 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f4c6c0041d0 con 0x7f4c7c103660 2024-09-19T04:16:42.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.701+0000 7f4c737fe640 1 --2- 172.21.15.7:0/1082154760 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4c680a32d0 0x7f4c680a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:42.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.701+0000 7f4c822d3640 1 --2- 172.21.15.7:0/1082154760 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4c680a32d0 0x7f4c680a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:42.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.701+0000 7f4c737fe640 1 -- 172.21.15.7:0/1082154760 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f4c6c0cf6f0 con 0x7f4c7c103660 2024-09-19T04:16:42.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.701+0000 7f4c822d3640 1 --2- 172.21.15.7:0/1082154760 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4c680a32d0 0x7f4c680a5790 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009bd0 tx=0x7f4c78005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:42.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.705+0000 7f4c737fe640 1 -- 172.21.15.7:0/1082154760 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4c6c09bf70 con 0x7f4c7c103660 2024-09-19T04:16:42.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.916+0000 7f4c84537640 1 -- 172.21.15.7:0/1082154760 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c7c1071e0 con 0x7f4c7c103660 2024-09-19T04:16:42.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.916+0000 7f4c737fe640 1 -- 172.21.15.7:0/1082154760 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11962 (secure 0 0 0) 0x7f4c6c09b870 con 0x7f4c7c103660 2024-09-19T04:16:42.919 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:16:42.919 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"btime":"2024-09-19T04:15:17:816953+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:15:17.816938+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24496,"mds_2":24482,"mds_3":24478,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24506,24496,24482,24478,24472]},"id":1}]} 2024-09-19T04:16:42.919 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 27 2024-09-19T04:16:42.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.918+0000 7f4c84537640 1 -- 172.21.15.7:0/1082154760 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4c680a32d0 msgr2=0x7f4c680a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:42.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.918+0000 7f4c84537640 1 --2- 172.21.15.7:0/1082154760 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4c680a32d0 0x7f4c680a5790 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009bd0 tx=0x7f4c78005f90 comp rx=0 tx=0).stop 2024-09-19T04:16:42.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.918+0000 7f4c84537640 1 -- 172.21.15.7:0/1082154760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c7c103660 msgr2=0x7f4c7c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:42.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.918+0000 7f4c84537640 1 --2- 172.21.15.7:0/1082154760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c7c103660 0x7f4c7c100ee0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c00d950 tx=0x7f4c6c00de10 comp rx=0 tx=0).stop 2024-09-19T04:16:42.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.918+0000 7f4c84537640 1 -- 172.21.15.7:0/1082154760 shutdown_connections 2024-09-19T04:16:42.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.918+0000 7f4c84537640 1 --2- 172.21.15.7:0/1082154760 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4c680a32d0 0x7f4c680a5790 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:42.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.918+0000 7f4c84537640 1 --2- 172.21.15.7:0/1082154760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c7c10c170 0x7f4c7c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:42.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.918+0000 7f4c84537640 1 --2- 172.21.15.7:0/1082154760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c7c103660 0x7f4c7c100ee0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:42.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.918+0000 7f4c84537640 1 --2- 172.21.15.7:0/1082154760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c7c102d40 0x7f4c7c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:42.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.918+0000 7f4c84537640 1 -- 172.21.15.7:0/1082154760 >> 172.21.15.7:0/1082154760 conn(0x7f4c7c0fc7a0 msgr2=0x7f4c7c0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:42.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.918+0000 7f4c84537640 1 -- 172.21.15.7:0/1082154760 shutdown_connections 2024-09-19T04:16:42.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:42.918+0000 7f4c84537640 1 -- 172.21.15.7:0/1082154760 wait complete. 2024-09-19T04:16:43.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:43 smithi092 ceph-mon[34940]: pgmap v346: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T04:16:43.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:43 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1082154760' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:16:43.357 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:43 smithi007 ceph-mon[31360]: pgmap v346: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T04:16:43.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:43 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1082154760' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:16:43.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:43 smithi102 ceph-mon[35446]: pgmap v346: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T04:16:43.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:43 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1082154760' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:16:43.615 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:16:43.885 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:44.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.376+0000 7f3e4cf55640 1 -- 172.21.15.7:0/1680200305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e48103740 msgr2=0x7f3e48107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:44.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.376+0000 7f3e4cf55640 1 --2- 172.21.15.7:0/1680200305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e48103740 0x7f3e48107b80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c009930 tx=0x7f3e3c02a420 comp rx=0 tx=0).stop 2024-09-19T04:16:44.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.377+0000 7f3e4cf55640 1 -- 172.21.15.7:0/1680200305 shutdown_connections 2024-09-19T04:16:44.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.377+0000 7f3e4cf55640 1 --2- 172.21.15.7:0/1680200305 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e48108290 0x7f3e4810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:44.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.377+0000 7f3e4cf55640 1 --2- 172.21.15.7:0/1680200305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e48103740 0x7f3e48107b80 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:44.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.377+0000 7f3e4cf55640 1 --2- 172.21.15.7:0/1680200305 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e48102d90 0x7f3e48103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:44.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.377+0000 7f3e4cf55640 1 -- 172.21.15.7:0/1680200305 >> 172.21.15.7:0/1680200305 conn(0x7f3e480fc7d0 msgr2=0x7f3e480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:44.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.377+0000 7f3e4cf55640 1 -- 172.21.15.7:0/1680200305 shutdown_connections 2024-09-19T04:16:44.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.377+0000 7f3e4cf55640 1 -- 172.21.15.7:0/1680200305 wait complete. 2024-09-19T04:16:44.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.377+0000 7f3e4cf55640 1 Processor -- start 2024-09-19T04:16:44.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.378+0000 7f3e4cf55640 1 -- start start 2024-09-19T04:16:44.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.378+0000 7f3e4cf55640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e48102d90 0x7f3e481009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:44.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.378+0000 7f3e4cf55640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e48103740 0x7f3e48100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:44.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.378+0000 7f3e4cf55640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e48108290 0x7f3e48101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:44.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.378+0000 7f3e4cf55640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3e481120b0 con 0x7f3e48102d90 2024-09-19T04:16:44.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.378+0000 7f3e4cf55640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3e48111f30 con 0x7f3e48108290 2024-09-19T04:16:44.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.378+0000 7f3e4cf55640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3e48112230 con 0x7f3e48103740 2024-09-19T04:16:44.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.378+0000 7f3e4659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e48102d90 0x7f3e481009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:44.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.378+0000 7f3e4659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e48102d90 0x7f3e481009f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57472/0 (socket says 172.21.15.7:57472) 2024-09-19T04:16:44.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.378+0000 7f3e4659c640 1 -- 172.21.15.7:0/72351931 learned_addr learned my addr 172.21.15.7:0/72351931 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:44.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.378+0000 7f3e45d9b640 1 --2- 172.21.15.7:0/72351931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e48103740 0x7f3e48100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:44.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.378+0000 7f3e46d9d640 1 --2- 172.21.15.7:0/72351931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e48108290 0x7f3e48101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:44.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.378+0000 7f3e4659c640 1 -- 172.21.15.7:0/72351931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e48103740 msgr2=0x7f3e48100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:44.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.378+0000 7f3e4659c640 1 --2- 172.21.15.7:0/72351931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e48103740 0x7f3e48100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:44.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.378+0000 7f3e4659c640 1 -- 172.21.15.7:0/72351931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e48108290 msgr2=0x7f3e48101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:44.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.378+0000 7f3e4659c640 1 --2- 172.21.15.7:0/72351931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e48108290 0x7f3e48101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:44.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.378+0000 7f3e4659c640 1 -- 172.21.15.7:0/72351931 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e481a6ad0 con 0x7f3e48102d90 2024-09-19T04:16:44.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.379+0000 7f3e4659c640 1 --2- 172.21.15.7:0/72351931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e48102d90 0x7f3e481009f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3e3800d950 tx=0x7f3e3800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:44.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.379+0000 7f3e377fe640 1 -- 172.21.15.7:0/72351931 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e38017070 con 0x7f3e48102d90 2024-09-19T04:16:44.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.379+0000 7f3e4cf55640 1 -- 172.21.15.7:0/72351931 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e481a6dc0 con 0x7f3e48102d90 2024-09-19T04:16:44.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.379+0000 7f3e377fe640 1 -- 172.21.15.7:0/72351931 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e38009c30 con 0x7f3e48102d90 2024-09-19T04:16:44.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.379+0000 7f3e377fe640 1 -- 172.21.15.7:0/72351931 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e3800f6b0 con 0x7f3e48102d90 2024-09-19T04:16:44.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.379+0000 7f3e4cf55640 1 -- 172.21.15.7:0/72351931 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e481a7220 con 0x7f3e48102d90 2024-09-19T04:16:44.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.380+0000 7f3e4cf55640 1 -- 172.21.15.7:0/72351931 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e48103170 con 0x7f3e48102d90 2024-09-19T04:16:44.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.381+0000 7f3e377fe640 1 -- 172.21.15.7:0/72351931 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f3e380109d0 con 0x7f3e48102d90 2024-09-19T04:16:44.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.382+0000 7f3e377fe640 1 --2- 172.21.15.7:0/72351931 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3e300a32d0 0x7f3e300a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:44.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.382+0000 7f3e377fe640 1 -- 172.21.15.7:0/72351931 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f3e380cf970 con 0x7f3e48102d90 2024-09-19T04:16:44.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.382+0000 7f3e45d9b640 1 --2- 172.21.15.7:0/72351931 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3e300a32d0 0x7f3e300a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:44.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.383+0000 7f3e45d9b640 1 --2- 172.21.15.7:0/72351931 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3e300a32d0 0x7f3e300a5790 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c004770 tx=0x7f3e3c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:44.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.385+0000 7f3e377fe640 1 -- 172.21.15.7:0/72351931 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3e38009de0 con 0x7f3e48102d90 2024-09-19T04:16:44.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.564+0000 7f3e4cf55640 1 -- 172.21.15.7:0/72351931 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e48101f20 con 0x7f3e48102d90 2024-09-19T04:16:44.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.565+0000 7f3e377fe640 1 -- 172.21.15.7:0/72351931 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24568 (secure 0 0 0) 0x7f3e3809bb40 con 0x7f3e48102d90 2024-09-19T04:16:44.568 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:16:44.568 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":88,"fsid":"77957c0a-763c-11ef-bceb-c7b262605968","created":"2024-09-19T04:06:58.337394+0000","modified":"2024-09-19T04:15:46.990958+0000","last_up_change":"2024-09-19T04:13:42.312137+0000","last_in_change":"2024-09-19T04:13:18.757925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:09:59.544984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:14:30.225637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:14:32.252497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T04:14:38.781821+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d9b93bd5-ee22-4fb0-ba29-bfa208430a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6803","nonce":240599233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6805","nonce":240599233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6809","nonce":240599233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6807","nonce":240599233}]},"public_addr":"172.21.15.7:6803/240599233","cluster_addr":"172.21.15.7:6805/240599233","heartbeat_back_addr":"172.21.15.7:6809/240599233","heartbeat_front_addr":"172.21.15.7:6807/240599233","state":["exists","up"]},{"osd":1,"uuid":"db5793e6-f3ad-4075-a02b-206bf7f1e59a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6801","nonce":902403333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6803","nonce":902403333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6807","nonce":902403333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6805","nonce":902403333}]},"public_addr":"172.21.15.92:6801/902403333","cluster_addr":"172.21.15.92:6803/902403333","heartbeat_back_addr":"172.21.15.92:6807/902403333","heartbeat_front_addr":"172.21.15.92:6805/902403333","state":["exists","up"]},{"osd":2,"uuid":"1eb83a1b-82d8-4983-bae3-b161adb3a33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6801","nonce":2078441772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6803","nonce":2078441772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6807","nonce":2078441772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6805","nonce":2078441772}]},"public_addr":"172.21.15.102:6801/2078441772","cluster_addr":"172.21.15.102:6803/2078441772","heartbeat_back_addr":"172.21.15.102:6807/2078441772","heartbeat_front_addr":"172.21.15.102:6805/2078441772","state":["exists","up"]},{"osd":3,"uuid":"68ba79e5-bcf0-4349-9e14-42f2fa9c11b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6811","nonce":2729561132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6813","nonce":2729561132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6817","nonce":2729561132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6815","nonce":2729561132}]},"public_addr":"172.21.15.7:6811/2729561132","cluster_addr":"172.21.15.7:6813/2729561132","heartbeat_back_addr":"172.21.15.7:6817/2729561132","heartbeat_front_addr":"172.21.15.7:6815/2729561132","state":["exists","up"]},{"osd":4,"uuid":"f20d4a51-121f-4ac8-afeb-5962d83bd697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6809","nonce":2799734294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6811","nonce":2799734294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6815","nonce":2799734294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6813","nonce":2799734294}]},"public_addr":"172.21.15.92:6809/2799734294","cluster_addr":"172.21.15.92:6811/2799734294","heartbeat_back_addr":"172.21.15.92:6815/2799734294","heartbeat_front_addr":"172.21.15.92:6813/2799734294","state":["exists","up"]},{"osd":5,"uuid":"aac02b0a-99dc-4457-8898-c68dc196517a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6809","nonce":3099678146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6811","nonce":3099678146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6815","nonce":3099678146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6813","nonce":3099678146}]},"public_addr":"172.21.15.102:6809/3099678146","cluster_addr":"172.21.15.102:6811/3099678146","heartbeat_back_addr":"172.21.15.102:6815/3099678146","heartbeat_front_addr":"172.21.15.102:6813/3099678146","state":["exists","up"]},{"osd":6,"uuid":"7e5a8b30-8406-486c-ace5-79158a3757a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6819","nonce":1569704304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6821","nonce":1569704304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6825","nonce":1569704304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6823","nonce":1569704304}]},"public_addr":"172.21.15.7:6819/1569704304","cluster_addr":"172.21.15.7:6821/1569704304","heartbeat_back_addr":"172.21.15.7:6825/1569704304","heartbeat_front_addr":"172.21.15.7:6823/1569704304","state":["exists","up"]},{"osd":7,"uuid":"e6a7049a-17a1-43b2-8ecd-5f4ca7c337be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6817","nonce":3411102480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6819","nonce":3411102480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6823","nonce":3411102480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6821","nonce":3411102480}]},"public_addr":"172.21.15.92:6817/3411102480","cluster_addr":"172.21.15.92:6819/3411102480","heartbeat_back_addr":"172.21.15.92:6823/3411102480","heartbeat_front_addr":"172.21.15.92:6821/3411102480","state":["exists","up"]},{"osd":8,"uuid":"31879baa-861d-4322-990f-0b9a42b8b610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6817","nonce":2990859925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6819","nonce":2990859925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6823","nonce":2990859925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6821","nonce":2990859925}]},"public_addr":"172.21.15.102:6817/2990859925","cluster_addr":"172.21.15.102:6819/2990859925","heartbeat_back_addr":"172.21.15.102:6823/2990859925","heartbeat_front_addr":"172.21.15.102:6821/2990859925","state":["exists","up"]},{"osd":9,"uuid":"6d65db33-926c-4a6e-a072-707e9c9de92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6827","nonce":1710319475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6829","nonce":1710319475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6833","nonce":1710319475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6831","nonce":1710319475}]},"public_addr":"172.21.15.7:6827/1710319475","cluster_addr":"172.21.15.7:6829/1710319475","heartbeat_back_addr":"172.21.15.7:6833/1710319475","heartbeat_front_addr":"172.21.15.7:6831/1710319475","state":["exists","up"]},{"osd":10,"uuid":"9ab681ee-0bef-47bd-bf3d-20b17c6b870c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6825","nonce":1063265541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6827","nonce":1063265541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6831","nonce":1063265541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6829","nonce":1063265541}]},"public_addr":"172.21.15.92:6825/1063265541","cluster_addr":"172.21.15.92:6827/1063265541","heartbeat_back_addr":"172.21.15.92:6831/1063265541","heartbeat_front_addr":"172.21.15.92:6829/1063265541","state":["exists","up"]},{"osd":11,"uuid":"dc398e14-5f9e-4f0a-b158-35cbc1f73a83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6825","nonce":1175425599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6827","nonce":1175425599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6831","nonce":1175425599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6829","nonce":1175425599}]},"public_addr":"172.21.15.102:6825/1175425599","cluster_addr":"172.21.15.102:6827/1175425599","heartbeat_back_addr":"172.21.15.102:6831/1175425599","heartbeat_front_addr":"172.21.15.102:6829/1175425599","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:07.857319+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:31.430120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:56.892301+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:10:22.011884+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:10:46.326025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:11:10.339084+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:11:35.365906+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:01.104309+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:25.717295+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:51.387644+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:13:15.076355+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:13:40.253150+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":9},{"from":5,"to":8}]},{"pgid":"3.c","mappings":[{"from":5,"to":6}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/2883028938":"2024-09-20T04:07:45.039922+0000","172.21.15.7:0/1186412739":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6800/751091002":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6801/751091002":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6801/940106179":"2024-09-20T04:07:20.364033+0000","172.21.15.7:6800/940106179":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/1450115700":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/2954294373":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/1996930242":"2024-09-20T04:07:45.039922+0000","172.21.15.7:0/3562231347":"2024-09-20T04:07:20.364033+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:16:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.568+0000 7f3e4cf55640 1 -- 172.21.15.7:0/72351931 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3e300a32d0 msgr2=0x7f3e300a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.568+0000 7f3e4cf55640 1 --2- 172.21.15.7:0/72351931 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3e300a32d0 0x7f3e300a5790 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c004770 tx=0x7f3e3c0058d0 comp rx=0 tx=0).stop 2024-09-19T04:16:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.568+0000 7f3e4cf55640 1 -- 172.21.15.7:0/72351931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e48102d90 msgr2=0x7f3e481009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.568+0000 7f3e4cf55640 1 --2- 172.21.15.7:0/72351931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e48102d90 0x7f3e481009f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3e3800d950 tx=0x7f3e3800de10 comp rx=0 tx=0).stop 2024-09-19T04:16:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.568+0000 7f3e4cf55640 1 -- 172.21.15.7:0/72351931 shutdown_connections 2024-09-19T04:16:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.568+0000 7f3e4cf55640 1 --2- 172.21.15.7:0/72351931 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3e300a32d0 0x7f3e300a5790 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.568+0000 7f3e4cf55640 1 --2- 172.21.15.7:0/72351931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e48108290 0x7f3e48101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.568+0000 7f3e4cf55640 1 --2- 172.21.15.7:0/72351931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e48103740 0x7f3e48100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.568+0000 7f3e4cf55640 1 --2- 172.21.15.7:0/72351931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3e48102d90 0x7f3e481009f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:44.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.568+0000 7f3e4cf55640 1 -- 172.21.15.7:0/72351931 >> 172.21.15.7:0/72351931 conn(0x7f3e480fc7d0 msgr2=0x7f3e48105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:44.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.568+0000 7f3e4cf55640 1 -- 172.21.15.7:0/72351931 shutdown_connections 2024-09-19T04:16:44.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:44.568+0000 7f3e4cf55640 1 -- 172.21.15.7:0/72351931 wait complete. 2024-09-19T04:16:45.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:45 smithi007 ceph-mon[31360]: pgmap v347: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T04:16:45.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:45 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/72351931' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:16:45.220 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T04:14:34.007803+0000', 'modified': '2024-09-19T04:15:17.816938+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24506, 'mds_1': 24496, 'mds_2': 24482, 'mds_3': 24478, 'mds_4': 24472}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14583': {'gid': 14583, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.7:6839/2492396165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6838', 'nonce': 2492396165}, {'type': 'v1', 'addr': '172.21.15.7:6839', 'nonce': 2492396165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14595': {'gid': 14595, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.7:6841/4142126419', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6840', 'nonce': 4142126419}, {'type': 'v1', 'addr': '172.21.15.7:6841', 'nonce': 4142126419}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24424': {'gid': 24424, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.102:6833/3063042931', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6832', 'nonce': 3063042931}, {'type': 'v1', 'addr': '172.21.15.102:6833', 'nonce': 3063042931}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24431': {'gid': 24431, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.92:6833/4006669352', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6832', 'nonce': 4006669352}, {'type': 'v1', 'addr': '172.21.15.92:6833', 'nonce': 4006669352}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.92:6835/4235013488', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6834', 'nonce': 4235013488}, {'type': 'v1', 'addr': '172.21.15.92:6835', 'nonce': 4235013488}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.102:6835/1756454579', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6834', 'nonce': 1756454579}, {'type': 'v1', 'addr': '172.21.15.102:6835', 'nonce': 1756454579}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24478': {'gid': 24478, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.102:6837/618291553', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6836', 'nonce': 618291553}, {'type': 'v1', 'addr': '172.21.15.102:6837', 'nonce': 618291553}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24482': {'gid': 24482, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.92:6837/319779585', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6836', 'nonce': 319779585}, {'type': 'v1', 'addr': '172.21.15.92:6837', 'nonce': 319779585}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24496': {'gid': 24496, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.102:6839/2728093829', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6838', 'nonce': 2728093829}, {'type': 'v1', 'addr': '172.21.15.102:6839', 'nonce': 2728093829}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24506': {'gid': 24506, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.92:6839/3805481296', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6838', 'nonce': 3805481296}, {'type': 'v1', 'addr': '172.21.15.92:6839', 'nonce': 3805481296}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24506, 'qdb_cluster': [24506, 24496, 24482, 24478, 24472]} 2024-09-19T04:16:45.221 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-19T04:16:45.221 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph tell mds.f status 2024-09-19T04:16:45.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:45 smithi102 ceph-mon[35446]: pgmap v347: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T04:16:45.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:45 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/72351931' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:16:45.482 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:45.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:45 smithi092 ceph-mon[34940]: pgmap v347: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T04:16:45.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:45 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/72351931' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:16:45.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.960+0000 7f141af50640 1 -- 172.21.15.7:0/2266715775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1414102570 msgr2=0x7f14141029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:45.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.960+0000 7f141af50640 1 --2- 172.21.15.7:0/2266715775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1414102570 0x7f14141029b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f13fc009900 tx=0x7f13fc02a480 comp rx=0 tx=0).stop 2024-09-19T04:16:45.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.960+0000 7f141af50640 1 -- 172.21.15.7:0/2266715775 shutdown_connections 2024-09-19T04:16:45.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.960+0000 7f141af50640 1 --2- 172.21.15.7:0/2266715775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1414102ef0 0x7f141410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:45.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.960+0000 7f141af50640 1 --2- 172.21.15.7:0/2266715775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1414102570 0x7f14141029b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:45.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.960+0000 7f141af50640 1 --2- 172.21.15.7:0/2266715775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1414100e20 0x7f1414101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:45.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.960+0000 7f141af50640 1 -- 172.21.15.7:0/2266715775 >> 172.21.15.7:0/2266715775 conn(0x7f14140fc7d0 msgr2=0x7f14140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:45.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.960+0000 7f141af50640 1 -- 172.21.15.7:0/2266715775 shutdown_connections 2024-09-19T04:16:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.960+0000 7f141af50640 1 -- 172.21.15.7:0/2266715775 wait complete. 2024-09-19T04:16:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.961+0000 7f141af50640 1 Processor -- start 2024-09-19T04:16:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.961+0000 7f141af50640 1 -- start start 2024-09-19T04:16:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.961+0000 7f141af50640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1414100e20 0x7f1414198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.961+0000 7f141af50640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1414102570 0x7f1414198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:45.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.961+0000 7f141af50640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1414102ef0 0x7f141419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:45.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.961+0000 7f141af50640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1414112060 con 0x7f1414102570 2024-09-19T04:16:45.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.961+0000 7f141af50640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1414111ee0 con 0x7f1414102ef0 2024-09-19T04:16:45.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.961+0000 7f141af50640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f14141121e0 con 0x7f1414100e20 2024-09-19T04:16:45.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.961+0000 7f1413fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1414102570 0x7f1414198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:45.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.961+0000 7f1413fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1414102570 0x7f1414198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57484/0 (socket says 172.21.15.7:57484) 2024-09-19T04:16:45.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.961+0000 7f1413fff640 1 -- 172.21.15.7:0/2109320284 learned_addr learned my addr 172.21.15.7:0/2109320284 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:45.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.961+0000 7f14194ed640 1 --2- 172.21.15.7:0/2109320284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1414102ef0 0x7f141419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:45.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.961+0000 7f1418cec640 1 --2- 172.21.15.7:0/2109320284 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1414100e20 0x7f1414198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:45.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.961+0000 7f1413fff640 1 -- 172.21.15.7:0/2109320284 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1414100e20 msgr2=0x7f1414198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:45.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.961+0000 7f1413fff640 1 --2- 172.21.15.7:0/2109320284 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1414100e20 0x7f1414198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:45.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.961+0000 7f1413fff640 1 -- 172.21.15.7:0/2109320284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1414102ef0 msgr2=0x7f141419cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:45.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.961+0000 7f1413fff640 1 --2- 172.21.15.7:0/2109320284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1414102ef0 0x7f141419cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:45.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.961+0000 7f1413fff640 1 -- 172.21.15.7:0/2109320284 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141419d4b0 con 0x7f1414102570 2024-09-19T04:16:45.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.962+0000 7f1413fff640 1 --2- 172.21.15.7:0/2109320284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1414102570 0x7f1414198a40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f13fc006010 tx=0x7f13fc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:45.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.962+0000 7f1411ffb640 1 -- 172.21.15.7:0/2109320284 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc03f070 con 0x7f1414102570 2024-09-19T04:16:45.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.962+0000 7f1411ffb640 1 -- 172.21.15.7:0/2109320284 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13fc031c30 con 0x7f1414102570 2024-09-19T04:16:45.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.962+0000 7f141af50640 1 -- 172.21.15.7:0/2109320284 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f141419d740 con 0x7f1414102570 2024-09-19T04:16:45.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.962+0000 7f1411ffb640 1 -- 172.21.15.7:0/2109320284 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc035030 con 0x7f1414102570 2024-09-19T04:16:45.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.962+0000 7f141af50640 1 -- 172.21.15.7:0/2109320284 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14141a5080 con 0x7f1414102570 2024-09-19T04:16:45.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.964+0000 7f1411ffb640 1 -- 172.21.15.7:0/2109320284 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f13fc042070 con 0x7f1414102570 2024-09-19T04:16:45.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.964+0000 7f141d329740 1 Processor -- start 2024-09-19T04:16:45.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.965+0000 7f141d329740 1 -- start start 2024-09-19T04:16:45.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.965+0000 7f141d329740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cac0689d0 0x555cac068db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:45.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.965+0000 7f141d329740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cac0692f0 0x555cac073670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:45.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.965+0000 7f141d329740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cac073bb0 0x555cac075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:45.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.965+0000 7f141d329740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555cabfcf090 con 0x555cac0689d0 2024-09-19T04:16:45.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.965+0000 7f141d329740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555cabf76a70 con 0x555cac073bb0 2024-09-19T04:16:45.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.965+0000 7f141d329740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555cabfcb050 con 0x555cac0692f0 2024-09-19T04:16:45.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.965+0000 7f1411ffb640 1 --2- 172.21.15.7:0/2109320284 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f14000a32d0 0x7f14000a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:45.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.965+0000 7f14194ed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cac0689d0 0x555cac068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:45.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.965+0000 7f14194ed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cac0689d0 0x555cac068db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57492/0 (socket says 172.21.15.7:57492) 2024-09-19T04:16:45.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.965+0000 7f14194ed640 1 -- 172.21.15.7:0/2574534332 learned_addr learned my addr 172.21.15.7:0/2574534332 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:45.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.965+0000 7f14194ed640 1 --2- 172.21.15.7:0/2109320284 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f14000a32d0 0x7f14000a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:45.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.965+0000 7f1418cec640 1 --2- 172.21.15.7:0/2574534332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cac0692f0 0x555cac073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:45.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.965+0000 7f1411ffb640 1 -- 172.21.15.7:0/2109320284 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f13fc0f0640 con 0x7f1414102570 2024-09-19T04:16:45.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.965+0000 7f1413fff640 1 --2- 172.21.15.7:0/2574534332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cac073bb0 0x555cac075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:45.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.965+0000 7f14194ed640 1 -- 172.21.15.7:0/2574534332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cac0692f0 msgr2=0x555cac073670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:45.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.965+0000 7f14194ed640 1 --2- 172.21.15.7:0/2574534332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cac0692f0 0x555cac073670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:45.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.965+0000 7f14194ed640 1 -- 172.21.15.7:0/2574534332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cac073bb0 msgr2=0x555cac075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:45.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.965+0000 7f14194ed640 1 --2- 172.21.15.7:0/2574534332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cac073bb0 0x555cac075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:45.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.965+0000 7f14194ed640 1 -- 172.21.15.7:0/2574534332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cabf83130 con 0x555cac0689d0 2024-09-19T04:16:45.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.965+0000 7f1418cec640 1 --2- 172.21.15.7:0/2574534332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cac0692f0 0x555cac073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:16:45.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.965+0000 7f1413fff640 1 --2- 172.21.15.7:0/2574534332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cac073bb0 0x555cac075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:16:45.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.966+0000 7f14194ed640 1 --2- 172.21.15.7:0/2574534332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cac0689d0 0x555cac068db0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f140c012d80 tx=0x7f140c010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d49fc19d379112 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:45.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.966+0000 7f14194ed640 1 --2- 172.21.15.7:0/2109320284 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f14000a32d0 0x7f14000a5790 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f140c010c40 tx=0x7f140c017000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:45.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.966+0000 7f140affd640 1 -- 172.21.15.7:0/2574534332 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c023070 con 0x555cac0689d0 2024-09-19T04:16:45.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.966+0000 7f140affd640 1 -- 172.21.15.7:0/2574534332 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f140c0125a0 con 0x555cac0689d0 2024-09-19T04:16:45.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.966+0000 7f140affd640 1 -- 172.21.15.7:0/2574534332 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c003bb0 con 0x555cac0689d0 2024-09-19T04:16:45.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.967+0000 7f141d329740 1 -- 172.21.15.7:0/2574534332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cac0689d0 msgr2=0x555cac068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:45.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.967+0000 7f141d329740 1 --2- 172.21.15.7:0/2574534332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cac0689d0 0x555cac068db0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f140c012d80 tx=0x7f140c010740 comp rx=0 tx=0).stop 2024-09-19T04:16:45.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.967+0000 7f141d329740 1 -- 172.21.15.7:0/2574534332 shutdown_connections 2024-09-19T04:16:45.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.967+0000 7f141d329740 1 --2- 172.21.15.7:0/2574534332 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cac073bb0 0x555cac075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:45.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.967+0000 7f141d329740 1 --2- 172.21.15.7:0/2574534332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cac0692f0 0x555cac073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:45.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.967+0000 7f141d329740 1 --2- 172.21.15.7:0/2574534332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cac0689d0 0x555cac068db0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:45.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.967+0000 7f141d329740 1 -- 172.21.15.7:0/2574534332 >> 172.21.15.7:0/2574534332 conn(0x555cac064f60 msgr2=0x555cac065340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:45.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.967+0000 7f141d329740 1 -- 172.21.15.7:0/2574534332 shutdown_connections 2024-09-19T04:16:45.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.967+0000 7f141d329740 1 -- 172.21.15.7:0/2574534332 wait complete. 2024-09-19T04:16:45.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.967+0000 7f141d329740 1 -- start start 2024-09-19T04:16:45.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.967+0000 7f141d329740 1 Processor -- start 2024-09-19T04:16:45.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.968+0000 7f141d329740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cac0689d0 0x555cac0734b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:45.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.968+0000 7f141d329740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cac0692f0 0x555cac070800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:45.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.968+0000 7f141d329740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cac073bb0 0x555cac070d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:45.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.968+0000 7f141d329740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555cac076780 con 0x555cac0689d0 2024-09-19T04:16:45.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.968+0000 7f141d329740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555cabf89f20 con 0x555cac073bb0 2024-09-19T04:16:45.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.968+0000 7f141d329740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555cac076900 con 0x555cac0692f0 2024-09-19T04:16:45.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.968+0000 7f141d329740 10 client.0 _ll_register_callbacks cb 0x555cabf53030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:16:45.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.968+0000 7f1418cec640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cac0689d0 0x555cac0734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:45.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.968+0000 7f1418cec640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cac0689d0 0x555cac0734b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57494/0 (socket says 172.21.15.7:57494) 2024-09-19T04:16:45.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.968+0000 7f1418cec640 1 -- 172.21.15.7:0/737337421 learned_addr learned my addr 172.21.15.7:0/737337421 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:45.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.968+0000 7f1413fff640 1 --2- 172.21.15.7:0/737337421 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cac0692f0 0x555cac070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:45.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.968+0000 7f14194ed640 1 --2- 172.21.15.7:0/737337421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cac073bb0 0x555cac070d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:45.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.968+0000 7f1418cec640 1 -- 172.21.15.7:0/737337421 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cac0692f0 msgr2=0x555cac070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:45.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.968+0000 7f1418cec640 1 --2- 172.21.15.7:0/737337421 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cac0692f0 0x555cac070800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:45.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.968+0000 7f1418cec640 1 -- 172.21.15.7:0/737337421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cac073bb0 msgr2=0x555cac070d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:45.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.968+0000 7f1418cec640 1 --2- 172.21.15.7:0/737337421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cac073bb0 0x555cac070d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:45.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.968+0000 7f1418cec640 1 -- 172.21.15.7:0/737337421 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cabd402b0 con 0x555cac0689d0 2024-09-19T04:16:45.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.968+0000 7f1418cec640 1 --2- 172.21.15.7:0/737337421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cac0689d0 0x555cac0734b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f140400be50 tx=0x7f14040117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8572eadb616848bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:45.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.968+0000 7f13f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:16:45.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.968+0000 7f13f3fff640 1 -- 172.21.15.7:0/737337421 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1404012650 con 0x555cac0689d0 2024-09-19T04:16:45.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.968+0000 7f13f3fff640 1 -- 172.21.15.7:0/737337421 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f14040127f0 con 0x555cac0689d0 2024-09-19T04:16:45.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.968+0000 7f141d329740 1 -- 172.21.15.7:0/737337421 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f140c0125a0 con 0x555cac0689d0 2024-09-19T04:16:45.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.969+0000 7f13f3fff640 1 -- 172.21.15.7:0/737337421 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f14040129f0 con 0x555cac0689d0 2024-09-19T04:16:45.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.969+0000 7f141d329740 10 client.15198 fetch_fsmap learned FSMap version 27 2024-09-19T04:16:45.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.969+0000 7f141d329740 1 -- 172.21.15.7:0/737337421 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555cac0820c0 con 0x555cac0689d0 2024-09-19T04:16:45.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.969+0000 7f13f3fff640 1 -- 172.21.15.7:0/737337421 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f140c0125a0 con 0x555cac0689d0 2024-09-19T04:16:45.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.969+0000 7f13f3fff640 1 -- 172.21.15.7:0/737337421 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f140401a3d0 con 0x555cac0689d0 2024-09-19T04:16:45.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.969+0000 7f141d329740 10 client.15198 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:16:45.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.969+0000 7f141d329740 10 client.15198 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-19T04:16:45.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.969+0000 7f141d329740 20 client.15198 populate_metadata read hostname 'smithi007' 2024-09-19T04:16:45.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.969+0000 7f141d329740 1 --2- 172.21.15.7:0/737337421 >> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] conn(0x555cac084750 0x555cac085bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:45.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.969+0000 7f141d329740 4 client.15198 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:16:45.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.969+0000 7f141d329740 1 -- 172.21.15.7:0/737337421 --> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cabfdc600 con 0x555cac084750 2024-09-19T04:16:45.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.969+0000 7f1413fff640 1 --2- 172.21.15.7:0/737337421 >> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] conn(0x555cac084750 0x555cac085bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:45.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.970+0000 7f13f3fff640 10 client.15198 ms_handle_connect on v2:172.21.15.102:6834/1756454579 2024-09-19T04:16:45.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.970+0000 7f1413fff640 1 --2- 172.21.15.7:0/737337421 >> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] conn(0x555cac084750 0x555cac085bc0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=944976be75023237 server_cookie=bcbb7b73fe60da50 in_seq=0 out_seq=0 2024-09-19T04:16:45.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.971+0000 7f13f3fff640 1 -- 172.21.15.7:0/737337421 <== mds.4 v2:172.21.15.102:6834/1756454579 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555cabfdc600 con 0x555cac084750 2024-09-19T04:16:45.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.971+0000 7f13f3fff640 10 client.15198 handle_command_reply: tid=0 2024-09-19T04:16:45.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.971+0000 7f141d329740 1 client.15198 shutdown 2024-09-19T04:16:45.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.971+0000 7f141d329740 1 -- 172.21.15.7:0/737337421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cac0689d0 msgr2=0x555cac0734b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:45.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.971+0000 7f141d329740 1 --2- 172.21.15.7:0/737337421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cac0689d0 0x555cac0734b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f140400be50 tx=0x7f14040117b0 comp rx=0 tx=0).stop 2024-09-19T04:16:45.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.971+0000 7f141d329740 1 -- 172.21.15.7:0/737337421 shutdown_connections 2024-09-19T04:16:45.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.971+0000 7f141d329740 1 --2- 172.21.15.7:0/737337421 >> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] conn(0x555cac084750 0x555cac085bc0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:45.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.971+0000 7f141d329740 1 --2- 172.21.15.7:0/737337421 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cac073bb0 0x555cac070d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:45.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.971+0000 7f141d329740 1 --2- 172.21.15.7:0/737337421 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cac0692f0 0x555cac070800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:45.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.971+0000 7f141d329740 1 --2- 172.21.15.7:0/737337421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cac0689d0 0x555cac0734b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:45.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.971+0000 7f13f3fff640 0 client.15198 ms_handle_reset on v2:172.21.15.102:6834/1756454579 2024-09-19T04:16:45.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.971+0000 7f141d329740 1 -- 172.21.15.7:0/737337421 >> 172.21.15.7:0/737337421 conn(0x555cac064f60 msgr2=0x555cac06ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:45.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.971+0000 7f141d329740 1 -- 172.21.15.7:0/737337421 shutdown_connections 2024-09-19T04:16:45.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.971+0000 7f141d329740 1 -- 172.21.15.7:0/737337421 wait complete. 2024-09-19T04:16:45.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.971+0000 7f141d329740 20 client.15198 trim_cache size 0 max 16384 2024-09-19T04:16:45.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.989+0000 7f141d329740 1 Processor -- start 2024-09-19T04:16:45.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.989+0000 7f141d329740 1 -- start start 2024-09-19T04:16:45.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.989+0000 7f141d329740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cac0689d0 0x555cac0854f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:45.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.989+0000 7f141d329740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cac0692f0 0x555cac08dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:45.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.989+0000 7f141d329740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cac073bb0 0x555cac08e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.989+0000 7f141d329740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555cac083f00 con 0x555cac0689d0 2024-09-19T04:16:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.989+0000 7f141d329740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555cac0845d0 con 0x555cac073bb0 2024-09-19T04:16:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.989+0000 7f141d329740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555cac084ca0 con 0x555cac0692f0 2024-09-19T04:16:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.989+0000 7f1418cec640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cac0689d0 0x555cac0854f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.989+0000 7f1418cec640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cac0689d0 0x555cac0854f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57498/0 (socket says 172.21.15.7:57498) 2024-09-19T04:16:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.989+0000 7f1418cec640 1 -- 172.21.15.7:0/2158450076 learned_addr learned my addr 172.21.15.7:0/2158450076 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.990+0000 7f14194ed640 1 --2- 172.21.15.7:0/2158450076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cac073bb0 0x555cac08e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.990+0000 7f1413fff640 1 --2- 172.21.15.7:0/2158450076 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cac0692f0 0x555cac08dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.990+0000 7f1418cec640 1 -- 172.21.15.7:0/2158450076 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cac0692f0 msgr2=0x555cac08dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.990+0000 7f1418cec640 1 --2- 172.21.15.7:0/2158450076 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cac0692f0 0x555cac08dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.990+0000 7f1418cec640 1 -- 172.21.15.7:0/2158450076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cac073bb0 msgr2=0x555cac08e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.990+0000 7f1418cec640 1 --2- 172.21.15.7:0/2158450076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cac073bb0 0x555cac08e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.990+0000 7f1418cec640 1 -- 172.21.15.7:0/2158450076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cac076890 con 0x555cac0689d0 2024-09-19T04:16:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.990+0000 7f14194ed640 1 --2- 172.21.15.7:0/2158450076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cac073bb0 0x555cac08e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:16:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.990+0000 7f1413fff640 1 --2- 172.21.15.7:0/2158450076 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cac0692f0 0x555cac08dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:16:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.990+0000 7f1418cec640 1 --2- 172.21.15.7:0/2158450076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cac0689d0 0x555cac0854f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f140401a840 tx=0x7f140400ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5001f4fea0f065bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.990+0000 7f140a7fc640 1 -- 172.21.15.7:0/2158450076 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140402d020 con 0x555cac0689d0 2024-09-19T04:16:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.990+0000 7f140a7fc640 1 -- 172.21.15.7:0/2158450076 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f140400b570 con 0x555cac0689d0 2024-09-19T04:16:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.990+0000 7f140a7fc640 1 -- 172.21.15.7:0/2158450076 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1404004030 con 0x555cac0689d0 2024-09-19T04:16:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.991+0000 7f141d329740 1 -- 172.21.15.7:0/2158450076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cac0689d0 msgr2=0x555cac0854f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.991+0000 7f141d329740 1 --2- 172.21.15.7:0/2158450076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cac0689d0 0x555cac0854f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f140401a840 tx=0x7f140400ba70 comp rx=0 tx=0).stop 2024-09-19T04:16:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.991+0000 7f141d329740 1 -- 172.21.15.7:0/2158450076 shutdown_connections 2024-09-19T04:16:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.991+0000 7f141d329740 1 --2- 172.21.15.7:0/2158450076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cac073bb0 0x555cac08e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.991+0000 7f141d329740 1 --2- 172.21.15.7:0/2158450076 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cac0692f0 0x555cac08dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.991+0000 7f141d329740 1 --2- 172.21.15.7:0/2158450076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cac0689d0 0x555cac0854f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.991+0000 7f141d329740 1 -- 172.21.15.7:0/2158450076 >> 172.21.15.7:0/2158450076 conn(0x555cac064f60 msgr2=0x555cac06f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.991+0000 7f141d329740 1 -- 172.21.15.7:0/2158450076 shutdown_connections 2024-09-19T04:16:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.991+0000 7f141d329740 1 -- 172.21.15.7:0/2158450076 wait complete. 2024-09-19T04:16:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.991+0000 7f141d329740 1 -- start start 2024-09-19T04:16:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.991+0000 7f141d329740 1 Processor -- start 2024-09-19T04:16:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.992+0000 7f141d329740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cac0689d0 0x555cac088ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.992+0000 7f141d329740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cac0692f0 0x555cac089430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.992+0000 7f141d329740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cac073bb0 0x555cac0ece50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.992+0000 7f141d329740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555cac085a40 con 0x555cac0692f0 2024-09-19T04:16:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.992+0000 7f141d329740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555cac085370 con 0x555cac073bb0 2024-09-19T04:16:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.992+0000 7f141d329740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555cac086110 con 0x555cac0689d0 2024-09-19T04:16:46.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.992+0000 7f141d329740 10 client.0 _ll_register_callbacks cb 0x7f1404005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:16:46.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.992+0000 7f1413fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cac0692f0 0x555cac089430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:46.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.992+0000 7f1413fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cac0692f0 0x555cac089430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57512/0 (socket says 172.21.15.7:57512) 2024-09-19T04:16:46.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.992+0000 7f1413fff640 1 -- 172.21.15.7:0/2089721181 learned_addr learned my addr 172.21.15.7:0/2089721181 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:46.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.992+0000 7f1418cec640 1 --2- 172.21.15.7:0/2089721181 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cac0689d0 0x555cac088ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:46.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.992+0000 7f14194ed640 1 --2- 172.21.15.7:0/2089721181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cac073bb0 0x555cac0ece50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:46.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.992+0000 7f1413fff640 1 -- 172.21.15.7:0/2089721181 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cac0689d0 msgr2=0x555cac088ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:46.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.992+0000 7f1413fff640 1 --2- 172.21.15.7:0/2089721181 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cac0689d0 0x555cac088ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:46.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.992+0000 7f1413fff640 1 -- 172.21.15.7:0/2089721181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cac073bb0 msgr2=0x555cac0ece50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:46.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.992+0000 7f1413fff640 1 --2- 172.21.15.7:0/2089721181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cac073bb0 0x555cac0ece50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:46.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.992+0000 7f1413fff640 1 -- 172.21.15.7:0/2089721181 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cac089d30 con 0x555cac0692f0 2024-09-19T04:16:46.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.992+0000 7f14194ed640 1 --2- 172.21.15.7:0/2089721181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cac073bb0 0x555cac0ece50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:16:46.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.993+0000 7f1413fff640 1 --2- 172.21.15.7:0/2089721181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cac0692f0 0x555cac089430 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f13fc0b84a0 tx=0x7f13fc003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd60fdcbfffc0a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:46.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.993+0000 7f13f3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:16:46.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.993+0000 7f13f3fff640 1 -- 172.21.15.7:0/2089721181 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc049040 con 0x555cac0692f0 2024-09-19T04:16:46.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.993+0000 7f13f3fff640 1 -- 172.21.15.7:0/2089721181 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9071+0+0 (secure 0 0 0) 0x7f13fc0f0340 con 0x555cac0692f0 2024-09-19T04:16:46.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.993+0000 7f141d329740 1 -- 172.21.15.7:0/2089721181 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f140400b570 con 0x555cac0692f0 2024-09-19T04:16:46.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.993+0000 7f13f3fff640 1 -- 172.21.15.7:0/2089721181 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f13fc031de0 con 0x555cac0692f0 2024-09-19T04:16:46.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.993+0000 7f141d329740 10 client.15204 fetch_fsmap learned FSMap version 27 2024-09-19T04:16:46.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.993+0000 7f141d329740 1 -- 172.21.15.7:0/2089721181 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555cac0ee430 con 0x555cac0692f0 2024-09-19T04:16:46.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.993+0000 7f13f3fff640 1 -- 172.21.15.7:0/2089721181 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f140400b570 con 0x555cac0692f0 2024-09-19T04:16:46.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.993+0000 7f13f3fff640 1 -- 172.21.15.7:0/2089721181 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f13fc0d0ce0 con 0x555cac0692f0 2024-09-19T04:16:46.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.993+0000 7f141d329740 10 client.15204 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:16:46.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.993+0000 7f141d329740 10 client.15204 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-19T04:16:46.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.993+0000 7f141d329740 20 client.15204 populate_metadata read hostname 'smithi007' 2024-09-19T04:16:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.993+0000 7f141d329740 1 --2- 172.21.15.7:0/2089721181 >> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] conn(0x555cac0f3050 0x555cac0f1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.993+0000 7f141d329740 4 client.15204 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T04:16:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.993+0000 7f141d329740 1 -- 172.21.15.7:0/2089721181 --> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] -- command(tid 0: {"prefix": "status"}) -- 0x555cabfd6b10 con 0x555cac0f3050 2024-09-19T04:16:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.994+0000 7f1418cec640 1 --2- 172.21.15.7:0/2089721181 >> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] conn(0x555cac0f3050 0x555cac0f1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.994+0000 7f1418cec640 1 --2- 172.21.15.7:0/2089721181 >> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] conn(0x555cac0f3050 0x555cac0f1d60 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b214c9fe9d6262ec server_cookie=42fc62df038dfcc5 in_seq=0 out_seq=0 2024-09-19T04:16:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.994+0000 7f13f3fff640 10 client.15204 ms_handle_connect on v2:172.21.15.102:6834/1756454579 2024-09-19T04:16:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.994+0000 7f13f3fff640 1 -- 172.21.15.7:0/2089721181 <== mds.4 v2:172.21.15.102:6834/1756454579 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x555cabfd6b10 con 0x555cac0f3050 2024-09-19T04:16:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.994+0000 7f13f3fff640 10 client.15204 handle_command_reply: tid=0 2024-09-19T04:16:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.994+0000 7f141d329740 1 client.15204 shutdown 2024-09-19T04:16:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.995+0000 7f141d329740 1 -- 172.21.15.7:0/2089721181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cac0692f0 msgr2=0x555cac089430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.995+0000 7f141d329740 1 --2- 172.21.15.7:0/2089721181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cac0692f0 0x555cac089430 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f13fc0b84a0 tx=0x7f13fc003b90 comp rx=0 tx=0).stop 2024-09-19T04:16:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.995+0000 7f141d329740 1 -- 172.21.15.7:0/2089721181 shutdown_connections 2024-09-19T04:16:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.995+0000 7f141d329740 1 --2- 172.21.15.7:0/2089721181 >> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] conn(0x555cac0f3050 0x555cac0f1d60 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:46.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.995+0000 7f141d329740 1 --2- 172.21.15.7:0/2089721181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cac073bb0 0x555cac0ece50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:46.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.995+0000 7f141d329740 1 --2- 172.21.15.7:0/2089721181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cac0692f0 0x555cac089430 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:46.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.995+0000 7f13f3fff640 0 client.15204 ms_handle_reset on v2:172.21.15.102:6834/1756454579 2024-09-19T04:16:46.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.995+0000 7f141d329740 1 --2- 172.21.15.7:0/2089721181 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cac0689d0 0x555cac088ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:46.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.995+0000 7f141d329740 1 -- 172.21.15.7:0/2089721181 >> 172.21.15.7:0/2089721181 conn(0x555cac064f60 msgr2=0x555cac064020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:46.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.995+0000 7f141d329740 1 -- 172.21.15.7:0/2089721181 shutdown_connections 2024-09-19T04:16:46.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.995+0000 7f141d329740 1 -- 172.21.15.7:0/2089721181 wait complete. 2024-09-19T04:16:46.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.995+0000 7f141d329740 20 client.15204 trim_cache size 0 max 16384 2024-09-19T04:16:46.004 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:16:46.005 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "77957c0a-763c-11ef-bceb-c7b262605968", 2024-09-19T04:16:46.005 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 4, 2024-09-19T04:16:46.005 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24472, 2024-09-19T04:16:46.005 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-19T04:16:46.005 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-19T04:16:46.005 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-19T04:16:46.005 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 89.184495833, 2024-09-19T04:16:46.005 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 27, 2024-09-19T04:16:46.005 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 88, 2024-09-19T04:16:46.005 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 86, 2024-09-19T04:16:46.005 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 159.23232012599999 2024-09-19T04:16:46.005 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:16:46.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.995+0000 7f141af50640 1 -- 172.21.15.7:0/2109320284 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f14000a32d0 msgr2=0x7f14000a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:46.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.995+0000 7f141af50640 1 --2- 172.21.15.7:0/2109320284 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f14000a32d0 0x7f14000a5790 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f140c010c40 tx=0x7f140c017000 comp rx=0 tx=0).stop 2024-09-19T04:16:46.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.995+0000 7f141af50640 1 -- 172.21.15.7:0/2109320284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1414102570 msgr2=0x7f1414198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:46.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.995+0000 7f141af50640 1 --2- 172.21.15.7:0/2109320284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1414102570 0x7f1414198a40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f13fc006010 tx=0x7f13fc003c10 comp rx=0 tx=0).stop 2024-09-19T04:16:46.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.995+0000 7f141af50640 1 -- 172.21.15.7:0/2109320284 shutdown_connections 2024-09-19T04:16:46.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.995+0000 7f141af50640 1 --2- 172.21.15.7:0/2109320284 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f14000a32d0 0x7f14000a5790 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:46.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.995+0000 7f141af50640 1 --2- 172.21.15.7:0/2109320284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1414102ef0 0x7f141419cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:46.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.995+0000 7f141af50640 1 --2- 172.21.15.7:0/2109320284 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1414102570 0x7f1414198a40 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:46.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.995+0000 7f141af50640 1 --2- 172.21.15.7:0/2109320284 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1414100e20 0x7f1414198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:46.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.996+0000 7f141af50640 1 -- 172.21.15.7:0/2109320284 >> 172.21.15.7:0/2109320284 conn(0x7f14140fc7d0 msgr2=0x7f14140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:46.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.996+0000 7f141af50640 1 -- 172.21.15.7:0/2109320284 shutdown_connections 2024-09-19T04:16:46.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:45.996+0000 7f141af50640 1 -- 172.21.15.7:0/2109320284 wait complete. 2024-09-19T04:16:46.308 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T04:16:46.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-19T04:16:46.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-19T04:16:46.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2024-09-19T04:16:46.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [5, 10]}]: dispatch 2024-09-19T04:16:46.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T04:16:46.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-19T04:16:46.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-19T04:16:46.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2024-09-19T04:16:46.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [5, 10]}]: dispatch 2024-09-19T04:16:46.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:46 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T04:16:46.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:46 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-19T04:16:46.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:46 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-19T04:16:46.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:46 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]: dispatch 2024-09-19T04:16:46.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:46 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [5, 10]}]: dispatch 2024-09-19T04:16:46.698 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-19T04:16:46.956 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:47.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:47 smithi007 ceph-mon[31360]: pgmap v348: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T04:16:47.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:47 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T04:16:47.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:47 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-19T04:16:47.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:47 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-19T04:16:47.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:47 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-09-19T04:16:47.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:47 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [5, 10]}]': finished 2024-09-19T04:16:47.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:47 smithi007 ceph-mon[31360]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T04:16:47.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:47 smithi007 ceph-mon[31360]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-19T04:16:47.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:47 smithi102 ceph-mon[35446]: pgmap v348: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T04:16:47.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:47 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T04:16:47.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:47 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-19T04:16:47.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:47 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-19T04:16:47.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:47 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-09-19T04:16:47.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:47 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [5, 10]}]': finished 2024-09-19T04:16:47.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:47 smithi102 ceph-mon[35446]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T04:16:47.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:47 smithi102 ceph-mon[35446]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-19T04:16:47.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.471+0000 7f8cf33b4640 1 -- 172.21.15.7:0/3114606976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cec102790 msgr2=0x7f8cec1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:47.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.471+0000 7f8cf33b4640 1 --2- 172.21.15.7:0/3114606976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cec102790 0x7f8cec1067e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0009900 tx=0x7f8ce002a410 comp rx=0 tx=0).stop 2024-09-19T04:16:47.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.471+0000 7f8cf33b4640 1 -- 172.21.15.7:0/3114606976 shutdown_connections 2024-09-19T04:16:47.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.471+0000 7f8cf33b4640 1 --2- 172.21.15.7:0/3114606976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cec106f10 0x7f8cec10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.471+0000 7f8cf33b4640 1 --2- 172.21.15.7:0/3114606976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cec102790 0x7f8cec1067e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.471+0000 7f8cf33b4640 1 --2- 172.21.15.7:0/3114606976 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cec101de0 0x7f8cec1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.471+0000 7f8cf33b4640 1 -- 172.21.15.7:0/3114606976 >> 172.21.15.7:0/3114606976 conn(0x7f8cec0fd8c0 msgr2=0x7f8cec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:47.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.471+0000 7f8cf33b4640 1 -- 172.21.15.7:0/3114606976 shutdown_connections 2024-09-19T04:16:47.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.471+0000 7f8cf33b4640 1 -- 172.21.15.7:0/3114606976 wait complete. 2024-09-19T04:16:47.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.472+0000 7f8cf33b4640 1 Processor -- start 2024-09-19T04:16:47.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.472+0000 7f8cf33b4640 1 -- start start 2024-09-19T04:16:47.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.472+0000 7f8cf33b4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cec101de0 0x7f8cec1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:47.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.472+0000 7f8cf33b4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cec102790 0x7f8cec198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:47.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.472+0000 7f8cf33b4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cec106f10 0x7f8cec19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:47.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.472+0000 7f8cf33b4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8cec111f70 con 0x7f8cec106f10 2024-09-19T04:16:47.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.472+0000 7f8cf33b4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8cec111df0 con 0x7f8cec102790 2024-09-19T04:16:47.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.472+0000 7f8cf33b4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8cec1120f0 con 0x7f8cec101de0 2024-09-19T04:16:47.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.472+0000 7f8cf1951640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cec106f10 0x7f8cec19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:47.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.472+0000 7f8cf1951640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cec106f10 0x7f8cec19cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48134/0 (socket says 172.21.15.7:48134) 2024-09-19T04:16:47.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.472+0000 7f8cf1951640 1 -- 172.21.15.7:0/2742977194 learned_addr learned my addr 172.21.15.7:0/2742977194 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:47.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.472+0000 7f8cf094f640 1 --2- 172.21.15.7:0/2742977194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cec102790 0x7f8cec198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:47.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.472+0000 7f8cf1150640 1 --2- 172.21.15.7:0/2742977194 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cec101de0 0x7f8cec1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:47.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.472+0000 7f8cf1951640 1 -- 172.21.15.7:0/2742977194 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cec101de0 msgr2=0x7f8cec1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:47.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.472+0000 7f8cf1951640 1 --2- 172.21.15.7:0/2742977194 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cec101de0 0x7f8cec1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.472+0000 7f8cf1951640 1 -- 172.21.15.7:0/2742977194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cec102790 msgr2=0x7f8cec198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:47.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.472+0000 7f8cf1951640 1 --2- 172.21.15.7:0/2742977194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cec102790 0x7f8cec198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.472+0000 7f8cf1951640 1 -- 172.21.15.7:0/2742977194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cec19d380 con 0x7f8cec106f10 2024-09-19T04:16:47.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.472+0000 7f8cf1150640 1 --2- 172.21.15.7:0/2742977194 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cec101de0 0x7f8cec1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:16:47.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.473+0000 7f8cf1951640 1 --2- 172.21.15.7:0/2742977194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cec106f10 0x7f8cec19cca0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8ce400c970 tx=0x7f8ce400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:47.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.473+0000 7f8cea7fc640 1 -- 172.21.15.7:0/2742977194 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce4007bb0 con 0x7f8cec106f10 2024-09-19T04:16:47.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.473+0000 7f8cea7fc640 1 -- 172.21.15.7:0/2742977194 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ce4007d50 con 0x7f8cec106f10 2024-09-19T04:16:47.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.473+0000 7f8cf33b4640 1 -- 172.21.15.7:0/2742977194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cec19d670 con 0x7f8cec106f10 2024-09-19T04:16:47.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.473+0000 7f8cea7fc640 1 -- 172.21.15.7:0/2742977194 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce4018800 con 0x7f8cec106f10 2024-09-19T04:16:47.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.473+0000 7f8cf33b4640 1 -- 172.21.15.7:0/2742977194 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cec1a4f50 con 0x7f8cec106f10 2024-09-19T04:16:47.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.475+0000 7f8cea7fc640 1 -- 172.21.15.7:0/2742977194 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f8ce400fa50 con 0x7f8cec106f10 2024-09-19T04:16:47.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.475+0000 7f8cf578d740 1 Processor -- start 2024-09-19T04:16:47.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.475+0000 7f8cf578d740 1 -- start start 2024-09-19T04:16:47.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.476+0000 7f8cf578d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55728408f9d0 0x55728408fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:47.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.476+0000 7f8cf578d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572840902f0 0x55728409a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:47.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.476+0000 7f8cf578d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55728409abb0 0x55728409cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:47.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.476+0000 7f8cf578d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557283ff6090 con 0x55728409abb0 2024-09-19T04:16:47.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.476+0000 7f8cf578d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557283f9da70 con 0x55728408f9d0 2024-09-19T04:16:47.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.476+0000 7f8cf578d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557283ff2050 con 0x5572840902f0 2024-09-19T04:16:47.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.476+0000 7f8cf094f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55728409abb0 0x55728409cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:47.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.476+0000 7f8cea7fc640 1 --2- 172.21.15.7:0/2742977194 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f8cd40a3240 0x7f8cd40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:47.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.476+0000 7f8cf094f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55728409abb0 0x55728409cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48144/0 (socket says 172.21.15.7:48144) 2024-09-19T04:16:47.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.476+0000 7f8cf094f640 1 -- 172.21.15.7:0/2538763454 learned_addr learned my addr 172.21.15.7:0/2538763454 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:47.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.476+0000 7f8cf094f640 1 --2- 172.21.15.7:0/2538763454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55728408f9d0 0x55728408fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:47.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.476+0000 7f8cf1150640 1 --2- 172.21.15.7:0/2538763454 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572840902f0 0x55728409a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:47.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.476+0000 7f8cf1951640 1 --2- 172.21.15.7:0/2742977194 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f8cd40a3240 0x7f8cd40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:47.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.476+0000 7f8cea7fc640 1 -- 172.21.15.7:0/2742977194 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f8ce40cfd70 con 0x7f8cec106f10 2024-09-19T04:16:47.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.476+0000 7f8cf094f640 1 -- 172.21.15.7:0/2538763454 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572840902f0 msgr2=0x55728409a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:47.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.476+0000 7f8cf094f640 1 --2- 172.21.15.7:0/2538763454 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572840902f0 0x55728409a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.476+0000 7f8cf094f640 1 -- 172.21.15.7:0/2538763454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55728408f9d0 msgr2=0x55728408fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:47.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.476+0000 7f8cf094f640 1 --2- 172.21.15.7:0/2538763454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55728408f9d0 0x55728408fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.476+0000 7f8cf094f640 1 -- 172.21.15.7:0/2538763454 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557283faa130 con 0x55728409abb0 2024-09-19T04:16:47.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.477+0000 7f8cf094f640 1 --2- 172.21.15.7:0/2538763454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55728409abb0 0x55728409cfa0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0031550 tx=0x7f8ce00058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5d63c2690ece4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:47.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.477+0000 7f8cf1951640 1 --2- 172.21.15.7:0/2742977194 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f8cd40a3240 0x7f8cd40a5700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4098990 tx=0x7f8ce406ee40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:47.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.477+0000 7f8cd37fe640 1 -- 172.21.15.7:0/2538763454 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0035040 con 0x55728409abb0 2024-09-19T04:16:47.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.477+0000 7f8cd37fe640 1 -- 172.21.15.7:0/2538763454 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ce00319e0 con 0x55728409abb0 2024-09-19T04:16:47.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.477+0000 7f8cd37fe640 1 -- 172.21.15.7:0/2538763454 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0004a00 con 0x55728409abb0 2024-09-19T04:16:47.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.478+0000 7f8cf578d740 1 -- 172.21.15.7:0/2538763454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55728409abb0 msgr2=0x55728409cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:47.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.478+0000 7f8cf578d740 1 --2- 172.21.15.7:0/2538763454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55728409abb0 0x55728409cfa0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0031550 tx=0x7f8ce00058d0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.478+0000 7f8cf578d740 1 -- 172.21.15.7:0/2538763454 shutdown_connections 2024-09-19T04:16:47.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.478+0000 7f8cf578d740 1 --2- 172.21.15.7:0/2538763454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55728409abb0 0x55728409cfa0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.478+0000 7f8cf578d740 1 --2- 172.21.15.7:0/2538763454 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572840902f0 0x55728409a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.478+0000 7f8cf578d740 1 --2- 172.21.15.7:0/2538763454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55728408f9d0 0x55728408fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.478+0000 7f8cf578d740 1 -- 172.21.15.7:0/2538763454 >> 172.21.15.7:0/2538763454 conn(0x55728408bf60 msgr2=0x55728408c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:47.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.478+0000 7f8cf578d740 1 -- 172.21.15.7:0/2538763454 shutdown_connections 2024-09-19T04:16:47.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.478+0000 7f8cf578d740 1 -- 172.21.15.7:0/2538763454 wait complete. 2024-09-19T04:16:47.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.478+0000 7f8cf578d740 1 -- start start 2024-09-19T04:16:47.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.478+0000 7f8cf578d740 1 Processor -- start 2024-09-19T04:16:47.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.479+0000 7f8cf578d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55728408f9d0 0x55728409a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:47.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.479+0000 7f8cf578d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572840902f0 0x5572840977e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:47.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.479+0000 7f8cf578d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55728409abb0 0x557284097d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:47.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.479+0000 7f8cf578d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55728409d780 con 0x55728408f9d0 2024-09-19T04:16:47.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.479+0000 7f8cf578d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557283fb0f20 con 0x55728409abb0 2024-09-19T04:16:47.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.479+0000 7f8cf578d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55728409d900 con 0x5572840902f0 2024-09-19T04:16:47.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.479+0000 7f8cf578d740 10 client.0 _ll_register_callbacks cb 0x557283f7a030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:16:47.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.479+0000 7f8cf094f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55728408f9d0 0x55728409a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.479+0000 7f8cf094f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55728408f9d0 0x55728409a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48156/0 (socket says 172.21.15.7:48156) 2024-09-19T04:16:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.479+0000 7f8cf094f640 1 -- 172.21.15.7:0/1642872832 learned_addr learned my addr 172.21.15.7:0/1642872832 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.479+0000 7f8cf094f640 1 --2- 172.21.15.7:0/1642872832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55728409abb0 0x557284097d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.479+0000 7f8cf1150640 1 --2- 172.21.15.7:0/1642872832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572840902f0 0x5572840977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.479+0000 7f8cf094f640 1 -- 172.21.15.7:0/1642872832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572840902f0 msgr2=0x5572840977e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.479+0000 7f8cf094f640 1 --2- 172.21.15.7:0/1642872832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572840902f0 0x5572840977e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.479+0000 7f8cf094f640 1 -- 172.21.15.7:0/1642872832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55728409abb0 msgr2=0x557284097d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.479+0000 7f8cf094f640 1 --2- 172.21.15.7:0/1642872832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55728409abb0 0x557284097d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.479+0000 7f8cf094f640 1 -- 172.21.15.7:0/1642872832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557283d672b0 con 0x55728408f9d0 2024-09-19T04:16:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.479+0000 7f8cf094f640 1 --2- 172.21.15.7:0/1642872832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55728408f9d0 0x55728409a490 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8ce002a930 tx=0x7f8ce00044b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2786af63d8af491a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.479+0000 7f8cd0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:16:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.479+0000 7f8cd0ff9640 1 -- 172.21.15.7:0/1642872832 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0035070 con 0x55728408f9d0 2024-09-19T04:16:47.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.479+0000 7f8cd0ff9640 1 -- 172.21.15.7:0/1642872832 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f8ce0004bb0 con 0x55728408f9d0 2024-09-19T04:16:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.479+0000 7f8cf578d740 1 -- 172.21.15.7:0/1642872832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ce00319e0 con 0x55728408f9d0 2024-09-19T04:16:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.480+0000 7f8cd0ff9640 1 -- 172.21.15.7:0/1642872832 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8ce0004db0 con 0x55728408f9d0 2024-09-19T04:16:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.480+0000 7f8cf578d740 10 client.15216 fetch_fsmap learned FSMap version 27 2024-09-19T04:16:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.480+0000 7f8cf578d740 1 -- 172.21.15.7:0/1642872832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5572840a90f0 con 0x55728408f9d0 2024-09-19T04:16:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.480+0000 7f8cd0ff9640 1 -- 172.21.15.7:0/1642872832 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ce00319e0 con 0x55728408f9d0 2024-09-19T04:16:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.481+0000 7f8cd0ff9640 1 -- 172.21.15.7:0/1642872832 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f8ce003a040 con 0x55728408f9d0 2024-09-19T04:16:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.481+0000 7f8cf578d740 10 client.15216 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:16:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.481+0000 7f8cf578d740 10 client.15216 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T04:16:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.481+0000 7f8cf578d740 20 client.15216 populate_metadata read hostname 'smithi007' 2024-09-19T04:16:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.481+0000 7f8cf578d740 1 --2- 172.21.15.7:0/1642872832 >> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] conn(0x5572840aa440 0x5572840ac560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.481+0000 7f8cf578d740 4 client.15216 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:16:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.481+0000 7f8cf578d740 1 -- 172.21.15.7:0/1642872832 --> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557284003600 con 0x5572840aa440 2024-09-19T04:16:47.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.481+0000 7f8cf1150640 1 --2- 172.21.15.7:0/1642872832 >> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] conn(0x5572840aa440 0x5572840ac560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.482+0000 7f8cf1150640 1 --2- 172.21.15.7:0/1642872832 >> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] conn(0x5572840aa440 0x5572840ac560 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1283a5b1b7d85019 server_cookie=d5a5ba9e106a374f in_seq=0 out_seq=0 2024-09-19T04:16:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.482+0000 7f8cd0ff9640 10 client.15216 ms_handle_connect on v2:172.21.15.102:6836/618291553 2024-09-19T04:16:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.482+0000 7f8cd0ff9640 1 -- 172.21.15.7:0/1642872832 <== mds.3 v2:172.21.15.102:6836/618291553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557284003600 con 0x5572840aa440 2024-09-19T04:16:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.482+0000 7f8cd0ff9640 10 client.15216 handle_command_reply: tid=0 2024-09-19T04:16:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.483+0000 7f8cf578d740 1 client.15216 shutdown 2024-09-19T04:16:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.483+0000 7f8cf578d740 1 -- 172.21.15.7:0/1642872832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55728408f9d0 msgr2=0x55728409a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.483+0000 7f8cf578d740 1 --2- 172.21.15.7:0/1642872832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55728408f9d0 0x55728409a490 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8ce002a930 tx=0x7f8ce00044b0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.483+0000 7f8cf578d740 1 -- 172.21.15.7:0/1642872832 shutdown_connections 2024-09-19T04:16:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.483+0000 7f8cf578d740 1 --2- 172.21.15.7:0/1642872832 >> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] conn(0x5572840aa440 0x5572840ac560 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.483+0000 7f8cd0ff9640 0 client.15216 ms_handle_reset on v2:172.21.15.102:6836/618291553 2024-09-19T04:16:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.483+0000 7f8cf578d740 1 --2- 172.21.15.7:0/1642872832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55728409abb0 0x557284097d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.483+0000 7f8cf578d740 1 --2- 172.21.15.7:0/1642872832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5572840902f0 0x5572840977e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.483+0000 7f8cf578d740 1 --2- 172.21.15.7:0/1642872832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55728408f9d0 0x55728409a490 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.483+0000 7f8cf578d740 1 -- 172.21.15.7:0/1642872832 >> 172.21.15.7:0/1642872832 conn(0x55728408bf60 msgr2=0x557284091c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:47.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.483+0000 7f8cf578d740 1 -- 172.21.15.7:0/1642872832 shutdown_connections 2024-09-19T04:16:47.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.483+0000 7f8cf578d740 1 -- 172.21.15.7:0/1642872832 wait complete. 2024-09-19T04:16:47.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.483+0000 7f8cf578d740 20 client.15216 trim_cache size 0 max 16384 2024-09-19T04:16:47.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.501+0000 7f8cf578d740 1 Processor -- start 2024-09-19T04:16:47.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.501+0000 7f8cf578d740 1 -- start start 2024-09-19T04:16:47.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.501+0000 7f8cf578d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55728408f9d0 0x5572840ac560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:47.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.501+0000 7f8cf578d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572840902f0 0x557284092c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:47.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.501+0000 7f8cf578d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55728409abb0 0x557284094a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:47.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.501+0000 7f8cf578d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5572840aa8a0 con 0x55728408f9d0 2024-09-19T04:16:47.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.501+0000 7f8cf578d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5572840aaf70 con 0x5572840902f0 2024-09-19T04:16:47.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.501+0000 7f8cf578d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5572840ab640 con 0x55728409abb0 2024-09-19T04:16:47.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.501+0000 7f8cf094f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55728408f9d0 0x5572840ac560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:47.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.501+0000 7f8cf094f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55728408f9d0 0x5572840ac560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48168/0 (socket says 172.21.15.7:48168) 2024-09-19T04:16:47.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.501+0000 7f8cf094f640 1 -- 172.21.15.7:0/80779858 learned_addr learned my addr 172.21.15.7:0/80779858 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:47.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.501+0000 7f8cf1150640 1 --2- 172.21.15.7:0/80779858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572840902f0 0x557284092c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:47.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.502+0000 7f8cf094f640 1 --2- 172.21.15.7:0/80779858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55728409abb0 0x557284094a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:47.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.502+0000 7f8cf094f640 1 -- 172.21.15.7:0/80779858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55728409abb0 msgr2=0x557284094a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:47.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.502+0000 7f8cf094f640 1 --2- 172.21.15.7:0/80779858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55728409abb0 0x557284094a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.502+0000 7f8cf094f640 1 -- 172.21.15.7:0/80779858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572840902f0 msgr2=0x557284092c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:47.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.502+0000 7f8cf094f640 1 --2- 172.21.15.7:0/80779858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572840902f0 0x557284092c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.502+0000 7f8cf094f640 1 -- 172.21.15.7:0/80779858 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55728409a800 con 0x55728408f9d0 2024-09-19T04:16:47.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.502+0000 7f8cf094f640 1 --2- 172.21.15.7:0/80779858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55728408f9d0 0x5572840ac560 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0009900 tx=0x7f8ce0004f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5972fb9db23c7d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:47.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.502+0000 7f8cd2ffd640 1 -- 172.21.15.7:0/80779858 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0035040 con 0x55728408f9d0 2024-09-19T04:16:47.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.502+0000 7f8cd2ffd640 1 -- 172.21.15.7:0/80779858 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ce00315b0 con 0x55728408f9d0 2024-09-19T04:16:47.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.502+0000 7f8cd2ffd640 1 -- 172.21.15.7:0/80779858 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce004abb0 con 0x55728408f9d0 2024-09-19T04:16:47.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.503+0000 7f8cf578d740 1 -- 172.21.15.7:0/80779858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55728408f9d0 msgr2=0x5572840ac560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:47.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.503+0000 7f8cf578d740 1 --2- 172.21.15.7:0/80779858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55728408f9d0 0x5572840ac560 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0009900 tx=0x7f8ce0004f50 comp rx=0 tx=0).stop 2024-09-19T04:16:47.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.503+0000 7f8cf578d740 1 -- 172.21.15.7:0/80779858 shutdown_connections 2024-09-19T04:16:47.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.503+0000 7f8cf578d740 1 --2- 172.21.15.7:0/80779858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55728409abb0 0x557284094a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.503+0000 7f8cf578d740 1 --2- 172.21.15.7:0/80779858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5572840902f0 0x557284092c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.503+0000 7f8cf578d740 1 --2- 172.21.15.7:0/80779858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55728408f9d0 0x5572840ac560 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.503+0000 7f8cf578d740 1 -- 172.21.15.7:0/80779858 >> 172.21.15.7:0/80779858 conn(0x55728408bf60 msgr2=0x557284092580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:47.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.503+0000 7f8cf578d740 1 -- 172.21.15.7:0/80779858 shutdown_connections 2024-09-19T04:16:47.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.503+0000 7f8cf578d740 1 -- 172.21.15.7:0/80779858 wait complete. 2024-09-19T04:16:47.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.503+0000 7f8cf578d740 1 -- start start 2024-09-19T04:16:47.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.503+0000 7f8cf578d740 1 Processor -- start 2024-09-19T04:16:47.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.504+0000 7f8cf578d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55728408f9d0 0x5572840b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:47.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.504+0000 7f8cf578d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572840902f0 0x5572840b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:47.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.504+0000 7f8cf578d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55728409abb0 0x5572840add50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:47.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.504+0000 7f8cf578d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5572840ac3e0 con 0x5572840902f0 2024-09-19T04:16:47.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.504+0000 7f8cf578d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5572840abd10 con 0x55728409abb0 2024-09-19T04:16:47.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.504+0000 7f8cf578d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5572840acab0 con 0x55728408f9d0 2024-09-19T04:16:47.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.504+0000 7f8cf578d740 10 client.0 _ll_register_callbacks cb 0x7f8ce0032ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:16:47.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.504+0000 7f8cf1150640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572840902f0 0x5572840b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:47.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.504+0000 7f8cf1150640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572840902f0 0x5572840b4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48172/0 (socket says 172.21.15.7:48172) 2024-09-19T04:16:47.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.504+0000 7f8cf1150640 1 -- 172.21.15.7:0/2356492011 learned_addr learned my addr 172.21.15.7:0/2356492011 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:47.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.504+0000 7f8cf094f640 1 --2- 172.21.15.7:0/2356492011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55728408f9d0 0x5572840b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:47.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.504+0000 7f8cf094f640 1 --2- 172.21.15.7:0/2356492011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55728409abb0 0x5572840add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:47.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.504+0000 7f8cf1150640 1 -- 172.21.15.7:0/2356492011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55728408f9d0 msgr2=0x5572840b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:47.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.504+0000 7f8cf1150640 1 --2- 172.21.15.7:0/2356492011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55728408f9d0 0x5572840b4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.504+0000 7f8cf1150640 1 -- 172.21.15.7:0/2356492011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55728409abb0 msgr2=0x5572840add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:47.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.504+0000 7f8cf1150640 1 --2- 172.21.15.7:0/2356492011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55728409abb0 0x5572840add50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.504+0000 7f8cf1150640 1 -- 172.21.15.7:0/2356492011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572840ae580 con 0x5572840902f0 2024-09-19T04:16:47.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.504+0000 7f8cf094f640 1 --2- 172.21.15.7:0/2356492011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55728408f9d0 0x5572840b4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:16:47.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.504+0000 7f8cf1150640 1 --2- 172.21.15.7:0/2356492011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572840902f0 0x5572840b4f60 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x55728408cdc0 tx=0x7f8cdc0118f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=577d081a454b4780 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:47.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.504+0000 7f8cd0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:16:47.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.504+0000 7f8cd0ff9640 1 -- 172.21.15.7:0/2356492011 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc021030 con 0x5572840902f0 2024-09-19T04:16:47.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.504+0000 7f8cd0ff9640 1 -- 172.21.15.7:0/2356492011 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f8cdc01d5a0 con 0x5572840902f0 2024-09-19T04:16:47.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.504+0000 7f8cf578d740 1 -- 172.21.15.7:0/2356492011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ce00315b0 con 0x5572840902f0 2024-09-19T04:16:47.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.505+0000 7f8cd0ff9640 1 -- 172.21.15.7:0/2356492011 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8cdc030050 con 0x5572840902f0 2024-09-19T04:16:47.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.505+0000 7f8cf578d740 10 client.15222 fetch_fsmap learned FSMap version 27 2024-09-19T04:16:47.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.505+0000 7f8cf578d740 1 -- 172.21.15.7:0/2356492011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5572840b3060 con 0x5572840902f0 2024-09-19T04:16:47.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.505+0000 7f8cd0ff9640 1 -- 172.21.15.7:0/2356492011 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ce00315b0 con 0x5572840902f0 2024-09-19T04:16:47.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.505+0000 7f8cd0ff9640 1 -- 172.21.15.7:0/2356492011 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f8cdc005720 con 0x5572840902f0 2024-09-19T04:16:47.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.505+0000 7f8cf578d740 10 client.15222 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:16:47.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.505+0000 7f8cf578d740 10 client.15222 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T04:16:47.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.505+0000 7f8cf578d740 20 client.15222 populate_metadata read hostname 'smithi007' 2024-09-19T04:16:47.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.505+0000 7f8cf578d740 1 --2- 172.21.15.7:0/2356492011 >> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] conn(0x5572840aa440 0x557284118c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:47.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.505+0000 7f8cf578d740 4 client.15222 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T04:16:47.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.505+0000 7f8cf578d740 1 -- 172.21.15.7:0/2356492011 --> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] -- command(tid 0: {"prefix": "status"}) -- 0x557283ffdb10 con 0x5572840aa440 2024-09-19T04:16:47.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.505+0000 7f8cf094f640 1 --2- 172.21.15.7:0/2356492011 >> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] conn(0x5572840aa440 0x557284118c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:47.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.506+0000 7f8cd0ff9640 10 client.15222 ms_handle_connect on v2:172.21.15.102:6836/618291553 2024-09-19T04:16:47.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.506+0000 7f8cf094f640 1 --2- 172.21.15.7:0/2356492011 >> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] conn(0x5572840aa440 0x557284118c50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8b57c2c6b00c3b5a server_cookie=6d9952a7a39f5395 in_seq=0 out_seq=0 2024-09-19T04:16:47.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.506+0000 7f8cd0ff9640 1 -- 172.21.15.7:0/2356492011 <== mds.3 v2:172.21.15.102:6836/618291553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x557283ffdb10 con 0x5572840aa440 2024-09-19T04:16:47.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.506+0000 7f8cd0ff9640 10 client.15222 handle_command_reply: tid=0 2024-09-19T04:16:47.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.506+0000 7f8cf578d740 1 client.15222 shutdown 2024-09-19T04:16:47.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.506+0000 7f8cf578d740 1 -- 172.21.15.7:0/2356492011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572840902f0 msgr2=0x5572840b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:47.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.506+0000 7f8cf578d740 1 --2- 172.21.15.7:0/2356492011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572840902f0 0x5572840b4f60 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x55728408cdc0 tx=0x7f8cdc0118f0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.506+0000 7f8cf578d740 1 -- 172.21.15.7:0/2356492011 shutdown_connections 2024-09-19T04:16:47.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.506+0000 7f8cf578d740 1 --2- 172.21.15.7:0/2356492011 >> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] conn(0x5572840aa440 0x557284118c50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.506+0000 7f8cf578d740 1 --2- 172.21.15.7:0/2356492011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55728409abb0 0x5572840add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.506+0000 7f8cf578d740 1 --2- 172.21.15.7:0/2356492011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5572840902f0 0x5572840b4f60 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.506+0000 7f8cf578d740 1 --2- 172.21.15.7:0/2356492011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55728408f9d0 0x5572840b4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.506+0000 7f8cf578d740 1 -- 172.21.15.7:0/2356492011 >> 172.21.15.7:0/2356492011 conn(0x55728408bf60 msgr2=0x55728408b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:47.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.506+0000 7f8cd0ff9640 0 client.15222 ms_handle_reset on v2:172.21.15.102:6836/618291553 2024-09-19T04:16:47.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.506+0000 7f8cf578d740 1 -- 172.21.15.7:0/2356492011 shutdown_connections 2024-09-19T04:16:47.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.506+0000 7f8cf578d740 1 -- 172.21.15.7:0/2356492011 wait complete. 2024-09-19T04:16:47.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.506+0000 7f8cf578d740 20 client.15222 trim_cache size 0 max 16384 2024-09-19T04:16:47.515 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:16:47.515 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "77957c0a-763c-11ef-bceb-c7b262605968", 2024-09-19T04:16:47.515 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 3, 2024-09-19T04:16:47.515 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24478, 2024-09-19T04:16:47.515 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-19T04:16:47.515 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-19T04:16:47.515 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-19T04:16:47.515 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 91.700741205, 2024-09-19T04:16:47.515 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 27, 2024-09-19T04:16:47.515 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 90, 2024-09-19T04:16:47.515 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 86, 2024-09-19T04:16:47.516 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 158.21326228199999 2024-09-19T04:16:47.516 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:16:47.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.507+0000 7f8cf33b4640 1 -- 172.21.15.7:0/2742977194 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f8cd40a3240 msgr2=0x7f8cd40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:47.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.507+0000 7f8cf33b4640 1 --2- 172.21.15.7:0/2742977194 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f8cd40a3240 0x7f8cd40a5700 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4098990 tx=0x7f8ce406ee40 comp rx=0 tx=0).stop 2024-09-19T04:16:47.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.507+0000 7f8cf33b4640 1 -- 172.21.15.7:0/2742977194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cec106f10 msgr2=0x7f8cec19cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:47.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.507+0000 7f8cf33b4640 1 --2- 172.21.15.7:0/2742977194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cec106f10 0x7f8cec19cca0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8ce400c970 tx=0x7f8ce400ce30 comp rx=0 tx=0).stop 2024-09-19T04:16:47.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.507+0000 7f8cf33b4640 1 -- 172.21.15.7:0/2742977194 shutdown_connections 2024-09-19T04:16:47.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.507+0000 7f8cf33b4640 1 --2- 172.21.15.7:0/2742977194 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f8cd40a3240 0x7f8cd40a5700 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.507+0000 7f8cf33b4640 1 --2- 172.21.15.7:0/2742977194 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8cec106f10 0x7f8cec19cca0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.507+0000 7f8cf33b4640 1 --2- 172.21.15.7:0/2742977194 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cec102790 0x7f8cec198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.507+0000 7f8cf33b4640 1 --2- 172.21.15.7:0/2742977194 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8cec101de0 0x7f8cec1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:47.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.507+0000 7f8cf33b4640 1 -- 172.21.15.7:0/2742977194 >> 172.21.15.7:0/2742977194 conn(0x7f8cec0fd8c0 msgr2=0x7f8cec0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:47.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.507+0000 7f8cf33b4640 1 -- 172.21.15.7:0/2742977194 shutdown_connections 2024-09-19T04:16:47.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:47.507+0000 7f8cf33b4640 1 -- 172.21.15.7:0/2742977194 wait complete. 2024-09-19T04:16:47.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:47 smithi092 ceph-mon[34940]: pgmap v348: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T04:16:47.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:47 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T04:16:47.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:47 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-19T04:16:47.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:47 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-19T04:16:47.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:47 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [9, 8]}]': finished 2024-09-19T04:16:47.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:47 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [5, 10]}]': finished 2024-09-19T04:16:47.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:47 smithi092 ceph-mon[34940]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T04:16:47.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:47 smithi092 ceph-mon[34940]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-19T04:16:48.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:48 smithi007 ceph-mon[31360]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T04:16:48.234 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T04:16:48.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:48 smithi102 ceph-mon[35446]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T04:16:48.493 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:48.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:48 smithi092 ceph-mon[34940]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T04:16:48.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.957+0000 7fb1aad86640 1 -- 172.21.15.7:0/1189148272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1a4100a60 msgr2=0x7fb1a4100ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:48.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.957+0000 7fb1aad86640 1 --2- 172.21.15.7:0/1189148272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1a4100a60 0x7fb1a4100ec0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb190009930 tx=0x7fb19002a420 comp rx=0 tx=0).stop 2024-09-19T04:16:48.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.957+0000 7fb1aad86640 1 -- 172.21.15.7:0/1189148272 shutdown_connections 2024-09-19T04:16:48.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.957+0000 7fb1aad86640 1 --2- 172.21.15.7:0/1189148272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1a4101400 0x7fb1a410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:48.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.957+0000 7fb1aad86640 1 --2- 172.21.15.7:0/1189148272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1a4100a60 0x7fb1a4100ec0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:48.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.957+0000 7fb1aad86640 1 --2- 172.21.15.7:0/1189148272 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1a4106a60 0x7fb1a4106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:48.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.957+0000 7fb1aad86640 1 -- 172.21.15.7:0/1189148272 >> 172.21.15.7:0/1189148272 conn(0x7fb1a40fc780 msgr2=0x7fb1a40feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:48.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.957+0000 7fb1aad86640 1 -- 172.21.15.7:0/1189148272 shutdown_connections 2024-09-19T04:16:48.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.957+0000 7fb1aad86640 1 -- 172.21.15.7:0/1189148272 wait complete. 2024-09-19T04:16:48.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.957+0000 7fb1aad86640 1 Processor -- start 2024-09-19T04:16:48.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.958+0000 7fb1aad86640 1 -- start start 2024-09-19T04:16:48.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.958+0000 7fb1aad86640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1a4100a60 0x7fb1a41972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:48.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.958+0000 7fb1aad86640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1a4101400 0x7fb1a4197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:48.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.958+0000 7fb1aad86640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1a4106a60 0x7fb1a419bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:48.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.958+0000 7fb1aad86640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a4110e60 con 0x7fb1a4100a60 2024-09-19T04:16:48.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.958+0000 7fb1aad86640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a4110ce0 con 0x7fb1a4101400 2024-09-19T04:16:48.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.958+0000 7fb1aad86640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a4110fe0 con 0x7fb1a4106a60 2024-09-19T04:16:48.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.958+0000 7fb1a8b22640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1a4100a60 0x7fb1a41972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:48.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.958+0000 7fb1a8b22640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1a4100a60 0x7fb1a41972c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48176/0 (socket says 172.21.15.7:48176) 2024-09-19T04:16:48.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.958+0000 7fb1a8b22640 1 -- 172.21.15.7:0/1483946357 learned_addr learned my addr 172.21.15.7:0/1483946357 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:48.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.958+0000 7fb1a9323640 1 --2- 172.21.15.7:0/1483946357 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1a4106a60 0x7fb1a419bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:48.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.958+0000 7fb1a3fff640 1 --2- 172.21.15.7:0/1483946357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1a4101400 0x7fb1a4197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:48.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.958+0000 7fb1a8b22640 1 -- 172.21.15.7:0/1483946357 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1a4106a60 msgr2=0x7fb1a419bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:48.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.958+0000 7fb1a8b22640 1 --2- 172.21.15.7:0/1483946357 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1a4106a60 0x7fb1a419bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:48.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.958+0000 7fb1a8b22640 1 -- 172.21.15.7:0/1483946357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1a4101400 msgr2=0x7fb1a4197800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:48.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.958+0000 7fb1a8b22640 1 --2- 172.21.15.7:0/1483946357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1a4101400 0x7fb1a4197800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:48.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.958+0000 7fb1a8b22640 1 -- 172.21.15.7:0/1483946357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a419c270 con 0x7fb1a4100a60 2024-09-19T04:16:48.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.958+0000 7fb1a8b22640 1 --2- 172.21.15.7:0/1483946357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1a4100a60 0x7fb1a41972c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb198007b50 tx=0x7fb19800e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:48.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.959+0000 7fb1a1ffb640 1 -- 172.21.15.7:0/1483946357 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb198007c40 con 0x7fb1a4100a60 2024-09-19T04:16:48.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.959+0000 7fb1a1ffb640 1 -- 172.21.15.7:0/1483946357 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb198007de0 con 0x7fb1a4100a60 2024-09-19T04:16:48.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.959+0000 7fb1aad86640 1 -- 172.21.15.7:0/1483946357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1a419c560 con 0x7fb1a4100a60 2024-09-19T04:16:48.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.959+0000 7fb1a1ffb640 1 -- 172.21.15.7:0/1483946357 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19800ae60 con 0x7fb1a4100a60 2024-09-19T04:16:48.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.959+0000 7fb1aad86640 1 -- 172.21.15.7:0/1483946357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1a406a790 con 0x7fb1a4100a60 2024-09-19T04:16:48.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.961+0000 7fb1a1ffb640 1 -- 172.21.15.7:0/1483946357 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fb19800a440 con 0x7fb1a4100a60 2024-09-19T04:16:48.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.961+0000 7fb1ad15f740 1 Processor -- start 2024-09-19T04:16:48.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.962+0000 7fb1ad15f740 1 -- start start 2024-09-19T04:16:48.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.962+0000 7fb1ad15f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573a8a1a8d0 0x5573a8a1acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:48.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.962+0000 7fb1ad15f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5573a8a1b1f0 0x5573a8a29a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:48.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.962+0000 7fb1ad15f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573a8a29fc0 0x5573a8a2c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:48.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.962+0000 7fb1ad15f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5573a8981090 con 0x5573a8a1a8d0 2024-09-19T04:16:48.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.962+0000 7fb1ad15f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5573a8928a70 con 0x5573a8a29fc0 2024-09-19T04:16:48.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.962+0000 7fb1ad15f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5573a897d050 con 0x5573a8a1b1f0 2024-09-19T04:16:48.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.962+0000 7fb1a1ffb640 1 --2- 172.21.15.7:0/1483946357 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb1940a32c0 0x7fb1940a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:48.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.962+0000 7fb1a9323640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573a8a1a8d0 0x5573a8a1acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:48.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.962+0000 7fb1a9323640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573a8a1a8d0 0x5573a8a1acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48180/0 (socket says 172.21.15.7:48180) 2024-09-19T04:16:48.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.962+0000 7fb1a9323640 1 -- 172.21.15.7:0/2106431711 learned_addr learned my addr 172.21.15.7:0/2106431711 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:48.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.962+0000 7fb1a9323640 1 --2- 172.21.15.7:0/1483946357 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb1940a32c0 0x7fb1940a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:48.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.962+0000 7fb1a1ffb640 1 -- 172.21.15.7:0/1483946357 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fb1980d1120 con 0x7fb1a4100a60 2024-09-19T04:16:48.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.962+0000 7fb1a8b22640 1 --2- 172.21.15.7:0/2106431711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5573a8a1b1f0 0x5573a8a29a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:48.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.962+0000 7fb1a3fff640 1 --2- 172.21.15.7:0/2106431711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573a8a29fc0 0x5573a8a2c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:48.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.962+0000 7fb1a9323640 1 -- 172.21.15.7:0/2106431711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5573a8a1b1f0 msgr2=0x5573a8a29a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:48.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.962+0000 7fb1a9323640 1 --2- 172.21.15.7:0/2106431711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5573a8a1b1f0 0x5573a8a29a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:48.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.962+0000 7fb1a9323640 1 -- 172.21.15.7:0/2106431711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573a8a29fc0 msgr2=0x5573a8a2c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:48.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.962+0000 7fb1a9323640 1 --2- 172.21.15.7:0/2106431711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573a8a29fc0 0x5573a8a2c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:48.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.962+0000 7fb1a9323640 1 -- 172.21.15.7:0/2106431711 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573a8935130 con 0x5573a8a1a8d0 2024-09-19T04:16:48.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.962+0000 7fb1a3fff640 1 --2- 172.21.15.7:0/2106431711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573a8a29fc0 0x5573a8a2c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:16:48.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.963+0000 7fb1a9323640 1 --2- 172.21.15.7:0/2106431711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573a8a1a8d0 0x5573a8a1acb0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb19c011e20 tx=0x7fb19c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bbd7288365fb589 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:48.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.963+0000 7fb1a9323640 1 --2- 172.21.15.7:0/1483946357 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb1940a32c0 0x7fb1940a5780 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00fc90 tx=0x7fb19c01e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:48.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.963+0000 7fb18effd640 1 -- 172.21.15.7:0/2106431711 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19c01dcb0 con 0x5573a8a1a8d0 2024-09-19T04:16:48.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.963+0000 7fb18effd640 1 -- 172.21.15.7:0/2106431711 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb19c01de50 con 0x5573a8a1a8d0 2024-09-19T04:16:48.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.963+0000 7fb18effd640 1 -- 172.21.15.7:0/2106431711 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19c004280 con 0x5573a8a1a8d0 2024-09-19T04:16:48.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.963+0000 7fb1ad15f740 1 -- 172.21.15.7:0/2106431711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573a8a1a8d0 msgr2=0x5573a8a1acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:48.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.963+0000 7fb1ad15f740 1 --2- 172.21.15.7:0/2106431711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573a8a1a8d0 0x5573a8a1acb0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb19c011e20 tx=0x7fb19c00f790 comp rx=0 tx=0).stop 2024-09-19T04:16:48.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.964+0000 7fb1ad15f740 1 -- 172.21.15.7:0/2106431711 shutdown_connections 2024-09-19T04:16:48.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.964+0000 7fb1ad15f740 1 --2- 172.21.15.7:0/2106431711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573a8a29fc0 0x5573a8a2c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:48.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.964+0000 7fb1ad15f740 1 --2- 172.21.15.7:0/2106431711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5573a8a1b1f0 0x5573a8a29a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:48.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.964+0000 7fb1ad15f740 1 --2- 172.21.15.7:0/2106431711 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573a8a1a8d0 0x5573a8a1acb0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:48.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.964+0000 7fb1ad15f740 1 -- 172.21.15.7:0/2106431711 >> 172.21.15.7:0/2106431711 conn(0x5573a8a16f60 msgr2=0x5573a8a17340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:48.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.964+0000 7fb1ad15f740 1 -- 172.21.15.7:0/2106431711 shutdown_connections 2024-09-19T04:16:48.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.964+0000 7fb1ad15f740 1 -- 172.21.15.7:0/2106431711 wait complete. 2024-09-19T04:16:48.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.964+0000 7fb1ad15f740 1 -- start start 2024-09-19T04:16:48.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.964+0000 7fb1ad15f740 1 Processor -- start 2024-09-19T04:16:48.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.964+0000 7fb1ad15f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5573a8a1a8d0 0x5573a8a29930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:48.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.964+0000 7fb1ad15f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573a8a1b1f0 0x5573a8a26c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:48.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.964+0000 7fb1ad15f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573a8a29fc0 0x5573a8a271e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:48.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.964+0000 7fb1ad15f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5573a8a2cb30 con 0x5573a8a29fc0 2024-09-19T04:16:48.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.965+0000 7fb1ad15f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5573a893bf20 con 0x5573a8a1b1f0 2024-09-19T04:16:48.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.965+0000 7fb1ad15f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5573a8a2ccb0 con 0x5573a8a1a8d0 2024-09-19T04:16:48.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.965+0000 7fb1ad15f740 10 client.0 _ll_register_callbacks cb 0x5573a8905030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:16:48.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.965+0000 7fb1a9323640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573a8a29fc0 0x5573a8a271e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:48.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.965+0000 7fb1a9323640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573a8a29fc0 0x5573a8a271e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48182/0 (socket says 172.21.15.7:48182) 2024-09-19T04:16:48.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.965+0000 7fb1a9323640 1 -- 172.21.15.7:0/2969439164 learned_addr learned my addr 172.21.15.7:0/2969439164 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:48.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.965+0000 7fb1a3fff640 1 --2- 172.21.15.7:0/2969439164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573a8a1b1f0 0x5573a8a26c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:48.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.965+0000 7fb1a8b22640 1 --2- 172.21.15.7:0/2969439164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5573a8a1a8d0 0x5573a8a29930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:48.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.965+0000 7fb1a9323640 1 -- 172.21.15.7:0/2969439164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5573a8a1a8d0 msgr2=0x5573a8a29930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:48.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.965+0000 7fb1a9323640 1 --2- 172.21.15.7:0/2969439164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5573a8a1a8d0 0x5573a8a29930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:48.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.965+0000 7fb1a9323640 1 -- 172.21.15.7:0/2969439164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573a8a1b1f0 msgr2=0x5573a8a26c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:48.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.965+0000 7fb1a9323640 1 --2- 172.21.15.7:0/2969439164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573a8a1b1f0 0x5573a8a26c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:48.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.965+0000 7fb1a9323640 1 -- 172.21.15.7:0/2969439164 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573a86f22b0 con 0x5573a8a29fc0 2024-09-19T04:16:48.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.965+0000 7fb1a8b22640 1 --2- 172.21.15.7:0/2969439164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5573a8a1a8d0 0x5573a8a29930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:16:48.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.965+0000 7fb1a9323640 1 --2- 172.21.15.7:0/2969439164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573a8a29fc0 0x5573a8a271e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb19c003d50 tx=0x7fb19c004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d83675545eeb0f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:48.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.965+0000 7fb183fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:16:48.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.965+0000 7fb183fff640 1 -- 172.21.15.7:0/2969439164 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19c033020 con 0x5573a8a29fc0 2024-09-19T04:16:48.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.965+0000 7fb183fff640 1 -- 172.21.15.7:0/2969439164 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fb19c005040 con 0x5573a8a29fc0 2024-09-19T04:16:48.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.965+0000 7fb1ad15f740 1 -- 172.21.15.7:0/2969439164 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb19c01de50 con 0x5573a8a29fc0 2024-09-19T04:16:48.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.966+0000 7fb183fff640 1 -- 172.21.15.7:0/2969439164 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb19c03e050 con 0x5573a8a29fc0 2024-09-19T04:16:48.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.966+0000 7fb1ad15f740 10 client.15234 fetch_fsmap learned FSMap version 27 2024-09-19T04:16:48.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.966+0000 7fb1ad15f740 1 -- 172.21.15.7:0/2969439164 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5573a8a38540 con 0x5573a8a29fc0 2024-09-19T04:16:48.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.966+0000 7fb183fff640 1 -- 172.21.15.7:0/2969439164 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb19c01de50 con 0x5573a8a29fc0 2024-09-19T04:16:48.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.966+0000 7fb183fff640 1 -- 172.21.15.7:0/2969439164 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fb19c003fd0 con 0x5573a8a29fc0 2024-09-19T04:16:48.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.966+0000 7fb1ad15f740 10 client.15234 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:16:48.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.966+0000 7fb1ad15f740 10 client.15234 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T04:16:48.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.966+0000 7fb1ad15f740 20 client.15234 populate_metadata read hostname 'smithi007' 2024-09-19T04:16:48.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.966+0000 7fb1ad15f740 1 --2- 172.21.15.7:0/2969439164 >> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] conn(0x5573a8a3a960 0x5573a8a3bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:48.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.966+0000 7fb1ad15f740 4 client.15234 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:16:48.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.966+0000 7fb1ad15f740 1 -- 172.21.15.7:0/2969439164 --> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5573a898e600 con 0x5573a8a3a960 2024-09-19T04:16:48.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.966+0000 7fb1a8b22640 1 --2- 172.21.15.7:0/2969439164 >> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] conn(0x5573a8a3a960 0x5573a8a3bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:48.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.967+0000 7fb1a8b22640 1 --2- 172.21.15.7:0/2969439164 >> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] conn(0x5573a8a3a960 0x5573a8a3bdd0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4e207b8cb49df2d9 server_cookie=a6c9a945e7ec7882 in_seq=0 out_seq=0 2024-09-19T04:16:48.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.967+0000 7fb183fff640 10 client.15234 ms_handle_connect on v2:172.21.15.92:6836/319779585 2024-09-19T04:16:48.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.968+0000 7fb183fff640 1 -- 172.21.15.7:0/2969439164 <== mds.2 v2:172.21.15.92:6836/319779585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5573a898e600 con 0x5573a8a3a960 2024-09-19T04:16:48.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.968+0000 7fb183fff640 10 client.15234 handle_command_reply: tid=0 2024-09-19T04:16:48.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.968+0000 7fb1ad15f740 1 client.15234 shutdown 2024-09-19T04:16:48.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.968+0000 7fb1ad15f740 1 -- 172.21.15.7:0/2969439164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573a8a29fc0 msgr2=0x5573a8a271e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:48.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.968+0000 7fb1ad15f740 1 --2- 172.21.15.7:0/2969439164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573a8a29fc0 0x5573a8a271e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb19c003d50 tx=0x7fb19c004f40 comp rx=0 tx=0).stop 2024-09-19T04:16:48.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.968+0000 7fb1ad15f740 1 -- 172.21.15.7:0/2969439164 shutdown_connections 2024-09-19T04:16:48.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.968+0000 7fb1ad15f740 1 --2- 172.21.15.7:0/2969439164 >> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] conn(0x5573a8a3a960 0x5573a8a3bdd0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:48.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.968+0000 7fb1ad15f740 1 --2- 172.21.15.7:0/2969439164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573a8a29fc0 0x5573a8a271e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:48.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.968+0000 7fb183fff640 0 client.15234 ms_handle_reset on v2:172.21.15.92:6836/319779585 2024-09-19T04:16:48.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.968+0000 7fb1ad15f740 1 --2- 172.21.15.7:0/2969439164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573a8a1b1f0 0x5573a8a26c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:48.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.968+0000 7fb1ad15f740 1 --2- 172.21.15.7:0/2969439164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5573a8a1a8d0 0x5573a8a29930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:48.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.968+0000 7fb1ad15f740 1 -- 172.21.15.7:0/2969439164 >> 172.21.15.7:0/2969439164 conn(0x5573a8a16f60 msgr2=0x5573a8a1ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:48.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.968+0000 7fb1ad15f740 1 -- 172.21.15.7:0/2969439164 shutdown_connections 2024-09-19T04:16:48.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.968+0000 7fb1ad15f740 1 -- 172.21.15.7:0/2969439164 wait complete. 2024-09-19T04:16:48.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.968+0000 7fb1ad15f740 20 client.15234 trim_cache size 0 max 16384 2024-09-19T04:16:48.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.986+0000 7fb1ad15f740 1 Processor -- start 2024-09-19T04:16:48.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.986+0000 7fb1ad15f740 1 -- start start 2024-09-19T04:16:48.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.986+0000 7fb1ad15f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573a8a1a8d0 0x5573a8a271d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:48.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.986+0000 7fb1ad15f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5573a8a1b1f0 0x5573a8a3bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:48.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.986+0000 7fb1ad15f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573a8a29fc0 0x5573a8a11e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:48.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.986+0000 7fb1ad15f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5573a8a3a110 con 0x5573a8a1a8d0 2024-09-19T04:16:48.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.986+0000 7fb1ad15f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5573a8a3a7e0 con 0x5573a8a29fc0 2024-09-19T04:16:48.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.986+0000 7fb1ad15f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5573a8a3aeb0 con 0x5573a8a1b1f0 2024-09-19T04:16:48.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.986+0000 7fb1a8b22640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573a8a1a8d0 0x5573a8a271d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:48.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.987+0000 7fb1a8b22640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573a8a1a8d0 0x5573a8a271d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48188/0 (socket says 172.21.15.7:48188) 2024-09-19T04:16:48.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.987+0000 7fb1a8b22640 1 -- 172.21.15.7:0/4216654714 learned_addr learned my addr 172.21.15.7:0/4216654714 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:48.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.987+0000 7fb1a9323640 1 --2- 172.21.15.7:0/4216654714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573a8a29fc0 0x5573a8a11e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:48.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.987+0000 7fb1a3fff640 1 --2- 172.21.15.7:0/4216654714 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5573a8a1b1f0 0x5573a8a3bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:48.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.987+0000 7fb1a8b22640 1 -- 172.21.15.7:0/4216654714 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5573a8a1b1f0 msgr2=0x5573a8a3bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:48.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.987+0000 7fb1a8b22640 1 --2- 172.21.15.7:0/4216654714 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5573a8a1b1f0 0x5573a8a3bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:48.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.987+0000 7fb1a8b22640 1 -- 172.21.15.7:0/4216654714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573a8a29fc0 msgr2=0x5573a8a11e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:48.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.987+0000 7fb1a8b22640 1 --2- 172.21.15.7:0/4216654714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573a8a29fc0 0x5573a8a11e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:48.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.987+0000 7fb1a8b22640 1 -- 172.21.15.7:0/4216654714 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573a8a36860 con 0x5573a8a1a8d0 2024-09-19T04:16:48.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.987+0000 7fb1a9323640 1 --2- 172.21.15.7:0/4216654714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573a8a29fc0 0x5573a8a11e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:16:48.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.987+0000 7fb1a8b22640 1 --2- 172.21.15.7:0/4216654714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573a8a1a8d0 0x5573a8a271d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb198099860 tx=0x7fb198099040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f0a2a66eca4c154 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:48.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.987+0000 7fb18e7fc640 1 -- 172.21.15.7:0/4216654714 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1980a5fe0 con 0x5573a8a1a8d0 2024-09-19T04:16:48.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.987+0000 7fb18e7fc640 1 -- 172.21.15.7:0/4216654714 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb19800a730 con 0x5573a8a1a8d0 2024-09-19T04:16:48.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.987+0000 7fb18e7fc640 1 -- 172.21.15.7:0/4216654714 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19809c850 con 0x5573a8a1a8d0 2024-09-19T04:16:48.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.988+0000 7fb1ad15f740 1 -- 172.21.15.7:0/4216654714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573a8a1a8d0 msgr2=0x5573a8a271d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:48.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.988+0000 7fb1ad15f740 1 --2- 172.21.15.7:0/4216654714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573a8a1a8d0 0x5573a8a271d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb198099860 tx=0x7fb198099040 comp rx=0 tx=0).stop 2024-09-19T04:16:48.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.988+0000 7fb1ad15f740 1 -- 172.21.15.7:0/4216654714 shutdown_connections 2024-09-19T04:16:48.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.988+0000 7fb1ad15f740 1 --2- 172.21.15.7:0/4216654714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573a8a29fc0 0x5573a8a11e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:48.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.988+0000 7fb1ad15f740 1 --2- 172.21.15.7:0/4216654714 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5573a8a1b1f0 0x5573a8a3bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:48.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.988+0000 7fb1ad15f740 1 --2- 172.21.15.7:0/4216654714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573a8a1a8d0 0x5573a8a271d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:48.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.988+0000 7fb1ad15f740 1 -- 172.21.15.7:0/4216654714 >> 172.21.15.7:0/4216654714 conn(0x5573a8a16f60 msgr2=0x5573a8a17340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:48.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.988+0000 7fb1ad15f740 1 -- 172.21.15.7:0/4216654714 shutdown_connections 2024-09-19T04:16:48.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.988+0000 7fb1ad15f740 1 -- 172.21.15.7:0/4216654714 wait complete. 2024-09-19T04:16:48.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.988+0000 7fb1ad15f740 1 -- start start 2024-09-19T04:16:48.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.988+0000 7fb1ad15f740 1 Processor -- start 2024-09-19T04:16:48.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.989+0000 7fb1ad15f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573a8a1a8d0 0x5573a8a3d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:48.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.989+0000 7fb1ad15f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573a8a1b1f0 0x5573a8a3dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:48.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.989+0000 7fb1ad15f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5573a8a29fc0 0x5573a8aa3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:48.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.989+0000 7fb1ad15f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5573a8a3bc50 con 0x5573a8a1b1f0 2024-09-19T04:16:48.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.989+0000 7fb1ad15f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5573a8a3b580 con 0x5573a8a1a8d0 2024-09-19T04:16:48.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.989+0000 7fb1ad15f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5573a8a3c320 con 0x5573a8a29fc0 2024-09-19T04:16:48.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.989+0000 7fb1ad15f740 10 client.0 _ll_register_callbacks cb 0x7fb198097d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:16:48.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.989+0000 7fb1a3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573a8a1b1f0 0x5573a8a3dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:48.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.989+0000 7fb1a3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573a8a1b1f0 0x5573a8a3dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48200/0 (socket says 172.21.15.7:48200) 2024-09-19T04:16:48.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.989+0000 7fb1a3fff640 1 -- 172.21.15.7:0/3381223115 learned_addr learned my addr 172.21.15.7:0/3381223115 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:48.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.989+0000 7fb1a9323640 1 --2- 172.21.15.7:0/3381223115 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5573a8a29fc0 0x5573a8aa3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:48.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.989+0000 7fb1a8b22640 1 --2- 172.21.15.7:0/3381223115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573a8a1a8d0 0x5573a8a3d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:48.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.989+0000 7fb1a3fff640 1 -- 172.21.15.7:0/3381223115 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5573a8a29fc0 msgr2=0x5573a8aa3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:48.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.989+0000 7fb1a3fff640 1 --2- 172.21.15.7:0/3381223115 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5573a8a29fc0 0x5573a8aa3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:48.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.989+0000 7fb1a3fff640 1 -- 172.21.15.7:0/3381223115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573a8a1a8d0 msgr2=0x5573a8a3d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:48.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.989+0000 7fb1a3fff640 1 --2- 172.21.15.7:0/3381223115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573a8a1a8d0 0x5573a8a3d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:48.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.989+0000 7fb1a3fff640 1 -- 172.21.15.7:0/3381223115 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573a8aa35a0 con 0x5573a8a1b1f0 2024-09-19T04:16:48.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.989+0000 7fb1a3fff640 1 --2- 172.21.15.7:0/3381223115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573a8a1b1f0 0x5573a8a3dab0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb190009340 tx=0x7fb190031920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b2576b2a4c6e8a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:48.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.989+0000 7fb183fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:16:48.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.990+0000 7fb183fff640 1 -- 172.21.15.7:0/3381223115 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb190035040 con 0x5573a8a1b1f0 2024-09-19T04:16:49.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.990+0000 7fb183fff640 1 -- 172.21.15.7:0/3381223115 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fb190004250 con 0x5573a8a1b1f0 2024-09-19T04:16:49.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.990+0000 7fb1ad15f740 1 -- 172.21.15.7:0/3381223115 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb19800a730 con 0x5573a8a1b1f0 2024-09-19T04:16:49.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.990+0000 7fb183fff640 1 -- 172.21.15.7:0/3381223115 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb190031a10 con 0x5573a8a1b1f0 2024-09-19T04:16:49.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.990+0000 7fb1ad15f740 10 client.15240 fetch_fsmap learned FSMap version 27 2024-09-19T04:16:49.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.990+0000 7fb1ad15f740 1 -- 172.21.15.7:0/3381223115 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5573a8aa4800 con 0x5573a8a1b1f0 2024-09-19T04:16:49.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.990+0000 7fb183fff640 1 -- 172.21.15.7:0/3381223115 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb19800a730 con 0x5573a8a1b1f0 2024-09-19T04:16:49.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.990+0000 7fb183fff640 1 -- 172.21.15.7:0/3381223115 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7fb190004ae0 con 0x5573a8a1b1f0 2024-09-19T04:16:49.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.990+0000 7fb1ad15f740 10 client.15240 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:16:49.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.990+0000 7fb1ad15f740 10 client.15240 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T04:16:49.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.990+0000 7fb1ad15f740 20 client.15240 populate_metadata read hostname 'smithi007' 2024-09-19T04:16:49.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.990+0000 7fb1ad15f740 1 --2- 172.21.15.7:0/3381223115 >> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] conn(0x5573a8a3a960 0x5573a8aa8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:49.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.990+0000 7fb1ad15f740 4 client.15240 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T04:16:49.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.990+0000 7fb1ad15f740 1 -- 172.21.15.7:0/3381223115 --> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] -- command(tid 0: {"prefix": "status"}) -- 0x5573a8988b10 con 0x5573a8a3a960 2024-09-19T04:16:49.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.991+0000 7fb1a8b22640 1 --2- 172.21.15.7:0/3381223115 >> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] conn(0x5573a8a3a960 0x5573a8aa8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:49.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.991+0000 7fb1a8b22640 1 --2- 172.21.15.7:0/3381223115 >> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] conn(0x5573a8a3a960 0x5573a8aa8190 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cc59004a9ce39722 server_cookie=e09acc352341ded8 in_seq=0 out_seq=0 2024-09-19T04:16:49.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.991+0000 7fb183fff640 10 client.15240 ms_handle_connect on v2:172.21.15.92:6836/319779585 2024-09-19T04:16:49.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.991+0000 7fb183fff640 1 -- 172.21.15.7:0/3381223115 <== mds.2 v2:172.21.15.92:6836/319779585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5573a8988b10 con 0x5573a8a3a960 2024-09-19T04:16:49.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.991+0000 7fb183fff640 10 client.15240 handle_command_reply: tid=0 2024-09-19T04:16:49.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.991+0000 7fb1ad15f740 1 client.15240 shutdown 2024-09-19T04:16:49.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.991+0000 7fb1ad15f740 1 -- 172.21.15.7:0/3381223115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573a8a1b1f0 msgr2=0x5573a8a3dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:49.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.991+0000 7fb1ad15f740 1 --2- 172.21.15.7:0/3381223115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573a8a1b1f0 0x5573a8a3dab0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb190009340 tx=0x7fb190031920 comp rx=0 tx=0).stop 2024-09-19T04:16:49.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.991+0000 7fb1ad15f740 1 -- 172.21.15.7:0/3381223115 shutdown_connections 2024-09-19T04:16:49.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.991+0000 7fb1ad15f740 1 --2- 172.21.15.7:0/3381223115 >> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] conn(0x5573a8a3a960 0x5573a8aa8190 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:49.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.991+0000 7fb1ad15f740 1 --2- 172.21.15.7:0/3381223115 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5573a8a29fc0 0x5573a8aa3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:49.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.991+0000 7fb1ad15f740 1 --2- 172.21.15.7:0/3381223115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5573a8a1b1f0 0x5573a8a3dab0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:49.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.991+0000 7fb1ad15f740 1 --2- 172.21.15.7:0/3381223115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5573a8a1a8d0 0x5573a8a3d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:49.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.991+0000 7fb1ad15f740 1 -- 172.21.15.7:0/3381223115 >> 172.21.15.7:0/3381223115 conn(0x5573a8a16f60 msgr2=0x5573a8a39a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:49.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.991+0000 7fb183fff640 0 client.15240 ms_handle_reset on v2:172.21.15.92:6836/319779585 2024-09-19T04:16:49.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.992+0000 7fb1ad15f740 1 -- 172.21.15.7:0/3381223115 shutdown_connections 2024-09-19T04:16:49.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.992+0000 7fb1ad15f740 1 -- 172.21.15.7:0/3381223115 wait complete. 2024-09-19T04:16:49.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.992+0000 7fb1ad15f740 20 client.15240 trim_cache size 0 max 16384 2024-09-19T04:16:49.002 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:16:49.002 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "77957c0a-763c-11ef-bceb-c7b262605968", 2024-09-19T04:16:49.002 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 2, 2024-09-19T04:16:49.003 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24482, 2024-09-19T04:16:49.003 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-19T04:16:49.003 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-19T04:16:49.003 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-19T04:16:49.003 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 94.194310525000006, 2024-09-19T04:16:49.003 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 27, 2024-09-19T04:16:49.003 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 90, 2024-09-19T04:16:49.003 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 86, 2024-09-19T04:16:49.003 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 156.98818844100001 2024-09-19T04:16:49.004 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:16:49.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.992+0000 7fb1aad86640 1 -- 172.21.15.7:0/1483946357 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb1940a32c0 msgr2=0x7fb1940a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:49.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.992+0000 7fb1aad86640 1 --2- 172.21.15.7:0/1483946357 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb1940a32c0 0x7fb1940a5780 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00fc90 tx=0x7fb19c01e000 comp rx=0 tx=0).stop 2024-09-19T04:16:49.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.992+0000 7fb1aad86640 1 -- 172.21.15.7:0/1483946357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1a4100a60 msgr2=0x7fb1a41972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:49.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.992+0000 7fb1aad86640 1 --2- 172.21.15.7:0/1483946357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1a4100a60 0x7fb1a41972c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb198007b50 tx=0x7fb19800e420 comp rx=0 tx=0).stop 2024-09-19T04:16:49.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.992+0000 7fb1aad86640 1 -- 172.21.15.7:0/1483946357 shutdown_connections 2024-09-19T04:16:49.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.992+0000 7fb1aad86640 1 --2- 172.21.15.7:0/1483946357 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb1940a32c0 0x7fb1940a5780 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:49.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.992+0000 7fb1aad86640 1 --2- 172.21.15.7:0/1483946357 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1a4106a60 0x7fb1a419bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:49.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.992+0000 7fb1aad86640 1 --2- 172.21.15.7:0/1483946357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1a4101400 0x7fb1a4197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:49.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.992+0000 7fb1aad86640 1 --2- 172.21.15.7:0/1483946357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1a4100a60 0x7fb1a41972c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:49.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.992+0000 7fb1aad86640 1 -- 172.21.15.7:0/1483946357 >> 172.21.15.7:0/1483946357 conn(0x7fb1a40fc780 msgr2=0x7fb1a40fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:49.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.992+0000 7fb1aad86640 1 -- 172.21.15.7:0/1483946357 shutdown_connections 2024-09-19T04:16:49.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:48.993+0000 7fb1aad86640 1 -- 172.21.15.7:0/1483946357 wait complete. 2024-09-19T04:16:49.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:49 smithi007 ceph-mon[31360]: pgmap v351: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T04:16:49.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:49 smithi102 ceph-mon[35446]: pgmap v351: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T04:16:49.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:49 smithi092 ceph-mon[34940]: pgmap v351: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-19T04:16:49.669 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T04:16:49.924 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:50.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.369+0000 7f9d133d4640 1 -- 172.21.15.7:0/1975890410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d0c101de0 msgr2=0x7f9d0c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:50.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.369+0000 7f9d133d4640 1 --2- 172.21.15.7:0/1975890410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d0c101de0 0x7f9d0c1021c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9d08009900 tx=0x7f9d0802a410 comp rx=0 tx=0).stop 2024-09-19T04:16:50.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.369+0000 7f9d133d4640 1 -- 172.21.15.7:0/1975890410 shutdown_connections 2024-09-19T04:16:50.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.369+0000 7f9d133d4640 1 --2- 172.21.15.7:0/1975890410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d0c106f10 0x7f9d0c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.369+0000 7f9d133d4640 1 --2- 172.21.15.7:0/1975890410 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d0c102790 0x7f9d0c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.369+0000 7f9d133d4640 1 --2- 172.21.15.7:0/1975890410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d0c101de0 0x7f9d0c1021c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.369+0000 7f9d133d4640 1 -- 172.21.15.7:0/1975890410 >> 172.21.15.7:0/1975890410 conn(0x7f9d0c0fd8c0 msgr2=0x7f9d0c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:50.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.369+0000 7f9d133d4640 1 -- 172.21.15.7:0/1975890410 shutdown_connections 2024-09-19T04:16:50.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.369+0000 7f9d133d4640 1 -- 172.21.15.7:0/1975890410 wait complete. 2024-09-19T04:16:50.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.370+0000 7f9d133d4640 1 Processor -- start 2024-09-19T04:16:50.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.370+0000 7f9d133d4640 1 -- start start 2024-09-19T04:16:50.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.370+0000 7f9d133d4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d0c101de0 0x7f9d0c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:50.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.370+0000 7f9d133d4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d0c102790 0x7f9d0c1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:50.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.370+0000 7f9d133d4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d0c106f10 0x7f9d0c19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:50.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.370+0000 7f9d133d4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c111f70 con 0x7f9d0c102790 2024-09-19T04:16:50.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.370+0000 7f9d133d4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c111df0 con 0x7f9d0c101de0 2024-09-19T04:16:50.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.370+0000 7f9d133d4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c1120f0 con 0x7f9d0c106f10 2024-09-19T04:16:50.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.370+0000 7f9d1096f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d0c102790 0x7f9d0c1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:50.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.370+0000 7f9d1096f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d0c102790 0x7f9d0c1989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48212/0 (socket says 172.21.15.7:48212) 2024-09-19T04:16:50.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.370+0000 7f9d1096f640 1 -- 172.21.15.7:0/3394933389 learned_addr learned my addr 172.21.15.7:0/3394933389 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:50.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.371+0000 7f9d11971640 1 --2- 172.21.15.7:0/3394933389 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d0c106f10 0x7f9d0c19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:50.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.371+0000 7f9d11170640 1 --2- 172.21.15.7:0/3394933389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d0c101de0 0x7f9d0c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:50.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.371+0000 7f9d1096f640 1 -- 172.21.15.7:0/3394933389 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d0c106f10 msgr2=0x7f9d0c19cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:50.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.371+0000 7f9d1096f640 1 --2- 172.21.15.7:0/3394933389 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d0c106f10 0x7f9d0c19cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.371+0000 7f9d1096f640 1 -- 172.21.15.7:0/3394933389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d0c101de0 msgr2=0x7f9d0c198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:50.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.371+0000 7f9d1096f640 1 --2- 172.21.15.7:0/3394933389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d0c101de0 0x7f9d0c198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.371+0000 7f9d1096f640 1 -- 172.21.15.7:0/3394933389 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d0c19d410 con 0x7f9d0c102790 2024-09-19T04:16:50.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.371+0000 7f9d11170640 1 --2- 172.21.15.7:0/3394933389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d0c101de0 0x7f9d0c198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:16:50.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.371+0000 7f9d1096f640 1 --2- 172.21.15.7:0/3394933389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d0c102790 0x7f9d0c1989a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc00d770 tx=0x7f9cfc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:50.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.371+0000 7f9d027fc640 1 -- 172.21.15.7:0/3394933389 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc017070 con 0x7f9d0c102790 2024-09-19T04:16:50.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.371+0000 7f9d133d4640 1 -- 172.21.15.7:0/3394933389 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d0c19d700 con 0x7f9d0c102790 2024-09-19T04:16:50.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.371+0000 7f9d027fc640 1 -- 172.21.15.7:0/3394933389 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cfc005500 con 0x7f9d0c102790 2024-09-19T04:16:50.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.371+0000 7f9d027fc640 1 -- 172.21.15.7:0/3394933389 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc004e00 con 0x7f9d0c102790 2024-09-19T04:16:50.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.371+0000 7f9d133d4640 1 -- 172.21.15.7:0/3394933389 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d0c1a4fe0 con 0x7f9d0c102790 2024-09-19T04:16:50.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.373+0000 7f9d027fc640 1 -- 172.21.15.7:0/3394933389 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f9cfc004fa0 con 0x7f9d0c102790 2024-09-19T04:16:50.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.374+0000 7f9d157ad740 1 Processor -- start 2024-09-19T04:16:50.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.374+0000 7f9d157ad740 1 -- start start 2024-09-19T04:16:50.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.374+0000 7f9d157ad740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55909fd9d8d0 0x55909fd9dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:50.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.374+0000 7f9d157ad740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909fd9e1f0 0x55909fdaca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:50.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.374+0000 7f9d157ad740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55909fdacfc0 0x55909fdaf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:50.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.374+0000 7f9d157ad740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55909fd04090 con 0x55909fd9e1f0 2024-09-19T04:16:50.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.374+0000 7f9d157ad740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55909fcaba70 con 0x55909fd9d8d0 2024-09-19T04:16:50.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.374+0000 7f9d157ad740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55909fd00050 con 0x55909fdacfc0 2024-09-19T04:16:50.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.374+0000 7f9d027fc640 1 --2- 172.21.15.7:0/3394933389 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9cf80a3240 0x7f9cf80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:50.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.374+0000 7f9d11170640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909fd9e1f0 0x55909fdaca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:50.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.374+0000 7f9d11170640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909fd9e1f0 0x55909fdaca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48220/0 (socket says 172.21.15.7:48220) 2024-09-19T04:16:50.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.374+0000 7f9d11170640 1 -- 172.21.15.7:0/908339101 learned_addr learned my addr 172.21.15.7:0/908339101 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:50.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.375+0000 7f9d027fc640 1 -- 172.21.15.7:0/3394933389 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f9cfc0cf7a0 con 0x7f9d0c102790 2024-09-19T04:16:50.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.375+0000 7f9d11971640 1 --2- 172.21.15.7:0/908339101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55909fd9d8d0 0x55909fd9dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:50.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.375+0000 7f9d1096f640 1 --2- 172.21.15.7:0/908339101 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55909fdacfc0 0x55909fdaf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:50.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.375+0000 7f9d11170640 1 -- 172.21.15.7:0/908339101 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55909fdacfc0 msgr2=0x55909fdaf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:50.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.375+0000 7f9d11170640 1 --2- 172.21.15.7:0/908339101 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55909fdacfc0 0x55909fdaf3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.375+0000 7f9d11170640 1 -- 172.21.15.7:0/908339101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55909fd9d8d0 msgr2=0x55909fd9dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:50.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.375+0000 7f9d11971640 1 --2- 172.21.15.7:0/3394933389 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9cf80a3240 0x7f9cf80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:50.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.375+0000 7f9d11170640 1 --2- 172.21.15.7:0/908339101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55909fd9d8d0 0x55909fd9dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.375+0000 7f9d11170640 1 -- 172.21.15.7:0/908339101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55909fcb8130 con 0x55909fd9e1f0 2024-09-19T04:16:50.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.375+0000 7f9d11170640 1 --2- 172.21.15.7:0/908339101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909fd9e1f0 0x55909fdaca80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9d08033000 tx=0x7f9d08032cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89627bfe9bed6b88 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:50.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.375+0000 7f9cf77fe640 1 -- 172.21.15.7:0/908339101 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0803f070 con 0x55909fd9e1f0 2024-09-19T04:16:50.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.375+0000 7f9cf77fe640 1 -- 172.21.15.7:0/908339101 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d080317b0 con 0x55909fd9e1f0 2024-09-19T04:16:50.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.375+0000 7f9cf77fe640 1 -- 172.21.15.7:0/908339101 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d08035070 con 0x55909fd9e1f0 2024-09-19T04:16:50.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.376+0000 7f9d157ad740 1 -- 172.21.15.7:0/908339101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909fd9e1f0 msgr2=0x55909fdaca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:50.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.376+0000 7f9d157ad740 1 --2- 172.21.15.7:0/908339101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909fd9e1f0 0x55909fdaca80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9d08033000 tx=0x7f9d08032cb0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.376+0000 7f9d11971640 1 --2- 172.21.15.7:0/3394933389 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9cf80a3240 0x7f9cf80a5700 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9d04009990 tx=0x7f9d040096a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:50.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.376+0000 7f9d157ad740 1 -- 172.21.15.7:0/908339101 shutdown_connections 2024-09-19T04:16:50.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.376+0000 7f9d157ad740 1 --2- 172.21.15.7:0/908339101 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55909fdacfc0 0x55909fdaf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.376+0000 7f9d157ad740 1 --2- 172.21.15.7:0/908339101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909fd9e1f0 0x55909fdaca80 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.376+0000 7f9d157ad740 1 --2- 172.21.15.7:0/908339101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55909fd9d8d0 0x55909fd9dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.376+0000 7f9d157ad740 1 -- 172.21.15.7:0/908339101 >> 172.21.15.7:0/908339101 conn(0x55909fd99f60 msgr2=0x55909fd9a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:50.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.376+0000 7f9d157ad740 1 -- 172.21.15.7:0/908339101 shutdown_connections 2024-09-19T04:16:50.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.376+0000 7f9d157ad740 1 -- 172.21.15.7:0/908339101 wait complete. 2024-09-19T04:16:50.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.376+0000 7f9d157ad740 1 -- start start 2024-09-19T04:16:50.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.376+0000 7f9d157ad740 1 Processor -- start 2024-09-19T04:16:50.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.377+0000 7f9d157ad740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55909fd9d8d0 0x55909fdac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:50.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.377+0000 7f9d157ad740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909fd9e1f0 0x55909fda9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:50.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.377+0000 7f9d157ad740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55909fdacfc0 0x55909fdaa170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:50.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.377+0000 7f9d157ad740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55909fdafb90 con 0x55909fd9e1f0 2024-09-19T04:16:50.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.377+0000 7f9d157ad740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55909fcbef20 con 0x55909fd9d8d0 2024-09-19T04:16:50.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.377+0000 7f9d157ad740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55909fdafd10 con 0x55909fdacfc0 2024-09-19T04:16:50.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.377+0000 7f9d157ad740 10 client.0 _ll_register_callbacks cb 0x55909fc88030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:16:50.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.377+0000 7f9d1096f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909fd9e1f0 0x55909fda9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:50.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.377+0000 7f9d1096f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909fd9e1f0 0x55909fda9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48222/0 (socket says 172.21.15.7:48222) 2024-09-19T04:16:50.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.377+0000 7f9d1096f640 1 -- 172.21.15.7:0/2319303336 learned_addr learned my addr 172.21.15.7:0/2319303336 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:50.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.377+0000 7f9d11971640 1 --2- 172.21.15.7:0/2319303336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55909fdacfc0 0x55909fdaa170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:50.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.377+0000 7f9d11170640 1 --2- 172.21.15.7:0/2319303336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55909fd9d8d0 0x55909fdac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:50.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.377+0000 7f9d1096f640 1 -- 172.21.15.7:0/2319303336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55909fdacfc0 msgr2=0x55909fdaa170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:50.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.377+0000 7f9d1096f640 1 --2- 172.21.15.7:0/2319303336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55909fdacfc0 0x55909fdaa170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.377+0000 7f9d1096f640 1 -- 172.21.15.7:0/2319303336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55909fd9d8d0 msgr2=0x55909fdac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:50.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.377+0000 7f9d1096f640 1 --2- 172.21.15.7:0/2319303336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55909fd9d8d0 0x55909fdac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.377+0000 7f9d1096f640 1 -- 172.21.15.7:0/2319303336 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55909fa752b0 con 0x55909fd9e1f0 2024-09-19T04:16:50.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.377+0000 7f9d11170640 1 --2- 172.21.15.7:0/2319303336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55909fd9d8d0 0x55909fdac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:16:50.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.377+0000 7f9d1096f640 1 --2- 172.21.15.7:0/2319303336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909fd9e1f0 0x55909fda9c30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc097e10 tx=0x7f9cfc09b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61a93134cf17c318 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:50.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.377+0000 7f9cf4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:16:50.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.378+0000 7f9cf4ff9640 1 -- 172.21.15.7:0/2319303336 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc0b4060 con 0x55909fd9e1f0 2024-09-19T04:16:50.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.378+0000 7f9cf4ff9640 1 -- 172.21.15.7:0/2319303336 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f9cfc0860b0 con 0x55909fd9e1f0 2024-09-19T04:16:50.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.378+0000 7f9d157ad740 1 -- 172.21.15.7:0/2319303336 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d080317b0 con 0x55909fd9e1f0 2024-09-19T04:16:50.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.378+0000 7f9cf4ff9640 1 -- 172.21.15.7:0/2319303336 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9cfc020040 con 0x55909fd9e1f0 2024-09-19T04:16:50.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.378+0000 7f9d157ad740 10 client.15252 fetch_fsmap learned FSMap version 27 2024-09-19T04:16:50.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.378+0000 7f9d157ad740 1 -- 172.21.15.7:0/2319303336 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55909fdbb5b0 con 0x55909fd9e1f0 2024-09-19T04:16:50.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.378+0000 7f9cf4ff9640 1 -- 172.21.15.7:0/2319303336 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d080317b0 con 0x55909fd9e1f0 2024-09-19T04:16:50.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.378+0000 7f9cf4ff9640 1 -- 172.21.15.7:0/2319303336 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f9cfc09cce0 con 0x55909fd9e1f0 2024-09-19T04:16:50.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.378+0000 7f9d157ad740 10 client.15252 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:16:50.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.378+0000 7f9d157ad740 10 client.15252 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T04:16:50.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.378+0000 7f9d157ad740 20 client.15252 populate_metadata read hostname 'smithi007' 2024-09-19T04:16:50.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.378+0000 7f9d157ad740 1 --2- 172.21.15.7:0/2319303336 >> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] conn(0x55909fdbdb90 0x55909fdbf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:50.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.378+0000 7f9d157ad740 4 client.15252 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:16:50.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.378+0000 7f9d157ad740 1 -- 172.21.15.7:0/2319303336 --> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55909fd11600 con 0x55909fdbdb90 2024-09-19T04:16:50.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.378+0000 7f9d11170640 1 --2- 172.21.15.7:0/2319303336 >> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] conn(0x55909fdbdb90 0x55909fdbf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:50.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.379+0000 7f9d11170640 1 --2- 172.21.15.7:0/2319303336 >> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] conn(0x55909fdbdb90 0x55909fdbf000 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2d0977055ca4e996 server_cookie=d9bc7e1ae507b4a3 in_seq=0 out_seq=0 2024-09-19T04:16:50.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.379+0000 7f9cf4ff9640 10 client.15252 ms_handle_connect on v2:172.21.15.102:6838/2728093829 2024-09-19T04:16:50.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.380+0000 7f9cf4ff9640 1 -- 172.21.15.7:0/2319303336 <== mds.1 v2:172.21.15.102:6838/2728093829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55909fd11600 con 0x55909fdbdb90 2024-09-19T04:16:50.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.380+0000 7f9cf4ff9640 10 client.15252 handle_command_reply: tid=0 2024-09-19T04:16:50.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.380+0000 7f9d157ad740 1 client.15252 shutdown 2024-09-19T04:16:50.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.380+0000 7f9d157ad740 1 -- 172.21.15.7:0/2319303336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909fd9e1f0 msgr2=0x55909fda9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:50.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.380+0000 7f9d157ad740 1 --2- 172.21.15.7:0/2319303336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909fd9e1f0 0x55909fda9c30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc097e10 tx=0x7f9cfc09b400 comp rx=0 tx=0).stop 2024-09-19T04:16:50.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.380+0000 7f9d157ad740 1 -- 172.21.15.7:0/2319303336 shutdown_connections 2024-09-19T04:16:50.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.380+0000 7f9d157ad740 1 --2- 172.21.15.7:0/2319303336 >> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] conn(0x55909fdbdb90 0x55909fdbf000 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.380+0000 7f9d157ad740 1 --2- 172.21.15.7:0/2319303336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55909fdacfc0 0x55909fdaa170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.380+0000 7f9d157ad740 1 --2- 172.21.15.7:0/2319303336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909fd9e1f0 0x55909fda9c30 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.380+0000 7f9d157ad740 1 --2- 172.21.15.7:0/2319303336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55909fd9d8d0 0x55909fdac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.380+0000 7f9cf4ff9640 0 client.15252 ms_handle_reset on v2:172.21.15.102:6838/2728093829 2024-09-19T04:16:50.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.380+0000 7f9d157ad740 1 -- 172.21.15.7:0/2319303336 >> 172.21.15.7:0/2319303336 conn(0x55909fd99f60 msgr2=0x55909fd9fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:50.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.380+0000 7f9d157ad740 1 -- 172.21.15.7:0/2319303336 shutdown_connections 2024-09-19T04:16:50.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.380+0000 7f9d157ad740 1 -- 172.21.15.7:0/2319303336 wait complete. 2024-09-19T04:16:50.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.380+0000 7f9d157ad740 20 client.15252 trim_cache size 0 max 16384 2024-09-19T04:16:50.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.398+0000 7f9d157ad740 1 Processor -- start 2024-09-19T04:16:50.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.398+0000 7f9d157ad740 1 -- start start 2024-09-19T04:16:50.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.398+0000 7f9d157ad740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55909fd9d8d0 0x55909fdbf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:50.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.398+0000 7f9d157ad740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55909fd9e1f0 0x55909fd995d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:50.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.398+0000 7f9d157ad740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909fdacfc0 0x55909fd9f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:50.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.398+0000 7f9d157ad740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55909fdbd340 con 0x55909fdacfc0 2024-09-19T04:16:50.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.398+0000 7f9d157ad740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55909fdbda10 con 0x55909fd9d8d0 2024-09-19T04:16:50.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.398+0000 7f9d157ad740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55909fdbe0e0 con 0x55909fd9e1f0 2024-09-19T04:16:50.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.399+0000 7f9d11971640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909fdacfc0 0x55909fd9f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:50.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.399+0000 7f9d11971640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909fdacfc0 0x55909fd9f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48230/0 (socket says 172.21.15.7:48230) 2024-09-19T04:16:50.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.399+0000 7f9d11971640 1 -- 172.21.15.7:0/2527713142 learned_addr learned my addr 172.21.15.7:0/2527713142 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:50.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.399+0000 7f9d11170640 1 --2- 172.21.15.7:0/2527713142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55909fd9d8d0 0x55909fdbf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:50.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.399+0000 7f9d1096f640 1 --2- 172.21.15.7:0/2527713142 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55909fd9e1f0 0x55909fd995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:50.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.399+0000 7f9d11971640 1 -- 172.21.15.7:0/2527713142 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55909fd9e1f0 msgr2=0x55909fd995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:50.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.399+0000 7f9d11971640 1 --2- 172.21.15.7:0/2527713142 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55909fd9e1f0 0x55909fd995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.399+0000 7f9d11971640 1 -- 172.21.15.7:0/2527713142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55909fd9d8d0 msgr2=0x55909fdbf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:50.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.399+0000 7f9d11971640 1 --2- 172.21.15.7:0/2527713142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55909fd9d8d0 0x55909fdbf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.399+0000 7f9d11971640 1 -- 172.21.15.7:0/2527713142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55909fd9b0f0 con 0x55909fdacfc0 2024-09-19T04:16:50.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.399+0000 7f9d11170640 1 --2- 172.21.15.7:0/2527713142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55909fd9d8d0 0x55909fdbf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:16:50.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.399+0000 7f9d11971640 1 --2- 172.21.15.7:0/2527713142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909fdacfc0 0x55909fd9f450 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9d04003cd0 tx=0x7f9d04009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639766de43690492 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:50.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.399+0000 7f9cf6ffd640 1 -- 172.21.15.7:0/2527713142 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d04010720 con 0x55909fdacfc0 2024-09-19T04:16:50.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.399+0000 7f9cf6ffd640 1 -- 172.21.15.7:0/2527713142 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d0401a070 con 0x55909fdacfc0 2024-09-19T04:16:50.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.399+0000 7f9cf6ffd640 1 -- 172.21.15.7:0/2527713142 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0402abc0 con 0x55909fdacfc0 2024-09-19T04:16:50.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.400+0000 7f9d157ad740 1 -- 172.21.15.7:0/2527713142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909fdacfc0 msgr2=0x55909fd9f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:50.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.400+0000 7f9d157ad740 1 --2- 172.21.15.7:0/2527713142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909fdacfc0 0x55909fd9f450 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9d04003cd0 tx=0x7f9d04009920 comp rx=0 tx=0).stop 2024-09-19T04:16:50.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.400+0000 7f9d157ad740 1 -- 172.21.15.7:0/2527713142 shutdown_connections 2024-09-19T04:16:50.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.400+0000 7f9d157ad740 1 --2- 172.21.15.7:0/2527713142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909fdacfc0 0x55909fd9f450 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.400+0000 7f9d157ad740 1 --2- 172.21.15.7:0/2527713142 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55909fd9e1f0 0x55909fd995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.400+0000 7f9d157ad740 1 --2- 172.21.15.7:0/2527713142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55909fd9d8d0 0x55909fdbf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.400+0000 7f9d157ad740 1 -- 172.21.15.7:0/2527713142 >> 172.21.15.7:0/2527713142 conn(0x55909fd99f60 msgr2=0x55909fda5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:50.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.400+0000 7f9d157ad740 1 -- 172.21.15.7:0/2527713142 shutdown_connections 2024-09-19T04:16:50.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.400+0000 7f9d157ad740 1 -- 172.21.15.7:0/2527713142 wait complete. 2024-09-19T04:16:50.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.400+0000 7f9d157ad740 1 -- start start 2024-09-19T04:16:50.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.400+0000 7f9d157ad740 1 Processor -- start 2024-09-19T04:16:50.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.401+0000 7f9d157ad740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909fd9d8d0 0x55909fdc7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:50.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.401+0000 7f9d157ad740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55909fd9e1f0 0x55909fdc7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:50.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.401+0000 7f9d157ad740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55909fdacfc0 0x55909fdc0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:50.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.401+0000 7f9d157ad740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55909fdbee80 con 0x55909fd9d8d0 2024-09-19T04:16:50.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.401+0000 7f9d157ad740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55909fdbe7b0 con 0x55909fd9e1f0 2024-09-19T04:16:50.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.401+0000 7f9d157ad740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55909fdbf550 con 0x55909fdacfc0 2024-09-19T04:16:50.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.401+0000 7f9d157ad740 10 client.0 _ll_register_callbacks cb 0x7f9cfc00de80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:16:50.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.401+0000 7f9d11170640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909fd9d8d0 0x55909fdc7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:50.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.401+0000 7f9d11170640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909fd9d8d0 0x55909fdc7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48234/0 (socket says 172.21.15.7:48234) 2024-09-19T04:16:50.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.401+0000 7f9d11170640 1 -- 172.21.15.7:0/1644695955 learned_addr learned my addr 172.21.15.7:0/1644695955 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:50.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.401+0000 7f9d11971640 1 --2- 172.21.15.7:0/1644695955 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55909fdacfc0 0x55909fdc0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:50.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.401+0000 7f9d1096f640 1 --2- 172.21.15.7:0/1644695955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55909fd9e1f0 0x55909fdc7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:50.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.401+0000 7f9d11170640 1 -- 172.21.15.7:0/1644695955 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55909fdacfc0 msgr2=0x55909fdc0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:50.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.401+0000 7f9d11170640 1 --2- 172.21.15.7:0/1644695955 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55909fdacfc0 0x55909fdc0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.401+0000 7f9d11170640 1 -- 172.21.15.7:0/1644695955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55909fd9e1f0 msgr2=0x55909fdc7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:50.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.401+0000 7f9d11170640 1 --2- 172.21.15.7:0/1644695955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55909fd9e1f0 0x55909fdc7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.401+0000 7f9d11170640 1 -- 172.21.15.7:0/1644695955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55909fdc1290 con 0x55909fd9d8d0 2024-09-19T04:16:50.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.401+0000 7f9d1096f640 1 --2- 172.21.15.7:0/1644695955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55909fd9e1f0 0x55909fdc7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:16:50.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.402+0000 7f9d11170640 1 --2- 172.21.15.7:0/1644695955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909fd9d8d0 0x55909fdc7590 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9d08005340 tx=0x7f9d08005370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6177693dc760907f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:50.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.402+0000 7f9cf4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:16:50.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.402+0000 7f9cf4ff9640 1 -- 172.21.15.7:0/1644695955 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d08051060 con 0x55909fd9d8d0 2024-09-19T04:16:50.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.402+0000 7f9cf4ff9640 1 -- 172.21.15.7:0/1644695955 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f9d080318b0 con 0x55909fd9d8d0 2024-09-19T04:16:50.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.402+0000 7f9d157ad740 1 -- 172.21.15.7:0/1644695955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d0401a070 con 0x55909fd9d8d0 2024-09-19T04:16:50.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.402+0000 7f9cf4ff9640 1 -- 172.21.15.7:0/1644695955 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9d08058050 con 0x55909fd9d8d0 2024-09-19T04:16:50.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.402+0000 7f9d157ad740 10 client.15258 fetch_fsmap learned FSMap version 27 2024-09-19T04:16:50.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.402+0000 7f9d157ad740 1 -- 172.21.15.7:0/1644695955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55909fdc5c60 con 0x55909fd9d8d0 2024-09-19T04:16:50.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.402+0000 7f9cf4ff9640 1 -- 172.21.15.7:0/1644695955 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d0401a070 con 0x55909fd9d8d0 2024-09-19T04:16:50.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.402+0000 7f9cf4ff9640 1 -- 172.21.15.7:0/1644695955 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f9d08003a70 con 0x55909fd9d8d0 2024-09-19T04:16:50.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.402+0000 7f9d157ad740 10 client.15258 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:16:50.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.402+0000 7f9d157ad740 10 client.15258 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T04:16:50.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.402+0000 7f9d157ad740 20 client.15258 populate_metadata read hostname 'smithi007' 2024-09-19T04:16:50.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.402+0000 7f9d157ad740 1 --2- 172.21.15.7:0/1644695955 >> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] conn(0x55909fe2c510 0x55909fe2b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:50.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.403+0000 7f9d157ad740 4 client.15258 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T04:16:50.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.403+0000 7f9d157ad740 1 -- 172.21.15.7:0/1644695955 --> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] -- command(tid 0: {"prefix": "status"}) -- 0x55909fd0bb10 con 0x55909fe2c510 2024-09-19T04:16:50.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.403+0000 7f9d1096f640 1 --2- 172.21.15.7:0/1644695955 >> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] conn(0x55909fe2c510 0x55909fe2b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:50.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.403+0000 7f9d1096f640 1 --2- 172.21.15.7:0/1644695955 >> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] conn(0x55909fe2c510 0x55909fe2b220 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8d97b4498f1e1687 server_cookie=a801a18d6626d4ed in_seq=0 out_seq=0 2024-09-19T04:16:50.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.403+0000 7f9cf4ff9640 10 client.15258 ms_handle_connect on v2:172.21.15.102:6838/2728093829 2024-09-19T04:16:50.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.403+0000 7f9cf4ff9640 1 -- 172.21.15.7:0/1644695955 <== mds.1 v2:172.21.15.102:6838/2728093829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55909fd0bb10 con 0x55909fe2c510 2024-09-19T04:16:50.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.403+0000 7f9cf4ff9640 10 client.15258 handle_command_reply: tid=0 2024-09-19T04:16:50.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.404+0000 7f9d157ad740 1 client.15258 shutdown 2024-09-19T04:16:50.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.404+0000 7f9d157ad740 1 -- 172.21.15.7:0/1644695955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909fd9d8d0 msgr2=0x55909fdc7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:50.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.404+0000 7f9d157ad740 1 --2- 172.21.15.7:0/1644695955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909fd9d8d0 0x55909fdc7590 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9d08005340 tx=0x7f9d08005370 comp rx=0 tx=0).stop 2024-09-19T04:16:50.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.404+0000 7f9d157ad740 1 -- 172.21.15.7:0/1644695955 shutdown_connections 2024-09-19T04:16:50.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.404+0000 7f9d157ad740 1 --2- 172.21.15.7:0/1644695955 >> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] conn(0x55909fe2c510 0x55909fe2b220 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.404+0000 7f9d157ad740 1 --2- 172.21.15.7:0/1644695955 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55909fdacfc0 0x55909fdc0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.404+0000 7f9d157ad740 1 --2- 172.21.15.7:0/1644695955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55909fd9e1f0 0x55909fdc7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.404+0000 7f9cf4ff9640 0 client.15258 ms_handle_reset on v2:172.21.15.102:6838/2728093829 2024-09-19T04:16:50.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.404+0000 7f9d157ad740 1 --2- 172.21.15.7:0/1644695955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55909fd9d8d0 0x55909fdc7590 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.404+0000 7f9d157ad740 1 -- 172.21.15.7:0/1644695955 >> 172.21.15.7:0/1644695955 conn(0x55909fd99f60 msgr2=0x55909fd9f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:50.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.404+0000 7f9d157ad740 1 -- 172.21.15.7:0/1644695955 shutdown_connections 2024-09-19T04:16:50.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.404+0000 7f9d157ad740 1 -- 172.21.15.7:0/1644695955 wait complete. 2024-09-19T04:16:50.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.404+0000 7f9d157ad740 20 client.15258 trim_cache size 0 max 16384 2024-09-19T04:16:50.411 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:16:50.411 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "77957c0a-763c-11ef-bceb-c7b262605968", 2024-09-19T04:16:50.411 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 1, 2024-09-19T04:16:50.411 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24496, 2024-09-19T04:16:50.411 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-19T04:16:50.411 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-19T04:16:50.411 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-19T04:16:50.411 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 96.611043502000001, 2024-09-19T04:16:50.411 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 27, 2024-09-19T04:16:50.411 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 90, 2024-09-19T04:16:50.411 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 86, 2024-09-19T04:16:50.411 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 155.73505826600001 2024-09-19T04:16:50.411 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:16:50.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.404+0000 7f9d133d4640 1 -- 172.21.15.7:0/3394933389 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9cf80a3240 msgr2=0x7f9cf80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:50.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.404+0000 7f9d133d4640 1 --2- 172.21.15.7:0/3394933389 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9cf80a3240 0x7f9cf80a5700 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9d04009990 tx=0x7f9d040096a0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.404+0000 7f9d133d4640 1 -- 172.21.15.7:0/3394933389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d0c102790 msgr2=0x7f9d0c1989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:50.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.404+0000 7f9d133d4640 1 --2- 172.21.15.7:0/3394933389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d0c102790 0x7f9d0c1989a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc00d770 tx=0x7f9cfc00dc30 comp rx=0 tx=0).stop 2024-09-19T04:16:50.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.405+0000 7f9d133d4640 1 -- 172.21.15.7:0/3394933389 shutdown_connections 2024-09-19T04:16:50.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.405+0000 7f9d133d4640 1 --2- 172.21.15.7:0/3394933389 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9cf80a3240 0x7f9cf80a5700 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.405+0000 7f9d133d4640 1 --2- 172.21.15.7:0/3394933389 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d0c106f10 0x7f9d0c19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.405+0000 7f9d133d4640 1 --2- 172.21.15.7:0/3394933389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d0c102790 0x7f9d0c1989a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.405+0000 7f9d133d4640 1 --2- 172.21.15.7:0/3394933389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d0c101de0 0x7f9d0c198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:50.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.405+0000 7f9d133d4640 1 -- 172.21.15.7:0/3394933389 >> 172.21.15.7:0/3394933389 conn(0x7f9d0c0fd8c0 msgr2=0x7f9d0c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:50.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.405+0000 7f9d133d4640 1 -- 172.21.15.7:0/3394933389 shutdown_connections 2024-09-19T04:16:50.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:50.405+0000 7f9d133d4640 1 -- 172.21.15.7:0/3394933389 wait complete. 2024-09-19T04:16:51.093 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T04:16:51.350 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:51.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:51 smithi007 ceph-mon[31360]: pgmap v352: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 895 B/s wr, 12 op/s; 150 B/s, 0 objects/s recovering 2024-09-19T04:16:51.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:51 smithi102 ceph-mon[35446]: pgmap v352: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 895 B/s wr, 12 op/s; 150 B/s, 0 objects/s recovering 2024-09-19T04:16:51.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:51 smithi092 ceph-mon[34940]: pgmap v352: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 895 B/s wr, 12 op/s; 150 B/s, 0 objects/s recovering 2024-09-19T04:16:51.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.832+0000 7f1a640c6640 1 -- 172.21.15.7:0/896357636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a5c101420 msgr2=0x7f1a5c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:51.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.832+0000 7f1a640c6640 1 --2- 172.21.15.7:0/896357636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a5c101420 0x7f1a5c10d950 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009cd0 tx=0x7f1a5402a8e0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.832+0000 7f1a640c6640 1 -- 172.21.15.7:0/896357636 shutdown_connections 2024-09-19T04:16:51.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.832+0000 7f1a640c6640 1 --2- 172.21.15.7:0/896357636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a5c101420 0x7f1a5c10d950 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.832+0000 7f1a640c6640 1 --2- 172.21.15.7:0/896357636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a5c100a80 0x7f1a5c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.832+0000 7f1a640c6640 1 --2- 172.21.15.7:0/896357636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a5c106a80 0x7f1a5c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.832+0000 7f1a640c6640 1 -- 172.21.15.7:0/896357636 >> 172.21.15.7:0/896357636 conn(0x7f1a5c0fc7a0 msgr2=0x7f1a5c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:51.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.832+0000 7f1a640c6640 1 -- 172.21.15.7:0/896357636 shutdown_connections 2024-09-19T04:16:51.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.832+0000 7f1a640c6640 1 -- 172.21.15.7:0/896357636 wait complete. 2024-09-19T04:16:51.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.833+0000 7f1a640c6640 1 Processor -- start 2024-09-19T04:16:51.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.833+0000 7f1a640c6640 1 -- start start 2024-09-19T04:16:51.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.833+0000 7f1a640c6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a5c100a80 0x7f1a5c199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:51.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.833+0000 7f1a640c6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a5c101420 0x7f1a5c1996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:51.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.833+0000 7f1a640c6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a5c106a80 0x7f1a5c1a41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:51.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.833+0000 7f1a640c6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5c110e80 con 0x7f1a5c106a80 2024-09-19T04:16:51.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.833+0000 7f1a640c6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5c110d00 con 0x7f1a5c100a80 2024-09-19T04:16:51.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.833+0000 7f1a640c6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5c111000 con 0x7f1a5c101420 2024-09-19T04:16:51.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.833+0000 7f1a62663640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a5c106a80 0x7f1a5c1a41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:51.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.833+0000 7f1a61661640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a5c101420 0x7f1a5c1996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:51.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.833+0000 7f1a61e62640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a5c100a80 0x7f1a5c199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:51.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.833+0000 7f1a62663640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a5c106a80 0x7f1a5c1a41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48264/0 (socket says 172.21.15.7:48264) 2024-09-19T04:16:51.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.833+0000 7f1a62663640 1 -- 172.21.15.7:0/3379563105 learned_addr learned my addr 172.21.15.7:0/3379563105 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:51.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.834+0000 7f1a62663640 1 -- 172.21.15.7:0/3379563105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a5c101420 msgr2=0x7f1a5c1996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:51.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.834+0000 7f1a62663640 1 --2- 172.21.15.7:0/3379563105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a5c101420 0x7f1a5c1996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.834+0000 7f1a62663640 1 -- 172.21.15.7:0/3379563105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a5c100a80 msgr2=0x7f1a5c199170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:51.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.834+0000 7f1a62663640 1 --2- 172.21.15.7:0/3379563105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a5c100a80 0x7f1a5c199170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.834+0000 7f1a62663640 1 -- 172.21.15.7:0/3379563105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a5c1a4730 con 0x7f1a5c106a80 2024-09-19T04:16:51.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.834+0000 7f1a62663640 1 --2- 172.21.15.7:0/3379563105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a5c106a80 0x7f1a5c1a41f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1a54006010 tx=0x7f1a54003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:51.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.834+0000 7f1a52ffd640 1 -- 172.21.15.7:0/3379563105 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54004450 con 0x7f1a5c106a80 2024-09-19T04:16:51.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.834+0000 7f1a52ffd640 1 -- 172.21.15.7:0/3379563105 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a54003e10 con 0x7f1a5c106a80 2024-09-19T04:16:51.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.834+0000 7f1a640c6640 1 -- 172.21.15.7:0/3379563105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a5c1a4900 con 0x7f1a5c106a80 2024-09-19T04:16:51.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.834+0000 7f1a52ffd640 1 -- 172.21.15.7:0/3379563105 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54046480 con 0x7f1a5c106a80 2024-09-19T04:16:51.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.834+0000 7f1a640c6640 1 -- 172.21.15.7:0/3379563105 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a5c1a4db0 con 0x7f1a5c106a80 2024-09-19T04:16:51.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.837+0000 7f1a6649f740 1 Processor -- start 2024-09-19T04:16:51.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.837+0000 7f1a52ffd640 1 -- 172.21.15.7:0/3379563105 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f1a540045f0 con 0x7f1a5c106a80 2024-09-19T04:16:51.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.837+0000 7f1a6649f740 1 -- start start 2024-09-19T04:16:51.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.838+0000 7f1a6649f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0e21479d0 0x55a0e2147db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:51.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.838+0000 7f1a6649f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0e21482f0 0x55a0e2152670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:51.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.838+0000 7f1a6649f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0e2152bb0 0x55a0e2154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:51.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.838+0000 7f1a6649f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a0e20ae090 con 0x55a0e21482f0 2024-09-19T04:16:51.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.838+0000 7f1a6649f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a0e2055a70 con 0x55a0e2152bb0 2024-09-19T04:16:51.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.838+0000 7f1a6649f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a0e20aa050 con 0x55a0e21479d0 2024-09-19T04:16:51.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.838+0000 7f1a61e62640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0e21482f0 0x55a0e2152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:51.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.838+0000 7f1a61e62640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0e21482f0 0x55a0e2152670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48276/0 (socket says 172.21.15.7:48276) 2024-09-19T04:16:51.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.838+0000 7f1a61e62640 1 -- 172.21.15.7:0/2264369529 learned_addr learned my addr 172.21.15.7:0/2264369529 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:51.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.838+0000 7f1a61661640 1 --2- 172.21.15.7:0/2264369529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0e2152bb0 0x55a0e2154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:51.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.838+0000 7f1a61661640 1 --2- 172.21.15.7:0/2264369529 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0e21479d0 0x55a0e2147db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:51.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.838+0000 7f1a52ffd640 1 --2- 172.21.15.7:0/3379563105 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1a480a3240 0x7f1a480a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:51.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.838+0000 7f1a61e62640 1 -- 172.21.15.7:0/2264369529 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0e21479d0 msgr2=0x55a0e2147db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:51.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.838+0000 7f1a61e62640 1 --2- 172.21.15.7:0/2264369529 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0e21479d0 0x55a0e2147db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.838+0000 7f1a61e62640 1 -- 172.21.15.7:0/2264369529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0e2152bb0 msgr2=0x55a0e2154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:51.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.838+0000 7f1a61e62640 1 --2- 172.21.15.7:0/2264369529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0e2152bb0 0x55a0e2154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.838+0000 7f1a61e62640 1 -- 172.21.15.7:0/2264369529 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0e2062130 con 0x55a0e21482f0 2024-09-19T04:16:51.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.838+0000 7f1a61661640 1 --2- 172.21.15.7:0/2264369529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0e2152bb0 0x55a0e2154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:16:51.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.838+0000 7f1a52ffd640 1 -- 172.21.15.7:0/3379563105 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f1a5402e030 con 0x7f1a5c106a80 2024-09-19T04:16:51.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.838+0000 7f1a62663640 1 --2- 172.21.15.7:0/3379563105 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1a480a3240 0x7f1a480a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:51.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.838+0000 7f1a61e62640 1 --2- 172.21.15.7:0/2264369529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0e21482f0 0x55a0e2152670 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1a5800ac90 tx=0x7f1a5800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c832529fa187ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:51.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.839+0000 7f1a47fff640 1 -- 172.21.15.7:0/2264369529 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5801d070 con 0x55a0e21482f0 2024-09-19T04:16:51.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.839+0000 7f1a47fff640 1 -- 172.21.15.7:0/2264369529 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a58018b20 con 0x55a0e21482f0 2024-09-19T04:16:51.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.839+0000 7f1a47fff640 1 -- 172.21.15.7:0/2264369529 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a58010b40 con 0x55a0e21482f0 2024-09-19T04:16:51.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.839+0000 7f1a6649f740 1 -- 172.21.15.7:0/2264369529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0e21482f0 msgr2=0x55a0e2152670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:51.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.839+0000 7f1a62663640 1 --2- 172.21.15.7:0/3379563105 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1a480a3240 0x7f1a480a5700 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1a540ba1f0 tx=0x7f1a540a8040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:51.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.839+0000 7f1a6649f740 1 --2- 172.21.15.7:0/2264369529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0e21482f0 0x55a0e2152670 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1a5800ac90 tx=0x7f1a5800f790 comp rx=0 tx=0).stop 2024-09-19T04:16:51.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.839+0000 7f1a6649f740 1 -- 172.21.15.7:0/2264369529 shutdown_connections 2024-09-19T04:16:51.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.839+0000 7f1a6649f740 1 --2- 172.21.15.7:0/2264369529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0e2152bb0 0x55a0e2154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.839+0000 7f1a6649f740 1 --2- 172.21.15.7:0/2264369529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0e21482f0 0x55a0e2152670 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.839+0000 7f1a6649f740 1 --2- 172.21.15.7:0/2264369529 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0e21479d0 0x55a0e2147db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.839+0000 7f1a6649f740 1 -- 172.21.15.7:0/2264369529 >> 172.21.15.7:0/2264369529 conn(0x55a0e2143f60 msgr2=0x55a0e2144340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:51.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.840+0000 7f1a6649f740 1 -- 172.21.15.7:0/2264369529 shutdown_connections 2024-09-19T04:16:51.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.840+0000 7f1a6649f740 1 -- 172.21.15.7:0/2264369529 wait complete. 2024-09-19T04:16:51.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.840+0000 7f1a6649f740 1 -- start start 2024-09-19T04:16:51.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.840+0000 7f1a6649f740 1 Processor -- start 2024-09-19T04:16:51.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.840+0000 7f1a6649f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0e21479d0 0x55a0e2152400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:51.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.840+0000 7f1a6649f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0e21482f0 0x55a0e214f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:51.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.840+0000 7f1a6649f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0e2152bb0 0x55a0e214fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:51.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.840+0000 7f1a6649f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a0e2155780 con 0x55a0e21479d0 2024-09-19T04:16:51.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.840+0000 7f1a6649f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a0e2068f20 con 0x55a0e2152bb0 2024-09-19T04:16:51.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.840+0000 7f1a6649f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a0e2155900 con 0x55a0e21482f0 2024-09-19T04:16:51.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.840+0000 7f1a6649f740 10 client.0 _ll_register_callbacks cb 0x55a0e2032030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:16:51.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.840+0000 7f1a61661640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0e21479d0 0x55a0e2152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:51.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.841+0000 7f1a61661640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0e21479d0 0x55a0e2152400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48282/0 (socket says 172.21.15.7:48282) 2024-09-19T04:16:51.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.841+0000 7f1a61661640 1 -- 172.21.15.7:0/2088658524 learned_addr learned my addr 172.21.15.7:0/2088658524 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:51.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.841+0000 7f1a61661640 1 --2- 172.21.15.7:0/2088658524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0e2152bb0 0x55a0e214fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:51.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.841+0000 7f1a61e62640 1 --2- 172.21.15.7:0/2088658524 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0e21482f0 0x55a0e214f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:51.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.841+0000 7f1a61661640 1 -- 172.21.15.7:0/2088658524 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0e21482f0 msgr2=0x55a0e214f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:51.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.841+0000 7f1a61661640 1 --2- 172.21.15.7:0/2088658524 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0e21482f0 0x55a0e214f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.841+0000 7f1a61661640 1 -- 172.21.15.7:0/2088658524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0e2152bb0 msgr2=0x55a0e214fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:51.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.841+0000 7f1a61661640 1 --2- 172.21.15.7:0/2088658524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0e2152bb0 0x55a0e214fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.841+0000 7f1a61661640 1 -- 172.21.15.7:0/2088658524 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0e1e1f2b0 con 0x55a0e21479d0 2024-09-19T04:16:51.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.841+0000 7f1a61661640 1 --2- 172.21.15.7:0/2088658524 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0e21479d0 0x55a0e2152400 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c010f60 tx=0x7f1a4c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=655fc154cd9dd027 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:51.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.841+0000 7f1a457fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:16:51.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.841+0000 7f1a457fa640 1 -- 172.21.15.7:0/2088658524 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c00c550 con 0x55a0e21479d0 2024-09-19T04:16:51.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.841+0000 7f1a457fa640 1 -- 172.21.15.7:0/2088658524 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f1a4c00c6f0 con 0x55a0e21479d0 2024-09-19T04:16:51.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.841+0000 7f1a6649f740 1 -- 172.21.15.7:0/2088658524 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a58018b20 con 0x55a0e21479d0 2024-09-19T04:16:51.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.841+0000 7f1a457fa640 1 -- 172.21.15.7:0/2088658524 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1a4c028050 con 0x55a0e21479d0 2024-09-19T04:16:51.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.841+0000 7f1a6649f740 10 client.15270 fetch_fsmap learned FSMap version 27 2024-09-19T04:16:51.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.841+0000 7f1a6649f740 1 -- 172.21.15.7:0/2088658524 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a0e21610d0 con 0x55a0e21479d0 2024-09-19T04:16:51.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.842+0000 7f1a457fa640 1 -- 172.21.15.7:0/2088658524 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a58018b20 con 0x55a0e21479d0 2024-09-19T04:16:51.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.842+0000 7f1a457fa640 1 -- 172.21.15.7:0/2088658524 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f1a4c020810 con 0x55a0e21479d0 2024-09-19T04:16:51.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.842+0000 7f1a6649f740 10 client.15270 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:16:51.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.842+0000 7f1a6649f740 10 client.15270 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T04:16:51.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.842+0000 7f1a6649f740 20 client.15270 populate_metadata read hostname 'smithi007' 2024-09-19T04:16:51.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.842+0000 7f1a6649f740 1 --2- 172.21.15.7:0/2088658524 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55a0e21636b0 0x55a0e2164b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:51.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.842+0000 7f1a6649f740 4 client.15270 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:16:51.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.842+0000 7f1a6649f740 1 -- 172.21.15.7:0/2088658524 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0e20bb600 con 0x55a0e21636b0 2024-09-19T04:16:51.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.842+0000 7f1a61e62640 1 --2- 172.21.15.7:0/2088658524 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55a0e21636b0 0x55a0e2164b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:51.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.843+0000 7f1a61e62640 1 --2- 172.21.15.7:0/2088658524 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55a0e21636b0 0x55a0e2164b20 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8305b3504a6a1710 server_cookie=36facdee3be14e23 in_seq=0 out_seq=0 2024-09-19T04:16:51.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.843+0000 7f1a457fa640 10 client.15270 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:16:51.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.843+0000 7f1a457fa640 1 -- 172.21.15.7:0/2088658524 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a0e20bb600 con 0x55a0e21636b0 2024-09-19T04:16:51.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.843+0000 7f1a457fa640 10 client.15270 handle_command_reply: tid=0 2024-09-19T04:16:51.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.844+0000 7f1a6649f740 1 client.15270 shutdown 2024-09-19T04:16:51.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.844+0000 7f1a6649f740 1 -- 172.21.15.7:0/2088658524 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0e21479d0 msgr2=0x55a0e2152400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:51.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.844+0000 7f1a6649f740 1 --2- 172.21.15.7:0/2088658524 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0e21479d0 0x55a0e2152400 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c010f60 tx=0x7f1a4c004730 comp rx=0 tx=0).stop 2024-09-19T04:16:51.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.844+0000 7f1a6649f740 1 -- 172.21.15.7:0/2088658524 shutdown_connections 2024-09-19T04:16:51.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.844+0000 7f1a6649f740 1 --2- 172.21.15.7:0/2088658524 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55a0e21636b0 0x55a0e2164b20 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.844+0000 7f1a6649f740 1 --2- 172.21.15.7:0/2088658524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0e2152bb0 0x55a0e214fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.844+0000 7f1a6649f740 1 --2- 172.21.15.7:0/2088658524 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0e21482f0 0x55a0e214f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.844+0000 7f1a457fa640 0 client.15270 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:16:51.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.844+0000 7f1a6649f740 1 --2- 172.21.15.7:0/2088658524 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0e21479d0 0x55a0e2152400 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.844+0000 7f1a6649f740 1 -- 172.21.15.7:0/2088658524 >> 172.21.15.7:0/2088658524 conn(0x55a0e2143f60 msgr2=0x55a0e2149c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:51.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.844+0000 7f1a6649f740 1 -- 172.21.15.7:0/2088658524 shutdown_connections 2024-09-19T04:16:51.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.844+0000 7f1a6649f740 1 -- 172.21.15.7:0/2088658524 wait complete. 2024-09-19T04:16:51.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.844+0000 7f1a6649f740 20 client.15270 trim_cache size 0 max 16384 2024-09-19T04:16:51.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.862+0000 7f1a6649f740 1 Processor -- start 2024-09-19T04:16:51.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.862+0000 7f1a6649f740 1 -- start start 2024-09-19T04:16:51.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.862+0000 7f1a6649f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0e21479d0 0x55a0e2164b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:51.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.862+0000 7f1a6649f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0e21482f0 0x55a0e214f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:51.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.862+0000 7f1a6649f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0e2152bb0 0x55a0e214fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:51.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.862+0000 7f1a6649f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a0e2162e60 con 0x55a0e21479d0 2024-09-19T04:16:51.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.862+0000 7f1a6649f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a0e2163530 con 0x55a0e2152bb0 2024-09-19T04:16:51.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.862+0000 7f1a6649f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a0e2163c00 con 0x55a0e21482f0 2024-09-19T04:16:51.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.862+0000 7f1a61661640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0e21479d0 0x55a0e2164b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:51.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.862+0000 7f1a61661640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0e21479d0 0x55a0e2164b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48286/0 (socket says 172.21.15.7:48286) 2024-09-19T04:16:51.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.862+0000 7f1a61661640 1 -- 172.21.15.7:0/3063104793 learned_addr learned my addr 172.21.15.7:0/3063104793 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:51.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.862+0000 7f1a61e62640 1 --2- 172.21.15.7:0/3063104793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0e21482f0 0x55a0e214f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:51.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.862+0000 7f1a61661640 1 -- 172.21.15.7:0/3063104793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0e21482f0 msgr2=0x55a0e214f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:51.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.862+0000 7f1a61661640 1 --2- 172.21.15.7:0/3063104793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0e21482f0 0x55a0e214f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.862+0000 7f1a61661640 1 -- 172.21.15.7:0/3063104793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0e2152bb0 msgr2=0x55a0e214fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:51.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.862+0000 7f1a61661640 1 --2- 172.21.15.7:0/3063104793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0e2152bb0 0x55a0e214fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.862+0000 7f1a61661640 1 -- 172.21.15.7:0/3063104793 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0e2152770 con 0x55a0e21479d0 2024-09-19T04:16:51.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.863+0000 7f1a61661640 1 --2- 172.21.15.7:0/3063104793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0e21479d0 0x55a0e2164b20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c020c10 tx=0x7f1a4c00a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84f6efd4cc445f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:51.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.863+0000 7f1a477fe640 1 -- 172.21.15.7:0/3063104793 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c032070 con 0x55a0e21479d0 2024-09-19T04:16:51.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.863+0000 7f1a477fe640 1 -- 172.21.15.7:0/3063104793 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a4c020e00 con 0x55a0e21479d0 2024-09-19T04:16:51.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.863+0000 7f1a477fe640 1 -- 172.21.15.7:0/3063104793 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c01f7f0 con 0x55a0e21479d0 2024-09-19T04:16:51.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.863+0000 7f1a6649f740 1 -- 172.21.15.7:0/3063104793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0e21479d0 msgr2=0x55a0e2164b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:51.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.863+0000 7f1a6649f740 1 --2- 172.21.15.7:0/3063104793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0e21479d0 0x55a0e2164b20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c020c10 tx=0x7f1a4c00a570 comp rx=0 tx=0).stop 2024-09-19T04:16:51.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.863+0000 7f1a6649f740 1 -- 172.21.15.7:0/3063104793 shutdown_connections 2024-09-19T04:16:51.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.863+0000 7f1a6649f740 1 --2- 172.21.15.7:0/3063104793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0e2152bb0 0x55a0e214fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.863+0000 7f1a6649f740 1 --2- 172.21.15.7:0/3063104793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0e21482f0 0x55a0e214f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.863+0000 7f1a6649f740 1 --2- 172.21.15.7:0/3063104793 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0e21479d0 0x55a0e2164b20 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.863+0000 7f1a6649f740 1 -- 172.21.15.7:0/3063104793 >> 172.21.15.7:0/3063104793 conn(0x55a0e2143f60 msgr2=0x55a0e214e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:51.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.863+0000 7f1a6649f740 1 -- 172.21.15.7:0/3063104793 shutdown_connections 2024-09-19T04:16:51.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.864+0000 7f1a6649f740 1 -- 172.21.15.7:0/3063104793 wait complete. 2024-09-19T04:16:51.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.864+0000 7f1a6649f740 1 -- start start 2024-09-19T04:16:51.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.864+0000 7f1a6649f740 1 Processor -- start 2024-09-19T04:16:51.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.864+0000 7f1a6649f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0e21479d0 0x55a0e216d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:51.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.864+0000 7f1a6649f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0e21482f0 0x55a0e216d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:51.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.865+0000 7f1a6649f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0e2152bb0 0x55a0e2166550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:51.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.865+0000 7f1a6649f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a0e21649a0 con 0x55a0e21482f0 2024-09-19T04:16:51.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.865+0000 7f1a6649f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a0e21642d0 con 0x55a0e21479d0 2024-09-19T04:16:51.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.865+0000 7f1a6649f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a0e2165070 con 0x55a0e2152bb0 2024-09-19T04:16:51.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.865+0000 7f1a6649f740 10 client.0 _ll_register_callbacks cb 0x7f1a4c00a950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:16:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.865+0000 7f1a61e62640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0e21482f0 0x55a0e216d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.865+0000 7f1a61e62640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0e21482f0 0x55a0e216d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48300/0 (socket says 172.21.15.7:48300) 2024-09-19T04:16:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.865+0000 7f1a61e62640 1 -- 172.21.15.7:0/3739228157 learned_addr learned my addr 172.21.15.7:0/3739228157 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.865+0000 7f1a61661640 1 --2- 172.21.15.7:0/3739228157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0e21479d0 0x55a0e216d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.865+0000 7f1a61661640 1 --2- 172.21.15.7:0/3739228157 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0e2152bb0 0x55a0e2166550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.865+0000 7f1a61e62640 1 -- 172.21.15.7:0/3739228157 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0e2152bb0 msgr2=0x55a0e2166550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.865+0000 7f1a61e62640 1 --2- 172.21.15.7:0/3739228157 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0e2152bb0 0x55a0e2166550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.865+0000 7f1a61e62640 1 -- 172.21.15.7:0/3739228157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0e21479d0 msgr2=0x55a0e216d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:16:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.865+0000 7f1a61e62640 1 --2- 172.21.15.7:0/3739228157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0e21479d0 0x55a0e216d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.865+0000 7f1a61e62640 1 -- 172.21.15.7:0/3739228157 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0e2166d80 con 0x55a0e21482f0 2024-09-19T04:16:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.865+0000 7f1a61e62640 1 --2- 172.21.15.7:0/3739228157 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0e21482f0 0x55a0e216d5c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1a580107d0 tx=0x7f1a58010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9ce77a83cec49ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.865+0000 7f1a457fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:16:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.865+0000 7f1a457fa640 1 -- 172.21.15.7:0/3739228157 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5801d040 con 0x55a0e21482f0 2024-09-19T04:16:51.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.865+0000 7f1a457fa640 1 -- 172.21.15.7:0/3739228157 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f1a580187c0 con 0x55a0e21482f0 2024-09-19T04:16:51.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.865+0000 7f1a6649f740 1 -- 172.21.15.7:0/3739228157 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a4c020e00 con 0x55a0e21482f0 2024-09-19T04:16:51.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.866+0000 7f1a457fa640 1 -- 172.21.15.7:0/3739228157 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1a58005d80 con 0x55a0e21482f0 2024-09-19T04:16:51.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.866+0000 7f1a6649f740 10 client.15276 fetch_fsmap learned FSMap version 27 2024-09-19T04:16:51.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.866+0000 7f1a6649f740 1 -- 172.21.15.7:0/3739228157 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a0e216b710 con 0x55a0e21482f0 2024-09-19T04:16:51.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.866+0000 7f1a457fa640 1 -- 172.21.15.7:0/3739228157 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a4c020e00 con 0x55a0e21482f0 2024-09-19T04:16:51.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.866+0000 7f1a457fa640 1 -- 172.21.15.7:0/3739228157 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 27) ==== 8370+0+0 (secure 0 0 0) 0x7f1a58005340 con 0x55a0e21482f0 2024-09-19T04:16:51.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.866+0000 7f1a6649f740 10 client.15276 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:16:51.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.866+0000 7f1a6649f740 10 client.15276 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T04:16:51.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.866+0000 7f1a6649f740 20 client.15276 populate_metadata read hostname 'smithi007' 2024-09-19T04:16:51.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.866+0000 7f1a6649f740 1 --2- 172.21.15.7:0/3739228157 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55a0e21636b0 0x55a0e21d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:51.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.866+0000 7f1a6649f740 4 client.15276 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T04:16:51.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.866+0000 7f1a6649f740 1 -- 172.21.15.7:0/3739228157 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "status"}) -- 0x55a0e20b5b10 con 0x55a0e21636b0 2024-09-19T04:16:51.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.866+0000 7f1a61661640 1 --2- 172.21.15.7:0/3739228157 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55a0e21636b0 0x55a0e21d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:51.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.867+0000 7f1a457fa640 10 client.15276 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:16:51.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.867+0000 7f1a61661640 1 --2- 172.21.15.7:0/3739228157 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55a0e21636b0 0x55a0e21d0fc0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd75f6722138a421 server_cookie=671c3fdf42db4578 in_seq=0 out_seq=0 2024-09-19T04:16:51.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.867+0000 7f1a457fa640 1 -- 172.21.15.7:0/3739228157 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55a0e20b5b10 con 0x55a0e21636b0 2024-09-19T04:16:51.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.867+0000 7f1a457fa640 10 client.15276 handle_command_reply: tid=0 2024-09-19T04:16:51.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.867+0000 7f1a6649f740 1 client.15276 shutdown 2024-09-19T04:16:51.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.867+0000 7f1a6649f740 1 -- 172.21.15.7:0/3739228157 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0e21482f0 msgr2=0x55a0e216d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:51.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.867+0000 7f1a6649f740 1 --2- 172.21.15.7:0/3739228157 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0e21482f0 0x55a0e216d5c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1a580107d0 tx=0x7f1a58010800 comp rx=0 tx=0).stop 2024-09-19T04:16:51.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.867+0000 7f1a6649f740 1 -- 172.21.15.7:0/3739228157 shutdown_connections 2024-09-19T04:16:51.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.867+0000 7f1a6649f740 1 --2- 172.21.15.7:0/3739228157 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55a0e21636b0 0x55a0e21d0fc0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.867+0000 7f1a6649f740 1 --2- 172.21.15.7:0/3739228157 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a0e2152bb0 0x55a0e2166550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.867+0000 7f1a6649f740 1 --2- 172.21.15.7:0/3739228157 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a0e21482f0 0x55a0e216d5c0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.867+0000 7f1a457fa640 0 client.15276 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:16:51.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.867+0000 7f1a6649f740 1 --2- 172.21.15.7:0/3739228157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0e21479d0 0x55a0e216d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.867+0000 7f1a6649f740 1 -- 172.21.15.7:0/3739228157 >> 172.21.15.7:0/3739228157 conn(0x55a0e2143f60 msgr2=0x55a0e21427e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:51.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.867+0000 7f1a6649f740 1 -- 172.21.15.7:0/3739228157 shutdown_connections 2024-09-19T04:16:51.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.867+0000 7f1a6649f740 1 -- 172.21.15.7:0/3739228157 wait complete. 2024-09-19T04:16:51.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.868+0000 7f1a6649f740 20 client.15276 trim_cache size 0 max 16384 2024-09-19T04:16:51.874 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:16:51.874 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "77957c0a-763c-11ef-bceb-c7b262605968", 2024-09-19T04:16:51.874 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-09-19T04:16:51.874 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24506, 2024-09-19T04:16:51.874 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-19T04:16:51.874 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-19T04:16:51.874 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-19T04:16:51.875 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 137.54828976499999, 2024-09-19T04:16:51.875 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 27, 2024-09-19T04:16:51.875 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 90, 2024-09-19T04:16:51.875 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 86, 2024-09-19T04:16:51.875 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 149.06791315199999 2024-09-19T04:16:51.875 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:16:51.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.868+0000 7f1a640c6640 1 -- 172.21.15.7:0/3379563105 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1a480a3240 msgr2=0x7f1a480a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:51.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.868+0000 7f1a640c6640 1 --2- 172.21.15.7:0/3379563105 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1a480a3240 0x7f1a480a5700 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1a540ba1f0 tx=0x7f1a540a8040 comp rx=0 tx=0).stop 2024-09-19T04:16:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.868+0000 7f1a640c6640 1 -- 172.21.15.7:0/3379563105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a5c106a80 msgr2=0x7f1a5c1a41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.868+0000 7f1a640c6640 1 --2- 172.21.15.7:0/3379563105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a5c106a80 0x7f1a5c1a41f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1a54006010 tx=0x7f1a54003c20 comp rx=0 tx=0).stop 2024-09-19T04:16:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.868+0000 7f1a640c6640 1 -- 172.21.15.7:0/3379563105 shutdown_connections 2024-09-19T04:16:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.868+0000 7f1a640c6640 1 --2- 172.21.15.7:0/3379563105 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1a480a3240 0x7f1a480a5700 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.868+0000 7f1a640c6640 1 --2- 172.21.15.7:0/3379563105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a5c106a80 0x7f1a5c1a41f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.868+0000 7f1a640c6640 1 --2- 172.21.15.7:0/3379563105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a5c101420 0x7f1a5c1996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.868+0000 7f1a640c6640 1 --2- 172.21.15.7:0/3379563105 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a5c100a80 0x7f1a5c199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.868+0000 7f1a640c6640 1 -- 172.21.15.7:0/3379563105 >> 172.21.15.7:0/3379563105 conn(0x7f1a5c0fc7a0 msgr2=0x7f1a5c0fcc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.868+0000 7f1a640c6640 1 -- 172.21.15.7:0/3379563105 shutdown_connections 2024-09-19T04:16:51.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:51.868+0000 7f1a640c6640 1 -- 172.21.15.7:0/3379563105 wait complete. 2024-09-19T04:16:52.584 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T04:16:52.598 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T04:16:52.598 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T04:16:52.599 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T04:16:52.599 INFO:teuthology.run_tasks:Running task kclient... 2024-09-19T04:16:52.619 INFO:tasks.kclient:Mounting kernel clients... 2024-09-19T04:16:52.619 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-19T04:16:52.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:16:52.619 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-09-19T04:16:52.636 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-19T04:16:52.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:16:52.638 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-19T04:16:52.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:16:52.704 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2024-09-19T04:16:52.802 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-19T04:16:52.802 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T04:16:52.802 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T04:16:52.802 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T04:16:53.065 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:53.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:53 smithi007 ceph-mon[31360]: pgmap v353: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 895 B/s wr, 9 op/s; 150 B/s, 0 objects/s recovering 2024-09-19T04:16:53.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:53 smithi102 ceph-mon[35446]: pgmap v353: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 895 B/s wr, 9 op/s; 150 B/s, 0 objects/s recovering 2024-09-19T04:16:53.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:53 smithi092 ceph-mon[34940]: pgmap v353: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 895 B/s wr, 9 op/s; 150 B/s, 0 objects/s recovering 2024-09-19T04:16:53.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.545+0000 7f3b5ba6e640 1 -- 172.21.15.7:0/472398155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b54101de0 msgr2=0x7f3b541021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:53.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.545+0000 7f3b5ba6e640 1 --2- 172.21.15.7:0/472398155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b54101de0 0x7f3b541021c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3b50009ca0 tx=0x7f3b5002a8c0 comp rx=0 tx=0).stop 2024-09-19T04:16:53.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.546+0000 7f3b5ba6e640 1 -- 172.21.15.7:0/472398155 shutdown_connections 2024-09-19T04:16:53.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.546+0000 7f3b5ba6e640 1 --2- 172.21.15.7:0/472398155 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b54106f10 0x7f3b5410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:53.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.546+0000 7f3b5ba6e640 1 --2- 172.21.15.7:0/472398155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b54102790 0x7f3b541067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:53.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.546+0000 7f3b5ba6e640 1 --2- 172.21.15.7:0/472398155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b54101de0 0x7f3b541021c0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:53.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.546+0000 7f3b5ba6e640 1 -- 172.21.15.7:0/472398155 >> 172.21.15.7:0/472398155 conn(0x7f3b540fd8c0 msgr2=0x7f3b540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:53.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.546+0000 7f3b5ba6e640 1 -- 172.21.15.7:0/472398155 shutdown_connections 2024-09-19T04:16:53.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.546+0000 7f3b5ba6e640 1 -- 172.21.15.7:0/472398155 wait complete. 2024-09-19T04:16:53.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.546+0000 7f3b5ba6e640 1 Processor -- start 2024-09-19T04:16:53.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.546+0000 7f3b5ba6e640 1 -- start start 2024-09-19T04:16:53.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.547+0000 7f3b5ba6e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b54101de0 0x7f3b540744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:53.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.547+0000 7f3b5ba6e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b54102790 0x7f3b54074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:53.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.547+0000 7f3b5ba6e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b54106f10 0x7f3b54074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:53.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.547+0000 7f3b5ba6e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3b54112010 con 0x7f3b54106f10 2024-09-19T04:16:53.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.547+0000 7f3b5ba6e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3b54111e90 con 0x7f3b54101de0 2024-09-19T04:16:53.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.547+0000 7f3b5ba6e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3b54112190 con 0x7f3b54102790 2024-09-19T04:16:53.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.547+0000 7f3b5a00b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b54106f10 0x7f3b54074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:53.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.547+0000 7f3b5a00b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b54106f10 0x7f3b54074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48318/0 (socket says 172.21.15.7:48318) 2024-09-19T04:16:53.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.547+0000 7f3b5a00b640 1 -- 172.21.15.7:0/3343763100 learned_addr learned my addr 172.21.15.7:0/3343763100 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:53.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.547+0000 7f3b5980a640 1 --2- 172.21.15.7:0/3343763100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b54101de0 0x7f3b540744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:53.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.547+0000 7f3b59009640 1 --2- 172.21.15.7:0/3343763100 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b54102790 0x7f3b54074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:53.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.547+0000 7f3b5a00b640 1 -- 172.21.15.7:0/3343763100 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b54102790 msgr2=0x7f3b54074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:53.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.547+0000 7f3b5a00b640 1 --2- 172.21.15.7:0/3343763100 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b54102790 0x7f3b54074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:53.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.547+0000 7f3b5a00b640 1 -- 172.21.15.7:0/3343763100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b54101de0 msgr2=0x7f3b540744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:53.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.547+0000 7f3b5a00b640 1 --2- 172.21.15.7:0/3343763100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b54101de0 0x7f3b540744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:53.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.547+0000 7f3b5a00b640 1 -- 172.21.15.7:0/3343763100 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b541a6a70 con 0x7f3b54106f10 2024-09-19T04:16:53.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.547+0000 7f3b5a00b640 1 --2- 172.21.15.7:0/3343763100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b54106f10 0x7f3b54074f70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c009fd0 tx=0x7f3b4c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:53.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.547+0000 7f3b4affd640 1 -- 172.21.15.7:0/3343763100 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c011830 con 0x7f3b54106f10 2024-09-19T04:16:53.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.547+0000 7f3b4affd640 1 -- 172.21.15.7:0/3343763100 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b4c016070 con 0x7f3b54106f10 2024-09-19T04:16:53.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.547+0000 7f3b5ba6e640 1 -- 172.21.15.7:0/3343763100 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b541a6d60 con 0x7f3b54106f10 2024-09-19T04:16:53.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.547+0000 7f3b4affd640 1 -- 172.21.15.7:0/3343763100 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c00f2e0 con 0x7f3b54106f10 2024-09-19T04:16:53.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.548+0000 7f3b5ba6e640 1 -- 172.21.15.7:0/3343763100 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b541a7250 con 0x7f3b54106f10 2024-09-19T04:16:53.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.549+0000 7f3b5ba6e640 1 -- 172.21.15.7:0/3343763100 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b54102240 con 0x7f3b54106f10 2024-09-19T04:16:53.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.550+0000 7f3b4affd640 1 -- 172.21.15.7:0/3343763100 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f3b4c0119d0 con 0x7f3b54106f10 2024-09-19T04:16:53.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.550+0000 7f3b4affd640 1 --2- 172.21.15.7:0/3343763100 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3b400a3240 0x7f3b400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:53.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.551+0000 7f3b5980a640 1 --2- 172.21.15.7:0/3343763100 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3b400a3240 0x7f3b400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:53.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.551+0000 7f3b4affd640 1 -- 172.21.15.7:0/3343763100 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f3b4c0cf350 con 0x7f3b54106f10 2024-09-19T04:16:53.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.551+0000 7f3b5980a640 1 --2- 172.21.15.7:0/3343763100 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3b400a3240 0x7f3b400a5700 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3b50006010 tx=0x7f3b50009900 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:53.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.555+0000 7f3b4affd640 1 -- 172.21.15.7:0/3343763100 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3b4c09bca0 con 0x7f3b54106f10 2024-09-19T04:16:53.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.769+0000 7f3b5ba6e640 1 -- 172.21.15.7:0/3343763100 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3b5410a0f0 con 0x7f3b54106f10 2024-09-19T04:16:53.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.769+0000 7f3b4affd640 1 -- 172.21.15.7:0/3343763100 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+88 (secure 0 0 0) 0x7f3b4c09b5a0 con 0x7f3b54106f10 2024-09-19T04:16:53.770 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-19T04:16:53.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.771+0000 7f3b5ba6e640 1 -- 172.21.15.7:0/3343763100 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3b400a3240 msgr2=0x7f3b400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:53.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.771+0000 7f3b5ba6e640 1 --2- 172.21.15.7:0/3343763100 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3b400a3240 0x7f3b400a5700 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3b50006010 tx=0x7f3b50009900 comp rx=0 tx=0).stop 2024-09-19T04:16:53.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.771+0000 7f3b5ba6e640 1 -- 172.21.15.7:0/3343763100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b54106f10 msgr2=0x7f3b54074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:53.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.771+0000 7f3b5ba6e640 1 --2- 172.21.15.7:0/3343763100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b54106f10 0x7f3b54074f70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c009fd0 tx=0x7f3b4c00b8e0 comp rx=0 tx=0).stop 2024-09-19T04:16:53.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.771+0000 7f3b5ba6e640 1 -- 172.21.15.7:0/3343763100 shutdown_connections 2024-09-19T04:16:53.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.771+0000 7f3b5ba6e640 1 --2- 172.21.15.7:0/3343763100 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3b400a3240 0x7f3b400a5700 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:53.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.771+0000 7f3b5ba6e640 1 --2- 172.21.15.7:0/3343763100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b54106f10 0x7f3b54074f70 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:53.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.771+0000 7f3b5ba6e640 1 --2- 172.21.15.7:0/3343763100 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b54102790 0x7f3b54074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:53.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.771+0000 7f3b5ba6e640 1 --2- 172.21.15.7:0/3343763100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b54101de0 0x7f3b540744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:53.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.771+0000 7f3b5ba6e640 1 -- 172.21.15.7:0/3343763100 >> 172.21.15.7:0/3343763100 conn(0x7f3b540fd8c0 msgr2=0x7f3b540fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:53.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.771+0000 7f3b5ba6e640 1 -- 172.21.15.7:0/3343763100 shutdown_connections 2024-09-19T04:16:53.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:53.772+0000 7f3b5ba6e640 1 -- 172.21.15.7:0/3343763100 wait complete. 2024-09-19T04:16:54.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:54 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3343763100' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T04:16:54.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:54 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3343763100' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T04:16:54.430 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T04:16:54.430 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T04:16:54.430 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-09-19T04:16:54.430 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T04:16:54.431 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T04:16:54.431 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T04:16:54.431 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T04:16:54.431 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T04:16:54.431 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T04:16:54.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:16:54.432 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-09-19T04:16:54.450 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T04:16:54.450 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T04:16:54.450 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T04:16:54.450 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-09-19T04:16:54.451 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-09-19T04:16:54.451 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-09-19T04:16:54.451 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T04:16:54.451 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-09-19T04:16:54.451 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-09-19T04:16:54.451 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T04:16:54.451 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-09-19T04:16:54.451 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-09-19T04:16:54.451 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T04:16:54.451 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-09-19T04:16:54.451 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-09-19T04:16:54.452 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T04:16:54.452 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42152sec preferred_lft 42152sec 2024-09-19T04:16:54.452 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-09-19T04:16:54.452 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-09-19T04:16:54.452 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T04:16:54.452 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-09-19T04:16:54.452 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-09-19T04:16:54.452 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T04:16:54.452 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T04:16:54.453 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-19T04:16:54.453 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add name ceph-brx type bridge 2024-09-19T04:16:54.453 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr flush dev ceph-brx 2024-09-19T04:16:54.453 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set ceph-brx up 2024-09-19T04:16:54.453 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T04:16:54.453 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-19T04:16:54.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T04:16:54.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:54 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3343763100' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T04:16:54.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T04:16:54.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:16:54.597 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T04:16:54.623 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-09-19T04:16:54.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:16:54.624 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-09-19T04:16:54.681 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-09-19T04:16:54.681 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T04:16:54.681 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T04:16:54.681 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T04:16:54.681 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T04:16:54.682 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T04:16:54.682 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-19T04:16:54.682 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T04:16:54.682 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T04:16:54.682 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T04:16:54.682 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-19T04:16:54.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T04:16:54.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T04:16:54.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:16:54.811 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-09-19T04:16:54.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:16:54.828 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list-id 2024-09-19T04:16:54.883 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T04:16:54.883 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-19T04:16:54.883 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T04:16:54.883 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T04:16:54.883 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-19T04:16:54.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T04:16:54.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T04:16:55.003 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T04:16:55.003 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T04:16:55.003 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-19T04:16:55.003 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T04:16:55.003 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T04:16:55.003 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T04:16:55.004 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T04:16:55.004 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T04:16:55.004 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-19T04:16:55.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T04:16:55.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T04:16:55.122 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T04:16:55.122 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-19T04:16:55.122 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-09-19T04:16:55.122 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T04:16:55.122 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-19T04:16:55.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T04:16:55.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T04:16:55.202 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T04:16:55.202 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T04:16:55.218 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T04:16:55.218 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T04:16:55.218 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T04:16:55.274 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-19T04:16:55.274 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-19T04:16:55.274 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/011e04cb-6eb6-42d8-ad92-600be877f3e7 2024-09-19T04:16:55.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:16:55.274 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/011e04cb-6eb6-42d8-ad92-600be877f3e7 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-19T04:16:55.336 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:55 smithi007 ceph-mon[31360]: pgmap v354: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 895 B/s wr, 10 op/s; 150 B/s, 0 objects/s recovering 2024-09-19T04:16:55.359 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-19T04:16:55.359 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-09-19T04:16:55.359 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-09-19T04:16:55.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:55 smithi102 ceph-mon[35446]: pgmap v354: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 895 B/s wr, 10 op/s; 150 B/s, 0 objects/s recovering 2024-09-19T04:16:55.497 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-19T04:16:55.497 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-09-19T04:16:55.497 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-09-19T04:16:55.498 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.92:3300,172.21.15.102:3300" 2024-09-19T04:16:55.498 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:3300,172.21.15.92:3300,172.21.15.102:3300:/volumes/qa/sv_1/011e04cb-6eb6-42d8-ad92-600be877f3e7 2024-09-19T04:16:55.498 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,key=0,fsid=77957c0a-763c-11ef-bceb-c7b262605968" will pass to kernel 2024-09-19T04:16:55.499 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T04:16:55.499 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-09-19T04:16:55.499 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T04:16:55.499 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T04:16:55.499 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T04:16:55.501 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T04:16:55.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:16:55.501 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T04:16:55.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:55 smithi092 ceph-mon[34940]: pgmap v354: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 895 B/s wr, 10 op/s; 150 B/s, 0 objects/s recovering 2024-09-19T04:16:55.575 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T04:16:55.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T04:16:55.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T04:16:55.673 INFO:teuthology.orchestra.run.smithi007.stdout:client15285 2024-09-19T04:16:55.674 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T04:16:55.674 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T04:16:55.691 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T04:16:55.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T04:16:55.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T04:16:55.789 INFO:teuthology.orchestra.run.smithi007.stdout:client15285 2024-09-19T04:16:55.789 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T04:16:55.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T04:16:55.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T04:16:55.847 INFO:teuthology.orchestra.run.smithi007.stdout:client15285 2024-09-19T04:16:55.848 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/77957c0a-763c-11ef-bceb-c7b262605968.client15285/status') 2024-09-19T04:16:55.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T04:16:55.908 INFO:teuthology.orchestra.run.smithi007.stdout:instance: client.15285 (3)192.168.0.1:0/2893652638 2024-09-19T04:16:55.908 INFO:teuthology.orchestra.run.smithi007.stdout:blocklisted: false 2024-09-19T04:16:55.909 INFO:teuthology.orchestra.run.smithi007.stderr:0+1 records in 2024-09-19T04:16:55.909 INFO:teuthology.orchestra.run.smithi007.stderr:0+1 records out 2024-09-19T04:16:55.909 INFO:teuthology.orchestra.run.smithi007.stderr:70 bytes copied, 2.7882e-05 s, 2.5 MB/s 2024-09-19T04:16:55.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T04:16:55.916 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T04:16:55.927 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T04:16:55.927 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-09-19T04:16:55.927 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-19T04:16:56.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.031+0000 7ff7552e6640 1 -- 172.21.15.7:0/1474191730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff750101da0 msgr2=0x7ff750108630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:56.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.031+0000 7ff7552e6640 1 --2- 172.21.15.7:0/1474191730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff750101da0 0x7ff750108630 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff748009ca0 tx=0x7ff74802a8c0 comp rx=0 tx=0).stop 2024-09-19T04:16:56.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.031+0000 7ff7552e6640 1 -- 172.21.15.7:0/1474191730 shutdown_connections 2024-09-19T04:16:56.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.031+0000 7ff7552e6640 1 --2- 172.21.15.7:0/1474191730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff750101da0 0x7ff750108630 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:56.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.031+0000 7ff7552e6640 1 --2- 172.21.15.7:0/1474191730 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7501013e0 0x7ff750101860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:56.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.031+0000 7ff7552e6640 1 --2- 172.21.15.7:0/1474191730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7501001f0 0x7ff7501005f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:56.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.031+0000 7ff7552e6640 1 -- 172.21.15.7:0/1474191730 >> 172.21.15.7:0/1474191730 conn(0x7ff7500fb970 msgr2=0x7ff7500fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:56.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.031+0000 7ff7552e6640 1 -- 172.21.15.7:0/1474191730 shutdown_connections 2024-09-19T04:16:56.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.031+0000 7ff7552e6640 1 -- 172.21.15.7:0/1474191730 wait complete. 2024-09-19T04:16:56.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.031+0000 7ff7552e6640 1 Processor -- start 2024-09-19T04:16:56.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.031+0000 7ff7552e6640 1 -- start start 2024-09-19T04:16:56.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.032+0000 7ff7552e6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7501001f0 0x7ff750197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:56.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.032+0000 7ff7552e6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7501013e0 0x7ff750198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:56.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.032+0000 7ff7552e6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff750101da0 0x7ff75019f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:56.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.032+0000 7ff7552e6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff75010d860 con 0x7ff750101da0 2024-09-19T04:16:56.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.032+0000 7ff7552e6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff75010d6e0 con 0x7ff7501013e0 2024-09-19T04:16:56.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.032+0000 7ff7552e6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff75010d9e0 con 0x7ff7501001f0 2024-09-19T04:16:56.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.032+0000 7ff74f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff750101da0 0x7ff75019f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:56.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.032+0000 7ff74effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7501001f0 0x7ff750197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:56.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.032+0000 7ff74f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff750101da0 0x7ff75019f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48334/0 (socket says 172.21.15.7:48334) 2024-09-19T04:16:56.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.032+0000 7ff74f7fe640 1 -- 172.21.15.7:0/1347071326 learned_addr learned my addr 172.21.15.7:0/1347071326 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:56.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.032+0000 7ff74e7fc640 1 --2- 172.21.15.7:0/1347071326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7501013e0 0x7ff750198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:56.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.032+0000 7ff74f7fe640 1 -- 172.21.15.7:0/1347071326 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7501001f0 msgr2=0x7ff750197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:56.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.032+0000 7ff74f7fe640 1 --2- 172.21.15.7:0/1347071326 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7501001f0 0x7ff750197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:56.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.032+0000 7ff74f7fe640 1 -- 172.21.15.7:0/1347071326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7501013e0 msgr2=0x7ff750198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:56.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.032+0000 7ff74f7fe640 1 --2- 172.21.15.7:0/1347071326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7501013e0 0x7ff750198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:56.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.032+0000 7ff74f7fe640 1 -- 172.21.15.7:0/1347071326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff75019fae0 con 0x7ff750101da0 2024-09-19T04:16:56.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.032+0000 7ff74f7fe640 1 --2- 172.21.15.7:0/1347071326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff750101da0 0x7ff75019f470 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff748005e30 tx=0x7ff748004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:56.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.032+0000 7ff737fff640 1 -- 172.21.15.7:0/1347071326 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff748003b70 con 0x7ff750101da0 2024-09-19T04:16:56.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.032+0000 7ff737fff640 1 -- 172.21.15.7:0/1347071326 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff748003d10 con 0x7ff750101da0 2024-09-19T04:16:56.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.033+0000 7ff7552e6640 1 -- 172.21.15.7:0/1347071326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff75019fd70 con 0x7ff750101da0 2024-09-19T04:16:56.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.033+0000 7ff737fff640 1 -- 172.21.15.7:0/1347071326 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74802fbd0 con 0x7ff750101da0 2024-09-19T04:16:56.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.033+0000 7ff7552e6640 1 -- 172.21.15.7:0/1347071326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7501a0260 con 0x7ff750101da0 2024-09-19T04:16:56.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.033+0000 7ff7552e6640 1 -- 172.21.15.7:0/1347071326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff750107600 con 0x7ff750101da0 2024-09-19T04:16:56.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.035+0000 7ff737fff640 1 -- 172.21.15.7:0/1347071326 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7ff74802fd70 con 0x7ff750101da0 2024-09-19T04:16:56.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.035+0000 7ff737fff640 1 --2- 172.21.15.7:0/1347071326 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff7380a3240 0x7ff7380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:56.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.035+0000 7ff737fff640 1 -- 172.21.15.7:0/1347071326 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7ff7480f0e50 con 0x7ff750101da0 2024-09-19T04:16:56.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.035+0000 7ff74effd640 1 --2- 172.21.15.7:0/1347071326 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff7380a3240 0x7ff7380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:56.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.036+0000 7ff74effd640 1 --2- 172.21.15.7:0/1347071326 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff7380a3240 0x7ff7380a5700 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff750101240 tx=0x7ff740005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:56.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.040+0000 7ff737fff640 1 -- 172.21.15.7:0/1347071326 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff7480bd8c0 con 0x7ff750101da0 2024-09-19T04:16:56.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:56.257+0000 7ff7552e6640 1 -- 172.21.15.7:0/1347071326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7ff75002d7c0 con 0x7ff750101da0 2024-09-19T04:16:57.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.086+0000 7ff737fff640 1 -- 172.21.15.7:0/1347071326 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v28) ==== 118+0+0 (secure 0 0 0) 0x7ff7480bd1c0 con 0x7ff750101da0 2024-09-19T04:16:57.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.089+0000 7ff7552e6640 1 -- 172.21.15.7:0/1347071326 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff7380a3240 msgr2=0x7ff7380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:57.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.089+0000 7ff7552e6640 1 --2- 172.21.15.7:0/1347071326 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff7380a3240 0x7ff7380a5700 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff750101240 tx=0x7ff740005f90 comp rx=0 tx=0).stop 2024-09-19T04:16:57.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.089+0000 7ff7552e6640 1 -- 172.21.15.7:0/1347071326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff750101da0 msgr2=0x7ff75019f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:57.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.089+0000 7ff7552e6640 1 --2- 172.21.15.7:0/1347071326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff750101da0 0x7ff75019f470 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff748005e30 tx=0x7ff748004ab0 comp rx=0 tx=0).stop 2024-09-19T04:16:57.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.089+0000 7ff7552e6640 1 -- 172.21.15.7:0/1347071326 shutdown_connections 2024-09-19T04:16:57.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.089+0000 7ff7552e6640 1 --2- 172.21.15.7:0/1347071326 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff7380a3240 0x7ff7380a5700 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:57.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.089+0000 7ff7552e6640 1 --2- 172.21.15.7:0/1347071326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff750101da0 0x7ff75019f470 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:57.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.089+0000 7ff7552e6640 1 --2- 172.21.15.7:0/1347071326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7501013e0 0x7ff750198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:57.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.089+0000 7ff7552e6640 1 --2- 172.21.15.7:0/1347071326 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7501001f0 0x7ff750197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:57.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.089+0000 7ff7552e6640 1 -- 172.21.15.7:0/1347071326 >> 172.21.15.7:0/1347071326 conn(0x7ff7500fb970 msgr2=0x7ff7501047d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:57.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.089+0000 7ff7552e6640 1 -- 172.21.15.7:0/1347071326 shutdown_connections 2024-09-19T04:16:57.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.089+0000 7ff7552e6640 1 -- 172.21.15.7:0/1347071326 wait complete. 2024-09-19T04:16:57.104 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-19T04:16:57.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.216+0000 7feb20637640 1 -- 172.21.15.7:0/901360985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb18100a40 msgr2=0x7feb18100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:57.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.216+0000 7feb20637640 1 --2- 172.21.15.7:0/901360985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb18100a40 0x7feb18100e40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7feb14009900 tx=0x7feb1402a410 comp rx=0 tx=0).stop 2024-09-19T04:16:57.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.216+0000 7feb20637640 1 -- 172.21.15.7:0/901360985 shutdown_connections 2024-09-19T04:16:57.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.216+0000 7feb20637640 1 --2- 172.21.15.7:0/901360985 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb181025f0 0x7feb18108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:57.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.216+0000 7feb20637640 1 --2- 172.21.15.7:0/901360985 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb18101c30 0x7feb181020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:57.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.216+0000 7feb20637640 1 --2- 172.21.15.7:0/901360985 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb18100a40 0x7feb18100e40 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:57.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.216+0000 7feb20637640 1 -- 172.21.15.7:0/901360985 >> 172.21.15.7:0/901360985 conn(0x7feb180fc1c0 msgr2=0x7feb180fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:57.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.216+0000 7feb20637640 1 -- 172.21.15.7:0/901360985 shutdown_connections 2024-09-19T04:16:57.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.216+0000 7feb20637640 1 -- 172.21.15.7:0/901360985 wait complete. 2024-09-19T04:16:57.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.217+0000 7feb20637640 1 Processor -- start 2024-09-19T04:16:57.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.217+0000 7feb20637640 1 -- start start 2024-09-19T04:16:57.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.217+0000 7feb20637640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb18100a40 0x7feb18198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:57.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.217+0000 7feb20637640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb18101c30 0x7feb181985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:57.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.217+0000 7feb20637640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb181025f0 0x7feb1819f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:57.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.217+0000 7feb20637640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7feb1810c7a0 con 0x7feb181025f0 2024-09-19T04:16:57.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.217+0000 7feb20637640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feb1810c620 con 0x7feb18100a40 2024-09-19T04:16:57.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.217+0000 7feb20637640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7feb1810c920 con 0x7feb18101c30 2024-09-19T04:16:57.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.217+0000 7feb1ebd4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb181025f0 0x7feb1819f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:57.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.217+0000 7feb1ebd4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb181025f0 0x7feb1819f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48352/0 (socket says 172.21.15.7:48352) 2024-09-19T04:16:57.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.217+0000 7feb1ebd4640 1 -- 172.21.15.7:0/3569307498 learned_addr learned my addr 172.21.15.7:0/3569307498 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:57.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.217+0000 7feb1dbd2640 1 --2- 172.21.15.7:0/3569307498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb18101c30 0x7feb181985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:57.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.217+0000 7feb1e3d3640 1 --2- 172.21.15.7:0/3569307498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb18100a40 0x7feb18198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:57.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.218+0000 7feb1ebd4640 1 -- 172.21.15.7:0/3569307498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb18101c30 msgr2=0x7feb181985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:57.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.218+0000 7feb1ebd4640 1 --2- 172.21.15.7:0/3569307498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb18101c30 0x7feb181985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:57.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.218+0000 7feb1ebd4640 1 -- 172.21.15.7:0/3569307498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb18100a40 msgr2=0x7feb18198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:57.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.218+0000 7feb1ebd4640 1 --2- 172.21.15.7:0/3569307498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb18100a40 0x7feb18198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:57.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.218+0000 7feb1ebd4640 1 -- 172.21.15.7:0/3569307498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb1819fc80 con 0x7feb181025f0 2024-09-19T04:16:57.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.218+0000 7feb1ebd4640 1 --2- 172.21.15.7:0/3569307498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb181025f0 0x7feb1819f610 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7feb1000b970 tx=0x7feb1000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:57.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.218+0000 7feb0f7fe640 1 -- 172.21.15.7:0/3569307498 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb10019070 con 0x7feb181025f0 2024-09-19T04:16:57.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.218+0000 7feb0f7fe640 1 -- 172.21.15.7:0/3569307498 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb10014440 con 0x7feb181025f0 2024-09-19T04:16:57.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.218+0000 7feb20637640 1 -- 172.21.15.7:0/3569307498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb1819ff70 con 0x7feb181025f0 2024-09-19T04:16:57.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.218+0000 7feb0f7fe640 1 -- 172.21.15.7:0/3569307498 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb100075d0 con 0x7feb181025f0 2024-09-19T04:16:57.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.218+0000 7feb20637640 1 -- 172.21.15.7:0/3569307498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb181a0460 con 0x7feb181025f0 2024-09-19T04:16:57.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.219+0000 7feb20637640 1 -- 172.21.15.7:0/3569307498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb181a06f0 con 0x7feb181025f0 2024-09-19T04:16:57.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.220+0000 7feb0f7fe640 1 -- 172.21.15.7:0/3569307498 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7feb1001c070 con 0x7feb181025f0 2024-09-19T04:16:57.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.221+0000 7feb0f7fe640 1 --2- 172.21.15.7:0/3569307498 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7feb040a3240 0x7feb040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:57.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.221+0000 7feb0f7fe640 1 -- 172.21.15.7:0/3569307498 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7feb100cf260 con 0x7feb181025f0 2024-09-19T04:16:57.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.221+0000 7feb1e3d3640 1 --2- 172.21.15.7:0/3569307498 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7feb040a3240 0x7feb040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:57.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.222+0000 7feb1e3d3640 1 --2- 172.21.15.7:0/3569307498 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7feb040a3240 0x7feb040a5700 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7feb14005ab0 tx=0x7feb14000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:57.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.225+0000 7feb0f7fe640 1 -- 172.21.15.7:0/3569307498 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7feb1009b560 con 0x7feb181025f0 2024-09-19T04:16:57.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:57 smithi007 ceph-mon[31360]: pgmap v355: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 787 B/s wr, 11 op/s; 132 B/s, 0 objects/s recovering 2024-09-19T04:16:57.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:57 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1347071326' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-19T04:16:57.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:57 smithi102 ceph-mon[35446]: pgmap v355: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 787 B/s wr, 11 op/s; 132 B/s, 0 objects/s recovering 2024-09-19T04:16:57.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:57 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1347071326' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-19T04:16:57.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.432+0000 7feb20637640 1 -- 172.21.15.7:0/3569307498 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7feb1806a150 con 0x7feb040a3240 2024-09-19T04:16:57.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.453+0000 7feb0f7fe640 1 -- 172.21.15.7:0/3569307498 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7feb1806a150 con 0x7feb040a3240 2024-09-19T04:16:57.455 INFO:teuthology.orchestra.run.smithi007.stdout:{} 2024-09-19T04:16:57.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.455+0000 7feb20637640 1 -- 172.21.15.7:0/3569307498 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7feb040a3240 msgr2=0x7feb040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:57.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.455+0000 7feb20637640 1 --2- 172.21.15.7:0/3569307498 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7feb040a3240 0x7feb040a5700 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7feb14005ab0 tx=0x7feb14000bc0 comp rx=0 tx=0).stop 2024-09-19T04:16:57.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.455+0000 7feb20637640 1 -- 172.21.15.7:0/3569307498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb181025f0 msgr2=0x7feb1819f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:57.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.455+0000 7feb20637640 1 --2- 172.21.15.7:0/3569307498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb181025f0 0x7feb1819f610 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7feb1000b970 tx=0x7feb1000bd70 comp rx=0 tx=0).stop 2024-09-19T04:16:57.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.455+0000 7feb20637640 1 -- 172.21.15.7:0/3569307498 shutdown_connections 2024-09-19T04:16:57.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.455+0000 7feb20637640 1 --2- 172.21.15.7:0/3569307498 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7feb040a3240 0x7feb040a5700 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:57.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.455+0000 7feb20637640 1 --2- 172.21.15.7:0/3569307498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb181025f0 0x7feb1819f610 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:57.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.455+0000 7feb20637640 1 --2- 172.21.15.7:0/3569307498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb18101c30 0x7feb181985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:57.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.455+0000 7feb20637640 1 --2- 172.21.15.7:0/3569307498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb18100a40 0x7feb18198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:57.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.455+0000 7feb20637640 1 -- 172.21.15.7:0/3569307498 >> 172.21.15.7:0/3569307498 conn(0x7feb180fc1c0 msgr2=0x7feb18069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:57.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.455+0000 7feb20637640 1 -- 172.21.15.7:0/3569307498 shutdown_connections 2024-09-19T04:16:57.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:57.455+0000 7feb20637640 1 -- 172.21.15.7:0/3569307498 wait complete. 2024-09-19T04:16:57.468 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-19T04:16:57.479 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-19T04:16:57.490 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-09-19T04:16:57.490 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-19T04:16:57.493 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-19T04:16:57.511 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T04:16:57.511 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T04:16:57.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:57 smithi092 ceph-mon[34940]: pgmap v355: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 787 B/s wr, 11 op/s; 132 B/s, 0 objects/s recovering 2024-09-19T04:16:57.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:57 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1347071326' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-19T04:16:57.770 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:57.877 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:16:57 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:16:57.437+0000 7fd27aea6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:16:57.877 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:16:57 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:16:57.437+0000 7fd27aea6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:16:57.877 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:16:57 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:16:57.437+0000 7fd27aea6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:16:57.877 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:16:57 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:16:57.437+0000 7fd27aea6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:16:57.877 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:16:57 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x[31590]: 2024-09-19T04:16:57.437+0000 7fd27aea6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:16:58.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:58 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1347071326' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-19T04:16:58.191 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:58 smithi007 ceph-mon[31360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:16:58.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.273+0000 7f315ae92640 1 -- 172.21.15.7:0/309287042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3154102ef0 msgr2=0x7f315410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:58.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.273+0000 7f315ae92640 1 --2- 172.21.15.7:0/309287042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3154102ef0 0x7f315410da40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f314c009ca0 tx=0x7f314c02a950 comp rx=0 tx=0).stop 2024-09-19T04:16:58.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.273+0000 7f315ae92640 1 -- 172.21.15.7:0/309287042 shutdown_connections 2024-09-19T04:16:58.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.273+0000 7f315ae92640 1 --2- 172.21.15.7:0/309287042 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3154102ef0 0x7f315410da40 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:58.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.273+0000 7f315ae92640 1 --2- 172.21.15.7:0/309287042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3154102570 0x7f31541029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:58.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.273+0000 7f315ae92640 1 --2- 172.21.15.7:0/309287042 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3154100e20 0x7f3154101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:58.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.273+0000 7f315ae92640 1 -- 172.21.15.7:0/309287042 >> 172.21.15.7:0/309287042 conn(0x7f31540fc7d0 msgr2=0x7f31540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:58.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.273+0000 7f315ae92640 1 -- 172.21.15.7:0/309287042 shutdown_connections 2024-09-19T04:16:58.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.273+0000 7f315ae92640 1 -- 172.21.15.7:0/309287042 wait complete. 2024-09-19T04:16:58.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.273+0000 7f315ae92640 1 Processor -- start 2024-09-19T04:16:58.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.274+0000 7f315ae92640 1 -- start start 2024-09-19T04:16:58.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.274+0000 7f315ae92640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3154100e20 0x7f31540fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:58.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.274+0000 7f315ae92640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3154102570 0x7f31540fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:58.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.274+0000 7f315ae92640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3154102ef0 0x7f31540fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.274+0000 7f315ae92640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3154110f80 con 0x7f3154102ef0 2024-09-19T04:16:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.274+0000 7f315ae92640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3154110e00 con 0x7f3154102570 2024-09-19T04:16:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.274+0000 7f315ae92640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3154111100 con 0x7f3154100e20 2024-09-19T04:16:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.274+0000 7f315942f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3154102ef0 0x7f31540fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.274+0000 7f315942f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3154102ef0 0x7f31540fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57754/0 (socket says 172.21.15.7:57754) 2024-09-19T04:16:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.274+0000 7f315942f640 1 -- 172.21.15.7:0/570271697 learned_addr learned my addr 172.21.15.7:0/570271697 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.274+0000 7f3158c2e640 1 --2- 172.21.15.7:0/570271697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3154100e20 0x7f31540fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.274+0000 7f3153fff640 1 --2- 172.21.15.7:0/570271697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3154102570 0x7f31540fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.274+0000 7f315942f640 1 -- 172.21.15.7:0/570271697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3154100e20 msgr2=0x7f31540fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.274+0000 7f315942f640 1 --2- 172.21.15.7:0/570271697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3154100e20 0x7f31540fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.274+0000 7f315942f640 1 -- 172.21.15.7:0/570271697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3154102570 msgr2=0x7f31540fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.274+0000 7f315942f640 1 --2- 172.21.15.7:0/570271697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3154102570 0x7f31540fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.274+0000 7f315942f640 1 -- 172.21.15.7:0/570271697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31541a69a0 con 0x7f3154102ef0 2024-09-19T04:16:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.275+0000 7f315942f640 1 --2- 172.21.15.7:0/570271697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3154102ef0 0x7f31540fd700 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f314c004af0 tx=0x7f314c02f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.275+0000 7f3151ffb640 1 -- 172.21.15.7:0/570271697 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c034040 con 0x7f3154102ef0 2024-09-19T04:16:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.275+0000 7f3151ffb640 1 -- 172.21.15.7:0/570271697 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f314c030920 con 0x7f3154102ef0 2024-09-19T04:16:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.275+0000 7f315ae92640 1 -- 172.21.15.7:0/570271697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31541a6c30 con 0x7f3154102ef0 2024-09-19T04:16:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.275+0000 7f3151ffb640 1 -- 172.21.15.7:0/570271697 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c004820 con 0x7f3154102ef0 2024-09-19T04:16:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.275+0000 7f315ae92640 1 -- 172.21.15.7:0/570271697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31541a7160 con 0x7f3154102ef0 2024-09-19T04:16:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.276+0000 7f315ae92640 1 -- 172.21.15.7:0/570271697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3154101200 con 0x7f3154102ef0 2024-09-19T04:16:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.277+0000 7f3151ffb640 1 -- 172.21.15.7:0/570271697 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f314c037020 con 0x7f3154102ef0 2024-09-19T04:16:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.278+0000 7f3151ffb640 1 --2- 172.21.15.7:0/570271697 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f31440a32c0 0x7f31440a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:58.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.278+0000 7f3158c2e640 1 --2- 172.21.15.7:0/570271697 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f31440a32c0 0x7f31440a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:58.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.278+0000 7f3151ffb640 1 -- 172.21.15.7:0/570271697 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f314c0f0b50 con 0x7f3154102ef0 2024-09-19T04:16:58.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.279+0000 7f3158c2e640 1 --2- 172.21.15.7:0/570271697 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f31440a32c0 0x7f31440a5780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3148009bd0 tx=0x7f3148005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:58.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.281+0000 7f3151ffb640 1 -- 172.21.15.7:0/570271697 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f314c0bd460 con 0x7f3154102ef0 2024-09-19T04:16:58.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:58 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1347071326' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-19T04:16:58.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:58 smithi102 ceph-mon[35446]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:16:58.448 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:58 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1347071326' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-19T04:16:58.448 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:58 smithi092 ceph-mon[34940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:16:58.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.454+0000 7f315ae92640 1 -- 172.21.15.7:0/570271697 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3154062630 con 0x7f31440a32c0 2024-09-19T04:16:58.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.463+0000 7f3151ffb640 1 -- 172.21.15.7:0/570271697 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340805 (secure 0 0 0) 0x7f3154062630 con 0x7f31440a32c0 2024-09-19T04:16:58.468 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:16:58.470 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-19T04:16:58.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.467+0000 7f315ae92640 1 -- 172.21.15.7:0/570271697 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f31440a32c0 msgr2=0x7f31440a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:58.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.467+0000 7f315ae92640 1 --2- 172.21.15.7:0/570271697 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f31440a32c0 0x7f31440a5780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3148009bd0 tx=0x7f3148005f90 comp rx=0 tx=0).stop 2024-09-19T04:16:58.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.467+0000 7f315ae92640 1 -- 172.21.15.7:0/570271697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3154102ef0 msgr2=0x7f31540fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:58.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.467+0000 7f315ae92640 1 --2- 172.21.15.7:0/570271697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3154102ef0 0x7f31540fd700 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f314c004af0 tx=0x7f314c02f5b0 comp rx=0 tx=0).stop 2024-09-19T04:16:58.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.467+0000 7f315ae92640 1 -- 172.21.15.7:0/570271697 shutdown_connections 2024-09-19T04:16:58.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.467+0000 7f315ae92640 1 --2- 172.21.15.7:0/570271697 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f31440a32c0 0x7f31440a5780 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:58.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.467+0000 7f315ae92640 1 --2- 172.21.15.7:0/570271697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3154102ef0 0x7f31540fd700 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:58.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.467+0000 7f315ae92640 1 --2- 172.21.15.7:0/570271697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3154102570 0x7f31540fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:58.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.467+0000 7f315ae92640 1 --2- 172.21.15.7:0/570271697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3154100e20 0x7f31540fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:58.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.467+0000 7f315ae92640 1 -- 172.21.15.7:0/570271697 >> 172.21.15.7:0/570271697 conn(0x7f31540fc7d0 msgr2=0x7f315406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:58.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.468+0000 7f315ae92640 1 -- 172.21.15.7:0/570271697 shutdown_connections 2024-09-19T04:16:58.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:58.468+0000 7f315ae92640 1 -- 172.21.15.7:0/570271697 wait complete. 2024-09-19T04:16:59.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:59 smithi007 ceph-mon[31360]: pgmap v356: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 709 B/s wr, 10 op/s; 119 B/s, 0 objects/s recovering 2024-09-19T04:16:59.189 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:16:59 smithi007 ceph-mon[31360]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:16:59.218 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":356,"stamp":"2024-09-19T04:16:57.156346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662963,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1118,"num_read_kb":687,"num_write":443,"num_write_kb":3092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1181940,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":863,"ondisk_log_size":863,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":357424,"kb_used_data":12260,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124584400,"statfs":{"total":1151940427776,"available":1151574425600,"internally_reserved":0,"allocated":12554240,"data_stored":8144231,"data_compressed":464928,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19141,"internal_metadata":353154363},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":531,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1204,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.100335"},"pg_stats":[{"pgid":"2.1f","version":"88'14","reported_seq":150,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:51.954978+0000","last_change":"2024-09-19T04:14:31.294836+0000","last_active":"2024-09-19T04:16:51.954978+0000","last_peered":"2024-09-19T04:16:51.954978+0000","last_clean":"2024-09-19T04:16:51.954978+0000","last_became_active":"2024-09-19T04:14:31.294589+0000","last_became_peered":"2024-09-19T04:14:31.294589+0000","last_unstale":"2024-09-19T04:16:51.954978+0000","last_undegraded":"2024-09-19T04:16:51.954978+0000","last_fullsized":"2024-09-19T04:16:51.954978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:39:54.093519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063986+0000","last_change":"2024-09-19T04:14:33.316023+0000","last_active":"2024-09-19T04:16:47.063986+0000","last_peered":"2024-09-19T04:16:47.063986+0000","last_clean":"2024-09-19T04:16:47.063986+0000","last_became_active":"2024-09-19T04:14:33.315732+0000","last_became_peered":"2024-09-19T04:14:33.315732+0000","last_unstale":"2024-09-19T04:16:47.063986+0000","last_undegraded":"2024-09-19T04:16:47.063986+0000","last_fullsized":"2024-09-19T04:16:47.063986+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:00.782788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.062795+0000","last_change":"2024-09-19T04:14:40.368540+0000","last_active":"2024-09-19T04:16:47.062795+0000","last_peered":"2024-09-19T04:16:47.062795+0000","last_clean":"2024-09-19T04:16:47.062795+0000","last_became_active":"2024-09-19T04:14:40.367906+0000","last_became_peered":"2024-09-19T04:14:40.367906+0000","last_unstale":"2024-09-19T04:16:47.062795+0000","last_undegraded":"2024-09-19T04:16:47.062795+0000","last_fullsized":"2024-09-19T04:16:47.062795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:35.660297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064184+0000","last_change":"2024-09-19T04:14:31.321870+0000","last_active":"2024-09-19T04:16:47.064184+0000","last_peered":"2024-09-19T04:16:47.064184+0000","last_clean":"2024-09-19T04:16:47.064184+0000","last_became_active":"2024-09-19T04:14:31.321495+0000","last_became_peered":"2024-09-19T04:14:31.321495+0000","last_unstale":"2024-09-19T04:16:47.064184+0000","last_undegraded":"2024-09-19T04:16:47.064184+0000","last_fullsized":"2024-09-19T04:16:47.064184+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:58.063748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.571064+0000","last_change":"2024-09-19T04:14:33.307451+0000","last_active":"2024-09-19T04:16:47.571064+0000","last_peered":"2024-09-19T04:16:47.571064+0000","last_clean":"2024-09-19T04:16:47.571064+0000","last_became_active":"2024-09-19T04:14:33.307129+0000","last_became_peered":"2024-09-19T04:14:33.307129+0000","last_unstale":"2024-09-19T04:16:47.571064+0000","last_undegraded":"2024-09-19T04:16:47.571064+0000","last_fullsized":"2024-09-19T04:16:47.571064+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:28.851012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064923+0000","last_change":"2024-09-19T04:16:47.064923+0000","last_active":"2024-09-19T04:16:47.064923+0000","last_peered":"2024-09-19T04:16:47.064923+0000","last_clean":"2024-09-19T04:16:47.064923+0000","last_became_active":"2024-09-19T04:16:47.064455+0000","last_became_peered":"2024-09-19T04:16:47.064455+0000","last_unstale":"2024-09-19T04:16:47.064923+0000","last_undegraded":"2024-09-19T04:16:47.064923+0000","last_fullsized":"2024-09-19T04:16:47.064923+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:54.446799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.059664+0000","last_change":"2024-09-19T04:14:31.298497+0000","last_active":"2024-09-19T04:16:47.059664+0000","last_peered":"2024-09-19T04:16:47.059664+0000","last_clean":"2024-09-19T04:16:47.059664+0000","last_became_active":"2024-09-19T04:14:31.298185+0000","last_became_peered":"2024-09-19T04:14:31.298185+0000","last_unstale":"2024-09-19T04:16:47.059664+0000","last_undegraded":"2024-09-19T04:16:47.059664+0000","last_fullsized":"2024-09-19T04:16:47.059664+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:56:12.701718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063565+0000","last_change":"2024-09-19T04:14:33.316922+0000","last_active":"2024-09-19T04:16:47.063565+0000","last_peered":"2024-09-19T04:16:47.063565+0000","last_clean":"2024-09-19T04:16:47.063565+0000","last_became_active":"2024-09-19T04:14:33.316613+0000","last_became_peered":"2024-09-19T04:14:33.316613+0000","last_unstale":"2024-09-19T04:16:47.063565+0000","last_undegraded":"2024-09-19T04:16:47.063565+0000","last_fullsized":"2024-09-19T04:16:47.063565+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:22.237900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058493+0000","last_change":"2024-09-19T04:15:47.000772+0000","last_active":"2024-09-19T04:16:47.058493+0000","last_peered":"2024-09-19T04:16:47.058493+0000","last_clean":"2024-09-19T04:16:47.058493+0000","last_became_active":"2024-09-19T04:15:47.000316+0000","last_became_peered":"2024-09-19T04:15:47.000316+0000","last_unstale":"2024-09-19T04:16:47.058493+0000","last_undegraded":"2024-09-19T04:16:47.058493+0000","last_fullsized":"2024-09-19T04:16:47.058493+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:03.292714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.077203+0000","last_change":"2024-09-19T04:16:47.076757+0000","last_active":"2024-09-19T04:16:47.077203+0000","last_peered":"2024-09-19T04:16:47.077203+0000","last_clean":"2024-09-19T04:16:47.077203+0000","last_became_active":"2024-09-19T04:16:47.067225+0000","last_became_peered":"2024-09-19T04:16:47.067225+0000","last_unstale":"2024-09-19T04:16:47.077203+0000","last_undegraded":"2024-09-19T04:16:47.077203+0000","last_fullsized":"2024-09-19T04:16:47.077203+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:38.370696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064150+0000","last_change":"2024-09-19T04:14:33.313560+0000","last_active":"2024-09-19T04:16:47.064150+0000","last_peered":"2024-09-19T04:16:47.064150+0000","last_clean":"2024-09-19T04:16:47.064150+0000","last_became_active":"2024-09-19T04:14:33.313200+0000","last_became_peered":"2024-09-19T04:14:33.313200+0000","last_unstale":"2024-09-19T04:16:47.064150+0000","last_undegraded":"2024-09-19T04:16:47.064150+0000","last_fullsized":"2024-09-19T04:16:47.064150+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:33.807866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058389+0000","last_change":"2024-09-19T04:14:40.368125+0000","last_active":"2024-09-19T04:16:47.058389+0000","last_peered":"2024-09-19T04:16:47.058389+0000","last_clean":"2024-09-19T04:16:47.058389+0000","last_became_active":"2024-09-19T04:14:40.367772+0000","last_became_peered":"2024-09-19T04:14:40.367772+0000","last_unstale":"2024-09-19T04:16:47.058389+0000","last_undegraded":"2024-09-19T04:16:47.058389+0000","last_fullsized":"2024-09-19T04:16:47.058389+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:07:19.740391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067353+0000","last_change":"2024-09-19T04:14:33.307489+0000","last_active":"2024-09-19T04:16:47.067353+0000","last_peered":"2024-09-19T04:16:47.067353+0000","last_clean":"2024-09-19T04:16:47.067353+0000","last_became_active":"2024-09-19T04:14:33.307143+0000","last_became_peered":"2024-09-19T04:14:33.307143+0000","last_unstale":"2024-09-19T04:16:47.067353+0000","last_undegraded":"2024-09-19T04:16:47.067353+0000","last_fullsized":"2024-09-19T04:16:47.067353+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:51:14.018972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.059318+0000","last_change":"2024-09-19T04:14:31.299342+0000","last_active":"2024-09-19T04:16:47.059318+0000","last_peered":"2024-09-19T04:16:47.059318+0000","last_clean":"2024-09-19T04:16:47.059318+0000","last_became_active":"2024-09-19T04:14:31.298927+0000","last_became_peered":"2024-09-19T04:14:31.298927+0000","last_unstale":"2024-09-19T04:16:47.059318+0000","last_undegraded":"2024-09-19T04:16:47.059318+0000","last_fullsized":"2024-09-19T04:16:47.059318+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:38.483077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058641+0000","last_change":"2024-09-19T04:14:40.405762+0000","last_active":"2024-09-19T04:16:47.058641+0000","last_peered":"2024-09-19T04:16:47.058641+0000","last_clean":"2024-09-19T04:16:47.058641+0000","last_became_active":"2024-09-19T04:14:40.405379+0000","last_became_peered":"2024-09-19T04:14:40.405379+0000","last_unstale":"2024-09-19T04:16:47.058641+0000","last_undegraded":"2024-09-19T04:16:47.058641+0000","last_fullsized":"2024-09-19T04:16:47.058641+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:41:36.628112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063612+0000","last_change":"2024-09-19T04:14:33.318521+0000","last_active":"2024-09-19T04:16:47.063612+0000","last_peered":"2024-09-19T04:16:47.063612+0000","last_clean":"2024-09-19T04:16:47.063612+0000","last_became_active":"2024-09-19T04:14:33.318200+0000","last_became_peered":"2024-09-19T04:14:33.318200+0000","last_unstale":"2024-09-19T04:16:47.063612+0000","last_undegraded":"2024-09-19T04:16:47.063612+0000","last_fullsized":"2024-09-19T04:16:47.063612+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:45.497455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.071920+0000","last_change":"2024-09-19T04:16:47.071492+0000","last_active":"2024-09-19T04:16:47.071920+0000","last_peered":"2024-09-19T04:16:47.071920+0000","last_clean":"2024-09-19T04:16:47.071920+0000","last_became_active":"2024-09-19T04:16:47.066432+0000","last_became_peered":"2024-09-19T04:16:47.066432+0000","last_unstale":"2024-09-19T04:16:47.071920+0000","last_undegraded":"2024-09-19T04:16:47.071920+0000","last_fullsized":"2024-09-19T04:16:47.071920+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:33.096458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058545+0000","last_change":"2024-09-19T04:14:40.366110+0000","last_active":"2024-09-19T04:16:47.058545+0000","last_peered":"2024-09-19T04:16:47.058545+0000","last_clean":"2024-09-19T04:16:47.058545+0000","last_became_active":"2024-09-19T04:14:40.365558+0000","last_became_peered":"2024-09-19T04:14:40.365558+0000","last_unstale":"2024-09-19T04:16:47.058545+0000","last_undegraded":"2024-09-19T04:16:47.058545+0000","last_fullsized":"2024-09-19T04:16:47.058545+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:24.049603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.060993+0000","last_change":"2024-09-19T04:14:33.307400+0000","last_active":"2024-09-19T04:16:47.060993+0000","last_peered":"2024-09-19T04:16:47.060993+0000","last_clean":"2024-09-19T04:16:47.060993+0000","last_became_active":"2024-09-19T04:14:33.307095+0000","last_became_peered":"2024-09-19T04:14:33.307095+0000","last_unstale":"2024-09-19T04:16:47.060993+0000","last_undegraded":"2024-09-19T04:16:47.060993+0000","last_fullsized":"2024-09-19T04:16:47.060993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:27.582568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063516+0000","last_change":"2024-09-19T04:14:31.287190+0000","last_active":"2024-09-19T04:16:47.063516+0000","last_peered":"2024-09-19T04:16:47.063516+0000","last_clean":"2024-09-19T04:16:47.063516+0000","last_became_active":"2024-09-19T04:14:31.286817+0000","last_became_peered":"2024-09-19T04:14:31.286817+0000","last_unstale":"2024-09-19T04:16:47.063516+0000","last_undegraded":"2024-09-19T04:16:47.063516+0000","last_fullsized":"2024-09-19T04:16:47.063516+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:44.522615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.135670+0000","last_change":"2024-09-19T04:14:40.372153+0000","last_active":"2024-09-19T04:16:47.135670+0000","last_peered":"2024-09-19T04:16:47.135670+0000","last_clean":"2024-09-19T04:16:47.135670+0000","last_became_active":"2024-09-19T04:14:40.371309+0000","last_became_peered":"2024-09-19T04:14:40.371309+0000","last_unstale":"2024-09-19T04:16:47.135670+0000","last_undegraded":"2024-09-19T04:16:47.135670+0000","last_fullsized":"2024-09-19T04:16:47.135670+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:46.608489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058954+0000","last_change":"2024-09-19T04:14:33.310884+0000","last_active":"2024-09-19T04:16:47.058954+0000","last_peered":"2024-09-19T04:16:47.058954+0000","last_clean":"2024-09-19T04:16:47.058954+0000","last_became_active":"2024-09-19T04:14:33.310532+0000","last_became_peered":"2024-09-19T04:14:33.310532+0000","last_unstale":"2024-09-19T04:16:47.058954+0000","last_undegraded":"2024-09-19T04:16:47.058954+0000","last_fullsized":"2024-09-19T04:16:47.058954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:49:16.565018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063454+0000","last_change":"2024-09-19T04:14:31.322216+0000","last_active":"2024-09-19T04:16:47.063454+0000","last_peered":"2024-09-19T04:16:47.063454+0000","last_clean":"2024-09-19T04:16:47.063454+0000","last_became_active":"2024-09-19T04:14:31.321941+0000","last_became_peered":"2024-09-19T04:14:31.321941+0000","last_unstale":"2024-09-19T04:16:47.063454+0000","last_undegraded":"2024-09-19T04:16:47.063454+0000","last_fullsized":"2024-09-19T04:16:47.063454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:14.624104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058784+0000","last_change":"2024-09-19T04:14:40.405749+0000","last_active":"2024-09-19T04:16:47.058784+0000","last_peered":"2024-09-19T04:16:47.058784+0000","last_clean":"2024-09-19T04:16:47.058784+0000","last_became_active":"2024-09-19T04:14:40.405353+0000","last_became_peered":"2024-09-19T04:14:40.405353+0000","last_unstale":"2024-09-19T04:16:47.058784+0000","last_undegraded":"2024-09-19T04:16:47.058784+0000","last_fullsized":"2024-09-19T04:16:47.058784+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:13.311989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.571027+0000","last_change":"2024-09-19T04:14:33.312057+0000","last_active":"2024-09-19T04:16:47.571027+0000","last_peered":"2024-09-19T04:16:47.571027+0000","last_clean":"2024-09-19T04:16:47.571027+0000","last_became_active":"2024-09-19T04:14:33.311751+0000","last_became_peered":"2024-09-19T04:14:33.311751+0000","last_unstale":"2024-09-19T04:16:47.571027+0000","last_undegraded":"2024-09-19T04:16:47.571027+0000","last_fullsized":"2024-09-19T04:16:47.571027+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:28.843870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058939+0000","last_change":"2024-09-19T04:14:31.287529+0000","last_active":"2024-09-19T04:16:47.058939+0000","last_peered":"2024-09-19T04:16:47.058939+0000","last_clean":"2024-09-19T04:16:47.058939+0000","last_became_active":"2024-09-19T04:14:31.287172+0000","last_became_peered":"2024-09-19T04:14:31.287172+0000","last_unstale":"2024-09-19T04:16:47.058939+0000","last_undegraded":"2024-09-19T04:16:47.058939+0000","last_fullsized":"2024-09-19T04:16:47.058939+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:32:23.351997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063528+0000","last_change":"2024-09-19T04:14:40.363772+0000","last_active":"2024-09-19T04:16:47.063528+0000","last_peered":"2024-09-19T04:16:47.063528+0000","last_clean":"2024-09-19T04:16:47.063528+0000","last_became_active":"2024-09-19T04:14:40.363395+0000","last_became_peered":"2024-09-19T04:14:40.363395+0000","last_unstale":"2024-09-19T04:16:47.063528+0000","last_undegraded":"2024-09-19T04:16:47.063528+0000","last_fullsized":"2024-09-19T04:16:47.063528+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:22.090743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064210+0000","last_change":"2024-09-19T04:14:33.310108+0000","last_active":"2024-09-19T04:16:47.064210+0000","last_peered":"2024-09-19T04:16:47.064210+0000","last_clean":"2024-09-19T04:16:47.064210+0000","last_became_active":"2024-09-19T04:14:33.309812+0000","last_became_peered":"2024-09-19T04:14:33.309812+0000","last_unstale":"2024-09-19T04:16:47.064210+0000","last_undegraded":"2024-09-19T04:16:47.064210+0000","last_fullsized":"2024-09-19T04:16:47.064210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:48.570530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'17","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.135907+0000","last_change":"2024-09-19T04:14:31.293115+0000","last_active":"2024-09-19T04:16:47.135907+0000","last_peered":"2024-09-19T04:16:47.135907+0000","last_clean":"2024-09-19T04:16:47.135907+0000","last_became_active":"2024-09-19T04:14:31.292733+0000","last_became_peered":"2024-09-19T04:14:31.292733+0000","last_unstale":"2024-09-19T04:16:47.135907+0000","last_undegraded":"2024-09-19T04:16:47.135907+0000","last_fullsized":"2024-09-19T04:16:47.135907+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:11.936757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063704+0000","last_change":"2024-09-19T04:14:40.405241+0000","last_active":"2024-09-19T04:16:47.063704+0000","last_peered":"2024-09-19T04:16:47.063704+0000","last_clean":"2024-09-19T04:16:47.063704+0000","last_became_active":"2024-09-19T04:14:40.404846+0000","last_became_peered":"2024-09-19T04:14:40.404846+0000","last_unstale":"2024-09-19T04:16:47.063704+0000","last_undegraded":"2024-09-19T04:16:47.063704+0000","last_fullsized":"2024-09-19T04:16:47.063704+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:49.842644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057711+0000","last_change":"2024-09-19T04:14:33.305796+0000","last_active":"2024-09-19T04:16:47.057711+0000","last_peered":"2024-09-19T04:16:47.057711+0000","last_clean":"2024-09-19T04:16:47.057711+0000","last_became_active":"2024-09-19T04:14:33.305499+0000","last_became_peered":"2024-09-19T04:14:33.305499+0000","last_unstale":"2024-09-19T04:16:47.057711+0000","last_undegraded":"2024-09-19T04:16:47.057711+0000","last_fullsized":"2024-09-19T04:16:47.057711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:08.357655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.059737+0000","last_change":"2024-09-19T04:14:31.322459+0000","last_active":"2024-09-19T04:16:47.059737+0000","last_peered":"2024-09-19T04:16:47.059737+0000","last_clean":"2024-09-19T04:16:47.059737+0000","last_became_active":"2024-09-19T04:14:31.322149+0000","last_became_peered":"2024-09-19T04:14:31.322149+0000","last_unstale":"2024-09-19T04:16:47.059737+0000","last_undegraded":"2024-09-19T04:16:47.059737+0000","last_fullsized":"2024-09-19T04:16:47.059737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:06:15.208618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.061247+0000","last_change":"2024-09-19T04:14:40.372869+0000","last_active":"2024-09-19T04:16:47.061247+0000","last_peered":"2024-09-19T04:16:47.061247+0000","last_clean":"2024-09-19T04:16:47.061247+0000","last_became_active":"2024-09-19T04:14:40.372203+0000","last_became_peered":"2024-09-19T04:14:40.372203+0000","last_unstale":"2024-09-19T04:16:47.061247+0000","last_undegraded":"2024-09-19T04:16:47.061247+0000","last_fullsized":"2024-09-19T04:16:47.061247+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:34.900656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"88'4","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.136056+0000","last_change":"2024-09-19T04:14:33.315443+0000","last_active":"2024-09-19T04:16:47.136056+0000","last_peered":"2024-09-19T04:16:47.136056+0000","last_clean":"2024-09-19T04:16:47.136056+0000","last_became_active":"2024-09-19T04:14:33.315067+0000","last_became_peered":"2024-09-19T04:14:33.315067+0000","last_unstale":"2024-09-19T04:16:47.136056+0000","last_undegraded":"2024-09-19T04:16:47.136056+0000","last_fullsized":"2024-09-19T04:16:47.136056+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:59.194674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.135801+0000","last_change":"2024-09-19T04:14:31.322623+0000","last_active":"2024-09-19T04:16:47.135801+0000","last_peered":"2024-09-19T04:16:47.135801+0000","last_clean":"2024-09-19T04:16:47.135801+0000","last_became_active":"2024-09-19T04:14:31.321838+0000","last_became_peered":"2024-09-19T04:14:31.321838+0000","last_unstale":"2024-09-19T04:16:47.135801+0000","last_undegraded":"2024-09-19T04:16:47.135801+0000","last_fullsized":"2024-09-19T04:16:47.135801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:30:37.073072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.059147+0000","last_change":"2024-09-19T04:15:47.343430+0000","last_active":"2024-09-19T04:16:47.059147+0000","last_peered":"2024-09-19T04:16:47.059147+0000","last_clean":"2024-09-19T04:16:47.059147+0000","last_became_active":"2024-09-19T04:15:47.342319+0000","last_became_peered":"2024-09-19T04:15:47.342319+0000","last_unstale":"2024-09-19T04:16:47.059147+0000","last_undegraded":"2024-09-19T04:16:47.059147+0000","last_fullsized":"2024-09-19T04:16:47.059147+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:05.641357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.136056+0000","last_change":"2024-09-19T04:14:33.319748+0000","last_active":"2024-09-19T04:16:47.136056+0000","last_peered":"2024-09-19T04:16:47.136056+0000","last_clean":"2024-09-19T04:16:47.136056+0000","last_became_active":"2024-09-19T04:14:33.319173+0000","last_became_peered":"2024-09-19T04:14:33.319173+0000","last_unstale":"2024-09-19T04:16:47.136056+0000","last_undegraded":"2024-09-19T04:16:47.136056+0000","last_fullsized":"2024-09-19T04:16:47.136056+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:24.419811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'7","reported_seq":145,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:51.955586+0000","last_change":"2024-09-19T04:14:31.292077+0000","last_active":"2024-09-19T04:16:51.955586+0000","last_peered":"2024-09-19T04:16:51.955586+0000","last_clean":"2024-09-19T04:16:51.955586+0000","last_became_active":"2024-09-19T04:14:31.291737+0000","last_became_peered":"2024-09-19T04:14:31.291737+0000","last_unstale":"2024-09-19T04:16:51.955586+0000","last_undegraded":"2024-09-19T04:16:51.955586+0000","last_fullsized":"2024-09-19T04:16:51.955586+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:32.570641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057613+0000","last_change":"2024-09-19T04:14:40.369734+0000","last_active":"2024-09-19T04:16:47.057613+0000","last_peered":"2024-09-19T04:16:47.057613+0000","last_clean":"2024-09-19T04:16:47.057613+0000","last_became_active":"2024-09-19T04:14:40.367563+0000","last_became_peered":"2024-09-19T04:14:40.367563+0000","last_unstale":"2024-09-19T04:16:47.057613+0000","last_undegraded":"2024-09-19T04:16:47.057613+0000","last_fullsized":"2024-09-19T04:16:47.057613+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:47.229115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063672+0000","last_change":"2024-09-19T04:14:33.309687+0000","last_active":"2024-09-19T04:16:47.063672+0000","last_peered":"2024-09-19T04:16:47.063672+0000","last_clean":"2024-09-19T04:16:47.063672+0000","last_became_active":"2024-09-19T04:14:33.308692+0000","last_became_peered":"2024-09-19T04:14:33.308692+0000","last_unstale":"2024-09-19T04:16:47.063672+0000","last_undegraded":"2024-09-19T04:16:47.063672+0000","last_fullsized":"2024-09-19T04:16:47.063672+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:58.716927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'6","reported_seq":141,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:50.977895+0000","last_change":"2024-09-19T04:14:31.322024+0000","last_active":"2024-09-19T04:16:50.977895+0000","last_peered":"2024-09-19T04:16:50.977895+0000","last_clean":"2024-09-19T04:16:50.977895+0000","last_became_active":"2024-09-19T04:14:31.321640+0000","last_became_peered":"2024-09-19T04:14:31.321640+0000","last_unstale":"2024-09-19T04:16:50.977895+0000","last_undegraded":"2024-09-19T04:16:50.977895+0000","last_fullsized":"2024-09-19T04:16:50.977895+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:25:36.159774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057744+0000","last_change":"2024-09-19T04:14:40.405793+0000","last_active":"2024-09-19T04:16:47.057744+0000","last_peered":"2024-09-19T04:16:47.057744+0000","last_clean":"2024-09-19T04:16:47.057744+0000","last_became_active":"2024-09-19T04:14:40.405354+0000","last_became_peered":"2024-09-19T04:14:40.405354+0000","last_unstale":"2024-09-19T04:16:47.057744+0000","last_undegraded":"2024-09-19T04:16:47.057744+0000","last_fullsized":"2024-09-19T04:16:47.057744+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:46:37.893202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057180+0000","last_change":"2024-09-19T04:14:33.313007+0000","last_active":"2024-09-19T04:16:47.057180+0000","last_peered":"2024-09-19T04:16:47.057180+0000","last_clean":"2024-09-19T04:16:47.057180+0000","last_became_active":"2024-09-19T04:14:33.312665+0000","last_became_peered":"2024-09-19T04:14:33.312665+0000","last_unstale":"2024-09-19T04:16:47.057180+0000","last_undegraded":"2024-09-19T04:16:47.057180+0000","last_fullsized":"2024-09-19T04:16:47.057180+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:09.976707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067276+0000","last_change":"2024-09-19T04:14:31.294072+0000","last_active":"2024-09-19T04:16:47.067276+0000","last_peered":"2024-09-19T04:16:47.067276+0000","last_clean":"2024-09-19T04:16:47.067276+0000","last_became_active":"2024-09-19T04:14:31.293648+0000","last_became_peered":"2024-09-19T04:14:31.293648+0000","last_unstale":"2024-09-19T04:16:47.067276+0000","last_undegraded":"2024-09-19T04:16:47.067276+0000","last_fullsized":"2024-09-19T04:16:47.067276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:14.910714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.065167+0000","last_change":"2024-09-19T04:14:40.406327+0000","last_active":"2024-09-19T04:16:47.065167+0000","last_peered":"2024-09-19T04:16:47.065167+0000","last_clean":"2024-09-19T04:16:47.065167+0000","last_became_active":"2024-09-19T04:14:40.405602+0000","last_became_peered":"2024-09-19T04:14:40.405602+0000","last_unstale":"2024-09-19T04:16:47.065167+0000","last_undegraded":"2024-09-19T04:16:47.065167+0000","last_fullsized":"2024-09-19T04:16:47.065167+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:47:23.078480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.135349+0000","last_change":"2024-09-19T04:15:47.342605+0000","last_active":"2024-09-19T04:16:47.135349+0000","last_peered":"2024-09-19T04:16:47.135349+0000","last_clean":"2024-09-19T04:16:47.135349+0000","last_became_active":"2024-09-19T04:15:47.342215+0000","last_became_peered":"2024-09-19T04:15:47.342215+0000","last_unstale":"2024-09-19T04:16:47.135349+0000","last_undegraded":"2024-09-19T04:16:47.135349+0000","last_fullsized":"2024-09-19T04:16:47.135349+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:01.315513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,1],"acting":[9,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058993+0000","last_change":"2024-09-19T04:14:31.290207+0000","last_active":"2024-09-19T04:16:47.058993+0000","last_peered":"2024-09-19T04:16:47.058993+0000","last_clean":"2024-09-19T04:16:47.058993+0000","last_became_active":"2024-09-19T04:14:31.289863+0000","last_became_peered":"2024-09-19T04:14:31.289863+0000","last_unstale":"2024-09-19T04:16:47.058993+0000","last_undegraded":"2024-09-19T04:16:47.058993+0000","last_fullsized":"2024-09-19T04:16:47.058993+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:39.241894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":351,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067362+0000","last_change":"2024-09-19T04:13:20.845240+0000","last_active":"2024-09-19T04:16:47.067362+0000","last_peered":"2024-09-19T04:16:47.067362+0000","last_clean":"2024-09-19T04:16:47.067362+0000","last_became_active":"2024-09-19T04:13:20.844771+0000","last_became_peered":"2024-09-19T04:13:20.844771+0000","last_unstale":"2024-09-19T04:16:47.067362+0000","last_undegraded":"2024-09-19T04:16:47.067362+0000","last_fullsized":"2024-09-19T04:16:47.067362+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:09:59.809148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:09:59.809148+0000","last_clean_scrub_stamp":"2024-09-19T04:09:59.809148+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:12:29.694263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067926+0000","last_change":"2024-09-19T04:14:40.369257+0000","last_active":"2024-09-19T04:16:47.067926+0000","last_peered":"2024-09-19T04:16:47.067926+0000","last_clean":"2024-09-19T04:16:47.067926+0000","last_became_active":"2024-09-19T04:14:40.368865+0000","last_became_peered":"2024-09-19T04:14:40.368865+0000","last_unstale":"2024-09-19T04:16:47.067926+0000","last_undegraded":"2024-09-19T04:16:47.067926+0000","last_fullsized":"2024-09-19T04:16:47.067926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:37:52.120157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.068065+0000","last_change":"2024-09-19T04:14:33.311221+0000","last_active":"2024-09-19T04:16:47.068065+0000","last_peered":"2024-09-19T04:16:47.068065+0000","last_clean":"2024-09-19T04:16:47.068065+0000","last_became_active":"2024-09-19T04:14:33.310886+0000","last_became_peered":"2024-09-19T04:14:33.310886+0000","last_unstale":"2024-09-19T04:16:47.068065+0000","last_undegraded":"2024-09-19T04:16:47.068065+0000","last_fullsized":"2024-09-19T04:16:47.068065+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:04:32.348676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":143,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:52.992256+0000","last_change":"2024-09-19T04:14:31.322464+0000","last_active":"2024-09-19T04:16:52.992256+0000","last_peered":"2024-09-19T04:16:52.992256+0000","last_clean":"2024-09-19T04:16:52.992256+0000","last_became_active":"2024-09-19T04:14:31.322115+0000","last_became_peered":"2024-09-19T04:14:31.322115+0000","last_unstale":"2024-09-19T04:16:52.992256+0000","last_undegraded":"2024-09-19T04:16:52.992256+0000","last_fullsized":"2024-09-19T04:16:52.992256+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:24:27.623328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063926+0000","last_change":"2024-09-19T04:14:40.371391+0000","last_active":"2024-09-19T04:16:47.063926+0000","last_peered":"2024-09-19T04:16:47.063926+0000","last_clean":"2024-09-19T04:16:47.063926+0000","last_became_active":"2024-09-19T04:14:40.371091+0000","last_became_peered":"2024-09-19T04:14:40.371091+0000","last_unstale":"2024-09-19T04:16:47.063926+0000","last_undegraded":"2024-09-19T04:16:47.063926+0000","last_fullsized":"2024-09-19T04:16:47.063926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:39:14.889348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"88'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067617+0000","last_change":"2024-09-19T04:15:47.003652+0000","last_active":"2024-09-19T04:16:47.067617+0000","last_peered":"2024-09-19T04:16:47.067617+0000","last_clean":"2024-09-19T04:16:47.067617+0000","last_became_active":"2024-09-19T04:15:47.003226+0000","last_became_peered":"2024-09-19T04:15:47.003226+0000","last_unstale":"2024-09-19T04:16:47.067617+0000","last_undegraded":"2024-09-19T04:16:47.067617+0000","last_fullsized":"2024-09-19T04:16:47.067617+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:38.948427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.065509+0000","last_change":"2024-09-19T04:14:31.293156+0000","last_active":"2024-09-19T04:16:47.065509+0000","last_peered":"2024-09-19T04:16:47.065509+0000","last_clean":"2024-09-19T04:16:47.065509+0000","last_became_active":"2024-09-19T04:14:31.292772+0000","last_became_peered":"2024-09-19T04:14:31.292772+0000","last_unstale":"2024-09-19T04:16:47.065509+0000","last_undegraded":"2024-09-19T04:16:47.065509+0000","last_fullsized":"2024-09-19T04:16:47.065509+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:03:18.530662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.570714+0000","last_change":"2024-09-19T04:14:40.371434+0000","last_active":"2024-09-19T04:16:47.570714+0000","last_peered":"2024-09-19T04:16:47.570714+0000","last_clean":"2024-09-19T04:16:47.570714+0000","last_became_active":"2024-09-19T04:14:40.371037+0000","last_became_peered":"2024-09-19T04:14:40.371037+0000","last_unstale":"2024-09-19T04:16:47.570714+0000","last_undegraded":"2024-09-19T04:16:47.570714+0000","last_fullsized":"2024-09-19T04:16:47.570714+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:43:34.787860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067852+0000","last_change":"2024-09-19T04:14:33.308321+0000","last_active":"2024-09-19T04:16:47.067852+0000","last_peered":"2024-09-19T04:16:47.067852+0000","last_clean":"2024-09-19T04:16:47.067852+0000","last_became_active":"2024-09-19T04:14:33.307983+0000","last_became_peered":"2024-09-19T04:14:33.307983+0000","last_unstale":"2024-09-19T04:16:47.067852+0000","last_undegraded":"2024-09-19T04:16:47.067852+0000","last_fullsized":"2024-09-19T04:16:47.067852+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:46.202123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057834+0000","last_change":"2024-09-19T04:14:31.297326+0000","last_active":"2024-09-19T04:16:47.057834+0000","last_peered":"2024-09-19T04:16:47.057834+0000","last_clean":"2024-09-19T04:16:47.057834+0000","last_became_active":"2024-09-19T04:14:31.297056+0000","last_became_peered":"2024-09-19T04:14:31.297056+0000","last_unstale":"2024-09-19T04:16:47.057834+0000","last_undegraded":"2024-09-19T04:16:47.057834+0000","last_fullsized":"2024-09-19T04:16:47.057834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:15:26.324855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063512+0000","last_change":"2024-09-19T04:14:40.370123+0000","last_active":"2024-09-19T04:16:47.063512+0000","last_peered":"2024-09-19T04:16:47.063512+0000","last_clean":"2024-09-19T04:16:47.063512+0000","last_became_active":"2024-09-19T04:14:40.367758+0000","last_became_peered":"2024-09-19T04:14:40.367758+0000","last_unstale":"2024-09-19T04:16:47.063512+0000","last_undegraded":"2024-09-19T04:16:47.063512+0000","last_fullsized":"2024-09-19T04:16:47.063512+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:07.932122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.061501+0000","last_change":"2024-09-19T04:14:33.314239+0000","last_active":"2024-09-19T04:16:47.061501+0000","last_peered":"2024-09-19T04:16:47.061501+0000","last_clean":"2024-09-19T04:16:47.061501+0000","last_became_active":"2024-09-19T04:14:33.313918+0000","last_became_peered":"2024-09-19T04:14:33.313918+0000","last_unstale":"2024-09-19T04:16:47.061501+0000","last_undegraded":"2024-09-19T04:16:47.061501+0000","last_fullsized":"2024-09-19T04:16:47.061501+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:00:12.756505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.059564+0000","last_change":"2024-09-19T04:14:31.295377+0000","last_active":"2024-09-19T04:16:47.059564+0000","last_peered":"2024-09-19T04:16:47.059564+0000","last_clean":"2024-09-19T04:16:47.059564+0000","last_became_active":"2024-09-19T04:14:31.295042+0000","last_became_peered":"2024-09-19T04:14:31.295042+0000","last_unstale":"2024-09-19T04:16:47.059564+0000","last_undegraded":"2024-09-19T04:16:47.059564+0000","last_fullsized":"2024-09-19T04:16:47.059564+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:35.842847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063698+0000","last_change":"2024-09-19T04:14:40.370790+0000","last_active":"2024-09-19T04:16:47.063698+0000","last_peered":"2024-09-19T04:16:47.063698+0000","last_clean":"2024-09-19T04:16:47.063698+0000","last_became_active":"2024-09-19T04:14:40.370377+0000","last_became_peered":"2024-09-19T04:14:40.370377+0000","last_unstale":"2024-09-19T04:16:47.063698+0000","last_undegraded":"2024-09-19T04:16:47.063698+0000","last_fullsized":"2024-09-19T04:16:47.063698+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:09.331769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063823+0000","last_change":"2024-09-19T04:15:47.342260+0000","last_active":"2024-09-19T04:16:47.063823+0000","last_peered":"2024-09-19T04:16:47.063823+0000","last_clean":"2024-09-19T04:16:47.063823+0000","last_became_active":"2024-09-19T04:15:47.341713+0000","last_became_peered":"2024-09-19T04:15:47.341713+0000","last_unstale":"2024-09-19T04:16:47.063823+0000","last_undegraded":"2024-09-19T04:16:47.063823+0000","last_fullsized":"2024-09-19T04:16:47.063823+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:25:47.822844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":57,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.059020+0000","last_change":"2024-09-19T04:14:31.322413+0000","last_active":"2024-09-19T04:16:47.059020+0000","last_peered":"2024-09-19T04:16:47.059020+0000","last_clean":"2024-09-19T04:16:47.059020+0000","last_became_active":"2024-09-19T04:14:31.322082+0000","last_became_peered":"2024-09-19T04:14:31.322082+0000","last_unstale":"2024-09-19T04:16:47.059020+0000","last_undegraded":"2024-09-19T04:16:47.059020+0000","last_fullsized":"2024-09-19T04:16:47.059020+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:50.010021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057771+0000","last_change":"2024-09-19T04:14:40.373071+0000","last_active":"2024-09-19T04:16:47.057771+0000","last_peered":"2024-09-19T04:16:47.057771+0000","last_clean":"2024-09-19T04:16:47.057771+0000","last_became_active":"2024-09-19T04:14:40.372679+0000","last_became_peered":"2024-09-19T04:14:40.372679+0000","last_unstale":"2024-09-19T04:16:47.057771+0000","last_undegraded":"2024-09-19T04:16:47.057771+0000","last_fullsized":"2024-09-19T04:16:47.057771+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:23.136807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067239+0000","last_change":"2024-09-19T04:14:33.319165+0000","last_active":"2024-09-19T04:16:47.067239+0000","last_peered":"2024-09-19T04:16:47.067239+0000","last_clean":"2024-09-19T04:16:47.067239+0000","last_became_active":"2024-09-19T04:14:33.318830+0000","last_became_peered":"2024-09-19T04:14:33.318830+0000","last_unstale":"2024-09-19T04:16:47.067239+0000","last_undegraded":"2024-09-19T04:16:47.067239+0000","last_fullsized":"2024-09-19T04:16:47.067239+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:05:43.936069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'7","reported_seq":146,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:52.981638+0000","last_change":"2024-09-19T04:14:31.291564+0000","last_active":"2024-09-19T04:16:52.981638+0000","last_peered":"2024-09-19T04:16:52.981638+0000","last_clean":"2024-09-19T04:16:52.981638+0000","last_became_active":"2024-09-19T04:14:31.291241+0000","last_became_peered":"2024-09-19T04:14:31.291241+0000","last_unstale":"2024-09-19T04:16:52.981638+0000","last_undegraded":"2024-09-19T04:16:52.981638+0000","last_fullsized":"2024-09-19T04:16:52.981638+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:38:09.419140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.135728+0000","last_change":"2024-09-19T04:14:40.371707+0000","last_active":"2024-09-19T04:16:47.135728+0000","last_peered":"2024-09-19T04:16:47.135728+0000","last_clean":"2024-09-19T04:16:47.135728+0000","last_became_active":"2024-09-19T04:14:40.370767+0000","last_became_peered":"2024-09-19T04:14:40.370767+0000","last_unstale":"2024-09-19T04:16:47.135728+0000","last_undegraded":"2024-09-19T04:16:47.135728+0000","last_fullsized":"2024-09-19T04:16:47.135728+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:38.022486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067584+0000","last_change":"2024-09-19T04:14:33.316098+0000","last_active":"2024-09-19T04:16:47.067584+0000","last_peered":"2024-09-19T04:16:47.067584+0000","last_clean":"2024-09-19T04:16:47.067584+0000","last_became_active":"2024-09-19T04:14:33.315755+0000","last_became_peered":"2024-09-19T04:14:33.315755+0000","last_unstale":"2024-09-19T04:16:47.067584+0000","last_undegraded":"2024-09-19T04:16:47.067584+0000","last_fullsized":"2024-09-19T04:16:47.067584+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:45:01.531200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.065848+0000","last_change":"2024-09-19T04:14:31.291145+0000","last_active":"2024-09-19T04:16:47.065848+0000","last_peered":"2024-09-19T04:16:47.065848+0000","last_clean":"2024-09-19T04:16:47.065848+0000","last_became_active":"2024-09-19T04:14:31.290763+0000","last_became_peered":"2024-09-19T04:14:31.290763+0000","last_unstale":"2024-09-19T04:16:47.065848+0000","last_undegraded":"2024-09-19T04:16:47.065848+0000","last_fullsized":"2024-09-19T04:16:47.065848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:37.556544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.061681+0000","last_change":"2024-09-19T04:14:40.371371+0000","last_active":"2024-09-19T04:16:47.061681+0000","last_peered":"2024-09-19T04:16:47.061681+0000","last_clean":"2024-09-19T04:16:47.061681+0000","last_became_active":"2024-09-19T04:14:40.370988+0000","last_became_peered":"2024-09-19T04:14:40.370988+0000","last_unstale":"2024-09-19T04:16:47.061681+0000","last_undegraded":"2024-09-19T04:16:47.061681+0000","last_fullsized":"2024-09-19T04:16:47.061681+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:57.089953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057403+0000","last_change":"2024-09-19T04:15:47.003980+0000","last_active":"2024-09-19T04:16:47.057403+0000","last_peered":"2024-09-19T04:16:47.057403+0000","last_clean":"2024-09-19T04:16:47.057403+0000","last_became_active":"2024-09-19T04:15:47.003573+0000","last_became_peered":"2024-09-19T04:15:47.003573+0000","last_unstale":"2024-09-19T04:16:47.057403+0000","last_undegraded":"2024-09-19T04:16:47.057403+0000","last_fullsized":"2024-09-19T04:16:47.057403+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:35:12.971378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063280+0000","last_change":"2024-09-19T04:14:31.297106+0000","last_active":"2024-09-19T04:16:47.063280+0000","last_peered":"2024-09-19T04:16:47.063280+0000","last_clean":"2024-09-19T04:16:47.063280+0000","last_became_active":"2024-09-19T04:14:31.296688+0000","last_became_peered":"2024-09-19T04:14:31.296688+0000","last_unstale":"2024-09-19T04:16:47.063280+0000","last_undegraded":"2024-09-19T04:16:47.063280+0000","last_fullsized":"2024-09-19T04:16:47.063280+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:18.882219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064088+0000","last_change":"2024-09-19T04:14:40.371641+0000","last_active":"2024-09-19T04:16:47.064088+0000","last_peered":"2024-09-19T04:16:47.064088+0000","last_clean":"2024-09-19T04:16:47.064088+0000","last_became_active":"2024-09-19T04:14:40.370354+0000","last_became_peered":"2024-09-19T04:14:40.370354+0000","last_unstale":"2024-09-19T04:16:47.064088+0000","last_undegraded":"2024-09-19T04:16:47.064088+0000","last_fullsized":"2024-09-19T04:16:47.064088+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:01:11.572011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.059488+0000","last_change":"2024-09-19T04:14:33.307767+0000","last_active":"2024-09-19T04:16:47.059488+0000","last_peered":"2024-09-19T04:16:47.059488+0000","last_clean":"2024-09-19T04:16:47.059488+0000","last_became_active":"2024-09-19T04:14:33.307396+0000","last_became_peered":"2024-09-19T04:14:33.307396+0000","last_unstale":"2024-09-19T04:16:47.059488+0000","last_undegraded":"2024-09-19T04:16:47.059488+0000","last_fullsized":"2024-09-19T04:16:47.059488+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:21.018641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'39","reported_seq":279,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:52.074593+0000","last_change":"2024-09-19T04:14:31.298106+0000","last_active":"2024-09-19T04:16:52.074593+0000","last_peered":"2024-09-19T04:16:52.074593+0000","last_clean":"2024-09-19T04:16:52.074593+0000","last_became_active":"2024-09-19T04:14:31.297731+0000","last_became_peered":"2024-09-19T04:14:31.297731+0000","last_unstale":"2024-09-19T04:16:52.074593+0000","last_undegraded":"2024-09-19T04:16:52.074593+0000","last_fullsized":"2024-09-19T04:16:52.074593+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:29.127759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64871,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":201,"num_read_kb":164,"num_write":41,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.135577+0000","last_change":"2024-09-19T04:14:40.372927+0000","last_active":"2024-09-19T04:16:47.135577+0000","last_peered":"2024-09-19T04:16:47.135577+0000","last_clean":"2024-09-19T04:16:47.135577+0000","last_became_active":"2024-09-19T04:14:40.372521+0000","last_became_peered":"2024-09-19T04:14:40.372521+0000","last_unstale":"2024-09-19T04:16:47.135577+0000","last_undegraded":"2024-09-19T04:16:47.135577+0000","last_fullsized":"2024-09-19T04:16:47.135577+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:15:00.863812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063722+0000","last_change":"2024-09-19T04:14:33.308154+0000","last_active":"2024-09-19T04:16:47.063722+0000","last_peered":"2024-09-19T04:16:47.063722+0000","last_clean":"2024-09-19T04:16:47.063722+0000","last_became_active":"2024-09-19T04:14:33.307831+0000","last_became_peered":"2024-09-19T04:14:33.307831+0000","last_unstale":"2024-09-19T04:16:47.063722+0000","last_undegraded":"2024-09-19T04:16:47.063722+0000","last_fullsized":"2024-09-19T04:16:47.063722+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:16:14.656133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064634+0000","last_change":"2024-09-19T04:14:31.324011+0000","last_active":"2024-09-19T04:16:47.064634+0000","last_peered":"2024-09-19T04:16:47.064634+0000","last_clean":"2024-09-19T04:16:47.064634+0000","last_became_active":"2024-09-19T04:14:31.323622+0000","last_became_peered":"2024-09-19T04:14:31.323622+0000","last_unstale":"2024-09-19T04:16:47.064634+0000","last_undegraded":"2024-09-19T04:16:47.064634+0000","last_fullsized":"2024-09-19T04:16:47.064634+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:39.198602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058635+0000","last_change":"2024-09-19T04:14:40.365938+0000","last_active":"2024-09-19T04:16:47.058635+0000","last_peered":"2024-09-19T04:16:47.058635+0000","last_clean":"2024-09-19T04:16:47.058635+0000","last_became_active":"2024-09-19T04:14:40.365539+0000","last_became_peered":"2024-09-19T04:14:40.365539+0000","last_unstale":"2024-09-19T04:16:47.058635+0000","last_undegraded":"2024-09-19T04:16:47.058635+0000","last_fullsized":"2024-09-19T04:16:47.058635+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:09.723008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.571075+0000","last_change":"2024-09-19T04:14:33.316286+0000","last_active":"2024-09-19T04:16:47.571075+0000","last_peered":"2024-09-19T04:16:47.571075+0000","last_clean":"2024-09-19T04:16:47.571075+0000","last_became_active":"2024-09-19T04:14:33.315980+0000","last_became_peered":"2024-09-19T04:14:33.315980+0000","last_unstale":"2024-09-19T04:16:47.571075+0000","last_undegraded":"2024-09-19T04:16:47.571075+0000","last_fullsized":"2024-09-19T04:16:47.571075+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:58.383139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067783+0000","last_change":"2024-09-19T04:14:31.299111+0000","last_active":"2024-09-19T04:16:47.067783+0000","last_peered":"2024-09-19T04:16:47.067783+0000","last_clean":"2024-09-19T04:16:47.067783+0000","last_became_active":"2024-09-19T04:14:31.298390+0000","last_became_peered":"2024-09-19T04:14:31.298390+0000","last_unstale":"2024-09-19T04:16:47.067783+0000","last_undegraded":"2024-09-19T04:16:47.067783+0000","last_fullsized":"2024-09-19T04:16:47.067783+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:39.710412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.135278+0000","last_change":"2024-09-19T04:14:40.371108+0000","last_active":"2024-09-19T04:16:47.135278+0000","last_peered":"2024-09-19T04:16:47.135278+0000","last_clean":"2024-09-19T04:16:47.135278+0000","last_became_active":"2024-09-19T04:14:40.370729+0000","last_became_peered":"2024-09-19T04:14:40.370729+0000","last_unstale":"2024-09-19T04:16:47.135278+0000","last_undegraded":"2024-09-19T04:16:47.135278+0000","last_fullsized":"2024-09-19T04:16:47.135278+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:59.610235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064001+0000","last_change":"2024-09-19T04:14:33.314423+0000","last_active":"2024-09-19T04:16:47.064001+0000","last_peered":"2024-09-19T04:16:47.064001+0000","last_clean":"2024-09-19T04:16:47.064001+0000","last_became_active":"2024-09-19T04:14:33.314123+0000","last_became_peered":"2024-09-19T04:14:33.314123+0000","last_unstale":"2024-09-19T04:16:47.064001+0000","last_undegraded":"2024-09-19T04:16:47.064001+0000","last_fullsized":"2024-09-19T04:16:47.064001+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:29:57.781116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":232,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:51.989508+0000","last_change":"2024-09-19T04:14:31.293267+0000","last_active":"2024-09-19T04:16:51.989508+0000","last_peered":"2024-09-19T04:16:51.989508+0000","last_clean":"2024-09-19T04:16:51.989508+0000","last_became_active":"2024-09-19T04:14:31.292862+0000","last_became_peered":"2024-09-19T04:14:31.292862+0000","last_unstale":"2024-09-19T04:16:51.989508+0000","last_undegraded":"2024-09-19T04:16:51.989508+0000","last_fullsized":"2024-09-19T04:16:51.989508+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:37.876696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":190,"num_read_kb":190,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063338+0000","last_change":"2024-09-19T04:14:40.373078+0000","last_active":"2024-09-19T04:16:47.063338+0000","last_peered":"2024-09-19T04:16:47.063338+0000","last_clean":"2024-09-19T04:16:47.063338+0000","last_became_active":"2024-09-19T04:14:40.372468+0000","last_became_peered":"2024-09-19T04:14:40.372468+0000","last_unstale":"2024-09-19T04:16:47.063338+0000","last_undegraded":"2024-09-19T04:16:47.063338+0000","last_fullsized":"2024-09-19T04:16:47.063338+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:54.945801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.570776+0000","last_change":"2024-09-19T04:14:40.368946+0000","last_active":"2024-09-19T04:16:47.570776+0000","last_peered":"2024-09-19T04:16:47.570776+0000","last_clean":"2024-09-19T04:16:47.570776+0000","last_became_active":"2024-09-19T04:14:40.368549+0000","last_became_peered":"2024-09-19T04:14:40.368549+0000","last_unstale":"2024-09-19T04:16:47.570776+0000","last_undegraded":"2024-09-19T04:16:47.570776+0000","last_fullsized":"2024-09-19T04:16:47.570776+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:24.563488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.135349+0000","last_change":"2024-09-19T04:14:33.307214+0000","last_active":"2024-09-19T04:16:47.135349+0000","last_peered":"2024-09-19T04:16:47.135349+0000","last_clean":"2024-09-19T04:16:47.135349+0000","last_became_active":"2024-09-19T04:14:33.306913+0000","last_became_peered":"2024-09-19T04:14:33.306913+0000","last_unstale":"2024-09-19T04:16:47.135349+0000","last_undegraded":"2024-09-19T04:16:47.135349+0000","last_fullsized":"2024-09-19T04:16:47.135349+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:49.402532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063845+0000","last_change":"2024-09-19T04:14:31.294488+0000","last_active":"2024-09-19T04:16:47.063845+0000","last_peered":"2024-09-19T04:16:47.063845+0000","last_clean":"2024-09-19T04:16:47.063845+0000","last_became_active":"2024-09-19T04:14:31.294145+0000","last_became_peered":"2024-09-19T04:14:31.294145+0000","last_unstale":"2024-09-19T04:16:47.063845+0000","last_undegraded":"2024-09-19T04:16:47.063845+0000","last_fullsized":"2024-09-19T04:16:47.063845+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:28:19.411650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.061366+0000","last_change":"2024-09-19T04:14:40.372366+0000","last_active":"2024-09-19T04:16:47.061366+0000","last_peered":"2024-09-19T04:16:47.061366+0000","last_clean":"2024-09-19T04:16:47.061366+0000","last_became_active":"2024-09-19T04:14:40.371922+0000","last_became_peered":"2024-09-19T04:14:40.371922+0000","last_unstale":"2024-09-19T04:16:47.061366+0000","last_undegraded":"2024-09-19T04:16:47.061366+0000","last_fullsized":"2024-09-19T04:16:47.061366+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:55:01.724088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063646+0000","last_change":"2024-09-19T04:14:33.308351+0000","last_active":"2024-09-19T04:16:47.063646+0000","last_peered":"2024-09-19T04:16:47.063646+0000","last_clean":"2024-09-19T04:16:47.063646+0000","last_became_active":"2024-09-19T04:14:33.308052+0000","last_became_peered":"2024-09-19T04:14:33.308052+0000","last_unstale":"2024-09-19T04:16:47.063646+0000","last_undegraded":"2024-09-19T04:16:47.063646+0000","last_fullsized":"2024-09-19T04:16:47.063646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:06:32.056738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057232+0000","last_change":"2024-09-19T04:14:31.291742+0000","last_active":"2024-09-19T04:16:47.057232+0000","last_peered":"2024-09-19T04:16:47.057232+0000","last_clean":"2024-09-19T04:16:47.057232+0000","last_became_active":"2024-09-19T04:14:31.291315+0000","last_became_peered":"2024-09-19T04:14:31.291315+0000","last_unstale":"2024-09-19T04:16:47.057232+0000","last_undegraded":"2024-09-19T04:16:47.057232+0000","last_fullsized":"2024-09-19T04:16:47.057232+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:16.159276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.136189+0000","last_change":"2024-09-19T04:14:31.293898+0000","last_active":"2024-09-19T04:16:47.136189+0000","last_peered":"2024-09-19T04:16:47.136189+0000","last_clean":"2024-09-19T04:16:47.136189+0000","last_became_active":"2024-09-19T04:14:31.293499+0000","last_became_peered":"2024-09-19T04:14:31.293499+0000","last_unstale":"2024-09-19T04:16:47.136189+0000","last_undegraded":"2024-09-19T04:16:47.136189+0000","last_fullsized":"2024-09-19T04:16:47.136189+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:25:55.590644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064005+0000","last_change":"2024-09-19T04:14:33.314094+0000","last_active":"2024-09-19T04:16:47.064005+0000","last_peered":"2024-09-19T04:16:47.064005+0000","last_clean":"2024-09-19T04:16:47.064005+0000","last_became_active":"2024-09-19T04:14:33.312782+0000","last_became_peered":"2024-09-19T04:14:33.312782+0000","last_unstale":"2024-09-19T04:16:47.064005+0000","last_undegraded":"2024-09-19T04:16:47.064005+0000","last_fullsized":"2024-09-19T04:16:47.064005+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:40.121676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.062592+0000","last_change":"2024-09-19T04:14:40.369159+0000","last_active":"2024-09-19T04:16:47.062592+0000","last_peered":"2024-09-19T04:16:47.062592+0000","last_clean":"2024-09-19T04:16:47.062592+0000","last_became_active":"2024-09-19T04:14:40.368732+0000","last_became_peered":"2024-09-19T04:14:40.368732+0000","last_unstale":"2024-09-19T04:16:47.062592+0000","last_undegraded":"2024-09-19T04:16:47.062592+0000","last_fullsized":"2024-09-19T04:16:47.062592+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:12:29.176834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":152,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:51.075285+0000","last_change":"2024-09-19T04:16:47.072639+0000","last_active":"2024-09-19T04:16:51.075285+0000","last_peered":"2024-09-19T04:16:51.075285+0000","last_clean":"2024-09-19T04:16:51.075285+0000","last_became_active":"2024-09-19T04:16:47.068508+0000","last_became_peered":"2024-09-19T04:16:47.068508+0000","last_unstale":"2024-09-19T04:16:51.075285+0000","last_undegraded":"2024-09-19T04:16:51.075285+0000","last_fullsized":"2024-09-19T04:16:51.075285+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:43.540304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":90,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.059276+0000","last_change":"2024-09-19T04:14:33.300555+0000","last_active":"2024-09-19T04:16:47.059276+0000","last_peered":"2024-09-19T04:16:47.059276+0000","last_clean":"2024-09-19T04:16:47.059276+0000","last_became_active":"2024-09-19T04:14:33.300220+0000","last_became_peered":"2024-09-19T04:14:33.300220+0000","last_unstale":"2024-09-19T04:16:47.059276+0000","last_undegraded":"2024-09-19T04:16:47.059276+0000","last_fullsized":"2024-09-19T04:16:47.059276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:32.584140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.137653+0000","last_change":"2024-09-19T04:16:47.137653+0000","last_active":"2024-09-19T04:16:47.137653+0000","last_peered":"2024-09-19T04:16:47.137653+0000","last_clean":"2024-09-19T04:16:47.137653+0000","last_became_active":"2024-09-19T04:16:47.137087+0000","last_became_peered":"2024-09-19T04:16:47.137087+0000","last_unstale":"2024-09-19T04:16:47.137653+0000","last_undegraded":"2024-09-19T04:16:47.137653+0000","last_fullsized":"2024-09-19T04:16:47.137653+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:31.312087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,7,11],"acting":[2,10,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.060868+0000","last_change":"2024-09-19T04:14:33.312801+0000","last_active":"2024-09-19T04:16:47.060868+0000","last_peered":"2024-09-19T04:16:47.060868+0000","last_clean":"2024-09-19T04:16:47.060868+0000","last_became_active":"2024-09-19T04:14:33.312430+0000","last_became_peered":"2024-09-19T04:14:33.312430+0000","last_unstale":"2024-09-19T04:16:47.060868+0000","last_undegraded":"2024-09-19T04:16:47.060868+0000","last_fullsized":"2024-09-19T04:16:47.060868+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:29.069507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063851+0000","last_change":"2024-09-19T04:14:33.313076+0000","last_active":"2024-09-19T04:16:47.063851+0000","last_peered":"2024-09-19T04:16:47.063851+0000","last_clean":"2024-09-19T04:16:47.063851+0000","last_became_active":"2024-09-19T04:14:33.312730+0000","last_became_peered":"2024-09-19T04:14:33.312730+0000","last_unstale":"2024-09-19T04:16:47.063851+0000","last_undegraded":"2024-09-19T04:16:47.063851+0000","last_fullsized":"2024-09-19T04:16:47.063851+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:33.397309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063194+0000","last_change":"2024-09-19T04:14:33.314724+0000","last_active":"2024-09-19T04:16:47.063194+0000","last_peered":"2024-09-19T04:16:47.063194+0000","last_clean":"2024-09-19T04:16:47.063194+0000","last_became_active":"2024-09-19T04:14:33.314359+0000","last_became_peered":"2024-09-19T04:14:33.314359+0000","last_unstale":"2024-09-19T04:16:47.063194+0000","last_undegraded":"2024-09-19T04:16:47.063194+0000","last_fullsized":"2024-09-19T04:16:47.063194+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:37:39.357193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.570754+0000","last_change":"2024-09-19T04:14:33.312834+0000","last_active":"2024-09-19T04:16:47.570754+0000","last_peered":"2024-09-19T04:16:47.570754+0000","last_clean":"2024-09-19T04:16:47.570754+0000","last_became_active":"2024-09-19T04:14:33.312538+0000","last_became_peered":"2024-09-19T04:14:33.312538+0000","last_unstale":"2024-09-19T04:16:47.570754+0000","last_undegraded":"2024-09-19T04:16:47.570754+0000","last_fullsized":"2024-09-19T04:16:47.570754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:25:37.694910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057648+0000","last_change":"2024-09-19T04:14:33.305735+0000","last_active":"2024-09-19T04:16:47.057648+0000","last_peered":"2024-09-19T04:16:47.057648+0000","last_clean":"2024-09-19T04:16:47.057648+0000","last_became_active":"2024-09-19T04:14:33.305415+0000","last_became_peered":"2024-09-19T04:14:33.305415+0000","last_unstale":"2024-09-19T04:16:47.057648+0000","last_undegraded":"2024-09-19T04:16:47.057648+0000","last_fullsized":"2024-09-19T04:16:47.057648+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:20.160211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.061663+0000","last_change":"2024-09-19T04:14:33.313379+0000","last_active":"2024-09-19T04:16:47.061663+0000","last_peered":"2024-09-19T04:16:47.061663+0000","last_clean":"2024-09-19T04:16:47.061663+0000","last_became_active":"2024-09-19T04:14:33.312453+0000","last_became_peered":"2024-09-19T04:14:33.312453+0000","last_unstale":"2024-09-19T04:16:47.061663+0000","last_undegraded":"2024-09-19T04:16:47.061663+0000","last_fullsized":"2024-09-19T04:16:47.061663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:44.832004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063977+0000","last_change":"2024-09-19T04:14:33.307371+0000","last_active":"2024-09-19T04:16:47.063977+0000","last_peered":"2024-09-19T04:16:47.063977+0000","last_clean":"2024-09-19T04:16:47.063977+0000","last_became_active":"2024-09-19T04:14:33.307033+0000","last_became_peered":"2024-09-19T04:14:33.307033+0000","last_unstale":"2024-09-19T04:16:47.063977+0000","last_undegraded":"2024-09-19T04:16:47.063977+0000","last_fullsized":"2024-09-19T04:16:47.063977+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:12.027213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064150+0000","last_change":"2024-09-19T04:15:47.342412+0000","last_active":"2024-09-19T04:16:47.064150+0000","last_peered":"2024-09-19T04:16:47.064150+0000","last_clean":"2024-09-19T04:16:47.064150+0000","last_became_active":"2024-09-19T04:15:47.341989+0000","last_became_peered":"2024-09-19T04:15:47.341989+0000","last_unstale":"2024-09-19T04:16:47.064150+0000","last_undegraded":"2024-09-19T04:16:47.064150+0000","last_fullsized":"2024-09-19T04:16:47.064150+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:32.713199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063980+0000","last_change":"2024-09-19T04:14:33.314296+0000","last_active":"2024-09-19T04:16:47.063980+0000","last_peered":"2024-09-19T04:16:47.063980+0000","last_clean":"2024-09-19T04:16:47.063980+0000","last_became_active":"2024-09-19T04:14:33.311230+0000","last_became_peered":"2024-09-19T04:14:33.311230+0000","last_unstale":"2024-09-19T04:16:47.063980+0000","last_undegraded":"2024-09-19T04:16:47.063980+0000","last_fullsized":"2024-09-19T04:16:47.063980+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:37:51.395086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063485+0000","last_change":"2024-09-19T04:14:33.317125+0000","last_active":"2024-09-19T04:16:47.063485+0000","last_peered":"2024-09-19T04:16:47.063485+0000","last_clean":"2024-09-19T04:16:47.063485+0000","last_became_active":"2024-09-19T04:14:33.316805+0000","last_became_peered":"2024-09-19T04:14:33.316805+0000","last_unstale":"2024-09-19T04:16:47.063485+0000","last_undegraded":"2024-09-19T04:16:47.063485+0000","last_fullsized":"2024-09-19T04:16:47.063485+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:27.754882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063974+0000","last_change":"2024-09-19T04:14:33.310081+0000","last_active":"2024-09-19T04:16:47.063974+0000","last_peered":"2024-09-19T04:16:47.063974+0000","last_clean":"2024-09-19T04:16:47.063974+0000","last_became_active":"2024-09-19T04:14:33.308675+0000","last_became_peered":"2024-09-19T04:14:33.308675+0000","last_unstale":"2024-09-19T04:16:47.063974+0000","last_undegraded":"2024-09-19T04:16:47.063974+0000","last_fullsized":"2024-09-19T04:16:47.063974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:58.187633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057611+0000","last_change":"2024-09-19T04:14:33.308220+0000","last_active":"2024-09-19T04:16:47.057611+0000","last_peered":"2024-09-19T04:16:47.057611+0000","last_clean":"2024-09-19T04:16:47.057611+0000","last_became_active":"2024-09-19T04:14:33.307934+0000","last_became_peered":"2024-09-19T04:14:33.307934+0000","last_unstale":"2024-09-19T04:16:47.057611+0000","last_undegraded":"2024-09-19T04:16:47.057611+0000","last_fullsized":"2024-09-19T04:16:47.057611+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:22.490250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.062008+0000","last_change":"2024-09-19T04:14:33.306617+0000","last_active":"2024-09-19T04:16:47.062008+0000","last_peered":"2024-09-19T04:16:47.062008+0000","last_clean":"2024-09-19T04:16:47.062008+0000","last_became_active":"2024-09-19T04:14:33.306244+0000","last_became_peered":"2024-09-19T04:14:33.306244+0000","last_unstale":"2024-09-19T04:16:47.062008+0000","last_undegraded":"2024-09-19T04:16:47.062008+0000","last_fullsized":"2024-09-19T04:16:47.062008+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:22.095989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063298+0000","last_change":"2024-09-19T04:14:33.314915+0000","last_active":"2024-09-19T04:16:47.063298+0000","last_peered":"2024-09-19T04:16:47.063298+0000","last_clean":"2024-09-19T04:16:47.063298+0000","last_became_active":"2024-09-19T04:14:33.314601+0000","last_became_peered":"2024-09-19T04:14:33.314601+0000","last_unstale":"2024-09-19T04:16:47.063298+0000","last_undegraded":"2024-09-19T04:16:47.063298+0000","last_fullsized":"2024-09-19T04:16:47.063298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:37.687964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.135920+0000","last_change":"2024-09-19T04:14:33.304667+0000","last_active":"2024-09-19T04:16:47.135920+0000","last_peered":"2024-09-19T04:16:47.135920+0000","last_clean":"2024-09-19T04:16:47.135920+0000","last_became_active":"2024-09-19T04:14:33.304356+0000","last_became_peered":"2024-09-19T04:14:33.304356+0000","last_unstale":"2024-09-19T04:16:47.135920+0000","last_undegraded":"2024-09-19T04:16:47.135920+0000","last_fullsized":"2024-09-19T04:16:47.135920+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:37.128074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.061919+0000","last_change":"2024-09-19T04:14:33.310002+0000","last_active":"2024-09-19T04:16:47.061919+0000","last_peered":"2024-09-19T04:16:47.061919+0000","last_clean":"2024-09-19T04:16:47.061919+0000","last_became_active":"2024-09-19T04:14:33.309639+0000","last_became_peered":"2024-09-19T04:14:33.309639+0000","last_unstale":"2024-09-19T04:16:47.061919+0000","last_undegraded":"2024-09-19T04:16:47.061919+0000","last_fullsized":"2024-09-19T04:16:47.061919+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:21.954435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063291+0000","last_change":"2024-09-19T04:14:33.307296+0000","last_active":"2024-09-19T04:16:47.063291+0000","last_peered":"2024-09-19T04:16:47.063291+0000","last_clean":"2024-09-19T04:16:47.063291+0000","last_became_active":"2024-09-19T04:14:33.306998+0000","last_became_peered":"2024-09-19T04:14:33.306998+0000","last_unstale":"2024-09-19T04:16:47.063291+0000","last_undegraded":"2024-09-19T04:16:47.063291+0000","last_fullsized":"2024-09-19T04:16:47.063291+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:55.833196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.570628+0000","last_change":"2024-09-19T04:14:33.313568+0000","last_active":"2024-09-19T04:16:47.570628+0000","last_peered":"2024-09-19T04:16:47.570628+0000","last_clean":"2024-09-19T04:16:47.570628+0000","last_became_active":"2024-09-19T04:14:33.313228+0000","last_became_peered":"2024-09-19T04:14:33.313228+0000","last_unstale":"2024-09-19T04:16:47.570628+0000","last_undegraded":"2024-09-19T04:16:47.570628+0000","last_fullsized":"2024-09-19T04:16:47.570628+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:31:43.348866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.570568+0000","last_change":"2024-09-19T04:14:33.309745+0000","last_active":"2024-09-19T04:16:47.570568+0000","last_peered":"2024-09-19T04:16:47.570568+0000","last_clean":"2024-09-19T04:16:47.570568+0000","last_became_active":"2024-09-19T04:14:33.309327+0000","last_became_peered":"2024-09-19T04:14:33.309327+0000","last_unstale":"2024-09-19T04:16:47.570568+0000","last_undegraded":"2024-09-19T04:16:47.570568+0000","last_fullsized":"2024-09-19T04:16:47.570568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:05.081550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057516+0000","last_change":"2024-09-19T04:14:33.306186+0000","last_active":"2024-09-19T04:16:47.057516+0000","last_peered":"2024-09-19T04:16:47.057516+0000","last_clean":"2024-09-19T04:16:47.057516+0000","last_became_active":"2024-09-19T04:14:33.305865+0000","last_became_peered":"2024-09-19T04:14:33.305865+0000","last_unstale":"2024-09-19T04:16:47.057516+0000","last_undegraded":"2024-09-19T04:16:47.057516+0000","last_fullsized":"2024-09-19T04:16:47.057516+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:33.054326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058719+0000","last_change":"2024-09-19T04:14:33.307667+0000","last_active":"2024-09-19T04:16:47.058719+0000","last_peered":"2024-09-19T04:16:47.058719+0000","last_clean":"2024-09-19T04:16:47.058719+0000","last_became_active":"2024-09-19T04:14:33.307315+0000","last_became_peered":"2024-09-19T04:14:33.307315+0000","last_unstale":"2024-09-19T04:16:47.058719+0000","last_undegraded":"2024-09-19T04:16:47.058719+0000","last_fullsized":"2024-09-19T04:16:47.058719+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:52.209438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067897+0000","last_change":"2024-09-19T04:14:33.312430+0000","last_active":"2024-09-19T04:16:47.067897+0000","last_peered":"2024-09-19T04:16:47.067897+0000","last_clean":"2024-09-19T04:16:47.067897+0000","last_became_active":"2024-09-19T04:14:33.311786+0000","last_became_peered":"2024-09-19T04:14:33.311786+0000","last_unstale":"2024-09-19T04:16:47.067897+0000","last_undegraded":"2024-09-19T04:16:47.067897+0000","last_fullsized":"2024-09-19T04:16:47.067897+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:17:25.785612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.136502+0000","last_change":"2024-09-19T04:14:33.310478+0000","last_active":"2024-09-19T04:16:47.136502+0000","last_peered":"2024-09-19T04:16:47.136502+0000","last_clean":"2024-09-19T04:16:47.136502+0000","last_became_active":"2024-09-19T04:14:33.309960+0000","last_became_peered":"2024-09-19T04:14:33.309960+0000","last_unstale":"2024-09-19T04:16:47.136502+0000","last_undegraded":"2024-09-19T04:16:47.136502+0000","last_fullsized":"2024-09-19T04:16:47.136502+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:37:43.008022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064009+0000","last_change":"2024-09-19T04:14:33.312449+0000","last_active":"2024-09-19T04:16:47.064009+0000","last_peered":"2024-09-19T04:16:47.064009+0000","last_clean":"2024-09-19T04:16:47.064009+0000","last_became_active":"2024-09-19T04:14:33.312124+0000","last_became_peered":"2024-09-19T04:14:33.312124+0000","last_unstale":"2024-09-19T04:16:47.064009+0000","last_undegraded":"2024-09-19T04:16:47.064009+0000","last_fullsized":"2024-09-19T04:16:47.064009+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:53.556895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063525+0000","last_change":"2024-09-19T04:14:33.317095+0000","last_active":"2024-09-19T04:16:47.063525+0000","last_peered":"2024-09-19T04:16:47.063525+0000","last_clean":"2024-09-19T04:16:47.063525+0000","last_became_active":"2024-09-19T04:14:33.316763+0000","last_became_peered":"2024-09-19T04:14:33.316763+0000","last_unstale":"2024-09-19T04:16:47.063525+0000","last_undegraded":"2024-09-19T04:16:47.063525+0000","last_fullsized":"2024-09-19T04:16:47.063525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:14.894679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067254+0000","last_change":"2024-09-19T04:14:33.316578+0000","last_active":"2024-09-19T04:16:47.067254+0000","last_peered":"2024-09-19T04:16:47.067254+0000","last_clean":"2024-09-19T04:16:47.067254+0000","last_became_active":"2024-09-19T04:14:33.316215+0000","last_became_peered":"2024-09-19T04:14:33.316215+0000","last_unstale":"2024-09-19T04:16:47.067254+0000","last_undegraded":"2024-09-19T04:16:47.067254+0000","last_fullsized":"2024-09-19T04:16:47.067254+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:18.770360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.136155+0000","last_change":"2024-09-19T04:15:47.000540+0000","last_active":"2024-09-19T04:16:47.136155+0000","last_peered":"2024-09-19T04:16:47.136155+0000","last_clean":"2024-09-19T04:16:47.136155+0000","last_became_active":"2024-09-19T04:15:47.000155+0000","last_became_peered":"2024-09-19T04:15:47.000155+0000","last_unstale":"2024-09-19T04:16:47.136155+0000","last_undegraded":"2024-09-19T04:16:47.136155+0000","last_fullsized":"2024-09-19T04:16:47.136155+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:19.055366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.059133+0000","last_change":"2024-09-19T04:14:33.309468+0000","last_active":"2024-09-19T04:16:47.059133+0000","last_peered":"2024-09-19T04:16:47.059133+0000","last_clean":"2024-09-19T04:16:47.059133+0000","last_became_active":"2024-09-19T04:14:33.309164+0000","last_became_peered":"2024-09-19T04:14:33.309164+0000","last_unstale":"2024-09-19T04:16:47.059133+0000","last_undegraded":"2024-09-19T04:16:47.059133+0000","last_fullsized":"2024-09-19T04:16:47.059133+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:05:19.193395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.135491+0000","last_change":"2024-09-19T04:15:47.342502+0000","last_active":"2024-09-19T04:16:47.135491+0000","last_peered":"2024-09-19T04:16:47.135491+0000","last_clean":"2024-09-19T04:16:47.135491+0000","last_became_active":"2024-09-19T04:15:47.342127+0000","last_became_peered":"2024-09-19T04:15:47.342127+0000","last_unstale":"2024-09-19T04:16:47.135491+0000","last_undegraded":"2024-09-19T04:16:47.135491+0000","last_fullsized":"2024-09-19T04:16:47.135491+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:47.192614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.570756+0000","last_change":"2024-09-19T04:14:33.308268+0000","last_active":"2024-09-19T04:16:47.570756+0000","last_peered":"2024-09-19T04:16:47.570756+0000","last_clean":"2024-09-19T04:16:47.570756+0000","last_became_active":"2024-09-19T04:14:33.307945+0000","last_became_peered":"2024-09-19T04:14:33.307945+0000","last_unstale":"2024-09-19T04:16:47.570756+0000","last_undegraded":"2024-09-19T04:16:47.570756+0000","last_fullsized":"2024-09-19T04:16:47.570756+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:24.410351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.570902+0000","last_change":"2024-09-19T04:14:33.315522+0000","last_active":"2024-09-19T04:16:47.570902+0000","last_peered":"2024-09-19T04:16:47.570902+0000","last_clean":"2024-09-19T04:16:47.570902+0000","last_became_active":"2024-09-19T04:14:33.315220+0000","last_became_peered":"2024-09-19T04:14:33.315220+0000","last_unstale":"2024-09-19T04:16:47.570902+0000","last_undegraded":"2024-09-19T04:16:47.570902+0000","last_fullsized":"2024-09-19T04:16:47.570902+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:41:40.915933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"88'8","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.061734+0000","last_change":"2024-09-19T04:14:33.309450+0000","last_active":"2024-09-19T04:16:47.061734+0000","last_peered":"2024-09-19T04:16:47.061734+0000","last_clean":"2024-09-19T04:16:47.061734+0000","last_became_active":"2024-09-19T04:14:33.309013+0000","last_became_peered":"2024-09-19T04:14:33.309013+0000","last_unstale":"2024-09-19T04:16:47.061734+0000","last_undegraded":"2024-09-19T04:16:47.061734+0000","last_fullsized":"2024-09-19T04:16:47.061734+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:49.523372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72361,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":992,"num_read_kb":578,"num_write":260,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1204,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":217083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285207,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579946,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1003520,"data_stored":516143,"data_compressed":29678,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808879,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28156,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716996,"statfs":{"total":95995035648,"available":95966203904,"internally_reserved":0,"allocated":1150976,"data_stored":1167782,"data_compressed":65942,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972404,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1028096,"data_stored":519587,"data_compressed":29678,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201336,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32184,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712968,"statfs":{"total":95995035648,"available":95962079232,"internally_reserved":0,"allocated":1015808,"data_stored":515287,"data_compressed":29678,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430269,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1073152,"data_stored":1113043,"data_compressed":65942,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593795,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":999424,"data_stored":511529,"data_compressed":29678,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822728,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1081344,"data_stored":1107557,"data_compressed":65942,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986252,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1015808,"data_stored":516225,"data_compressed":29678,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215185,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1011712,"data_stored":510703,"data_compressed":29678,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411415,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1081344,"data_stored":576494,"data_compressed":29678,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1069056,"data_stored":577430,"data_compressed":29678,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738465,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1024000,"data_stored":512451,"data_compressed":29678,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34629,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34629,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34629,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":67157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":66221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":67141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T04:16:59.225 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T04:16:59.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:59 smithi102 ceph-mon[35446]: pgmap v356: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 709 B/s wr, 10 op/s; 119 B/s, 0 objects/s recovering 2024-09-19T04:16:59.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:16:59 smithi102 ceph-mon[35446]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:16:59.486 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:16:59.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:59 smithi092 ceph-mon[34940]: pgmap v356: 129 pgs: 129 active+clean; 647 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 709 B/s wr, 10 op/s; 119 B/s, 0 objects/s recovering 2024-09-19T04:16:59.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:16:59 smithi092 ceph-mon[34940]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:16:59.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.957+0000 7f2782721640 1 -- 172.21.15.7:0/2427170015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f277c106a80 msgr2=0x7f277c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:59.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.957+0000 7f2782721640 1 --2- 172.21.15.7:0/2427170015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f277c106a80 0x7f277c106e60 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f276c009930 tx=0x7f276c02a420 comp rx=0 tx=0).stop 2024-09-19T04:16:59.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.957+0000 7f2782721640 1 -- 172.21.15.7:0/2427170015 shutdown_connections 2024-09-19T04:16:59.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.957+0000 7f2782721640 1 --2- 172.21.15.7:0/2427170015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f277c101420 0x7f277c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:59.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.957+0000 7f2782721640 1 --2- 172.21.15.7:0/2427170015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f277c100a80 0x7f277c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:59.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.957+0000 7f2782721640 1 --2- 172.21.15.7:0/2427170015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f277c106a80 0x7f277c106e60 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:59.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.957+0000 7f2782721640 1 -- 172.21.15.7:0/2427170015 >> 172.21.15.7:0/2427170015 conn(0x7f277c0fc7a0 msgr2=0x7f277c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:16:59.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.957+0000 7f2782721640 1 -- 172.21.15.7:0/2427170015 shutdown_connections 2024-09-19T04:16:59.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.957+0000 7f2782721640 1 -- 172.21.15.7:0/2427170015 wait complete. 2024-09-19T04:16:59.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.958+0000 7f2782721640 1 Processor -- start 2024-09-19T04:16:59.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.958+0000 7f2782721640 1 -- start start 2024-09-19T04:16:59.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.958+0000 7f2782721640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f277c100a80 0x7f277c197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:59.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.958+0000 7f2782721640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f277c101420 0x7f277c1978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:59.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.958+0000 7f2782721640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f277c106a80 0x7f277c19bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:59.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.958+0000 7f2782721640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f277c110e40 con 0x7f277c100a80 2024-09-19T04:16:59.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.958+0000 7f2782721640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f277c110cc0 con 0x7f277c106a80 2024-09-19T04:16:59.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.958+0000 7f2782721640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f277c110fc0 con 0x7f277c101420 2024-09-19T04:16:59.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.959+0000 7f277bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f277c100a80 0x7f277c197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:59.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.959+0000 7f277bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f277c100a80 0x7f277c197380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57778/0 (socket says 172.21.15.7:57778) 2024-09-19T04:16:59.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.959+0000 7f277bfff640 1 -- 172.21.15.7:0/1969159561 learned_addr learned my addr 172.21.15.7:0/1969159561 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:16:59.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.959+0000 7f2780cbe640 1 --2- 172.21.15.7:0/1969159561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f277c106a80 0x7f277c19bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:59.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.959+0000 7f2773fff640 1 --2- 172.21.15.7:0/1969159561 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f277c101420 0x7f277c1978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:59.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.959+0000 7f277bfff640 1 -- 172.21.15.7:0/1969159561 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f277c101420 msgr2=0x7f277c1978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:59.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.959+0000 7f277bfff640 1 --2- 172.21.15.7:0/1969159561 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f277c101420 0x7f277c1978c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:59.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.959+0000 7f277bfff640 1 -- 172.21.15.7:0/1969159561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f277c106a80 msgr2=0x7f277c19bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:16:59.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.959+0000 7f277bfff640 1 --2- 172.21.15.7:0/1969159561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f277c106a80 0x7f277c19bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:16:59.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.959+0000 7f277bfff640 1 -- 172.21.15.7:0/1969159561 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f277c19c330 con 0x7f277c100a80 2024-09-19T04:16:59.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.959+0000 7f277bfff640 1 --2- 172.21.15.7:0/1969159561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f277c100a80 0x7f277c197380 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f276c009230 tx=0x7f276c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:59.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.959+0000 7f2779ffb640 1 -- 172.21.15.7:0/1969159561 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c03f030 con 0x7f277c100a80 2024-09-19T04:16:59.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.959+0000 7f2779ffb640 1 -- 172.21.15.7:0/1969159561 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f276c003ad0 con 0x7f277c100a80 2024-09-19T04:16:59.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.959+0000 7f2782721640 1 -- 172.21.15.7:0/1969159561 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f277c19c5c0 con 0x7f277c100a80 2024-09-19T04:16:59.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.959+0000 7f2779ffb640 1 -- 172.21.15.7:0/1969159561 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c035070 con 0x7f277c100a80 2024-09-19T04:16:59.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.959+0000 7f2782721640 1 -- 172.21.15.7:0/1969159561 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f277c1a3f00 con 0x7f277c100a80 2024-09-19T04:16:59.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.960+0000 7f2782721640 1 -- 172.21.15.7:0/1969159561 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f277c100ee0 con 0x7f277c100a80 2024-09-19T04:16:59.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.961+0000 7f2779ffb640 1 -- 172.21.15.7:0/1969159561 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f276c042030 con 0x7f277c100a80 2024-09-19T04:16:59.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.962+0000 7f2779ffb640 1 --2- 172.21.15.7:0/1969159561 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f27680a32c0 0x7f27680a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:16:59.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.962+0000 7f2773fff640 1 --2- 172.21.15.7:0/1969159561 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f27680a32c0 0x7f27680a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:16:59.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.962+0000 7f2779ffb640 1 -- 172.21.15.7:0/1969159561 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f276c0eff60 con 0x7f277c100a80 2024-09-19T04:16:59.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.963+0000 7f2773fff640 1 --2- 172.21.15.7:0/1969159561 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f27680a32c0 0x7f27680a5780 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f277c0fedd0 tx=0x7f276400b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:16:59.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:16:59.967+0000 7f2779ffb640 1 -- 172.21.15.7:0/1969159561 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f276c0bc870 con 0x7f277c100a80 2024-09-19T04:17:00.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:00.110+0000 7f2779ffb640 1 -- 172.21.15.7:0/1969159561 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f276c003c80 con 0x7f277c100a80 2024-09-19T04:17:00.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:00 smithi007 ceph-mon[31360]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:17:00.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:00.144+0000 7f2782721640 1 -- 172.21.15.7:0/1969159561 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f277c109060 con 0x7f27680a32c0 2024-09-19T04:17:00.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:00.152+0000 7f2779ffb640 1 -- 172.21.15.7:0/1969159561 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340816 (secure 0 0 0) 0x7f276400b340 con 0x7f27680a32c0 2024-09-19T04:17:00.160 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:17:00.162 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-19T04:17:00.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:00.156+0000 7f2782721640 1 -- 172.21.15.7:0/1969159561 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f27680a32c0 msgr2=0x7f27680a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:00.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:00.156+0000 7f2782721640 1 --2- 172.21.15.7:0/1969159561 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f27680a32c0 0x7f27680a5780 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f277c0fedd0 tx=0x7f276400b590 comp rx=0 tx=0).stop 2024-09-19T04:17:00.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:00.156+0000 7f2782721640 1 -- 172.21.15.7:0/1969159561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f277c100a80 msgr2=0x7f277c197380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:00.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:00.156+0000 7f2782721640 1 --2- 172.21.15.7:0/1969159561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f277c100a80 0x7f277c197380 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f276c009230 tx=0x7f276c004270 comp rx=0 tx=0).stop 2024-09-19T04:17:00.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:00.156+0000 7f2782721640 1 -- 172.21.15.7:0/1969159561 shutdown_connections 2024-09-19T04:17:00.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:00.156+0000 7f2782721640 1 --2- 172.21.15.7:0/1969159561 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f27680a32c0 0x7f27680a5780 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:00.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:00.156+0000 7f2782721640 1 --2- 172.21.15.7:0/1969159561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f277c106a80 0x7f277c19bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:00.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:00.156+0000 7f2782721640 1 --2- 172.21.15.7:0/1969159561 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f277c101420 0x7f277c1978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:00.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:00.156+0000 7f2782721640 1 --2- 172.21.15.7:0/1969159561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f277c100a80 0x7f277c197380 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:00.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:00.156+0000 7f2782721640 1 -- 172.21.15.7:0/1969159561 >> 172.21.15.7:0/1969159561 conn(0x7f277c0fc7a0 msgr2=0x7f277c0fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:00.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:00.156+0000 7f2782721640 1 -- 172.21.15.7:0/1969159561 shutdown_connections 2024-09-19T04:17:00.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:00.156+0000 7f2782721640 1 -- 172.21.15.7:0/1969159561 wait complete. 2024-09-19T04:17:00.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:00 smithi102 ceph-mon[35446]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:17:00.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:00 smithi092 ceph-mon[34940]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:17:00.786 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":357,"stamp":"2024-09-19T04:16:59.156795+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":671592,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1166,"num_read_kb":715,"num_write":458,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1181940,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":874,"ondisk_log_size":874,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":357380,"kb_used_data":12260,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124584444,"statfs":{"total":1151940427776,"available":1151574470656,"internally_reserved":0,"allocated":12554240,"data_stored":8147343,"data_compressed":464928,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19141,"internal_metadata":353154363},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9160,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":80,"num_write":24,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1204,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003161"},"pg_stats":[{"pgid":"2.1f","version":"88'14","reported_seq":155,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:56.962226+0000","last_change":"2024-09-19T04:14:31.294836+0000","last_active":"2024-09-19T04:16:56.962226+0000","last_peered":"2024-09-19T04:16:56.962226+0000","last_clean":"2024-09-19T04:16:56.962226+0000","last_became_active":"2024-09-19T04:14:31.294589+0000","last_became_peered":"2024-09-19T04:14:31.294589+0000","last_unstale":"2024-09-19T04:16:56.962226+0000","last_undegraded":"2024-09-19T04:16:56.962226+0000","last_fullsized":"2024-09-19T04:16:56.962226+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:39:54.093519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063986+0000","last_change":"2024-09-19T04:14:33.316023+0000","last_active":"2024-09-19T04:16:47.063986+0000","last_peered":"2024-09-19T04:16:47.063986+0000","last_clean":"2024-09-19T04:16:47.063986+0000","last_became_active":"2024-09-19T04:14:33.315732+0000","last_became_peered":"2024-09-19T04:14:33.315732+0000","last_unstale":"2024-09-19T04:16:47.063986+0000","last_undegraded":"2024-09-19T04:16:47.063986+0000","last_fullsized":"2024-09-19T04:16:47.063986+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:00.782788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.062795+0000","last_change":"2024-09-19T04:14:40.368540+0000","last_active":"2024-09-19T04:16:47.062795+0000","last_peered":"2024-09-19T04:16:47.062795+0000","last_clean":"2024-09-19T04:16:47.062795+0000","last_became_active":"2024-09-19T04:14:40.367906+0000","last_became_peered":"2024-09-19T04:14:40.367906+0000","last_unstale":"2024-09-19T04:16:47.062795+0000","last_undegraded":"2024-09-19T04:16:47.062795+0000","last_fullsized":"2024-09-19T04:16:47.062795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:35.660297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064184+0000","last_change":"2024-09-19T04:14:31.321870+0000","last_active":"2024-09-19T04:16:47.064184+0000","last_peered":"2024-09-19T04:16:47.064184+0000","last_clean":"2024-09-19T04:16:47.064184+0000","last_became_active":"2024-09-19T04:14:31.321495+0000","last_became_peered":"2024-09-19T04:14:31.321495+0000","last_unstale":"2024-09-19T04:16:47.064184+0000","last_undegraded":"2024-09-19T04:16:47.064184+0000","last_fullsized":"2024-09-19T04:16:47.064184+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:58.063748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.571064+0000","last_change":"2024-09-19T04:14:33.307451+0000","last_active":"2024-09-19T04:16:47.571064+0000","last_peered":"2024-09-19T04:16:47.571064+0000","last_clean":"2024-09-19T04:16:47.571064+0000","last_became_active":"2024-09-19T04:14:33.307129+0000","last_became_peered":"2024-09-19T04:14:33.307129+0000","last_unstale":"2024-09-19T04:16:47.571064+0000","last_undegraded":"2024-09-19T04:16:47.571064+0000","last_fullsized":"2024-09-19T04:16:47.571064+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:28.851012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064923+0000","last_change":"2024-09-19T04:16:47.064923+0000","last_active":"2024-09-19T04:16:47.064923+0000","last_peered":"2024-09-19T04:16:47.064923+0000","last_clean":"2024-09-19T04:16:47.064923+0000","last_became_active":"2024-09-19T04:16:47.064455+0000","last_became_peered":"2024-09-19T04:16:47.064455+0000","last_unstale":"2024-09-19T04:16:47.064923+0000","last_undegraded":"2024-09-19T04:16:47.064923+0000","last_fullsized":"2024-09-19T04:16:47.064923+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:54.446799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'13","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.059712+0000","last_change":"2024-09-19T04:14:31.298497+0000","last_active":"2024-09-19T04:16:47.059712+0000","last_peered":"2024-09-19T04:16:47.059712+0000","last_clean":"2024-09-19T04:16:47.059712+0000","last_became_active":"2024-09-19T04:14:31.298185+0000","last_became_peered":"2024-09-19T04:14:31.298185+0000","last_unstale":"2024-09-19T04:16:47.059712+0000","last_undegraded":"2024-09-19T04:16:47.059712+0000","last_fullsized":"2024-09-19T04:16:47.059712+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:56:12.701718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063565+0000","last_change":"2024-09-19T04:14:33.316922+0000","last_active":"2024-09-19T04:16:47.063565+0000","last_peered":"2024-09-19T04:16:47.063565+0000","last_clean":"2024-09-19T04:16:47.063565+0000","last_became_active":"2024-09-19T04:14:33.316613+0000","last_became_peered":"2024-09-19T04:14:33.316613+0000","last_unstale":"2024-09-19T04:16:47.063565+0000","last_undegraded":"2024-09-19T04:16:47.063565+0000","last_fullsized":"2024-09-19T04:16:47.063565+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:22.237900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058493+0000","last_change":"2024-09-19T04:15:47.000772+0000","last_active":"2024-09-19T04:16:47.058493+0000","last_peered":"2024-09-19T04:16:47.058493+0000","last_clean":"2024-09-19T04:16:47.058493+0000","last_became_active":"2024-09-19T04:15:47.000316+0000","last_became_peered":"2024-09-19T04:15:47.000316+0000","last_unstale":"2024-09-19T04:16:47.058493+0000","last_undegraded":"2024-09-19T04:16:47.058493+0000","last_fullsized":"2024-09-19T04:16:47.058493+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:03.292714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.077203+0000","last_change":"2024-09-19T04:16:47.076757+0000","last_active":"2024-09-19T04:16:47.077203+0000","last_peered":"2024-09-19T04:16:47.077203+0000","last_clean":"2024-09-19T04:16:47.077203+0000","last_became_active":"2024-09-19T04:16:47.067225+0000","last_became_peered":"2024-09-19T04:16:47.067225+0000","last_unstale":"2024-09-19T04:16:47.077203+0000","last_undegraded":"2024-09-19T04:16:47.077203+0000","last_fullsized":"2024-09-19T04:16:47.077203+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:38.370696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064150+0000","last_change":"2024-09-19T04:14:33.313560+0000","last_active":"2024-09-19T04:16:47.064150+0000","last_peered":"2024-09-19T04:16:47.064150+0000","last_clean":"2024-09-19T04:16:47.064150+0000","last_became_active":"2024-09-19T04:14:33.313200+0000","last_became_peered":"2024-09-19T04:14:33.313200+0000","last_unstale":"2024-09-19T04:16:47.064150+0000","last_undegraded":"2024-09-19T04:16:47.064150+0000","last_fullsized":"2024-09-19T04:16:47.064150+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:33.807866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058389+0000","last_change":"2024-09-19T04:14:40.368125+0000","last_active":"2024-09-19T04:16:47.058389+0000","last_peered":"2024-09-19T04:16:47.058389+0000","last_clean":"2024-09-19T04:16:47.058389+0000","last_became_active":"2024-09-19T04:14:40.367772+0000","last_became_peered":"2024-09-19T04:14:40.367772+0000","last_unstale":"2024-09-19T04:16:47.058389+0000","last_undegraded":"2024-09-19T04:16:47.058389+0000","last_fullsized":"2024-09-19T04:16:47.058389+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:07:19.740391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067353+0000","last_change":"2024-09-19T04:14:33.307489+0000","last_active":"2024-09-19T04:16:47.067353+0000","last_peered":"2024-09-19T04:16:47.067353+0000","last_clean":"2024-09-19T04:16:47.067353+0000","last_became_active":"2024-09-19T04:14:33.307143+0000","last_became_peered":"2024-09-19T04:14:33.307143+0000","last_unstale":"2024-09-19T04:16:47.067353+0000","last_undegraded":"2024-09-19T04:16:47.067353+0000","last_fullsized":"2024-09-19T04:16:47.067353+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:51:14.018972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.059318+0000","last_change":"2024-09-19T04:14:31.299342+0000","last_active":"2024-09-19T04:16:47.059318+0000","last_peered":"2024-09-19T04:16:47.059318+0000","last_clean":"2024-09-19T04:16:47.059318+0000","last_became_active":"2024-09-19T04:14:31.298927+0000","last_became_peered":"2024-09-19T04:14:31.298927+0000","last_unstale":"2024-09-19T04:16:47.059318+0000","last_undegraded":"2024-09-19T04:16:47.059318+0000","last_fullsized":"2024-09-19T04:16:47.059318+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:38.483077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058702+0000","last_change":"2024-09-19T04:14:40.405762+0000","last_active":"2024-09-19T04:16:47.058702+0000","last_peered":"2024-09-19T04:16:47.058702+0000","last_clean":"2024-09-19T04:16:47.058702+0000","last_became_active":"2024-09-19T04:14:40.405379+0000","last_became_peered":"2024-09-19T04:14:40.405379+0000","last_unstale":"2024-09-19T04:16:47.058702+0000","last_undegraded":"2024-09-19T04:16:47.058702+0000","last_fullsized":"2024-09-19T04:16:47.058702+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:41:36.628112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063612+0000","last_change":"2024-09-19T04:14:33.318521+0000","last_active":"2024-09-19T04:16:47.063612+0000","last_peered":"2024-09-19T04:16:47.063612+0000","last_clean":"2024-09-19T04:16:47.063612+0000","last_became_active":"2024-09-19T04:14:33.318200+0000","last_became_peered":"2024-09-19T04:14:33.318200+0000","last_unstale":"2024-09-19T04:16:47.063612+0000","last_undegraded":"2024-09-19T04:16:47.063612+0000","last_fullsized":"2024-09-19T04:16:47.063612+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:45.497455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"90'4","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.966922+0000","last_change":"2024-09-19T04:16:47.071492+0000","last_active":"2024-09-19T04:16:47.966922+0000","last_peered":"2024-09-19T04:16:47.966922+0000","last_clean":"2024-09-19T04:16:47.966922+0000","last_became_active":"2024-09-19T04:16:47.066432+0000","last_became_peered":"2024-09-19T04:16:47.066432+0000","last_unstale":"2024-09-19T04:16:47.966922+0000","last_undegraded":"2024-09-19T04:16:47.966922+0000","last_fullsized":"2024-09-19T04:16:47.966922+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:33.096458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058887+0000","last_change":"2024-09-19T04:14:40.366110+0000","last_active":"2024-09-19T04:16:47.058887+0000","last_peered":"2024-09-19T04:16:47.058887+0000","last_clean":"2024-09-19T04:16:47.058887+0000","last_became_active":"2024-09-19T04:14:40.365558+0000","last_became_peered":"2024-09-19T04:14:40.365558+0000","last_unstale":"2024-09-19T04:16:47.058887+0000","last_undegraded":"2024-09-19T04:16:47.058887+0000","last_fullsized":"2024-09-19T04:16:47.058887+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:24.049603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.060993+0000","last_change":"2024-09-19T04:14:33.307400+0000","last_active":"2024-09-19T04:16:47.060993+0000","last_peered":"2024-09-19T04:16:47.060993+0000","last_clean":"2024-09-19T04:16:47.060993+0000","last_became_active":"2024-09-19T04:14:33.307095+0000","last_became_peered":"2024-09-19T04:14:33.307095+0000","last_unstale":"2024-09-19T04:16:47.060993+0000","last_undegraded":"2024-09-19T04:16:47.060993+0000","last_fullsized":"2024-09-19T04:16:47.060993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:27.582568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063516+0000","last_change":"2024-09-19T04:14:31.287190+0000","last_active":"2024-09-19T04:16:47.063516+0000","last_peered":"2024-09-19T04:16:47.063516+0000","last_clean":"2024-09-19T04:16:47.063516+0000","last_became_active":"2024-09-19T04:14:31.286817+0000","last_became_peered":"2024-09-19T04:14:31.286817+0000","last_unstale":"2024-09-19T04:16:47.063516+0000","last_undegraded":"2024-09-19T04:16:47.063516+0000","last_fullsized":"2024-09-19T04:16:47.063516+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:44.522615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.135735+0000","last_change":"2024-09-19T04:14:40.372153+0000","last_active":"2024-09-19T04:16:47.135735+0000","last_peered":"2024-09-19T04:16:47.135735+0000","last_clean":"2024-09-19T04:16:47.135735+0000","last_became_active":"2024-09-19T04:14:40.371309+0000","last_became_peered":"2024-09-19T04:14:40.371309+0000","last_unstale":"2024-09-19T04:16:47.135735+0000","last_undegraded":"2024-09-19T04:16:47.135735+0000","last_fullsized":"2024-09-19T04:16:47.135735+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:46.608489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058954+0000","last_change":"2024-09-19T04:14:33.310884+0000","last_active":"2024-09-19T04:16:47.058954+0000","last_peered":"2024-09-19T04:16:47.058954+0000","last_clean":"2024-09-19T04:16:47.058954+0000","last_became_active":"2024-09-19T04:14:33.310532+0000","last_became_peered":"2024-09-19T04:14:33.310532+0000","last_unstale":"2024-09-19T04:16:47.058954+0000","last_undegraded":"2024-09-19T04:16:47.058954+0000","last_fullsized":"2024-09-19T04:16:47.058954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:49:16.565018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063454+0000","last_change":"2024-09-19T04:14:31.322216+0000","last_active":"2024-09-19T04:16:47.063454+0000","last_peered":"2024-09-19T04:16:47.063454+0000","last_clean":"2024-09-19T04:16:47.063454+0000","last_became_active":"2024-09-19T04:14:31.321941+0000","last_became_peered":"2024-09-19T04:14:31.321941+0000","last_unstale":"2024-09-19T04:16:47.063454+0000","last_undegraded":"2024-09-19T04:16:47.063454+0000","last_fullsized":"2024-09-19T04:16:47.063454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:14.624104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058857+0000","last_change":"2024-09-19T04:14:40.405749+0000","last_active":"2024-09-19T04:16:47.058857+0000","last_peered":"2024-09-19T04:16:47.058857+0000","last_clean":"2024-09-19T04:16:47.058857+0000","last_became_active":"2024-09-19T04:14:40.405353+0000","last_became_peered":"2024-09-19T04:14:40.405353+0000","last_unstale":"2024-09-19T04:16:47.058857+0000","last_undegraded":"2024-09-19T04:16:47.058857+0000","last_fullsized":"2024-09-19T04:16:47.058857+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:13.311989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.571027+0000","last_change":"2024-09-19T04:14:33.312057+0000","last_active":"2024-09-19T04:16:47.571027+0000","last_peered":"2024-09-19T04:16:47.571027+0000","last_clean":"2024-09-19T04:16:47.571027+0000","last_became_active":"2024-09-19T04:14:33.311751+0000","last_became_peered":"2024-09-19T04:14:33.311751+0000","last_unstale":"2024-09-19T04:16:47.571027+0000","last_undegraded":"2024-09-19T04:16:47.571027+0000","last_fullsized":"2024-09-19T04:16:47.571027+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:28.843870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058939+0000","last_change":"2024-09-19T04:14:31.287529+0000","last_active":"2024-09-19T04:16:47.058939+0000","last_peered":"2024-09-19T04:16:47.058939+0000","last_clean":"2024-09-19T04:16:47.058939+0000","last_became_active":"2024-09-19T04:14:31.287172+0000","last_became_peered":"2024-09-19T04:14:31.287172+0000","last_unstale":"2024-09-19T04:16:47.058939+0000","last_undegraded":"2024-09-19T04:16:47.058939+0000","last_fullsized":"2024-09-19T04:16:47.058939+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:32:23.351997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063528+0000","last_change":"2024-09-19T04:14:40.363772+0000","last_active":"2024-09-19T04:16:47.063528+0000","last_peered":"2024-09-19T04:16:47.063528+0000","last_clean":"2024-09-19T04:16:47.063528+0000","last_became_active":"2024-09-19T04:14:40.363395+0000","last_became_peered":"2024-09-19T04:14:40.363395+0000","last_unstale":"2024-09-19T04:16:47.063528+0000","last_undegraded":"2024-09-19T04:16:47.063528+0000","last_fullsized":"2024-09-19T04:16:47.063528+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:22.090743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064210+0000","last_change":"2024-09-19T04:14:33.310108+0000","last_active":"2024-09-19T04:16:47.064210+0000","last_peered":"2024-09-19T04:16:47.064210+0000","last_clean":"2024-09-19T04:16:47.064210+0000","last_became_active":"2024-09-19T04:14:33.309812+0000","last_became_peered":"2024-09-19T04:14:33.309812+0000","last_unstale":"2024-09-19T04:16:47.064210+0000","last_undegraded":"2024-09-19T04:16:47.064210+0000","last_fullsized":"2024-09-19T04:16:47.064210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:48.570530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'19","reported_seq":58,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:56.346828+0000","last_change":"2024-09-19T04:14:31.293115+0000","last_active":"2024-09-19T04:16:56.346828+0000","last_peered":"2024-09-19T04:16:56.346828+0000","last_clean":"2024-09-19T04:16:56.346828+0000","last_became_active":"2024-09-19T04:14:31.292733+0000","last_became_peered":"2024-09-19T04:14:31.292733+0000","last_unstale":"2024-09-19T04:16:56.346828+0000","last_undegraded":"2024-09-19T04:16:56.346828+0000","last_fullsized":"2024-09-19T04:16:56.346828+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:11.936757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063704+0000","last_change":"2024-09-19T04:14:40.405241+0000","last_active":"2024-09-19T04:16:47.063704+0000","last_peered":"2024-09-19T04:16:47.063704+0000","last_clean":"2024-09-19T04:16:47.063704+0000","last_became_active":"2024-09-19T04:14:40.404846+0000","last_became_peered":"2024-09-19T04:14:40.404846+0000","last_unstale":"2024-09-19T04:16:47.063704+0000","last_undegraded":"2024-09-19T04:16:47.063704+0000","last_fullsized":"2024-09-19T04:16:47.063704+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:49.842644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057711+0000","last_change":"2024-09-19T04:14:33.305796+0000","last_active":"2024-09-19T04:16:47.057711+0000","last_peered":"2024-09-19T04:16:47.057711+0000","last_clean":"2024-09-19T04:16:47.057711+0000","last_became_active":"2024-09-19T04:14:33.305499+0000","last_became_peered":"2024-09-19T04:14:33.305499+0000","last_unstale":"2024-09-19T04:16:47.057711+0000","last_undegraded":"2024-09-19T04:16:47.057711+0000","last_fullsized":"2024-09-19T04:16:47.057711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:08.357655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.059737+0000","last_change":"2024-09-19T04:14:31.322459+0000","last_active":"2024-09-19T04:16:47.059737+0000","last_peered":"2024-09-19T04:16:47.059737+0000","last_clean":"2024-09-19T04:16:47.059737+0000","last_became_active":"2024-09-19T04:14:31.322149+0000","last_became_peered":"2024-09-19T04:14:31.322149+0000","last_unstale":"2024-09-19T04:16:47.059737+0000","last_undegraded":"2024-09-19T04:16:47.059737+0000","last_fullsized":"2024-09-19T04:16:47.059737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:06:15.208618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.061247+0000","last_change":"2024-09-19T04:14:40.372869+0000","last_active":"2024-09-19T04:16:47.061247+0000","last_peered":"2024-09-19T04:16:47.061247+0000","last_clean":"2024-09-19T04:16:47.061247+0000","last_became_active":"2024-09-19T04:14:40.372203+0000","last_became_peered":"2024-09-19T04:14:40.372203+0000","last_unstale":"2024-09-19T04:16:47.061247+0000","last_undegraded":"2024-09-19T04:16:47.061247+0000","last_fullsized":"2024-09-19T04:16:47.061247+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:34.900656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"88'4","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.136056+0000","last_change":"2024-09-19T04:14:33.315443+0000","last_active":"2024-09-19T04:16:47.136056+0000","last_peered":"2024-09-19T04:16:47.136056+0000","last_clean":"2024-09-19T04:16:47.136056+0000","last_became_active":"2024-09-19T04:14:33.315067+0000","last_became_peered":"2024-09-19T04:14:33.315067+0000","last_unstale":"2024-09-19T04:16:47.136056+0000","last_undegraded":"2024-09-19T04:16:47.136056+0000","last_fullsized":"2024-09-19T04:16:47.136056+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:59.194674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.135801+0000","last_change":"2024-09-19T04:14:31.322623+0000","last_active":"2024-09-19T04:16:47.135801+0000","last_peered":"2024-09-19T04:16:47.135801+0000","last_clean":"2024-09-19T04:16:47.135801+0000","last_became_active":"2024-09-19T04:14:31.321838+0000","last_became_peered":"2024-09-19T04:14:31.321838+0000","last_unstale":"2024-09-19T04:16:47.135801+0000","last_undegraded":"2024-09-19T04:16:47.135801+0000","last_fullsized":"2024-09-19T04:16:47.135801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:30:37.073072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.059147+0000","last_change":"2024-09-19T04:15:47.343430+0000","last_active":"2024-09-19T04:16:47.059147+0000","last_peered":"2024-09-19T04:16:47.059147+0000","last_clean":"2024-09-19T04:16:47.059147+0000","last_became_active":"2024-09-19T04:15:47.342319+0000","last_became_peered":"2024-09-19T04:15:47.342319+0000","last_unstale":"2024-09-19T04:16:47.059147+0000","last_undegraded":"2024-09-19T04:16:47.059147+0000","last_fullsized":"2024-09-19T04:16:47.059147+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:05.641357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.136056+0000","last_change":"2024-09-19T04:14:33.319748+0000","last_active":"2024-09-19T04:16:47.136056+0000","last_peered":"2024-09-19T04:16:47.136056+0000","last_clean":"2024-09-19T04:16:47.136056+0000","last_became_active":"2024-09-19T04:14:33.319173+0000","last_became_peered":"2024-09-19T04:14:33.319173+0000","last_unstale":"2024-09-19T04:16:47.136056+0000","last_undegraded":"2024-09-19T04:16:47.136056+0000","last_fullsized":"2024-09-19T04:16:47.136056+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:24.419811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"90'9","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:57.964172+0000","last_change":"2024-09-19T04:14:31.292077+0000","last_active":"2024-09-19T04:16:57.964172+0000","last_peered":"2024-09-19T04:16:57.964172+0000","last_clean":"2024-09-19T04:16:57.964172+0000","last_became_active":"2024-09-19T04:14:31.291737+0000","last_became_peered":"2024-09-19T04:14:31.291737+0000","last_unstale":"2024-09-19T04:16:57.964172+0000","last_undegraded":"2024-09-19T04:16:57.964172+0000","last_fullsized":"2024-09-19T04:16:57.964172+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:32.570641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1823,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057613+0000","last_change":"2024-09-19T04:14:40.369734+0000","last_active":"2024-09-19T04:16:47.057613+0000","last_peered":"2024-09-19T04:16:47.057613+0000","last_clean":"2024-09-19T04:16:47.057613+0000","last_became_active":"2024-09-19T04:14:40.367563+0000","last_became_peered":"2024-09-19T04:14:40.367563+0000","last_unstale":"2024-09-19T04:16:47.057613+0000","last_undegraded":"2024-09-19T04:16:47.057613+0000","last_fullsized":"2024-09-19T04:16:47.057613+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:47.229115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063672+0000","last_change":"2024-09-19T04:14:33.309687+0000","last_active":"2024-09-19T04:16:47.063672+0000","last_peered":"2024-09-19T04:16:47.063672+0000","last_clean":"2024-09-19T04:16:47.063672+0000","last_became_active":"2024-09-19T04:14:33.308692+0000","last_became_peered":"2024-09-19T04:14:33.308692+0000","last_unstale":"2024-09-19T04:16:47.063672+0000","last_undegraded":"2024-09-19T04:16:47.063672+0000","last_fullsized":"2024-09-19T04:16:47.063672+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:58.716927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'6","reported_seq":146,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:55.985718+0000","last_change":"2024-09-19T04:14:31.322024+0000","last_active":"2024-09-19T04:16:55.985718+0000","last_peered":"2024-09-19T04:16:55.985718+0000","last_clean":"2024-09-19T04:16:55.985718+0000","last_became_active":"2024-09-19T04:14:31.321640+0000","last_became_peered":"2024-09-19T04:14:31.321640+0000","last_unstale":"2024-09-19T04:16:55.985718+0000","last_undegraded":"2024-09-19T04:16:55.985718+0000","last_fullsized":"2024-09-19T04:16:55.985718+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:25:36.159774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057744+0000","last_change":"2024-09-19T04:14:40.405793+0000","last_active":"2024-09-19T04:16:47.057744+0000","last_peered":"2024-09-19T04:16:47.057744+0000","last_clean":"2024-09-19T04:16:47.057744+0000","last_became_active":"2024-09-19T04:14:40.405354+0000","last_became_peered":"2024-09-19T04:14:40.405354+0000","last_unstale":"2024-09-19T04:16:47.057744+0000","last_undegraded":"2024-09-19T04:16:47.057744+0000","last_fullsized":"2024-09-19T04:16:47.057744+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:46:37.893202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057180+0000","last_change":"2024-09-19T04:14:33.313007+0000","last_active":"2024-09-19T04:16:47.057180+0000","last_peered":"2024-09-19T04:16:47.057180+0000","last_clean":"2024-09-19T04:16:47.057180+0000","last_became_active":"2024-09-19T04:14:33.312665+0000","last_became_peered":"2024-09-19T04:14:33.312665+0000","last_unstale":"2024-09-19T04:16:47.057180+0000","last_undegraded":"2024-09-19T04:16:47.057180+0000","last_fullsized":"2024-09-19T04:16:47.057180+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:09.976707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067276+0000","last_change":"2024-09-19T04:14:31.294072+0000","last_active":"2024-09-19T04:16:47.067276+0000","last_peered":"2024-09-19T04:16:47.067276+0000","last_clean":"2024-09-19T04:16:47.067276+0000","last_became_active":"2024-09-19T04:14:31.293648+0000","last_became_peered":"2024-09-19T04:14:31.293648+0000","last_unstale":"2024-09-19T04:16:47.067276+0000","last_undegraded":"2024-09-19T04:16:47.067276+0000","last_fullsized":"2024-09-19T04:16:47.067276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:14.910714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.065167+0000","last_change":"2024-09-19T04:14:40.406327+0000","last_active":"2024-09-19T04:16:47.065167+0000","last_peered":"2024-09-19T04:16:47.065167+0000","last_clean":"2024-09-19T04:16:47.065167+0000","last_became_active":"2024-09-19T04:14:40.405602+0000","last_became_peered":"2024-09-19T04:14:40.405602+0000","last_unstale":"2024-09-19T04:16:47.065167+0000","last_undegraded":"2024-09-19T04:16:47.065167+0000","last_fullsized":"2024-09-19T04:16:47.065167+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:47:23.078480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.135349+0000","last_change":"2024-09-19T04:15:47.342605+0000","last_active":"2024-09-19T04:16:47.135349+0000","last_peered":"2024-09-19T04:16:47.135349+0000","last_clean":"2024-09-19T04:16:47.135349+0000","last_became_active":"2024-09-19T04:15:47.342215+0000","last_became_peered":"2024-09-19T04:15:47.342215+0000","last_unstale":"2024-09-19T04:16:47.135349+0000","last_undegraded":"2024-09-19T04:16:47.135349+0000","last_fullsized":"2024-09-19T04:16:47.135349+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:01.315513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,1],"acting":[9,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058993+0000","last_change":"2024-09-19T04:14:31.290207+0000","last_active":"2024-09-19T04:16:47.058993+0000","last_peered":"2024-09-19T04:16:47.058993+0000","last_clean":"2024-09-19T04:16:47.058993+0000","last_became_active":"2024-09-19T04:14:31.289863+0000","last_became_peered":"2024-09-19T04:14:31.289863+0000","last_unstale":"2024-09-19T04:16:47.058993+0000","last_undegraded":"2024-09-19T04:16:47.058993+0000","last_fullsized":"2024-09-19T04:16:47.058993+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:39.241894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":351,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067362+0000","last_change":"2024-09-19T04:13:20.845240+0000","last_active":"2024-09-19T04:16:47.067362+0000","last_peered":"2024-09-19T04:16:47.067362+0000","last_clean":"2024-09-19T04:16:47.067362+0000","last_became_active":"2024-09-19T04:13:20.844771+0000","last_became_peered":"2024-09-19T04:13:20.844771+0000","last_unstale":"2024-09-19T04:16:47.067362+0000","last_undegraded":"2024-09-19T04:16:47.067362+0000","last_fullsized":"2024-09-19T04:16:47.067362+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:09:59.809148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:09:59.809148+0000","last_clean_scrub_stamp":"2024-09-19T04:09:59.809148+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:12:29.694263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067926+0000","last_change":"2024-09-19T04:14:40.369257+0000","last_active":"2024-09-19T04:16:47.067926+0000","last_peered":"2024-09-19T04:16:47.067926+0000","last_clean":"2024-09-19T04:16:47.067926+0000","last_became_active":"2024-09-19T04:14:40.368865+0000","last_became_peered":"2024-09-19T04:14:40.368865+0000","last_unstale":"2024-09-19T04:16:47.067926+0000","last_undegraded":"2024-09-19T04:16:47.067926+0000","last_fullsized":"2024-09-19T04:16:47.067926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:37:52.120157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.068065+0000","last_change":"2024-09-19T04:14:33.311221+0000","last_active":"2024-09-19T04:16:47.068065+0000","last_peered":"2024-09-19T04:16:47.068065+0000","last_clean":"2024-09-19T04:16:47.068065+0000","last_became_active":"2024-09-19T04:14:33.310886+0000","last_became_peered":"2024-09-19T04:14:33.310886+0000","last_unstale":"2024-09-19T04:16:47.068065+0000","last_undegraded":"2024-09-19T04:16:47.068065+0000","last_fullsized":"2024-09-19T04:16:47.068065+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:04:32.348676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":143,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:52.992256+0000","last_change":"2024-09-19T04:14:31.322464+0000","last_active":"2024-09-19T04:16:52.992256+0000","last_peered":"2024-09-19T04:16:52.992256+0000","last_clean":"2024-09-19T04:16:52.992256+0000","last_became_active":"2024-09-19T04:14:31.322115+0000","last_became_peered":"2024-09-19T04:14:31.322115+0000","last_unstale":"2024-09-19T04:16:52.992256+0000","last_undegraded":"2024-09-19T04:16:52.992256+0000","last_fullsized":"2024-09-19T04:16:52.992256+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:24:27.623328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":99,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063926+0000","last_change":"2024-09-19T04:14:40.371391+0000","last_active":"2024-09-19T04:16:47.063926+0000","last_peered":"2024-09-19T04:16:47.063926+0000","last_clean":"2024-09-19T04:16:47.063926+0000","last_became_active":"2024-09-19T04:14:40.371091+0000","last_became_peered":"2024-09-19T04:14:40.371091+0000","last_unstale":"2024-09-19T04:16:47.063926+0000","last_undegraded":"2024-09-19T04:16:47.063926+0000","last_fullsized":"2024-09-19T04:16:47.063926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:39:14.889348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"88'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067617+0000","last_change":"2024-09-19T04:15:47.003652+0000","last_active":"2024-09-19T04:16:47.067617+0000","last_peered":"2024-09-19T04:16:47.067617+0000","last_clean":"2024-09-19T04:16:47.067617+0000","last_became_active":"2024-09-19T04:15:47.003226+0000","last_became_peered":"2024-09-19T04:15:47.003226+0000","last_unstale":"2024-09-19T04:16:47.067617+0000","last_undegraded":"2024-09-19T04:16:47.067617+0000","last_fullsized":"2024-09-19T04:16:47.067617+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:38.948427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.065509+0000","last_change":"2024-09-19T04:14:31.293156+0000","last_active":"2024-09-19T04:16:47.065509+0000","last_peered":"2024-09-19T04:16:47.065509+0000","last_clean":"2024-09-19T04:16:47.065509+0000","last_became_active":"2024-09-19T04:14:31.292772+0000","last_became_peered":"2024-09-19T04:14:31.292772+0000","last_unstale":"2024-09-19T04:16:47.065509+0000","last_undegraded":"2024-09-19T04:16:47.065509+0000","last_fullsized":"2024-09-19T04:16:47.065509+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:03:18.530662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.570714+0000","last_change":"2024-09-19T04:14:40.371434+0000","last_active":"2024-09-19T04:16:47.570714+0000","last_peered":"2024-09-19T04:16:47.570714+0000","last_clean":"2024-09-19T04:16:47.570714+0000","last_became_active":"2024-09-19T04:14:40.371037+0000","last_became_peered":"2024-09-19T04:14:40.371037+0000","last_unstale":"2024-09-19T04:16:47.570714+0000","last_undegraded":"2024-09-19T04:16:47.570714+0000","last_fullsized":"2024-09-19T04:16:47.570714+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:43:34.787860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067852+0000","last_change":"2024-09-19T04:14:33.308321+0000","last_active":"2024-09-19T04:16:47.067852+0000","last_peered":"2024-09-19T04:16:47.067852+0000","last_clean":"2024-09-19T04:16:47.067852+0000","last_became_active":"2024-09-19T04:14:33.307983+0000","last_became_peered":"2024-09-19T04:14:33.307983+0000","last_unstale":"2024-09-19T04:16:47.067852+0000","last_undegraded":"2024-09-19T04:16:47.067852+0000","last_fullsized":"2024-09-19T04:16:47.067852+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:46.202123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057834+0000","last_change":"2024-09-19T04:14:31.297326+0000","last_active":"2024-09-19T04:16:47.057834+0000","last_peered":"2024-09-19T04:16:47.057834+0000","last_clean":"2024-09-19T04:16:47.057834+0000","last_became_active":"2024-09-19T04:14:31.297056+0000","last_became_peered":"2024-09-19T04:14:31.297056+0000","last_unstale":"2024-09-19T04:16:47.057834+0000","last_undegraded":"2024-09-19T04:16:47.057834+0000","last_fullsized":"2024-09-19T04:16:47.057834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:15:26.324855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063512+0000","last_change":"2024-09-19T04:14:40.370123+0000","last_active":"2024-09-19T04:16:47.063512+0000","last_peered":"2024-09-19T04:16:47.063512+0000","last_clean":"2024-09-19T04:16:47.063512+0000","last_became_active":"2024-09-19T04:14:40.367758+0000","last_became_peered":"2024-09-19T04:14:40.367758+0000","last_unstale":"2024-09-19T04:16:47.063512+0000","last_undegraded":"2024-09-19T04:16:47.063512+0000","last_fullsized":"2024-09-19T04:16:47.063512+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:07.932122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.061501+0000","last_change":"2024-09-19T04:14:33.314239+0000","last_active":"2024-09-19T04:16:47.061501+0000","last_peered":"2024-09-19T04:16:47.061501+0000","last_clean":"2024-09-19T04:16:47.061501+0000","last_became_active":"2024-09-19T04:14:33.313918+0000","last_became_peered":"2024-09-19T04:14:33.313918+0000","last_unstale":"2024-09-19T04:16:47.061501+0000","last_undegraded":"2024-09-19T04:16:47.061501+0000","last_fullsized":"2024-09-19T04:16:47.061501+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:00:12.756505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.059564+0000","last_change":"2024-09-19T04:14:31.295377+0000","last_active":"2024-09-19T04:16:47.059564+0000","last_peered":"2024-09-19T04:16:47.059564+0000","last_clean":"2024-09-19T04:16:47.059564+0000","last_became_active":"2024-09-19T04:14:31.295042+0000","last_became_peered":"2024-09-19T04:14:31.295042+0000","last_unstale":"2024-09-19T04:16:47.059564+0000","last_undegraded":"2024-09-19T04:16:47.059564+0000","last_fullsized":"2024-09-19T04:16:47.059564+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:35.842847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063698+0000","last_change":"2024-09-19T04:14:40.370790+0000","last_active":"2024-09-19T04:16:47.063698+0000","last_peered":"2024-09-19T04:16:47.063698+0000","last_clean":"2024-09-19T04:16:47.063698+0000","last_became_active":"2024-09-19T04:14:40.370377+0000","last_became_peered":"2024-09-19T04:14:40.370377+0000","last_unstale":"2024-09-19T04:16:47.063698+0000","last_undegraded":"2024-09-19T04:16:47.063698+0000","last_fullsized":"2024-09-19T04:16:47.063698+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:09.331769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063823+0000","last_change":"2024-09-19T04:15:47.342260+0000","last_active":"2024-09-19T04:16:47.063823+0000","last_peered":"2024-09-19T04:16:47.063823+0000","last_clean":"2024-09-19T04:16:47.063823+0000","last_became_active":"2024-09-19T04:15:47.341713+0000","last_became_peered":"2024-09-19T04:15:47.341713+0000","last_unstale":"2024-09-19T04:16:47.063823+0000","last_undegraded":"2024-09-19T04:16:47.063823+0000","last_fullsized":"2024-09-19T04:16:47.063823+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:25:47.822844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":57,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.059020+0000","last_change":"2024-09-19T04:14:31.322413+0000","last_active":"2024-09-19T04:16:47.059020+0000","last_peered":"2024-09-19T04:16:47.059020+0000","last_clean":"2024-09-19T04:16:47.059020+0000","last_became_active":"2024-09-19T04:14:31.322082+0000","last_became_peered":"2024-09-19T04:14:31.322082+0000","last_unstale":"2024-09-19T04:16:47.059020+0000","last_undegraded":"2024-09-19T04:16:47.059020+0000","last_fullsized":"2024-09-19T04:16:47.059020+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:50.010021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057771+0000","last_change":"2024-09-19T04:14:40.373071+0000","last_active":"2024-09-19T04:16:47.057771+0000","last_peered":"2024-09-19T04:16:47.057771+0000","last_clean":"2024-09-19T04:16:47.057771+0000","last_became_active":"2024-09-19T04:14:40.372679+0000","last_became_peered":"2024-09-19T04:14:40.372679+0000","last_unstale":"2024-09-19T04:16:47.057771+0000","last_undegraded":"2024-09-19T04:16:47.057771+0000","last_fullsized":"2024-09-19T04:16:47.057771+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:23.136807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067239+0000","last_change":"2024-09-19T04:14:33.319165+0000","last_active":"2024-09-19T04:16:47.067239+0000","last_peered":"2024-09-19T04:16:47.067239+0000","last_clean":"2024-09-19T04:16:47.067239+0000","last_became_active":"2024-09-19T04:14:33.318830+0000","last_became_peered":"2024-09-19T04:14:33.318830+0000","last_unstale":"2024-09-19T04:16:47.067239+0000","last_undegraded":"2024-09-19T04:16:47.067239+0000","last_fullsized":"2024-09-19T04:16:47.067239+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:05:43.936069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'7","reported_seq":151,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:56.988332+0000","last_change":"2024-09-19T04:14:31.291564+0000","last_active":"2024-09-19T04:16:56.988332+0000","last_peered":"2024-09-19T04:16:56.988332+0000","last_clean":"2024-09-19T04:16:56.988332+0000","last_became_active":"2024-09-19T04:14:31.291241+0000","last_became_peered":"2024-09-19T04:14:31.291241+0000","last_unstale":"2024-09-19T04:16:56.988332+0000","last_undegraded":"2024-09-19T04:16:56.988332+0000","last_fullsized":"2024-09-19T04:16:56.988332+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:38:09.419140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.135728+0000","last_change":"2024-09-19T04:14:40.371707+0000","last_active":"2024-09-19T04:16:47.135728+0000","last_peered":"2024-09-19T04:16:47.135728+0000","last_clean":"2024-09-19T04:16:47.135728+0000","last_became_active":"2024-09-19T04:14:40.370767+0000","last_became_peered":"2024-09-19T04:14:40.370767+0000","last_unstale":"2024-09-19T04:16:47.135728+0000","last_undegraded":"2024-09-19T04:16:47.135728+0000","last_fullsized":"2024-09-19T04:16:47.135728+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:38.022486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067584+0000","last_change":"2024-09-19T04:14:33.316098+0000","last_active":"2024-09-19T04:16:47.067584+0000","last_peered":"2024-09-19T04:16:47.067584+0000","last_clean":"2024-09-19T04:16:47.067584+0000","last_became_active":"2024-09-19T04:14:33.315755+0000","last_became_peered":"2024-09-19T04:14:33.315755+0000","last_unstale":"2024-09-19T04:16:47.067584+0000","last_undegraded":"2024-09-19T04:16:47.067584+0000","last_fullsized":"2024-09-19T04:16:47.067584+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:45:01.531200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.065848+0000","last_change":"2024-09-19T04:14:31.291145+0000","last_active":"2024-09-19T04:16:47.065848+0000","last_peered":"2024-09-19T04:16:47.065848+0000","last_clean":"2024-09-19T04:16:47.065848+0000","last_became_active":"2024-09-19T04:14:31.290763+0000","last_became_peered":"2024-09-19T04:14:31.290763+0000","last_unstale":"2024-09-19T04:16:47.065848+0000","last_undegraded":"2024-09-19T04:16:47.065848+0000","last_fullsized":"2024-09-19T04:16:47.065848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:37.556544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.061681+0000","last_change":"2024-09-19T04:14:40.371371+0000","last_active":"2024-09-19T04:16:47.061681+0000","last_peered":"2024-09-19T04:16:47.061681+0000","last_clean":"2024-09-19T04:16:47.061681+0000","last_became_active":"2024-09-19T04:14:40.370988+0000","last_became_peered":"2024-09-19T04:14:40.370988+0000","last_unstale":"2024-09-19T04:16:47.061681+0000","last_undegraded":"2024-09-19T04:16:47.061681+0000","last_fullsized":"2024-09-19T04:16:47.061681+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:57.089953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057403+0000","last_change":"2024-09-19T04:15:47.003980+0000","last_active":"2024-09-19T04:16:47.057403+0000","last_peered":"2024-09-19T04:16:47.057403+0000","last_clean":"2024-09-19T04:16:47.057403+0000","last_became_active":"2024-09-19T04:15:47.003573+0000","last_became_peered":"2024-09-19T04:15:47.003573+0000","last_unstale":"2024-09-19T04:16:47.057403+0000","last_undegraded":"2024-09-19T04:16:47.057403+0000","last_fullsized":"2024-09-19T04:16:47.057403+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:35:12.971378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063280+0000","last_change":"2024-09-19T04:14:31.297106+0000","last_active":"2024-09-19T04:16:47.063280+0000","last_peered":"2024-09-19T04:16:47.063280+0000","last_clean":"2024-09-19T04:16:47.063280+0000","last_became_active":"2024-09-19T04:14:31.296688+0000","last_became_peered":"2024-09-19T04:14:31.296688+0000","last_unstale":"2024-09-19T04:16:47.063280+0000","last_undegraded":"2024-09-19T04:16:47.063280+0000","last_fullsized":"2024-09-19T04:16:47.063280+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:18.882219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064088+0000","last_change":"2024-09-19T04:14:40.371641+0000","last_active":"2024-09-19T04:16:47.064088+0000","last_peered":"2024-09-19T04:16:47.064088+0000","last_clean":"2024-09-19T04:16:47.064088+0000","last_became_active":"2024-09-19T04:14:40.370354+0000","last_became_peered":"2024-09-19T04:14:40.370354+0000","last_unstale":"2024-09-19T04:16:47.064088+0000","last_undegraded":"2024-09-19T04:16:47.064088+0000","last_fullsized":"2024-09-19T04:16:47.064088+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:01:11.572011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.059539+0000","last_change":"2024-09-19T04:14:33.307767+0000","last_active":"2024-09-19T04:16:47.059539+0000","last_peered":"2024-09-19T04:16:47.059539+0000","last_clean":"2024-09-19T04:16:47.059539+0000","last_became_active":"2024-09-19T04:14:33.307396+0000","last_became_peered":"2024-09-19T04:14:33.307396+0000","last_unstale":"2024-09-19T04:16:47.059539+0000","last_undegraded":"2024-09-19T04:16:47.059539+0000","last_fullsized":"2024-09-19T04:16:47.059539+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:21.018641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'42","reported_seq":293,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:57.442290+0000","last_change":"2024-09-19T04:14:31.298106+0000","last_active":"2024-09-19T04:16:57.442290+0000","last_peered":"2024-09-19T04:16:57.442290+0000","last_clean":"2024-09-19T04:16:57.442290+0000","last_became_active":"2024-09-19T04:14:31.297731+0000","last_became_peered":"2024-09-19T04:14:31.297731+0000","last_unstale":"2024-09-19T04:16:57.442290+0000","last_undegraded":"2024-09-19T04:16:57.442290+0000","last_fullsized":"2024-09-19T04:16:57.442290+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:29.127759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72406,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":212,"num_read_kb":170,"num_write":44,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.135577+0000","last_change":"2024-09-19T04:14:40.372927+0000","last_active":"2024-09-19T04:16:47.135577+0000","last_peered":"2024-09-19T04:16:47.135577+0000","last_clean":"2024-09-19T04:16:47.135577+0000","last_became_active":"2024-09-19T04:14:40.372521+0000","last_became_peered":"2024-09-19T04:14:40.372521+0000","last_unstale":"2024-09-19T04:16:47.135577+0000","last_undegraded":"2024-09-19T04:16:47.135577+0000","last_fullsized":"2024-09-19T04:16:47.135577+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:15:00.863812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063722+0000","last_change":"2024-09-19T04:14:33.308154+0000","last_active":"2024-09-19T04:16:47.063722+0000","last_peered":"2024-09-19T04:16:47.063722+0000","last_clean":"2024-09-19T04:16:47.063722+0000","last_became_active":"2024-09-19T04:14:33.307831+0000","last_became_peered":"2024-09-19T04:14:33.307831+0000","last_unstale":"2024-09-19T04:16:47.063722+0000","last_undegraded":"2024-09-19T04:16:47.063722+0000","last_fullsized":"2024-09-19T04:16:47.063722+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:16:14.656133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064967+0000","last_change":"2024-09-19T04:14:31.324011+0000","last_active":"2024-09-19T04:16:47.064967+0000","last_peered":"2024-09-19T04:16:47.064967+0000","last_clean":"2024-09-19T04:16:47.064967+0000","last_became_active":"2024-09-19T04:14:31.323622+0000","last_became_peered":"2024-09-19T04:14:31.323622+0000","last_unstale":"2024-09-19T04:16:47.064967+0000","last_undegraded":"2024-09-19T04:16:47.064967+0000","last_fullsized":"2024-09-19T04:16:47.064967+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:39.198602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058635+0000","last_change":"2024-09-19T04:14:40.365938+0000","last_active":"2024-09-19T04:16:47.058635+0000","last_peered":"2024-09-19T04:16:47.058635+0000","last_clean":"2024-09-19T04:16:47.058635+0000","last_became_active":"2024-09-19T04:14:40.365539+0000","last_became_peered":"2024-09-19T04:14:40.365539+0000","last_unstale":"2024-09-19T04:16:47.058635+0000","last_undegraded":"2024-09-19T04:16:47.058635+0000","last_fullsized":"2024-09-19T04:16:47.058635+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:09.723008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.571075+0000","last_change":"2024-09-19T04:14:33.316286+0000","last_active":"2024-09-19T04:16:47.571075+0000","last_peered":"2024-09-19T04:16:47.571075+0000","last_clean":"2024-09-19T04:16:47.571075+0000","last_became_active":"2024-09-19T04:14:33.315980+0000","last_became_peered":"2024-09-19T04:14:33.315980+0000","last_unstale":"2024-09-19T04:16:47.571075+0000","last_undegraded":"2024-09-19T04:16:47.571075+0000","last_fullsized":"2024-09-19T04:16:47.571075+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:58.383139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067880+0000","last_change":"2024-09-19T04:14:31.299111+0000","last_active":"2024-09-19T04:16:47.067880+0000","last_peered":"2024-09-19T04:16:47.067880+0000","last_clean":"2024-09-19T04:16:47.067880+0000","last_became_active":"2024-09-19T04:14:31.298390+0000","last_became_peered":"2024-09-19T04:14:31.298390+0000","last_unstale":"2024-09-19T04:16:47.067880+0000","last_undegraded":"2024-09-19T04:16:47.067880+0000","last_fullsized":"2024-09-19T04:16:47.067880+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:39.710412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.135278+0000","last_change":"2024-09-19T04:14:40.371108+0000","last_active":"2024-09-19T04:16:47.135278+0000","last_peered":"2024-09-19T04:16:47.135278+0000","last_clean":"2024-09-19T04:16:47.135278+0000","last_became_active":"2024-09-19T04:14:40.370729+0000","last_became_peered":"2024-09-19T04:14:40.370729+0000","last_unstale":"2024-09-19T04:16:47.135278+0000","last_undegraded":"2024-09-19T04:16:47.135278+0000","last_fullsized":"2024-09-19T04:16:47.135278+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:59.610235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064054+0000","last_change":"2024-09-19T04:14:33.314423+0000","last_active":"2024-09-19T04:16:47.064054+0000","last_peered":"2024-09-19T04:16:47.064054+0000","last_clean":"2024-09-19T04:16:47.064054+0000","last_became_active":"2024-09-19T04:14:33.314123+0000","last_became_peered":"2024-09-19T04:14:33.314123+0000","last_unstale":"2024-09-19T04:16:47.064054+0000","last_undegraded":"2024-09-19T04:16:47.064054+0000","last_fullsized":"2024-09-19T04:16:47.064054+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:29:57.781116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"90'5","reported_seq":244,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:57.446101+0000","last_change":"2024-09-19T04:14:31.293267+0000","last_active":"2024-09-19T04:16:57.446101+0000","last_peered":"2024-09-19T04:16:57.446101+0000","last_clean":"2024-09-19T04:16:57.446101+0000","last_became_active":"2024-09-19T04:14:31.292862+0000","last_became_peered":"2024-09-19T04:14:31.292862+0000","last_unstale":"2024-09-19T04:16:57.446101+0000","last_undegraded":"2024-09-19T04:16:57.446101+0000","last_fullsized":"2024-09-19T04:16:57.446101+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:37.876696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":200,"num_read_kb":200,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063338+0000","last_change":"2024-09-19T04:14:40.373078+0000","last_active":"2024-09-19T04:16:47.063338+0000","last_peered":"2024-09-19T04:16:47.063338+0000","last_clean":"2024-09-19T04:16:47.063338+0000","last_became_active":"2024-09-19T04:14:40.372468+0000","last_became_peered":"2024-09-19T04:14:40.372468+0000","last_unstale":"2024-09-19T04:16:47.063338+0000","last_undegraded":"2024-09-19T04:16:47.063338+0000","last_fullsized":"2024-09-19T04:16:47.063338+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:54.945801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.570776+0000","last_change":"2024-09-19T04:14:40.368946+0000","last_active":"2024-09-19T04:16:47.570776+0000","last_peered":"2024-09-19T04:16:47.570776+0000","last_clean":"2024-09-19T04:16:47.570776+0000","last_became_active":"2024-09-19T04:14:40.368549+0000","last_became_peered":"2024-09-19T04:14:40.368549+0000","last_unstale":"2024-09-19T04:16:47.570776+0000","last_undegraded":"2024-09-19T04:16:47.570776+0000","last_fullsized":"2024-09-19T04:16:47.570776+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:24.563488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.135449+0000","last_change":"2024-09-19T04:14:33.307214+0000","last_active":"2024-09-19T04:16:47.135449+0000","last_peered":"2024-09-19T04:16:47.135449+0000","last_clean":"2024-09-19T04:16:47.135449+0000","last_became_active":"2024-09-19T04:14:33.306913+0000","last_became_peered":"2024-09-19T04:14:33.306913+0000","last_unstale":"2024-09-19T04:16:47.135449+0000","last_undegraded":"2024-09-19T04:16:47.135449+0000","last_fullsized":"2024-09-19T04:16:47.135449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:49.402532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063894+0000","last_change":"2024-09-19T04:14:31.294488+0000","last_active":"2024-09-19T04:16:47.063894+0000","last_peered":"2024-09-19T04:16:47.063894+0000","last_clean":"2024-09-19T04:16:47.063894+0000","last_became_active":"2024-09-19T04:14:31.294145+0000","last_became_peered":"2024-09-19T04:14:31.294145+0000","last_unstale":"2024-09-19T04:16:47.063894+0000","last_undegraded":"2024-09-19T04:16:47.063894+0000","last_fullsized":"2024-09-19T04:16:47.063894+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:28:19.411650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.061366+0000","last_change":"2024-09-19T04:14:40.372366+0000","last_active":"2024-09-19T04:16:47.061366+0000","last_peered":"2024-09-19T04:16:47.061366+0000","last_clean":"2024-09-19T04:16:47.061366+0000","last_became_active":"2024-09-19T04:14:40.371922+0000","last_became_peered":"2024-09-19T04:14:40.371922+0000","last_unstale":"2024-09-19T04:16:47.061366+0000","last_undegraded":"2024-09-19T04:16:47.061366+0000","last_fullsized":"2024-09-19T04:16:47.061366+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:55:01.724088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063700+0000","last_change":"2024-09-19T04:14:33.308351+0000","last_active":"2024-09-19T04:16:47.063700+0000","last_peered":"2024-09-19T04:16:47.063700+0000","last_clean":"2024-09-19T04:16:47.063700+0000","last_became_active":"2024-09-19T04:14:33.308052+0000","last_became_peered":"2024-09-19T04:14:33.308052+0000","last_unstale":"2024-09-19T04:16:47.063700+0000","last_undegraded":"2024-09-19T04:16:47.063700+0000","last_fullsized":"2024-09-19T04:16:47.063700+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:06:32.056738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057291+0000","last_change":"2024-09-19T04:14:31.291742+0000","last_active":"2024-09-19T04:16:47.057291+0000","last_peered":"2024-09-19T04:16:47.057291+0000","last_clean":"2024-09-19T04:16:47.057291+0000","last_became_active":"2024-09-19T04:14:31.291315+0000","last_became_peered":"2024-09-19T04:14:31.291315+0000","last_unstale":"2024-09-19T04:16:47.057291+0000","last_undegraded":"2024-09-19T04:16:47.057291+0000","last_fullsized":"2024-09-19T04:16:47.057291+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:16.159276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.136189+0000","last_change":"2024-09-19T04:14:31.293898+0000","last_active":"2024-09-19T04:16:47.136189+0000","last_peered":"2024-09-19T04:16:47.136189+0000","last_clean":"2024-09-19T04:16:47.136189+0000","last_became_active":"2024-09-19T04:14:31.293499+0000","last_became_peered":"2024-09-19T04:14:31.293499+0000","last_unstale":"2024-09-19T04:16:47.136189+0000","last_undegraded":"2024-09-19T04:16:47.136189+0000","last_fullsized":"2024-09-19T04:16:47.136189+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:25:55.590644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064005+0000","last_change":"2024-09-19T04:14:33.314094+0000","last_active":"2024-09-19T04:16:47.064005+0000","last_peered":"2024-09-19T04:16:47.064005+0000","last_clean":"2024-09-19T04:16:47.064005+0000","last_became_active":"2024-09-19T04:14:33.312782+0000","last_became_peered":"2024-09-19T04:14:33.312782+0000","last_unstale":"2024-09-19T04:16:47.064005+0000","last_undegraded":"2024-09-19T04:16:47.064005+0000","last_fullsized":"2024-09-19T04:16:47.064005+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:40.121676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.062592+0000","last_change":"2024-09-19T04:14:40.369159+0000","last_active":"2024-09-19T04:16:47.062592+0000","last_peered":"2024-09-19T04:16:47.062592+0000","last_clean":"2024-09-19T04:16:47.062592+0000","last_became_active":"2024-09-19T04:14:40.368732+0000","last_became_peered":"2024-09-19T04:14:40.368732+0000","last_unstale":"2024-09-19T04:16:47.062592+0000","last_undegraded":"2024-09-19T04:16:47.062592+0000","last_fullsized":"2024-09-19T04:16:47.062592+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:12:29.176834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'6","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:57.081537+0000","last_change":"2024-09-19T04:16:47.072639+0000","last_active":"2024-09-19T04:16:57.081537+0000","last_peered":"2024-09-19T04:16:57.081537+0000","last_clean":"2024-09-19T04:16:57.081537+0000","last_became_active":"2024-09-19T04:16:47.068508+0000","last_became_peered":"2024-09-19T04:16:47.068508+0000","last_unstale":"2024-09-19T04:16:57.081537+0000","last_undegraded":"2024-09-19T04:16:57.081537+0000","last_fullsized":"2024-09-19T04:16:57.081537+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:43.540304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.059276+0000","last_change":"2024-09-19T04:14:33.300555+0000","last_active":"2024-09-19T04:16:47.059276+0000","last_peered":"2024-09-19T04:16:47.059276+0000","last_clean":"2024-09-19T04:16:47.059276+0000","last_became_active":"2024-09-19T04:14:33.300220+0000","last_became_peered":"2024-09-19T04:14:33.300220+0000","last_unstale":"2024-09-19T04:16:47.059276+0000","last_undegraded":"2024-09-19T04:16:47.059276+0000","last_fullsized":"2024-09-19T04:16:47.059276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:32.584140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.137653+0000","last_change":"2024-09-19T04:16:47.137653+0000","last_active":"2024-09-19T04:16:47.137653+0000","last_peered":"2024-09-19T04:16:47.137653+0000","last_clean":"2024-09-19T04:16:47.137653+0000","last_became_active":"2024-09-19T04:16:47.137087+0000","last_became_peered":"2024-09-19T04:16:47.137087+0000","last_unstale":"2024-09-19T04:16:47.137653+0000","last_undegraded":"2024-09-19T04:16:47.137653+0000","last_fullsized":"2024-09-19T04:16:47.137653+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:31.312087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,7,11],"acting":[2,10,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.060868+0000","last_change":"2024-09-19T04:14:33.312801+0000","last_active":"2024-09-19T04:16:47.060868+0000","last_peered":"2024-09-19T04:16:47.060868+0000","last_clean":"2024-09-19T04:16:47.060868+0000","last_became_active":"2024-09-19T04:14:33.312430+0000","last_became_peered":"2024-09-19T04:14:33.312430+0000","last_unstale":"2024-09-19T04:16:47.060868+0000","last_undegraded":"2024-09-19T04:16:47.060868+0000","last_fullsized":"2024-09-19T04:16:47.060868+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:29.069507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063851+0000","last_change":"2024-09-19T04:14:33.313076+0000","last_active":"2024-09-19T04:16:47.063851+0000","last_peered":"2024-09-19T04:16:47.063851+0000","last_clean":"2024-09-19T04:16:47.063851+0000","last_became_active":"2024-09-19T04:14:33.312730+0000","last_became_peered":"2024-09-19T04:14:33.312730+0000","last_unstale":"2024-09-19T04:16:47.063851+0000","last_undegraded":"2024-09-19T04:16:47.063851+0000","last_fullsized":"2024-09-19T04:16:47.063851+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:33.397309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063194+0000","last_change":"2024-09-19T04:14:33.314724+0000","last_active":"2024-09-19T04:16:47.063194+0000","last_peered":"2024-09-19T04:16:47.063194+0000","last_clean":"2024-09-19T04:16:47.063194+0000","last_became_active":"2024-09-19T04:14:33.314359+0000","last_became_peered":"2024-09-19T04:14:33.314359+0000","last_unstale":"2024-09-19T04:16:47.063194+0000","last_undegraded":"2024-09-19T04:16:47.063194+0000","last_fullsized":"2024-09-19T04:16:47.063194+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:37:39.357193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.570754+0000","last_change":"2024-09-19T04:14:33.312834+0000","last_active":"2024-09-19T04:16:47.570754+0000","last_peered":"2024-09-19T04:16:47.570754+0000","last_clean":"2024-09-19T04:16:47.570754+0000","last_became_active":"2024-09-19T04:14:33.312538+0000","last_became_peered":"2024-09-19T04:14:33.312538+0000","last_unstale":"2024-09-19T04:16:47.570754+0000","last_undegraded":"2024-09-19T04:16:47.570754+0000","last_fullsized":"2024-09-19T04:16:47.570754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:25:37.694910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057648+0000","last_change":"2024-09-19T04:14:33.305735+0000","last_active":"2024-09-19T04:16:47.057648+0000","last_peered":"2024-09-19T04:16:47.057648+0000","last_clean":"2024-09-19T04:16:47.057648+0000","last_became_active":"2024-09-19T04:14:33.305415+0000","last_became_peered":"2024-09-19T04:14:33.305415+0000","last_unstale":"2024-09-19T04:16:47.057648+0000","last_undegraded":"2024-09-19T04:16:47.057648+0000","last_fullsized":"2024-09-19T04:16:47.057648+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:20.160211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.061663+0000","last_change":"2024-09-19T04:14:33.313379+0000","last_active":"2024-09-19T04:16:47.061663+0000","last_peered":"2024-09-19T04:16:47.061663+0000","last_clean":"2024-09-19T04:16:47.061663+0000","last_became_active":"2024-09-19T04:14:33.312453+0000","last_became_peered":"2024-09-19T04:14:33.312453+0000","last_unstale":"2024-09-19T04:16:47.061663+0000","last_undegraded":"2024-09-19T04:16:47.061663+0000","last_fullsized":"2024-09-19T04:16:47.061663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:44.832004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063977+0000","last_change":"2024-09-19T04:14:33.307371+0000","last_active":"2024-09-19T04:16:47.063977+0000","last_peered":"2024-09-19T04:16:47.063977+0000","last_clean":"2024-09-19T04:16:47.063977+0000","last_became_active":"2024-09-19T04:14:33.307033+0000","last_became_peered":"2024-09-19T04:14:33.307033+0000","last_unstale":"2024-09-19T04:16:47.063977+0000","last_undegraded":"2024-09-19T04:16:47.063977+0000","last_fullsized":"2024-09-19T04:16:47.063977+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:12.027213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064150+0000","last_change":"2024-09-19T04:15:47.342412+0000","last_active":"2024-09-19T04:16:47.064150+0000","last_peered":"2024-09-19T04:16:47.064150+0000","last_clean":"2024-09-19T04:16:47.064150+0000","last_became_active":"2024-09-19T04:15:47.341989+0000","last_became_peered":"2024-09-19T04:15:47.341989+0000","last_unstale":"2024-09-19T04:16:47.064150+0000","last_undegraded":"2024-09-19T04:16:47.064150+0000","last_fullsized":"2024-09-19T04:16:47.064150+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:32.713199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063980+0000","last_change":"2024-09-19T04:14:33.314296+0000","last_active":"2024-09-19T04:16:47.063980+0000","last_peered":"2024-09-19T04:16:47.063980+0000","last_clean":"2024-09-19T04:16:47.063980+0000","last_became_active":"2024-09-19T04:14:33.311230+0000","last_became_peered":"2024-09-19T04:14:33.311230+0000","last_unstale":"2024-09-19T04:16:47.063980+0000","last_undegraded":"2024-09-19T04:16:47.063980+0000","last_fullsized":"2024-09-19T04:16:47.063980+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:37:51.395086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063485+0000","last_change":"2024-09-19T04:14:33.317125+0000","last_active":"2024-09-19T04:16:47.063485+0000","last_peered":"2024-09-19T04:16:47.063485+0000","last_clean":"2024-09-19T04:16:47.063485+0000","last_became_active":"2024-09-19T04:14:33.316805+0000","last_became_peered":"2024-09-19T04:14:33.316805+0000","last_unstale":"2024-09-19T04:16:47.063485+0000","last_undegraded":"2024-09-19T04:16:47.063485+0000","last_fullsized":"2024-09-19T04:16:47.063485+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:27.754882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063974+0000","last_change":"2024-09-19T04:14:33.310081+0000","last_active":"2024-09-19T04:16:47.063974+0000","last_peered":"2024-09-19T04:16:47.063974+0000","last_clean":"2024-09-19T04:16:47.063974+0000","last_became_active":"2024-09-19T04:14:33.308675+0000","last_became_peered":"2024-09-19T04:14:33.308675+0000","last_unstale":"2024-09-19T04:16:47.063974+0000","last_undegraded":"2024-09-19T04:16:47.063974+0000","last_fullsized":"2024-09-19T04:16:47.063974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:58.187633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057611+0000","last_change":"2024-09-19T04:14:33.308220+0000","last_active":"2024-09-19T04:16:47.057611+0000","last_peered":"2024-09-19T04:16:47.057611+0000","last_clean":"2024-09-19T04:16:47.057611+0000","last_became_active":"2024-09-19T04:14:33.307934+0000","last_became_peered":"2024-09-19T04:14:33.307934+0000","last_unstale":"2024-09-19T04:16:47.057611+0000","last_undegraded":"2024-09-19T04:16:47.057611+0000","last_fullsized":"2024-09-19T04:16:47.057611+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:22.490250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.062008+0000","last_change":"2024-09-19T04:14:33.306617+0000","last_active":"2024-09-19T04:16:47.062008+0000","last_peered":"2024-09-19T04:16:47.062008+0000","last_clean":"2024-09-19T04:16:47.062008+0000","last_became_active":"2024-09-19T04:14:33.306244+0000","last_became_peered":"2024-09-19T04:14:33.306244+0000","last_unstale":"2024-09-19T04:16:47.062008+0000","last_undegraded":"2024-09-19T04:16:47.062008+0000","last_fullsized":"2024-09-19T04:16:47.062008+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:22.095989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063298+0000","last_change":"2024-09-19T04:14:33.314915+0000","last_active":"2024-09-19T04:16:47.063298+0000","last_peered":"2024-09-19T04:16:47.063298+0000","last_clean":"2024-09-19T04:16:47.063298+0000","last_became_active":"2024-09-19T04:14:33.314601+0000","last_became_peered":"2024-09-19T04:14:33.314601+0000","last_unstale":"2024-09-19T04:16:47.063298+0000","last_undegraded":"2024-09-19T04:16:47.063298+0000","last_fullsized":"2024-09-19T04:16:47.063298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:37.687964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.135920+0000","last_change":"2024-09-19T04:14:33.304667+0000","last_active":"2024-09-19T04:16:47.135920+0000","last_peered":"2024-09-19T04:16:47.135920+0000","last_clean":"2024-09-19T04:16:47.135920+0000","last_became_active":"2024-09-19T04:14:33.304356+0000","last_became_peered":"2024-09-19T04:14:33.304356+0000","last_unstale":"2024-09-19T04:16:47.135920+0000","last_undegraded":"2024-09-19T04:16:47.135920+0000","last_fullsized":"2024-09-19T04:16:47.135920+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:37.128074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.061919+0000","last_change":"2024-09-19T04:14:33.310002+0000","last_active":"2024-09-19T04:16:47.061919+0000","last_peered":"2024-09-19T04:16:47.061919+0000","last_clean":"2024-09-19T04:16:47.061919+0000","last_became_active":"2024-09-19T04:14:33.309639+0000","last_became_peered":"2024-09-19T04:14:33.309639+0000","last_unstale":"2024-09-19T04:16:47.061919+0000","last_undegraded":"2024-09-19T04:16:47.061919+0000","last_fullsized":"2024-09-19T04:16:47.061919+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:21.954435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063291+0000","last_change":"2024-09-19T04:14:33.307296+0000","last_active":"2024-09-19T04:16:47.063291+0000","last_peered":"2024-09-19T04:16:47.063291+0000","last_clean":"2024-09-19T04:16:47.063291+0000","last_became_active":"2024-09-19T04:14:33.306998+0000","last_became_peered":"2024-09-19T04:14:33.306998+0000","last_unstale":"2024-09-19T04:16:47.063291+0000","last_undegraded":"2024-09-19T04:16:47.063291+0000","last_fullsized":"2024-09-19T04:16:47.063291+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:55.833196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.570628+0000","last_change":"2024-09-19T04:14:33.313568+0000","last_active":"2024-09-19T04:16:47.570628+0000","last_peered":"2024-09-19T04:16:47.570628+0000","last_clean":"2024-09-19T04:16:47.570628+0000","last_became_active":"2024-09-19T04:14:33.313228+0000","last_became_peered":"2024-09-19T04:14:33.313228+0000","last_unstale":"2024-09-19T04:16:47.570628+0000","last_undegraded":"2024-09-19T04:16:47.570628+0000","last_fullsized":"2024-09-19T04:16:47.570628+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:31:43.348866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.570568+0000","last_change":"2024-09-19T04:14:33.309745+0000","last_active":"2024-09-19T04:16:47.570568+0000","last_peered":"2024-09-19T04:16:47.570568+0000","last_clean":"2024-09-19T04:16:47.570568+0000","last_became_active":"2024-09-19T04:14:33.309327+0000","last_became_peered":"2024-09-19T04:14:33.309327+0000","last_unstale":"2024-09-19T04:16:47.570568+0000","last_undegraded":"2024-09-19T04:16:47.570568+0000","last_fullsized":"2024-09-19T04:16:47.570568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:05.081550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057569+0000","last_change":"2024-09-19T04:14:33.306186+0000","last_active":"2024-09-19T04:16:47.057569+0000","last_peered":"2024-09-19T04:16:47.057569+0000","last_clean":"2024-09-19T04:16:47.057569+0000","last_became_active":"2024-09-19T04:14:33.305865+0000","last_became_peered":"2024-09-19T04:14:33.305865+0000","last_unstale":"2024-09-19T04:16:47.057569+0000","last_undegraded":"2024-09-19T04:16:47.057569+0000","last_fullsized":"2024-09-19T04:16:47.057569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:33.054326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058771+0000","last_change":"2024-09-19T04:14:33.307667+0000","last_active":"2024-09-19T04:16:47.058771+0000","last_peered":"2024-09-19T04:16:47.058771+0000","last_clean":"2024-09-19T04:16:47.058771+0000","last_became_active":"2024-09-19T04:14:33.307315+0000","last_became_peered":"2024-09-19T04:14:33.307315+0000","last_unstale":"2024-09-19T04:16:47.058771+0000","last_undegraded":"2024-09-19T04:16:47.058771+0000","last_fullsized":"2024-09-19T04:16:47.058771+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:52.209438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067945+0000","last_change":"2024-09-19T04:14:33.312430+0000","last_active":"2024-09-19T04:16:47.067945+0000","last_peered":"2024-09-19T04:16:47.067945+0000","last_clean":"2024-09-19T04:16:47.067945+0000","last_became_active":"2024-09-19T04:14:33.311786+0000","last_became_peered":"2024-09-19T04:14:33.311786+0000","last_unstale":"2024-09-19T04:16:47.067945+0000","last_undegraded":"2024-09-19T04:16:47.067945+0000","last_fullsized":"2024-09-19T04:16:47.067945+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:17:25.785612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.136532+0000","last_change":"2024-09-19T04:14:33.310478+0000","last_active":"2024-09-19T04:16:47.136532+0000","last_peered":"2024-09-19T04:16:47.136532+0000","last_clean":"2024-09-19T04:16:47.136532+0000","last_became_active":"2024-09-19T04:14:33.309960+0000","last_became_peered":"2024-09-19T04:14:33.309960+0000","last_unstale":"2024-09-19T04:16:47.136532+0000","last_undegraded":"2024-09-19T04:16:47.136532+0000","last_fullsized":"2024-09-19T04:16:47.136532+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:37:43.008022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064064+0000","last_change":"2024-09-19T04:14:33.312449+0000","last_active":"2024-09-19T04:16:47.064064+0000","last_peered":"2024-09-19T04:16:47.064064+0000","last_clean":"2024-09-19T04:16:47.064064+0000","last_became_active":"2024-09-19T04:14:33.312124+0000","last_became_peered":"2024-09-19T04:14:33.312124+0000","last_unstale":"2024-09-19T04:16:47.064064+0000","last_undegraded":"2024-09-19T04:16:47.064064+0000","last_fullsized":"2024-09-19T04:16:47.064064+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:53.556895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063525+0000","last_change":"2024-09-19T04:14:33.317095+0000","last_active":"2024-09-19T04:16:47.063525+0000","last_peered":"2024-09-19T04:16:47.063525+0000","last_clean":"2024-09-19T04:16:47.063525+0000","last_became_active":"2024-09-19T04:14:33.316763+0000","last_became_peered":"2024-09-19T04:14:33.316763+0000","last_unstale":"2024-09-19T04:16:47.063525+0000","last_undegraded":"2024-09-19T04:16:47.063525+0000","last_fullsized":"2024-09-19T04:16:47.063525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:14.894679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067254+0000","last_change":"2024-09-19T04:14:33.316578+0000","last_active":"2024-09-19T04:16:47.067254+0000","last_peered":"2024-09-19T04:16:47.067254+0000","last_clean":"2024-09-19T04:16:47.067254+0000","last_became_active":"2024-09-19T04:14:33.316215+0000","last_became_peered":"2024-09-19T04:14:33.316215+0000","last_unstale":"2024-09-19T04:16:47.067254+0000","last_undegraded":"2024-09-19T04:16:47.067254+0000","last_fullsized":"2024-09-19T04:16:47.067254+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:18.770360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.136155+0000","last_change":"2024-09-19T04:15:47.000540+0000","last_active":"2024-09-19T04:16:47.136155+0000","last_peered":"2024-09-19T04:16:47.136155+0000","last_clean":"2024-09-19T04:16:47.136155+0000","last_became_active":"2024-09-19T04:15:47.000155+0000","last_became_peered":"2024-09-19T04:15:47.000155+0000","last_unstale":"2024-09-19T04:16:47.136155+0000","last_undegraded":"2024-09-19T04:16:47.136155+0000","last_fullsized":"2024-09-19T04:16:47.136155+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:19.055366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.059133+0000","last_change":"2024-09-19T04:14:33.309468+0000","last_active":"2024-09-19T04:16:47.059133+0000","last_peered":"2024-09-19T04:16:47.059133+0000","last_clean":"2024-09-19T04:16:47.059133+0000","last_became_active":"2024-09-19T04:14:33.309164+0000","last_became_peered":"2024-09-19T04:14:33.309164+0000","last_unstale":"2024-09-19T04:16:47.059133+0000","last_undegraded":"2024-09-19T04:16:47.059133+0000","last_fullsized":"2024-09-19T04:16:47.059133+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:05:19.193395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.135491+0000","last_change":"2024-09-19T04:15:47.342502+0000","last_active":"2024-09-19T04:16:47.135491+0000","last_peered":"2024-09-19T04:16:47.135491+0000","last_clean":"2024-09-19T04:16:47.135491+0000","last_became_active":"2024-09-19T04:15:47.342127+0000","last_became_peered":"2024-09-19T04:15:47.342127+0000","last_unstale":"2024-09-19T04:16:47.135491+0000","last_undegraded":"2024-09-19T04:16:47.135491+0000","last_fullsized":"2024-09-19T04:16:47.135491+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:47.192614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.570756+0000","last_change":"2024-09-19T04:14:33.308268+0000","last_active":"2024-09-19T04:16:47.570756+0000","last_peered":"2024-09-19T04:16:47.570756+0000","last_clean":"2024-09-19T04:16:47.570756+0000","last_became_active":"2024-09-19T04:14:33.307945+0000","last_became_peered":"2024-09-19T04:14:33.307945+0000","last_unstale":"2024-09-19T04:16:47.570756+0000","last_undegraded":"2024-09-19T04:16:47.570756+0000","last_fullsized":"2024-09-19T04:16:47.570756+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:24.410351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.570902+0000","last_change":"2024-09-19T04:14:33.315522+0000","last_active":"2024-09-19T04:16:47.570902+0000","last_peered":"2024-09-19T04:16:47.570902+0000","last_clean":"2024-09-19T04:16:47.570902+0000","last_became_active":"2024-09-19T04:14:33.315220+0000","last_became_peered":"2024-09-19T04:14:33.315220+0000","last_unstale":"2024-09-19T04:16:47.570902+0000","last_undegraded":"2024-09-19T04:16:47.570902+0000","last_fullsized":"2024-09-19T04:16:47.570902+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:41:40.915933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"88'8","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.061734+0000","last_change":"2024-09-19T04:14:33.309450+0000","last_active":"2024-09-19T04:16:47.061734+0000","last_peered":"2024-09-19T04:16:47.061734+0000","last_clean":"2024-09-19T04:16:47.061734+0000","last_became_active":"2024-09-19T04:14:33.309013+0000","last_became_peered":"2024-09-19T04:14:33.309013+0000","last_unstale":"2024-09-19T04:16:47.061734+0000","last_undegraded":"2024-09-19T04:16:47.061734+0000","last_fullsized":"2024-09-19T04:16:47.061734+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:49.523372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":80990,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1040,"num_read_kb":606,"num_write":275,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1204,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":232915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":235,"ondisk_log_size":235,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285207,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579947,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1003520,"data_stored":516143,"data_compressed":29678,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808880,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28156,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716996,"statfs":{"total":95995035648,"available":95966203904,"internally_reserved":0,"allocated":1150976,"data_stored":1168090,"data_compressed":65942,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972405,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":519587,"data_compressed":29678,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201337,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1015808,"data_stored":515287,"data_compressed":29678,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430270,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32232,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712920,"statfs":{"total":95995035648,"available":95962030080,"internally_reserved":0,"allocated":1073152,"data_stored":1114137,"data_compressed":65942,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593796,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":512230,"data_compressed":29678,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822729,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1081344,"data_stored":1107557,"data_compressed":65942,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986253,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1015808,"data_stored":516618,"data_compressed":29678,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215186,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":510703,"data_compressed":29678,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411415,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1081344,"data_stored":576494,"data_compressed":29678,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":578046,"data_compressed":29678,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738465,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1024000,"data_stored":512451,"data_compressed":29678,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34629,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34629,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34629,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":72873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":66221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":74676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T04:17:00.791 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T04:17:00.792 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T04:17:01.049 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:17:01.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:01 smithi007 ceph-mon[31360]: pgmap v357: 129 pgs: 129 active+clean; 656 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.0 KiB/s wr, 13 op/s; 100 B/s, 0 objects/s recovering 2024-09-19T04:17:01.358 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:01 smithi007 ceph-mon[31360]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-19T04:17:01.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:01 smithi102 ceph-mon[35446]: pgmap v357: 129 pgs: 129 active+clean; 656 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.0 KiB/s wr, 13 op/s; 100 B/s, 0 objects/s recovering 2024-09-19T04:17:01.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:01 smithi102 ceph-mon[35446]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-19T04:17:01.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:01 smithi092 ceph-mon[34940]: pgmap v357: 129 pgs: 129 active+clean; 656 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.0 KiB/s wr, 13 op/s; 100 B/s, 0 objects/s recovering 2024-09-19T04:17:01.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:01 smithi092 ceph-mon[34940]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-19T04:17:01.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.551+0000 7f9a9056a640 1 -- 172.21.15.7:0/1285194731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a88101de0 msgr2=0x7f9a881021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:01.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.551+0000 7f9a9056a640 1 --2- 172.21.15.7:0/1285194731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a88101de0 0x7f9a881021c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9a84009900 tx=0x7f9a8402a410 comp rx=0 tx=0).stop 2024-09-19T04:17:01.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.551+0000 7f9a9056a640 1 -- 172.21.15.7:0/1285194731 shutdown_connections 2024-09-19T04:17:01.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.551+0000 7f9a9056a640 1 --2- 172.21.15.7:0/1285194731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a88106f10 0x7f9a8810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:01.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.551+0000 7f9a9056a640 1 --2- 172.21.15.7:0/1285194731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a88102790 0x7f9a881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:01.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.551+0000 7f9a9056a640 1 --2- 172.21.15.7:0/1285194731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a88101de0 0x7f9a881021c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:01.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.551+0000 7f9a9056a640 1 -- 172.21.15.7:0/1285194731 >> 172.21.15.7:0/1285194731 conn(0x7f9a880fd8c0 msgr2=0x7f9a880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:01.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.551+0000 7f9a9056a640 1 -- 172.21.15.7:0/1285194731 shutdown_connections 2024-09-19T04:17:01.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.551+0000 7f9a9056a640 1 -- 172.21.15.7:0/1285194731 wait complete. 2024-09-19T04:17:01.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.552+0000 7f9a9056a640 1 Processor -- start 2024-09-19T04:17:01.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.552+0000 7f9a9056a640 1 -- start start 2024-09-19T04:17:01.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.552+0000 7f9a9056a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a88101de0 0x7f9a880744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:01.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.552+0000 7f9a9056a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a88102790 0x7f9a88074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:01.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.552+0000 7f9a9056a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a88106f10 0x7f9a88074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:01.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.552+0000 7f9a9056a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9a88111f70 con 0x7f9a88102790 2024-09-19T04:17:01.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.552+0000 7f9a9056a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9a88111df0 con 0x7f9a88101de0 2024-09-19T04:17:01.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.552+0000 7f9a9056a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9a881120f0 con 0x7f9a88106f10 2024-09-19T04:17:01.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.552+0000 7f9a8db05640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a88102790 0x7f9a88074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:01.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.552+0000 7f9a8db05640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a88102790 0x7f9a88074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57784/0 (socket says 172.21.15.7:57784) 2024-09-19T04:17:01.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.552+0000 7f9a8db05640 1 -- 172.21.15.7:0/3293806321 learned_addr learned my addr 172.21.15.7:0/3293806321 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:01.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.552+0000 7f9a8e306640 1 --2- 172.21.15.7:0/3293806321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a88101de0 0x7f9a880744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:01.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.552+0000 7f9a8eb07640 1 --2- 172.21.15.7:0/3293806321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a88106f10 0x7f9a88074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:01.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.553+0000 7f9a8db05640 1 -- 172.21.15.7:0/3293806321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a88106f10 msgr2=0x7f9a88074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:01.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.553+0000 7f9a8db05640 1 --2- 172.21.15.7:0/3293806321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a88106f10 0x7f9a88074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:01.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.553+0000 7f9a8db05640 1 -- 172.21.15.7:0/3293806321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a88101de0 msgr2=0x7f9a880744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:01.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.553+0000 7f9a8db05640 1 --2- 172.21.15.7:0/3293806321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a88101de0 0x7f9a880744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:01.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.553+0000 7f9a8db05640 1 -- 172.21.15.7:0/3293806321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a881a6890 con 0x7f9a88102790 2024-09-19T04:17:01.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.553+0000 7f9a8eb07640 1 --2- 172.21.15.7:0/3293806321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a88106f10 0x7f9a88074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:17:01.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.553+0000 7f9a8db05640 1 --2- 172.21.15.7:0/3293806321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a88102790 0x7f9a88074a30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800d950 tx=0x7f9a7800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:01.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.553+0000 7f9a7f7fe640 1 -- 172.21.15.7:0/3293806321 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a78017070 con 0x7f9a88102790 2024-09-19T04:17:01.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.553+0000 7f9a7f7fe640 1 -- 172.21.15.7:0/3293806321 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a78009c30 con 0x7f9a88102790 2024-09-19T04:17:01.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.553+0000 7f9a9056a640 1 -- 172.21.15.7:0/3293806321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a881a6b80 con 0x7f9a88102790 2024-09-19T04:17:01.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.553+0000 7f9a7f7fe640 1 -- 172.21.15.7:0/3293806321 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7800f6b0 con 0x7f9a88102790 2024-09-19T04:17:01.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.553+0000 7f9a9056a640 1 -- 172.21.15.7:0/3293806321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a881a70c0 con 0x7f9a88102790 2024-09-19T04:17:01.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.554+0000 7f9a9056a640 1 -- 172.21.15.7:0/3293806321 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a881021c0 con 0x7f9a88102790 2024-09-19T04:17:01.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.555+0000 7f9a7f7fe640 1 -- 172.21.15.7:0/3293806321 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f9a780109d0 con 0x7f9a88102790 2024-09-19T04:17:01.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.556+0000 7f9a7f7fe640 1 --2- 172.21.15.7:0/3293806321 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9a740a32d0 0x7f9a740a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:01.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.556+0000 7f9a7f7fe640 1 -- 172.21.15.7:0/3293806321 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f9a780cfa80 con 0x7f9a88102790 2024-09-19T04:17:01.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.556+0000 7f9a8e306640 1 --2- 172.21.15.7:0/3293806321 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9a740a32d0 0x7f9a740a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:01.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.557+0000 7f9a8e306640 1 --2- 172.21.15.7:0/3293806321 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9a740a32d0 0x7f9a740a5790 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9a84009230 tx=0x7f9a840058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:01.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.559+0000 7f9a7f7fe640 1 -- 172.21.15.7:0/3293806321 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9a78009de0 con 0x7f9a88102790 2024-09-19T04:17:01.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.730+0000 7f9a9056a640 1 -- 172.21.15.7:0/3293806321 --> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9a88062630 con 0x7f9a740a32d0 2024-09-19T04:17:01.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.738+0000 7f9a7f7fe640 1 -- 172.21.15.7:0/3293806321 <== mgr.14150 v2:172.21.15.7:6800/1262394163 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340815 (secure 0 0 0) 0x7f9a88062630 con 0x7f9a740a32d0 2024-09-19T04:17:01.744 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:17:01.745 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-19T04:17:01.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.742+0000 7f9a9056a640 1 -- 172.21.15.7:0/3293806321 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9a740a32d0 msgr2=0x7f9a740a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:01.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.742+0000 7f9a9056a640 1 --2- 172.21.15.7:0/3293806321 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9a740a32d0 0x7f9a740a5790 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9a84009230 tx=0x7f9a840058d0 comp rx=0 tx=0).stop 2024-09-19T04:17:01.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.742+0000 7f9a9056a640 1 -- 172.21.15.7:0/3293806321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a88102790 msgr2=0x7f9a88074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:01.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.742+0000 7f9a9056a640 1 --2- 172.21.15.7:0/3293806321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a88102790 0x7f9a88074a30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800d950 tx=0x7f9a7800de10 comp rx=0 tx=0).stop 2024-09-19T04:17:01.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.742+0000 7f9a9056a640 1 -- 172.21.15.7:0/3293806321 shutdown_connections 2024-09-19T04:17:01.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.742+0000 7f9a9056a640 1 --2- 172.21.15.7:0/3293806321 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9a740a32d0 0x7f9a740a5790 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:01.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.742+0000 7f9a9056a640 1 --2- 172.21.15.7:0/3293806321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a88106f10 0x7f9a88074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:01.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.742+0000 7f9a9056a640 1 --2- 172.21.15.7:0/3293806321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a88102790 0x7f9a88074a30 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:01.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.742+0000 7f9a9056a640 1 --2- 172.21.15.7:0/3293806321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a88101de0 0x7f9a880744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:01.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.742+0000 7f9a9056a640 1 -- 172.21.15.7:0/3293806321 >> 172.21.15.7:0/3293806321 conn(0x7f9a880fd8c0 msgr2=0x7f9a880febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:01.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.743+0000 7f9a9056a640 1 -- 172.21.15.7:0/3293806321 shutdown_connections 2024-09-19T04:17:01.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:01.743+0000 7f9a9056a640 1 -- 172.21.15.7:0/3293806321 wait complete. 2024-09-19T04:17:02.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:02 smithi007 ceph-mon[31360]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:17:02.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:02 smithi102 ceph-mon[35446]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:17:02.420 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":358,"stamp":"2024-09-19T04:17:01.157532+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":671592,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1171,"num_read_kb":715,"num_write":458,"num_write_kb":3109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1181940,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":874,"ondisk_log_size":874,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":357388,"kb_used_data":12268,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124584436,"statfs":{"total":1151940427776,"available":1151574462464,"internally_reserved":0,"allocated":12562432,"data_stored":8154878,"data_compressed":464928,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19141,"internal_metadata":353154363},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8629,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":53,"num_write":15,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003393"},"pg_stats":[{"pgid":"2.1f","version":"88'14","reported_seq":155,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:56.962226+0000","last_change":"2024-09-19T04:14:31.294836+0000","last_active":"2024-09-19T04:16:56.962226+0000","last_peered":"2024-09-19T04:16:56.962226+0000","last_clean":"2024-09-19T04:16:56.962226+0000","last_became_active":"2024-09-19T04:14:31.294589+0000","last_became_peered":"2024-09-19T04:14:31.294589+0000","last_unstale":"2024-09-19T04:16:56.962226+0000","last_undegraded":"2024-09-19T04:16:56.962226+0000","last_fullsized":"2024-09-19T04:16:56.962226+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:39:54.093519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063986+0000","last_change":"2024-09-19T04:14:33.316023+0000","last_active":"2024-09-19T04:16:47.063986+0000","last_peered":"2024-09-19T04:16:47.063986+0000","last_clean":"2024-09-19T04:16:47.063986+0000","last_became_active":"2024-09-19T04:14:33.315732+0000","last_became_peered":"2024-09-19T04:14:33.315732+0000","last_unstale":"2024-09-19T04:16:47.063986+0000","last_undegraded":"2024-09-19T04:16:47.063986+0000","last_fullsized":"2024-09-19T04:16:47.063986+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:00.782788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.062795+0000","last_change":"2024-09-19T04:14:40.368540+0000","last_active":"2024-09-19T04:16:47.062795+0000","last_peered":"2024-09-19T04:16:47.062795+0000","last_clean":"2024-09-19T04:16:47.062795+0000","last_became_active":"2024-09-19T04:14:40.367906+0000","last_became_peered":"2024-09-19T04:14:40.367906+0000","last_unstale":"2024-09-19T04:16:47.062795+0000","last_undegraded":"2024-09-19T04:16:47.062795+0000","last_fullsized":"2024-09-19T04:16:47.062795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:35.660297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064184+0000","last_change":"2024-09-19T04:14:31.321870+0000","last_active":"2024-09-19T04:16:47.064184+0000","last_peered":"2024-09-19T04:16:47.064184+0000","last_clean":"2024-09-19T04:16:47.064184+0000","last_became_active":"2024-09-19T04:14:31.321495+0000","last_became_peered":"2024-09-19T04:14:31.321495+0000","last_unstale":"2024-09-19T04:16:47.064184+0000","last_undegraded":"2024-09-19T04:16:47.064184+0000","last_fullsized":"2024-09-19T04:16:47.064184+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:58.063748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.571064+0000","last_change":"2024-09-19T04:14:33.307451+0000","last_active":"2024-09-19T04:16:47.571064+0000","last_peered":"2024-09-19T04:16:47.571064+0000","last_clean":"2024-09-19T04:16:47.571064+0000","last_became_active":"2024-09-19T04:14:33.307129+0000","last_became_peered":"2024-09-19T04:14:33.307129+0000","last_unstale":"2024-09-19T04:16:47.571064+0000","last_undegraded":"2024-09-19T04:16:47.571064+0000","last_fullsized":"2024-09-19T04:16:47.571064+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:28.851012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064923+0000","last_change":"2024-09-19T04:16:47.064923+0000","last_active":"2024-09-19T04:16:47.064923+0000","last_peered":"2024-09-19T04:16:47.064923+0000","last_clean":"2024-09-19T04:16:47.064923+0000","last_became_active":"2024-09-19T04:16:47.064455+0000","last_became_peered":"2024-09-19T04:16:47.064455+0000","last_unstale":"2024-09-19T04:16:47.064923+0000","last_undegraded":"2024-09-19T04:16:47.064923+0000","last_fullsized":"2024-09-19T04:16:47.064923+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:54.446799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'13","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.059712+0000","last_change":"2024-09-19T04:14:31.298497+0000","last_active":"2024-09-19T04:16:47.059712+0000","last_peered":"2024-09-19T04:16:47.059712+0000","last_clean":"2024-09-19T04:16:47.059712+0000","last_became_active":"2024-09-19T04:14:31.298185+0000","last_became_peered":"2024-09-19T04:14:31.298185+0000","last_unstale":"2024-09-19T04:16:47.059712+0000","last_undegraded":"2024-09-19T04:16:47.059712+0000","last_fullsized":"2024-09-19T04:16:47.059712+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:56:12.701718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063565+0000","last_change":"2024-09-19T04:14:33.316922+0000","last_active":"2024-09-19T04:16:47.063565+0000","last_peered":"2024-09-19T04:16:47.063565+0000","last_clean":"2024-09-19T04:16:47.063565+0000","last_became_active":"2024-09-19T04:14:33.316613+0000","last_became_peered":"2024-09-19T04:14:33.316613+0000","last_unstale":"2024-09-19T04:16:47.063565+0000","last_undegraded":"2024-09-19T04:16:47.063565+0000","last_fullsized":"2024-09-19T04:16:47.063565+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:22.237900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058493+0000","last_change":"2024-09-19T04:15:47.000772+0000","last_active":"2024-09-19T04:16:47.058493+0000","last_peered":"2024-09-19T04:16:47.058493+0000","last_clean":"2024-09-19T04:16:47.058493+0000","last_became_active":"2024-09-19T04:15:47.000316+0000","last_became_peered":"2024-09-19T04:15:47.000316+0000","last_unstale":"2024-09-19T04:16:47.058493+0000","last_undegraded":"2024-09-19T04:16:47.058493+0000","last_fullsized":"2024-09-19T04:16:47.058493+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:03.292714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.077203+0000","last_change":"2024-09-19T04:16:47.076757+0000","last_active":"2024-09-19T04:16:47.077203+0000","last_peered":"2024-09-19T04:16:47.077203+0000","last_clean":"2024-09-19T04:16:47.077203+0000","last_became_active":"2024-09-19T04:16:47.067225+0000","last_became_peered":"2024-09-19T04:16:47.067225+0000","last_unstale":"2024-09-19T04:16:47.077203+0000","last_undegraded":"2024-09-19T04:16:47.077203+0000","last_fullsized":"2024-09-19T04:16:47.077203+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:38.370696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064150+0000","last_change":"2024-09-19T04:14:33.313560+0000","last_active":"2024-09-19T04:16:47.064150+0000","last_peered":"2024-09-19T04:16:47.064150+0000","last_clean":"2024-09-19T04:16:47.064150+0000","last_became_active":"2024-09-19T04:14:33.313200+0000","last_became_peered":"2024-09-19T04:14:33.313200+0000","last_unstale":"2024-09-19T04:16:47.064150+0000","last_undegraded":"2024-09-19T04:16:47.064150+0000","last_fullsized":"2024-09-19T04:16:47.064150+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:33.807866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058389+0000","last_change":"2024-09-19T04:14:40.368125+0000","last_active":"2024-09-19T04:16:47.058389+0000","last_peered":"2024-09-19T04:16:47.058389+0000","last_clean":"2024-09-19T04:16:47.058389+0000","last_became_active":"2024-09-19T04:14:40.367772+0000","last_became_peered":"2024-09-19T04:14:40.367772+0000","last_unstale":"2024-09-19T04:16:47.058389+0000","last_undegraded":"2024-09-19T04:16:47.058389+0000","last_fullsized":"2024-09-19T04:16:47.058389+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:07:19.740391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067353+0000","last_change":"2024-09-19T04:14:33.307489+0000","last_active":"2024-09-19T04:16:47.067353+0000","last_peered":"2024-09-19T04:16:47.067353+0000","last_clean":"2024-09-19T04:16:47.067353+0000","last_became_active":"2024-09-19T04:14:33.307143+0000","last_became_peered":"2024-09-19T04:14:33.307143+0000","last_unstale":"2024-09-19T04:16:47.067353+0000","last_undegraded":"2024-09-19T04:16:47.067353+0000","last_fullsized":"2024-09-19T04:16:47.067353+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:51:14.018972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.059318+0000","last_change":"2024-09-19T04:14:31.299342+0000","last_active":"2024-09-19T04:16:47.059318+0000","last_peered":"2024-09-19T04:16:47.059318+0000","last_clean":"2024-09-19T04:16:47.059318+0000","last_became_active":"2024-09-19T04:14:31.298927+0000","last_became_peered":"2024-09-19T04:14:31.298927+0000","last_unstale":"2024-09-19T04:16:47.059318+0000","last_undegraded":"2024-09-19T04:16:47.059318+0000","last_fullsized":"2024-09-19T04:16:47.059318+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:38.483077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058702+0000","last_change":"2024-09-19T04:14:40.405762+0000","last_active":"2024-09-19T04:16:47.058702+0000","last_peered":"2024-09-19T04:16:47.058702+0000","last_clean":"2024-09-19T04:16:47.058702+0000","last_became_active":"2024-09-19T04:14:40.405379+0000","last_became_peered":"2024-09-19T04:14:40.405379+0000","last_unstale":"2024-09-19T04:16:47.058702+0000","last_undegraded":"2024-09-19T04:16:47.058702+0000","last_fullsized":"2024-09-19T04:16:47.058702+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:41:36.628112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063612+0000","last_change":"2024-09-19T04:14:33.318521+0000","last_active":"2024-09-19T04:16:47.063612+0000","last_peered":"2024-09-19T04:16:47.063612+0000","last_clean":"2024-09-19T04:16:47.063612+0000","last_became_active":"2024-09-19T04:14:33.318200+0000","last_became_peered":"2024-09-19T04:14:33.318200+0000","last_unstale":"2024-09-19T04:16:47.063612+0000","last_undegraded":"2024-09-19T04:16:47.063612+0000","last_fullsized":"2024-09-19T04:16:47.063612+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:45.497455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"90'4","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.966922+0000","last_change":"2024-09-19T04:16:47.071492+0000","last_active":"2024-09-19T04:16:47.966922+0000","last_peered":"2024-09-19T04:16:47.966922+0000","last_clean":"2024-09-19T04:16:47.966922+0000","last_became_active":"2024-09-19T04:16:47.066432+0000","last_became_peered":"2024-09-19T04:16:47.066432+0000","last_unstale":"2024-09-19T04:16:47.966922+0000","last_undegraded":"2024-09-19T04:16:47.966922+0000","last_fullsized":"2024-09-19T04:16:47.966922+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:33.096458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"86'1","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058887+0000","last_change":"2024-09-19T04:14:40.366110+0000","last_active":"2024-09-19T04:16:47.058887+0000","last_peered":"2024-09-19T04:16:47.058887+0000","last_clean":"2024-09-19T04:16:47.058887+0000","last_became_active":"2024-09-19T04:14:40.365558+0000","last_became_peered":"2024-09-19T04:14:40.365558+0000","last_unstale":"2024-09-19T04:16:47.058887+0000","last_undegraded":"2024-09-19T04:16:47.058887+0000","last_fullsized":"2024-09-19T04:16:47.058887+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:24.049603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.060993+0000","last_change":"2024-09-19T04:14:33.307400+0000","last_active":"2024-09-19T04:16:47.060993+0000","last_peered":"2024-09-19T04:16:47.060993+0000","last_clean":"2024-09-19T04:16:47.060993+0000","last_became_active":"2024-09-19T04:14:33.307095+0000","last_became_peered":"2024-09-19T04:14:33.307095+0000","last_unstale":"2024-09-19T04:16:47.060993+0000","last_undegraded":"2024-09-19T04:16:47.060993+0000","last_fullsized":"2024-09-19T04:16:47.060993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:27.582568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063516+0000","last_change":"2024-09-19T04:14:31.287190+0000","last_active":"2024-09-19T04:16:47.063516+0000","last_peered":"2024-09-19T04:16:47.063516+0000","last_clean":"2024-09-19T04:16:47.063516+0000","last_became_active":"2024-09-19T04:14:31.286817+0000","last_became_peered":"2024-09-19T04:14:31.286817+0000","last_unstale":"2024-09-19T04:16:47.063516+0000","last_undegraded":"2024-09-19T04:16:47.063516+0000","last_fullsized":"2024-09-19T04:16:47.063516+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:44.522615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.135735+0000","last_change":"2024-09-19T04:14:40.372153+0000","last_active":"2024-09-19T04:16:47.135735+0000","last_peered":"2024-09-19T04:16:47.135735+0000","last_clean":"2024-09-19T04:16:47.135735+0000","last_became_active":"2024-09-19T04:14:40.371309+0000","last_became_peered":"2024-09-19T04:14:40.371309+0000","last_unstale":"2024-09-19T04:16:47.135735+0000","last_undegraded":"2024-09-19T04:16:47.135735+0000","last_fullsized":"2024-09-19T04:16:47.135735+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:09:46.608489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058954+0000","last_change":"2024-09-19T04:14:33.310884+0000","last_active":"2024-09-19T04:16:47.058954+0000","last_peered":"2024-09-19T04:16:47.058954+0000","last_clean":"2024-09-19T04:16:47.058954+0000","last_became_active":"2024-09-19T04:14:33.310532+0000","last_became_peered":"2024-09-19T04:14:33.310532+0000","last_unstale":"2024-09-19T04:16:47.058954+0000","last_undegraded":"2024-09-19T04:16:47.058954+0000","last_fullsized":"2024-09-19T04:16:47.058954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:49:16.565018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063454+0000","last_change":"2024-09-19T04:14:31.322216+0000","last_active":"2024-09-19T04:16:47.063454+0000","last_peered":"2024-09-19T04:16:47.063454+0000","last_clean":"2024-09-19T04:16:47.063454+0000","last_became_active":"2024-09-19T04:14:31.321941+0000","last_became_peered":"2024-09-19T04:14:31.321941+0000","last_unstale":"2024-09-19T04:16:47.063454+0000","last_undegraded":"2024-09-19T04:16:47.063454+0000","last_fullsized":"2024-09-19T04:16:47.063454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:14.624104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058857+0000","last_change":"2024-09-19T04:14:40.405749+0000","last_active":"2024-09-19T04:16:47.058857+0000","last_peered":"2024-09-19T04:16:47.058857+0000","last_clean":"2024-09-19T04:16:47.058857+0000","last_became_active":"2024-09-19T04:14:40.405353+0000","last_became_peered":"2024-09-19T04:14:40.405353+0000","last_unstale":"2024-09-19T04:16:47.058857+0000","last_undegraded":"2024-09-19T04:16:47.058857+0000","last_fullsized":"2024-09-19T04:16:47.058857+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:13.311989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.571027+0000","last_change":"2024-09-19T04:14:33.312057+0000","last_active":"2024-09-19T04:16:47.571027+0000","last_peered":"2024-09-19T04:16:47.571027+0000","last_clean":"2024-09-19T04:16:47.571027+0000","last_became_active":"2024-09-19T04:14:33.311751+0000","last_became_peered":"2024-09-19T04:14:33.311751+0000","last_unstale":"2024-09-19T04:16:47.571027+0000","last_undegraded":"2024-09-19T04:16:47.571027+0000","last_fullsized":"2024-09-19T04:16:47.571027+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:08:28.843870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058939+0000","last_change":"2024-09-19T04:14:31.287529+0000","last_active":"2024-09-19T04:16:47.058939+0000","last_peered":"2024-09-19T04:16:47.058939+0000","last_clean":"2024-09-19T04:16:47.058939+0000","last_became_active":"2024-09-19T04:14:31.287172+0000","last_became_peered":"2024-09-19T04:14:31.287172+0000","last_unstale":"2024-09-19T04:16:47.058939+0000","last_undegraded":"2024-09-19T04:16:47.058939+0000","last_fullsized":"2024-09-19T04:16:47.058939+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:32:23.351997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063528+0000","last_change":"2024-09-19T04:14:40.363772+0000","last_active":"2024-09-19T04:16:47.063528+0000","last_peered":"2024-09-19T04:16:47.063528+0000","last_clean":"2024-09-19T04:16:47.063528+0000","last_became_active":"2024-09-19T04:14:40.363395+0000","last_became_peered":"2024-09-19T04:14:40.363395+0000","last_unstale":"2024-09-19T04:16:47.063528+0000","last_undegraded":"2024-09-19T04:16:47.063528+0000","last_fullsized":"2024-09-19T04:16:47.063528+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:22.090743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064210+0000","last_change":"2024-09-19T04:14:33.310108+0000","last_active":"2024-09-19T04:16:47.064210+0000","last_peered":"2024-09-19T04:16:47.064210+0000","last_clean":"2024-09-19T04:16:47.064210+0000","last_became_active":"2024-09-19T04:14:33.309812+0000","last_became_peered":"2024-09-19T04:14:33.309812+0000","last_unstale":"2024-09-19T04:16:47.064210+0000","last_undegraded":"2024-09-19T04:16:47.064210+0000","last_fullsized":"2024-09-19T04:16:47.064210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:48.570530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'19","reported_seq":58,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:56.346828+0000","last_change":"2024-09-19T04:14:31.293115+0000","last_active":"2024-09-19T04:16:56.346828+0000","last_peered":"2024-09-19T04:16:56.346828+0000","last_clean":"2024-09-19T04:16:56.346828+0000","last_became_active":"2024-09-19T04:14:31.292733+0000","last_became_peered":"2024-09-19T04:14:31.292733+0000","last_unstale":"2024-09-19T04:16:56.346828+0000","last_undegraded":"2024-09-19T04:16:56.346828+0000","last_fullsized":"2024-09-19T04:16:56.346828+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:11.936757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063704+0000","last_change":"2024-09-19T04:14:40.405241+0000","last_active":"2024-09-19T04:16:47.063704+0000","last_peered":"2024-09-19T04:16:47.063704+0000","last_clean":"2024-09-19T04:16:47.063704+0000","last_became_active":"2024-09-19T04:14:40.404846+0000","last_became_peered":"2024-09-19T04:14:40.404846+0000","last_unstale":"2024-09-19T04:16:47.063704+0000","last_undegraded":"2024-09-19T04:16:47.063704+0000","last_fullsized":"2024-09-19T04:16:47.063704+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:49.842644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057711+0000","last_change":"2024-09-19T04:14:33.305796+0000","last_active":"2024-09-19T04:16:47.057711+0000","last_peered":"2024-09-19T04:16:47.057711+0000","last_clean":"2024-09-19T04:16:47.057711+0000","last_became_active":"2024-09-19T04:14:33.305499+0000","last_became_peered":"2024-09-19T04:14:33.305499+0000","last_unstale":"2024-09-19T04:16:47.057711+0000","last_undegraded":"2024-09-19T04:16:47.057711+0000","last_fullsized":"2024-09-19T04:16:47.057711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:08.357655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.059737+0000","last_change":"2024-09-19T04:14:31.322459+0000","last_active":"2024-09-19T04:16:47.059737+0000","last_peered":"2024-09-19T04:16:47.059737+0000","last_clean":"2024-09-19T04:16:47.059737+0000","last_became_active":"2024-09-19T04:14:31.322149+0000","last_became_peered":"2024-09-19T04:14:31.322149+0000","last_unstale":"2024-09-19T04:16:47.059737+0000","last_undegraded":"2024-09-19T04:16:47.059737+0000","last_fullsized":"2024-09-19T04:16:47.059737+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:06:15.208618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.061247+0000","last_change":"2024-09-19T04:14:40.372869+0000","last_active":"2024-09-19T04:16:47.061247+0000","last_peered":"2024-09-19T04:16:47.061247+0000","last_clean":"2024-09-19T04:16:47.061247+0000","last_became_active":"2024-09-19T04:14:40.372203+0000","last_became_peered":"2024-09-19T04:14:40.372203+0000","last_unstale":"2024-09-19T04:16:47.061247+0000","last_undegraded":"2024-09-19T04:16:47.061247+0000","last_fullsized":"2024-09-19T04:16:47.061247+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:34.900656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"88'4","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.136056+0000","last_change":"2024-09-19T04:14:33.315443+0000","last_active":"2024-09-19T04:16:47.136056+0000","last_peered":"2024-09-19T04:16:47.136056+0000","last_clean":"2024-09-19T04:16:47.136056+0000","last_became_active":"2024-09-19T04:14:33.315067+0000","last_became_peered":"2024-09-19T04:14:33.315067+0000","last_unstale":"2024-09-19T04:16:47.136056+0000","last_undegraded":"2024-09-19T04:16:47.136056+0000","last_fullsized":"2024-09-19T04:16:47.136056+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:59.194674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.135801+0000","last_change":"2024-09-19T04:14:31.322623+0000","last_active":"2024-09-19T04:16:47.135801+0000","last_peered":"2024-09-19T04:16:47.135801+0000","last_clean":"2024-09-19T04:16:47.135801+0000","last_became_active":"2024-09-19T04:14:31.321838+0000","last_became_peered":"2024-09-19T04:14:31.321838+0000","last_unstale":"2024-09-19T04:16:47.135801+0000","last_undegraded":"2024-09-19T04:16:47.135801+0000","last_fullsized":"2024-09-19T04:16:47.135801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:30:37.073072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.059147+0000","last_change":"2024-09-19T04:15:47.343430+0000","last_active":"2024-09-19T04:16:47.059147+0000","last_peered":"2024-09-19T04:16:47.059147+0000","last_clean":"2024-09-19T04:16:47.059147+0000","last_became_active":"2024-09-19T04:15:47.342319+0000","last_became_peered":"2024-09-19T04:15:47.342319+0000","last_unstale":"2024-09-19T04:16:47.059147+0000","last_undegraded":"2024-09-19T04:16:47.059147+0000","last_fullsized":"2024-09-19T04:16:47.059147+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:05.641357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.136056+0000","last_change":"2024-09-19T04:14:33.319748+0000","last_active":"2024-09-19T04:16:47.136056+0000","last_peered":"2024-09-19T04:16:47.136056+0000","last_clean":"2024-09-19T04:16:47.136056+0000","last_became_active":"2024-09-19T04:14:33.319173+0000","last_became_peered":"2024-09-19T04:14:33.319173+0000","last_unstale":"2024-09-19T04:16:47.136056+0000","last_undegraded":"2024-09-19T04:16:47.136056+0000","last_fullsized":"2024-09-19T04:16:47.136056+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:24.419811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"90'9","reported_seq":154,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:57.964172+0000","last_change":"2024-09-19T04:14:31.292077+0000","last_active":"2024-09-19T04:16:57.964172+0000","last_peered":"2024-09-19T04:16:57.964172+0000","last_clean":"2024-09-19T04:16:57.964172+0000","last_became_active":"2024-09-19T04:14:31.291737+0000","last_became_peered":"2024-09-19T04:14:31.291737+0000","last_unstale":"2024-09-19T04:16:57.964172+0000","last_undegraded":"2024-09-19T04:16:57.964172+0000","last_fullsized":"2024-09-19T04:16:57.964172+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:32.570641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1823,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057613+0000","last_change":"2024-09-19T04:14:40.369734+0000","last_active":"2024-09-19T04:16:47.057613+0000","last_peered":"2024-09-19T04:16:47.057613+0000","last_clean":"2024-09-19T04:16:47.057613+0000","last_became_active":"2024-09-19T04:14:40.367563+0000","last_became_peered":"2024-09-19T04:14:40.367563+0000","last_unstale":"2024-09-19T04:16:47.057613+0000","last_undegraded":"2024-09-19T04:16:47.057613+0000","last_fullsized":"2024-09-19T04:16:47.057613+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:47.229115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063672+0000","last_change":"2024-09-19T04:14:33.309687+0000","last_active":"2024-09-19T04:16:47.063672+0000","last_peered":"2024-09-19T04:16:47.063672+0000","last_clean":"2024-09-19T04:16:47.063672+0000","last_became_active":"2024-09-19T04:14:33.308692+0000","last_became_peered":"2024-09-19T04:14:33.308692+0000","last_unstale":"2024-09-19T04:16:47.063672+0000","last_undegraded":"2024-09-19T04:16:47.063672+0000","last_fullsized":"2024-09-19T04:16:47.063672+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:58.716927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'6","reported_seq":146,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:55.985718+0000","last_change":"2024-09-19T04:14:31.322024+0000","last_active":"2024-09-19T04:16:55.985718+0000","last_peered":"2024-09-19T04:16:55.985718+0000","last_clean":"2024-09-19T04:16:55.985718+0000","last_became_active":"2024-09-19T04:14:31.321640+0000","last_became_peered":"2024-09-19T04:14:31.321640+0000","last_unstale":"2024-09-19T04:16:55.985718+0000","last_undegraded":"2024-09-19T04:16:55.985718+0000","last_fullsized":"2024-09-19T04:16:55.985718+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:25:36.159774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057744+0000","last_change":"2024-09-19T04:14:40.405793+0000","last_active":"2024-09-19T04:16:47.057744+0000","last_peered":"2024-09-19T04:16:47.057744+0000","last_clean":"2024-09-19T04:16:47.057744+0000","last_became_active":"2024-09-19T04:14:40.405354+0000","last_became_peered":"2024-09-19T04:14:40.405354+0000","last_unstale":"2024-09-19T04:16:47.057744+0000","last_undegraded":"2024-09-19T04:16:47.057744+0000","last_fullsized":"2024-09-19T04:16:47.057744+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:46:37.893202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057180+0000","last_change":"2024-09-19T04:14:33.313007+0000","last_active":"2024-09-19T04:16:47.057180+0000","last_peered":"2024-09-19T04:16:47.057180+0000","last_clean":"2024-09-19T04:16:47.057180+0000","last_became_active":"2024-09-19T04:14:33.312665+0000","last_became_peered":"2024-09-19T04:14:33.312665+0000","last_unstale":"2024-09-19T04:16:47.057180+0000","last_undegraded":"2024-09-19T04:16:47.057180+0000","last_fullsized":"2024-09-19T04:16:47.057180+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:09.976707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067276+0000","last_change":"2024-09-19T04:14:31.294072+0000","last_active":"2024-09-19T04:16:47.067276+0000","last_peered":"2024-09-19T04:16:47.067276+0000","last_clean":"2024-09-19T04:16:47.067276+0000","last_became_active":"2024-09-19T04:14:31.293648+0000","last_became_peered":"2024-09-19T04:14:31.293648+0000","last_unstale":"2024-09-19T04:16:47.067276+0000","last_undegraded":"2024-09-19T04:16:47.067276+0000","last_fullsized":"2024-09-19T04:16:47.067276+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:14.910714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.065167+0000","last_change":"2024-09-19T04:14:40.406327+0000","last_active":"2024-09-19T04:16:47.065167+0000","last_peered":"2024-09-19T04:16:47.065167+0000","last_clean":"2024-09-19T04:16:47.065167+0000","last_became_active":"2024-09-19T04:14:40.405602+0000","last_became_peered":"2024-09-19T04:14:40.405602+0000","last_unstale":"2024-09-19T04:16:47.065167+0000","last_undegraded":"2024-09-19T04:16:47.065167+0000","last_fullsized":"2024-09-19T04:16:47.065167+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:47:23.078480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.135349+0000","last_change":"2024-09-19T04:15:47.342605+0000","last_active":"2024-09-19T04:16:47.135349+0000","last_peered":"2024-09-19T04:16:47.135349+0000","last_clean":"2024-09-19T04:16:47.135349+0000","last_became_active":"2024-09-19T04:15:47.342215+0000","last_became_peered":"2024-09-19T04:15:47.342215+0000","last_unstale":"2024-09-19T04:16:47.135349+0000","last_undegraded":"2024-09-19T04:16:47.135349+0000","last_fullsized":"2024-09-19T04:16:47.135349+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:01.315513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,1],"acting":[9,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058993+0000","last_change":"2024-09-19T04:14:31.290207+0000","last_active":"2024-09-19T04:16:47.058993+0000","last_peered":"2024-09-19T04:16:47.058993+0000","last_clean":"2024-09-19T04:16:47.058993+0000","last_became_active":"2024-09-19T04:14:31.289863+0000","last_became_peered":"2024-09-19T04:14:31.289863+0000","last_unstale":"2024-09-19T04:16:47.058993+0000","last_undegraded":"2024-09-19T04:16:47.058993+0000","last_fullsized":"2024-09-19T04:16:47.058993+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:39.241894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":351,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067362+0000","last_change":"2024-09-19T04:13:20.845240+0000","last_active":"2024-09-19T04:16:47.067362+0000","last_peered":"2024-09-19T04:16:47.067362+0000","last_clean":"2024-09-19T04:16:47.067362+0000","last_became_active":"2024-09-19T04:13:20.844771+0000","last_became_peered":"2024-09-19T04:13:20.844771+0000","last_unstale":"2024-09-19T04:16:47.067362+0000","last_undegraded":"2024-09-19T04:16:47.067362+0000","last_fullsized":"2024-09-19T04:16:47.067362+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:09:59.809148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:09:59.809148+0000","last_clean_scrub_stamp":"2024-09-19T04:09:59.809148+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:12:29.694263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"86'1","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067926+0000","last_change":"2024-09-19T04:14:40.369257+0000","last_active":"2024-09-19T04:16:47.067926+0000","last_peered":"2024-09-19T04:16:47.067926+0000","last_clean":"2024-09-19T04:16:47.067926+0000","last_became_active":"2024-09-19T04:14:40.368865+0000","last_became_peered":"2024-09-19T04:14:40.368865+0000","last_unstale":"2024-09-19T04:16:47.067926+0000","last_undegraded":"2024-09-19T04:16:47.067926+0000","last_fullsized":"2024-09-19T04:16:47.067926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:37:52.120157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.068065+0000","last_change":"2024-09-19T04:14:33.311221+0000","last_active":"2024-09-19T04:16:47.068065+0000","last_peered":"2024-09-19T04:16:47.068065+0000","last_clean":"2024-09-19T04:16:47.068065+0000","last_became_active":"2024-09-19T04:14:33.310886+0000","last_became_peered":"2024-09-19T04:14:33.310886+0000","last_unstale":"2024-09-19T04:16:47.068065+0000","last_undegraded":"2024-09-19T04:16:47.068065+0000","last_fullsized":"2024-09-19T04:16:47.068065+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:04:32.348676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":148,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:58.000119+0000","last_change":"2024-09-19T04:14:31.322464+0000","last_active":"2024-09-19T04:16:58.000119+0000","last_peered":"2024-09-19T04:16:58.000119+0000","last_clean":"2024-09-19T04:16:58.000119+0000","last_became_active":"2024-09-19T04:14:31.322115+0000","last_became_peered":"2024-09-19T04:14:31.322115+0000","last_unstale":"2024-09-19T04:16:58.000119+0000","last_undegraded":"2024-09-19T04:16:58.000119+0000","last_fullsized":"2024-09-19T04:16:58.000119+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:24:27.623328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063926+0000","last_change":"2024-09-19T04:14:40.371391+0000","last_active":"2024-09-19T04:16:47.063926+0000","last_peered":"2024-09-19T04:16:47.063926+0000","last_clean":"2024-09-19T04:16:47.063926+0000","last_became_active":"2024-09-19T04:14:40.371091+0000","last_became_peered":"2024-09-19T04:14:40.371091+0000","last_unstale":"2024-09-19T04:16:47.063926+0000","last_undegraded":"2024-09-19T04:16:47.063926+0000","last_fullsized":"2024-09-19T04:16:47.063926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:39:14.889348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"88'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067617+0000","last_change":"2024-09-19T04:15:47.003652+0000","last_active":"2024-09-19T04:16:47.067617+0000","last_peered":"2024-09-19T04:16:47.067617+0000","last_clean":"2024-09-19T04:16:47.067617+0000","last_became_active":"2024-09-19T04:15:47.003226+0000","last_became_peered":"2024-09-19T04:15:47.003226+0000","last_unstale":"2024-09-19T04:16:47.067617+0000","last_undegraded":"2024-09-19T04:16:47.067617+0000","last_fullsized":"2024-09-19T04:16:47.067617+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:38.948427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.065509+0000","last_change":"2024-09-19T04:14:31.293156+0000","last_active":"2024-09-19T04:16:47.065509+0000","last_peered":"2024-09-19T04:16:47.065509+0000","last_clean":"2024-09-19T04:16:47.065509+0000","last_became_active":"2024-09-19T04:14:31.292772+0000","last_became_peered":"2024-09-19T04:14:31.292772+0000","last_unstale":"2024-09-19T04:16:47.065509+0000","last_undegraded":"2024-09-19T04:16:47.065509+0000","last_fullsized":"2024-09-19T04:16:47.065509+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:03:18.530662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.570714+0000","last_change":"2024-09-19T04:14:40.371434+0000","last_active":"2024-09-19T04:16:47.570714+0000","last_peered":"2024-09-19T04:16:47.570714+0000","last_clean":"2024-09-19T04:16:47.570714+0000","last_became_active":"2024-09-19T04:14:40.371037+0000","last_became_peered":"2024-09-19T04:14:40.371037+0000","last_unstale":"2024-09-19T04:16:47.570714+0000","last_undegraded":"2024-09-19T04:16:47.570714+0000","last_fullsized":"2024-09-19T04:16:47.570714+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:43:34.787860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067852+0000","last_change":"2024-09-19T04:14:33.308321+0000","last_active":"2024-09-19T04:16:47.067852+0000","last_peered":"2024-09-19T04:16:47.067852+0000","last_clean":"2024-09-19T04:16:47.067852+0000","last_became_active":"2024-09-19T04:14:33.307983+0000","last_became_peered":"2024-09-19T04:14:33.307983+0000","last_unstale":"2024-09-19T04:16:47.067852+0000","last_undegraded":"2024-09-19T04:16:47.067852+0000","last_fullsized":"2024-09-19T04:16:47.067852+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:46.202123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057834+0000","last_change":"2024-09-19T04:14:31.297326+0000","last_active":"2024-09-19T04:16:47.057834+0000","last_peered":"2024-09-19T04:16:47.057834+0000","last_clean":"2024-09-19T04:16:47.057834+0000","last_became_active":"2024-09-19T04:14:31.297056+0000","last_became_peered":"2024-09-19T04:14:31.297056+0000","last_unstale":"2024-09-19T04:16:47.057834+0000","last_undegraded":"2024-09-19T04:16:47.057834+0000","last_fullsized":"2024-09-19T04:16:47.057834+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:15:26.324855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063512+0000","last_change":"2024-09-19T04:14:40.370123+0000","last_active":"2024-09-19T04:16:47.063512+0000","last_peered":"2024-09-19T04:16:47.063512+0000","last_clean":"2024-09-19T04:16:47.063512+0000","last_became_active":"2024-09-19T04:14:40.367758+0000","last_became_peered":"2024-09-19T04:14:40.367758+0000","last_unstale":"2024-09-19T04:16:47.063512+0000","last_undegraded":"2024-09-19T04:16:47.063512+0000","last_fullsized":"2024-09-19T04:16:47.063512+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:07.932122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.061501+0000","last_change":"2024-09-19T04:14:33.314239+0000","last_active":"2024-09-19T04:16:47.061501+0000","last_peered":"2024-09-19T04:16:47.061501+0000","last_clean":"2024-09-19T04:16:47.061501+0000","last_became_active":"2024-09-19T04:14:33.313918+0000","last_became_peered":"2024-09-19T04:14:33.313918+0000","last_unstale":"2024-09-19T04:16:47.061501+0000","last_undegraded":"2024-09-19T04:16:47.061501+0000","last_fullsized":"2024-09-19T04:16:47.061501+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:00:12.756505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.059564+0000","last_change":"2024-09-19T04:14:31.295377+0000","last_active":"2024-09-19T04:16:47.059564+0000","last_peered":"2024-09-19T04:16:47.059564+0000","last_clean":"2024-09-19T04:16:47.059564+0000","last_became_active":"2024-09-19T04:14:31.295042+0000","last_became_peered":"2024-09-19T04:14:31.295042+0000","last_unstale":"2024-09-19T04:16:47.059564+0000","last_undegraded":"2024-09-19T04:16:47.059564+0000","last_fullsized":"2024-09-19T04:16:47.059564+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:35.842847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063698+0000","last_change":"2024-09-19T04:14:40.370790+0000","last_active":"2024-09-19T04:16:47.063698+0000","last_peered":"2024-09-19T04:16:47.063698+0000","last_clean":"2024-09-19T04:16:47.063698+0000","last_became_active":"2024-09-19T04:14:40.370377+0000","last_became_peered":"2024-09-19T04:14:40.370377+0000","last_unstale":"2024-09-19T04:16:47.063698+0000","last_undegraded":"2024-09-19T04:16:47.063698+0000","last_fullsized":"2024-09-19T04:16:47.063698+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:09.331769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063823+0000","last_change":"2024-09-19T04:15:47.342260+0000","last_active":"2024-09-19T04:16:47.063823+0000","last_peered":"2024-09-19T04:16:47.063823+0000","last_clean":"2024-09-19T04:16:47.063823+0000","last_became_active":"2024-09-19T04:15:47.341713+0000","last_became_peered":"2024-09-19T04:15:47.341713+0000","last_unstale":"2024-09-19T04:16:47.063823+0000","last_undegraded":"2024-09-19T04:16:47.063823+0000","last_fullsized":"2024-09-19T04:16:47.063823+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:25:47.822844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":57,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.059020+0000","last_change":"2024-09-19T04:14:31.322413+0000","last_active":"2024-09-19T04:16:47.059020+0000","last_peered":"2024-09-19T04:16:47.059020+0000","last_clean":"2024-09-19T04:16:47.059020+0000","last_became_active":"2024-09-19T04:14:31.322082+0000","last_became_peered":"2024-09-19T04:14:31.322082+0000","last_unstale":"2024-09-19T04:16:47.059020+0000","last_undegraded":"2024-09-19T04:16:47.059020+0000","last_fullsized":"2024-09-19T04:16:47.059020+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:10:50.010021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057771+0000","last_change":"2024-09-19T04:14:40.373071+0000","last_active":"2024-09-19T04:16:47.057771+0000","last_peered":"2024-09-19T04:16:47.057771+0000","last_clean":"2024-09-19T04:16:47.057771+0000","last_became_active":"2024-09-19T04:14:40.372679+0000","last_became_peered":"2024-09-19T04:14:40.372679+0000","last_unstale":"2024-09-19T04:16:47.057771+0000","last_undegraded":"2024-09-19T04:16:47.057771+0000","last_fullsized":"2024-09-19T04:16:47.057771+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:23.136807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067239+0000","last_change":"2024-09-19T04:14:33.319165+0000","last_active":"2024-09-19T04:16:47.067239+0000","last_peered":"2024-09-19T04:16:47.067239+0000","last_clean":"2024-09-19T04:16:47.067239+0000","last_became_active":"2024-09-19T04:14:33.318830+0000","last_became_peered":"2024-09-19T04:14:33.318830+0000","last_unstale":"2024-09-19T04:16:47.067239+0000","last_undegraded":"2024-09-19T04:16:47.067239+0000","last_fullsized":"2024-09-19T04:16:47.067239+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:05:43.936069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'7","reported_seq":151,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:56.988332+0000","last_change":"2024-09-19T04:14:31.291564+0000","last_active":"2024-09-19T04:16:56.988332+0000","last_peered":"2024-09-19T04:16:56.988332+0000","last_clean":"2024-09-19T04:16:56.988332+0000","last_became_active":"2024-09-19T04:14:31.291241+0000","last_became_peered":"2024-09-19T04:14:31.291241+0000","last_unstale":"2024-09-19T04:16:56.988332+0000","last_undegraded":"2024-09-19T04:16:56.988332+0000","last_fullsized":"2024-09-19T04:16:56.988332+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:38:09.419140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.135728+0000","last_change":"2024-09-19T04:14:40.371707+0000","last_active":"2024-09-19T04:16:47.135728+0000","last_peered":"2024-09-19T04:16:47.135728+0000","last_clean":"2024-09-19T04:16:47.135728+0000","last_became_active":"2024-09-19T04:14:40.370767+0000","last_became_peered":"2024-09-19T04:14:40.370767+0000","last_unstale":"2024-09-19T04:16:47.135728+0000","last_undegraded":"2024-09-19T04:16:47.135728+0000","last_fullsized":"2024-09-19T04:16:47.135728+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:38.022486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067584+0000","last_change":"2024-09-19T04:14:33.316098+0000","last_active":"2024-09-19T04:16:47.067584+0000","last_peered":"2024-09-19T04:16:47.067584+0000","last_clean":"2024-09-19T04:16:47.067584+0000","last_became_active":"2024-09-19T04:14:33.315755+0000","last_became_peered":"2024-09-19T04:14:33.315755+0000","last_unstale":"2024-09-19T04:16:47.067584+0000","last_undegraded":"2024-09-19T04:16:47.067584+0000","last_fullsized":"2024-09-19T04:16:47.067584+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:45:01.531200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.065848+0000","last_change":"2024-09-19T04:14:31.291145+0000","last_active":"2024-09-19T04:16:47.065848+0000","last_peered":"2024-09-19T04:16:47.065848+0000","last_clean":"2024-09-19T04:16:47.065848+0000","last_became_active":"2024-09-19T04:14:31.290763+0000","last_became_peered":"2024-09-19T04:14:31.290763+0000","last_unstale":"2024-09-19T04:16:47.065848+0000","last_undegraded":"2024-09-19T04:16:47.065848+0000","last_fullsized":"2024-09-19T04:16:47.065848+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:37.556544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.061681+0000","last_change":"2024-09-19T04:14:40.371371+0000","last_active":"2024-09-19T04:16:47.061681+0000","last_peered":"2024-09-19T04:16:47.061681+0000","last_clean":"2024-09-19T04:16:47.061681+0000","last_became_active":"2024-09-19T04:14:40.370988+0000","last_became_peered":"2024-09-19T04:14:40.370988+0000","last_unstale":"2024-09-19T04:16:47.061681+0000","last_undegraded":"2024-09-19T04:16:47.061681+0000","last_fullsized":"2024-09-19T04:16:47.061681+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:57.089953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057403+0000","last_change":"2024-09-19T04:15:47.003980+0000","last_active":"2024-09-19T04:16:47.057403+0000","last_peered":"2024-09-19T04:16:47.057403+0000","last_clean":"2024-09-19T04:16:47.057403+0000","last_became_active":"2024-09-19T04:15:47.003573+0000","last_became_peered":"2024-09-19T04:15:47.003573+0000","last_unstale":"2024-09-19T04:16:47.057403+0000","last_undegraded":"2024-09-19T04:16:47.057403+0000","last_fullsized":"2024-09-19T04:16:47.057403+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:35:12.971378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063280+0000","last_change":"2024-09-19T04:14:31.297106+0000","last_active":"2024-09-19T04:16:47.063280+0000","last_peered":"2024-09-19T04:16:47.063280+0000","last_clean":"2024-09-19T04:16:47.063280+0000","last_became_active":"2024-09-19T04:14:31.296688+0000","last_became_peered":"2024-09-19T04:14:31.296688+0000","last_unstale":"2024-09-19T04:16:47.063280+0000","last_undegraded":"2024-09-19T04:16:47.063280+0000","last_fullsized":"2024-09-19T04:16:47.063280+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:18.882219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064088+0000","last_change":"2024-09-19T04:14:40.371641+0000","last_active":"2024-09-19T04:16:47.064088+0000","last_peered":"2024-09-19T04:16:47.064088+0000","last_clean":"2024-09-19T04:16:47.064088+0000","last_became_active":"2024-09-19T04:14:40.370354+0000","last_became_peered":"2024-09-19T04:14:40.370354+0000","last_unstale":"2024-09-19T04:16:47.064088+0000","last_undegraded":"2024-09-19T04:16:47.064088+0000","last_fullsized":"2024-09-19T04:16:47.064088+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:01:11.572011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.059539+0000","last_change":"2024-09-19T04:14:33.307767+0000","last_active":"2024-09-19T04:16:47.059539+0000","last_peered":"2024-09-19T04:16:47.059539+0000","last_clean":"2024-09-19T04:16:47.059539+0000","last_became_active":"2024-09-19T04:14:33.307396+0000","last_became_peered":"2024-09-19T04:14:33.307396+0000","last_unstale":"2024-09-19T04:16:47.059539+0000","last_undegraded":"2024-09-19T04:16:47.059539+0000","last_fullsized":"2024-09-19T04:16:47.059539+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:50:21.018641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'42","reported_seq":293,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:57.442290+0000","last_change":"2024-09-19T04:14:31.298106+0000","last_active":"2024-09-19T04:16:57.442290+0000","last_peered":"2024-09-19T04:16:57.442290+0000","last_clean":"2024-09-19T04:16:57.442290+0000","last_became_active":"2024-09-19T04:14:31.297731+0000","last_became_peered":"2024-09-19T04:14:31.297731+0000","last_unstale":"2024-09-19T04:16:57.442290+0000","last_undegraded":"2024-09-19T04:16:57.442290+0000","last_fullsized":"2024-09-19T04:16:57.442290+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:29.127759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72406,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":212,"num_read_kb":170,"num_write":44,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.135577+0000","last_change":"2024-09-19T04:14:40.372927+0000","last_active":"2024-09-19T04:16:47.135577+0000","last_peered":"2024-09-19T04:16:47.135577+0000","last_clean":"2024-09-19T04:16:47.135577+0000","last_became_active":"2024-09-19T04:14:40.372521+0000","last_became_peered":"2024-09-19T04:14:40.372521+0000","last_unstale":"2024-09-19T04:16:47.135577+0000","last_undegraded":"2024-09-19T04:16:47.135577+0000","last_fullsized":"2024-09-19T04:16:47.135577+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:15:00.863812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063722+0000","last_change":"2024-09-19T04:14:33.308154+0000","last_active":"2024-09-19T04:16:47.063722+0000","last_peered":"2024-09-19T04:16:47.063722+0000","last_clean":"2024-09-19T04:16:47.063722+0000","last_became_active":"2024-09-19T04:14:33.307831+0000","last_became_peered":"2024-09-19T04:14:33.307831+0000","last_unstale":"2024-09-19T04:16:47.063722+0000","last_undegraded":"2024-09-19T04:16:47.063722+0000","last_fullsized":"2024-09-19T04:16:47.063722+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:16:14.656133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064967+0000","last_change":"2024-09-19T04:14:31.324011+0000","last_active":"2024-09-19T04:16:47.064967+0000","last_peered":"2024-09-19T04:16:47.064967+0000","last_clean":"2024-09-19T04:16:47.064967+0000","last_became_active":"2024-09-19T04:14:31.323622+0000","last_became_peered":"2024-09-19T04:14:31.323622+0000","last_unstale":"2024-09-19T04:16:47.064967+0000","last_undegraded":"2024-09-19T04:16:47.064967+0000","last_fullsized":"2024-09-19T04:16:47.064967+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:39.198602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058635+0000","last_change":"2024-09-19T04:14:40.365938+0000","last_active":"2024-09-19T04:16:47.058635+0000","last_peered":"2024-09-19T04:16:47.058635+0000","last_clean":"2024-09-19T04:16:47.058635+0000","last_became_active":"2024-09-19T04:14:40.365539+0000","last_became_peered":"2024-09-19T04:14:40.365539+0000","last_unstale":"2024-09-19T04:16:47.058635+0000","last_undegraded":"2024-09-19T04:16:47.058635+0000","last_fullsized":"2024-09-19T04:16:47.058635+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:09.723008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.571135+0000","last_change":"2024-09-19T04:14:33.316286+0000","last_active":"2024-09-19T04:16:47.571135+0000","last_peered":"2024-09-19T04:16:47.571135+0000","last_clean":"2024-09-19T04:16:47.571135+0000","last_became_active":"2024-09-19T04:14:33.315980+0000","last_became_peered":"2024-09-19T04:14:33.315980+0000","last_unstale":"2024-09-19T04:16:47.571135+0000","last_undegraded":"2024-09-19T04:16:47.571135+0000","last_fullsized":"2024-09-19T04:16:47.571135+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:58.383139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067880+0000","last_change":"2024-09-19T04:14:31.299111+0000","last_active":"2024-09-19T04:16:47.067880+0000","last_peered":"2024-09-19T04:16:47.067880+0000","last_clean":"2024-09-19T04:16:47.067880+0000","last_became_active":"2024-09-19T04:14:31.298390+0000","last_became_peered":"2024-09-19T04:14:31.298390+0000","last_unstale":"2024-09-19T04:16:47.067880+0000","last_undegraded":"2024-09-19T04:16:47.067880+0000","last_fullsized":"2024-09-19T04:16:47.067880+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:39.710412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.135278+0000","last_change":"2024-09-19T04:14:40.371108+0000","last_active":"2024-09-19T04:16:47.135278+0000","last_peered":"2024-09-19T04:16:47.135278+0000","last_clean":"2024-09-19T04:16:47.135278+0000","last_became_active":"2024-09-19T04:14:40.370729+0000","last_became_peered":"2024-09-19T04:14:40.370729+0000","last_unstale":"2024-09-19T04:16:47.135278+0000","last_undegraded":"2024-09-19T04:16:47.135278+0000","last_fullsized":"2024-09-19T04:16:47.135278+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:59.610235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064054+0000","last_change":"2024-09-19T04:14:33.314423+0000","last_active":"2024-09-19T04:16:47.064054+0000","last_peered":"2024-09-19T04:16:47.064054+0000","last_clean":"2024-09-19T04:16:47.064054+0000","last_became_active":"2024-09-19T04:14:33.314123+0000","last_became_peered":"2024-09-19T04:14:33.314123+0000","last_unstale":"2024-09-19T04:16:47.064054+0000","last_undegraded":"2024-09-19T04:16:47.064054+0000","last_fullsized":"2024-09-19T04:16:47.064054+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:29:57.781116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"90'5","reported_seq":244,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:57.446101+0000","last_change":"2024-09-19T04:14:31.293267+0000","last_active":"2024-09-19T04:16:57.446101+0000","last_peered":"2024-09-19T04:16:57.446101+0000","last_clean":"2024-09-19T04:16:57.446101+0000","last_became_active":"2024-09-19T04:14:31.292862+0000","last_became_peered":"2024-09-19T04:14:31.292862+0000","last_unstale":"2024-09-19T04:16:57.446101+0000","last_undegraded":"2024-09-19T04:16:57.446101+0000","last_fullsized":"2024-09-19T04:16:57.446101+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:37.876696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":200,"num_read_kb":200,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063338+0000","last_change":"2024-09-19T04:14:40.373078+0000","last_active":"2024-09-19T04:16:47.063338+0000","last_peered":"2024-09-19T04:16:47.063338+0000","last_clean":"2024-09-19T04:16:47.063338+0000","last_became_active":"2024-09-19T04:14:40.372468+0000","last_became_peered":"2024-09-19T04:14:40.372468+0000","last_unstale":"2024-09-19T04:16:47.063338+0000","last_undegraded":"2024-09-19T04:16:47.063338+0000","last_fullsized":"2024-09-19T04:16:47.063338+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:54.945801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.570776+0000","last_change":"2024-09-19T04:14:40.368946+0000","last_active":"2024-09-19T04:16:47.570776+0000","last_peered":"2024-09-19T04:16:47.570776+0000","last_clean":"2024-09-19T04:16:47.570776+0000","last_became_active":"2024-09-19T04:14:40.368549+0000","last_became_peered":"2024-09-19T04:14:40.368549+0000","last_unstale":"2024-09-19T04:16:47.570776+0000","last_undegraded":"2024-09-19T04:16:47.570776+0000","last_fullsized":"2024-09-19T04:16:47.570776+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:24.563488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.135449+0000","last_change":"2024-09-19T04:14:33.307214+0000","last_active":"2024-09-19T04:16:47.135449+0000","last_peered":"2024-09-19T04:16:47.135449+0000","last_clean":"2024-09-19T04:16:47.135449+0000","last_became_active":"2024-09-19T04:14:33.306913+0000","last_became_peered":"2024-09-19T04:14:33.306913+0000","last_unstale":"2024-09-19T04:16:47.135449+0000","last_undegraded":"2024-09-19T04:16:47.135449+0000","last_fullsized":"2024-09-19T04:16:47.135449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:53:49.402532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063894+0000","last_change":"2024-09-19T04:14:31.294488+0000","last_active":"2024-09-19T04:16:47.063894+0000","last_peered":"2024-09-19T04:16:47.063894+0000","last_clean":"2024-09-19T04:16:47.063894+0000","last_became_active":"2024-09-19T04:14:31.294145+0000","last_became_peered":"2024-09-19T04:14:31.294145+0000","last_unstale":"2024-09-19T04:16:47.063894+0000","last_undegraded":"2024-09-19T04:16:47.063894+0000","last_fullsized":"2024-09-19T04:16:47.063894+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:28:19.411650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.061366+0000","last_change":"2024-09-19T04:14:40.372366+0000","last_active":"2024-09-19T04:16:47.061366+0000","last_peered":"2024-09-19T04:16:47.061366+0000","last_clean":"2024-09-19T04:16:47.061366+0000","last_became_active":"2024-09-19T04:14:40.371922+0000","last_became_peered":"2024-09-19T04:14:40.371922+0000","last_unstale":"2024-09-19T04:16:47.061366+0000","last_undegraded":"2024-09-19T04:16:47.061366+0000","last_fullsized":"2024-09-19T04:16:47.061366+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:55:01.724088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063700+0000","last_change":"2024-09-19T04:14:33.308351+0000","last_active":"2024-09-19T04:16:47.063700+0000","last_peered":"2024-09-19T04:16:47.063700+0000","last_clean":"2024-09-19T04:16:47.063700+0000","last_became_active":"2024-09-19T04:14:33.308052+0000","last_became_peered":"2024-09-19T04:14:33.308052+0000","last_unstale":"2024-09-19T04:16:47.063700+0000","last_undegraded":"2024-09-19T04:16:47.063700+0000","last_fullsized":"2024-09-19T04:16:47.063700+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:06:32.056738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057291+0000","last_change":"2024-09-19T04:14:31.291742+0000","last_active":"2024-09-19T04:16:47.057291+0000","last_peered":"2024-09-19T04:16:47.057291+0000","last_clean":"2024-09-19T04:16:47.057291+0000","last_became_active":"2024-09-19T04:14:31.291315+0000","last_became_peered":"2024-09-19T04:14:31.291315+0000","last_unstale":"2024-09-19T04:16:47.057291+0000","last_undegraded":"2024-09-19T04:16:47.057291+0000","last_fullsized":"2024-09-19T04:16:47.057291+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:16.159276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.136189+0000","last_change":"2024-09-19T04:14:31.293898+0000","last_active":"2024-09-19T04:16:47.136189+0000","last_peered":"2024-09-19T04:16:47.136189+0000","last_clean":"2024-09-19T04:16:47.136189+0000","last_became_active":"2024-09-19T04:14:31.293499+0000","last_became_peered":"2024-09-19T04:14:31.293499+0000","last_unstale":"2024-09-19T04:16:47.136189+0000","last_undegraded":"2024-09-19T04:16:47.136189+0000","last_fullsized":"2024-09-19T04:16:47.136189+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:25:55.590644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064005+0000","last_change":"2024-09-19T04:14:33.314094+0000","last_active":"2024-09-19T04:16:47.064005+0000","last_peered":"2024-09-19T04:16:47.064005+0000","last_clean":"2024-09-19T04:16:47.064005+0000","last_became_active":"2024-09-19T04:14:33.312782+0000","last_became_peered":"2024-09-19T04:14:33.312782+0000","last_unstale":"2024-09-19T04:16:47.064005+0000","last_undegraded":"2024-09-19T04:16:47.064005+0000","last_fullsized":"2024-09-19T04:16:47.064005+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:40.121676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.062592+0000","last_change":"2024-09-19T04:14:40.369159+0000","last_active":"2024-09-19T04:16:47.062592+0000","last_peered":"2024-09-19T04:16:47.062592+0000","last_clean":"2024-09-19T04:16:47.062592+0000","last_became_active":"2024-09-19T04:14:40.368732+0000","last_became_peered":"2024-09-19T04:14:40.368732+0000","last_unstale":"2024-09-19T04:16:47.062592+0000","last_undegraded":"2024-09-19T04:16:47.062592+0000","last_fullsized":"2024-09-19T04:16:47.062592+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:12:29.176834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'6","reported_seq":158,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:57.081537+0000","last_change":"2024-09-19T04:16:47.072639+0000","last_active":"2024-09-19T04:16:57.081537+0000","last_peered":"2024-09-19T04:16:57.081537+0000","last_clean":"2024-09-19T04:16:57.081537+0000","last_became_active":"2024-09-19T04:16:47.068508+0000","last_became_peered":"2024-09-19T04:16:47.068508+0000","last_unstale":"2024-09-19T04:16:57.081537+0000","last_undegraded":"2024-09-19T04:16:57.081537+0000","last_fullsized":"2024-09-19T04:16:57.081537+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:30.275833+0000","last_clean_scrub_stamp":"2024-09-19T04:14:30.275833+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:43.540304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.059276+0000","last_change":"2024-09-19T04:14:33.300555+0000","last_active":"2024-09-19T04:16:47.059276+0000","last_peered":"2024-09-19T04:16:47.059276+0000","last_clean":"2024-09-19T04:16:47.059276+0000","last_became_active":"2024-09-19T04:14:33.300220+0000","last_became_peered":"2024-09-19T04:14:33.300220+0000","last_unstale":"2024-09-19T04:16:47.059276+0000","last_undegraded":"2024-09-19T04:16:47.059276+0000","last_fullsized":"2024-09-19T04:16:47.059276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:32.584140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.137653+0000","last_change":"2024-09-19T04:16:47.137653+0000","last_active":"2024-09-19T04:16:47.137653+0000","last_peered":"2024-09-19T04:16:47.137653+0000","last_clean":"2024-09-19T04:16:47.137653+0000","last_became_active":"2024-09-19T04:16:47.137087+0000","last_became_peered":"2024-09-19T04:16:47.137087+0000","last_unstale":"2024-09-19T04:16:47.137653+0000","last_undegraded":"2024-09-19T04:16:47.137653+0000","last_fullsized":"2024-09-19T04:16:47.137653+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:39.345373+0000","last_clean_scrub_stamp":"2024-09-19T04:14:39.345373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:11:31.312087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,7,11],"acting":[2,10,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.060868+0000","last_change":"2024-09-19T04:14:33.312801+0000","last_active":"2024-09-19T04:16:47.060868+0000","last_peered":"2024-09-19T04:16:47.060868+0000","last_clean":"2024-09-19T04:16:47.060868+0000","last_became_active":"2024-09-19T04:14:33.312430+0000","last_became_peered":"2024-09-19T04:14:33.312430+0000","last_unstale":"2024-09-19T04:16:47.060868+0000","last_undegraded":"2024-09-19T04:16:47.060868+0000","last_fullsized":"2024-09-19T04:16:47.060868+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:29.069507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063851+0000","last_change":"2024-09-19T04:14:33.313076+0000","last_active":"2024-09-19T04:16:47.063851+0000","last_peered":"2024-09-19T04:16:47.063851+0000","last_clean":"2024-09-19T04:16:47.063851+0000","last_became_active":"2024-09-19T04:14:33.312730+0000","last_became_peered":"2024-09-19T04:14:33.312730+0000","last_unstale":"2024-09-19T04:16:47.063851+0000","last_undegraded":"2024-09-19T04:16:47.063851+0000","last_fullsized":"2024-09-19T04:16:47.063851+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:33.397309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063194+0000","last_change":"2024-09-19T04:14:33.314724+0000","last_active":"2024-09-19T04:16:47.063194+0000","last_peered":"2024-09-19T04:16:47.063194+0000","last_clean":"2024-09-19T04:16:47.063194+0000","last_became_active":"2024-09-19T04:14:33.314359+0000","last_became_peered":"2024-09-19T04:14:33.314359+0000","last_unstale":"2024-09-19T04:16:47.063194+0000","last_undegraded":"2024-09-19T04:16:47.063194+0000","last_fullsized":"2024-09-19T04:16:47.063194+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:37:39.357193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.570754+0000","last_change":"2024-09-19T04:14:33.312834+0000","last_active":"2024-09-19T04:16:47.570754+0000","last_peered":"2024-09-19T04:16:47.570754+0000","last_clean":"2024-09-19T04:16:47.570754+0000","last_became_active":"2024-09-19T04:14:33.312538+0000","last_became_peered":"2024-09-19T04:14:33.312538+0000","last_unstale":"2024-09-19T04:16:47.570754+0000","last_undegraded":"2024-09-19T04:16:47.570754+0000","last_fullsized":"2024-09-19T04:16:47.570754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:25:37.694910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057648+0000","last_change":"2024-09-19T04:14:33.305735+0000","last_active":"2024-09-19T04:16:47.057648+0000","last_peered":"2024-09-19T04:16:47.057648+0000","last_clean":"2024-09-19T04:16:47.057648+0000","last_became_active":"2024-09-19T04:14:33.305415+0000","last_became_peered":"2024-09-19T04:14:33.305415+0000","last_unstale":"2024-09-19T04:16:47.057648+0000","last_undegraded":"2024-09-19T04:16:47.057648+0000","last_fullsized":"2024-09-19T04:16:47.057648+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:43:20.160211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.061663+0000","last_change":"2024-09-19T04:14:33.313379+0000","last_active":"2024-09-19T04:16:47.061663+0000","last_peered":"2024-09-19T04:16:47.061663+0000","last_clean":"2024-09-19T04:16:47.061663+0000","last_became_active":"2024-09-19T04:14:33.312453+0000","last_became_peered":"2024-09-19T04:14:33.312453+0000","last_unstale":"2024-09-19T04:16:47.061663+0000","last_undegraded":"2024-09-19T04:16:47.061663+0000","last_fullsized":"2024-09-19T04:16:47.061663+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:44.832004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":49,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063977+0000","last_change":"2024-09-19T04:14:33.307371+0000","last_active":"2024-09-19T04:16:47.063977+0000","last_peered":"2024-09-19T04:16:47.063977+0000","last_clean":"2024-09-19T04:16:47.063977+0000","last_became_active":"2024-09-19T04:14:33.307033+0000","last_became_peered":"2024-09-19T04:14:33.307033+0000","last_unstale":"2024-09-19T04:16:47.063977+0000","last_undegraded":"2024-09-19T04:16:47.063977+0000","last_fullsized":"2024-09-19T04:16:47.063977+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:12.027213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064150+0000","last_change":"2024-09-19T04:15:47.342412+0000","last_active":"2024-09-19T04:16:47.064150+0000","last_peered":"2024-09-19T04:16:47.064150+0000","last_clean":"2024-09-19T04:16:47.064150+0000","last_became_active":"2024-09-19T04:15:47.341989+0000","last_became_peered":"2024-09-19T04:15:47.341989+0000","last_unstale":"2024-09-19T04:16:47.064150+0000","last_undegraded":"2024-09-19T04:16:47.064150+0000","last_fullsized":"2024-09-19T04:16:47.064150+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:32.713199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063980+0000","last_change":"2024-09-19T04:14:33.314296+0000","last_active":"2024-09-19T04:16:47.063980+0000","last_peered":"2024-09-19T04:16:47.063980+0000","last_clean":"2024-09-19T04:16:47.063980+0000","last_became_active":"2024-09-19T04:14:33.311230+0000","last_became_peered":"2024-09-19T04:14:33.311230+0000","last_unstale":"2024-09-19T04:16:47.063980+0000","last_undegraded":"2024-09-19T04:16:47.063980+0000","last_fullsized":"2024-09-19T04:16:47.063980+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:37:51.395086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063485+0000","last_change":"2024-09-19T04:14:33.317125+0000","last_active":"2024-09-19T04:16:47.063485+0000","last_peered":"2024-09-19T04:16:47.063485+0000","last_clean":"2024-09-19T04:16:47.063485+0000","last_became_active":"2024-09-19T04:14:33.316805+0000","last_became_peered":"2024-09-19T04:14:33.316805+0000","last_unstale":"2024-09-19T04:16:47.063485+0000","last_undegraded":"2024-09-19T04:16:47.063485+0000","last_fullsized":"2024-09-19T04:16:47.063485+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:27.754882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063974+0000","last_change":"2024-09-19T04:14:33.310081+0000","last_active":"2024-09-19T04:16:47.063974+0000","last_peered":"2024-09-19T04:16:47.063974+0000","last_clean":"2024-09-19T04:16:47.063974+0000","last_became_active":"2024-09-19T04:14:33.308675+0000","last_became_peered":"2024-09-19T04:14:33.308675+0000","last_unstale":"2024-09-19T04:16:47.063974+0000","last_undegraded":"2024-09-19T04:16:47.063974+0000","last_fullsized":"2024-09-19T04:16:47.063974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:58.187633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057611+0000","last_change":"2024-09-19T04:14:33.308220+0000","last_active":"2024-09-19T04:16:47.057611+0000","last_peered":"2024-09-19T04:16:47.057611+0000","last_clean":"2024-09-19T04:16:47.057611+0000","last_became_active":"2024-09-19T04:14:33.307934+0000","last_became_peered":"2024-09-19T04:14:33.307934+0000","last_unstale":"2024-09-19T04:16:47.057611+0000","last_undegraded":"2024-09-19T04:16:47.057611+0000","last_fullsized":"2024-09-19T04:16:47.057611+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:22.490250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.062008+0000","last_change":"2024-09-19T04:14:33.306617+0000","last_active":"2024-09-19T04:16:47.062008+0000","last_peered":"2024-09-19T04:16:47.062008+0000","last_clean":"2024-09-19T04:16:47.062008+0000","last_became_active":"2024-09-19T04:14:33.306244+0000","last_became_peered":"2024-09-19T04:14:33.306244+0000","last_unstale":"2024-09-19T04:16:47.062008+0000","last_undegraded":"2024-09-19T04:16:47.062008+0000","last_fullsized":"2024-09-19T04:16:47.062008+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:22.095989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063298+0000","last_change":"2024-09-19T04:14:33.314915+0000","last_active":"2024-09-19T04:16:47.063298+0000","last_peered":"2024-09-19T04:16:47.063298+0000","last_clean":"2024-09-19T04:16:47.063298+0000","last_became_active":"2024-09-19T04:14:33.314601+0000","last_became_peered":"2024-09-19T04:14:33.314601+0000","last_unstale":"2024-09-19T04:16:47.063298+0000","last_undegraded":"2024-09-19T04:16:47.063298+0000","last_fullsized":"2024-09-19T04:16:47.063298+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:37.687964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.135920+0000","last_change":"2024-09-19T04:14:33.304667+0000","last_active":"2024-09-19T04:16:47.135920+0000","last_peered":"2024-09-19T04:16:47.135920+0000","last_clean":"2024-09-19T04:16:47.135920+0000","last_became_active":"2024-09-19T04:14:33.304356+0000","last_became_peered":"2024-09-19T04:14:33.304356+0000","last_unstale":"2024-09-19T04:16:47.135920+0000","last_undegraded":"2024-09-19T04:16:47.135920+0000","last_fullsized":"2024-09-19T04:16:47.135920+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:37.128074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.061919+0000","last_change":"2024-09-19T04:14:33.310002+0000","last_active":"2024-09-19T04:16:47.061919+0000","last_peered":"2024-09-19T04:16:47.061919+0000","last_clean":"2024-09-19T04:16:47.061919+0000","last_became_active":"2024-09-19T04:14:33.309639+0000","last_became_peered":"2024-09-19T04:14:33.309639+0000","last_unstale":"2024-09-19T04:16:47.061919+0000","last_undegraded":"2024-09-19T04:16:47.061919+0000","last_fullsized":"2024-09-19T04:16:47.061919+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:21.954435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063291+0000","last_change":"2024-09-19T04:14:33.307296+0000","last_active":"2024-09-19T04:16:47.063291+0000","last_peered":"2024-09-19T04:16:47.063291+0000","last_clean":"2024-09-19T04:16:47.063291+0000","last_became_active":"2024-09-19T04:14:33.306998+0000","last_became_peered":"2024-09-19T04:14:33.306998+0000","last_unstale":"2024-09-19T04:16:47.063291+0000","last_undegraded":"2024-09-19T04:16:47.063291+0000","last_fullsized":"2024-09-19T04:16:47.063291+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:55.833196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.570628+0000","last_change":"2024-09-19T04:14:33.313568+0000","last_active":"2024-09-19T04:16:47.570628+0000","last_peered":"2024-09-19T04:16:47.570628+0000","last_clean":"2024-09-19T04:16:47.570628+0000","last_became_active":"2024-09-19T04:14:33.313228+0000","last_became_peered":"2024-09-19T04:14:33.313228+0000","last_unstale":"2024-09-19T04:16:47.570628+0000","last_undegraded":"2024-09-19T04:16:47.570628+0000","last_fullsized":"2024-09-19T04:16:47.570628+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:31:43.348866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.570568+0000","last_change":"2024-09-19T04:14:33.309745+0000","last_active":"2024-09-19T04:16:47.570568+0000","last_peered":"2024-09-19T04:16:47.570568+0000","last_clean":"2024-09-19T04:16:47.570568+0000","last_became_active":"2024-09-19T04:14:33.309327+0000","last_became_peered":"2024-09-19T04:14:33.309327+0000","last_unstale":"2024-09-19T04:16:47.570568+0000","last_undegraded":"2024-09-19T04:16:47.570568+0000","last_fullsized":"2024-09-19T04:16:47.570568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:05.081550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.057569+0000","last_change":"2024-09-19T04:14:33.306186+0000","last_active":"2024-09-19T04:16:47.057569+0000","last_peered":"2024-09-19T04:16:47.057569+0000","last_clean":"2024-09-19T04:16:47.057569+0000","last_became_active":"2024-09-19T04:14:33.305865+0000","last_became_peered":"2024-09-19T04:14:33.305865+0000","last_unstale":"2024-09-19T04:16:47.057569+0000","last_undegraded":"2024-09-19T04:16:47.057569+0000","last_fullsized":"2024-09-19T04:16:47.057569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:33.054326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.058771+0000","last_change":"2024-09-19T04:14:33.307667+0000","last_active":"2024-09-19T04:16:47.058771+0000","last_peered":"2024-09-19T04:16:47.058771+0000","last_clean":"2024-09-19T04:16:47.058771+0000","last_became_active":"2024-09-19T04:14:33.307315+0000","last_became_peered":"2024-09-19T04:14:33.307315+0000","last_unstale":"2024-09-19T04:16:47.058771+0000","last_undegraded":"2024-09-19T04:16:47.058771+0000","last_fullsized":"2024-09-19T04:16:47.058771+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:52.209438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067945+0000","last_change":"2024-09-19T04:14:33.312430+0000","last_active":"2024-09-19T04:16:47.067945+0000","last_peered":"2024-09-19T04:16:47.067945+0000","last_clean":"2024-09-19T04:16:47.067945+0000","last_became_active":"2024-09-19T04:14:33.311786+0000","last_became_peered":"2024-09-19T04:14:33.311786+0000","last_unstale":"2024-09-19T04:16:47.067945+0000","last_undegraded":"2024-09-19T04:16:47.067945+0000","last_fullsized":"2024-09-19T04:16:47.067945+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:17:25.785612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.136532+0000","last_change":"2024-09-19T04:14:33.310478+0000","last_active":"2024-09-19T04:16:47.136532+0000","last_peered":"2024-09-19T04:16:47.136532+0000","last_clean":"2024-09-19T04:16:47.136532+0000","last_became_active":"2024-09-19T04:14:33.309960+0000","last_became_peered":"2024-09-19T04:14:33.309960+0000","last_unstale":"2024-09-19T04:16:47.136532+0000","last_undegraded":"2024-09-19T04:16:47.136532+0000","last_fullsized":"2024-09-19T04:16:47.136532+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:37:43.008022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.064064+0000","last_change":"2024-09-19T04:14:33.312449+0000","last_active":"2024-09-19T04:16:47.064064+0000","last_peered":"2024-09-19T04:16:47.064064+0000","last_clean":"2024-09-19T04:16:47.064064+0000","last_became_active":"2024-09-19T04:14:33.312124+0000","last_became_peered":"2024-09-19T04:14:33.312124+0000","last_unstale":"2024-09-19T04:16:47.064064+0000","last_undegraded":"2024-09-19T04:16:47.064064+0000","last_fullsized":"2024-09-19T04:16:47.064064+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:53.556895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.063525+0000","last_change":"2024-09-19T04:14:33.317095+0000","last_active":"2024-09-19T04:16:47.063525+0000","last_peered":"2024-09-19T04:16:47.063525+0000","last_clean":"2024-09-19T04:16:47.063525+0000","last_became_active":"2024-09-19T04:14:33.316763+0000","last_became_peered":"2024-09-19T04:14:33.316763+0000","last_unstale":"2024-09-19T04:16:47.063525+0000","last_undegraded":"2024-09-19T04:16:47.063525+0000","last_fullsized":"2024-09-19T04:16:47.063525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:32:14.894679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.067254+0000","last_change":"2024-09-19T04:14:33.316578+0000","last_active":"2024-09-19T04:16:47.067254+0000","last_peered":"2024-09-19T04:16:47.067254+0000","last_clean":"2024-09-19T04:16:47.067254+0000","last_became_active":"2024-09-19T04:14:33.316215+0000","last_became_peered":"2024-09-19T04:14:33.316215+0000","last_unstale":"2024-09-19T04:16:47.067254+0000","last_undegraded":"2024-09-19T04:16:47.067254+0000","last_fullsized":"2024-09-19T04:16:47.067254+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:18.770360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.136155+0000","last_change":"2024-09-19T04:15:47.000540+0000","last_active":"2024-09-19T04:16:47.136155+0000","last_peered":"2024-09-19T04:16:47.136155+0000","last_clean":"2024-09-19T04:16:47.136155+0000","last_became_active":"2024-09-19T04:15:47.000155+0000","last_became_peered":"2024-09-19T04:15:47.000155+0000","last_unstale":"2024-09-19T04:16:47.136155+0000","last_undegraded":"2024-09-19T04:16:47.136155+0000","last_fullsized":"2024-09-19T04:16:47.136155+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:19.055366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.059133+0000","last_change":"2024-09-19T04:14:33.309468+0000","last_active":"2024-09-19T04:16:47.059133+0000","last_peered":"2024-09-19T04:16:47.059133+0000","last_clean":"2024-09-19T04:16:47.059133+0000","last_became_active":"2024-09-19T04:14:33.309164+0000","last_became_peered":"2024-09-19T04:14:33.309164+0000","last_unstale":"2024-09-19T04:16:47.059133+0000","last_undegraded":"2024-09-19T04:16:47.059133+0000","last_fullsized":"2024-09-19T04:16:47.059133+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:05:19.193395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.135491+0000","last_change":"2024-09-19T04:15:47.342502+0000","last_active":"2024-09-19T04:16:47.135491+0000","last_peered":"2024-09-19T04:16:47.135491+0000","last_clean":"2024-09-19T04:16:47.135491+0000","last_became_active":"2024-09-19T04:15:47.342127+0000","last_became_peered":"2024-09-19T04:15:47.342127+0000","last_unstale":"2024-09-19T04:16:47.135491+0000","last_undegraded":"2024-09-19T04:16:47.135491+0000","last_fullsized":"2024-09-19T04:16:47.135491+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:47.192614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.570756+0000","last_change":"2024-09-19T04:14:33.308268+0000","last_active":"2024-09-19T04:16:47.570756+0000","last_peered":"2024-09-19T04:16:47.570756+0000","last_clean":"2024-09-19T04:16:47.570756+0000","last_became_active":"2024-09-19T04:14:33.307945+0000","last_became_peered":"2024-09-19T04:14:33.307945+0000","last_unstale":"2024-09-19T04:16:47.570756+0000","last_undegraded":"2024-09-19T04:16:47.570756+0000","last_fullsized":"2024-09-19T04:16:47.570756+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:24.410351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.570902+0000","last_change":"2024-09-19T04:14:33.315522+0000","last_active":"2024-09-19T04:16:47.570902+0000","last_peered":"2024-09-19T04:16:47.570902+0000","last_clean":"2024-09-19T04:16:47.570902+0000","last_became_active":"2024-09-19T04:14:33.315220+0000","last_became_peered":"2024-09-19T04:14:33.315220+0000","last_unstale":"2024-09-19T04:16:47.570902+0000","last_undegraded":"2024-09-19T04:16:47.570902+0000","last_fullsized":"2024-09-19T04:16:47.570902+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:41:40.915933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"88'8","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T04:16:47.061734+0000","last_change":"2024-09-19T04:14:33.309450+0000","last_active":"2024-09-19T04:16:47.061734+0000","last_peered":"2024-09-19T04:16:47.061734+0000","last_clean":"2024-09-19T04:16:47.061734+0000","last_became_active":"2024-09-19T04:14:33.309013+0000","last_became_peered":"2024-09-19T04:14:33.309013+0000","last_unstale":"2024-09-19T04:16:47.061734+0000","last_undegraded":"2024-09-19T04:16:47.061734+0000","last_fullsized":"2024-09-19T04:16:47.061734+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:14:32.285973+0000","last_clean_scrub_stamp":"2024-09-19T04:14:32.285973+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:11:49.523372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":80990,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1045,"num_read_kb":606,"num_write":275,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":1204,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":240450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":235,"ondisk_log_size":235,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285207,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579947,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1003520,"data_stored":516143,"data_compressed":29678,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808880,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28156,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716996,"statfs":{"total":95995035648,"available":95966203904,"internally_reserved":0,"allocated":1150976,"data_stored":1168090,"data_compressed":65942,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972405,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":519587,"data_compressed":29678,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201337,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1015808,"data_stored":515287,"data_compressed":29678,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430270,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32232,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712920,"statfs":{"total":95995035648,"available":95962030080,"internally_reserved":0,"allocated":1073152,"data_stored":1114137,"data_compressed":65942,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593796,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":512230,"data_compressed":29678,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822729,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1081344,"data_stored":1107557,"data_compressed":65942,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986253,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1015808,"data_stored":516618,"data_compressed":29678,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215186,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":510703,"data_compressed":29678,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411416,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":584029,"data_compressed":29678,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":578046,"data_compressed":29678,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738466,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1024000,"data_stored":512451,"data_compressed":29678,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34629,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34629,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34629,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36264,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":72873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":73756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":74676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T04:17:02.425 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:17:02.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:02 smithi092 ceph-mon[34940]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:17:02.680 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:17:03.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.169+0000 7f633c58f640 1 -- 172.21.15.7:0/3570780491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6334102790 msgr2=0x7f63341067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:03.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.169+0000 7f633c58f640 1 --2- 172.21.15.7:0/3570780491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6334102790 0x7f63341067e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6324009900 tx=0x7f632402a3f0 comp rx=0 tx=0).stop 2024-09-19T04:17:03.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.169+0000 7f633c58f640 1 -- 172.21.15.7:0/3570780491 shutdown_connections 2024-09-19T04:17:03.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.169+0000 7f633c58f640 1 --2- 172.21.15.7:0/3570780491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6334106f10 0x7f633410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:03.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.169+0000 7f633c58f640 1 --2- 172.21.15.7:0/3570780491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6334102790 0x7f63341067e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:03.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.169+0000 7f633c58f640 1 --2- 172.21.15.7:0/3570780491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6334101de0 0x7f63341021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:03.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.169+0000 7f633c58f640 1 -- 172.21.15.7:0/3570780491 >> 172.21.15.7:0/3570780491 conn(0x7f63340fd8c0 msgr2=0x7f63340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:03.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.169+0000 7f633c58f640 1 -- 172.21.15.7:0/3570780491 shutdown_connections 2024-09-19T04:17:03.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.169+0000 7f633c58f640 1 -- 172.21.15.7:0/3570780491 wait complete. 2024-09-19T04:17:03.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.170+0000 7f633c58f640 1 Processor -- start 2024-09-19T04:17:03.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.170+0000 7f633c58f640 1 -- start start 2024-09-19T04:17:03.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.170+0000 7f633c58f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6334101de0 0x7f63341984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:03.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.170+0000 7f633c58f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6334102790 0x7f6334198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:03.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.170+0000 7f633c58f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6334106f10 0x7f633419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:03.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.170+0000 7f633c58f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6334111f70 con 0x7f6334102790 2024-09-19T04:17:03.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.170+0000 7f633c58f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6334111df0 con 0x7f6334106f10 2024-09-19T04:17:03.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.170+0000 7f633c58f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f63341120f0 con 0x7f6334101de0 2024-09-19T04:17:03.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.170+0000 7f6339b2a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6334102790 0x7f6334198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:03.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.170+0000 7f6339b2a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6334102790 0x7f6334198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57814/0 (socket says 172.21.15.7:57814) 2024-09-19T04:17:03.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.170+0000 7f6339b2a640 1 -- 172.21.15.7:0/2936410420 learned_addr learned my addr 172.21.15.7:0/2936410420 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:03.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.170+0000 7f633a32b640 1 --2- 172.21.15.7:0/2936410420 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6334101de0 0x7f63341984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:03.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.170+0000 7f633ab2c640 1 --2- 172.21.15.7:0/2936410420 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6334106f10 0x7f633419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:03.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.170+0000 7f6339b2a640 1 -- 172.21.15.7:0/2936410420 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6334101de0 msgr2=0x7f63341984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:03.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.170+0000 7f6339b2a640 1 --2- 172.21.15.7:0/2936410420 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6334101de0 0x7f63341984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:03.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.170+0000 7f6339b2a640 1 -- 172.21.15.7:0/2936410420 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6334106f10 msgr2=0x7f633419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:03.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.171+0000 7f6339b2a640 1 --2- 172.21.15.7:0/2936410420 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6334106f10 0x7f633419cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:03.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.171+0000 7f6339b2a640 1 -- 172.21.15.7:0/2936410420 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f633419d480 con 0x7f6334102790 2024-09-19T04:17:03.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.171+0000 7f6339b2a640 1 --2- 172.21.15.7:0/2936410420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6334102790 0x7f6334198a10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6324006010 tx=0x7f63240042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:03.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.171+0000 7f632b7fe640 1 -- 172.21.15.7:0/2936410420 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632403f030 con 0x7f6334102790 2024-09-19T04:17:03.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.171+0000 7f632b7fe640 1 -- 172.21.15.7:0/2936410420 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6324003ce0 con 0x7f6334102790 2024-09-19T04:17:03.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.171+0000 7f632b7fe640 1 -- 172.21.15.7:0/2936410420 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6324035070 con 0x7f6334102790 2024-09-19T04:17:03.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.171+0000 7f633c58f640 1 -- 172.21.15.7:0/2936410420 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f633419d710 con 0x7f6334102790 2024-09-19T04:17:03.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.171+0000 7f633c58f640 1 -- 172.21.15.7:0/2936410420 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63341a5050 con 0x7f6334102790 2024-09-19T04:17:03.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.172+0000 7f633c58f640 1 -- 172.21.15.7:0/2936410420 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63341021c0 con 0x7f6334102790 2024-09-19T04:17:03.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.173+0000 7f632b7fe640 1 -- 172.21.15.7:0/2936410420 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f6324042030 con 0x7f6334102790 2024-09-19T04:17:03.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.174+0000 7f632b7fe640 1 --2- 172.21.15.7:0/2936410420 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f63200a3350 0x7f63200a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:03.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.174+0000 7f633a32b640 1 --2- 172.21.15.7:0/2936410420 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f63200a3350 0x7f63200a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:03.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.174+0000 7f632b7fe640 1 -- 172.21.15.7:0/2936410420 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f63240f0400 con 0x7f6334102790 2024-09-19T04:17:03.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.174+0000 7f633a32b640 1 --2- 172.21.15.7:0/2936410420 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f63200a3350 0x7f63200a5810 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6330005d00 tx=0x7f633000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:03.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.178+0000 7f632b7fe640 1 -- 172.21.15.7:0/2936410420 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f63240bccb0 con 0x7f6334102790 2024-09-19T04:17:03.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:03 smithi007 ceph-mon[31360]: pgmap v358: 129 pgs: 129 active+clean; 656 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-19T04:17:03.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:03 smithi007 ceph-mon[31360]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:17:03.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.396+0000 7f633c58f640 1 -- 172.21.15.7:0/2936410420 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f633410a150 con 0x7f6334102790 2024-09-19T04:17:03.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.396+0000 7f632b7fe640 1 -- 172.21.15.7:0/2936410420 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11962 (secure 0 0 0) 0x7f63240bc5b0 con 0x7f6334102790 2024-09-19T04:17:03.398 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:17:03.398 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":28,"btime":"2024-09-19T04:16:57:081835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:16:56.259017+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24496,"mds_2":24482,"mds_3":24478,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24472,24478,24482,24496,24506]},"id":1}]} 2024-09-19T04:17:03.398 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 28 2024-09-19T04:17:03.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.399+0000 7f633c58f640 1 -- 172.21.15.7:0/2936410420 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f63200a3350 msgr2=0x7f63200a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:03.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.399+0000 7f633c58f640 1 --2- 172.21.15.7:0/2936410420 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f63200a3350 0x7f63200a5810 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6330005d00 tx=0x7f633000b410 comp rx=0 tx=0).stop 2024-09-19T04:17:03.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.399+0000 7f633c58f640 1 -- 172.21.15.7:0/2936410420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6334102790 msgr2=0x7f6334198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:03.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.399+0000 7f633c58f640 1 --2- 172.21.15.7:0/2936410420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6334102790 0x7f6334198a10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6324006010 tx=0x7f63240042f0 comp rx=0 tx=0).stop 2024-09-19T04:17:03.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.399+0000 7f633c58f640 1 -- 172.21.15.7:0/2936410420 shutdown_connections 2024-09-19T04:17:03.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.399+0000 7f633c58f640 1 --2- 172.21.15.7:0/2936410420 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f63200a3350 0x7f63200a5810 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:03.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.399+0000 7f633c58f640 1 --2- 172.21.15.7:0/2936410420 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6334106f10 0x7f633419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:03.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.399+0000 7f633c58f640 1 --2- 172.21.15.7:0/2936410420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6334102790 0x7f6334198a10 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:03.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.399+0000 7f633c58f640 1 --2- 172.21.15.7:0/2936410420 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6334101de0 0x7f63341984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:03.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.399+0000 7f633c58f640 1 -- 172.21.15.7:0/2936410420 >> 172.21.15.7:0/2936410420 conn(0x7f63340fd8c0 msgr2=0x7f63340fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:03.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.399+0000 7f633c58f640 1 -- 172.21.15.7:0/2936410420 shutdown_connections 2024-09-19T04:17:03.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:03.399+0000 7f633c58f640 1 -- 172.21.15.7:0/2936410420 wait complete. 2024-09-19T04:17:03.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:03 smithi102 ceph-mon[35446]: pgmap v358: 129 pgs: 129 active+clean; 656 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-19T04:17:03.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:03 smithi102 ceph-mon[35446]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:17:03.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:03 smithi092 ceph-mon[34940]: pgmap v358: 129 pgs: 129 active+clean; 656 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-19T04:17:03.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:03 smithi092 ceph-mon[34940]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:17:04.101 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:17:04.360 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:17:04.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:04 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2936410420' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:17:04.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:04 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2936410420' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:17:04.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:04 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2936410420' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:17:04.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.838+0000 7f97a80b2640 1 -- 172.21.15.7:0/200445594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97a01036e0 msgr2=0x7f97a0107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:04.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.838+0000 7f97a80b2640 1 --2- 172.21.15.7:0/200445594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97a01036e0 0x7f97a0107b90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9790009930 tx=0x7f979002a420 comp rx=0 tx=0).stop 2024-09-19T04:17:04.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.838+0000 7f97a80b2640 1 -- 172.21.15.7:0/200445594 shutdown_connections 2024-09-19T04:17:04.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.838+0000 7f97a80b2640 1 --2- 172.21.15.7:0/200445594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97a01082a0 0x7f97a010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:04.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.838+0000 7f97a80b2640 1 --2- 172.21.15.7:0/200445594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97a01036e0 0x7f97a0107b90 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:04.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.838+0000 7f97a80b2640 1 --2- 172.21.15.7:0/200445594 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97a0102d30 0x7f97a0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:04.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.838+0000 7f97a80b2640 1 -- 172.21.15.7:0/200445594 >> 172.21.15.7:0/200445594 conn(0x7f97a00fc7d0 msgr2=0x7f97a00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:04.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.838+0000 7f97a80b2640 1 -- 172.21.15.7:0/200445594 shutdown_connections 2024-09-19T04:17:04.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.838+0000 7f97a80b2640 1 -- 172.21.15.7:0/200445594 wait complete. 2024-09-19T04:17:04.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.838+0000 7f97a80b2640 1 Processor -- start 2024-09-19T04:17:04.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.838+0000 7f97a80b2640 1 -- start start 2024-09-19T04:17:04.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.839+0000 7f97a80b2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97a0102d30 0x7f97a0198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:04.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.839+0000 7f97a80b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97a01036e0 0x7f97a0198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:04.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.839+0000 7f97a80b2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97a01082a0 0x7f97a019cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:04.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.839+0000 7f97a80b2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f97a01120e0 con 0x7f97a01082a0 2024-09-19T04:17:04.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.839+0000 7f97a80b2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f97a0111f60 con 0x7f97a0102d30 2024-09-19T04:17:04.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.839+0000 7f97a80b2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f97a0112260 con 0x7f97a01036e0 2024-09-19T04:17:04.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.839+0000 7f97a664f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97a01082a0 0x7f97a019cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:04.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.839+0000 7f97a664f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97a01082a0 0x7f97a019cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57828/0 (socket says 172.21.15.7:57828) 2024-09-19T04:17:04.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.839+0000 7f97a664f640 1 -- 172.21.15.7:0/3991996464 learned_addr learned my addr 172.21.15.7:0/3991996464 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:04.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.839+0000 7f97a5e4e640 1 --2- 172.21.15.7:0/3991996464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97a0102d30 0x7f97a0198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:04.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.839+0000 7f97a564d640 1 --2- 172.21.15.7:0/3991996464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97a01036e0 0x7f97a0198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:04.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.839+0000 7f97a664f640 1 -- 172.21.15.7:0/3991996464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97a01036e0 msgr2=0x7f97a0198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:04.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.839+0000 7f97a664f640 1 --2- 172.21.15.7:0/3991996464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97a01036e0 0x7f97a0198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:04.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.839+0000 7f97a664f640 1 -- 172.21.15.7:0/3991996464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97a0102d30 msgr2=0x7f97a0198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:04.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.839+0000 7f97a664f640 1 --2- 172.21.15.7:0/3991996464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97a0102d30 0x7f97a0198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:04.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.839+0000 7f97a664f640 1 -- 172.21.15.7:0/3991996464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a019d5f0 con 0x7f97a01082a0 2024-09-19T04:17:04.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.839+0000 7f97a664f640 1 --2- 172.21.15.7:0/3991996464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97a01082a0 0x7f97a019cf10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f979800b970 tx=0x7f979800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:04.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.839+0000 7f9796ffd640 1 -- 172.21.15.7:0/3991996464 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9798019070 con 0x7f97a01082a0 2024-09-19T04:17:04.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.839+0000 7f9796ffd640 1 -- 172.21.15.7:0/3991996464 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f979800cb40 con 0x7f97a01082a0 2024-09-19T04:17:04.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.839+0000 7f9796ffd640 1 -- 172.21.15.7:0/3991996464 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9798007650 con 0x7f97a01082a0 2024-09-19T04:17:04.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.839+0000 7f97a80b2640 1 -- 172.21.15.7:0/3991996464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97a019d8e0 con 0x7f97a01082a0 2024-09-19T04:17:04.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.840+0000 7f97a80b2640 1 -- 172.21.15.7:0/3991996464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97a01a51c0 con 0x7f97a01082a0 2024-09-19T04:17:04.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.840+0000 7f97a80b2640 1 -- 172.21.15.7:0/3991996464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97a0103110 con 0x7f97a01082a0 2024-09-19T04:17:04.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.843+0000 7f9796ffd640 1 -- 172.21.15.7:0/3991996464 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f979801c070 con 0x7f97a01082a0 2024-09-19T04:17:04.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.843+0000 7f9796ffd640 1 --2- 172.21.15.7:0/3991996464 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f978c0a32d0 0x7f978c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:04.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.843+0000 7f9796ffd640 1 -- 172.21.15.7:0/3991996464 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f97980cf800 con 0x7f97a01082a0 2024-09-19T04:17:04.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.843+0000 7f97a5e4e640 1 --2- 172.21.15.7:0/3991996464 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f978c0a32d0 0x7f978c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:04.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.844+0000 7f97a5e4e640 1 --2- 172.21.15.7:0/3991996464 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f978c0a32d0 0x7f978c0a5790 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f979c005fd0 tx=0x7f979c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:04.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:04.847+0000 7f9796ffd640 1 -- 172.21.15.7:0/3991996464 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f979809bab0 con 0x7f97a01082a0 2024-09-19T04:17:05.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:05.061+0000 7f97a80b2640 1 -- 172.21.15.7:0/3991996464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97a010a2b0 con 0x7f97a01082a0 2024-09-19T04:17:05.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:05.062+0000 7f9796ffd640 1 -- 172.21.15.7:0/3991996464 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11962 (secure 0 0 0) 0x7f979809fdb0 con 0x7f97a01082a0 2024-09-19T04:17:05.064 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:17:05.064 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":28,"btime":"2024-09-19T04:16:57:081835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:16:56.259017+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24496,"mds_2":24482,"mds_3":24478,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24472,24478,24482,24496,24506]},"id":1}]} 2024-09-19T04:17:05.064 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 28 2024-09-19T04:17:05.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:05.064+0000 7f97a80b2640 1 -- 172.21.15.7:0/3991996464 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f978c0a32d0 msgr2=0x7f978c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:05.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:05.064+0000 7f97a80b2640 1 --2- 172.21.15.7:0/3991996464 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f978c0a32d0 0x7f978c0a5790 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f979c005fd0 tx=0x7f979c00b390 comp rx=0 tx=0).stop 2024-09-19T04:17:05.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:05.064+0000 7f97a80b2640 1 -- 172.21.15.7:0/3991996464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97a01082a0 msgr2=0x7f97a019cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:05.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:05.064+0000 7f97a80b2640 1 --2- 172.21.15.7:0/3991996464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97a01082a0 0x7f97a019cf10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f979800b970 tx=0x7f979800be30 comp rx=0 tx=0).stop 2024-09-19T04:17:05.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:05.064+0000 7f97a80b2640 1 -- 172.21.15.7:0/3991996464 shutdown_connections 2024-09-19T04:17:05.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:05.064+0000 7f97a80b2640 1 --2- 172.21.15.7:0/3991996464 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f978c0a32d0 0x7f978c0a5790 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:05.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:05.064+0000 7f97a80b2640 1 --2- 172.21.15.7:0/3991996464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97a01082a0 0x7f97a019cf10 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:05.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:05.064+0000 7f97a80b2640 1 --2- 172.21.15.7:0/3991996464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97a01036e0 0x7f97a0198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:05.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:05.064+0000 7f97a80b2640 1 --2- 172.21.15.7:0/3991996464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97a0102d30 0x7f97a0198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:05.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:05.064+0000 7f97a80b2640 1 -- 172.21.15.7:0/3991996464 >> 172.21.15.7:0/3991996464 conn(0x7f97a00fc7d0 msgr2=0x7f97a0105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:05.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:05.064+0000 7f97a80b2640 1 -- 172.21.15.7:0/3991996464 shutdown_connections 2024-09-19T04:17:05.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:05.064+0000 7f97a80b2640 1 -- 172.21.15.7:0/3991996464 wait complete. 2024-09-19T04:17:05.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:05 smithi007 ceph-mon[31360]: pgmap v359: 129 pgs: 129 active+clean; 656 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-19T04:17:05.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:05 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3991996464' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:17:05.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:05 smithi102 ceph-mon[35446]: pgmap v359: 129 pgs: 129 active+clean; 656 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-19T04:17:05.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:05 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3991996464' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:17:05.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:05 smithi092 ceph-mon[34940]: pgmap v359: 129 pgs: 129 active+clean; 656 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-19T04:17:05.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:05 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3991996464' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:17:05.799 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:17:06.057 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:17:06.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:06 smithi007 ceph-mon[31360]: pgmap v360: 129 pgs: 129 active+clean; 656 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-19T04:17:06.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:06 smithi102 ceph-mon[35446]: pgmap v360: 129 pgs: 129 active+clean; 656 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-19T04:17:06.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.514+0000 7f4d84641640 1 -- 172.21.15.7:0/3891324121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d7c102790 msgr2=0x7f4d7c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:06.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.514+0000 7f4d84641640 1 --2- 172.21.15.7:0/3891324121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d7c102790 0x7f4d7c1067e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c009900 tx=0x7f4d6c02a410 comp rx=0 tx=0).stop 2024-09-19T04:17:06.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.514+0000 7f4d84641640 1 -- 172.21.15.7:0/3891324121 shutdown_connections 2024-09-19T04:17:06.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.514+0000 7f4d84641640 1 --2- 172.21.15.7:0/3891324121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d7c106f10 0x7f4d7c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:06.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.514+0000 7f4d84641640 1 --2- 172.21.15.7:0/3891324121 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d7c102790 0x7f4d7c1067e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:06.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.514+0000 7f4d84641640 1 --2- 172.21.15.7:0/3891324121 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d7c101de0 0x7f4d7c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:06.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.514+0000 7f4d84641640 1 -- 172.21.15.7:0/3891324121 >> 172.21.15.7:0/3891324121 conn(0x7f4d7c0fd8c0 msgr2=0x7f4d7c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:06.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.514+0000 7f4d84641640 1 -- 172.21.15.7:0/3891324121 shutdown_connections 2024-09-19T04:17:06.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.514+0000 7f4d84641640 1 -- 172.21.15.7:0/3891324121 wait complete. 2024-09-19T04:17:06.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.515+0000 7f4d84641640 1 Processor -- start 2024-09-19T04:17:06.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.515+0000 7f4d84641640 1 -- start start 2024-09-19T04:17:06.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.515+0000 7f4d84641640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d7c101de0 0x7f4d7c198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:06.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.515+0000 7f4d84641640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d7c102790 0x7f4d7c198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:06.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.515+0000 7f4d84641640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d7c106f10 0x7f4d7c19cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:06.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.515+0000 7f4d84641640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7c111f70 con 0x7f4d7c106f10 2024-09-19T04:17:06.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.515+0000 7f4d84641640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7c111df0 con 0x7f4d7c102790 2024-09-19T04:17:06.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.515+0000 7f4d84641640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7c1120f0 con 0x7f4d7c101de0 2024-09-19T04:17:06.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.515+0000 7f4d82bde640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d7c106f10 0x7f4d7c19cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:06.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.515+0000 7f4d82bde640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d7c106f10 0x7f4d7c19cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57850/0 (socket says 172.21.15.7:57850) 2024-09-19T04:17:06.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.515+0000 7f4d82bde640 1 -- 172.21.15.7:0/3065105264 learned_addr learned my addr 172.21.15.7:0/3065105264 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:06.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.515+0000 7f4d823dd640 1 --2- 172.21.15.7:0/3065105264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d7c101de0 0x7f4d7c198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:06.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.515+0000 7f4d81bdc640 1 --2- 172.21.15.7:0/3065105264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d7c102790 0x7f4d7c198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:06.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.515+0000 7f4d82bde640 1 -- 172.21.15.7:0/3065105264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d7c101de0 msgr2=0x7f4d7c198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:06.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.515+0000 7f4d82bde640 1 --2- 172.21.15.7:0/3065105264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d7c101de0 0x7f4d7c198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:06.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.515+0000 7f4d82bde640 1 -- 172.21.15.7:0/3065105264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d7c102790 msgr2=0x7f4d7c198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:06.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.515+0000 7f4d82bde640 1 --2- 172.21.15.7:0/3065105264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d7c102790 0x7f4d7c198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:06.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.516+0000 7f4d82bde640 1 -- 172.21.15.7:0/3065105264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d7c19d4c0 con 0x7f4d7c106f10 2024-09-19T04:17:06.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.516+0000 7f4d823dd640 1 --2- 172.21.15.7:0/3065105264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d7c101de0 0x7f4d7c198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:17:06.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.516+0000 7f4d81bdc640 1 --2- 172.21.15.7:0/3065105264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d7c102790 0x7f4d7c198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:17:06.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.516+0000 7f4d82bde640 1 --2- 172.21.15.7:0/3065105264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d7c106f10 0x7f4d7c19cde0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400cad0 tx=0x7f4d7400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:06.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.516+0000 7f4d737fe640 1 -- 172.21.15.7:0/3065105264 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7400ae20 con 0x7f4d7c106f10 2024-09-19T04:17:06.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.516+0000 7f4d84641640 1 -- 172.21.15.7:0/3065105264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d7c19d7b0 con 0x7f4d7c106f10 2024-09-19T04:17:06.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.516+0000 7f4d737fe640 1 -- 172.21.15.7:0/3065105264 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d74005020 con 0x7f4d7c106f10 2024-09-19T04:17:06.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.516+0000 7f4d737fe640 1 -- 172.21.15.7:0/3065105264 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7400f6f0 con 0x7f4d7c106f10 2024-09-19T04:17:06.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.516+0000 7f4d84641640 1 -- 172.21.15.7:0/3065105264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d7c1a5090 con 0x7f4d7c106f10 2024-09-19T04:17:06.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.517+0000 7f4d84641640 1 -- 172.21.15.7:0/3065105264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d7c1021c0 con 0x7f4d7c106f10 2024-09-19T04:17:06.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.518+0000 7f4d737fe640 1 -- 172.21.15.7:0/3065105264 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f4d740051d0 con 0x7f4d7c106f10 2024-09-19T04:17:06.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.519+0000 7f4d737fe640 1 --2- 172.21.15.7:0/3065105264 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4d680a32d0 0x7f4d680a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:06.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.519+0000 7f4d823dd640 1 --2- 172.21.15.7:0/3065105264 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4d680a32d0 0x7f4d680a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:06.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.519+0000 7f4d737fe640 1 -- 172.21.15.7:0/3065105264 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f4d740cff50 con 0x7f4d7c106f10 2024-09-19T04:17:06.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.519+0000 7f4d823dd640 1 --2- 172.21.15.7:0/3065105264 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4d680a32d0 0x7f4d680a5790 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4d78009b40 tx=0x7f4d78005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:06.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.523+0000 7f4d737fe640 1 -- 172.21.15.7:0/3065105264 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4d74014030 con 0x7f4d7c106f10 2024-09-19T04:17:06.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:06 smithi092 ceph-mon[34940]: pgmap v360: 129 pgs: 129 active+clean; 656 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-19T04:17:06.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.701+0000 7f4d84641640 1 -- 172.21.15.7:0/3065105264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4d7c10a150 con 0x7f4d7c106f10 2024-09-19T04:17:06.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.702+0000 7f4d737fe640 1 -- 172.21.15.7:0/3065105264 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24861 (secure 0 0 0) 0x7f4d7409c740 con 0x7f4d7c106f10 2024-09-19T04:17:06.704 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:17:06.704 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":90,"fsid":"77957c0a-763c-11ef-bceb-c7b262605968","created":"2024-09-19T04:06:58.337394+0000","modified":"2024-09-19T04:16:47.053920+0000","last_up_change":"2024-09-19T04:13:42.312137+0000","last_in_change":"2024-09-19T04:13:18.757925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:09:59.544984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:14:30.225637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:14:32.252497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T04:14:38.781821+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d9b93bd5-ee22-4fb0-ba29-bfa208430a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6803","nonce":240599233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6805","nonce":240599233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6809","nonce":240599233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6807","nonce":240599233}]},"public_addr":"172.21.15.7:6803/240599233","cluster_addr":"172.21.15.7:6805/240599233","heartbeat_back_addr":"172.21.15.7:6809/240599233","heartbeat_front_addr":"172.21.15.7:6807/240599233","state":["exists","up"]},{"osd":1,"uuid":"db5793e6-f3ad-4075-a02b-206bf7f1e59a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6801","nonce":902403333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6803","nonce":902403333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6807","nonce":902403333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6805","nonce":902403333}]},"public_addr":"172.21.15.92:6801/902403333","cluster_addr":"172.21.15.92:6803/902403333","heartbeat_back_addr":"172.21.15.92:6807/902403333","heartbeat_front_addr":"172.21.15.92:6805/902403333","state":["exists","up"]},{"osd":2,"uuid":"1eb83a1b-82d8-4983-bae3-b161adb3a33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6801","nonce":2078441772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6803","nonce":2078441772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6807","nonce":2078441772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6805","nonce":2078441772}]},"public_addr":"172.21.15.102:6801/2078441772","cluster_addr":"172.21.15.102:6803/2078441772","heartbeat_back_addr":"172.21.15.102:6807/2078441772","heartbeat_front_addr":"172.21.15.102:6805/2078441772","state":["exists","up"]},{"osd":3,"uuid":"68ba79e5-bcf0-4349-9e14-42f2fa9c11b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6811","nonce":2729561132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6813","nonce":2729561132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6817","nonce":2729561132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6815","nonce":2729561132}]},"public_addr":"172.21.15.7:6811/2729561132","cluster_addr":"172.21.15.7:6813/2729561132","heartbeat_back_addr":"172.21.15.7:6817/2729561132","heartbeat_front_addr":"172.21.15.7:6815/2729561132","state":["exists","up"]},{"osd":4,"uuid":"f20d4a51-121f-4ac8-afeb-5962d83bd697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6809","nonce":2799734294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6811","nonce":2799734294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6815","nonce":2799734294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6813","nonce":2799734294}]},"public_addr":"172.21.15.92:6809/2799734294","cluster_addr":"172.21.15.92:6811/2799734294","heartbeat_back_addr":"172.21.15.92:6815/2799734294","heartbeat_front_addr":"172.21.15.92:6813/2799734294","state":["exists","up"]},{"osd":5,"uuid":"aac02b0a-99dc-4457-8898-c68dc196517a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6809","nonce":3099678146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6811","nonce":3099678146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6815","nonce":3099678146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6813","nonce":3099678146}]},"public_addr":"172.21.15.102:6809/3099678146","cluster_addr":"172.21.15.102:6811/3099678146","heartbeat_back_addr":"172.21.15.102:6815/3099678146","heartbeat_front_addr":"172.21.15.102:6813/3099678146","state":["exists","up"]},{"osd":6,"uuid":"7e5a8b30-8406-486c-ace5-79158a3757a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6819","nonce":1569704304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6821","nonce":1569704304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6825","nonce":1569704304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6823","nonce":1569704304}]},"public_addr":"172.21.15.7:6819/1569704304","cluster_addr":"172.21.15.7:6821/1569704304","heartbeat_back_addr":"172.21.15.7:6825/1569704304","heartbeat_front_addr":"172.21.15.7:6823/1569704304","state":["exists","up"]},{"osd":7,"uuid":"e6a7049a-17a1-43b2-8ecd-5f4ca7c337be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6817","nonce":3411102480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6819","nonce":3411102480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6823","nonce":3411102480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6821","nonce":3411102480}]},"public_addr":"172.21.15.92:6817/3411102480","cluster_addr":"172.21.15.92:6819/3411102480","heartbeat_back_addr":"172.21.15.92:6823/3411102480","heartbeat_front_addr":"172.21.15.92:6821/3411102480","state":["exists","up"]},{"osd":8,"uuid":"31879baa-861d-4322-990f-0b9a42b8b610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6817","nonce":2990859925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6819","nonce":2990859925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6823","nonce":2990859925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6821","nonce":2990859925}]},"public_addr":"172.21.15.102:6817/2990859925","cluster_addr":"172.21.15.102:6819/2990859925","heartbeat_back_addr":"172.21.15.102:6823/2990859925","heartbeat_front_addr":"172.21.15.102:6821/2990859925","state":["exists","up"]},{"osd":9,"uuid":"6d65db33-926c-4a6e-a072-707e9c9de92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6827","nonce":1710319475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6829","nonce":1710319475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6833","nonce":1710319475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6831","nonce":1710319475}]},"public_addr":"172.21.15.7:6827/1710319475","cluster_addr":"172.21.15.7:6829/1710319475","heartbeat_back_addr":"172.21.15.7:6833/1710319475","heartbeat_front_addr":"172.21.15.7:6831/1710319475","state":["exists","up"]},{"osd":10,"uuid":"9ab681ee-0bef-47bd-bf3d-20b17c6b870c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6825","nonce":1063265541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6827","nonce":1063265541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6831","nonce":1063265541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6829","nonce":1063265541}]},"public_addr":"172.21.15.92:6825/1063265541","cluster_addr":"172.21.15.92:6827/1063265541","heartbeat_back_addr":"172.21.15.92:6831/1063265541","heartbeat_front_addr":"172.21.15.92:6829/1063265541","state":["exists","up"]},{"osd":11,"uuid":"dc398e14-5f9e-4f0a-b158-35cbc1f73a83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6825","nonce":1175425599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6827","nonce":1175425599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6831","nonce":1175425599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6829","nonce":1175425599}]},"public_addr":"172.21.15.102:6825/1175425599","cluster_addr":"172.21.15.102:6827/1175425599","heartbeat_back_addr":"172.21.15.102:6831/1175425599","heartbeat_front_addr":"172.21.15.102:6829/1175425599","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:07.857319+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:31.430120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:56.892301+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:10:22.011884+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:10:46.326025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:11:10.339084+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:11:35.365906+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:01.104309+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:25.717295+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:51.387644+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:13:15.076355+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:13:40.253150+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9},{"from":5,"to":8}]},{"pgid":"3.c","mappings":[{"from":5,"to":6}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1d","mappings":[{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/2883028938":"2024-09-20T04:07:45.039922+0000","172.21.15.7:0/1186412739":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6800/751091002":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6801/751091002":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6801/940106179":"2024-09-20T04:07:20.364033+0000","172.21.15.7:6800/940106179":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/1450115700":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/2954294373":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/1996930242":"2024-09-20T04:07:45.039922+0000","172.21.15.7:0/3562231347":"2024-09-20T04:07:20.364033+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:17:06.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.704+0000 7f4d84641640 1 -- 172.21.15.7:0/3065105264 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4d680a32d0 msgr2=0x7f4d680a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:06.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.704+0000 7f4d84641640 1 --2- 172.21.15.7:0/3065105264 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4d680a32d0 0x7f4d680a5790 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4d78009b40 tx=0x7f4d78005e50 comp rx=0 tx=0).stop 2024-09-19T04:17:06.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.704+0000 7f4d84641640 1 -- 172.21.15.7:0/3065105264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d7c106f10 msgr2=0x7f4d7c19cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:06.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.704+0000 7f4d84641640 1 --2- 172.21.15.7:0/3065105264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d7c106f10 0x7f4d7c19cde0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400cad0 tx=0x7f4d7400cf90 comp rx=0 tx=0).stop 2024-09-19T04:17:06.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.704+0000 7f4d84641640 1 -- 172.21.15.7:0/3065105264 shutdown_connections 2024-09-19T04:17:06.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.704+0000 7f4d84641640 1 --2- 172.21.15.7:0/3065105264 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4d680a32d0 0x7f4d680a5790 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:06.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.704+0000 7f4d84641640 1 --2- 172.21.15.7:0/3065105264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4d7c106f10 0x7f4d7c19cde0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:06.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.704+0000 7f4d84641640 1 --2- 172.21.15.7:0/3065105264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d7c102790 0x7f4d7c198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:06.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.704+0000 7f4d84641640 1 --2- 172.21.15.7:0/3065105264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d7c101de0 0x7f4d7c198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:06.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.704+0000 7f4d84641640 1 -- 172.21.15.7:0/3065105264 >> 172.21.15.7:0/3065105264 conn(0x7f4d7c0fd8c0 msgr2=0x7f4d7c0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:06.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.704+0000 7f4d84641640 1 -- 172.21.15.7:0/3065105264 shutdown_connections 2024-09-19T04:17:06.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:06.705+0000 7f4d84641640 1 -- 172.21.15.7:0/3065105264 wait complete. 2024-09-19T04:17:07.372 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:07 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3065105264' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:17:07.403 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-19T04:17:07.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:07 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3065105264' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:17:07.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:07 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3065105264' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:17:07.661 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:17:08.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:08 smithi007 ceph-mon[31360]: pgmap v361: 129 pgs: 129 active+clean; 656 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-09-19T04:17:08.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:08 smithi102 ceph-mon[35446]: pgmap v361: 129 pgs: 129 active+clean; 656 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-09-19T04:17:08.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:08 smithi092 ceph-mon[34940]: pgmap v361: 129 pgs: 129 active+clean; 656 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-09-19T04:17:08.897 INFO:teuthology.orchestra.run.smithi007.stdout:{"run_dir":"/var/run/ceph"} 2024-09-19T04:17:08.897 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-19T04:17:08.898 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 1747 2024-09-19T04:17:08.898 DEBUG:tasks.quiescer:Yielding 2024-09-19T04:17:08.898 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T04:17:08.912 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T04:17:08.912 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T04:17:08.912 INFO:tasks.workunit:timeout=3h 2024-09-19T04:17:08.912 INFO:tasks.workunit:cleanup=True 2024-09-19T04:17:08.913 DEBUG:teuthology.orchestra.run.smithi007:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T04:17:08.913 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:17:08.931 INFO:teuthology.orchestra.run.smithi007.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T04:17:08.931 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-19T04:17:08.931 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-19T04:17:08.932 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:17:08.932 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-19T04:17:08.932 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-19 04:15:24.686539158 +0000 2024-09-19T04:17:08.932 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-19 04:15:24.686539158 +0000 2024-09-19T04:17:08.932 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-19 04:16:55.568770705 +0000 2024-09-19T04:17:08.932 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-19 04:15:24.686539158 +0000 2024-09-19T04:17:08.932 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T04:17:08.932 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T04:17:09.011 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T04:17:09.068 INFO:tasks.workunit.client.0.smithi007.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T04:17:09.179 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:17:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.696+0000 7f9e4552a640 1 -- 172.21.15.7:0/3178996352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e40102ef0 msgr2=0x7f9e4010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.696+0000 7f9e4552a640 1 --2- 172.21.15.7:0/3178996352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e40102ef0 0x7f9e4010da40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9e38009ca0 tx=0x7f9e3802a950 comp rx=0 tx=0).stop 2024-09-19T04:17:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.696+0000 7f9e4552a640 1 -- 172.21.15.7:0/3178996352 shutdown_connections 2024-09-19T04:17:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.696+0000 7f9e4552a640 1 --2- 172.21.15.7:0/3178996352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e40102ef0 0x7f9e4010da40 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.696+0000 7f9e4552a640 1 --2- 172.21.15.7:0/3178996352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e40102570 0x7f9e401029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.696+0000 7f9e4552a640 1 --2- 172.21.15.7:0/3178996352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e40100e20 0x7f9e40101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.696+0000 7f9e4552a640 1 -- 172.21.15.7:0/3178996352 >> 172.21.15.7:0/3178996352 conn(0x7f9e400fc7d0 msgr2=0x7f9e400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.696+0000 7f9e4552a640 1 -- 172.21.15.7:0/3178996352 shutdown_connections 2024-09-19T04:17:09.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.696+0000 7f9e4552a640 1 -- 172.21.15.7:0/3178996352 wait complete. 2024-09-19T04:17:09.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.696+0000 7f9e4552a640 1 Processor -- start 2024-09-19T04:17:09.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.697+0000 7f9e4552a640 1 -- start start 2024-09-19T04:17:09.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.697+0000 7f9e4552a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e40100e20 0x7f9e40107ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:09.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.697+0000 7f9e4552a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e40102570 0x7f9e40108020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:09.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.697+0000 7f9e4552a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e40102ef0 0x7f9e40108560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:09.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.697+0000 7f9e4552a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9e40110f80 con 0x7f9e40102570 2024-09-19T04:17:09.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.697+0000 7f9e4552a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9e40110e00 con 0x7f9e40100e20 2024-09-19T04:17:09.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.697+0000 7f9e4552a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9e40111100 con 0x7f9e40102ef0 2024-09-19T04:17:09.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.697+0000 7f9e3e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e40102570 0x7f9e40108020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:09.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.697+0000 7f9e3e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e40102570 0x7f9e40108020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40792/0 (socket says 172.21.15.7:40792) 2024-09-19T04:17:09.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.697+0000 7f9e3e7fc640 1 -- 172.21.15.7:0/1869881657 learned_addr learned my addr 172.21.15.7:0/1869881657 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:09.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.697+0000 7f9e3effd640 1 --2- 172.21.15.7:0/1869881657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e40100e20 0x7f9e40107ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:09.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.697+0000 7f9e3f7fe640 1 --2- 172.21.15.7:0/1869881657 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e40102ef0 0x7f9e40108560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:09.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.697+0000 7f9e3e7fc640 1 -- 172.21.15.7:0/1869881657 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e40102ef0 msgr2=0x7f9e40108560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:09.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.697+0000 7f9e3e7fc640 1 --2- 172.21.15.7:0/1869881657 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e40102ef0 0x7f9e40108560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:09.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.697+0000 7f9e3e7fc640 1 -- 172.21.15.7:0/1869881657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e40100e20 msgr2=0x7f9e40107ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:09.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.697+0000 7f9e3e7fc640 1 --2- 172.21.15.7:0/1869881657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e40100e20 0x7f9e40107ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:09.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.697+0000 7f9e3e7fc640 1 -- 172.21.15.7:0/1869881657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e401a6950 con 0x7f9e40102570 2024-09-19T04:17:09.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.697+0000 7f9e3f7fe640 1 --2- 172.21.15.7:0/1869881657 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e40102ef0 0x7f9e40108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:17:09.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.697+0000 7f9e3effd640 1 --2- 172.21.15.7:0/1869881657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e40100e20 0x7f9e40107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:17:09.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.698+0000 7f9e3e7fc640 1 --2- 172.21.15.7:0/1869881657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e40102570 0x7f9e40108020 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9e3400e9f0 tx=0x7f9e3400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:09.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.698+0000 7f9e27fff640 1 -- 172.21.15.7:0/1869881657 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3400cd80 con 0x7f9e40102570 2024-09-19T04:17:09.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.698+0000 7f9e4552a640 1 -- 172.21.15.7:0/1869881657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e401a6c40 con 0x7f9e40102570 2024-09-19T04:17:09.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.698+0000 7f9e27fff640 1 -- 172.21.15.7:0/1869881657 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e34005500 con 0x7f9e40102570 2024-09-19T04:17:09.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.698+0000 7f9e27fff640 1 -- 172.21.15.7:0/1869881657 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e34010690 con 0x7f9e40102570 2024-09-19T04:17:09.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.698+0000 7f9e4552a640 1 -- 172.21.15.7:0/1869881657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e401a7180 con 0x7f9e40102570 2024-09-19T04:17:09.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.699+0000 7f9e4552a640 1 -- 172.21.15.7:0/1869881657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e40101200 con 0x7f9e40102570 2024-09-19T04:17:09.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.700+0000 7f9e27fff640 1 -- 172.21.15.7:0/1869881657 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f9e340046c0 con 0x7f9e40102570 2024-09-19T04:17:09.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.701+0000 7f9e27fff640 1 --2- 172.21.15.7:0/1869881657 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9e280a32d0 0x7f9e280a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:09.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.701+0000 7f9e27fff640 1 -- 172.21.15.7:0/1869881657 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f9e340d02d0 con 0x7f9e40102570 2024-09-19T04:17:09.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.701+0000 7f9e3effd640 1 --2- 172.21.15.7:0/1869881657 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9e280a32d0 0x7f9e280a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:09.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.702+0000 7f9e3effd640 1 --2- 172.21.15.7:0/1869881657 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9e280a32d0 0x7f9e280a5790 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9e30009fc0 tx=0x7f9e30005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:09.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.705+0000 7f9e27fff640 1 -- 172.21.15.7:0/1869881657 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9e3409cac0 con 0x7f9e40102570 2024-09-19T04:17:09.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.920+0000 7f9e4552a640 1 -- 172.21.15.7:0/1869881657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e401a73b0 con 0x7f9e40102570 2024-09-19T04:17:09.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.921+0000 7f9e27fff640 1 -- 172.21.15.7:0/1869881657 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11962 (secure 0 0 0) 0x7f9e3409c3c0 con 0x7f9e40102570 2024-09-19T04:17:09.922 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:17:09.922 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":28,"btime":"2024-09-19T04:16:57:081835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:16:56.259017+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24496,"mds_2":24482,"mds_3":24478,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24472,24478,24482,24496,24506]},"id":1}]} 2024-09-19T04:17:09.922 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 28 2024-09-19T04:17:09.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.923+0000 7f9e4552a640 1 -- 172.21.15.7:0/1869881657 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9e280a32d0 msgr2=0x7f9e280a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:09.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.923+0000 7f9e4552a640 1 --2- 172.21.15.7:0/1869881657 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9e280a32d0 0x7f9e280a5790 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9e30009fc0 tx=0x7f9e30005f90 comp rx=0 tx=0).stop 2024-09-19T04:17:09.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.923+0000 7f9e4552a640 1 -- 172.21.15.7:0/1869881657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e40102570 msgr2=0x7f9e40108020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:09.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.923+0000 7f9e4552a640 1 --2- 172.21.15.7:0/1869881657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e40102570 0x7f9e40108020 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9e3400e9f0 tx=0x7f9e3400edf0 comp rx=0 tx=0).stop 2024-09-19T04:17:09.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.923+0000 7f9e4552a640 1 -- 172.21.15.7:0/1869881657 shutdown_connections 2024-09-19T04:17:09.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.923+0000 7f9e4552a640 1 --2- 172.21.15.7:0/1869881657 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9e280a32d0 0x7f9e280a5790 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:09.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.923+0000 7f9e4552a640 1 --2- 172.21.15.7:0/1869881657 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e40102ef0 0x7f9e40108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:09.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.923+0000 7f9e4552a640 1 --2- 172.21.15.7:0/1869881657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e40102570 0x7f9e40108020 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:09.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.923+0000 7f9e4552a640 1 --2- 172.21.15.7:0/1869881657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e40100e20 0x7f9e40107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:09.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.923+0000 7f9e4552a640 1 -- 172.21.15.7:0/1869881657 >> 172.21.15.7:0/1869881657 conn(0x7f9e400fc7d0 msgr2=0x7f9e401037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:09.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.923+0000 7f9e4552a640 1 -- 172.21.15.7:0/1869881657 shutdown_connections 2024-09-19T04:17:09.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:09.923+0000 7f9e4552a640 1 -- 172.21.15.7:0/1869881657 wait complete. 2024-09-19T04:17:10.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:10 smithi092 ceph-mon[34940]: pgmap v362: 129 pgs: 129 active+clean; 656 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-19T04:17:10.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:10 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1869881657' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:17:10.575 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:10 smithi007 ceph-mon[31360]: pgmap v362: 129 pgs: 129 active+clean; 656 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-19T04:17:10.575 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:10 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1869881657' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:17:10.607 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T04:14:34.007803+0000', 'modified': '2024-09-19T04:16:56.259017+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24506, 'mds_1': 24496, 'mds_2': 24482, 'mds_3': 24478, 'mds_4': 24472}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14583': {'gid': 14583, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.7:6839/2492396165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6838', 'nonce': 2492396165}, {'type': 'v1', 'addr': '172.21.15.7:6839', 'nonce': 2492396165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14595': {'gid': 14595, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.7:6841/4142126419', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6840', 'nonce': 4142126419}, {'type': 'v1', 'addr': '172.21.15.7:6841', 'nonce': 4142126419}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24424': {'gid': 24424, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.102:6833/3063042931', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6832', 'nonce': 3063042931}, {'type': 'v1', 'addr': '172.21.15.102:6833', 'nonce': 3063042931}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24431': {'gid': 24431, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.92:6833/4006669352', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6832', 'nonce': 4006669352}, {'type': 'v1', 'addr': '172.21.15.92:6833', 'nonce': 4006669352}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.92:6835/4235013488', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6834', 'nonce': 4235013488}, {'type': 'v1', 'addr': '172.21.15.92:6835', 'nonce': 4235013488}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24472': {'gid': 24472, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.102:6835/1756454579', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6834', 'nonce': 1756454579}, {'type': 'v1', 'addr': '172.21.15.102:6835', 'nonce': 1756454579}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24478': {'gid': 24478, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.102:6837/618291553', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6836', 'nonce': 618291553}, {'type': 'v1', 'addr': '172.21.15.102:6837', 'nonce': 618291553}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24482': {'gid': 24482, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.92:6837/319779585', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6836', 'nonce': 319779585}, {'type': 'v1', 'addr': '172.21.15.92:6837', 'nonce': 319779585}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24496': {'gid': 24496, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.102:6839/2728093829', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6838', 'nonce': 2728093829}, {'type': 'v1', 'addr': '172.21.15.102:6839', 'nonce': 2728093829}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24506': {'gid': 24506, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.92:6839/3805481296', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6838', 'nonce': 3805481296}, {'type': 'v1', 'addr': '172.21.15.92:6839', 'nonce': 3805481296}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24506, 'qdb_cluster': [24472, 24478, 24482, 24496, 24506]} 2024-09-19T04:17:10.608 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-19T04:17:10.608 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph tell mds.f status 2024-09-19T04:17:10.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.630+0000 7ff133d91640 1 -- 172.21.15.7:0/602165007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff12c101c60 msgr2=0x7ff12c1020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:10.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.630+0000 7ff133d91640 1 --2- 172.21.15.7:0/602165007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff12c101c60 0x7ff12c1020e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009900 tx=0x7ff11c02a410 comp rx=0 tx=0).stop 2024-09-19T04:17:10.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.630+0000 7ff133d91640 1 -- 172.21.15.7:0/602165007 shutdown_connections 2024-09-19T04:17:10.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.630+0000 7ff133d91640 1 --2- 172.21.15.7:0/602165007 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff12c102620 0x7ff12c108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.630+0000 7ff133d91640 1 --2- 172.21.15.7:0/602165007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff12c101c60 0x7ff12c1020e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.630+0000 7ff133d91640 1 --2- 172.21.15.7:0/602165007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff12c100a70 0x7ff12c100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.630+0000 7ff133d91640 1 -- 172.21.15.7:0/602165007 >> 172.21.15.7:0/602165007 conn(0x7ff12c0fc1f0 msgr2=0x7ff12c0fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:10.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.630+0000 7ff133d91640 1 -- 172.21.15.7:0/602165007 shutdown_connections 2024-09-19T04:17:10.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.630+0000 7ff133d91640 1 -- 172.21.15.7:0/602165007 wait complete. 2024-09-19T04:17:10.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.630+0000 7ff133d91640 1 Processor -- start 2024-09-19T04:17:10.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.630+0000 7ff133d91640 1 -- start start 2024-09-19T04:17:10.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.630+0000 7ff133d91640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff12c100a70 0x7ff12c197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:10.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.630+0000 7ff133d91640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff12c101c60 0x7ff12c198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:10.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.630+0000 7ff133d91640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff12c102620 0x7ff12c19f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:10.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.630+0000 7ff133d91640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c10c6d0 con 0x7ff12c102620 2024-09-19T04:17:10.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.630+0000 7ff133d91640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c10c550 con 0x7ff12c100a70 2024-09-19T04:17:10.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.630+0000 7ff133d91640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c10c850 con 0x7ff12c101c60 2024-09-19T04:17:10.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.631+0000 7ff13232e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff12c102620 0x7ff12c19f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:10.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.631+0000 7ff13232e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff12c102620 0x7ff12c19f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40820/0 (socket says 172.21.15.7:40820) 2024-09-19T04:17:10.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.631+0000 7ff13232e640 1 -- 172.21.15.7:0/4118867553 learned_addr learned my addr 172.21.15.7:0/4118867553 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:10.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.631+0000 7ff13132c640 1 --2- 172.21.15.7:0/4118867553 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff12c101c60 0x7ff12c198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:10.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.631+0000 7ff131b2d640 1 --2- 172.21.15.7:0/4118867553 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff12c100a70 0x7ff12c197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.631+0000 7ff13232e640 1 -- 172.21.15.7:0/4118867553 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff12c101c60 msgr2=0x7ff12c198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.631+0000 7ff13232e640 1 --2- 172.21.15.7:0/4118867553 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff12c101c60 0x7ff12c198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.631+0000 7ff13232e640 1 -- 172.21.15.7:0/4118867553 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff12c100a70 msgr2=0x7ff12c197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.631+0000 7ff13232e640 1 --2- 172.21.15.7:0/4118867553 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff12c100a70 0x7ff12c197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.631+0000 7ff13232e640 1 -- 172.21.15.7:0/4118867553 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff12c19fac0 con 0x7ff12c102620 2024-09-19T04:17:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.631+0000 7ff13232e640 1 --2- 172.21.15.7:0/4118867553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff12c102620 0x7ff12c19f450 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff12400eaa0 tx=0x7ff12400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:10.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.631+0000 7ff122ffd640 1 -- 172.21.15.7:0/4118867553 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12400cdb0 con 0x7ff12c102620 2024-09-19T04:17:10.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.631+0000 7ff122ffd640 1 -- 172.21.15.7:0/4118867553 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff124005020 con 0x7ff12c102620 2024-09-19T04:17:10.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.631+0000 7ff133d91640 1 -- 172.21.15.7:0/4118867553 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff12c19fdb0 con 0x7ff12c102620 2024-09-19T04:17:10.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.631+0000 7ff122ffd640 1 -- 172.21.15.7:0/4118867553 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1240116b0 con 0x7ff12c102620 2024-09-19T04:17:10.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.631+0000 7ff133d91640 1 -- 172.21.15.7:0/4118867553 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff12c1a0220 con 0x7ff12c102620 2024-09-19T04:17:10.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.634+0000 7ff122ffd640 1 -- 172.21.15.7:0/4118867553 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7ff124005560 con 0x7ff12c102620 2024-09-19T04:17:10.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.634+0000 7ff136c0d740 1 Processor -- start 2024-09-19T04:17:10.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.634+0000 7ff136c0d740 1 -- start start 2024-09-19T04:17:10.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.634+0000 7ff136c0d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618c0ac9db0 0x5618c0aca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:10.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.634+0000 7ff136c0d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618c0aca6f0 0x5618c0acf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:10.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.634+0000 7ff136c0d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c0acf780 0x5618c0ad1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:10.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.634+0000 7ff136c0d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5618c0a292f0 con 0x5618c0aca6f0 2024-09-19T04:17:10.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.634+0000 7ff136c0d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5618c09d1270 con 0x5618c0acf780 2024-09-19T04:17:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.634+0000 7ff136c0d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5618c0a252b0 con 0x5618c0ac9db0 2024-09-19T04:17:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.635+0000 7ff131b2d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618c0aca6f0 0x5618c0acf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.635+0000 7ff131b2d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618c0aca6f0 0x5618c0acf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40828/0 (socket says 172.21.15.7:40828) 2024-09-19T04:17:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.635+0000 7ff131b2d640 1 -- 172.21.15.7:0/1566871539 learned_addr learned my addr 172.21.15.7:0/1566871539 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.635+0000 7ff13132c640 1 --2- 172.21.15.7:0/1566871539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618c0ac9db0 0x5618c0aca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.635+0000 7ff13132c640 1 --2- 172.21.15.7:0/1566871539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c0acf780 0x5618c0ad1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.635+0000 7ff122ffd640 1 --2- 172.21.15.7:0/4118867553 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff1180a32d0 0x7ff1180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.635+0000 7ff131b2d640 1 -- 172.21.15.7:0/1566871539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618c0ac9db0 msgr2=0x5618c0aca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.635+0000 7ff131b2d640 1 --2- 172.21.15.7:0/1566871539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618c0ac9db0 0x5618c0aca1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.635+0000 7ff131b2d640 1 -- 172.21.15.7:0/1566871539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c0acf780 msgr2=0x5618c0ad1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.635+0000 7ff131b2d640 1 --2- 172.21.15.7:0/1566871539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c0acf780 0x5618c0ad1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.635+0000 7ff131b2d640 1 -- 172.21.15.7:0/1566871539 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618c09d0340 con 0x5618c0aca6f0 2024-09-19T04:17:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.635+0000 7ff13132c640 1 --2- 172.21.15.7:0/1566871539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c0acf780 0x5618c0ad1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:17:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.635+0000 7ff13232e640 1 --2- 172.21.15.7:0/4118867553 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff1180a32d0 0x7ff1180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.635+0000 7ff122ffd640 1 -- 172.21.15.7:0/4118867553 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7ff1240d0010 con 0x7ff12c102620 2024-09-19T04:17:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.635+0000 7ff131b2d640 1 --2- 172.21.15.7:0/1566871539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618c0aca6f0 0x5618c0acf1b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff12800bcb0 tx=0x7ff1280107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815a246084ae359f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.635+0000 7ff117fff640 1 -- 172.21.15.7:0/1566871539 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff128004020 con 0x5618c0aca6f0 2024-09-19T04:17:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.636+0000 7ff117fff640 1 -- 172.21.15.7:0/1566871539 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff128005500 con 0x5618c0aca6f0 2024-09-19T04:17:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.636+0000 7ff117fff640 1 -- 172.21.15.7:0/1566871539 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff128004dd0 con 0x5618c0aca6f0 2024-09-19T04:17:10.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.636+0000 7ff136c0d740 1 -- 172.21.15.7:0/1566871539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618c0aca6f0 msgr2=0x5618c0acf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:10.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.636+0000 7ff13232e640 1 --2- 172.21.15.7:0/4118867553 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff1180a32d0 0x7ff1180a5790 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff12406f000 tx=0x7ff12406df80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:10.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.636+0000 7ff136c0d740 1 --2- 172.21.15.7:0/1566871539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618c0aca6f0 0x5618c0acf1b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff12800bcb0 tx=0x7ff1280107a0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.636+0000 7ff136c0d740 1 -- 172.21.15.7:0/1566871539 shutdown_connections 2024-09-19T04:17:10.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.636+0000 7ff136c0d740 1 --2- 172.21.15.7:0/1566871539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c0acf780 0x5618c0ad1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.636+0000 7ff136c0d740 1 --2- 172.21.15.7:0/1566871539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618c0aca6f0 0x5618c0acf1b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.636+0000 7ff136c0d740 1 --2- 172.21.15.7:0/1566871539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618c0ac9db0 0x5618c0aca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.636+0000 7ff136c0d740 1 -- 172.21.15.7:0/1566871539 >> 172.21.15.7:0/1566871539 conn(0x5618c0ac1010 msgr2=0x5618c0ac1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.636+0000 7ff136c0d740 1 -- 172.21.15.7:0/1566871539 shutdown_connections 2024-09-19T04:17:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.637+0000 7ff136c0d740 1 -- 172.21.15.7:0/1566871539 wait complete. 2024-09-19T04:17:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.637+0000 7ff136c0d740 1 -- start start 2024-09-19T04:17:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.637+0000 7ff136c0d740 1 Processor -- start 2024-09-19T04:17:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.637+0000 7ff136c0d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618c0ac9db0 0x5618c0ad3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.637+0000 7ff136c0d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c0aca6f0 0x5618c0ad44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.637+0000 7ff136c0d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618c0acf780 0x5618c0adb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.637+0000 7ff136c0d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5618c0ad2750 con 0x5618c0acf780 2024-09-19T04:17:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.637+0000 7ff136c0d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5618c09b2290 con 0x5618c0aca6f0 2024-09-19T04:17:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.637+0000 7ff136c0d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5618c0ad28d0 con 0x5618c0ac9db0 2024-09-19T04:17:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.637+0000 7ff136c0d740 10 client.0 _ll_register_callbacks cb 0x5618c09e3140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:17:10.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.637+0000 7ff13132c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618c0acf780 0x5618c0adb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:10.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.638+0000 7ff13132c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618c0acf780 0x5618c0adb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40830/0 (socket says 172.21.15.7:40830) 2024-09-19T04:17:10.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.638+0000 7ff13132c640 1 -- 172.21.15.7:0/1043350774 learned_addr learned my addr 172.21.15.7:0/1043350774 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:10.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.638+0000 7ff131b2d640 1 --2- 172.21.15.7:0/1043350774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c0aca6f0 0x5618c0ad44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:10.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.638+0000 7ff13132c640 1 --2- 172.21.15.7:0/1043350774 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618c0ac9db0 0x5618c0ad3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:10.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.638+0000 7ff13132c640 1 -- 172.21.15.7:0/1043350774 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618c0ac9db0 msgr2=0x5618c0ad3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:10.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.638+0000 7ff13132c640 1 --2- 172.21.15.7:0/1043350774 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618c0ac9db0 0x5618c0ad3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.638+0000 7ff13132c640 1 -- 172.21.15.7:0/1043350774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c0aca6f0 msgr2=0x5618c0ad44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:10.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.638+0000 7ff13132c640 1 --2- 172.21.15.7:0/1043350774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c0aca6f0 0x5618c0ad44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.638+0000 7ff13132c640 1 -- 172.21.15.7:0/1043350774 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618c073c210 con 0x5618c0acf780 2024-09-19T04:17:10.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.638+0000 7ff13132c640 1 --2- 172.21.15.7:0/1043350774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618c0acf780 0x5618c0adb520 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff11c0314e0 tx=0x7ff11c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828f34f405807bff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:10.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.638+0000 7ff1157fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:17:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.638+0000 7ff1157fa640 1 -- 172.21.15.7:0/1043350774 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c035070 con 0x5618c0acf780 2024-09-19T04:17:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.638+0000 7ff136c0d740 1 -- 172.21.15.7:0/1043350774 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff128005500 con 0x5618c0acf780 2024-09-19T04:17:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.638+0000 7ff1157fa640 1 -- 172.21.15.7:0/1043350774 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7ff11c004300 con 0x5618c0acf780 2024-09-19T04:17:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.638+0000 7ff1157fa640 1 -- 172.21.15.7:0/1043350774 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff11c005020 con 0x5618c0acf780 2024-09-19T04:17:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.638+0000 7ff136c0d740 10 client.15357 fetch_fsmap learned FSMap version 28 2024-09-19T04:17:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.638+0000 7ff136c0d740 1 -- 172.21.15.7:0/1043350774 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5618c0808620 con 0x5618c0acf780 2024-09-19T04:17:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.639+0000 7ff1157fa640 1 -- 172.21.15.7:0/1043350774 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff128005500 con 0x5618c0acf780 2024-09-19T04:17:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.639+0000 7ff1157fa640 1 -- 172.21.15.7:0/1043350774 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7ff11c0035f0 con 0x5618c0acf780 2024-09-19T04:17:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.639+0000 7ff136c0d740 10 client.15357 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:17:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.639+0000 7ff136c0d740 10 client.15357 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:17:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.639+0000 7ff136c0d740 20 client.15357 populate_metadata read hostname 'smithi007' 2024-09-19T04:17:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.639+0000 7ff136c0d740 1 --2- 172.21.15.7:0/1043350774 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5618c0adfbf0 0x5618c0ae2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.639+0000 7ff136c0d740 4 client.15357 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:17:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.639+0000 7ff136c0d740 1 -- 172.21.15.7:0/1043350774 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618c0a36a20 con 0x5618c0adfbf0 2024-09-19T04:17:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.639+0000 7ff131b2d640 1 --2- 172.21.15.7:0/1043350774 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5618c0adfbf0 0x5618c0ae2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.639+0000 7ff131b2d640 1 --2- 172.21.15.7:0/1043350774 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5618c0adfbf0 0x5618c0ae2020 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db15419534b7e6ee server_cookie=9c54a2b0ffba0610 in_seq=0 out_seq=0 2024-09-19T04:17:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.639+0000 7ff1157fa640 10 client.15357 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:17:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.640+0000 7ff1157fa640 1 -- 172.21.15.7:0/1043350774 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5618c0a36a20 con 0x5618c0adfbf0 2024-09-19T04:17:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.640+0000 7ff1157fa640 10 client.15357 handle_command_reply: tid=0 2024-09-19T04:17:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.640+0000 7ff136c0d740 1 client.15357 shutdown 2024-09-19T04:17:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.640+0000 7ff136c0d740 1 -- 172.21.15.7:0/1043350774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618c0acf780 msgr2=0x5618c0adb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.640+0000 7ff136c0d740 1 --2- 172.21.15.7:0/1043350774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618c0acf780 0x5618c0adb520 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff11c0314e0 tx=0x7ff11c009260 comp rx=0 tx=0).stop 2024-09-19T04:17:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.640+0000 7ff136c0d740 1 -- 172.21.15.7:0/1043350774 shutdown_connections 2024-09-19T04:17:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.640+0000 7ff136c0d740 1 --2- 172.21.15.7:0/1043350774 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5618c0adfbf0 0x5618c0ae2020 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.640+0000 7ff136c0d740 1 --2- 172.21.15.7:0/1043350774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618c0acf780 0x5618c0adb520 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.640+0000 7ff1157fa640 0 client.15357 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:17:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.640+0000 7ff136c0d740 1 --2- 172.21.15.7:0/1043350774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c0aca6f0 0x5618c0ad44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.640+0000 7ff136c0d740 1 --2- 172.21.15.7:0/1043350774 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618c0ac9db0 0x5618c0ad3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.640+0000 7ff136c0d740 1 -- 172.21.15.7:0/1043350774 >> 172.21.15.7:0/1043350774 conn(0x5618c0ac1010 msgr2=0x5618c0ac2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.641+0000 7ff136c0d740 1 -- 172.21.15.7:0/1043350774 shutdown_connections 2024-09-19T04:17:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.641+0000 7ff136c0d740 1 -- 172.21.15.7:0/1043350774 wait complete. 2024-09-19T04:17:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.641+0000 7ff136c0d740 20 client.15357 trim_cache size 0 max 16384 2024-09-19T04:17:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.655+0000 7ff136c0d740 1 Processor -- start 2024-09-19T04:17:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.655+0000 7ff136c0d740 1 -- start start 2024-09-19T04:17:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.655+0000 7ff136c0d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c0ac9db0 0x5618c0ac1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.655+0000 7ff136c0d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618c0aca6f0 0x5618c0adb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.655+0000 7ff136c0d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618c0acf780 0x5618c0ac2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.655+0000 7ff136c0d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c1a8720 con 0x5618c0acf780 2024-09-19T04:17:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.655+0000 7ff136c0d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c1aa260 con 0x5618c0ac9db0 2024-09-19T04:17:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.655+0000 7ff136c0d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c1a8df0 con 0x5618c0aca6f0 2024-09-19T04:17:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.656+0000 7ff13132c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618c0acf780 0x5618c0ac2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.656+0000 7ff13132c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618c0acf780 0x5618c0ac2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40832/0 (socket says 172.21.15.7:40832) 2024-09-19T04:17:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.656+0000 7ff131b2d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618c0aca6f0 0x5618c0adb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.656+0000 7ff13132c640 1 -- 172.21.15.7:0/418016452 learned_addr learned my addr 172.21.15.7:0/418016452 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.656+0000 7ff13132c640 1 --2- 172.21.15.7:0/418016452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c0ac9db0 0x5618c0ac1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.656+0000 7ff131b2d640 1 -- 172.21.15.7:0/418016452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c0ac9db0 msgr2=0x5618c0ac1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.656+0000 7ff131b2d640 1 --2- 172.21.15.7:0/418016452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c0ac9db0 0x5618c0ac1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.656+0000 7ff131b2d640 1 -- 172.21.15.7:0/418016452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618c0acf780 msgr2=0x5618c0ac2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.656+0000 7ff131b2d640 1 --2- 172.21.15.7:0/418016452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618c0acf780 0x5618c0ac2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.656+0000 7ff131b2d640 1 -- 172.21.15.7:0/418016452 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618c0acb380 con 0x5618c0aca6f0 2024-09-19T04:17:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.656+0000 7ff13132c640 1 --2- 172.21.15.7:0/418016452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618c0acf780 0x5618c0ac2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:17:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.656+0000 7ff131b2d640 1 --2- 172.21.15.7:0/418016452 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618c0aca6f0 0x5618c0adb440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff12800bc80 tx=0x7ff128013040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=495452ff58d9cc86 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.656+0000 7ff1177fe640 1 -- 172.21.15.7:0/418016452 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12802a430 con 0x5618c0aca6f0 2024-09-19T04:17:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.656+0000 7ff1177fe640 1 -- 172.21.15.7:0/418016452 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff12802aab0 con 0x5618c0aca6f0 2024-09-19T04:17:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.656+0000 7ff1177fe640 1 -- 172.21.15.7:0/418016452 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff128028860 con 0x5618c0aca6f0 2024-09-19T04:17:10.660 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:10 smithi102 ceph-mon[35446]: pgmap v362: 129 pgs: 129 active+clean; 656 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-19T04:17:10.660 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:10 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1869881657' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:17:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.657+0000 7ff136c0d740 1 -- 172.21.15.7:0/418016452 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618c0aca6f0 msgr2=0x5618c0adb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.657+0000 7ff136c0d740 1 --2- 172.21.15.7:0/418016452 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618c0aca6f0 0x5618c0adb440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff12800bc80 tx=0x7ff128013040 comp rx=0 tx=0).stop 2024-09-19T04:17:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.657+0000 7ff136c0d740 1 -- 172.21.15.7:0/418016452 shutdown_connections 2024-09-19T04:17:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.657+0000 7ff136c0d740 1 --2- 172.21.15.7:0/418016452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618c0acf780 0x5618c0ac2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.657+0000 7ff136c0d740 1 --2- 172.21.15.7:0/418016452 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618c0aca6f0 0x5618c0adb440 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.657+0000 7ff136c0d740 1 --2- 172.21.15.7:0/418016452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c0ac9db0 0x5618c0ac1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.657+0000 7ff136c0d740 1 -- 172.21.15.7:0/418016452 >> 172.21.15.7:0/418016452 conn(0x5618c0ac1010 msgr2=0x5618c0ad3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.657+0000 7ff136c0d740 1 -- 172.21.15.7:0/418016452 shutdown_connections 2024-09-19T04:17:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.657+0000 7ff136c0d740 1 -- 172.21.15.7:0/418016452 wait complete. 2024-09-19T04:17:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.657+0000 7ff136c0d740 1 -- start start 2024-09-19T04:17:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.658+0000 7ff136c0d740 1 Processor -- start 2024-09-19T04:17:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.658+0000 7ff136c0d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618c0ac9db0 0x5618c0ad8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.658+0000 7ff136c0d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c0aca6f0 0x5618c0ad92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.658+0000 7ff136c0d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618c0acf780 0x5618c0ada2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.658+0000 7ff136c0d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c1a9b90 con 0x5618c0ac9db0 2024-09-19T04:17:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.658+0000 7ff136c0d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c1a94c0 con 0x5618c0aca6f0 2024-09-19T04:17:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.658+0000 7ff136c0d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c1a66e0 con 0x5618c0acf780 2024-09-19T04:17:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.658+0000 7ff136c0d740 10 client.0 _ll_register_callbacks cb 0x7ff11c032c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:17:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.658+0000 7ff13132c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618c0ac9db0 0x5618c0ad8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.658+0000 7ff13132c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618c0ac9db0 0x5618c0ad8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40844/0 (socket says 172.21.15.7:40844) 2024-09-19T04:17:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.658+0000 7ff13132c640 1 -- 172.21.15.7:0/730641419 learned_addr learned my addr 172.21.15.7:0/730641419 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.658+0000 7ff131b2d640 1 --2- 172.21.15.7:0/730641419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c0aca6f0 0x5618c0ad92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.658+0000 7ff13132c640 1 -- 172.21.15.7:0/730641419 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618c0acf780 msgr2=0x5618c0ada2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.658+0000 7ff13132c640 1 --2- 172.21.15.7:0/730641419 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618c0acf780 0x5618c0ada2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.658+0000 7ff13132c640 1 -- 172.21.15.7:0/730641419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c0aca6f0 msgr2=0x5618c0ad92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.658+0000 7ff13132c640 1 --2- 172.21.15.7:0/730641419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c0aca6f0 0x5618c0ad92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.658+0000 7ff13132c640 1 -- 172.21.15.7:0/730641419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618c0acf520 con 0x5618c0ac9db0 2024-09-19T04:17:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.659+0000 7ff13132c640 1 --2- 172.21.15.7:0/730641419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618c0ac9db0 0x5618c0ad8d90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff11c003a90 tx=0x7ff11c009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a927bba83e2b62 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.659+0000 7ff1157fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:17:10.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.659+0000 7ff1157fa640 1 -- 172.21.15.7:0/730641419 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c05c070 con 0x5618c0ac9db0 2024-09-19T04:17:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.659+0000 7ff1157fa640 1 -- 172.21.15.7:0/730641419 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7ff11c004300 con 0x5618c0ac9db0 2024-09-19T04:17:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.659+0000 7ff136c0d740 1 -- 172.21.15.7:0/730641419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff12802aab0 con 0x5618c0ac9db0 2024-09-19T04:17:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.659+0000 7ff1157fa640 1 -- 172.21.15.7:0/730641419 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff11c068050 con 0x5618c0ac9db0 2024-09-19T04:17:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.659+0000 7ff136c0d740 10 client.15363 fetch_fsmap learned FSMap version 28 2024-09-19T04:17:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.659+0000 7ff136c0d740 1 -- 172.21.15.7:0/730641419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5618c0b4a9c0 con 0x5618c0ac9db0 2024-09-19T04:17:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.659+0000 7ff1157fa640 1 -- 172.21.15.7:0/730641419 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff12802aab0 con 0x5618c0ac9db0 2024-09-19T04:17:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.659+0000 7ff1157fa640 1 -- 172.21.15.7:0/730641419 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7ff11c004aa0 con 0x5618c0ac9db0 2024-09-19T04:17:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.659+0000 7ff136c0d740 10 client.15363 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:17:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.659+0000 7ff136c0d740 10 client.15363 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:17:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.659+0000 7ff136c0d740 20 client.15363 populate_metadata read hostname 'smithi007' 2024-09-19T04:17:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.659+0000 7ff136c0d740 1 --2- 172.21.15.7:0/730641419 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5618c0b4b2c0 0x5618c0b4d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:10.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.659+0000 7ff136c0d740 4 client.15363 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:17:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.659+0000 7ff136c0d740 1 -- 172.21.15.7:0/730641419 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5618c0a30d70 con 0x5618c0b4b2c0 2024-09-19T04:17:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.660+0000 7ff131b2d640 1 --2- 172.21.15.7:0/730641419 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5618c0b4b2c0 0x5618c0b4d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.660+0000 7ff1157fa640 10 client.15363 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:17:10.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.660+0000 7ff131b2d640 1 --2- 172.21.15.7:0/730641419 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5618c0b4b2c0 0x5618c0b4d6e0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd5e7fa898a7314a server_cookie=4d1fd61d15c61117 in_seq=0 out_seq=0 2024-09-19T04:17:10.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.673+0000 7ff1157fa640 1 -- 172.21.15.7:0/730641419 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5618c0a30d70 con 0x5618c0b4b2c0 2024-09-19T04:17:10.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.673+0000 7ff1157fa640 10 client.15363 handle_command_reply: tid=0 2024-09-19T04:17:10.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.673+0000 7ff136c0d740 1 client.15363 shutdown 2024-09-19T04:17:10.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.673+0000 7ff136c0d740 1 -- 172.21.15.7:0/730641419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618c0ac9db0 msgr2=0x5618c0ad8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:10.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.673+0000 7ff136c0d740 1 --2- 172.21.15.7:0/730641419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618c0ac9db0 0x5618c0ad8d90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff11c003a90 tx=0x7ff11c009520 comp rx=0 tx=0).stop 2024-09-19T04:17:10.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.673+0000 7ff136c0d740 1 -- 172.21.15.7:0/730641419 shutdown_connections 2024-09-19T04:17:10.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.673+0000 7ff136c0d740 1 --2- 172.21.15.7:0/730641419 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5618c0b4b2c0 0x5618c0b4d6e0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.673+0000 7ff136c0d740 1 --2- 172.21.15.7:0/730641419 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618c0acf780 0x5618c0ada2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.673+0000 7ff136c0d740 1 --2- 172.21.15.7:0/730641419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5618c0aca6f0 0x5618c0ad92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.673+0000 7ff136c0d740 1 --2- 172.21.15.7:0/730641419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618c0ac9db0 0x5618c0ad8d90 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.673+0000 7ff1157fa640 0 client.15363 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:17:10.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.673+0000 7ff136c0d740 1 -- 172.21.15.7:0/730641419 >> 172.21.15.7:0/730641419 conn(0x5618c0ac1010 msgr2=0x5618c0abf9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:10.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.673+0000 7ff136c0d740 1 -- 172.21.15.7:0/730641419 shutdown_connections 2024-09-19T04:17:10.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.673+0000 7ff136c0d740 1 -- 172.21.15.7:0/730641419 wait complete. 2024-09-19T04:17:10.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.673+0000 7ff136c0d740 20 client.15363 trim_cache size 0 max 16384 2024-09-19T04:17:10.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:17:10.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:17:10.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:17:10.676 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:17:10.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.674+0000 7ff133d91640 1 -- 172.21.15.7:0/4118867553 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff1180a32d0 msgr2=0x7ff1180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:10.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.674+0000 7ff133d91640 1 --2- 172.21.15.7:0/4118867553 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff1180a32d0 0x7ff1180a5790 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff12406f000 tx=0x7ff12406df80 comp rx=0 tx=0).stop 2024-09-19T04:17:10.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.674+0000 7ff133d91640 1 -- 172.21.15.7:0/4118867553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff12c102620 msgr2=0x7ff12c19f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:10.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.674+0000 7ff133d91640 1 --2- 172.21.15.7:0/4118867553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff12c102620 0x7ff12c19f450 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff12400eaa0 tx=0x7ff12400ef60 comp rx=0 tx=0).stop 2024-09-19T04:17:10.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.674+0000 7ff133d91640 1 -- 172.21.15.7:0/4118867553 shutdown_connections 2024-09-19T04:17:10.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.674+0000 7ff133d91640 1 --2- 172.21.15.7:0/4118867553 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ff1180a32d0 0x7ff1180a5790 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.674+0000 7ff133d91640 1 --2- 172.21.15.7:0/4118867553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff12c102620 0x7ff12c19f450 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.674+0000 7ff133d91640 1 --2- 172.21.15.7:0/4118867553 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff12c101c60 0x7ff12c198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.674+0000 7ff133d91640 1 --2- 172.21.15.7:0/4118867553 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff12c100a70 0x7ff12c197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:10.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.674+0000 7ff133d91640 1 -- 172.21.15.7:0/4118867553 >> 172.21.15.7:0/4118867553 conn(0x7ff12c0fc1f0 msgr2=0x7ff12c06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:10.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.674+0000 7ff133d91640 1 -- 172.21.15.7:0/4118867553 shutdown_connections 2024-09-19T04:17:10.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:10.674+0000 7ff133d91640 1 -- 172.21.15.7:0/4118867553 wait complete. 2024-09-19T04:17:10.895 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:17:11.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.362+0000 7f5118bc2640 1 -- 172.21.15.7:0/3983472894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5114102d40 msgr2=0x7f5114103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:11.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.362+0000 7f5118bc2640 1 --2- 172.21.15.7:0/3983472894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5114102d40 0x7f5114103120 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5104009900 tx=0x7f510402a480 comp rx=0 tx=0).stop 2024-09-19T04:17:11.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.363+0000 7f5118bc2640 1 -- 172.21.15.7:0/3983472894 shutdown_connections 2024-09-19T04:17:11.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.363+0000 7f5118bc2640 1 --2- 172.21.15.7:0/3983472894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f511410c170 0x7f511410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.363+0000 7f5118bc2640 1 --2- 172.21.15.7:0/3983472894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5114103660 0x7f511410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.363+0000 7f5118bc2640 1 --2- 172.21.15.7:0/3983472894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5114102d40 0x7f5114103120 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.363+0000 7f5118bc2640 1 -- 172.21.15.7:0/3983472894 >> 172.21.15.7:0/3983472894 conn(0x7f51140fc7a0 msgr2=0x7f51140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:11.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.363+0000 7f5118bc2640 1 -- 172.21.15.7:0/3983472894 shutdown_connections 2024-09-19T04:17:11.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.363+0000 7f5118bc2640 1 -- 172.21.15.7:0/3983472894 wait complete. 2024-09-19T04:17:11.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.363+0000 7f5118bc2640 1 Processor -- start 2024-09-19T04:17:11.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.363+0000 7f5118bc2640 1 -- start start 2024-09-19T04:17:11.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.364+0000 7f5118bc2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5114102d40 0x7f5114198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:11.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.364+0000 7f5118bc2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5114103660 0x7f5114198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:11.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.364+0000 7f5118bc2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f511410c170 0x7f511419ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:11.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.364+0000 7f5118bc2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5114111f70 con 0x7f511410c170 2024-09-19T04:17:11.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.364+0000 7f5118bc2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5114111df0 con 0x7f5114103660 2024-09-19T04:17:11.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.364+0000 7f5118bc2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f51141120f0 con 0x7f5114102d40 2024-09-19T04:17:11.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.364+0000 7f5112d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f511410c170 0x7f511419ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:11.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.364+0000 7f5112d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f511410c170 0x7f511419ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40866/0 (socket says 172.21.15.7:40866) 2024-09-19T04:17:11.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.364+0000 7f511259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5114102d40 0x7f5114198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:11.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.364+0000 7f5111d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5114103660 0x7f5114198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:11.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.364+0000 7f5112d9d640 1 -- 172.21.15.7:0/412255896 learned_addr learned my addr 172.21.15.7:0/412255896 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:11.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.364+0000 7f5112d9d640 1 -- 172.21.15.7:0/412255896 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5114102d40 msgr2=0x7f5114198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:11.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.364+0000 7f5112d9d640 1 --2- 172.21.15.7:0/412255896 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5114102d40 0x7f5114198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.364+0000 7f5112d9d640 1 -- 172.21.15.7:0/412255896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5114103660 msgr2=0x7f5114198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:11.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.364+0000 7f5112d9d640 1 --2- 172.21.15.7:0/412255896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5114103660 0x7f5114198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.364+0000 7f5112d9d640 1 -- 172.21.15.7:0/412255896 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511419d3b0 con 0x7f511410c170 2024-09-19T04:17:11.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.364+0000 7f5112d9d640 1 --2- 172.21.15.7:0/412255896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f511410c170 0x7f511419ccd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f510c00eaa0 tx=0x7f510c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:11.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.364+0000 7f51037fe640 1 -- 172.21.15.7:0/412255896 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f510c00cdb0 con 0x7f511410c170 2024-09-19T04:17:11.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.364+0000 7f5118bc2640 1 -- 172.21.15.7:0/412255896 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f511419d6a0 con 0x7f511410c170 2024-09-19T04:17:11.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.364+0000 7f51037fe640 1 -- 172.21.15.7:0/412255896 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f510c005020 con 0x7f511410c170 2024-09-19T04:17:11.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.364+0000 7f51037fe640 1 -- 172.21.15.7:0/412255896 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f510c0116b0 con 0x7f511410c170 2024-09-19T04:17:11.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.365+0000 7f5118bc2640 1 -- 172.21.15.7:0/412255896 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51141a4f80 con 0x7f511410c170 2024-09-19T04:17:11.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.367+0000 7f51037fe640 1 -- 172.21.15.7:0/412255896 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f510c005560 con 0x7f511410c170 2024-09-19T04:17:11.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.367+0000 7f511af9b740 1 Processor -- start 2024-09-19T04:17:11.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.367+0000 7f511af9b740 1 -- start start 2024-09-19T04:17:11.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.367+0000 7f511af9b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5fc7279d0 0x55d5fc727db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:11.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.367+0000 7f511af9b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5fc7282f0 0x55d5fc732670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:11.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.367+0000 7f511af9b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5fc732bb0 0x55d5fc734fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:11.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.367+0000 7f511af9b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d5fc68e090 con 0x55d5fc7282f0 2024-09-19T04:17:11.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.367+0000 7f511af9b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d5fc635a70 con 0x55d5fc7279d0 2024-09-19T04:17:11.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.367+0000 7f511af9b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d5fc68a050 con 0x55d5fc732bb0 2024-09-19T04:17:11.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.368+0000 7f511259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5fc7282f0 0x55d5fc732670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:11.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.368+0000 7f511259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5fc7282f0 0x55d5fc732670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40876/0 (socket says 172.21.15.7:40876) 2024-09-19T04:17:11.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.368+0000 7f511259c640 1 -- 172.21.15.7:0/310073532 learned_addr learned my addr 172.21.15.7:0/310073532 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:11.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.368+0000 7f51037fe640 1 --2- 172.21.15.7:0/412255896 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f50fc0a32d0 0x7f50fc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:11.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.368+0000 7f5111d9b640 1 --2- 172.21.15.7:0/310073532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5fc7279d0 0x55d5fc727db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:11.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.368+0000 7f5111d9b640 1 --2- 172.21.15.7:0/310073532 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5fc732bb0 0x55d5fc734fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:11.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.368+0000 7f5112d9d640 1 --2- 172.21.15.7:0/412255896 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f50fc0a32d0 0x7f50fc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:11.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.368+0000 7f511259c640 1 -- 172.21.15.7:0/310073532 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5fc732bb0 msgr2=0x55d5fc734fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:11.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.368+0000 7f511259c640 1 --2- 172.21.15.7:0/310073532 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5fc732bb0 0x55d5fc734fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.368+0000 7f511259c640 1 -- 172.21.15.7:0/310073532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5fc7279d0 msgr2=0x55d5fc727db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:11.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.368+0000 7f511259c640 1 --2- 172.21.15.7:0/310073532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5fc7279d0 0x55d5fc727db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.368+0000 7f511259c640 1 -- 172.21.15.7:0/310073532 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5fc642130 con 0x55d5fc7282f0 2024-09-19T04:17:11.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.368+0000 7f5111d9b640 1 --2- 172.21.15.7:0/310073532 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5fc732bb0 0x55d5fc734fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:17:11.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.368+0000 7f51037fe640 1 -- 172.21.15.7:0/412255896 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f510c0cffb0 con 0x7f511410c170 2024-09-19T04:17:11.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.368+0000 7f511259c640 1 --2- 172.21.15.7:0/310073532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5fc7282f0 0x55d5fc732670 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5104009900 tx=0x7f5104005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c1dd7cb4677bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:11.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.368+0000 7f5100ff9640 1 -- 172.21.15.7:0/310073532 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5104040070 con 0x55d5fc7282f0 2024-09-19T04:17:11.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.368+0000 7f5112d9d640 1 --2- 172.21.15.7:0/412255896 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f50fc0a32d0 0x7f50fc0a5790 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f510c0a47e0 tx=0x7f510c070040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:11.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.369+0000 7f5100ff9640 1 -- 172.21.15.7:0/310073532 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51040319f0 con 0x55d5fc7282f0 2024-09-19T04:17:11.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.369+0000 7f5100ff9640 1 -- 172.21.15.7:0/310073532 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5104035040 con 0x55d5fc7282f0 2024-09-19T04:17:11.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.369+0000 7f511af9b740 1 -- 172.21.15.7:0/310073532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5fc7282f0 msgr2=0x55d5fc732670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:11.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.369+0000 7f511af9b740 1 --2- 172.21.15.7:0/310073532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5fc7282f0 0x55d5fc732670 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5104009900 tx=0x7f5104005e80 comp rx=0 tx=0).stop 2024-09-19T04:17:11.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.369+0000 7f511af9b740 1 -- 172.21.15.7:0/310073532 shutdown_connections 2024-09-19T04:17:11.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.369+0000 7f511af9b740 1 --2- 172.21.15.7:0/310073532 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5fc732bb0 0x55d5fc734fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.369+0000 7f511af9b740 1 --2- 172.21.15.7:0/310073532 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5fc7282f0 0x55d5fc732670 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.369+0000 7f511af9b740 1 --2- 172.21.15.7:0/310073532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5fc7279d0 0x55d5fc727db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.369+0000 7f511af9b740 1 -- 172.21.15.7:0/310073532 >> 172.21.15.7:0/310073532 conn(0x55d5fc723f60 msgr2=0x55d5fc724340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:11.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.370+0000 7f511af9b740 1 -- 172.21.15.7:0/310073532 shutdown_connections 2024-09-19T04:17:11.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.370+0000 7f511af9b740 1 -- 172.21.15.7:0/310073532 wait complete. 2024-09-19T04:17:11.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.370+0000 7f511af9b740 1 -- start start 2024-09-19T04:17:11.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.370+0000 7f511af9b740 1 Processor -- start 2024-09-19T04:17:11.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.370+0000 7f511af9b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5fc7279d0 0x55d5fc732460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:11.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.370+0000 7f511af9b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5fc7282f0 0x55d5fc72f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:11.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.370+0000 7f511af9b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5fc732bb0 0x55d5fc72fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:11.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.370+0000 7f511af9b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d5fc735780 con 0x55d5fc732bb0 2024-09-19T04:17:11.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.370+0000 7f511af9b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d5fc648f20 con 0x55d5fc7282f0 2024-09-19T04:17:11.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.370+0000 7f511af9b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d5fc735900 con 0x55d5fc7279d0 2024-09-19T04:17:11.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.370+0000 7f511af9b740 10 client.0 _ll_register_callbacks cb 0x55d5fc612030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:17:11.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.370+0000 7f5111d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5fc732bb0 0x55d5fc72fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:11.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.370+0000 7f5111d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5fc732bb0 0x55d5fc72fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40884/0 (socket says 172.21.15.7:40884) 2024-09-19T04:17:11.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.370+0000 7f5111d9b640 1 -- 172.21.15.7:0/1062915772 learned_addr learned my addr 172.21.15.7:0/1062915772 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:11.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.371+0000 7f5111d9b640 1 --2- 172.21.15.7:0/1062915772 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5fc7279d0 0x55d5fc732460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:11.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.371+0000 7f511259c640 1 --2- 172.21.15.7:0/1062915772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5fc7282f0 0x55d5fc72f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:11.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.371+0000 7f5111d9b640 1 -- 172.21.15.7:0/1062915772 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5fc7279d0 msgr2=0x55d5fc732460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:11.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.371+0000 7f5111d9b640 1 --2- 172.21.15.7:0/1062915772 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5fc7279d0 0x55d5fc732460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.371+0000 7f5111d9b640 1 -- 172.21.15.7:0/1062915772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5fc7282f0 msgr2=0x55d5fc72f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:11.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.371+0000 7f5111d9b640 1 --2- 172.21.15.7:0/1062915772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5fc7282f0 0x55d5fc72f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.371+0000 7f5111d9b640 1 -- 172.21.15.7:0/1062915772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5fc3ff2b0 con 0x55d5fc732bb0 2024-09-19T04:17:11.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.371+0000 7f511259c640 1 --2- 172.21.15.7:0/1062915772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5fc7282f0 0x55d5fc72f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:17:11.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.371+0000 7f5111d9b640 1 --2- 172.21.15.7:0/1062915772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5fc732bb0 0x55d5fc72fcf0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5108012dd0 tx=0x7f5108004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a5048693077d9a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:11.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.371+0000 7f50f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:17:11.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.371+0000 7f50f9ffb640 1 -- 172.21.15.7:0/1062915772 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f510801b040 con 0x55d5fc732bb0 2024-09-19T04:17:11.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.371+0000 7f50f9ffb640 1 -- 172.21.15.7:0/1062915772 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f51080113e0 con 0x55d5fc732bb0 2024-09-19T04:17:11.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.371+0000 7f511af9b740 1 -- 172.21.15.7:0/1062915772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51040319f0 con 0x55d5fc732bb0 2024-09-19T04:17:11.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.371+0000 7f50f9ffb640 1 -- 172.21.15.7:0/1062915772 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5108010e70 con 0x55d5fc732bb0 2024-09-19T04:17:11.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.371+0000 7f511af9b740 10 client.15375 fetch_fsmap learned FSMap version 28 2024-09-19T04:17:11.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.371+0000 7f511af9b740 1 -- 172.21.15.7:0/1062915772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d5fc741100 con 0x55d5fc732bb0 2024-09-19T04:17:11.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.372+0000 7f50f9ffb640 1 -- 172.21.15.7:0/1062915772 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51040319f0 con 0x55d5fc732bb0 2024-09-19T04:17:11.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.372+0000 7f50f9ffb640 1 -- 172.21.15.7:0/1062915772 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f51080117e0 con 0x55d5fc732bb0 2024-09-19T04:17:11.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.372+0000 7f511af9b740 10 client.15375 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:17:11.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.372+0000 7f511af9b740 10 client.15375 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-19T04:17:11.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.372+0000 7f511af9b740 20 client.15375 populate_metadata read hostname 'smithi007' 2024-09-19T04:17:11.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.372+0000 7f511af9b740 1 --2- 172.21.15.7:0/1062915772 >> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] conn(0x55d5fc7436d0 0x55d5fc744b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:11.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.372+0000 7f511af9b740 4 client.15375 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:17:11.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.372+0000 7f511af9b740 1 -- 172.21.15.7:0/1062915772 --> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d5fc69b600 con 0x55d5fc7436d0 2024-09-19T04:17:11.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.372+0000 7f511259c640 1 --2- 172.21.15.7:0/1062915772 >> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] conn(0x55d5fc7436d0 0x55d5fc744b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:11.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.373+0000 7f511259c640 1 --2- 172.21.15.7:0/1062915772 >> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] conn(0x55d5fc7436d0 0x55d5fc744b40 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=39626dacf493f92b server_cookie=2ec0b7c2a1be58fa in_seq=0 out_seq=0 2024-09-19T04:17:11.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.373+0000 7f50f9ffb640 10 client.15375 ms_handle_connect on v2:172.21.15.102:6834/1756454579 2024-09-19T04:17:11.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.373+0000 7f50f9ffb640 1 -- 172.21.15.7:0/1062915772 <== mds.4 v2:172.21.15.102:6834/1756454579 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d5fc69b600 con 0x55d5fc7436d0 2024-09-19T04:17:11.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.373+0000 7f50f9ffb640 10 client.15375 handle_command_reply: tid=0 2024-09-19T04:17:11.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.373+0000 7f511af9b740 1 client.15375 shutdown 2024-09-19T04:17:11.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.373+0000 7f511af9b740 1 -- 172.21.15.7:0/1062915772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5fc732bb0 msgr2=0x55d5fc72fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:11.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.373+0000 7f511af9b740 1 --2- 172.21.15.7:0/1062915772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5fc732bb0 0x55d5fc72fcf0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5108012dd0 tx=0x7f5108004730 comp rx=0 tx=0).stop 2024-09-19T04:17:11.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.374+0000 7f511af9b740 1 -- 172.21.15.7:0/1062915772 shutdown_connections 2024-09-19T04:17:11.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.374+0000 7f511af9b740 1 --2- 172.21.15.7:0/1062915772 >> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] conn(0x55d5fc7436d0 0x55d5fc744b40 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.374+0000 7f50f9ffb640 0 client.15375 ms_handle_reset on v2:172.21.15.102:6834/1756454579 2024-09-19T04:17:11.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.374+0000 7f511af9b740 1 --2- 172.21.15.7:0/1062915772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5fc732bb0 0x55d5fc72fcf0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.374+0000 7f511af9b740 1 --2- 172.21.15.7:0/1062915772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5fc7282f0 0x55d5fc72f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.374+0000 7f511af9b740 1 --2- 172.21.15.7:0/1062915772 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5fc7279d0 0x55d5fc732460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.374+0000 7f511af9b740 1 -- 172.21.15.7:0/1062915772 >> 172.21.15.7:0/1062915772 conn(0x55d5fc723f60 msgr2=0x55d5fc729c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:11.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.374+0000 7f511af9b740 1 -- 172.21.15.7:0/1062915772 shutdown_connections 2024-09-19T04:17:11.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.374+0000 7f511af9b740 1 -- 172.21.15.7:0/1062915772 wait complete. 2024-09-19T04:17:11.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.374+0000 7f511af9b740 20 client.15375 trim_cache size 0 max 16384 2024-09-19T04:17:11.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.391+0000 7f511af9b740 1 Processor -- start 2024-09-19T04:17:11.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.391+0000 7f511af9b740 1 -- start start 2024-09-19T04:17:11.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.392+0000 7f511af9b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5fc7279d0 0x55d5fc72f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:11.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.392+0000 7f511af9b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5fc7282f0 0x55d5fc72fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:11.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.392+0000 7f511af9b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5fc732bb0 0x55d5fc72e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:11.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.392+0000 7f511af9b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d5fc742e80 con 0x55d5fc7279d0 2024-09-19T04:17:11.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.392+0000 7f511af9b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d5fc743550 con 0x55d5fc732bb0 2024-09-19T04:17:11.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.392+0000 7f511af9b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d5fc743c20 con 0x55d5fc7282f0 2024-09-19T04:17:11.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.392+0000 7f5111d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5fc7279d0 0x55d5fc72f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:11.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.392+0000 7f5111d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5fc7279d0 0x55d5fc72f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40890/0 (socket says 172.21.15.7:40890) 2024-09-19T04:17:11.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.392+0000 7f5111d9b640 1 -- 172.21.15.7:0/169662432 learned_addr learned my addr 172.21.15.7:0/169662432 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:11.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.392+0000 7f511259c640 1 --2- 172.21.15.7:0/169662432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5fc7282f0 0x55d5fc72fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:11.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.392+0000 7f5111d9b640 1 -- 172.21.15.7:0/169662432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5fc7282f0 msgr2=0x55d5fc72fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:11.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.392+0000 7f5111d9b640 1 --2- 172.21.15.7:0/169662432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5fc7282f0 0x55d5fc72fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.392+0000 7f5111d9b640 1 -- 172.21.15.7:0/169662432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5fc732bb0 msgr2=0x55d5fc72e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:11.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.392+0000 7f5111d9b640 1 --2- 172.21.15.7:0/169662432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5fc732bb0 0x55d5fc72e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.392+0000 7f5111d9b640 1 -- 172.21.15.7:0/169662432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5fc724be0 con 0x55d5fc7279d0 2024-09-19T04:17:11.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.392+0000 7f511259c640 1 --2- 172.21.15.7:0/169662432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5fc7282f0 0x55d5fc72fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:17:11.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.392+0000 7f5111d9b640 1 --2- 172.21.15.7:0/169662432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5fc7279d0 0x55d5fc72f770 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5108015fd0 tx=0x7f510800b2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75606818435f5c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:11.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.392+0000 7f50fbfff640 1 -- 172.21.15.7:0/169662432 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5108034070 con 0x55d5fc7279d0 2024-09-19T04:17:11.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.393+0000 7f50fbfff640 1 -- 172.21.15.7:0/169662432 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5108005850 con 0x55d5fc7279d0 2024-09-19T04:17:11.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.393+0000 7f50fbfff640 1 -- 172.21.15.7:0/169662432 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5108003d50 con 0x55d5fc7279d0 2024-09-19T04:17:11.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.393+0000 7f511af9b740 1 -- 172.21.15.7:0/169662432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5fc7279d0 msgr2=0x55d5fc72f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:11.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.393+0000 7f511af9b740 1 --2- 172.21.15.7:0/169662432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5fc7279d0 0x55d5fc72f770 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5108015fd0 tx=0x7f510800b2e0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.393+0000 7f511af9b740 1 -- 172.21.15.7:0/169662432 shutdown_connections 2024-09-19T04:17:11.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.393+0000 7f511af9b740 1 --2- 172.21.15.7:0/169662432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5fc732bb0 0x55d5fc72e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.393+0000 7f511af9b740 1 --2- 172.21.15.7:0/169662432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5fc7282f0 0x55d5fc72fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.393+0000 7f511af9b740 1 --2- 172.21.15.7:0/169662432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5fc7279d0 0x55d5fc72f770 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.393+0000 7f511af9b740 1 -- 172.21.15.7:0/169662432 >> 172.21.15.7:0/169662432 conn(0x55d5fc723f60 msgr2=0x55d5fc72ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:11.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.393+0000 7f511af9b740 1 -- 172.21.15.7:0/169662432 shutdown_connections 2024-09-19T04:17:11.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.393+0000 7f511af9b740 1 -- 172.21.15.7:0/169662432 wait complete. 2024-09-19T04:17:11.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.393+0000 7f511af9b740 1 -- start start 2024-09-19T04:17:11.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.394+0000 7f511af9b740 1 Processor -- start 2024-09-19T04:17:11.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.394+0000 7f511af9b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5fc7279d0 0x55d5fc748020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:11.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.394+0000 7f511af9b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5fc7282f0 0x55d5fc748560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:11.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.394+0000 7f511af9b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5fc732bb0 0x55d5fc7abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:11.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.394+0000 7f511af9b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d5fc7449c0 con 0x55d5fc732bb0 2024-09-19T04:17:11.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.394+0000 7f511af9b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d5fc7442f0 con 0x55d5fc7282f0 2024-09-19T04:17:11.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.394+0000 7f511af9b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d5fc745090 con 0x55d5fc7279d0 2024-09-19T04:17:11.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.394+0000 7f511af9b740 10 client.0 _ll_register_callbacks cb 0x7f510800beb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:17:11.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.394+0000 7f5111d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5fc732bb0 0x55d5fc7abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:11.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.394+0000 7f5111d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5fc732bb0 0x55d5fc7abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40902/0 (socket says 172.21.15.7:40902) 2024-09-19T04:17:11.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.394+0000 7f5111d9b640 1 -- 172.21.15.7:0/85254456 learned_addr learned my addr 172.21.15.7:0/85254456 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:11.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.394+0000 7f511259c640 1 --2- 172.21.15.7:0/85254456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5fc7282f0 0x55d5fc748560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:11.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.394+0000 7f5111d9b640 1 --2- 172.21.15.7:0/85254456 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5fc7279d0 0x55d5fc748020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:11.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.394+0000 7f5111d9b640 1 -- 172.21.15.7:0/85254456 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5fc7279d0 msgr2=0x55d5fc748020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:11.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.394+0000 7f5111d9b640 1 --2- 172.21.15.7:0/85254456 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5fc7279d0 0x55d5fc748020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.394+0000 7f5111d9b640 1 -- 172.21.15.7:0/85254456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5fc7282f0 msgr2=0x55d5fc748560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:11.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.394+0000 7f5111d9b640 1 --2- 172.21.15.7:0/85254456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5fc7282f0 0x55d5fc748560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.394+0000 7f5111d9b640 1 -- 172.21.15.7:0/85254456 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5fc748e50 con 0x55d5fc732bb0 2024-09-19T04:17:11.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.395+0000 7f5111d9b640 1 --2- 172.21.15.7:0/85254456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5fc732bb0 0x55d5fc7abdd0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5108011bb0 tx=0x7f5108003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=970849d4e62fbd09 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:11.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.395+0000 7f50f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:17:11.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.395+0000 7f50f9ffb640 1 -- 172.21.15.7:0/85254456 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5108034040 con 0x55d5fc732bb0 2024-09-19T04:17:11.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.395+0000 7f50f9ffb640 1 -- 172.21.15.7:0/85254456 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f51080052d0 con 0x55d5fc732bb0 2024-09-19T04:17:11.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.395+0000 7f511af9b740 1 -- 172.21.15.7:0/85254456 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5108005850 con 0x55d5fc732bb0 2024-09-19T04:17:11.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.395+0000 7f50f9ffb640 1 -- 172.21.15.7:0/85254456 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5108011e20 con 0x55d5fc732bb0 2024-09-19T04:17:11.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.395+0000 7f511af9b740 10 client.15381 fetch_fsmap learned FSMap version 28 2024-09-19T04:17:11.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.395+0000 7f511af9b740 1 -- 172.21.15.7:0/85254456 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d5fc7ad3b0 con 0x55d5fc732bb0 2024-09-19T04:17:11.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.395+0000 7f50f9ffb640 1 -- 172.21.15.7:0/85254456 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5108005850 con 0x55d5fc732bb0 2024-09-19T04:17:11.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.395+0000 7f50f9ffb640 1 -- 172.21.15.7:0/85254456 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5108022430 con 0x55d5fc732bb0 2024-09-19T04:17:11.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.395+0000 7f511af9b740 10 client.15381 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:17:11.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.395+0000 7f511af9b740 10 client.15381 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-19T04:17:11.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.395+0000 7f511af9b740 20 client.15381 populate_metadata read hostname 'smithi007' 2024-09-19T04:17:11.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.395+0000 7f511af9b740 1 --2- 172.21.15.7:0/85254456 >> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] conn(0x55d5fc7436d0 0x55d5fc7b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:11.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.395+0000 7f511af9b740 4 client.15381 mds_command: new command op to 24472 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T04:17:11.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.395+0000 7f511af9b740 1 -- 172.21.15.7:0/85254456 --> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] -- command(tid 0: {"prefix": "status"}) -- 0x55d5fc695b10 con 0x55d5fc7436d0 2024-09-19T04:17:11.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.396+0000 7f511259c640 1 --2- 172.21.15.7:0/85254456 >> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] conn(0x55d5fc7436d0 0x55d5fc7b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:11.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.396+0000 7f511259c640 1 --2- 172.21.15.7:0/85254456 >> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] conn(0x55d5fc7436d0 0x55d5fc7b09e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4cf0769e4a367930 server_cookie=2ce73f31d02f8bd0 in_seq=0 out_seq=0 2024-09-19T04:17:11.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.396+0000 7f50f9ffb640 10 client.15381 ms_handle_connect on v2:172.21.15.102:6834/1756454579 2024-09-19T04:17:11.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.396+0000 7f50f9ffb640 1 -- 172.21.15.7:0/85254456 <== mds.4 v2:172.21.15.102:6834/1756454579 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55d5fc695b10 con 0x55d5fc7436d0 2024-09-19T04:17:11.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.396+0000 7f50f9ffb640 10 client.15381 handle_command_reply: tid=0 2024-09-19T04:17:11.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.396+0000 7f511af9b740 1 client.15381 shutdown 2024-09-19T04:17:11.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.396+0000 7f511af9b740 1 -- 172.21.15.7:0/85254456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5fc732bb0 msgr2=0x55d5fc7abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:11.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.396+0000 7f511af9b740 1 --2- 172.21.15.7:0/85254456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5fc732bb0 0x55d5fc7abdd0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5108011bb0 tx=0x7f5108003910 comp rx=0 tx=0).stop 2024-09-19T04:17:11.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.396+0000 7f511af9b740 1 -- 172.21.15.7:0/85254456 shutdown_connections 2024-09-19T04:17:11.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.396+0000 7f511af9b740 1 --2- 172.21.15.7:0/85254456 >> [v2:172.21.15.102:6834/1756454579,v1:172.21.15.102:6835/1756454579] conn(0x55d5fc7436d0 0x55d5fc7b09e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.396+0000 7f511af9b740 1 --2- 172.21.15.7:0/85254456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d5fc732bb0 0x55d5fc7abdd0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.396+0000 7f511af9b740 1 --2- 172.21.15.7:0/85254456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5fc7282f0 0x55d5fc748560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.396+0000 7f50f9ffb640 0 client.15381 ms_handle_reset on v2:172.21.15.102:6834/1756454579 2024-09-19T04:17:11.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.396+0000 7f511af9b740 1 --2- 172.21.15.7:0/85254456 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5fc7279d0 0x55d5fc748020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.397+0000 7f511af9b740 1 -- 172.21.15.7:0/85254456 >> 172.21.15.7:0/85254456 conn(0x55d5fc723f60 msgr2=0x55d5fc72f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:11.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.397+0000 7f511af9b740 1 -- 172.21.15.7:0/85254456 shutdown_connections 2024-09-19T04:17:11.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.397+0000 7f511af9b740 1 -- 172.21.15.7:0/85254456 wait complete. 2024-09-19T04:17:11.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.397+0000 7f511af9b740 20 client.15381 trim_cache size 0 max 16384 2024-09-19T04:17:11.405 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:17:11.405 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "77957c0a-763c-11ef-bceb-c7b262605968", 2024-09-19T04:17:11.405 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 4, 2024-09-19T04:17:11.405 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24472, 2024-09-19T04:17:11.405 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-19T04:17:11.405 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-19T04:17:11.405 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-19T04:17:11.405 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 114.585334723, 2024-09-19T04:17:11.406 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 28, 2024-09-19T04:17:11.406 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 90, 2024-09-19T04:17:11.406 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 90, 2024-09-19T04:17:11.406 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 184.633159681 2024-09-19T04:17:11.406 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:17:11.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.397+0000 7f5118bc2640 1 -- 172.21.15.7:0/412255896 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f50fc0a32d0 msgr2=0x7f50fc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:11.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.397+0000 7f5118bc2640 1 --2- 172.21.15.7:0/412255896 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f50fc0a32d0 0x7f50fc0a5790 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f510c0a47e0 tx=0x7f510c070040 comp rx=0 tx=0).stop 2024-09-19T04:17:11.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.397+0000 7f5118bc2640 1 -- 172.21.15.7:0/412255896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f511410c170 msgr2=0x7f511419ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:11.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.397+0000 7f5118bc2640 1 --2- 172.21.15.7:0/412255896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f511410c170 0x7f511419ccd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f510c00eaa0 tx=0x7f510c00ef60 comp rx=0 tx=0).stop 2024-09-19T04:17:11.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.397+0000 7f5118bc2640 1 -- 172.21.15.7:0/412255896 shutdown_connections 2024-09-19T04:17:11.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.397+0000 7f5118bc2640 1 --2- 172.21.15.7:0/412255896 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f50fc0a32d0 0x7f50fc0a5790 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.397+0000 7f5118bc2640 1 --2- 172.21.15.7:0/412255896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f511410c170 0x7f511419ccd0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.397+0000 7f5118bc2640 1 --2- 172.21.15.7:0/412255896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5114103660 0x7f5114198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.397+0000 7f5118bc2640 1 --2- 172.21.15.7:0/412255896 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5114102d40 0x7f5114198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:11.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.397+0000 7f5118bc2640 1 -- 172.21.15.7:0/412255896 >> 172.21.15.7:0/412255896 conn(0x7f51140fc7a0 msgr2=0x7f51140fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:11.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.397+0000 7f5118bc2640 1 -- 172.21.15.7:0/412255896 shutdown_connections 2024-09-19T04:17:11.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:11.397+0000 7f5118bc2640 1 -- 172.21.15.7:0/412255896 wait complete. 2024-09-19T04:17:12.132 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-19T04:17:12.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:12 smithi007 ceph-mon[31360]: pgmap v363: 129 pgs: 129 active+clean; 656 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-19T04:17:12.435 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:17:12.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:12 smithi092 ceph-mon[34940]: pgmap v363: 129 pgs: 129 active+clean; 656 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-19T04:17:12.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:12 smithi102 ceph-mon[35446]: pgmap v363: 129 pgs: 129 active+clean; 656 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-19T04:17:12.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.895+0000 7fad59dfb640 1 -- 172.21.15.7:0/3933577919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad54100480 msgr2=0x7fad54100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:12.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.895+0000 7fad59dfb640 1 --2- 172.21.15.7:0/3933577919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad54100480 0x7fad54100860 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fad44009900 tx=0x7fad4402a410 comp rx=0 tx=0).stop 2024-09-19T04:17:12.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.895+0000 7fad59dfb640 1 -- 172.21.15.7:0/3933577919 shutdown_connections 2024-09-19T04:17:12.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.895+0000 7fad59dfb640 1 --2- 172.21.15.7:0/3933577919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad541055b0 0x7fad5410d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.895+0000 7fad59dfb640 1 --2- 172.21.15.7:0/3933577919 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad54100e30 0x7fad54104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.895+0000 7fad59dfb640 1 --2- 172.21.15.7:0/3933577919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad54100480 0x7fad54100860 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.895+0000 7fad59dfb640 1 -- 172.21.15.7:0/3933577919 >> 172.21.15.7:0/3933577919 conn(0x7fad54077210 msgr2=0x7fad540fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:12.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.896+0000 7fad59dfb640 1 -- 172.21.15.7:0/3933577919 shutdown_connections 2024-09-19T04:17:12.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.896+0000 7fad59dfb640 1 -- 172.21.15.7:0/3933577919 wait complete. 2024-09-19T04:17:12.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.896+0000 7fad59dfb640 1 Processor -- start 2024-09-19T04:17:12.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.896+0000 7fad59dfb640 1 -- start start 2024-09-19T04:17:12.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.897+0000 7fad59dfb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad54100480 0x7fad54198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:12.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.897+0000 7fad59dfb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad54100e30 0x7fad54198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:12.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.897+0000 7fad59dfb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad541055b0 0x7fad5419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:12.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.897+0000 7fad59dfb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fad5410fd60 con 0x7fad54100480 2024-09-19T04:17:12.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.897+0000 7fad59dfb640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fad5410fbe0 con 0x7fad541055b0 2024-09-19T04:17:12.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.897+0000 7fad59dfb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fad5410fee0 con 0x7fad54100e30 2024-09-19T04:17:12.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.897+0000 7fad537fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad54100480 0x7fad54198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:12.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.897+0000 7fad537fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad54100480 0x7fad54198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40912/0 (socket says 172.21.15.7:40912) 2024-09-19T04:17:12.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.897+0000 7fad537fe640 1 -- 172.21.15.7:0/3957473129 learned_addr learned my addr 172.21.15.7:0/3957473129 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:12.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.897+0000 7fad52ffd640 1 --2- 172.21.15.7:0/3957473129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad54100e30 0x7fad54198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:12.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.897+0000 7fad53fff640 1 --2- 172.21.15.7:0/3957473129 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad541055b0 0x7fad5419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:12.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.897+0000 7fad537fe640 1 -- 172.21.15.7:0/3957473129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad54100e30 msgr2=0x7fad54198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:12.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.897+0000 7fad537fe640 1 --2- 172.21.15.7:0/3957473129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad54100e30 0x7fad54198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.897+0000 7fad537fe640 1 -- 172.21.15.7:0/3957473129 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad541055b0 msgr2=0x7fad5419cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:12.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.897+0000 7fad537fe640 1 --2- 172.21.15.7:0/3957473129 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad541055b0 0x7fad5419cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.897+0000 7fad537fe640 1 -- 172.21.15.7:0/3957473129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad5419d3e0 con 0x7fad54100480 2024-09-19T04:17:12.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.897+0000 7fad537fe640 1 --2- 172.21.15.7:0/3957473129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad54100480 0x7fad54198430 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fad44006010 tx=0x7fad440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:12.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.897+0000 7fad50ff9640 1 -- 172.21.15.7:0/3957473129 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4403f030 con 0x7fad54100480 2024-09-19T04:17:12.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.898+0000 7fad50ff9640 1 -- 172.21.15.7:0/3957473129 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad44003ce0 con 0x7fad54100480 2024-09-19T04:17:12.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.898+0000 7fad59dfb640 1 -- 172.21.15.7:0/3957473129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad5419d670 con 0x7fad54100480 2024-09-19T04:17:12.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.898+0000 7fad50ff9640 1 -- 172.21.15.7:0/3957473129 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad44035070 con 0x7fad54100480 2024-09-19T04:17:12.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.898+0000 7fad59dfb640 1 -- 172.21.15.7:0/3957473129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad541a4fb0 con 0x7fad54100480 2024-09-19T04:17:12.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.900+0000 7fad50ff9640 1 -- 172.21.15.7:0/3957473129 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7fad44042030 con 0x7fad54100480 2024-09-19T04:17:12.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.900+0000 7fad5c1d4740 1 Processor -- start 2024-09-19T04:17:12.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.900+0000 7fad5c1d4740 1 -- start start 2024-09-19T04:17:12.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.900+0000 7fad5c1d4740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c100c8c8f0 0x55c100c8ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:12.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.900+0000 7fad5c1d4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c100c8d210 0x55c100c9ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:12.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.900+0000 7fad5c1d4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c100c9bfc0 0x55c100c9e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:12.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.900+0000 7fad5c1d4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c100bf3090 con 0x55c100c8d210 2024-09-19T04:17:12.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.900+0000 7fad5c1d4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c100b9aa70 con 0x55c100c9bfc0 2024-09-19T04:17:12.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.900+0000 7fad5c1d4740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c100bef050 con 0x55c100c8c8f0 2024-09-19T04:17:12.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.901+0000 7fad50ff9640 1 --2- 172.21.15.7:0/3957473129 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fad3c0a32d0 0x7fad3c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:12.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.901+0000 7fad537fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c100c8d210 0x55c100c9ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:12.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.901+0000 7fad537fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c100c8d210 0x55c100c9ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40916/0 (socket says 172.21.15.7:40916) 2024-09-19T04:17:12.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.901+0000 7fad537fe640 1 -- 172.21.15.7:0/1490084058 learned_addr learned my addr 172.21.15.7:0/1490084058 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:12.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.901+0000 7fad52ffd640 1 --2- 172.21.15.7:0/1490084058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c100c9bfc0 0x55c100c9e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:12.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.901+0000 7fad53fff640 1 --2- 172.21.15.7:0/3957473129 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fad3c0a32d0 0x7fad3c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:12.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.901+0000 7fad53fff640 1 --2- 172.21.15.7:0/1490084058 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c100c8c8f0 0x55c100c8ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:12.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.901+0000 7fad50ff9640 1 -- 172.21.15.7:0/3957473129 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fad440f02d0 con 0x7fad54100480 2024-09-19T04:17:12.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.901+0000 7fad53fff640 1 -- 172.21.15.7:0/1490084058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c100c9bfc0 msgr2=0x55c100c9e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:12.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.901+0000 7fad53fff640 1 --2- 172.21.15.7:0/1490084058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c100c9bfc0 0x55c100c9e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.901+0000 7fad53fff640 1 -- 172.21.15.7:0/1490084058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c100c8d210 msgr2=0x55c100c9ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:12.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.901+0000 7fad53fff640 1 --2- 172.21.15.7:0/1490084058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c100c8d210 0x55c100c9ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.901+0000 7fad53fff640 1 -- 172.21.15.7:0/1490084058 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c100ba7130 con 0x55c100c8c8f0 2024-09-19T04:17:12.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.901+0000 7fad537fe640 1 --2- 172.21.15.7:0/1490084058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c100c8d210 0x55c100c9ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:17:12.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.901+0000 7fad52ffd640 1 --2- 172.21.15.7:0/1490084058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c100c9bfc0 0x55c100c9e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:17:12.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.901+0000 7fad53fff640 1 --2- 172.21.15.7:0/1490084058 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c100c8c8f0 0x55c100c8ccd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fad4c00ecd0 tx=0x7fad4c00d7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3edd83d186a6df9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:12.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.901+0000 7fad53fff640 1 --2- 172.21.15.7:0/3957473129 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fad3c0a32d0 0x7fad3c0a5790 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fad4c00dcb0 tx=0x7fad4c01d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:12.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.902+0000 7fad39ffb640 1 -- 172.21.15.7:0/1490084058 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4c00e7e0 con 0x55c100c8c8f0 2024-09-19T04:17:12.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.902+0000 7fad39ffb640 1 -- 172.21.15.7:0/1490084058 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad4c01cc70 con 0x55c100c8c8f0 2024-09-19T04:17:12.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.902+0000 7fad39ffb640 1 -- 172.21.15.7:0/1490084058 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4c004030 con 0x55c100c8c8f0 2024-09-19T04:17:12.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.902+0000 7fad5c1d4740 1 -- 172.21.15.7:0/1490084058 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c100c8c8f0 msgr2=0x55c100c8ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:12.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.902+0000 7fad5c1d4740 1 --2- 172.21.15.7:0/1490084058 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c100c8c8f0 0x55c100c8ccd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fad4c00ecd0 tx=0x7fad4c00d7b0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.902+0000 7fad5c1d4740 1 -- 172.21.15.7:0/1490084058 shutdown_connections 2024-09-19T04:17:12.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.902+0000 7fad5c1d4740 1 --2- 172.21.15.7:0/1490084058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c100c9bfc0 0x55c100c9e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.902+0000 7fad5c1d4740 1 --2- 172.21.15.7:0/1490084058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c100c8d210 0x55c100c9ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.902+0000 7fad5c1d4740 1 --2- 172.21.15.7:0/1490084058 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c100c8c8f0 0x55c100c8ccd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.902+0000 7fad5c1d4740 1 -- 172.21.15.7:0/1490084058 >> 172.21.15.7:0/1490084058 conn(0x55c100c88f60 msgr2=0x55c100c89340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:12.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.902+0000 7fad5c1d4740 1 -- 172.21.15.7:0/1490084058 shutdown_connections 2024-09-19T04:17:12.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.902+0000 7fad5c1d4740 1 -- 172.21.15.7:0/1490084058 wait complete. 2024-09-19T04:17:12.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.903+0000 7fad5c1d4740 1 -- start start 2024-09-19T04:17:12.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.903+0000 7fad5c1d4740 1 Processor -- start 2024-09-19T04:17:12.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.903+0000 7fad5c1d4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c100c8c8f0 0x55c100c9b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:12.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.903+0000 7fad5c1d4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c100c8d210 0x55c100c98c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:12.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.903+0000 7fad5c1d4740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c100c9bfc0 0x55c100c99170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:12.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.903+0000 7fad5c1d4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c100c9ead0 con 0x55c100c8d210 2024-09-19T04:17:12.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.903+0000 7fad5c1d4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c100badf20 con 0x55c100c8c8f0 2024-09-19T04:17:12.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.903+0000 7fad5c1d4740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c100c9ec50 con 0x55c100c9bfc0 2024-09-19T04:17:12.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.903+0000 7fad5c1d4740 10 client.0 _ll_register_callbacks cb 0x55c100b77030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:17:12.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.903+0000 7fad52ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c100c8d210 0x55c100c98c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:12.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.903+0000 7fad52ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c100c8d210 0x55c100c98c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40922/0 (socket says 172.21.15.7:40922) 2024-09-19T04:17:12.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.903+0000 7fad52ffd640 1 -- 172.21.15.7:0/58068079 learned_addr learned my addr 172.21.15.7:0/58068079 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:12.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.904+0000 7fad53fff640 1 --2- 172.21.15.7:0/58068079 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c100c9bfc0 0x55c100c99170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:12.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.904+0000 7fad537fe640 1 --2- 172.21.15.7:0/58068079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c100c8c8f0 0x55c100c9b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:12.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.904+0000 7fad52ffd640 1 -- 172.21.15.7:0/58068079 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c100c9bfc0 msgr2=0x55c100c99170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:12.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.904+0000 7fad52ffd640 1 --2- 172.21.15.7:0/58068079 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c100c9bfc0 0x55c100c99170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.904+0000 7fad52ffd640 1 -- 172.21.15.7:0/58068079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c100c8c8f0 msgr2=0x55c100c9b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:12.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.904+0000 7fad52ffd640 1 --2- 172.21.15.7:0/58068079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c100c8c8f0 0x55c100c9b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.904+0000 7fad52ffd640 1 -- 172.21.15.7:0/58068079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1009642b0 con 0x55c100c8d210 2024-09-19T04:17:12.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.904+0000 7fad52ffd640 1 --2- 172.21.15.7:0/58068079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c100c8d210 0x55c100c98c30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fad4800b840 tx=0x7fad4800bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5d205cb07b6004 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:12.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.904+0000 7fad32ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:17:12.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.904+0000 7fad32ffd640 1 -- 172.21.15.7:0/58068079 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4801b440 con 0x55c100c8d210 2024-09-19T04:17:12.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.904+0000 7fad32ffd640 1 -- 172.21.15.7:0/58068079 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fad4801b5e0 con 0x55c100c8d210 2024-09-19T04:17:12.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.904+0000 7fad5c1d4740 1 -- 172.21.15.7:0/58068079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad4c01cc70 con 0x55c100c8d210 2024-09-19T04:17:12.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.904+0000 7fad32ffd640 1 -- 172.21.15.7:0/58068079 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fad4801b7e0 con 0x55c100c8d210 2024-09-19T04:17:12.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.904+0000 7fad5c1d4740 10 client.15393 fetch_fsmap learned FSMap version 28 2024-09-19T04:17:12.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.904+0000 7fad5c1d4740 1 -- 172.21.15.7:0/58068079 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c100caa520 con 0x55c100c8d210 2024-09-19T04:17:12.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.904+0000 7fad32ffd640 1 -- 172.21.15.7:0/58068079 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad4c01cc70 con 0x55c100c8d210 2024-09-19T04:17:12.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.905+0000 7fad32ffd640 1 -- 172.21.15.7:0/58068079 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fad48019020 con 0x55c100c8d210 2024-09-19T04:17:12.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.905+0000 7fad5c1d4740 10 client.15393 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:17:12.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.905+0000 7fad5c1d4740 10 client.15393 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T04:17:12.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.905+0000 7fad5c1d4740 20 client.15393 populate_metadata read hostname 'smithi007' 2024-09-19T04:17:12.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.905+0000 7fad5c1d4740 1 --2- 172.21.15.7:0/58068079 >> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] conn(0x55c100cacb50 0x55c100cadfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:12.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.905+0000 7fad5c1d4740 4 client.15393 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:17:12.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.905+0000 7fad5c1d4740 1 -- 172.21.15.7:0/58068079 --> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c100c00600 con 0x55c100cacb50 2024-09-19T04:17:12.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.905+0000 7fad537fe640 1 --2- 172.21.15.7:0/58068079 >> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] conn(0x55c100cacb50 0x55c100cadfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:12.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.905+0000 7fad537fe640 1 --2- 172.21.15.7:0/58068079 >> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] conn(0x55c100cacb50 0x55c100cadfc0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1f038997c672c83 server_cookie=55adccffb425a07c in_seq=0 out_seq=0 2024-09-19T04:17:12.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.905+0000 7fad32ffd640 10 client.15393 ms_handle_connect on v2:172.21.15.102:6836/618291553 2024-09-19T04:17:12.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.906+0000 7fad32ffd640 1 -- 172.21.15.7:0/58068079 <== mds.3 v2:172.21.15.102:6836/618291553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c100c00600 con 0x55c100cacb50 2024-09-19T04:17:12.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.906+0000 7fad32ffd640 10 client.15393 handle_command_reply: tid=0 2024-09-19T04:17:12.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.906+0000 7fad5c1d4740 1 client.15393 shutdown 2024-09-19T04:17:12.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.906+0000 7fad5c1d4740 1 -- 172.21.15.7:0/58068079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c100c8d210 msgr2=0x55c100c98c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:12.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.906+0000 7fad5c1d4740 1 --2- 172.21.15.7:0/58068079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c100c8d210 0x55c100c98c30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fad4800b840 tx=0x7fad4800bd00 comp rx=0 tx=0).stop 2024-09-19T04:17:12.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.907+0000 7fad5c1d4740 1 -- 172.21.15.7:0/58068079 shutdown_connections 2024-09-19T04:17:12.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.907+0000 7fad5c1d4740 1 --2- 172.21.15.7:0/58068079 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c100c9bfc0 0x55c100c99170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.907+0000 7fad5c1d4740 1 --2- 172.21.15.7:0/58068079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c100c8d210 0x55c100c98c30 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.907+0000 7fad5c1d4740 1 --2- 172.21.15.7:0/58068079 >> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] conn(0x55c100cacb50 0x55c100cadfc0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.907+0000 7fad5c1d4740 1 --2- 172.21.15.7:0/58068079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c100c8c8f0 0x55c100c9b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.907+0000 7fad32ffd640 0 client.15393 ms_handle_reset on v2:172.21.15.102:6836/618291553 2024-09-19T04:17:12.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.907+0000 7fad5c1d4740 1 -- 172.21.15.7:0/58068079 >> 172.21.15.7:0/58068079 conn(0x55c100c88f60 msgr2=0x55c100c8ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:12.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.907+0000 7fad5c1d4740 1 -- 172.21.15.7:0/58068079 shutdown_connections 2024-09-19T04:17:12.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.907+0000 7fad5c1d4740 1 -- 172.21.15.7:0/58068079 wait complete. 2024-09-19T04:17:12.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.907+0000 7fad5c1d4740 20 client.15393 trim_cache size 0 max 16384 2024-09-19T04:17:12.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.924+0000 7fad5c1d4740 1 Processor -- start 2024-09-19T04:17:12.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.924+0000 7fad5c1d4740 1 -- start start 2024-09-19T04:17:12.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.925+0000 7fad5c1d4740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c100c8c8f0 0x55c100cacb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:12.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.925+0000 7fad5c1d4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c100c8d210 0x55c100c8ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:12.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.925+0000 7fad5c1d4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c100c9bfc0 0x55c100c95e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:12.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.925+0000 7fad5c1d4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c100cac300 con 0x55c100c8d210 2024-09-19T04:17:12.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.925+0000 7fad5c1d4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c100cac9d0 con 0x55c100c9bfc0 2024-09-19T04:17:12.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.925+0000 7fad5c1d4740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c100cad0a0 con 0x55c100c8c8f0 2024-09-19T04:17:12.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.925+0000 7fad52ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c100c8d210 0x55c100c8ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:12.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.925+0000 7fad52ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c100c8d210 0x55c100c8ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40934/0 (socket says 172.21.15.7:40934) 2024-09-19T04:17:12.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.925+0000 7fad52ffd640 1 -- 172.21.15.7:0/3836342796 learned_addr learned my addr 172.21.15.7:0/3836342796 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:12.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.925+0000 7fad537fe640 1 --2- 172.21.15.7:0/3836342796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c100c8c8f0 0x55c100cacb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:12.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.925+0000 7fad52ffd640 1 -- 172.21.15.7:0/3836342796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c100c8c8f0 msgr2=0x55c100cacb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:12.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.925+0000 7fad52ffd640 1 --2- 172.21.15.7:0/3836342796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c100c8c8f0 0x55c100cacb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.925+0000 7fad52ffd640 1 -- 172.21.15.7:0/3836342796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c100c9bfc0 msgr2=0x55c100c95e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:12.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.925+0000 7fad52ffd640 1 --2- 172.21.15.7:0/3836342796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c100c9bfc0 0x55c100c95e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.925+0000 7fad52ffd640 1 -- 172.21.15.7:0/3836342796 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c100c9ec40 con 0x55c100c8d210 2024-09-19T04:17:12.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.925+0000 7fad52ffd640 1 --2- 172.21.15.7:0/3836342796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c100c8d210 0x55c100c8ea50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fad480059f0 tx=0x7fad4800bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469d10004897ef07 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:12.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.925+0000 7fad397fa640 1 -- 172.21.15.7:0/3836342796 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4802c070 con 0x55c100c8d210 2024-09-19T04:17:12.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.925+0000 7fad397fa640 1 -- 172.21.15.7:0/3836342796 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad480039c0 con 0x55c100c8d210 2024-09-19T04:17:12.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.925+0000 7fad397fa640 1 -- 172.21.15.7:0/3836342796 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad48011870 con 0x55c100c8d210 2024-09-19T04:17:12.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.926+0000 7fad5c1d4740 1 -- 172.21.15.7:0/3836342796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c100c8d210 msgr2=0x55c100c8ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:12.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.926+0000 7fad5c1d4740 1 --2- 172.21.15.7:0/3836342796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c100c8d210 0x55c100c8ea50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fad480059f0 tx=0x7fad4800bf50 comp rx=0 tx=0).stop 2024-09-19T04:17:12.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.926+0000 7fad5c1d4740 1 -- 172.21.15.7:0/3836342796 shutdown_connections 2024-09-19T04:17:12.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.926+0000 7fad5c1d4740 1 --2- 172.21.15.7:0/3836342796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c100c9bfc0 0x55c100c95e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.926+0000 7fad5c1d4740 1 --2- 172.21.15.7:0/3836342796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c100c8d210 0x55c100c8ea50 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.926+0000 7fad5c1d4740 1 --2- 172.21.15.7:0/3836342796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c100c8c8f0 0x55c100cacb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.926+0000 7fad5c1d4740 1 -- 172.21.15.7:0/3836342796 >> 172.21.15.7:0/3836342796 conn(0x55c100c88f60 msgr2=0x55c100c8e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:12.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.926+0000 7fad5c1d4740 1 -- 172.21.15.7:0/3836342796 shutdown_connections 2024-09-19T04:17:12.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.926+0000 7fad5c1d4740 1 -- 172.21.15.7:0/3836342796 wait complete. 2024-09-19T04:17:12.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.926+0000 7fad5c1d4740 1 -- start start 2024-09-19T04:17:12.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.927+0000 7fad5c1d4740 1 Processor -- start 2024-09-19T04:17:12.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.927+0000 7fad5c1d4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c100c8c8f0 0x55c100caf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:12.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.927+0000 7fad5c1d4740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c100c8d210 0x55c100cafca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:12.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.927+0000 7fad5c1d4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c100c9bfc0 0x55c100d15250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:12.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.927+0000 7fad5c1d4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c100cade40 con 0x55c100c8c8f0 2024-09-19T04:17:12.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.927+0000 7fad5c1d4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c100cad770 con 0x55c100c9bfc0 2024-09-19T04:17:12.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.927+0000 7fad5c1d4740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c100cae510 con 0x55c100c8d210 2024-09-19T04:17:12.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.927+0000 7fad5c1d4740 10 client.0 _ll_register_callbacks cb 0x7fad48005c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:17:12.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.927+0000 7fad537fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c100c8c8f0 0x55c100caf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:12.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.927+0000 7fad537fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c100c8c8f0 0x55c100caf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40950/0 (socket says 172.21.15.7:40950) 2024-09-19T04:17:12.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.927+0000 7fad537fe640 1 -- 172.21.15.7:0/2384815133 learned_addr learned my addr 172.21.15.7:0/2384815133 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:12.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.927+0000 7fad52ffd640 1 --2- 172.21.15.7:0/2384815133 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c100c8d210 0x55c100cafca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:12.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.927+0000 7fad537fe640 1 -- 172.21.15.7:0/2384815133 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c100c8d210 msgr2=0x55c100cafca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:12.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.927+0000 7fad537fe640 1 --2- 172.21.15.7:0/2384815133 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c100c8d210 0x55c100cafca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.927+0000 7fad537fe640 1 -- 172.21.15.7:0/2384815133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c100c9bfc0 msgr2=0x55c100d15250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:12.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.927+0000 7fad53fff640 1 --2- 172.21.15.7:0/2384815133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c100c9bfc0 0x55c100d15250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:12.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.927+0000 7fad537fe640 1 --2- 172.21.15.7:0/2384815133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c100c9bfc0 0x55c100d15250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.927+0000 7fad537fe640 1 -- 172.21.15.7:0/2384815133 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c100d15790 con 0x55c100c8c8f0 2024-09-19T04:17:12.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.927+0000 7fad537fe640 1 --2- 172.21.15.7:0/2384815133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c100c8c8f0 0x55c100caf760 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fad440c4bc0 tx=0x7fad440f0680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe8033cb2bcff44 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:12.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.927+0000 7fad32ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:17:12.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.927+0000 7fad32ffd640 1 -- 172.21.15.7:0/2384815133 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad44049040 con 0x55c100c8c8f0 2024-09-19T04:17:12.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.928+0000 7fad32ffd640 1 -- 172.21.15.7:0/2384815133 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fad440edb00 con 0x55c100c8c8f0 2024-09-19T04:17:12.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.928+0000 7fad5c1d4740 1 -- 172.21.15.7:0/2384815133 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad480039c0 con 0x55c100c8c8f0 2024-09-19T04:17:12.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.928+0000 7fad32ffd640 1 -- 172.21.15.7:0/2384815133 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fad4403bcb0 con 0x55c100c8c8f0 2024-09-19T04:17:12.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.928+0000 7fad5c1d4740 10 client.15399 fetch_fsmap learned FSMap version 28 2024-09-19T04:17:12.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.928+0000 7fad5c1d4740 1 -- 172.21.15.7:0/2384815133 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c100d16a30 con 0x55c100c8c8f0 2024-09-19T04:17:12.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.928+0000 7fad32ffd640 1 -- 172.21.15.7:0/2384815133 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad480039c0 con 0x55c100c8c8f0 2024-09-19T04:17:12.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.928+0000 7fad32ffd640 1 -- 172.21.15.7:0/2384815133 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fad440b8ba0 con 0x55c100c8c8f0 2024-09-19T04:17:12.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.928+0000 7fad5c1d4740 10 client.15399 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:17:12.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.928+0000 7fad5c1d4740 10 client.15399 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T04:17:12.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.928+0000 7fad5c1d4740 20 client.15399 populate_metadata read hostname 'smithi007' 2024-09-19T04:17:12.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.928+0000 7fad5c1d4740 1 --2- 172.21.15.7:0/2384815133 >> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] conn(0x55c100d1b5e0 0x55c100d1a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:12.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.928+0000 7fad5c1d4740 4 client.15399 mds_command: new command op to 24478 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T04:17:12.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.928+0000 7fad5c1d4740 1 -- 172.21.15.7:0/2384815133 --> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] -- command(tid 0: {"prefix": "status"}) -- 0x55c100bfab10 con 0x55c100d1b5e0 2024-09-19T04:17:12.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.928+0000 7fad52ffd640 1 --2- 172.21.15.7:0/2384815133 >> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] conn(0x55c100d1b5e0 0x55c100d1a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:12.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.929+0000 7fad52ffd640 1 --2- 172.21.15.7:0/2384815133 >> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] conn(0x55c100d1b5e0 0x55c100d1a2f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=91d8591a5e24b24e server_cookie=733b6a9e36bdabc3 in_seq=0 out_seq=0 2024-09-19T04:17:12.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.929+0000 7fad32ffd640 10 client.15399 ms_handle_connect on v2:172.21.15.102:6836/618291553 2024-09-19T04:17:12.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.929+0000 7fad32ffd640 1 -- 172.21.15.7:0/2384815133 <== mds.3 v2:172.21.15.102:6836/618291553 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55c100bfab10 con 0x55c100d1b5e0 2024-09-19T04:17:12.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.929+0000 7fad32ffd640 10 client.15399 handle_command_reply: tid=0 2024-09-19T04:17:12.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.929+0000 7fad5c1d4740 1 client.15399 shutdown 2024-09-19T04:17:12.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.929+0000 7fad5c1d4740 1 -- 172.21.15.7:0/2384815133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c100c8c8f0 msgr2=0x55c100caf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:12.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.929+0000 7fad5c1d4740 1 --2- 172.21.15.7:0/2384815133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c100c8c8f0 0x55c100caf760 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fad440c4bc0 tx=0x7fad440f0680 comp rx=0 tx=0).stop 2024-09-19T04:17:12.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.929+0000 7fad5c1d4740 1 -- 172.21.15.7:0/2384815133 shutdown_connections 2024-09-19T04:17:12.965 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:17:12.966 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "77957c0a-763c-11ef-bceb-c7b262605968", 2024-09-19T04:17:12.966 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 3, 2024-09-19T04:17:12.966 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24478, 2024-09-19T04:17:12.966 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-19T04:17:12.966 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-19T04:17:12.966 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-19T04:17:12.967 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 117.122767888, 2024-09-19T04:17:12.967 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 28, 2024-09-19T04:17:12.967 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 90, 2024-09-19T04:17:12.967 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 90, 2024-09-19T04:17:12.967 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 183.635287358 2024-09-19T04:17:12.967 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:17:12.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.929+0000 7fad5c1d4740 1 --2- 172.21.15.7:0/2384815133 >> [v2:172.21.15.102:6836/618291553,v1:172.21.15.102:6837/618291553] conn(0x55c100d1b5e0 0x55c100d1a2f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.929+0000 7fad5c1d4740 1 --2- 172.21.15.7:0/2384815133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c100c9bfc0 0x55c100d15250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.929+0000 7fad5c1d4740 1 --2- 172.21.15.7:0/2384815133 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c100c8d210 0x55c100cafca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.929+0000 7fad32ffd640 0 client.15399 ms_handle_reset on v2:172.21.15.102:6836/618291553 2024-09-19T04:17:12.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.929+0000 7fad5c1d4740 1 --2- 172.21.15.7:0/2384815133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c100c8c8f0 0x55c100caf760 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.929+0000 7fad5c1d4740 1 -- 172.21.15.7:0/2384815133 >> 172.21.15.7:0/2384815133 conn(0x55c100c88f60 msgr2=0x55c100c8eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:12.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.929+0000 7fad5c1d4740 1 -- 172.21.15.7:0/2384815133 shutdown_connections 2024-09-19T04:17:12.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.929+0000 7fad5c1d4740 1 -- 172.21.15.7:0/2384815133 wait complete. 2024-09-19T04:17:12.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.929+0000 7fad5c1d4740 20 client.15399 trim_cache size 0 max 16384 2024-09-19T04:17:12.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.930+0000 7fad59dfb640 1 -- 172.21.15.7:0/3957473129 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fad3c0a32d0 msgr2=0x7fad3c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:12.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.930+0000 7fad59dfb640 1 --2- 172.21.15.7:0/3957473129 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fad3c0a32d0 0x7fad3c0a5790 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fad4c00dcb0 tx=0x7fad4c01d000 comp rx=0 tx=0).stop 2024-09-19T04:17:12.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.930+0000 7fad59dfb640 1 -- 172.21.15.7:0/3957473129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad54100480 msgr2=0x7fad54198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:12.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.930+0000 7fad59dfb640 1 --2- 172.21.15.7:0/3957473129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad54100480 0x7fad54198430 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fad44006010 tx=0x7fad440042f0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.930+0000 7fad59dfb640 1 -- 172.21.15.7:0/3957473129 shutdown_connections 2024-09-19T04:17:12.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.930+0000 7fad59dfb640 1 --2- 172.21.15.7:0/3957473129 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fad3c0a32d0 0x7fad3c0a5790 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.930+0000 7fad59dfb640 1 --2- 172.21.15.7:0/3957473129 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad541055b0 0x7fad5419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.930+0000 7fad59dfb640 1 --2- 172.21.15.7:0/3957473129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad54100e30 0x7fad54198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.930+0000 7fad59dfb640 1 --2- 172.21.15.7:0/3957473129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad54100480 0x7fad54198430 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:12.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.930+0000 7fad59dfb640 1 -- 172.21.15.7:0/3957473129 >> 172.21.15.7:0/3957473129 conn(0x7fad54077210 msgr2=0x7fad54103eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:12.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.930+0000 7fad59dfb640 1 -- 172.21.15.7:0/3957473129 shutdown_connections 2024-09-19T04:17:12.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:12.930+0000 7fad59dfb640 1 -- 172.21.15.7:0/3957473129 wait complete. 2024-09-19T04:17:13.624 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T04:17:13.892 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:17:14.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.375+0000 7f3149a23640 1 -- 172.21.15.7:0/1949310505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3144101420 msgr2=0x7f314410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:14.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.375+0000 7f3149a23640 1 --2- 172.21.15.7:0/1949310505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3144101420 0x7f314410d950 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f313c009cd0 tx=0x7f313c02a8e0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.375+0000 7f3149a23640 1 -- 172.21.15.7:0/1949310505 shutdown_connections 2024-09-19T04:17:14.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.375+0000 7f3149a23640 1 --2- 172.21.15.7:0/1949310505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3144101420 0x7f314410d950 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.375+0000 7f3149a23640 1 --2- 172.21.15.7:0/1949310505 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3144100a80 0x7f3144100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.375+0000 7f3149a23640 1 --2- 172.21.15.7:0/1949310505 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3144106a80 0x7f3144106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.375+0000 7f3149a23640 1 -- 172.21.15.7:0/1949310505 >> 172.21.15.7:0/1949310505 conn(0x7f31440fc7a0 msgr2=0x7f31440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:14.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.375+0000 7f3149a23640 1 -- 172.21.15.7:0/1949310505 shutdown_connections 2024-09-19T04:17:14.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.375+0000 7f3149a23640 1 -- 172.21.15.7:0/1949310505 wait complete. 2024-09-19T04:17:14.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.375+0000 7f3149a23640 1 Processor -- start 2024-09-19T04:17:14.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.376+0000 7f3149a23640 1 -- start start 2024-09-19T04:17:14.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.376+0000 7f3149a23640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3144100a80 0x7f3144197310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:14.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.376+0000 7f3149a23640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3144101420 0x7f3144197850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:14.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.376+0000 7f3149a23640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3144106a80 0x7f314419bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:14.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.376+0000 7f3149a23640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3144110ed0 con 0x7f3144106a80 2024-09-19T04:17:14.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.376+0000 7f3149a23640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3144110d50 con 0x7f3144101420 2024-09-19T04:17:14.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.376+0000 7f3149a23640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3144111050 con 0x7f3144100a80 2024-09-19T04:17:14.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.376+0000 7f31437fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3144106a80 0x7f314419bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:14.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.376+0000 7f31437fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3144106a80 0x7f314419bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40974/0 (socket says 172.21.15.7:40974) 2024-09-19T04:17:14.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.376+0000 7f31437fe640 1 -- 172.21.15.7:0/1358572700 learned_addr learned my addr 172.21.15.7:0/1358572700 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:14.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.376+0000 7f3142ffd640 1 --2- 172.21.15.7:0/1358572700 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3144100a80 0x7f3144197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:14.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.376+0000 7f313bfff640 1 --2- 172.21.15.7:0/1358572700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3144101420 0x7f3144197850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:14.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.376+0000 7f31437fe640 1 -- 172.21.15.7:0/1358572700 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3144100a80 msgr2=0x7f3144197310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:14.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.376+0000 7f31437fe640 1 --2- 172.21.15.7:0/1358572700 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3144100a80 0x7f3144197310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.376+0000 7f31437fe640 1 -- 172.21.15.7:0/1358572700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3144101420 msgr2=0x7f3144197850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:14.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.376+0000 7f31437fe640 1 --2- 172.21.15.7:0/1358572700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3144101420 0x7f3144197850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.376+0000 7f31437fe640 1 -- 172.21.15.7:0/1358572700 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f314419c2c0 con 0x7f3144106a80 2024-09-19T04:17:14.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.376+0000 7f313bfff640 1 --2- 172.21.15.7:0/1358572700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3144101420 0x7f3144197850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:17:14.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.376+0000 7f31437fe640 1 --2- 172.21.15.7:0/1358572700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3144106a80 0x7f314419bbe0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f313c033040 tx=0x7f313c031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:14.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.377+0000 7f3148a21640 1 -- 172.21.15.7:0/1358572700 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313c004040 con 0x7f3144106a80 2024-09-19T04:17:14.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.377+0000 7f3148a21640 1 -- 172.21.15.7:0/1358572700 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f313c0046c0 con 0x7f3144106a80 2024-09-19T04:17:14.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.377+0000 7f3149a23640 1 -- 172.21.15.7:0/1358572700 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f314419c550 con 0x7f3144106a80 2024-09-19T04:17:14.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.377+0000 7f3148a21640 1 -- 172.21.15.7:0/1358572700 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313c030ed0 con 0x7f3144106a80 2024-09-19T04:17:14.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.377+0000 7f3149a23640 1 -- 172.21.15.7:0/1358572700 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31441a3e90 con 0x7f3144106a80 2024-09-19T04:17:14.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.379+0000 7f3148a21640 1 -- 172.21.15.7:0/1358572700 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f313c0041e0 con 0x7f3144106a80 2024-09-19T04:17:14.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.380+0000 7f3148a21640 1 --2- 172.21.15.7:0/1358572700 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f31300a32d0 0x7f31300a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:14.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.380+0000 7f3142ffd640 1 --2- 172.21.15.7:0/1358572700 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f31300a32d0 0x7f31300a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:14.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.380+0000 7f3148a21640 1 -- 172.21.15.7:0/1358572700 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f313c02e030 con 0x7f3144106a80 2024-09-19T04:17:14.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.380+0000 7f3142ffd640 1 --2- 172.21.15.7:0/1358572700 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f31300a32d0 0x7f31300a5790 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3134009b50 tx=0x7f3134005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:14.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.380+0000 7f314bdfc740 1 Processor -- start 2024-09-19T04:17:14.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.381+0000 7f314bdfc740 1 -- start start 2024-09-19T04:17:14.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.381+0000 7f314bdfc740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5582b1c579d0 0x5582b1c57db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:14.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.381+0000 7f314bdfc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5582b1c582f0 0x5582b1c62670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:14.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.381+0000 7f314bdfc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b1c62bb0 0x5582b1c64fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:14.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.381+0000 7f314bdfc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5582b1bbe090 con 0x5582b1c582f0 2024-09-19T04:17:14.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.381+0000 7f314bdfc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5582b1b65a70 con 0x5582b1c62bb0 2024-09-19T04:17:14.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.381+0000 7f314bdfc740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5582b1bba050 con 0x5582b1c579d0 2024-09-19T04:17:14.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.381+0000 7f313bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5582b1c582f0 0x5582b1c62670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:14.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.381+0000 7f313bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5582b1c582f0 0x5582b1c62670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40988/0 (socket says 172.21.15.7:40988) 2024-09-19T04:17:14.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.381+0000 7f313bfff640 1 -- 172.21.15.7:0/1619333776 learned_addr learned my addr 172.21.15.7:0/1619333776 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:14.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.382+0000 7f31437fe640 1 --2- 172.21.15.7:0/1619333776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b1c62bb0 0x5582b1c64fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:14.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.382+0000 7f313bfff640 1 -- 172.21.15.7:0/1619333776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5582b1c579d0 msgr2=0x5582b1c57db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T04:17:14.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.382+0000 7f313bfff640 1 --2- 172.21.15.7:0/1619333776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5582b1c579d0 0x5582b1c57db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.382+0000 7f313bfff640 1 -- 172.21.15.7:0/1619333776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b1c62bb0 msgr2=0x5582b1c64fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:14.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.382+0000 7f313bfff640 1 --2- 172.21.15.7:0/1619333776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b1c62bb0 0x5582b1c64fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.382+0000 7f313bfff640 1 -- 172.21.15.7:0/1619333776 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582b1b72130 con 0x5582b1c582f0 2024-09-19T04:17:14.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.382+0000 7f31437fe640 1 --2- 172.21.15.7:0/1619333776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b1c62bb0 0x5582b1c64fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:17:14.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.382+0000 7f313bfff640 1 --2- 172.21.15.7:0/1619333776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5582b1c582f0 0x5582b1c62670 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f312c009cb0 tx=0x7f312c011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9da4677ab44583 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:14.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.382+0000 7f3139ffb640 1 -- 172.21.15.7:0/1619333776 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312c0110d0 con 0x5582b1c582f0 2024-09-19T04:17:14.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.382+0000 7f3139ffb640 1 -- 172.21.15.7:0/1619333776 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f312c011270 con 0x5582b1c582f0 2024-09-19T04:17:14.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.382+0000 7f3139ffb640 1 -- 172.21.15.7:0/1619333776 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312c01a8c0 con 0x5582b1c582f0 2024-09-19T04:17:14.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.383+0000 7f314bdfc740 1 -- 172.21.15.7:0/1619333776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5582b1c582f0 msgr2=0x5582b1c62670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:14.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.383+0000 7f314bdfc740 1 --2- 172.21.15.7:0/1619333776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5582b1c582f0 0x5582b1c62670 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f312c009cb0 tx=0x7f312c011940 comp rx=0 tx=0).stop 2024-09-19T04:17:14.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.383+0000 7f314bdfc740 1 -- 172.21.15.7:0/1619333776 shutdown_connections 2024-09-19T04:17:14.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.383+0000 7f314bdfc740 1 --2- 172.21.15.7:0/1619333776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b1c62bb0 0x5582b1c64fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.383+0000 7f314bdfc740 1 --2- 172.21.15.7:0/1619333776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5582b1c582f0 0x5582b1c62670 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.383+0000 7f314bdfc740 1 --2- 172.21.15.7:0/1619333776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5582b1c579d0 0x5582b1c57db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.383+0000 7f314bdfc740 1 -- 172.21.15.7:0/1619333776 >> 172.21.15.7:0/1619333776 conn(0x5582b1c53f60 msgr2=0x5582b1c54340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:14.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.384+0000 7f314bdfc740 1 -- 172.21.15.7:0/1619333776 shutdown_connections 2024-09-19T04:17:14.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.384+0000 7f314bdfc740 1 -- 172.21.15.7:0/1619333776 wait complete. 2024-09-19T04:17:14.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.384+0000 7f314bdfc740 1 -- start start 2024-09-19T04:17:14.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.384+0000 7f314bdfc740 1 Processor -- start 2024-09-19T04:17:14.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.385+0000 7f314bdfc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5582b1c579d0 0x5582b1c624e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:14.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.385+0000 7f314bdfc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b1c582f0 0x5582b1c5f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:14.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.385+0000 7f314bdfc740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5582b1c62bb0 0x5582b1c5fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:14.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.385+0000 7f3142ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5582b1c579d0 0x5582b1c624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:14.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.385+0000 7f3142ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5582b1c579d0 0x5582b1c624e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40990/0 (socket says 172.21.15.7:40990) 2024-09-19T04:17:14.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.385+0000 7f313bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b1c582f0 0x5582b1c5f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:14.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.385+0000 7f31437fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5582b1c62bb0 0x5582b1c5fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:14.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.385+0000 7f313bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b1c582f0 0x5582b1c5f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:48360/0 (socket says 172.21.15.7:48360) 2024-09-19T04:17:14.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.385+0000 7f314bdfc740 1 -- 172.21.15.7:0/3721397134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5582b1c65780 con 0x5582b1c579d0 2024-09-19T04:17:14.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.385+0000 7f3142ffd640 1 -- 172.21.15.7:0/3721397134 learned_addr learned my addr 172.21.15.7:0/3721397134 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:14.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.385+0000 7f314bdfc740 1 -- 172.21.15.7:0/3721397134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5582b1b78f20 con 0x5582b1c582f0 2024-09-19T04:17:14.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.385+0000 7f314bdfc740 1 -- 172.21.15.7:0/3721397134 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5582b1c65900 con 0x5582b1c62bb0 2024-09-19T04:17:14.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.385+0000 7f314bdfc740 10 client.0 _ll_register_callbacks cb 0x5582b1b42030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:17:14.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.385+0000 7f313bfff640 1 -- 172.21.15.7:0/3721397134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5582b1c62bb0 msgr2=0x5582b1c5fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.385+0000 7f313bfff640 1 --2- 172.21.15.7:0/3721397134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5582b1c62bb0 0x5582b1c5fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.385+0000 7f313bfff640 1 -- 172.21.15.7:0/3721397134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5582b1c579d0 msgr2=0x5582b1c624e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.385+0000 7f313bfff640 1 --2- 172.21.15.7:0/3721397134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5582b1c579d0 0x5582b1c624e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.385+0000 7f313bfff640 1 -- 172.21.15.7:0/3721397134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582b192f2b0 con 0x5582b1c582f0 2024-09-19T04:17:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.386+0000 7f313bfff640 1 --2- 172.21.15.7:0/3721397134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b1c582f0 0x5582b1c5f830 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f312c009cb0 tx=0x7f312c00fd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af27ecda8fc10784 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.386+0000 7f3122ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T04:17:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.386+0000 7f3122ffd640 1 -- 172.21.15.7:0/3721397134 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312c0110d0 con 0x5582b1c582f0 2024-09-19T04:17:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.386+0000 7f314bdfc740 1 -- 172.21.15.7:0/3721397134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f312c011270 con 0x5582b1c582f0 2024-09-19T04:17:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.386+0000 7f3122ffd640 1 -- 172.21.15.7:0/3721397134 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f312c020070 con 0x5582b1c582f0 2024-09-19T04:17:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.386+0000 7f3122ffd640 1 -- 172.21.15.7:0/3721397134 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f312c00f550 con 0x5582b1c582f0 2024-09-19T04:17:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.386+0000 7f314bdfc740 10 client.25064 fetch_fsmap learned FSMap version 28 2024-09-19T04:17:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.386+0000 7f314bdfc740 1 -- 172.21.15.7:0/3721397134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5582b1c71160 con 0x5582b1c582f0 2024-09-19T04:17:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.386+0000 7f3122ffd640 1 -- 172.21.15.7:0/3721397134 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f312c011270 con 0x5582b1c582f0 2024-09-19T04:17:14.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.387+0000 7f3122ffd640 1 -- 172.21.15.7:0/3721397134 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f312c004b60 con 0x5582b1c582f0 2024-09-19T04:17:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.387+0000 7f314bdfc740 10 client.25064 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:17:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.387+0000 7f314bdfc740 10 client.25064 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T04:17:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.387+0000 7f314bdfc740 20 client.25064 populate_metadata read hostname 'smithi007' 2024-09-19T04:17:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.387+0000 7f314bdfc740 1 --2- 172.21.15.7:0/3721397134 >> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] conn(0x5582b1c735e0 0x5582b1c74a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.387+0000 7f314bdfc740 4 client.25064 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:17:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.387+0000 7f314bdfc740 1 -- 172.21.15.7:0/3721397134 --> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582b1bcb600 con 0x5582b1c735e0 2024-09-19T04:17:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.387+0000 7f3142ffd640 1 --2- 172.21.15.7:0/3721397134 >> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] conn(0x5582b1c735e0 0x5582b1c74a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.388+0000 7f3142ffd640 1 --2- 172.21.15.7:0/3721397134 >> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] conn(0x5582b1c735e0 0x5582b1c74a50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=28f52b4b4c0691fd server_cookie=b9b9750f9687df9 in_seq=0 out_seq=0 2024-09-19T04:17:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.388+0000 7f3122ffd640 10 client.25064 ms_handle_connect on v2:172.21.15.92:6836/319779585 2024-09-19T04:17:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.388+0000 7f3122ffd640 1 -- 172.21.15.7:0/3721397134 <== mds.2 v2:172.21.15.92:6836/319779585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5582b1bcb600 con 0x5582b1c735e0 2024-09-19T04:17:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.388+0000 7f3122ffd640 10 client.25064 handle_command_reply: tid=0 2024-09-19T04:17:14.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.388+0000 7f314bdfc740 1 client.25064 shutdown 2024-09-19T04:17:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.389+0000 7f314bdfc740 1 -- 172.21.15.7:0/3721397134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b1c582f0 msgr2=0x5582b1c5f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.389+0000 7f314bdfc740 1 --2- 172.21.15.7:0/3721397134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b1c582f0 0x5582b1c5f830 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f312c009cb0 tx=0x7f312c00fd80 comp rx=0 tx=0).stop 2024-09-19T04:17:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.389+0000 7f314bdfc740 1 -- 172.21.15.7:0/3721397134 shutdown_connections 2024-09-19T04:17:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.389+0000 7f314bdfc740 1 --2- 172.21.15.7:0/3721397134 >> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] conn(0x5582b1c735e0 0x5582b1c74a50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.389+0000 7f314bdfc740 1 --2- 172.21.15.7:0/3721397134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5582b1c62bb0 0x5582b1c5fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.389+0000 7f314bdfc740 1 --2- 172.21.15.7:0/3721397134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b1c582f0 0x5582b1c5f830 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.389+0000 7f314bdfc740 1 --2- 172.21.15.7:0/3721397134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5582b1c579d0 0x5582b1c624e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.389+0000 7f314bdfc740 1 -- 172.21.15.7:0/3721397134 >> 172.21.15.7:0/3721397134 conn(0x5582b1c53f60 msgr2=0x5582b1c59c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.389+0000 7f3122ffd640 0 client.25064 ms_handle_reset on v2:172.21.15.92:6836/319779585 2024-09-19T04:17:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.389+0000 7f314bdfc740 1 -- 172.21.15.7:0/3721397134 shutdown_connections 2024-09-19T04:17:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.389+0000 7f314bdfc740 1 -- 172.21.15.7:0/3721397134 wait complete. 2024-09-19T04:17:14.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.389+0000 7f314bdfc740 20 client.25064 trim_cache size 0 max 16384 2024-09-19T04:17:14.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.422+0000 7f314bdfc740 1 Processor -- start 2024-09-19T04:17:14.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.422+0000 7f314bdfc740 1 -- start start 2024-09-19T04:17:14.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.423+0000 7f314bdfc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5582b1c579d0 0x5582b1c73cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:14.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.423+0000 7f314bdfc740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5582b1c582f0 0x5582b1c61690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:14.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.423+0000 7f314bdfc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b1c62bb0 0x5582b1c5cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:14.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.423+0000 7f314bdfc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5582b1c72d90 con 0x5582b1c579d0 2024-09-19T04:17:14.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.423+0000 7f314bdfc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5582b1c73460 con 0x5582b1c62bb0 2024-09-19T04:17:14.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.423+0000 7f314bdfc740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5582b1c73b30 con 0x5582b1c582f0 2024-09-19T04:17:14.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.423+0000 7f3142ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5582b1c579d0 0x5582b1c73cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:14.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.423+0000 7f3142ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5582b1c579d0 0x5582b1c73cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40996/0 (socket says 172.21.15.7:40996) 2024-09-19T04:17:14.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.423+0000 7f3142ffd640 1 -- 172.21.15.7:0/300829609 learned_addr learned my addr 172.21.15.7:0/300829609 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:14.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.423+0000 7f313bfff640 1 --2- 172.21.15.7:0/300829609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5582b1c582f0 0x5582b1c61690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:14.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.423+0000 7f31437fe640 1 --2- 172.21.15.7:0/300829609 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b1c62bb0 0x5582b1c5cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:14.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.423+0000 7f3142ffd640 1 -- 172.21.15.7:0/300829609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5582b1c582f0 msgr2=0x5582b1c61690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:14.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.423+0000 7f3142ffd640 1 --2- 172.21.15.7:0/300829609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5582b1c582f0 0x5582b1c61690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.423+0000 7f3142ffd640 1 -- 172.21.15.7:0/300829609 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b1c62bb0 msgr2=0x5582b1c5cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:14.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.423+0000 7f3142ffd640 1 --2- 172.21.15.7:0/300829609 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b1c62bb0 0x5582b1c5cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.423+0000 7f3142ffd640 1 -- 172.21.15.7:0/300829609 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582b1c65310 con 0x5582b1c579d0 2024-09-19T04:17:14.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.423+0000 7f31437fe640 1 --2- 172.21.15.7:0/300829609 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b1c62bb0 0x5582b1c5cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:17:14.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.423+0000 7f3142ffd640 1 --2- 172.21.15.7:0/300829609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5582b1c579d0 0x5582b1c73cb0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3134009fd0 tx=0x7f3134014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3285e5351f2718a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:14.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.424+0000 7f31397fa640 1 -- 172.21.15.7:0/300829609 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313402c070 con 0x5582b1c579d0 2024-09-19T04:17:14.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.424+0000 7f31397fa640 1 -- 172.21.15.7:0/300829609 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31340279b0 con 0x5582b1c579d0 2024-09-19T04:17:14.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.424+0000 7f31397fa640 1 -- 172.21.15.7:0/300829609 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313401eb40 con 0x5582b1c579d0 2024-09-19T04:17:14.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.424+0000 7f314bdfc740 1 -- 172.21.15.7:0/300829609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5582b1c579d0 msgr2=0x5582b1c73cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:14.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.424+0000 7f314bdfc740 1 --2- 172.21.15.7:0/300829609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5582b1c579d0 0x5582b1c73cb0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3134009fd0 tx=0x7f3134014000 comp rx=0 tx=0).stop 2024-09-19T04:17:14.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.424+0000 7f314bdfc740 1 -- 172.21.15.7:0/300829609 shutdown_connections 2024-09-19T04:17:14.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.424+0000 7f314bdfc740 1 --2- 172.21.15.7:0/300829609 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b1c62bb0 0x5582b1c5cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.424+0000 7f314bdfc740 1 --2- 172.21.15.7:0/300829609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5582b1c582f0 0x5582b1c61690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.424+0000 7f314bdfc740 1 --2- 172.21.15.7:0/300829609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5582b1c579d0 0x5582b1c73cb0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.424+0000 7f314bdfc740 1 -- 172.21.15.7:0/300829609 >> 172.21.15.7:0/300829609 conn(0x5582b1c53f60 msgr2=0x5582b1c60f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:14.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.424+0000 7f314bdfc740 1 -- 172.21.15.7:0/300829609 shutdown_connections 2024-09-19T04:17:14.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.425+0000 7f314bdfc740 1 -- 172.21.15.7:0/300829609 wait complete. 2024-09-19T04:17:14.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.425+0000 7f314bdfc740 1 -- start start 2024-09-19T04:17:14.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.425+0000 7f314bdfc740 1 Processor -- start 2024-09-19T04:17:14.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.425+0000 7f314bdfc740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5582b1c579d0 0x5582b1c78a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:14.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.425+0000 7f314bdfc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5582b1c582f0 0x5582b1c78fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:14.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.425+0000 7f314bdfc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b1c62bb0 0x5582b1c79500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:14.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.425+0000 7f314bdfc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5582b1c748d0 con 0x5582b1c582f0 2024-09-19T04:17:14.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.425+0000 7f314bdfc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5582b1c74200 con 0x5582b1c62bb0 2024-09-19T04:17:14.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.425+0000 7f314bdfc740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5582b1c74fa0 con 0x5582b1c579d0 2024-09-19T04:17:14.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.425+0000 7f314bdfc740 10 client.0 _ll_register_callbacks cb 0x7f312c009b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:17:14.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.425+0000 7f313bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5582b1c582f0 0x5582b1c78fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:14.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.426+0000 7f313bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5582b1c582f0 0x5582b1c78fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41008/0 (socket says 172.21.15.7:41008) 2024-09-19T04:17:14.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.426+0000 7f313bfff640 1 -- 172.21.15.7:0/2705768656 learned_addr learned my addr 172.21.15.7:0/2705768656 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:14.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.426+0000 7f3142ffd640 1 --2- 172.21.15.7:0/2705768656 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5582b1c579d0 0x5582b1c78a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:14.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.426+0000 7f31437fe640 1 --2- 172.21.15.7:0/2705768656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b1c62bb0 0x5582b1c79500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:14.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.426+0000 7f313bfff640 1 -- 172.21.15.7:0/2705768656 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5582b1c579d0 msgr2=0x5582b1c78a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:14.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.426+0000 7f313bfff640 1 --2- 172.21.15.7:0/2705768656 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5582b1c579d0 0x5582b1c78a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.426+0000 7f313bfff640 1 -- 172.21.15.7:0/2705768656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b1c62bb0 msgr2=0x5582b1c79500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:14.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.426+0000 7f313bfff640 1 --2- 172.21.15.7:0/2705768656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b1c62bb0 0x5582b1c79500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.426+0000 7f313bfff640 1 -- 172.21.15.7:0/2705768656 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582b1cdccf0 con 0x5582b1c582f0 2024-09-19T04:17:14.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.426+0000 7f31437fe640 1 --2- 172.21.15.7:0/2705768656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b1c62bb0 0x5582b1c79500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:17:14.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.426+0000 7f313bfff640 1 --2- 172.21.15.7:0/2705768656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5582b1c582f0 0x5582b1c78fc0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f312c004f30 tx=0x7f312c01a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2077a3e49b73f227 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:14.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.426+0000 7f3122ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:17:14.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.426+0000 7f3122ffd640 1 -- 172.21.15.7:0/2705768656 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312c01a800 con 0x5582b1c582f0 2024-09-19T04:17:14.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.426+0000 7f3122ffd640 1 -- 172.21.15.7:0/2705768656 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f312c017040 con 0x5582b1c582f0 2024-09-19T04:17:14.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.426+0000 7f314bdfc740 1 -- 172.21.15.7:0/2705768656 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31340279b0 con 0x5582b1c582f0 2024-09-19T04:17:14.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.426+0000 7f3122ffd640 1 -- 172.21.15.7:0/2705768656 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f312c01ab20 con 0x5582b1c582f0 2024-09-19T04:17:14.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.426+0000 7f314bdfc740 10 client.15417 fetch_fsmap learned FSMap version 28 2024-09-19T04:17:14.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.426+0000 7f314bdfc740 1 -- 172.21.15.7:0/2705768656 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5582b1cddf10 con 0x5582b1c582f0 2024-09-19T04:17:14.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.427+0000 7f3122ffd640 1 -- 172.21.15.7:0/2705768656 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31340279b0 con 0x5582b1c582f0 2024-09-19T04:17:14.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.427+0000 7f3122ffd640 1 -- 172.21.15.7:0/2705768656 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f312c0049c0 con 0x5582b1c582f0 2024-09-19T04:17:14.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.427+0000 7f314bdfc740 10 client.15417 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:17:14.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.427+0000 7f314bdfc740 10 client.15417 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T04:17:14.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.427+0000 7f314bdfc740 20 client.15417 populate_metadata read hostname 'smithi007' 2024-09-19T04:17:14.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.427+0000 7f314bdfc740 1 --2- 172.21.15.7:0/2705768656 >> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] conn(0x5582b1ce2a40 0x5582b1ce1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:14.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.427+0000 7f314bdfc740 4 client.15417 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T04:17:14.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.427+0000 7f314bdfc740 1 -- 172.21.15.7:0/2705768656 --> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] -- command(tid 0: {"prefix": "status"}) -- 0x5582b1bc5b10 con 0x5582b1ce2a40 2024-09-19T04:17:14.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.427+0000 7f3142ffd640 1 --2- 172.21.15.7:0/2705768656 >> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] conn(0x5582b1ce2a40 0x5582b1ce1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:14.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.428+0000 7f3142ffd640 1 --2- 172.21.15.7:0/2705768656 >> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] conn(0x5582b1ce2a40 0x5582b1ce1750 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6dda5511faa68621 server_cookie=2495dfb0c4caa358 in_seq=0 out_seq=0 2024-09-19T04:17:14.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.428+0000 7f3122ffd640 10 client.15417 ms_handle_connect on v2:172.21.15.92:6836/319779585 2024-09-19T04:17:14.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.428+0000 7f3122ffd640 1 -- 172.21.15.7:0/2705768656 <== mds.2 v2:172.21.15.92:6836/319779585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5582b1bc5b10 con 0x5582b1ce2a40 2024-09-19T04:17:14.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.428+0000 7f3122ffd640 10 client.15417 handle_command_reply: tid=0 2024-09-19T04:17:14.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.428+0000 7f314bdfc740 1 client.15417 shutdown 2024-09-19T04:17:14.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.428+0000 7f314bdfc740 1 -- 172.21.15.7:0/2705768656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5582b1c582f0 msgr2=0x5582b1c78fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:14.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.428+0000 7f314bdfc740 1 --2- 172.21.15.7:0/2705768656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5582b1c582f0 0x5582b1c78fc0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f312c004f30 tx=0x7f312c01a680 comp rx=0 tx=0).stop 2024-09-19T04:17:14.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.428+0000 7f314bdfc740 1 -- 172.21.15.7:0/2705768656 shutdown_connections 2024-09-19T04:17:14.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.428+0000 7f314bdfc740 1 --2- 172.21.15.7:0/2705768656 >> [v2:172.21.15.92:6836/319779585,v1:172.21.15.92:6837/319779585] conn(0x5582b1ce2a40 0x5582b1ce1750 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.428+0000 7f314bdfc740 1 --2- 172.21.15.7:0/2705768656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582b1c62bb0 0x5582b1c79500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.428+0000 7f314bdfc740 1 --2- 172.21.15.7:0/2705768656 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5582b1c582f0 0x5582b1c78fc0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.428+0000 7f314bdfc740 1 --2- 172.21.15.7:0/2705768656 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5582b1c579d0 0x5582b1c78a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.428+0000 7f314bdfc740 1 -- 172.21.15.7:0/2705768656 >> 172.21.15.7:0/2705768656 conn(0x5582b1c53f60 msgr2=0x5582b1c616c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:14.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.428+0000 7f3122ffd640 0 client.15417 ms_handle_reset on v2:172.21.15.92:6836/319779585 2024-09-19T04:17:14.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.428+0000 7f314bdfc740 1 -- 172.21.15.7:0/2705768656 shutdown_connections 2024-09-19T04:17:14.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.428+0000 7f314bdfc740 1 -- 172.21.15.7:0/2705768656 wait complete. 2024-09-19T04:17:14.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.428+0000 7f314bdfc740 20 client.15417 trim_cache size 0 max 16384 2024-09-19T04:17:14.437 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:17:14.438 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "77957c0a-763c-11ef-bceb-c7b262605968", 2024-09-19T04:17:14.438 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 2, 2024-09-19T04:17:14.438 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24482, 2024-09-19T04:17:14.438 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-19T04:17:14.438 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-19T04:17:14.438 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-19T04:17:14.438 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 119.63001301, 2024-09-19T04:17:14.438 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 28, 2024-09-19T04:17:14.438 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 90, 2024-09-19T04:17:14.438 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 90, 2024-09-19T04:17:14.438 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 182.42389214599999 2024-09-19T04:17:14.438 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:17:14.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.429+0000 7f3149a23640 1 -- 172.21.15.7:0/1358572700 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f31300a32d0 msgr2=0x7f31300a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:14.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.429+0000 7f3149a23640 1 --2- 172.21.15.7:0/1358572700 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f31300a32d0 0x7f31300a5790 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3134009b50 tx=0x7f3134005f90 comp rx=0 tx=0).stop 2024-09-19T04:17:14.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.429+0000 7f3149a23640 1 -- 172.21.15.7:0/1358572700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3144106a80 msgr2=0x7f314419bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:14.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.429+0000 7f3149a23640 1 --2- 172.21.15.7:0/1358572700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3144106a80 0x7f314419bbe0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f313c033040 tx=0x7f313c031e60 comp rx=0 tx=0).stop 2024-09-19T04:17:14.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.429+0000 7f3149a23640 1 -- 172.21.15.7:0/1358572700 shutdown_connections 2024-09-19T04:17:14.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.429+0000 7f3149a23640 1 --2- 172.21.15.7:0/1358572700 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f31300a32d0 0x7f31300a5790 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.429+0000 7f3149a23640 1 --2- 172.21.15.7:0/1358572700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3144106a80 0x7f314419bbe0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.429+0000 7f3149a23640 1 --2- 172.21.15.7:0/1358572700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3144101420 0x7f3144197850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.429+0000 7f3149a23640 1 --2- 172.21.15.7:0/1358572700 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3144100a80 0x7f3144197310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:14.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.429+0000 7f3149a23640 1 -- 172.21.15.7:0/1358572700 >> 172.21.15.7:0/1358572700 conn(0x7f31440fc7a0 msgr2=0x7f31440fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:14.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.429+0000 7f3149a23640 1 -- 172.21.15.7:0/1358572700 shutdown_connections 2024-09-19T04:17:14.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:14.429+0000 7f3149a23640 1 -- 172.21.15.7:0/1358572700 wait complete. 2024-09-19T04:17:14.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:14 smithi092 ceph-mon[34940]: pgmap v364: 129 pgs: 129 active+clean; 662 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-09-19T04:17:14.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:14 smithi007 ceph-mon[31360]: pgmap v364: 129 pgs: 129 active+clean; 662 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-09-19T04:17:14.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:14 smithi102 ceph-mon[35446]: pgmap v364: 129 pgs: 129 active+clean; 662 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-09-19T04:17:15.132 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T04:17:15.393 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:17:15.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.891+0000 7f4009d8f640 1 -- 172.21.15.7:0/82783736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4004106a80 msgr2=0x7f4004106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:15.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.891+0000 7f4009d8f640 1 --2- 172.21.15.7:0/82783736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4004106a80 0x7f4004106e60 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009930 tx=0x7f3ff402a420 comp rx=0 tx=0).stop 2024-09-19T04:17:15.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.892+0000 7f4009d8f640 1 -- 172.21.15.7:0/82783736 shutdown_connections 2024-09-19T04:17:15.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.892+0000 7f4009d8f640 1 --2- 172.21.15.7:0/82783736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4004101420 0x7f400410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.892+0000 7f4009d8f640 1 --2- 172.21.15.7:0/82783736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4004100a80 0x7f4004100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.892+0000 7f4009d8f640 1 --2- 172.21.15.7:0/82783736 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4004106a80 0x7f4004106e60 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.892+0000 7f4009d8f640 1 -- 172.21.15.7:0/82783736 >> 172.21.15.7:0/82783736 conn(0x7f40040fc7a0 msgr2=0x7f40040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:15.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.892+0000 7f4009d8f640 1 -- 172.21.15.7:0/82783736 shutdown_connections 2024-09-19T04:17:15.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.892+0000 7f4009d8f640 1 -- 172.21.15.7:0/82783736 wait complete. 2024-09-19T04:17:15.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.892+0000 7f4009d8f640 1 Processor -- start 2024-09-19T04:17:15.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.892+0000 7f4009d8f640 1 -- start start 2024-09-19T04:17:15.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.893+0000 7f4009d8f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4004100a80 0x7f400419a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:15.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.893+0000 7f4009d8f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4004101420 0x7f400419aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:15.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.893+0000 7f4009d8f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4004106a80 0x7f400419ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:15.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.893+0000 7f4009d8f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4004111fa0 con 0x7f4004101420 2024-09-19T04:17:15.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.893+0000 7f4009d8f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4004111e20 con 0x7f4004106a80 2024-09-19T04:17:15.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.893+0000 7f4009d8f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4004112120 con 0x7f4004100a80 2024-09-19T04:17:15.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.893+0000 7f4002ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4004101420 0x7f400419aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:15.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.893+0000 7f4002ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4004101420 0x7f400419aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41024/0 (socket says 172.21.15.7:41024) 2024-09-19T04:17:15.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.893+0000 7f4002ffd640 1 -- 172.21.15.7:0/1626038647 learned_addr learned my addr 172.21.15.7:0/1626038647 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:15.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.893+0000 7f4003fff640 1 --2- 172.21.15.7:0/1626038647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4004106a80 0x7f400419ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:15.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.893+0000 7f40037fe640 1 --2- 172.21.15.7:0/1626038647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4004100a80 0x7f400419a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:15.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.893+0000 7f4002ffd640 1 -- 172.21.15.7:0/1626038647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4004100a80 msgr2=0x7f400419a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:15.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.893+0000 7f4002ffd640 1 --2- 172.21.15.7:0/1626038647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4004100a80 0x7f400419a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.893+0000 7f4002ffd640 1 -- 172.21.15.7:0/1626038647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4004106a80 msgr2=0x7f400419ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:15.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.893+0000 7f4002ffd640 1 --2- 172.21.15.7:0/1626038647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4004106a80 0x7f400419ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.893+0000 7f4002ffd640 1 -- 172.21.15.7:0/1626038647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f400419f530 con 0x7f4004101420 2024-09-19T04:17:15.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.893+0000 7f4002ffd640 1 --2- 172.21.15.7:0/1626038647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4004101420 0x7f400419aac0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3ff800c920 tx=0x7f3ff800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:15.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.893+0000 7f4000ff9640 1 -- 172.21.15.7:0/1626038647 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8007c70 con 0x7f4004101420 2024-09-19T04:17:15.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.893+0000 7f4000ff9640 1 -- 172.21.15.7:0/1626038647 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ff8007e10 con 0x7f4004101420 2024-09-19T04:17:15.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.893+0000 7f4009d8f640 1 -- 172.21.15.7:0/1626038647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f400419f820 con 0x7f4004101420 2024-09-19T04:17:15.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.893+0000 7f4000ff9640 1 -- 172.21.15.7:0/1626038647 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8018890 con 0x7f4004101420 2024-09-19T04:17:15.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.893+0000 7f4009d8f640 1 -- 172.21.15.7:0/1626038647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40041a7100 con 0x7f4004101420 2024-09-19T04:17:15.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.896+0000 7f4000ff9640 1 -- 172.21.15.7:0/1626038647 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f3ff8018a70 con 0x7f4004101420 2024-09-19T04:17:15.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.896+0000 7f400c168740 1 Processor -- start 2024-09-19T04:17:15.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.896+0000 7f400c168740 1 -- start start 2024-09-19T04:17:15.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.896+0000 7f400c168740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562dec98f9d0 0x562dec98fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:15.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.896+0000 7f400c168740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dec9902f0 0x562dec99a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:15.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.896+0000 7f400c168740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dec99abb0 0x562dec99cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:15.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.896+0000 7f400c168740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562dec8f6090 con 0x562dec99abb0 2024-09-19T04:17:15.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.896+0000 7f400c168740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562dec89da70 con 0x562dec9902f0 2024-09-19T04:17:15.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.896+0000 7f400c168740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562dec8f2050 con 0x562dec98f9d0 2024-09-19T04:17:15.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.896+0000 7f4002ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dec99abb0 0x562dec99cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:15.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.897+0000 7f4002ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dec99abb0 0x562dec99cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41038/0 (socket says 172.21.15.7:41038) 2024-09-19T04:17:15.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.897+0000 7f4002ffd640 1 -- 172.21.15.7:0/2764354606 learned_addr learned my addr 172.21.15.7:0/2764354606 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:15.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.897+0000 7f4003fff640 1 --2- 172.21.15.7:0/2764354606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562dec98f9d0 0x562dec98fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:15.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.897+0000 7f4000ff9640 1 --2- 172.21.15.7:0/1626038647 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3fec0a32d0 0x7f3fec0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:15.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.897+0000 7f40037fe640 1 --2- 172.21.15.7:0/2764354606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dec9902f0 0x562dec99a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:15.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.897+0000 7f4003fff640 1 --2- 172.21.15.7:0/1626038647 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3fec0a32d0 0x7f3fec0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:15.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.897+0000 7f4000ff9640 1 -- 172.21.15.7:0/1626038647 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f3ff80cffc0 con 0x7f4004101420 2024-09-19T04:17:15.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.897+0000 7f4002ffd640 1 -- 172.21.15.7:0/2764354606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562dec98f9d0 msgr2=0x562dec98fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:15.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.897+0000 7f4002ffd640 1 --2- 172.21.15.7:0/2764354606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562dec98f9d0 0x562dec98fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.897+0000 7f4002ffd640 1 -- 172.21.15.7:0/2764354606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dec9902f0 msgr2=0x562dec99a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:15.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.897+0000 7f4002ffd640 1 --2- 172.21.15.7:0/2764354606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dec9902f0 0x562dec99a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.897+0000 7f4002ffd640 1 -- 172.21.15.7:0/2764354606 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dec8aa130 con 0x562dec99abb0 2024-09-19T04:17:15.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.897+0000 7f40037fe640 1 --2- 172.21.15.7:0/2764354606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dec9902f0 0x562dec99a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:17:15.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.897+0000 7f4002ffd640 1 --2- 172.21.15.7:0/2764354606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dec99abb0 0x562dec99cfa0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3ff80cd510 tx=0x7f3ff800ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a15bceca9fdafc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:15.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.897+0000 7f4003fff640 1 --2- 172.21.15.7:0/1626038647 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3fec0a32d0 0x7f3fec0a5790 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc014ba0 tx=0x7f3ffc004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:15.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.897+0000 7f3fe9ffb640 1 -- 172.21.15.7:0/2764354606 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff809c7b0 con 0x562dec99abb0 2024-09-19T04:17:15.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.897+0000 7f3fe9ffb640 1 -- 172.21.15.7:0/2764354606 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ff809c0b0 con 0x562dec99abb0 2024-09-19T04:17:15.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.897+0000 7f3fe9ffb640 1 -- 172.21.15.7:0/2764354606 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff800fb30 con 0x562dec99abb0 2024-09-19T04:17:15.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.898+0000 7f400c168740 1 -- 172.21.15.7:0/2764354606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dec99abb0 msgr2=0x562dec99cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:15.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.898+0000 7f400c168740 1 --2- 172.21.15.7:0/2764354606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dec99abb0 0x562dec99cfa0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3ff80cd510 tx=0x7f3ff800ff30 comp rx=0 tx=0).stop 2024-09-19T04:17:15.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.898+0000 7f400c168740 1 -- 172.21.15.7:0/2764354606 shutdown_connections 2024-09-19T04:17:15.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.898+0000 7f400c168740 1 --2- 172.21.15.7:0/2764354606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dec99abb0 0x562dec99cfa0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.898+0000 7f400c168740 1 --2- 172.21.15.7:0/2764354606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dec9902f0 0x562dec99a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.898+0000 7f400c168740 1 --2- 172.21.15.7:0/2764354606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562dec98f9d0 0x562dec98fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.898+0000 7f400c168740 1 -- 172.21.15.7:0/2764354606 >> 172.21.15.7:0/2764354606 conn(0x562dec98bf60 msgr2=0x562dec98c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:15.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.898+0000 7f400c168740 1 -- 172.21.15.7:0/2764354606 shutdown_connections 2024-09-19T04:17:15.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.898+0000 7f400c168740 1 -- 172.21.15.7:0/2764354606 wait complete. 2024-09-19T04:17:15.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.898+0000 7f400c168740 1 -- start start 2024-09-19T04:17:15.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.899+0000 7f400c168740 1 Processor -- start 2024-09-19T04:17:15.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.899+0000 7f400c168740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dec98f9d0 0x562dec99a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:15.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.899+0000 7f400c168740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dec9902f0 0x562dec997730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:15.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.899+0000 7f400c168740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562dec99abb0 0x562dec997c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:15.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.899+0000 7f400c168740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562dec99d780 con 0x562dec98f9d0 2024-09-19T04:17:15.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.899+0000 7f400c168740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562dec8b0f20 con 0x562dec9902f0 2024-09-19T04:17:15.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.899+0000 7f400c168740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562dec99d900 con 0x562dec99abb0 2024-09-19T04:17:15.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.899+0000 7f400c168740 10 client.0 _ll_register_callbacks cb 0x562dec87a030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:17:15.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.899+0000 7f40037fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dec98f9d0 0x562dec99a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:15.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.899+0000 7f40037fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dec98f9d0 0x562dec99a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41052/0 (socket says 172.21.15.7:41052) 2024-09-19T04:17:15.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.899+0000 7f40037fe640 1 -- 172.21.15.7:0/321005057 learned_addr learned my addr 172.21.15.7:0/321005057 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:15.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.899+0000 7f4003fff640 1 --2- 172.21.15.7:0/321005057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562dec99abb0 0x562dec997c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:15.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.899+0000 7f4002ffd640 1 --2- 172.21.15.7:0/321005057 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dec9902f0 0x562dec997730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:15.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.899+0000 7f40037fe640 1 -- 172.21.15.7:0/321005057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562dec99abb0 msgr2=0x562dec997c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:15.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.899+0000 7f40037fe640 1 --2- 172.21.15.7:0/321005057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562dec99abb0 0x562dec997c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.899+0000 7f40037fe640 1 -- 172.21.15.7:0/321005057 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dec9902f0 msgr2=0x562dec997730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:15.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.899+0000 7f40037fe640 1 --2- 172.21.15.7:0/321005057 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dec9902f0 0x562dec997730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.900+0000 7f40037fe640 1 -- 172.21.15.7:0/321005057 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562dec6672b0 con 0x562dec98f9d0 2024-09-19T04:17:15.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.900+0000 7f4003fff640 1 --2- 172.21.15.7:0/321005057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562dec99abb0 0x562dec997c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:17:15.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.900+0000 7f4002ffd640 1 --2- 172.21.15.7:0/321005057 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dec9902f0 0x562dec997730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:17:15.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.900+0000 7f40037fe640 1 --2- 172.21.15.7:0/321005057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dec98f9d0 0x562dec99a3e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009930 tx=0x7f3ff4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e245c2851b7065 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:15.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.900+0000 7f3fe2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:17:15.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.900+0000 7f3fe2ffd640 1 -- 172.21.15.7:0/321005057 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff4035040 con 0x562dec98f9d0 2024-09-19T04:17:15.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.900+0000 7f3fe2ffd640 1 -- 172.21.15.7:0/321005057 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f3ff4005020 con 0x562dec98f9d0 2024-09-19T04:17:15.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.900+0000 7f400c168740 1 -- 172.21.15.7:0/321005057 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ff809c0b0 con 0x562dec98f9d0 2024-09-19T04:17:15.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.900+0000 7f3fe2ffd640 1 -- 172.21.15.7:0/321005057 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3ff404e050 con 0x562dec98f9d0 2024-09-19T04:17:15.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.900+0000 7f400c168740 10 client.15429 fetch_fsmap learned FSMap version 28 2024-09-19T04:17:15.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.900+0000 7f400c168740 1 -- 172.21.15.7:0/321005057 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562dec9a9030 con 0x562dec98f9d0 2024-09-19T04:17:15.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.900+0000 7f3fe2ffd640 1 -- 172.21.15.7:0/321005057 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ff809c0b0 con 0x562dec98f9d0 2024-09-19T04:17:15.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.900+0000 7f3fe2ffd640 1 -- 172.21.15.7:0/321005057 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f3ff40035f0 con 0x562dec98f9d0 2024-09-19T04:17:15.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.900+0000 7f400c168740 10 client.15429 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:17:15.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.900+0000 7f400c168740 10 client.15429 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T04:17:15.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.900+0000 7f400c168740 20 client.15429 populate_metadata read hostname 'smithi007' 2024-09-19T04:17:15.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.901+0000 7f400c168740 1 --2- 172.21.15.7:0/321005057 >> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] conn(0x562dec9ab640 0x562dec9acab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:15.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.901+0000 7f400c168740 4 client.15429 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:17:15.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.901+0000 7f400c168740 1 -- 172.21.15.7:0/321005057 --> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562dec903600 con 0x562dec9ab640 2024-09-19T04:17:15.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.901+0000 7f4002ffd640 1 --2- 172.21.15.7:0/321005057 >> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] conn(0x562dec9ab640 0x562dec9acab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:15.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.901+0000 7f3fe2ffd640 10 client.15429 ms_handle_connect on v2:172.21.15.102:6838/2728093829 2024-09-19T04:17:15.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.901+0000 7f4002ffd640 1 --2- 172.21.15.7:0/321005057 >> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] conn(0x562dec9ab640 0x562dec9acab0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6f343c9de02019fc server_cookie=fd0e7b390f41e0d5 in_seq=0 out_seq=0 2024-09-19T04:17:15.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.902+0000 7f3fe2ffd640 1 -- 172.21.15.7:0/321005057 <== mds.1 v2:172.21.15.102:6838/2728093829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562dec903600 con 0x562dec9ab640 2024-09-19T04:17:15.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.902+0000 7f3fe2ffd640 10 client.15429 handle_command_reply: tid=0 2024-09-19T04:17:15.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.902+0000 7f400c168740 1 client.15429 shutdown 2024-09-19T04:17:15.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.902+0000 7f400c168740 1 -- 172.21.15.7:0/321005057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dec98f9d0 msgr2=0x562dec99a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:15.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.902+0000 7f400c168740 1 --2- 172.21.15.7:0/321005057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dec98f9d0 0x562dec99a3e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009930 tx=0x7f3ff4004270 comp rx=0 tx=0).stop 2024-09-19T04:17:15.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.902+0000 7f400c168740 1 -- 172.21.15.7:0/321005057 shutdown_connections 2024-09-19T04:17:15.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.902+0000 7f400c168740 1 --2- 172.21.15.7:0/321005057 >> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] conn(0x562dec9ab640 0x562dec9acab0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.902+0000 7f400c168740 1 --2- 172.21.15.7:0/321005057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562dec99abb0 0x562dec997c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.902+0000 7f400c168740 1 --2- 172.21.15.7:0/321005057 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dec9902f0 0x562dec997730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.902+0000 7f400c168740 1 --2- 172.21.15.7:0/321005057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dec98f9d0 0x562dec99a3e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.902+0000 7f3fe2ffd640 0 client.15429 ms_handle_reset on v2:172.21.15.102:6838/2728093829 2024-09-19T04:17:15.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.902+0000 7f400c168740 1 -- 172.21.15.7:0/321005057 >> 172.21.15.7:0/321005057 conn(0x562dec98bf60 msgr2=0x562dec991c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:15.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.902+0000 7f400c168740 1 -- 172.21.15.7:0/321005057 shutdown_connections 2024-09-19T04:17:15.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.902+0000 7f400c168740 1 -- 172.21.15.7:0/321005057 wait complete. 2024-09-19T04:17:15.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.902+0000 7f400c168740 20 client.15429 trim_cache size 0 max 16384 2024-09-19T04:17:15.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.921+0000 7f400c168740 1 Processor -- start 2024-09-19T04:17:15.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.921+0000 7f400c168740 1 -- start start 2024-09-19T04:17:15.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.921+0000 7f400c168740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dec98f9d0 0x562dec9949b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:15.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.921+0000 7f400c168740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562dec9902f0 0x562dec994ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:15.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.921+0000 7f400c168740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dec99abb0 0x562dec9b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:15.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.921+0000 7f400c168740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562dec9aadf0 con 0x562dec98f9d0 2024-09-19T04:17:15.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.921+0000 7f400c168740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562dec9ab4c0 con 0x562dec99abb0 2024-09-19T04:17:15.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.921+0000 7f400c168740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562dec9abb90 con 0x562dec9902f0 2024-09-19T04:17:15.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.921+0000 7f40037fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dec98f9d0 0x562dec9949b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:15.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.921+0000 7f40037fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dec98f9d0 0x562dec9949b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41056/0 (socket says 172.21.15.7:41056) 2024-09-19T04:17:15.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.921+0000 7f40037fe640 1 -- 172.21.15.7:0/2548290377 learned_addr learned my addr 172.21.15.7:0/2548290377 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:15.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.921+0000 7f4002ffd640 1 --2- 172.21.15.7:0/2548290377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562dec9902f0 0x562dec994ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:15.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.921+0000 7f4003fff640 1 --2- 172.21.15.7:0/2548290377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dec99abb0 0x562dec9b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:15.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.922+0000 7f40037fe640 1 -- 172.21.15.7:0/2548290377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562dec9902f0 msgr2=0x562dec994ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:15.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.922+0000 7f40037fe640 1 --2- 172.21.15.7:0/2548290377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562dec9902f0 0x562dec994ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.922+0000 7f40037fe640 1 -- 172.21.15.7:0/2548290377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dec99abb0 msgr2=0x562dec9b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:15.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.922+0000 7f40037fe640 1 --2- 172.21.15.7:0/2548290377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dec99abb0 0x562dec9b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.922+0000 7f40037fe640 1 -- 172.21.15.7:0/2548290377 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562dec98d0f0 con 0x562dec98f9d0 2024-09-19T04:17:15.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.922+0000 7f40037fe640 1 --2- 172.21.15.7:0/2548290377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dec98f9d0 0x562dec9949b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4000c00 tx=0x7f3ff4005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39709488368d872d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:15.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.922+0000 7f3fe97fa640 1 -- 172.21.15.7:0/2548290377 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff4035070 con 0x562dec98f9d0 2024-09-19T04:17:15.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.922+0000 7f3fe97fa640 1 -- 172.21.15.7:0/2548290377 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ff4005500 con 0x562dec98f9d0 2024-09-19T04:17:15.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.922+0000 7f3fe97fa640 1 -- 172.21.15.7:0/2548290377 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff40047a0 con 0x562dec98f9d0 2024-09-19T04:17:15.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.923+0000 7f400c168740 1 -- 172.21.15.7:0/2548290377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dec98f9d0 msgr2=0x562dec9949b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:15.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.923+0000 7f400c168740 1 --2- 172.21.15.7:0/2548290377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dec98f9d0 0x562dec9949b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4000c00 tx=0x7f3ff4005e30 comp rx=0 tx=0).stop 2024-09-19T04:17:15.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.923+0000 7f400c168740 1 -- 172.21.15.7:0/2548290377 shutdown_connections 2024-09-19T04:17:15.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.923+0000 7f400c168740 1 --2- 172.21.15.7:0/2548290377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dec99abb0 0x562dec9b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.923+0000 7f400c168740 1 --2- 172.21.15.7:0/2548290377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562dec9902f0 0x562dec994ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.923+0000 7f400c168740 1 --2- 172.21.15.7:0/2548290377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dec98f9d0 0x562dec9949b0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.923+0000 7f400c168740 1 -- 172.21.15.7:0/2548290377 >> 172.21.15.7:0/2548290377 conn(0x562dec98bf60 msgr2=0x562dec996000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:15.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.923+0000 7f400c168740 1 -- 172.21.15.7:0/2548290377 shutdown_connections 2024-09-19T04:17:15.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.923+0000 7f400c168740 1 -- 172.21.15.7:0/2548290377 wait complete. 2024-09-19T04:17:15.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.923+0000 7f400c168740 1 -- start start 2024-09-19T04:17:15.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.924+0000 7f400c168740 1 Processor -- start 2024-09-19T04:17:15.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.924+0000 7f400c168740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dec98f9d0 0x562dec9afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:15.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.924+0000 7f400c168740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562dec9902f0 0x562dec9b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:15.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.924+0000 7f400c168740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dec99abb0 0x562dec9b0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:15.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.924+0000 7f400c168740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562dec9ac930 con 0x562dec99abb0 2024-09-19T04:17:15.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.924+0000 7f400c168740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562dec9ac260 con 0x562dec98f9d0 2024-09-19T04:17:15.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.924+0000 7f400c168740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562dec9ad000 con 0x562dec9902f0 2024-09-19T04:17:15.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.924+0000 7f4003fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dec99abb0 0x562dec9b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:15.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.924+0000 7f400c168740 10 client.0 _ll_register_callbacks cb 0x7f3ff4009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:17:15.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.924+0000 7f4003fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dec99abb0 0x562dec9b0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41062/0 (socket says 172.21.15.7:41062) 2024-09-19T04:17:15.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.924+0000 7f4003fff640 1 -- 172.21.15.7:0/2041468465 learned_addr learned my addr 172.21.15.7:0/2041468465 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:15.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.924+0000 7f40037fe640 1 --2- 172.21.15.7:0/2041468465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dec98f9d0 0x562dec9afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:15.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.924+0000 7f4002ffd640 1 --2- 172.21.15.7:0/2041468465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562dec9902f0 0x562dec9b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:15.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.924+0000 7f4003fff640 1 -- 172.21.15.7:0/2041468465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562dec9902f0 msgr2=0x562dec9b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:15.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.924+0000 7f4003fff640 1 --2- 172.21.15.7:0/2041468465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562dec9902f0 0x562dec9b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.924+0000 7f4003fff640 1 -- 172.21.15.7:0/2041468465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dec98f9d0 msgr2=0x562dec9afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:15.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.924+0000 7f4003fff640 1 --2- 172.21.15.7:0/2041468465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dec98f9d0 0x562dec9afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.924+0000 7f4003fff640 1 -- 172.21.15.7:0/2041468465 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562deca14030 con 0x562dec99abb0 2024-09-19T04:17:15.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.924+0000 7f4002ffd640 1 --2- 172.21.15.7:0/2041468465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562dec9902f0 0x562dec9b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:17:15.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.924+0000 7f4003fff640 1 --2- 172.21.15.7:0/2041468465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dec99abb0 0x562dec9b0840 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc007300 tx=0x7f3ffc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0723848d3d516d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:15.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.924+0000 7f3fe2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:17:15.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.925+0000 7f3fe2ffd640 1 -- 172.21.15.7:0/2041468465 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc004d20 con 0x562dec99abb0 2024-09-19T04:17:15.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.925+0000 7f3fe2ffd640 1 -- 172.21.15.7:0/2041468465 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f3ffc0139e0 con 0x562dec99abb0 2024-09-19T04:17:15.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.925+0000 7f400c168740 1 -- 172.21.15.7:0/2041468465 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ff4005500 con 0x562dec99abb0 2024-09-19T04:17:15.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.925+0000 7f3fe2ffd640 1 -- 172.21.15.7:0/2041468465 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3ffc035050 con 0x562dec99abb0 2024-09-19T04:17:15.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.925+0000 7f400c168740 10 client.15435 fetch_fsmap learned FSMap version 28 2024-09-19T04:17:15.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.925+0000 7f400c168740 1 -- 172.21.15.7:0/2041468465 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562deca15330 con 0x562dec99abb0 2024-09-19T04:17:15.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.925+0000 7f3fe2ffd640 1 -- 172.21.15.7:0/2041468465 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ff4005500 con 0x562dec99abb0 2024-09-19T04:17:15.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.925+0000 7f3fe2ffd640 1 -- 172.21.15.7:0/2041468465 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f3ffc020040 con 0x562dec99abb0 2024-09-19T04:17:15.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.925+0000 7f400c168740 10 client.15435 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:17:15.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.925+0000 7f400c168740 10 client.15435 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T04:17:15.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.925+0000 7f400c168740 20 client.15435 populate_metadata read hostname 'smithi007' 2024-09-19T04:17:15.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.925+0000 7f400c168740 1 --2- 172.21.15.7:0/2041468465 >> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] conn(0x562deca19f60 0x562deca18c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:15.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.925+0000 7f400c168740 4 client.15435 mds_command: new command op to 24496 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T04:17:15.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.925+0000 7f400c168740 1 -- 172.21.15.7:0/2041468465 --> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] -- command(tid 0: {"prefix": "status"}) -- 0x562dec8fdb10 con 0x562deca19f60 2024-09-19T04:17:15.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.926+0000 7f40037fe640 1 --2- 172.21.15.7:0/2041468465 >> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] conn(0x562deca19f60 0x562deca18c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:15.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.926+0000 7f40037fe640 1 --2- 172.21.15.7:0/2041468465 >> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] conn(0x562deca19f60 0x562deca18c70 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=29ea219dece23ff7 server_cookie=b553c93eca363066 in_seq=0 out_seq=0 2024-09-19T04:17:15.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.926+0000 7f3fe2ffd640 10 client.15435 ms_handle_connect on v2:172.21.15.102:6838/2728093829 2024-09-19T04:17:15.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.926+0000 7f3fe2ffd640 1 -- 172.21.15.7:0/2041468465 <== mds.1 v2:172.21.15.102:6838/2728093829 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x562dec8fdb10 con 0x562deca19f60 2024-09-19T04:17:15.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.926+0000 7f3fe2ffd640 10 client.15435 handle_command_reply: tid=0 2024-09-19T04:17:15.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.926+0000 7f400c168740 1 client.15435 shutdown 2024-09-19T04:17:15.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.926+0000 7f400c168740 1 -- 172.21.15.7:0/2041468465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dec99abb0 msgr2=0x562dec9b0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:15.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.926+0000 7f400c168740 1 --2- 172.21.15.7:0/2041468465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dec99abb0 0x562dec9b0840 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc007300 tx=0x7f3ffc004a40 comp rx=0 tx=0).stop 2024-09-19T04:17:15.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.927+0000 7f400c168740 1 -- 172.21.15.7:0/2041468465 shutdown_connections 2024-09-19T04:17:15.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.927+0000 7f400c168740 1 --2- 172.21.15.7:0/2041468465 >> [v2:172.21.15.102:6838/2728093829,v1:172.21.15.102:6839/2728093829] conn(0x562deca19f60 0x562deca18c70 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.927+0000 7f400c168740 1 --2- 172.21.15.7:0/2041468465 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562dec99abb0 0x562dec9b0840 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.927+0000 7f400c168740 1 --2- 172.21.15.7:0/2041468465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562dec9902f0 0x562dec9b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.927+0000 7f3fe2ffd640 0 client.15435 ms_handle_reset on v2:172.21.15.102:6838/2728093829 2024-09-19T04:17:15.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.927+0000 7f400c168740 1 --2- 172.21.15.7:0/2041468465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562dec98f9d0 0x562dec9afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.927+0000 7f400c168740 1 -- 172.21.15.7:0/2041468465 >> 172.21.15.7:0/2041468465 conn(0x562dec98bf60 msgr2=0x562dec98a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:15.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.927+0000 7f400c168740 1 -- 172.21.15.7:0/2041468465 shutdown_connections 2024-09-19T04:17:15.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.927+0000 7f400c168740 1 -- 172.21.15.7:0/2041468465 wait complete. 2024-09-19T04:17:15.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.927+0000 7f400c168740 20 client.15435 trim_cache size 0 max 16384 2024-09-19T04:17:15.936 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:17:15.936 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "77957c0a-763c-11ef-bceb-c7b262605968", 2024-09-19T04:17:15.937 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 1, 2024-09-19T04:17:15.937 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24496, 2024-09-19T04:17:15.937 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-19T04:17:15.937 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-19T04:17:15.937 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-19T04:17:15.937 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 122.133836311, 2024-09-19T04:17:15.937 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 28, 2024-09-19T04:17:15.937 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 90, 2024-09-19T04:17:15.937 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 90, 2024-09-19T04:17:15.938 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 181.25785076599999 2024-09-19T04:17:15.938 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:17:15.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.927+0000 7f4009d8f640 1 -- 172.21.15.7:0/1626038647 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3fec0a32d0 msgr2=0x7f3fec0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:15.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.927+0000 7f4009d8f640 1 --2- 172.21.15.7:0/1626038647 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3fec0a32d0 0x7f3fec0a5790 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc014ba0 tx=0x7f3ffc004ab0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.927+0000 7f4009d8f640 1 -- 172.21.15.7:0/1626038647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4004101420 msgr2=0x7f400419aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:15.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.927+0000 7f4009d8f640 1 --2- 172.21.15.7:0/1626038647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4004101420 0x7f400419aac0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3ff800c920 tx=0x7f3ff800cde0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.927+0000 7f4009d8f640 1 -- 172.21.15.7:0/1626038647 shutdown_connections 2024-09-19T04:17:15.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.927+0000 7f4009d8f640 1 --2- 172.21.15.7:0/1626038647 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3fec0a32d0 0x7f3fec0a5790 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.927+0000 7f4009d8f640 1 --2- 172.21.15.7:0/1626038647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4004106a80 0x7f400419ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.927+0000 7f4009d8f640 1 --2- 172.21.15.7:0/1626038647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4004101420 0x7f400419aac0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.927+0000 7f4009d8f640 1 --2- 172.21.15.7:0/1626038647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4004100a80 0x7f400419a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:15.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.927+0000 7f4009d8f640 1 -- 172.21.15.7:0/1626038647 >> 172.21.15.7:0/1626038647 conn(0x7f40040fc7a0 msgr2=0x7f40040fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:15.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.928+0000 7f4009d8f640 1 -- 172.21.15.7:0/1626038647 shutdown_connections 2024-09-19T04:17:15.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:15.928+0000 7f4009d8f640 1 -- 172.21.15.7:0/1626038647 wait complete. 2024-09-19T04:17:16.539 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:16 smithi007 ceph-mon[31360]: pgmap v365: 129 pgs: 129 active+clean; 663 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.5 KiB/s wr, 15 op/s 2024-09-19T04:17:16.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:16 smithi092 ceph-mon[34940]: pgmap v365: 129 pgs: 129 active+clean; 663 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.5 KiB/s wr, 15 op/s 2024-09-19T04:17:16.569 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T04:17:16.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:16 smithi102 ceph-mon[35446]: pgmap v365: 129 pgs: 129 active+clean; 663 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.5 KiB/s wr, 15 op/s 2024-09-19T04:17:16.830 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:17:17.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.275+0000 7f400dd7a640 1 -- 172.21.15.7:0/3911551208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4008103740 msgr2=0x7f4008107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:17.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.275+0000 7f400dd7a640 1 --2- 172.21.15.7:0/3911551208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4008103740 0x7f4008107b80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc009930 tx=0x7f3ffc02a420 comp rx=0 tx=0).stop 2024-09-19T04:17:17.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.275+0000 7f400dd7a640 1 -- 172.21.15.7:0/3911551208 shutdown_connections 2024-09-19T04:17:17.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.275+0000 7f400dd7a640 1 --2- 172.21.15.7:0/3911551208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4008108290 0x7f400810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.275+0000 7f400dd7a640 1 --2- 172.21.15.7:0/3911551208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4008103740 0x7f4008107b80 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.275+0000 7f400dd7a640 1 --2- 172.21.15.7:0/3911551208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4008102d90 0x7f4008103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.275+0000 7f400dd7a640 1 -- 172.21.15.7:0/3911551208 >> 172.21.15.7:0/3911551208 conn(0x7f40080fc7d0 msgr2=0x7f40080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:17.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.276+0000 7f400dd7a640 1 -- 172.21.15.7:0/3911551208 shutdown_connections 2024-09-19T04:17:17.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.276+0000 7f400dd7a640 1 -- 172.21.15.7:0/3911551208 wait complete. 2024-09-19T04:17:17.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.276+0000 7f400dd7a640 1 Processor -- start 2024-09-19T04:17:17.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.276+0000 7f400dd7a640 1 -- start start 2024-09-19T04:17:17.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.277+0000 7f400dd7a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4008102d90 0x7f4008198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:17.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.277+0000 7f400dd7a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4008103740 0x7f4008198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:17.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.277+0000 7f400dd7a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4008108290 0x7f400819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:17.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.277+0000 7f400dd7a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4008112050 con 0x7f4008103740 2024-09-19T04:17:17.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.277+0000 7f400dd7a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4008111ed0 con 0x7f4008108290 2024-09-19T04:17:17.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.277+0000 7f400dd7a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f40081121d0 con 0x7f4008102d90 2024-09-19T04:17:17.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.277+0000 7f4006ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4008103740 0x7f4008198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:17.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.277+0000 7f4006ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4008103740 0x7f4008198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41078/0 (socket says 172.21.15.7:41078) 2024-09-19T04:17:17.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.277+0000 7f4006ffd640 1 -- 172.21.15.7:0/3187062449 learned_addr learned my addr 172.21.15.7:0/3187062449 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:17.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.277+0000 7f40077fe640 1 --2- 172.21.15.7:0/3187062449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4008102d90 0x7f4008198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:17.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.277+0000 7f4007fff640 1 --2- 172.21.15.7:0/3187062449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4008108290 0x7f400819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:17.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.277+0000 7f4006ffd640 1 -- 172.21.15.7:0/3187062449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4008102d90 msgr2=0x7f4008198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:17.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.277+0000 7f4006ffd640 1 --2- 172.21.15.7:0/3187062449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4008102d90 0x7f4008198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.277+0000 7f4006ffd640 1 -- 172.21.15.7:0/3187062449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4008108290 msgr2=0x7f400819ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:17.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.277+0000 7f4006ffd640 1 --2- 172.21.15.7:0/3187062449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4008108290 0x7f400819ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.277+0000 7f4006ffd640 1 -- 172.21.15.7:0/3187062449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f400819d500 con 0x7f4008103740 2024-09-19T04:17:17.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.277+0000 7f4007fff640 1 --2- 172.21.15.7:0/3187062449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4008108290 0x7f400819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:17:17.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.277+0000 7f4006ffd640 1 --2- 172.21.15.7:0/3187062449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4008103740 0x7f4008198a90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc005940 tx=0x7f3ffc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:17.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.277+0000 7f4004ff9640 1 -- 172.21.15.7:0/3187062449 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc03f030 con 0x7f4008103740 2024-09-19T04:17:17.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.278+0000 7f4004ff9640 1 -- 172.21.15.7:0/3187062449 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ffc003ce0 con 0x7f4008103740 2024-09-19T04:17:17.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.278+0000 7f400dd7a640 1 -- 172.21.15.7:0/3187062449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f400819d790 con 0x7f4008103740 2024-09-19T04:17:17.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.278+0000 7f4004ff9640 1 -- 172.21.15.7:0/3187062449 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc035070 con 0x7f4008103740 2024-09-19T04:17:17.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.278+0000 7f400dd7a640 1 -- 172.21.15.7:0/3187062449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40081a50d0 con 0x7f4008103740 2024-09-19T04:17:17.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.280+0000 7f4004ff9640 1 -- 172.21.15.7:0/3187062449 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f3ffc042030 con 0x7f4008103740 2024-09-19T04:17:17.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.280+0000 7f4010153740 1 Processor -- start 2024-09-19T04:17:17.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.280+0000 7f4010153740 1 -- start start 2024-09-19T04:17:17.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.280+0000 7f4010153740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec281f69d0 0x55ec281f6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:17.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.280+0000 7f4010153740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec281f72f0 0x55ec28201670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:17.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.280+0000 7f4010153740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec28201bb0 0x55ec28203fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:17.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.281+0000 7f4010153740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ec2815d090 con 0x55ec281f72f0 2024-09-19T04:17:17.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.281+0000 7f4010153740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ec28104a70 con 0x55ec281f69d0 2024-09-19T04:17:17.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.281+0000 7f4010153740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ec28159050 con 0x55ec28201bb0 2024-09-19T04:17:17.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.281+0000 7f40077fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec281f72f0 0x55ec28201670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:17.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.281+0000 7f40077fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec281f72f0 0x55ec28201670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41092/0 (socket says 172.21.15.7:41092) 2024-09-19T04:17:17.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.281+0000 7f40077fe640 1 -- 172.21.15.7:0/2476101006 learned_addr learned my addr 172.21.15.7:0/2476101006 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:17.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.281+0000 7f4004ff9640 1 --2- 172.21.15.7:0/3187062449 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3ff00a32d0 0x7f3ff00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:17.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.281+0000 7f4006ffd640 1 --2- 172.21.15.7:0/2476101006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec28201bb0 0x55ec28203fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:17.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.281+0000 7f4007fff640 1 --2- 172.21.15.7:0/2476101006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec281f69d0 0x55ec281f6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:17.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.281+0000 7f4007fff640 1 --2- 172.21.15.7:0/3187062449 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3ff00a32d0 0x7f3ff00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:17.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.281+0000 7f40077fe640 1 -- 172.21.15.7:0/2476101006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec28201bb0 msgr2=0x55ec28203fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:17.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.281+0000 7f40077fe640 1 --2- 172.21.15.7:0/2476101006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec28201bb0 0x55ec28203fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.281+0000 7f40077fe640 1 -- 172.21.15.7:0/2476101006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec281f69d0 msgr2=0x55ec281f6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:17.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.281+0000 7f40077fe640 1 --2- 172.21.15.7:0/2476101006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec281f69d0 0x55ec281f6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.281+0000 7f40077fe640 1 -- 172.21.15.7:0/2476101006 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec28111130 con 0x55ec281f72f0 2024-09-19T04:17:17.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.281+0000 7f4006ffd640 1 --2- 172.21.15.7:0/2476101006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec28201bb0 0x55ec28203fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:17:17.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.281+0000 7f4004ff9640 1 -- 172.21.15.7:0/3187062449 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f3ffc0f03a0 con 0x7f4008103740 2024-09-19T04:17:17.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.281+0000 7f40077fe640 1 --2- 172.21.15.7:0/2476101006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec281f72f0 0x55ec28201670 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3ff800ad00 tx=0x7f3ff800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d502d5fa865474e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:17.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.281+0000 7f4007fff640 1 --2- 172.21.15.7:0/3187062449 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3ff00a32d0 0x7f3ff00a5790 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4000009370 tx=0x7f4000009240 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:17.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.281+0000 7f3fedffb640 1 -- 172.21.15.7:0/2476101006 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff801d070 con 0x55ec281f72f0 2024-09-19T04:17:17.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.282+0000 7f3fedffb640 1 -- 172.21.15.7:0/2476101006 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ff8018b20 con 0x55ec281f72f0 2024-09-19T04:17:17.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.282+0000 7f3fedffb640 1 -- 172.21.15.7:0/2476101006 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8010bc0 con 0x55ec281f72f0 2024-09-19T04:17:17.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.282+0000 7f4010153740 1 -- 172.21.15.7:0/2476101006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec281f72f0 msgr2=0x55ec28201670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:17.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.282+0000 7f4010153740 1 --2- 172.21.15.7:0/2476101006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec281f72f0 0x55ec28201670 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3ff800ad00 tx=0x7f3ff800f790 comp rx=0 tx=0).stop 2024-09-19T04:17:17.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.282+0000 7f4010153740 1 -- 172.21.15.7:0/2476101006 shutdown_connections 2024-09-19T04:17:17.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.282+0000 7f4010153740 1 --2- 172.21.15.7:0/2476101006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec28201bb0 0x55ec28203fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.282+0000 7f4010153740 1 --2- 172.21.15.7:0/2476101006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec281f72f0 0x55ec28201670 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.282+0000 7f4010153740 1 --2- 172.21.15.7:0/2476101006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec281f69d0 0x55ec281f6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.282+0000 7f4010153740 1 -- 172.21.15.7:0/2476101006 >> 172.21.15.7:0/2476101006 conn(0x55ec281f2f60 msgr2=0x55ec281f3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:17.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.282+0000 7f4010153740 1 -- 172.21.15.7:0/2476101006 shutdown_connections 2024-09-19T04:17:17.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.282+0000 7f4010153740 1 -- 172.21.15.7:0/2476101006 wait complete. 2024-09-19T04:17:17.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.283+0000 7f4010153740 1 -- start start 2024-09-19T04:17:17.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.283+0000 7f4010153740 1 Processor -- start 2024-09-19T04:17:17.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.283+0000 7f4010153740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec281f69d0 0x55ec28201470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:17.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.283+0000 7f4010153740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec281f72f0 0x55ec281fe7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:17.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.283+0000 7f4010153740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec28201bb0 0x55ec281fed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:17.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.283+0000 7f4010153740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ec28204780 con 0x55ec281f69d0 2024-09-19T04:17:17.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.283+0000 7f4010153740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ec28117f20 con 0x55ec28201bb0 2024-09-19T04:17:17.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.283+0000 7f4010153740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ec28204900 con 0x55ec281f72f0 2024-09-19T04:17:17.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.283+0000 7f4010153740 10 client.0 _ll_register_callbacks cb 0x55ec280e1030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:17:17.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.283+0000 7f40077fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec281f69d0 0x55ec28201470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:17.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.283+0000 7f40077fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec281f69d0 0x55ec28201470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41104/0 (socket says 172.21.15.7:41104) 2024-09-19T04:17:17.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.283+0000 7f40077fe640 1 -- 172.21.15.7:0/293858770 learned_addr learned my addr 172.21.15.7:0/293858770 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:17.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.283+0000 7f4006ffd640 1 --2- 172.21.15.7:0/293858770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec281f72f0 0x55ec281fe7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:17.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.284+0000 7f40077fe640 1 -- 172.21.15.7:0/293858770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec281f72f0 msgr2=0x55ec281fe7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:17.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.284+0000 7f40077fe640 1 --2- 172.21.15.7:0/293858770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec281f72f0 0x55ec281fe7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.284+0000 7f4007fff640 1 --2- 172.21.15.7:0/293858770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec28201bb0 0x55ec281fed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:17.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.284+0000 7f40077fe640 1 -- 172.21.15.7:0/293858770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec28201bb0 msgr2=0x55ec281fed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:17.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.284+0000 7f40077fe640 1 --2- 172.21.15.7:0/293858770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec28201bb0 0x55ec281fed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.284+0000 7f40077fe640 1 -- 172.21.15.7:0/293858770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec27ece2b0 con 0x55ec281f69d0 2024-09-19T04:17:17.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.284+0000 7f4007fff640 1 --2- 172.21.15.7:0/293858770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec28201bb0 0x55ec281fed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:17:17.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.284+0000 7f40077fe640 1 --2- 172.21.15.7:0/293858770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec281f69d0 0x55ec28201470 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3ff800a550 tx=0x7f3ff8018650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ede7d02868e6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:17.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.284+0000 7f3fe6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:17:17.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.284+0000 7f3fe6ffd640 1 -- 172.21.15.7:0/293858770 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff801d040 con 0x55ec281f69d0 2024-09-19T04:17:17.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.284+0000 7f3fe6ffd640 1 -- 172.21.15.7:0/293858770 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f3ff80108e0 con 0x55ec281f69d0 2024-09-19T04:17:17.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.284+0000 7f4010153740 1 -- 172.21.15.7:0/293858770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ff8018b20 con 0x55ec281f69d0 2024-09-19T04:17:17.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.284+0000 7f3fe6ffd640 1 -- 172.21.15.7:0/293858770 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3ff8031050 con 0x55ec281f69d0 2024-09-19T04:17:17.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.284+0000 7f4010153740 10 client.15447 fetch_fsmap learned FSMap version 28 2024-09-19T04:17:17.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.284+0000 7f4010153740 1 -- 172.21.15.7:0/293858770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ec282100d0 con 0x55ec281f69d0 2024-09-19T04:17:17.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.284+0000 7f3fe6ffd640 1 -- 172.21.15.7:0/293858770 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ff8018b20 con 0x55ec281f69d0 2024-09-19T04:17:17.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.285+0000 7f3fe6ffd640 1 -- 172.21.15.7:0/293858770 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f3ff8020030 con 0x55ec281f69d0 2024-09-19T04:17:17.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.285+0000 7f4010153740 10 client.15447 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:17:17.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.285+0000 7f4010153740 10 client.15447 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T04:17:17.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.285+0000 7f4010153740 20 client.15447 populate_metadata read hostname 'smithi007' 2024-09-19T04:17:17.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.285+0000 7f4010153740 1 --2- 172.21.15.7:0/293858770 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55ec282123a0 0x55ec28213810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:17.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.285+0000 7f4010153740 4 client.15447 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:17:17.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.285+0000 7f4010153740 1 -- 172.21.15.7:0/293858770 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec2816a600 con 0x55ec282123a0 2024-09-19T04:17:17.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.285+0000 7f4006ffd640 1 --2- 172.21.15.7:0/293858770 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55ec282123a0 0x55ec28213810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:17.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.286+0000 7f4006ffd640 1 --2- 172.21.15.7:0/293858770 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55ec282123a0 0x55ec28213810 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d7d83c820bc1b6 server_cookie=2e48e0872bf6aecc in_seq=0 out_seq=0 2024-09-19T04:17:17.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.286+0000 7f3fe6ffd640 10 client.15447 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:17:17.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.286+0000 7f3fe6ffd640 1 -- 172.21.15.7:0/293858770 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec2816a600 con 0x55ec282123a0 2024-09-19T04:17:17.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.286+0000 7f3fe6ffd640 10 client.15447 handle_command_reply: tid=0 2024-09-19T04:17:17.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.286+0000 7f4010153740 1 client.15447 shutdown 2024-09-19T04:17:17.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.286+0000 7f4010153740 1 -- 172.21.15.7:0/293858770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec281f69d0 msgr2=0x55ec28201470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:17.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.286+0000 7f4010153740 1 --2- 172.21.15.7:0/293858770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec281f69d0 0x55ec28201470 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3ff800a550 tx=0x7f3ff8018650 comp rx=0 tx=0).stop 2024-09-19T04:17:17.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.287+0000 7f4010153740 1 -- 172.21.15.7:0/293858770 shutdown_connections 2024-09-19T04:17:17.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.287+0000 7f4010153740 1 --2- 172.21.15.7:0/293858770 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55ec282123a0 0x55ec28213810 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.287+0000 7f4010153740 1 --2- 172.21.15.7:0/293858770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec28201bb0 0x55ec281fed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.287+0000 7f4010153740 1 --2- 172.21.15.7:0/293858770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec281f72f0 0x55ec281fe7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.287+0000 7f3fe6ffd640 0 client.15447 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:17:17.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.287+0000 7f4010153740 1 --2- 172.21.15.7:0/293858770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec281f69d0 0x55ec28201470 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.287+0000 7f4010153740 1 -- 172.21.15.7:0/293858770 >> 172.21.15.7:0/293858770 conn(0x55ec281f2f60 msgr2=0x55ec281f8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:17.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.287+0000 7f4010153740 1 -- 172.21.15.7:0/293858770 shutdown_connections 2024-09-19T04:17:17.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.287+0000 7f4010153740 1 -- 172.21.15.7:0/293858770 wait complete. 2024-09-19T04:17:17.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.287+0000 7f4010153740 20 client.15447 trim_cache size 0 max 16384 2024-09-19T04:17:17.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.307+0000 7f4010153740 1 Processor -- start 2024-09-19T04:17:17.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.307+0000 7f4010153740 1 -- start start 2024-09-19T04:17:17.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.307+0000 7f4010153740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec281f69d0 0x55ec28212a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:17.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.307+0000 7f4010153740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec281f72f0 0x55ec281fd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:17.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.307+0000 7f4010153740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec28201bb0 0x55ec2821bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:17.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.307+0000 7f4010153740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ec28211b50 con 0x55ec281f69d0 2024-09-19T04:17:17.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.307+0000 7f4010153740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ec28212220 con 0x55ec281f72f0 2024-09-19T04:17:17.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.307+0000 7f4010153740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ec282128f0 con 0x55ec28201bb0 2024-09-19T04:17:17.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.307+0000 7f40077fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec281f69d0 0x55ec28212a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:17.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.307+0000 7f40077fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec281f69d0 0x55ec28212a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41120/0 (socket says 172.21.15.7:41120) 2024-09-19T04:17:17.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.307+0000 7f40077fe640 1 -- 172.21.15.7:0/2162970566 learned_addr learned my addr 172.21.15.7:0/2162970566 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:17.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.307+0000 7f4007fff640 1 --2- 172.21.15.7:0/2162970566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec28201bb0 0x55ec2821bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:17.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.307+0000 7f4006ffd640 1 --2- 172.21.15.7:0/2162970566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec281f72f0 0x55ec281fd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:17.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.307+0000 7f40077fe640 1 -- 172.21.15.7:0/2162970566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec28201bb0 msgr2=0x55ec2821bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:17.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.307+0000 7f40077fe640 1 --2- 172.21.15.7:0/2162970566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec28201bb0 0x55ec2821bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.307+0000 7f40077fe640 1 -- 172.21.15.7:0/2162970566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec281f72f0 msgr2=0x55ec281fd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:17.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.307+0000 7f40077fe640 1 --2- 172.21.15.7:0/2162970566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec281f72f0 0x55ec281fd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.307+0000 7f40077fe640 1 -- 172.21.15.7:0/2162970566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec281fd770 con 0x55ec281f69d0 2024-09-19T04:17:17.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.307+0000 7f40077fe640 1 --2- 172.21.15.7:0/2162970566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec281f69d0 0x55ec28212a70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8000c00 tx=0x7f3ff800ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b9bd07fd6f18a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:17.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.308+0000 7f3fed7fa640 1 -- 172.21.15.7:0/2162970566 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff803a070 con 0x55ec281f69d0 2024-09-19T04:17:17.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.308+0000 7f3fed7fa640 1 -- 172.21.15.7:0/2162970566 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ff8028070 con 0x55ec281f69d0 2024-09-19T04:17:17.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.308+0000 7f3fed7fa640 1 -- 172.21.15.7:0/2162970566 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff801d030 con 0x55ec281f69d0 2024-09-19T04:17:17.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.308+0000 7f4010153740 1 -- 172.21.15.7:0/2162970566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec281f69d0 msgr2=0x55ec28212a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:17.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.308+0000 7f4010153740 1 --2- 172.21.15.7:0/2162970566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec281f69d0 0x55ec28212a70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8000c00 tx=0x7f3ff800ab80 comp rx=0 tx=0).stop 2024-09-19T04:17:17.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.308+0000 7f4010153740 1 -- 172.21.15.7:0/2162970566 shutdown_connections 2024-09-19T04:17:17.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.308+0000 7f4010153740 1 --2- 172.21.15.7:0/2162970566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec28201bb0 0x55ec2821bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.308+0000 7f4010153740 1 --2- 172.21.15.7:0/2162970566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec281f72f0 0x55ec281fd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.308+0000 7f4010153740 1 --2- 172.21.15.7:0/2162970566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec281f69d0 0x55ec28212a70 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.308+0000 7f4010153740 1 -- 172.21.15.7:0/2162970566 >> 172.21.15.7:0/2162970566 conn(0x55ec281f2f60 msgr2=0x55ec281f9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:17.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.308+0000 7f4010153740 1 -- 172.21.15.7:0/2162970566 shutdown_connections 2024-09-19T04:17:17.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.308+0000 7f4010153740 1 -- 172.21.15.7:0/2162970566 wait complete. 2024-09-19T04:17:17.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.309+0000 7f4010153740 1 -- start start 2024-09-19T04:17:17.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.309+0000 7f4010153740 1 Processor -- start 2024-09-19T04:17:17.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.309+0000 7f4010153740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec281f69d0 0x55ec2821bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:17.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.309+0000 7f4010153740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec281f72f0 0x55ec282194b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:17.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.309+0000 7f4010153740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec28201bb0 0x55ec282199f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:17.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.309+0000 7f4010153740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ec28213690 con 0x55ec281f69d0 2024-09-19T04:17:17.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.309+0000 7f4010153740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ec28212fc0 con 0x55ec28201bb0 2024-09-19T04:17:17.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.309+0000 7f4010153740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ec28213d60 con 0x55ec281f72f0 2024-09-19T04:17:17.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.309+0000 7f4010153740 10 client.0 _ll_register_callbacks cb 0x7f3ff801b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:17:17.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.309+0000 7f40077fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec281f69d0 0x55ec2821bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:17.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.309+0000 7f40077fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec281f69d0 0x55ec2821bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41122/0 (socket says 172.21.15.7:41122) 2024-09-19T04:17:17.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.309+0000 7f40077fe640 1 -- 172.21.15.7:0/234386764 learned_addr learned my addr 172.21.15.7:0/234386764 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:17.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.309+0000 7f4006ffd640 1 --2- 172.21.15.7:0/234386764 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec281f72f0 0x55ec282194b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:17.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.309+0000 7f4007fff640 1 --2- 172.21.15.7:0/234386764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec28201bb0 0x55ec282199f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:17.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.310+0000 7f40077fe640 1 -- 172.21.15.7:0/234386764 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec281f72f0 msgr2=0x55ec282194b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:17.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.310+0000 7f40077fe640 1 --2- 172.21.15.7:0/234386764 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec281f72f0 0x55ec282194b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.310+0000 7f40077fe640 1 -- 172.21.15.7:0/234386764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec28201bb0 msgr2=0x55ec282199f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:17.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.310+0000 7f40077fe640 1 --2- 172.21.15.7:0/234386764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec28201bb0 0x55ec282199f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.310+0000 7f40077fe640 1 -- 172.21.15.7:0/234386764 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec28219fe0 con 0x55ec281f69d0 2024-09-19T04:17:17.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.310+0000 7f40077fe640 1 --2- 172.21.15.7:0/234386764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec281f69d0 0x55ec2821bfc0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8004880 tx=0x7f3ff800fdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=577f786405755941 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:17.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.310+0000 7f3fe6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:17:17.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.310+0000 7f3fe6ffd640 1 -- 172.21.15.7:0/234386764 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff803a070 con 0x55ec281f69d0 2024-09-19T04:17:17.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.310+0000 7f3fe6ffd640 1 -- 172.21.15.7:0/234386764 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f3ff8018850 con 0x55ec281f69d0 2024-09-19T04:17:17.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.310+0000 7f4010153740 1 -- 172.21.15.7:0/234386764 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ff8028070 con 0x55ec281f69d0 2024-09-19T04:17:17.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.310+0000 7f3fe6ffd640 1 -- 172.21.15.7:0/234386764 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3ff801d040 con 0x55ec281f69d0 2024-09-19T04:17:17.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.310+0000 7f4010153740 10 client.15453 fetch_fsmap learned FSMap version 28 2024-09-19T04:17:17.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.310+0000 7f4010153740 1 -- 172.21.15.7:0/234386764 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ec282808e0 con 0x55ec281f69d0 2024-09-19T04:17:17.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.311+0000 7f3fe6ffd640 1 -- 172.21.15.7:0/234386764 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ff8028070 con 0x55ec281f69d0 2024-09-19T04:17:17.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.311+0000 7f3fe6ffd640 1 -- 172.21.15.7:0/234386764 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f3ff8020040 con 0x55ec281f69d0 2024-09-19T04:17:17.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.311+0000 7f4010153740 10 client.15453 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:17:17.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.311+0000 7f4010153740 10 client.15453 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T04:17:17.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.311+0000 7f4010153740 20 client.15453 populate_metadata read hostname 'smithi007' 2024-09-19T04:17:17.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.311+0000 7f4010153740 1 --2- 172.21.15.7:0/234386764 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55ec282850a0 0x55ec28283db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:17.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.311+0000 7f4010153740 4 client.15453 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T04:17:17.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.311+0000 7f4010153740 1 -- 172.21.15.7:0/234386764 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "status"}) -- 0x55ec28164b10 con 0x55ec282850a0 2024-09-19T04:17:17.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.311+0000 7f4006ffd640 1 --2- 172.21.15.7:0/234386764 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55ec282850a0 0x55ec28283db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:17.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.312+0000 7f3fe6ffd640 10 client.15453 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:17:17.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.312+0000 7f4006ffd640 1 --2- 172.21.15.7:0/234386764 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55ec282850a0 0x55ec28283db0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b622922b56cd4b17 server_cookie=56d2c65cf4704d8a in_seq=0 out_seq=0 2024-09-19T04:17:17.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.312+0000 7f3fe6ffd640 1 -- 172.21.15.7:0/234386764 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55ec28164b10 con 0x55ec282850a0 2024-09-19T04:17:17.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.312+0000 7f3fe6ffd640 10 client.15453 handle_command_reply: tid=0 2024-09-19T04:17:17.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.312+0000 7f4010153740 1 client.15453 shutdown 2024-09-19T04:17:17.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.312+0000 7f4010153740 1 -- 172.21.15.7:0/234386764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec281f69d0 msgr2=0x55ec2821bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:17.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.312+0000 7f4010153740 1 --2- 172.21.15.7:0/234386764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec281f69d0 0x55ec2821bfc0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8004880 tx=0x7f3ff800fdb0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.312+0000 7f4010153740 1 -- 172.21.15.7:0/234386764 shutdown_connections 2024-09-19T04:17:17.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.312+0000 7f4010153740 1 --2- 172.21.15.7:0/234386764 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55ec282850a0 0x55ec28283db0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.312+0000 7f4010153740 1 --2- 172.21.15.7:0/234386764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ec28201bb0 0x55ec282199f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.312+0000 7f4010153740 1 --2- 172.21.15.7:0/234386764 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec281f72f0 0x55ec282194b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.312+0000 7f3fe6ffd640 0 client.15453 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:17:17.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.312+0000 7f4010153740 1 --2- 172.21.15.7:0/234386764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec281f69d0 0x55ec2821bfc0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.312+0000 7f4010153740 1 -- 172.21.15.7:0/234386764 >> 172.21.15.7:0/234386764 conn(0x55ec281f2f60 msgr2=0x55ec281f15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:17.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.312+0000 7f4010153740 1 -- 172.21.15.7:0/234386764 shutdown_connections 2024-09-19T04:17:17.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.312+0000 7f4010153740 1 -- 172.21.15.7:0/234386764 wait complete. 2024-09-19T04:17:17.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.312+0000 7f4010153740 20 client.15453 trim_cache size 0 max 16384 2024-09-19T04:17:17.323 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:17:17.323 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "77957c0a-763c-11ef-bceb-c7b262605968", 2024-09-19T04:17:17.323 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-09-19T04:17:17.324 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24506, 2024-09-19T04:17:17.324 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-19T04:17:17.324 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-19T04:17:17.324 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-19T04:17:17.324 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 162.993070445, 2024-09-19T04:17:17.324 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 28, 2024-09-19T04:17:17.324 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 90, 2024-09-19T04:17:17.324 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 90, 2024-09-19T04:17:17.324 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 174.512693528 2024-09-19T04:17:17.324 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:17:17.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.313+0000 7f400dd7a640 1 -- 172.21.15.7:0/3187062449 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3ff00a32d0 msgr2=0x7f3ff00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:17.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.313+0000 7f400dd7a640 1 --2- 172.21.15.7:0/3187062449 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3ff00a32d0 0x7f3ff00a5790 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4000009370 tx=0x7f4000009240 comp rx=0 tx=0).stop 2024-09-19T04:17:17.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.313+0000 7f400dd7a640 1 -- 172.21.15.7:0/3187062449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4008103740 msgr2=0x7f4008198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:17.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.313+0000 7f400dd7a640 1 --2- 172.21.15.7:0/3187062449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4008103740 0x7f4008198a90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc005940 tx=0x7f3ffc0042f0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.313+0000 7f400dd7a640 1 -- 172.21.15.7:0/3187062449 shutdown_connections 2024-09-19T04:17:17.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.313+0000 7f400dd7a640 1 --2- 172.21.15.7:0/3187062449 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f3ff00a32d0 0x7f3ff00a5790 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.313+0000 7f400dd7a640 1 --2- 172.21.15.7:0/3187062449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4008108290 0x7f400819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.313+0000 7f400dd7a640 1 --2- 172.21.15.7:0/3187062449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4008103740 0x7f4008198a90 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.313+0000 7f400dd7a640 1 --2- 172.21.15.7:0/3187062449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4008102d90 0x7f4008198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:17.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.313+0000 7f400dd7a640 1 -- 172.21.15.7:0/3187062449 >> 172.21.15.7:0/3187062449 conn(0x7f40080fc7d0 msgr2=0x7f4008106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:17.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.313+0000 7f400dd7a640 1 -- 172.21.15.7:0/3187062449 shutdown_connections 2024-09-19T04:17:17.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:17.313+0000 7f400dd7a640 1 -- 172.21.15.7:0/3187062449 wait complete. 2024-09-19T04:17:18.063 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-19T04:17:18.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:18 smithi007 ceph-mon[31360]: pgmap v366: 129 pgs: 129 active+clean; 663 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2024-09-19T04:17:18.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:18 smithi092 ceph-mon[34940]: pgmap v366: 129 pgs: 129 active+clean; 663 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2024-09-19T04:17:18.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:18 smithi102 ceph-mon[35446]: pgmap v366: 129 pgs: 129 active+clean; 663 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2024-09-19T04:17:20.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:20 smithi092 ceph-mon[34940]: pgmap v367: 129 pgs: 129 active+clean; 663 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.5 KiB/s wr, 17 op/s 2024-09-19T04:17:20.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:20 smithi007 ceph-mon[31360]: pgmap v367: 129 pgs: 129 active+clean; 663 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.5 KiB/s wr, 17 op/s 2024-09-19T04:17:20.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:20 smithi102 ceph-mon[35446]: pgmap v367: 129 pgs: 129 active+clean; 663 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.5 KiB/s wr, 17 op/s 2024-09-19T04:17:22.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:22 smithi092 ceph-mon[34940]: pgmap v368: 129 pgs: 129 active+clean; 663 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2024-09-19T04:17:22.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:22 smithi007 ceph-mon[31360]: pgmap v368: 129 pgs: 129 active+clean; 663 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2024-09-19T04:17:22.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:22 smithi102 ceph-mon[35446]: pgmap v368: 129 pgs: 129 active+clean; 663 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.5 KiB/s wr, 14 op/s 2024-09-19T04:17:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.775+0000 7f6979d8d640 1 -- 172.21.15.7:0/1525720617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6974102d60 msgr2=0x7f69741031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.775+0000 7f6979d8d640 1 --2- 172.21.15.7:0/1525720617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6974102d60 0x7f69741031e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f695c009900 tx=0x7f695c02a410 comp rx=0 tx=0).stop 2024-09-19T04:17:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.775+0000 7f6979d8d640 1 -- 172.21.15.7:0/1525720617 shutdown_connections 2024-09-19T04:17:23.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.775+0000 7f6979d8d640 1 --2- 172.21.15.7:0/1525720617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6974103720 0x7f6974109fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.775+0000 7f6979d8d640 1 --2- 172.21.15.7:0/1525720617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6974102d60 0x7f69741031e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.775+0000 7f6979d8d640 1 --2- 172.21.15.7:0/1525720617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6974101b70 0x7f6974101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.775+0000 7f6979d8d640 1 -- 172.21.15.7:0/1525720617 >> 172.21.15.7:0/1525720617 conn(0x7f69740fd2f0 msgr2=0x7f69740ff710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.775+0000 7f6979d8d640 1 -- 172.21.15.7:0/1525720617 shutdown_connections 2024-09-19T04:17:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.775+0000 7f6979d8d640 1 -- 172.21.15.7:0/1525720617 wait complete. 2024-09-19T04:17:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.776+0000 7f6979d8d640 1 Processor -- start 2024-09-19T04:17:23.778 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.776+0000 7f6979d8d640 1 -- start start 2024-09-19T04:17:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.776+0000 7f6979d8d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6974101b70 0x7f6974197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.776+0000 7f6979d8d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6974102d60 0x7f6974198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.776+0000 7f6979d8d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6974103720 0x7f697419f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.776+0000 7f6979d8d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f697410d7d0 con 0x7f6974103720 2024-09-19T04:17:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.776+0000 7f6979d8d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f697410d650 con 0x7f6974102d60 2024-09-19T04:17:23.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.776+0000 7f6979d8d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f697410d950 con 0x7f6974101b70 2024-09-19T04:17:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.777+0000 7f6973fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6974103720 0x7f697419f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.777+0000 7f6973fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6974103720 0x7f697419f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51796/0 (socket says 172.21.15.7:51796) 2024-09-19T04:17:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.777+0000 7f6973fff640 1 -- 172.21.15.7:0/3360856379 learned_addr learned my addr 172.21.15.7:0/3360856379 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.777+0000 7f69737fe640 1 --2- 172.21.15.7:0/3360856379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6974102d60 0x7f6974198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.777+0000 7f696b7fe640 1 --2- 172.21.15.7:0/3360856379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6974101b70 0x7f6974197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.777+0000 7f6973fff640 1 -- 172.21.15.7:0/3360856379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6974101b70 msgr2=0x7f6974197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.777+0000 7f6973fff640 1 --2- 172.21.15.7:0/3360856379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6974101b70 0x7f6974197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.777+0000 7f6973fff640 1 -- 172.21.15.7:0/3360856379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6974102d60 msgr2=0x7f6974198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.777+0000 7f6973fff640 1 --2- 172.21.15.7:0/3360856379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6974102d60 0x7f6974198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.777+0000 7f6973fff640 1 -- 172.21.15.7:0/3360856379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f697419fa40 con 0x7f6974103720 2024-09-19T04:17:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.777+0000 7f69737fe640 1 --2- 172.21.15.7:0/3360856379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6974102d60 0x7f6974198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:17:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.777+0000 7f6973fff640 1 --2- 172.21.15.7:0/3360856379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6974103720 0x7f697419f3d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f696c00cce0 tx=0x7f696c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:23.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.777+0000 7f69717fa640 1 -- 172.21.15.7:0/3360856379 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c00f450 con 0x7f6974103720 2024-09-19T04:17:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.777+0000 7f69717fa640 1 -- 172.21.15.7:0/3360856379 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f696c00fad0 con 0x7f6974103720 2024-09-19T04:17:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.777+0000 7f6979d8d640 1 -- 172.21.15.7:0/3360856379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f697419fd30 con 0x7f6974103720 2024-09-19T04:17:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.777+0000 7f69717fa640 1 -- 172.21.15.7:0/3360856379 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c018c10 con 0x7f6974103720 2024-09-19T04:17:23.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.777+0000 7f6979d8d640 1 -- 172.21.15.7:0/3360856379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69741a01f0 con 0x7f6974103720 2024-09-19T04:17:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.780+0000 7f69717fa640 1 -- 172.21.15.7:0/3360856379 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f696c00f5f0 con 0x7f6974103720 2024-09-19T04:17:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.780+0000 7f697cc02740 1 Processor -- start 2024-09-19T04:17:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.780+0000 7f697cc02740 1 -- start start 2024-09-19T04:17:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.780+0000 7f697cc02740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56465b5fddb0 0x56465b5fe1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.780+0000 7f697cc02740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56465b5fe6f0 0x56465b6031b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:23.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.780+0000 7f697cc02740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56465b603780 0x56465b605c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.780+0000 7f697cc02740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56465b55d2f0 con 0x56465b603780 2024-09-19T04:17:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.780+0000 7f697cc02740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56465b505270 con 0x56465b5fddb0 2024-09-19T04:17:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.780+0000 7f697cc02740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56465b5592b0 con 0x56465b5fe6f0 2024-09-19T04:17:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.781+0000 7f69737fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56465b603780 0x56465b605c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.781+0000 7f69737fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56465b603780 0x56465b605c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51800/0 (socket says 172.21.15.7:51800) 2024-09-19T04:17:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.781+0000 7f69737fe640 1 -- 172.21.15.7:0/651666954 learned_addr learned my addr 172.21.15.7:0/651666954 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.781+0000 7f696b7fe640 1 --2- 172.21.15.7:0/651666954 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56465b5fe6f0 0x56465b6031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.781+0000 7f69737fe640 1 --2- 172.21.15.7:0/651666954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56465b5fddb0 0x56465b5fe1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.781+0000 7f69717fa640 1 --2- 172.21.15.7:0/3360856379 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f69600a3350 0x7f69600a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.781+0000 7f696b7fe640 1 -- 172.21.15.7:0/651666954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56465b5fddb0 msgr2=0x56465b5fe1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.781+0000 7f696b7fe640 1 --2- 172.21.15.7:0/651666954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56465b5fddb0 0x56465b5fe1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.781+0000 7f696b7fe640 1 -- 172.21.15.7:0/651666954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56465b603780 msgr2=0x56465b605c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.781+0000 7f696b7fe640 1 --2- 172.21.15.7:0/651666954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56465b603780 0x56465b605c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.781+0000 7f696b7fe640 1 -- 172.21.15.7:0/651666954 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56465b504340 con 0x56465b5fe6f0 2024-09-19T04:17:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.781+0000 7f69737fe640 1 --2- 172.21.15.7:0/651666954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56465b603780 0x56465b605c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:17:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.781+0000 7f6973fff640 1 --2- 172.21.15.7:0/3360856379 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f69600a3350 0x7f69600a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.781+0000 7f69717fa640 1 -- 172.21.15.7:0/3360856379 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f696c0d04e0 con 0x7f6974103720 2024-09-19T04:17:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.781+0000 7f696b7fe640 1 --2- 172.21.15.7:0/651666954 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56465b5fe6f0 0x56465b6031b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6974102bc0 tx=0x7f696400f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5a59e5941eb607b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.782+0000 7f6969ffb640 1 -- 172.21.15.7:0/651666954 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6964011440 con 0x56465b5fe6f0 2024-09-19T04:17:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.782+0000 7f6973fff640 1 --2- 172.21.15.7:0/3360856379 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f69600a3350 0x7f69600a5810 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f696c09c2d0 tx=0x7f696c06b310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.782+0000 7f6969ffb640 1 -- 172.21.15.7:0/651666954 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6964011ac0 con 0x56465b5fe6f0 2024-09-19T04:17:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.782+0000 7f6969ffb640 1 -- 172.21.15.7:0/651666954 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696401b9d0 con 0x56465b5fe6f0 2024-09-19T04:17:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.782+0000 7f697cc02740 1 -- 172.21.15.7:0/651666954 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56465b5fe6f0 msgr2=0x56465b6031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:23.789 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.782+0000 7f697cc02740 1 --2- 172.21.15.7:0/651666954 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56465b5fe6f0 0x56465b6031b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6974102bc0 tx=0x7f696400f730 comp rx=0 tx=0).stop 2024-09-19T04:17:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.783+0000 7f697cc02740 1 -- 172.21.15.7:0/651666954 shutdown_connections 2024-09-19T04:17:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.783+0000 7f697cc02740 1 --2- 172.21.15.7:0/651666954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56465b603780 0x56465b605c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.783+0000 7f697cc02740 1 --2- 172.21.15.7:0/651666954 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56465b5fe6f0 0x56465b6031b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.783+0000 7f697cc02740 1 --2- 172.21.15.7:0/651666954 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56465b5fddb0 0x56465b5fe1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.783+0000 7f697cc02740 1 -- 172.21.15.7:0/651666954 >> 172.21.15.7:0/651666954 conn(0x56465b5f9420 msgr2=0x56465b5f9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.783+0000 7f697cc02740 1 -- 172.21.15.7:0/651666954 shutdown_connections 2024-09-19T04:17:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.783+0000 7f697cc02740 1 -- 172.21.15.7:0/651666954 wait complete. 2024-09-19T04:17:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.783+0000 7f697cc02740 1 -- start start 2024-09-19T04:17:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.783+0000 7f697cc02740 1 Processor -- start 2024-09-19T04:17:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.784+0000 7f697cc02740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56465b5fddb0 0x56465b608090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.784+0000 7f697cc02740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56465b5fe6f0 0x56465b6085d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:23.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.784+0000 7f697cc02740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56465b603780 0x56465b60f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.784+0000 7f697cc02740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56465b606750 con 0x56465b5fddb0 2024-09-19T04:17:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.784+0000 7f697cc02740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56465b4e6290 con 0x56465b5fe6f0 2024-09-19T04:17:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.784+0000 7f697cc02740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56465b6068d0 con 0x56465b603780 2024-09-19T04:17:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.784+0000 7f697cc02740 10 client.0 _ll_register_callbacks cb 0x56465b517140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:17:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.784+0000 7f69737fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56465b5fddb0 0x56465b608090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.784+0000 7f69737fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56465b5fddb0 0x56465b608090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51802/0 (socket says 172.21.15.7:51802) 2024-09-19T04:17:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.784+0000 7f69737fe640 1 -- 172.21.15.7:0/2496560094 learned_addr learned my addr 172.21.15.7:0/2496560094 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.784+0000 7f696b7fe640 1 --2- 172.21.15.7:0/2496560094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56465b5fe6f0 0x56465b6085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.784+0000 7f69737fe640 1 --2- 172.21.15.7:0/2496560094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56465b603780 0x56465b60f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.784+0000 7f69737fe640 1 -- 172.21.15.7:0/2496560094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56465b603780 msgr2=0x56465b60f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.784+0000 7f69737fe640 1 --2- 172.21.15.7:0/2496560094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56465b603780 0x56465b60f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.784+0000 7f69737fe640 1 -- 172.21.15.7:0/2496560094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56465b5fe6f0 msgr2=0x56465b6085d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.784+0000 7f69737fe640 1 --2- 172.21.15.7:0/2496560094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56465b5fe6f0 0x56465b6085d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.784+0000 7f69737fe640 1 -- 172.21.15.7:0/2496560094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56465b270210 con 0x56465b5fddb0 2024-09-19T04:17:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.784+0000 7f69737fe640 1 --2- 172.21.15.7:0/2496560094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56465b5fddb0 0x56465b608090 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f695c0314e0 tx=0x7f695c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c757bbcf8493321 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.784+0000 7f6952ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:17:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.784+0000 7f6952ffd640 1 -- 172.21.15.7:0/2496560094 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695c035040 con 0x56465b5fddb0 2024-09-19T04:17:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.784+0000 7f6952ffd640 1 -- 172.21.15.7:0/2496560094 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f695c0035f0 con 0x56465b5fddb0 2024-09-19T04:17:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.784+0000 7f697cc02740 1 -- 172.21.15.7:0/2496560094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6964011ac0 con 0x56465b5fddb0 2024-09-19T04:17:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.785+0000 7f6952ffd640 1 -- 172.21.15.7:0/2496560094 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f695c052050 con 0x56465b5fddb0 2024-09-19T04:17:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.785+0000 7f697cc02740 10 client.15465 fetch_fsmap learned FSMap version 28 2024-09-19T04:17:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.785+0000 7f697cc02740 1 -- 172.21.15.7:0/2496560094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56465b33c620 con 0x56465b5fddb0 2024-09-19T04:17:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.785+0000 7f6952ffd640 1 -- 172.21.15.7:0/2496560094 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6964011ac0 con 0x56465b5fddb0 2024-09-19T04:17:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.785+0000 7f6952ffd640 1 -- 172.21.15.7:0/2496560094 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f695c03a040 con 0x56465b5fddb0 2024-09-19T04:17:23.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.785+0000 7f697cc02740 10 client.15465 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:17:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.785+0000 7f697cc02740 10 client.15465 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:17:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.785+0000 7f697cc02740 20 client.15465 populate_metadata read hostname 'smithi007' 2024-09-19T04:17:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.785+0000 7f697cc02740 1 --2- 172.21.15.7:0/2496560094 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x56465b613c90 0x56465b616080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.785+0000 7f697cc02740 4 client.15465 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:17:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.785+0000 7f697cc02740 1 -- 172.21.15.7:0/2496560094 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56465b56aa20 con 0x56465b613c90 2024-09-19T04:17:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.785+0000 7f696b7fe640 1 --2- 172.21.15.7:0/2496560094 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x56465b613c90 0x56465b616080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.786+0000 7f6952ffd640 10 client.15465 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:17:23.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.786+0000 7f696b7fe640 1 --2- 172.21.15.7:0/2496560094 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x56465b613c90 0x56465b616080 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cc0dc414076f7a5 server_cookie=2575a5e387e607fc in_seq=0 out_seq=0 2024-09-19T04:17:23.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.786+0000 7f6952ffd640 1 -- 172.21.15.7:0/2496560094 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56465b56aa20 con 0x56465b613c90 2024-09-19T04:17:23.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.786+0000 7f6952ffd640 10 client.15465 handle_command_reply: tid=0 2024-09-19T04:17:23.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.787+0000 7f697cc02740 1 client.15465 shutdown 2024-09-19T04:17:23.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.787+0000 7f697cc02740 1 -- 172.21.15.7:0/2496560094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56465b5fddb0 msgr2=0x56465b608090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.787+0000 7f697cc02740 1 --2- 172.21.15.7:0/2496560094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56465b5fddb0 0x56465b608090 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f695c0314e0 tx=0x7f695c02a410 comp rx=0 tx=0).stop 2024-09-19T04:17:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.787+0000 7f697cc02740 1 -- 172.21.15.7:0/2496560094 shutdown_connections 2024-09-19T04:17:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.787+0000 7f697cc02740 1 --2- 172.21.15.7:0/2496560094 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x56465b613c90 0x56465b616080 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.787+0000 7f697cc02740 1 --2- 172.21.15.7:0/2496560094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56465b603780 0x56465b60f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.787+0000 7f6952ffd640 0 client.15465 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:17:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.787+0000 7f697cc02740 1 --2- 172.21.15.7:0/2496560094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56465b5fe6f0 0x56465b6085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.787+0000 7f697cc02740 1 --2- 172.21.15.7:0/2496560094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56465b5fddb0 0x56465b608090 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.787+0000 7f697cc02740 1 -- 172.21.15.7:0/2496560094 >> 172.21.15.7:0/2496560094 conn(0x56465b5f9420 msgr2=0x56465b5f41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.787+0000 7f697cc02740 1 -- 172.21.15.7:0/2496560094 shutdown_connections 2024-09-19T04:17:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.787+0000 7f697cc02740 1 -- 172.21.15.7:0/2496560094 wait complete. 2024-09-19T04:17:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.787+0000 7f697cc02740 20 client.15465 trim_cache size 0 max 16384 2024-09-19T04:17:23.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.802+0000 7f697cc02740 1 Processor -- start 2024-09-19T04:17:23.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.802+0000 7f697cc02740 1 -- start start 2024-09-19T04:17:23.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.802+0000 7f697cc02740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56465b5fddb0 0x56465b5f40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:23.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.802+0000 7f697cc02740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56465b5fe6f0 0x56465b60f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:23.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.802+0000 7f697cc02740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56465b603780 0x56465b61a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:23.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.802+0000 7f697cc02740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f69741a8600 con 0x56465b603780 2024-09-19T04:17:23.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.802+0000 7f697cc02740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f69741aa140 con 0x56465b5fe6f0 2024-09-19T04:17:23.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.802+0000 7f697cc02740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f69741a8cd0 con 0x56465b5fddb0 2024-09-19T04:17:23.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.802+0000 7f69737fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56465b603780 0x56465b61a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:23.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.802+0000 7f69737fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56465b603780 0x56465b61a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51810/0 (socket says 172.21.15.7:51810) 2024-09-19T04:17:23.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.802+0000 7f69737fe640 1 -- 172.21.15.7:0/1536618606 learned_addr learned my addr 172.21.15.7:0/1536618606 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:23.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.802+0000 7f69737fe640 1 --2- 172.21.15.7:0/1536618606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56465b5fddb0 0x56465b5f40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.802+0000 7f696b7fe640 1 --2- 172.21.15.7:0/1536618606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56465b5fe6f0 0x56465b60f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.802+0000 7f69737fe640 1 -- 172.21.15.7:0/1536618606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56465b5fddb0 msgr2=0x56465b5f40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.802+0000 7f69737fe640 1 --2- 172.21.15.7:0/1536618606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56465b5fddb0 0x56465b5f40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.802+0000 7f69737fe640 1 -- 172.21.15.7:0/1536618606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56465b5fe6f0 msgr2=0x56465b60f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.802+0000 7f69737fe640 1 --2- 172.21.15.7:0/1536618606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56465b5fe6f0 0x56465b60f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.802+0000 7f69737fe640 1 -- 172.21.15.7:0/1536618606 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56465b612660 con 0x56465b603780 2024-09-19T04:17:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.803+0000 7f69737fe640 1 --2- 172.21.15.7:0/1536618606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56465b603780 0x56465b61a980 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f695c03d840 tx=0x7f695c031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7766428dd79fa9c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.803+0000 7f69697fa640 1 -- 172.21.15.7:0/1536618606 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695c035040 con 0x56465b603780 2024-09-19T04:17:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.803+0000 7f69697fa640 1 -- 172.21.15.7:0/1536618606 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f695c03d480 con 0x56465b603780 2024-09-19T04:17:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.803+0000 7f69697fa640 1 -- 172.21.15.7:0/1536618606 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695c031da0 con 0x56465b603780 2024-09-19T04:17:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.803+0000 7f697cc02740 1 -- 172.21.15.7:0/1536618606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56465b603780 msgr2=0x56465b61a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.803+0000 7f697cc02740 1 --2- 172.21.15.7:0/1536618606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56465b603780 0x56465b61a980 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f695c03d840 tx=0x7f695c031400 comp rx=0 tx=0).stop 2024-09-19T04:17:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.803+0000 7f697cc02740 1 -- 172.21.15.7:0/1536618606 shutdown_connections 2024-09-19T04:17:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.803+0000 7f697cc02740 1 --2- 172.21.15.7:0/1536618606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56465b603780 0x56465b61a980 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.803+0000 7f697cc02740 1 --2- 172.21.15.7:0/1536618606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56465b5fe6f0 0x56465b60f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.803+0000 7f697cc02740 1 --2- 172.21.15.7:0/1536618606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56465b5fddb0 0x56465b5f40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.803+0000 7f697cc02740 1 -- 172.21.15.7:0/1536618606 >> 172.21.15.7:0/1536618606 conn(0x56465b5f9420 msgr2=0x56465b5f39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.803+0000 7f697cc02740 1 -- 172.21.15.7:0/1536618606 shutdown_connections 2024-09-19T04:17:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.803+0000 7f697cc02740 1 -- 172.21.15.7:0/1536618606 wait complete. 2024-09-19T04:17:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.804+0000 7f697cc02740 1 -- start start 2024-09-19T04:17:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.804+0000 7f697cc02740 1 Processor -- start 2024-09-19T04:17:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.804+0000 7f697cc02740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56465b5fddb0 0x56465b60d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.804+0000 7f697cc02740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56465b5fe6f0 0x56465b60d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.804+0000 7f697cc02740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56465b603780 0x56465b60e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.804+0000 7f697cc02740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f69741a9a70 con 0x56465b603780 2024-09-19T04:17:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.804+0000 7f697cc02740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f69741a93a0 con 0x56465b5fe6f0 2024-09-19T04:17:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.804+0000 7f697cc02740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f69741a65c0 con 0x56465b5fddb0 2024-09-19T04:17:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.804+0000 7f697cc02740 10 client.0 _ll_register_callbacks cb 0x7f695c031980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:17:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.804+0000 7f69737fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56465b603780 0x56465b60e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.804+0000 7f69737fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56465b603780 0x56465b60e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51818/0 (socket says 172.21.15.7:51818) 2024-09-19T04:17:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.804+0000 7f69737fe640 1 -- 172.21.15.7:0/690329239 learned_addr learned my addr 172.21.15.7:0/690329239 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.804+0000 7f696b7fe640 1 --2- 172.21.15.7:0/690329239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56465b5fe6f0 0x56465b60d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.805+0000 7f69737fe640 1 --2- 172.21.15.7:0/690329239 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56465b5fddb0 0x56465b60d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.805+0000 7f69737fe640 1 -- 172.21.15.7:0/690329239 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56465b5fddb0 msgr2=0x56465b60d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.805+0000 7f69737fe640 1 --2- 172.21.15.7:0/690329239 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56465b5fddb0 0x56465b60d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.805+0000 7f69737fe640 1 -- 172.21.15.7:0/690329239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56465b5fe6f0 msgr2=0x56465b60d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.805+0000 7f69737fe640 1 --2- 172.21.15.7:0/690329239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56465b5fe6f0 0x56465b60d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.805+0000 7f69737fe640 1 -- 172.21.15.7:0/690329239 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56465b60ed40 con 0x56465b603780 2024-09-19T04:17:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.805+0000 7f69737fe640 1 --2- 172.21.15.7:0/690329239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56465b603780 0x56465b60e730 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x56465b60c7d0 tx=0x7f695c04e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941ad14f08de514c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.805+0000 7f6952ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:17:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.805+0000 7f6952ffd640 1 -- 172.21.15.7:0/690329239 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695c035030 con 0x56465b603780 2024-09-19T04:17:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.805+0000 7f6952ffd640 1 -- 172.21.15.7:0/690329239 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f695c031a30 con 0x56465b603780 2024-09-19T04:17:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.805+0000 7f697cc02740 1 -- 172.21.15.7:0/690329239 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f695c03d480 con 0x56465b603780 2024-09-19T04:17:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.805+0000 7f6952ffd640 1 -- 172.21.15.7:0/690329239 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f695c03da30 con 0x56465b603780 2024-09-19T04:17:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.805+0000 7f697cc02740 10 client.15471 fetch_fsmap learned FSMap version 28 2024-09-19T04:17:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.805+0000 7f697cc02740 1 -- 172.21.15.7:0/690329239 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56465b67ef10 con 0x56465b603780 2024-09-19T04:17:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.806+0000 7f6952ffd640 1 -- 172.21.15.7:0/690329239 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f695c03d480 con 0x56465b603780 2024-09-19T04:17:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.806+0000 7f6952ffd640 1 -- 172.21.15.7:0/690329239 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f695c05f030 con 0x56465b603780 2024-09-19T04:17:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.806+0000 7f697cc02740 10 client.15471 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:17:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.806+0000 7f697cc02740 10 client.15471 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:17:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.806+0000 7f697cc02740 20 client.15471 populate_metadata read hostname 'smithi007' 2024-09-19T04:17:23.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.806+0000 7f697cc02740 1 --2- 172.21.15.7:0/690329239 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x56465b67f8c0 0x56465b681ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:23.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.806+0000 7f697cc02740 4 client.15471 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:17:23.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.806+0000 7f697cc02740 1 -- 172.21.15.7:0/690329239 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56465b564d70 con 0x56465b67f8c0 2024-09-19T04:17:23.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.806+0000 7f696b7fe640 1 --2- 172.21.15.7:0/690329239 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x56465b67f8c0 0x56465b681ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:23.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.806+0000 7f696b7fe640 1 --2- 172.21.15.7:0/690329239 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x56465b67f8c0 0x56465b681ce0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e726db8db3989ea4 server_cookie=aed4a1df584ee9a1 in_seq=0 out_seq=0 2024-09-19T04:17:23.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.806+0000 7f6952ffd640 10 client.15471 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:17:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.810+0000 7f6952ffd640 1 -- 172.21.15.7:0/690329239 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56465b564d70 con 0x56465b67f8c0 2024-09-19T04:17:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.810+0000 7f6952ffd640 10 client.15471 handle_command_reply: tid=0 2024-09-19T04:17:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.810+0000 7f697cc02740 1 client.15471 shutdown 2024-09-19T04:17:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.810+0000 7f697cc02740 1 -- 172.21.15.7:0/690329239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56465b603780 msgr2=0x56465b60e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.810+0000 7f697cc02740 1 --2- 172.21.15.7:0/690329239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56465b603780 0x56465b60e730 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x56465b60c7d0 tx=0x7f695c04e040 comp rx=0 tx=0).stop 2024-09-19T04:17:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.810+0000 7f697cc02740 1 -- 172.21.15.7:0/690329239 shutdown_connections 2024-09-19T04:17:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.810+0000 7f697cc02740 1 --2- 172.21.15.7:0/690329239 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x56465b67f8c0 0x56465b681ce0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.810+0000 7f697cc02740 1 --2- 172.21.15.7:0/690329239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56465b603780 0x56465b60e730 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.810+0000 7f697cc02740 1 --2- 172.21.15.7:0/690329239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56465b5fe6f0 0x56465b60d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.810+0000 7f6952ffd640 0 client.15471 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:17:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.810+0000 7f697cc02740 1 --2- 172.21.15.7:0/690329239 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56465b5fddb0 0x56465b60d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.810+0000 7f697cc02740 1 -- 172.21.15.7:0/690329239 >> 172.21.15.7:0/690329239 conn(0x56465b5f9420 msgr2=0x56465b5f41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.810+0000 7f697cc02740 1 -- 172.21.15.7:0/690329239 shutdown_connections 2024-09-19T04:17:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.810+0000 7f697cc02740 1 -- 172.21.15.7:0/690329239 wait complete. 2024-09-19T04:17:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.810+0000 7f697cc02740 20 client.15471 trim_cache size 0 max 16384 2024-09-19T04:17:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:17:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:17:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:17:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:17:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.811+0000 7f6979d8d640 1 -- 172.21.15.7:0/3360856379 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f69600a3350 msgr2=0x7f69600a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.811+0000 7f6979d8d640 1 --2- 172.21.15.7:0/3360856379 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f69600a3350 0x7f69600a5810 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f696c09c2d0 tx=0x7f696c06b310 comp rx=0 tx=0).stop 2024-09-19T04:17:23.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.811+0000 7f6979d8d640 1 -- 172.21.15.7:0/3360856379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6974103720 msgr2=0x7f697419f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:23.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.811+0000 7f6979d8d640 1 --2- 172.21.15.7:0/3360856379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6974103720 0x7f697419f3d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f696c00cce0 tx=0x7f696c00a620 comp rx=0 tx=0).stop 2024-09-19T04:17:23.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.811+0000 7f6979d8d640 1 -- 172.21.15.7:0/3360856379 shutdown_connections 2024-09-19T04:17:23.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.811+0000 7f6979d8d640 1 --2- 172.21.15.7:0/3360856379 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f69600a3350 0x7f69600a5810 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.811+0000 7f6979d8d640 1 --2- 172.21.15.7:0/3360856379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6974103720 0x7f697419f3d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.811+0000 7f6979d8d640 1 --2- 172.21.15.7:0/3360856379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6974102d60 0x7f6974198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.811+0000 7f6979d8d640 1 --2- 172.21.15.7:0/3360856379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6974101b70 0x7f6974197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:23.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.811+0000 7f6979d8d640 1 -- 172.21.15.7:0/3360856379 >> 172.21.15.7:0/3360856379 conn(0x7f69740fd2f0 msgr2=0x7f69741060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:23.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.811+0000 7f6979d8d640 1 -- 172.21.15.7:0/3360856379 shutdown_connections 2024-09-19T04:17:23.817 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:23.811+0000 7f6979d8d640 1 -- 172.21.15.7:0/3360856379 wait complete. 2024-09-19T04:17:24.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:24 smithi092 ceph-mon[34940]: pgmap v369: 129 pgs: 129 active+clean; 663 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.4 KiB/s wr, 16 op/s 2024-09-19T04:17:24.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:24 smithi007 ceph-mon[31360]: pgmap v369: 129 pgs: 129 active+clean; 663 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.4 KiB/s wr, 16 op/s 2024-09-19T04:17:24.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:24 smithi102 ceph-mon[35446]: pgmap v369: 129 pgs: 129 active+clean; 663 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.4 KiB/s wr, 16 op/s 2024-09-19T04:17:26.549 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:26 smithi092 ceph-mon[34940]: pgmap v370: 129 pgs: 129 active+clean; 663 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-19T04:17:26.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:26 smithi007 ceph-mon[31360]: pgmap v370: 129 pgs: 129 active+clean; 663 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-19T04:17:26.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:26 smithi102 ceph-mon[35446]: pgmap v370: 129 pgs: 129 active+clean; 663 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-19T04:17:28.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:28 smithi092 ceph-mon[34940]: pgmap v371: 129 pgs: 129 active+clean; 663 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T04:17:28.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:28 smithi007 ceph-mon[31360]: pgmap v371: 129 pgs: 129 active+clean; 663 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T04:17:28.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:28 smithi102 ceph-mon[35446]: pgmap v371: 129 pgs: 129 active+clean; 663 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T04:17:30.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:30 smithi092 ceph-mon[34940]: pgmap v372: 129 pgs: 129 active+clean; 664 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-19T04:17:30.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:30 smithi007 ceph-mon[31360]: pgmap v372: 129 pgs: 129 active+clean; 664 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-19T04:17:30.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:30 smithi102 ceph-mon[35446]: pgmap v372: 129 pgs: 129 active+clean; 664 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-19T04:17:32.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:32 smithi092 ceph-mon[34940]: pgmap v373: 129 pgs: 129 active+clean; 664 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T04:17:32.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:32 smithi007 ceph-mon[31360]: pgmap v373: 129 pgs: 129 active+clean; 664 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T04:17:32.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:32 smithi102 ceph-mon[35446]: pgmap v373: 129 pgs: 129 active+clean; 664 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T04:17:33.064 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 11.2 2024-09-19T04:17:33.065 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:17:33.357 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:17:33.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.873+0000 7f345f8e4640 1 -- 172.21.15.7:0/3412110025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3458103760 msgr2=0x7f3458107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:33.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.873+0000 7f345f8e4640 1 --2- 172.21.15.7:0/3412110025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3458103760 0x7f3458107ba0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3448009930 tx=0x7f344802a420 comp rx=0 tx=0).stop 2024-09-19T04:17:33.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.874+0000 7f345f8e4640 1 -- 172.21.15.7:0/3412110025 shutdown_connections 2024-09-19T04:17:33.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.874+0000 7f345f8e4640 1 --2- 172.21.15.7:0/3412110025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34581082e0 0x7f345810ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:33.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.874+0000 7f345f8e4640 1 --2- 172.21.15.7:0/3412110025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3458103760 0x7f3458107ba0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:33.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.874+0000 7f345f8e4640 1 --2- 172.21.15.7:0/3412110025 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3458102db0 0x7f3458103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:33.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.874+0000 7f345f8e4640 1 -- 172.21.15.7:0/3412110025 >> 172.21.15.7:0/3412110025 conn(0x7f34580fc7d0 msgr2=0x7f34580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:33.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.874+0000 7f345f8e4640 1 -- 172.21.15.7:0/3412110025 shutdown_connections 2024-09-19T04:17:33.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.874+0000 7f345f8e4640 1 -- 172.21.15.7:0/3412110025 wait complete. 2024-09-19T04:17:33.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.874+0000 7f345f8e4640 1 Processor -- start 2024-09-19T04:17:33.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.874+0000 7f345f8e4640 1 -- start start 2024-09-19T04:17:33.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.875+0000 7f345f8e4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3458102db0 0x7f34581985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:33.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.875+0000 7f345f8e4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3458103760 0x7f3458198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:33.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.875+0000 7f345f8e4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34581082e0 0x7f345819ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:33.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.875+0000 7f345f8e4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3458112050 con 0x7f3458102db0 2024-09-19T04:17:33.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.875+0000 7f345f8e4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3458111ed0 con 0x7f34581082e0 2024-09-19T04:17:33.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.875+0000 7f345f8e4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f34581121d0 con 0x7f3458103760 2024-09-19T04:17:33.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.875+0000 7f345d680640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3458102db0 0x7f34581985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:33.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.875+0000 7f345d680640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3458102db0 0x7f34581985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32910/0 (socket says 172.21.15.7:32910) 2024-09-19T04:17:33.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.875+0000 7f345d680640 1 -- 172.21.15.7:0/486519660 learned_addr learned my addr 172.21.15.7:0/486519660 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:33.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.875+0000 7f345ce7f640 1 --2- 172.21.15.7:0/486519660 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3458103760 0x7f3458198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:33.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.875+0000 7f345de81640 1 --2- 172.21.15.7:0/486519660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34581082e0 0x7f345819ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:33.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.875+0000 7f345d680640 1 -- 172.21.15.7:0/486519660 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3458103760 msgr2=0x7f3458198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:33.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.875+0000 7f345d680640 1 --2- 172.21.15.7:0/486519660 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3458103760 0x7f3458198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:33.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.875+0000 7f345d680640 1 -- 172.21.15.7:0/486519660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34581082e0 msgr2=0x7f345819ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:33.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.875+0000 7f345d680640 1 --2- 172.21.15.7:0/486519660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34581082e0 0x7f345819ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:33.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.875+0000 7f345d680640 1 -- 172.21.15.7:0/486519660 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345819d560 con 0x7f3458102db0 2024-09-19T04:17:33.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.875+0000 7f345d680640 1 --2- 172.21.15.7:0/486519660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3458102db0 0x7f34581985b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f345400d950 tx=0x7f345400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:33.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.876+0000 7f344e7fc640 1 -- 172.21.15.7:0/486519660 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3454017070 con 0x7f3458102db0 2024-09-19T04:17:33.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.876+0000 7f344e7fc640 1 -- 172.21.15.7:0/486519660 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3454009c30 con 0x7f3458102db0 2024-09-19T04:17:33.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.876+0000 7f345f8e4640 1 -- 172.21.15.7:0/486519660 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f345819d850 con 0x7f3458102db0 2024-09-19T04:17:33.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.876+0000 7f344e7fc640 1 -- 172.21.15.7:0/486519660 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345400f6b0 con 0x7f3458102db0 2024-09-19T04:17:33.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.876+0000 7f345f8e4640 1 -- 172.21.15.7:0/486519660 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34581a5130 con 0x7f3458102db0 2024-09-19T04:17:33.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.877+0000 7f345f8e4640 1 -- 172.21.15.7:0/486519660 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3458103190 con 0x7f3458102db0 2024-09-19T04:17:33.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.878+0000 7f344e7fc640 1 -- 172.21.15.7:0/486519660 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f34540109d0 con 0x7f3458102db0 2024-09-19T04:17:33.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.879+0000 7f344e7fc640 1 --2- 172.21.15.7:0/486519660 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f34440a3350 0x7f34440a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:33.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.879+0000 7f345ce7f640 1 --2- 172.21.15.7:0/486519660 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f34440a3350 0x7f34440a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:33.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.879+0000 7f344e7fc640 1 -- 172.21.15.7:0/486519660 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f34540cfb10 con 0x7f3458102db0 2024-09-19T04:17:33.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.880+0000 7f345ce7f640 1 --2- 172.21.15.7:0/486519660 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f34440a3350 0x7f34440a5810 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3448009900 tx=0x7f3448005c00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:33.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:33.883+0000 7f344e7fc640 1 -- 172.21.15.7:0/486519660 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3454009de0 con 0x7f3458102db0 2024-09-19T04:17:34.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:34.108+0000 7f345f8e4640 1 -- 172.21.15.7:0/486519660 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f345810a2c0 con 0x7f3458102db0 2024-09-19T04:17:34.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:34.109+0000 7f344e7fc640 1 -- 172.21.15.7:0/486519660 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11962 (secure 0 0 0) 0x7f345409c300 con 0x7f3458102db0 2024-09-19T04:17:34.111 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:17:34.111 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":28,"btime":"2024-09-19T04:16:57:081835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:16:56.259017+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24496,"mds_2":24482,"mds_3":24478,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24472,24478,24482,24496,24506]},"id":1}]} 2024-09-19T04:17:34.111 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 28 2024-09-19T04:17:34.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:34.112+0000 7f345f8e4640 1 -- 172.21.15.7:0/486519660 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f34440a3350 msgr2=0x7f34440a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:34.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:34.112+0000 7f345f8e4640 1 --2- 172.21.15.7:0/486519660 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f34440a3350 0x7f34440a5810 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3448009900 tx=0x7f3448005c00 comp rx=0 tx=0).stop 2024-09-19T04:17:34.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:34.112+0000 7f345f8e4640 1 -- 172.21.15.7:0/486519660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3458102db0 msgr2=0x7f34581985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:34.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:34.112+0000 7f345f8e4640 1 --2- 172.21.15.7:0/486519660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3458102db0 0x7f34581985b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f345400d950 tx=0x7f345400de10 comp rx=0 tx=0).stop 2024-09-19T04:17:34.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:34.112+0000 7f345f8e4640 1 -- 172.21.15.7:0/486519660 shutdown_connections 2024-09-19T04:17:34.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:34.112+0000 7f345f8e4640 1 --2- 172.21.15.7:0/486519660 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f34440a3350 0x7f34440a5810 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:34.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:34.112+0000 7f345f8e4640 1 --2- 172.21.15.7:0/486519660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34581082e0 0x7f345819ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:34.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:34.112+0000 7f345f8e4640 1 --2- 172.21.15.7:0/486519660 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3458103760 0x7f3458198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:34.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:34.112+0000 7f345f8e4640 1 --2- 172.21.15.7:0/486519660 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3458102db0 0x7f34581985b0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:34.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:34.112+0000 7f345f8e4640 1 -- 172.21.15.7:0/486519660 >> 172.21.15.7:0/486519660 conn(0x7f34580fc7d0 msgr2=0x7f3458105df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:34.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:34.112+0000 7f345f8e4640 1 -- 172.21.15.7:0/486519660 shutdown_connections 2024-09-19T04:17:34.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:34.113+0000 7f345f8e4640 1 -- 172.21.15.7:0/486519660 wait complete. 2024-09-19T04:17:34.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:34 smithi007 ceph-mon[31360]: pgmap v374: 129 pgs: 129 active+clean; 664 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-19T04:17:34.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:34 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/486519660' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:17:34.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:34 smithi092 ceph-mon[34940]: pgmap v374: 129 pgs: 129 active+clean; 664 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-19T04:17:34.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:34 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/486519660' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:17:34.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:34 smithi102 ceph-mon[35446]: pgmap v374: 129 pgs: 129 active+clean; 664 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-19T04:17:34.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:34 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/486519660' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:17:35.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:35 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:17:35.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:35 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:17:35.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:35 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:17:36.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:36 smithi092 ceph-mon[34940]: pgmap v375: 129 pgs: 129 active+clean; 664 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T04:17:36.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:36 smithi007 ceph-mon[31360]: pgmap v375: 129 pgs: 129 active+clean; 664 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T04:17:36.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:36 smithi102 ceph-mon[35446]: pgmap v375: 129 pgs: 129 active+clean; 664 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T04:17:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.903+0000 7fc0cbbe4640 1 -- 172.21.15.7:0/2363672273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0c4104ef0 msgr2=0x7fc0c41072e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.903+0000 7fc0cbbe4640 1 --2- 172.21.15.7:0/2363672273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0c4104ef0 0x7fc0c41072e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4009900 tx=0x7fc0b402a410 comp rx=0 tx=0).stop 2024-09-19T04:17:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.903+0000 7fc0cbbe4640 1 -- 172.21.15.7:0/2363672273 shutdown_connections 2024-09-19T04:17:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.903+0000 7fc0cbbe4640 1 --2- 172.21.15.7:0/2363672273 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0c4107820 0x7fc0c4109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.903+0000 7fc0cbbe4640 1 --2- 172.21.15.7:0/2363672273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0c4104ef0 0x7fc0c41072e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.903+0000 7fc0cbbe4640 1 --2- 172.21.15.7:0/2363672273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0c41025c0 0x7fc0c41049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.903+0000 7fc0cbbe4640 1 -- 172.21.15.7:0/2363672273 >> 172.21.15.7:0/2363672273 conn(0x7fc0c40fc1c0 msgr2=0x7fc0c40fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.903+0000 7fc0cbbe4640 1 -- 172.21.15.7:0/2363672273 shutdown_connections 2024-09-19T04:17:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.903+0000 7fc0cbbe4640 1 -- 172.21.15.7:0/2363672273 wait complete. 2024-09-19T04:17:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.904+0000 7fc0cbbe4640 1 Processor -- start 2024-09-19T04:17:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.904+0000 7fc0cbbe4640 1 -- start start 2024-09-19T04:17:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.904+0000 7fc0cbbe4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0c41025c0 0x7fc0c419a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.904+0000 7fc0cbbe4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0c4104ef0 0x7fc0c419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.904+0000 7fc0cbbe4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0c4107820 0x7fc0c41a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.904+0000 7fc0cbbe4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c410d7d0 con 0x7fc0c4107820 2024-09-19T04:17:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.904+0000 7fc0cbbe4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c410d650 con 0x7fc0c4104ef0 2024-09-19T04:17:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.904+0000 7fc0cbbe4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c410d950 con 0x7fc0c41025c0 2024-09-19T04:17:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.904+0000 7fc0ca181640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0c4107820 0x7fc0c41a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.904+0000 7fc0ca181640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0c4107820 0x7fc0c41a16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32926/0 (socket says 172.21.15.7:32926) 2024-09-19T04:17:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.904+0000 7fc0ca181640 1 -- 172.21.15.7:0/149361150 learned_addr learned my addr 172.21.15.7:0/149361150 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.904+0000 7fc0c9980640 1 --2- 172.21.15.7:0/149361150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0c41025c0 0x7fc0c419a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.904+0000 7fc0c917f640 1 --2- 172.21.15.7:0/149361150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0c4104ef0 0x7fc0c419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.905+0000 7fc0ca181640 1 -- 172.21.15.7:0/149361150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0c41025c0 msgr2=0x7fc0c419a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.905+0000 7fc0ca181640 1 --2- 172.21.15.7:0/149361150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0c41025c0 0x7fc0c419a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.905+0000 7fc0ca181640 1 -- 172.21.15.7:0/149361150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0c4104ef0 msgr2=0x7fc0c419a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.905+0000 7fc0ca181640 1 --2- 172.21.15.7:0/149361150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0c4104ef0 0x7fc0c419a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.905+0000 7fc0ca181640 1 -- 172.21.15.7:0/149361150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c41a1d10 con 0x7fc0c4107820 2024-09-19T04:17:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.905+0000 7fc0c9980640 1 --2- 172.21.15.7:0/149361150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0c41025c0 0x7fc0c419a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:17:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.905+0000 7fc0ca181640 1 --2- 172.21.15.7:0/149361150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0c4107820 0x7fc0c41a16a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc00e9d0 tx=0x7fc0bc00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.905+0000 7fc0baffd640 1 -- 172.21.15.7:0/149361150 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc00cd80 con 0x7fc0c4107820 2024-09-19T04:17:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.905+0000 7fc0baffd640 1 -- 172.21.15.7:0/149361150 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0bc005020 con 0x7fc0c4107820 2024-09-19T04:17:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.905+0000 7fc0cbbe4640 1 -- 172.21.15.7:0/149361150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0c41a1fa0 con 0x7fc0c4107820 2024-09-19T04:17:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.905+0000 7fc0baffd640 1 -- 172.21.15.7:0/149361150 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc0116d0 con 0x7fc0c4107820 2024-09-19T04:17:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.905+0000 7fc0cbbe4640 1 -- 172.21.15.7:0/149361150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0c41a24c0 con 0x7fc0c4107820 2024-09-19T04:17:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.908+0000 7fc0baffd640 1 -- 172.21.15.7:0/149361150 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7fc0bc0051d0 con 0x7fc0c4107820 2024-09-19T04:17:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.908+0000 7fc0cea5c740 1 Processor -- start 2024-09-19T04:17:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.908+0000 7fc0cea5c740 1 -- start start 2024-09-19T04:17:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.908+0000 7fc0cea5c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5652912599a0 0x565291259da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.908+0000 7fc0cea5c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56529125a2e0 0x56529125eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.908+0000 7fc0cea5c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56529125f370 0x565291261830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.908+0000 7fc0cea5c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5652911bd2f0 con 0x56529125f370 2024-09-19T04:17:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.908+0000 7fc0cea5c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x565291165270 con 0x5652912599a0 2024-09-19T04:17:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.908+0000 7fc0cea5c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5652911b92b0 con 0x56529125a2e0 2024-09-19T04:17:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.909+0000 7fc0c917f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56529125f370 0x565291261830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.909+0000 7fc0c917f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56529125f370 0x565291261830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32942/0 (socket says 172.21.15.7:32942) 2024-09-19T04:17:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.909+0000 7fc0c917f640 1 -- 172.21.15.7:0/2703721788 learned_addr learned my addr 172.21.15.7:0/2703721788 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.909+0000 7fc0c917f640 1 --2- 172.21.15.7:0/2703721788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5652912599a0 0x565291259da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.909+0000 7fc0c9980640 1 --2- 172.21.15.7:0/2703721788 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56529125a2e0 0x56529125eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.909+0000 7fc0baffd640 1 --2- 172.21.15.7:0/149361150 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc0b00a3350 0x7fc0b00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.909+0000 7fc0c917f640 1 -- 172.21.15.7:0/2703721788 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56529125a2e0 msgr2=0x56529125eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.909+0000 7fc0c917f640 1 --2- 172.21.15.7:0/2703721788 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56529125a2e0 0x56529125eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.909+0000 7fc0c917f640 1 -- 172.21.15.7:0/2703721788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5652912599a0 msgr2=0x565291259da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.909+0000 7fc0c917f640 1 --2- 172.21.15.7:0/2703721788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5652912599a0 0x565291259da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.909+0000 7fc0c917f640 1 -- 172.21.15.7:0/2703721788 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565291164340 con 0x56529125f370 2024-09-19T04:17:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.909+0000 7fc0baffd640 1 -- 172.21.15.7:0/149361150 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fc0bc0d03f0 con 0x7fc0c4107820 2024-09-19T04:17:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.909+0000 7fc0ca181640 1 --2- 172.21.15.7:0/149361150 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc0b00a3350 0x7fc0b00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.909+0000 7fc0c917f640 1 --2- 172.21.15.7:0/2703721788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56529125f370 0x565291261830 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4005940 tx=0x7fc0b4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d97472e3728632 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.909+0000 7fc0affff640 1 -- 172.21.15.7:0/2703721788 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4035040 con 0x56529125f370 2024-09-19T04:17:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.909+0000 7fc0affff640 1 -- 172.21.15.7:0/2703721788 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0b40035f0 con 0x56529125f370 2024-09-19T04:17:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.909+0000 7fc0affff640 1 -- 172.21.15.7:0/2703721788 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b403d6e0 con 0x56529125f370 2024-09-19T04:17:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.910+0000 7fc0cea5c740 1 -- 172.21.15.7:0/2703721788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56529125f370 msgr2=0x565291261830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.910+0000 7fc0ca181640 1 --2- 172.21.15.7:0/149361150 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc0b00a3350 0x7fc0b00a5810 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc00c880 tx=0x7fc0bc00c7f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.910+0000 7fc0cea5c740 1 --2- 172.21.15.7:0/2703721788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56529125f370 0x565291261830 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4005940 tx=0x7fc0b4000bc0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.910+0000 7fc0cea5c740 1 -- 172.21.15.7:0/2703721788 shutdown_connections 2024-09-19T04:17:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.910+0000 7fc0cea5c740 1 --2- 172.21.15.7:0/2703721788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56529125f370 0x565291261830 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.910+0000 7fc0cea5c740 1 --2- 172.21.15.7:0/2703721788 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56529125a2e0 0x56529125eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.910+0000 7fc0cea5c740 1 --2- 172.21.15.7:0/2703721788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5652912599a0 0x565291259da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.910+0000 7fc0cea5c740 1 -- 172.21.15.7:0/2703721788 >> 172.21.15.7:0/2703721788 conn(0x565291255010 msgr2=0x565291255410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.910+0000 7fc0cea5c740 1 -- 172.21.15.7:0/2703721788 shutdown_connections 2024-09-19T04:17:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.910+0000 7fc0cea5c740 1 -- 172.21.15.7:0/2703721788 wait complete. 2024-09-19T04:17:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.911+0000 7fc0cea5c740 1 -- start start 2024-09-19T04:17:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.911+0000 7fc0cea5c740 1 Processor -- start 2024-09-19T04:17:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.911+0000 7fc0cea5c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5652912599a0 0x565291263b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.911+0000 7fc0cea5c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56529125a2e0 0x5652912640d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.911+0000 7fc0cea5c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56529125f370 0x56529126b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.911+0000 7fc0cea5c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5652912622e0 con 0x56529125a2e0 2024-09-19T04:17:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.911+0000 7fc0cea5c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x565291146290 con 0x5652912599a0 2024-09-19T04:17:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.911+0000 7fc0cea5c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x565291262460 con 0x56529125f370 2024-09-19T04:17:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.911+0000 7fc0cea5c740 10 client.0 _ll_register_callbacks cb 0x565291177140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:17:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.911+0000 7fc0c9980640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56529125a2e0 0x5652912640d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.911+0000 7fc0c9980640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56529125a2e0 0x5652912640d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32952/0 (socket says 172.21.15.7:32952) 2024-09-19T04:17:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.911+0000 7fc0c9980640 1 -- 172.21.15.7:0/3035235123 learned_addr learned my addr 172.21.15.7:0/3035235123 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.911+0000 7fc0c917f640 1 --2- 172.21.15.7:0/3035235123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5652912599a0 0x565291263b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.912+0000 7fc0c917f640 1 --2- 172.21.15.7:0/3035235123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56529125f370 0x56529126b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:36.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.912+0000 7fc0c9980640 1 -- 172.21.15.7:0/3035235123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56529125f370 msgr2=0x56529126b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:36.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.912+0000 7fc0c9980640 1 --2- 172.21.15.7:0/3035235123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56529125f370 0x56529126b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.912+0000 7fc0c9980640 1 -- 172.21.15.7:0/3035235123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5652912599a0 msgr2=0x565291263b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:36.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.912+0000 7fc0c9980640 1 --2- 172.21.15.7:0/3035235123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5652912599a0 0x565291263b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.919 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.912+0000 7fc0c9980640 1 -- 172.21.15.7:0/3035235123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565290ed0210 con 0x56529125a2e0 2024-09-19T04:17:36.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.912+0000 7fc0c917f640 1 --2- 172.21.15.7:0/3035235123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56529125f370 0x56529126b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:17:36.920 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.912+0000 7fc0c9980640 1 --2- 172.21.15.7:0/3035235123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56529125a2e0 0x5652912640d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc0c000bad0 tx=0x7fc0c000bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3abf76af7514dcca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:36.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.912+0000 7fc0ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:17:36.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.912+0000 7fc0ad7fa640 1 -- 172.21.15.7:0/3035235123 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c001b640 con 0x56529125a2e0 2024-09-19T04:17:36.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.912+0000 7fc0ad7fa640 1 -- 172.21.15.7:0/3035235123 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fc0c001b7e0 con 0x56529125a2e0 2024-09-19T04:17:36.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.912+0000 7fc0cea5c740 1 -- 172.21.15.7:0/3035235123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0b40035f0 con 0x56529125a2e0 2024-09-19T04:17:36.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.912+0000 7fc0ad7fa640 1 -- 172.21.15.7:0/3035235123 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc0c0024050 con 0x56529125a2e0 2024-09-19T04:17:36.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.912+0000 7fc0cea5c740 10 client.15489 fetch_fsmap learned FSMap version 28 2024-09-19T04:17:36.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.912+0000 7fc0cea5c740 1 -- 172.21.15.7:0/3035235123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x565290f9c620 con 0x56529125a2e0 2024-09-19T04:17:36.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.912+0000 7fc0ad7fa640 1 -- 172.21.15.7:0/3035235123 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0b40035f0 con 0x56529125a2e0 2024-09-19T04:17:36.921 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.913+0000 7fc0ad7fa640 1 -- 172.21.15.7:0/3035235123 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc0c0019020 con 0x56529125a2e0 2024-09-19T04:17:36.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.913+0000 7fc0cea5c740 10 client.15489 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:17:36.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.913+0000 7fc0cea5c740 10 client.15489 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:17:36.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.913+0000 7fc0cea5c740 20 client.15489 populate_metadata read hostname 'smithi007' 2024-09-19T04:17:36.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.913+0000 7fc0cea5c740 1 --2- 172.21.15.7:0/3035235123 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x56529126f860 0x565291271c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:36.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.913+0000 7fc0cea5c740 4 client.15489 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:17:36.922 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.913+0000 7fc0cea5c740 1 -- 172.21.15.7:0/3035235123 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5652911caa20 con 0x56529126f860 2024-09-19T04:17:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.913+0000 7fc0c917f640 1 --2- 172.21.15.7:0/3035235123 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x56529126f860 0x565291271c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.914+0000 7fc0c917f640 1 --2- 172.21.15.7:0/3035235123 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x56529126f860 0x565291271c90 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=feae96e0f5b0976a server_cookie=9cbced53fc110299 in_seq=0 out_seq=0 2024-09-19T04:17:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.914+0000 7fc0ad7fa640 10 client.15489 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:17:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.914+0000 7fc0ad7fa640 1 -- 172.21.15.7:0/3035235123 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5652911caa20 con 0x56529126f860 2024-09-19T04:17:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.914+0000 7fc0ad7fa640 10 client.15489 handle_command_reply: tid=0 2024-09-19T04:17:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.914+0000 7fc0cea5c740 1 client.15489 shutdown 2024-09-19T04:17:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.914+0000 7fc0cea5c740 1 -- 172.21.15.7:0/3035235123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56529125a2e0 msgr2=0x5652912640d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.914+0000 7fc0cea5c740 1 --2- 172.21.15.7:0/3035235123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56529125a2e0 0x5652912640d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc0c000bad0 tx=0x7fc0c000bf90 comp rx=0 tx=0).stop 2024-09-19T04:17:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.915+0000 7fc0cea5c740 1 -- 172.21.15.7:0/3035235123 shutdown_connections 2024-09-19T04:17:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.915+0000 7fc0cea5c740 1 --2- 172.21.15.7:0/3035235123 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x56529126f860 0x565291271c90 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.915+0000 7fc0cea5c740 1 --2- 172.21.15.7:0/3035235123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56529125f370 0x56529126b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.915+0000 7fc0cea5c740 1 --2- 172.21.15.7:0/3035235123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56529125a2e0 0x5652912640d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.915+0000 7fc0ad7fa640 0 client.15489 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:17:36.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.915+0000 7fc0cea5c740 1 --2- 172.21.15.7:0/3035235123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5652912599a0 0x565291263b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.915+0000 7fc0cea5c740 1 -- 172.21.15.7:0/3035235123 >> 172.21.15.7:0/3035235123 conn(0x565291255010 msgr2=0x565291256820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:36.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.915+0000 7fc0cea5c740 1 -- 172.21.15.7:0/3035235123 shutdown_connections 2024-09-19T04:17:36.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.915+0000 7fc0cea5c740 1 -- 172.21.15.7:0/3035235123 wait complete. 2024-09-19T04:17:36.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.915+0000 7fc0cea5c740 20 client.15489 trim_cache size 0 max 16384 2024-09-19T04:17:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.930+0000 7fc0cea5c740 1 Processor -- start 2024-09-19T04:17:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.930+0000 7fc0cea5c740 1 -- start start 2024-09-19T04:17:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.930+0000 7fc0cea5c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5652912599a0 0x565291255e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.930+0000 7fc0cea5c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56529125a2e0 0x56529126b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.930+0000 7fc0cea5c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56529125f370 0x5652912563d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.930+0000 7fc0cea5c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c41acae0 con 0x56529125a2e0 2024-09-19T04:17:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.930+0000 7fc0cea5c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c41ae620 con 0x5652912599a0 2024-09-19T04:17:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.930+0000 7fc0cea5c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c41ad1b0 con 0x56529125f370 2024-09-19T04:17:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.930+0000 7fc0c9980640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56529125a2e0 0x56529126b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.931+0000 7fc0c9980640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56529125a2e0 0x56529126b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32968/0 (socket says 172.21.15.7:32968) 2024-09-19T04:17:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.931+0000 7fc0c9980640 1 -- 172.21.15.7:0/3033960168 learned_addr learned my addr 172.21.15.7:0/3033960168 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.931+0000 7fc0c917f640 1 --2- 172.21.15.7:0/3033960168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5652912599a0 0x565291255e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.931+0000 7fc0c917f640 1 --2- 172.21.15.7:0/3033960168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56529125f370 0x5652912563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.931+0000 7fc0c9980640 1 -- 172.21.15.7:0/3033960168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56529125f370 msgr2=0x5652912563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.931+0000 7fc0c9980640 1 --2- 172.21.15.7:0/3033960168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56529125f370 0x5652912563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.931+0000 7fc0c9980640 1 -- 172.21.15.7:0/3033960168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5652912599a0 msgr2=0x565291255e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.931+0000 7fc0c9980640 1 --2- 172.21.15.7:0/3033960168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5652912599a0 0x565291255e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.931+0000 7fc0c9980640 1 -- 172.21.15.7:0/3033960168 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565291261bf0 con 0x56529125a2e0 2024-09-19T04:17:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.931+0000 7fc0c9980640 1 --2- 172.21.15.7:0/3033960168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56529125a2e0 0x56529126b0d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0011d80 tx=0x7fc0c0004480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ecbcb2f100eb84 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.931+0000 7fc0af7fe640 1 -- 172.21.15.7:0/3033960168 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c000f3d0 con 0x56529125a2e0 2024-09-19T04:17:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.931+0000 7fc0af7fe640 1 -- 172.21.15.7:0/3033960168 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0c00039c0 con 0x56529125a2e0 2024-09-19T04:17:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.931+0000 7fc0af7fe640 1 -- 172.21.15.7:0/3033960168 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0004680 con 0x56529125a2e0 2024-09-19T04:17:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.932+0000 7fc0cea5c740 1 -- 172.21.15.7:0/3033960168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56529125a2e0 msgr2=0x56529126b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.932+0000 7fc0cea5c740 1 --2- 172.21.15.7:0/3033960168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56529125a2e0 0x56529126b0d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0011d80 tx=0x7fc0c0004480 comp rx=0 tx=0).stop 2024-09-19T04:17:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.932+0000 7fc0cea5c740 1 -- 172.21.15.7:0/3033960168 shutdown_connections 2024-09-19T04:17:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.932+0000 7fc0cea5c740 1 --2- 172.21.15.7:0/3033960168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56529125f370 0x5652912563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.932+0000 7fc0cea5c740 1 --2- 172.21.15.7:0/3033960168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56529125a2e0 0x56529126b0d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.932+0000 7fc0cea5c740 1 --2- 172.21.15.7:0/3033960168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5652912599a0 0x565291255e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.932+0000 7fc0cea5c740 1 -- 172.21.15.7:0/3033960168 >> 172.21.15.7:0/3033960168 conn(0x565291255010 msgr2=0x56529125b480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.932+0000 7fc0cea5c740 1 -- 172.21.15.7:0/3033960168 shutdown_connections 2024-09-19T04:17:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.932+0000 7fc0cea5c740 1 -- 172.21.15.7:0/3033960168 wait complete. 2024-09-19T04:17:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.933+0000 7fc0cea5c740 1 -- start start 2024-09-19T04:17:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.933+0000 7fc0cea5c740 1 Processor -- start 2024-09-19T04:17:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.933+0000 7fc0cea5c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652912599a0 0x5652912688d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.933+0000 7fc0cea5c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56529125a2e0 0x565291268e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.933+0000 7fc0cea5c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56529125f370 0x565291269dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.933+0000 7fc0cea5c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c41adf50 con 0x56529125a2e0 2024-09-19T04:17:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.933+0000 7fc0cea5c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c41ad880 con 0x56529125f370 2024-09-19T04:17:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.933+0000 7fc0cea5c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c41aaaa0 con 0x5652912599a0 2024-09-19T04:17:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.933+0000 7fc0cea5c740 10 client.0 _ll_register_callbacks cb 0x7fc0c0004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:17:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.933+0000 7fc0c9980640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56529125a2e0 0x565291268e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.933+0000 7fc0c9980640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56529125a2e0 0x565291268e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32972/0 (socket says 172.21.15.7:32972) 2024-09-19T04:17:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.933+0000 7fc0c917f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652912599a0 0x5652912688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.933+0000 7fc0c9980640 1 -- 172.21.15.7:0/1481898218 learned_addr learned my addr 172.21.15.7:0/1481898218 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.934+0000 7fc0c917f640 1 --2- 172.21.15.7:0/1481898218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56529125f370 0x565291269dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.934+0000 7fc0c9980640 1 -- 172.21.15.7:0/1481898218 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652912599a0 msgr2=0x5652912688d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.934+0000 7fc0c9980640 1 --2- 172.21.15.7:0/1481898218 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652912599a0 0x5652912688d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.934+0000 7fc0c9980640 1 -- 172.21.15.7:0/1481898218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56529125f370 msgr2=0x565291269dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.934+0000 7fc0c9980640 1 --2- 172.21.15.7:0/1481898218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56529125f370 0x565291269dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.934+0000 7fc0c9980640 1 -- 172.21.15.7:0/1481898218 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56529126a3e0 con 0x56529125a2e0 2024-09-19T04:17:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.934+0000 7fc0c9980640 1 --2- 172.21.15.7:0/1481898218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56529125a2e0 0x565291268e10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0011c10 tx=0x7fc0c000f4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7f8bdc8b745b0c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.934+0000 7fc0ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:17:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.934+0000 7fc0ad7fa640 1 -- 172.21.15.7:0/1481898218 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0035070 con 0x56529125a2e0 2024-09-19T04:17:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.934+0000 7fc0ad7fa640 1 -- 172.21.15.7:0/1481898218 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fc0c0011e00 con 0x56529125a2e0 2024-09-19T04:17:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.934+0000 7fc0cea5c740 1 -- 172.21.15.7:0/1481898218 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0c00039c0 con 0x56529125a2e0 2024-09-19T04:17:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.934+0000 7fc0ad7fa640 1 -- 172.21.15.7:0/1481898218 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc0c0041050 con 0x56529125a2e0 2024-09-19T04:17:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.934+0000 7fc0cea5c740 10 client.15495 fetch_fsmap learned FSMap version 28 2024-09-19T04:17:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.934+0000 7fc0cea5c740 1 -- 172.21.15.7:0/1481898218 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5652912da570 con 0x56529125a2e0 2024-09-19T04:17:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.934+0000 7fc0ad7fa640 1 -- 172.21.15.7:0/1481898218 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0c00039c0 con 0x56529125a2e0 2024-09-19T04:17:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.935+0000 7fc0ad7fa640 1 -- 172.21.15.7:0/1481898218 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc0c0019040 con 0x56529125a2e0 2024-09-19T04:17:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.935+0000 7fc0cea5c740 10 client.15495 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:17:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.935+0000 7fc0cea5c740 10 client.15495 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:17:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.935+0000 7fc0cea5c740 20 client.15495 populate_metadata read hostname 'smithi007' 2024-09-19T04:17:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.935+0000 7fc0cea5c740 1 --2- 172.21.15.7:0/1481898218 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5652912dad50 0x5652912dd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.935+0000 7fc0cea5c740 4 client.15495 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:17:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.935+0000 7fc0cea5c740 1 -- 172.21.15.7:0/1481898218 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5652911c4d70 con 0x5652912dad50 2024-09-19T04:17:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.935+0000 7fc0c917f640 1 --2- 172.21.15.7:0/1481898218 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5652912dad50 0x5652912dd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.936+0000 7fc0c917f640 1 --2- 172.21.15.7:0/1481898218 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5652912dad50 0x5652912dd170 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd44747e3d693766 server_cookie=7b9714ed89635c2b in_seq=0 out_seq=0 2024-09-19T04:17:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.936+0000 7fc0ad7fa640 10 client.15495 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:17:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.939+0000 7fc0ad7fa640 1 -- 172.21.15.7:0/1481898218 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5652911c4d70 con 0x5652912dad50 2024-09-19T04:17:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.939+0000 7fc0ad7fa640 10 client.15495 handle_command_reply: tid=0 2024-09-19T04:17:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.939+0000 7fc0cea5c740 1 client.15495 shutdown 2024-09-19T04:17:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.939+0000 7fc0cea5c740 1 -- 172.21.15.7:0/1481898218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56529125a2e0 msgr2=0x565291268e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.939+0000 7fc0cea5c740 1 --2- 172.21.15.7:0/1481898218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56529125a2e0 0x565291268e10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0011c10 tx=0x7fc0c000f4c0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.939+0000 7fc0cea5c740 1 -- 172.21.15.7:0/1481898218 shutdown_connections 2024-09-19T04:17:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.939+0000 7fc0cea5c740 1 --2- 172.21.15.7:0/1481898218 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5652912dad50 0x5652912dd170 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.939+0000 7fc0cea5c740 1 --2- 172.21.15.7:0/1481898218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56529125f370 0x565291269dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.939+0000 7fc0cea5c740 1 --2- 172.21.15.7:0/1481898218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56529125a2e0 0x565291268e10 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.939+0000 7fc0ad7fa640 0 client.15495 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:17:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.939+0000 7fc0cea5c740 1 --2- 172.21.15.7:0/1481898218 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652912599a0 0x5652912688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.939+0000 7fc0cea5c740 1 -- 172.21.15.7:0/1481898218 >> 172.21.15.7:0/1481898218 conn(0x565291255010 msgr2=0x5652912539a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.939+0000 7fc0cea5c740 1 -- 172.21.15.7:0/1481898218 shutdown_connections 2024-09-19T04:17:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.939+0000 7fc0cea5c740 1 -- 172.21.15.7:0/1481898218 wait complete. 2024-09-19T04:17:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.939+0000 7fc0cea5c740 20 client.15495 trim_cache size 0 max 16384 2024-09-19T04:17:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:17:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:17:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:17:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:17:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.940+0000 7fc0cbbe4640 1 -- 172.21.15.7:0/149361150 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc0b00a3350 msgr2=0x7fc0b00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.940+0000 7fc0cbbe4640 1 --2- 172.21.15.7:0/149361150 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc0b00a3350 0x7fc0b00a5810 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc00c880 tx=0x7fc0bc00c7f0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.940+0000 7fc0cbbe4640 1 -- 172.21.15.7:0/149361150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0c4107820 msgr2=0x7fc0c41a16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.940+0000 7fc0cbbe4640 1 --2- 172.21.15.7:0/149361150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0c4107820 0x7fc0c41a16a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc00e9d0 tx=0x7fc0bc00ee90 comp rx=0 tx=0).stop 2024-09-19T04:17:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.940+0000 7fc0cbbe4640 1 -- 172.21.15.7:0/149361150 shutdown_connections 2024-09-19T04:17:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.940+0000 7fc0cbbe4640 1 --2- 172.21.15.7:0/149361150 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc0b00a3350 0x7fc0b00a5810 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.940+0000 7fc0cbbe4640 1 --2- 172.21.15.7:0/149361150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0c4107820 0x7fc0c41a16a0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.940+0000 7fc0cbbe4640 1 --2- 172.21.15.7:0/149361150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc0c4104ef0 0x7fc0c419a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.940+0000 7fc0cbbe4640 1 --2- 172.21.15.7:0/149361150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0c41025c0 0x7fc0c419a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.940+0000 7fc0cbbe4640 1 -- 172.21.15.7:0/149361150 >> 172.21.15.7:0/149361150 conn(0x7fc0c40fc1c0 msgr2=0x7fc0c4101d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.940+0000 7fc0cbbe4640 1 -- 172.21.15.7:0/149361150 shutdown_connections 2024-09-19T04:17:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:36.940+0000 7fc0cbbe4640 1 -- 172.21.15.7:0/149361150 wait complete. 2024-09-19T04:17:38.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:38 smithi092 ceph-mon[34940]: pgmap v376: 129 pgs: 129 active+clean; 664 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T04:17:38.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:38 smithi007 ceph-mon[31360]: pgmap v376: 129 pgs: 129 active+clean; 664 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T04:17:38.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:38 smithi102 ceph-mon[35446]: pgmap v376: 129 pgs: 129 active+clean; 664 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T04:17:39.241 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24506 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0' 2024-09-19T04:17:39.242 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24506 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0 2024-09-19T04:17:39.608 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:17:40.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.160+0000 7f4afd989640 1 -- 172.21.15.7:0/1496521073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4af8106f10 msgr2=0x7f4af810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:40.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.160+0000 7f4afd989640 1 --2- 172.21.15.7:0/1496521073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4af8106f10 0x7f4af810ea90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4af0009ca0 tx=0x7f4af002a8c0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.161+0000 7f4afd989640 1 -- 172.21.15.7:0/1496521073 shutdown_connections 2024-09-19T04:17:40.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.161+0000 7f4afd989640 1 --2- 172.21.15.7:0/1496521073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4af8106f10 0x7f4af810ea90 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.161+0000 7f4afd989640 1 --2- 172.21.15.7:0/1496521073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4af8102790 0x7f4af81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.161+0000 7f4afd989640 1 --2- 172.21.15.7:0/1496521073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4af8101de0 0x7f4af81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.161+0000 7f4afd989640 1 -- 172.21.15.7:0/1496521073 >> 172.21.15.7:0/1496521073 conn(0x7f4af80fd8e0 msgr2=0x7f4af80ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:40.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.161+0000 7f4afd989640 1 -- 172.21.15.7:0/1496521073 shutdown_connections 2024-09-19T04:17:40.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.161+0000 7f4afd989640 1 -- 172.21.15.7:0/1496521073 wait complete. 2024-09-19T04:17:40.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.162+0000 7f4afd989640 1 Processor -- start 2024-09-19T04:17:40.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.162+0000 7f4afd989640 1 -- start start 2024-09-19T04:17:40.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.162+0000 7f4afd989640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4af8101de0 0x7f4af81983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:40.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.162+0000 7f4afd989640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4af8102790 0x7f4af8198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:40.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.162+0000 7f4afd989640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4af8106f10 0x7f4af819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:40.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.162+0000 7f4afd989640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4af8111f70 con 0x7f4af8106f10 2024-09-19T04:17:40.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.162+0000 7f4afd989640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4af8111df0 con 0x7f4af8101de0 2024-09-19T04:17:40.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.162+0000 7f4afd989640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4af81120f0 con 0x7f4af8102790 2024-09-19T04:17:40.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.162+0000 7f4af77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4af8106f10 0x7f4af819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:40.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.162+0000 7f4af77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4af8106f10 0x7f4af819ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39622/0 (socket says 172.21.15.7:39622) 2024-09-19T04:17:40.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.162+0000 7f4af77fe640 1 -- 172.21.15.7:0/3706064479 learned_addr learned my addr 172.21.15.7:0/3706064479 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:40.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.163+0000 7f4af67fc640 1 --2- 172.21.15.7:0/3706064479 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4af8102790 0x7f4af8198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:40.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.163+0000 7f4af6ffd640 1 --2- 172.21.15.7:0/3706064479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4af8101de0 0x7f4af81983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:40.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.163+0000 7f4af77fe640 1 -- 172.21.15.7:0/3706064479 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4af8102790 msgr2=0x7f4af8198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:40.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.163+0000 7f4af77fe640 1 --2- 172.21.15.7:0/3706064479 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4af8102790 0x7f4af8198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.163+0000 7f4af77fe640 1 -- 172.21.15.7:0/3706064479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4af8101de0 msgr2=0x7f4af81983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:40.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.163+0000 7f4af77fe640 1 --2- 172.21.15.7:0/3706064479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4af8101de0 0x7f4af81983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.163+0000 7f4af77fe640 1 -- 172.21.15.7:0/3706064479 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af819d3a0 con 0x7f4af8106f10 2024-09-19T04:17:40.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.163+0000 7f4af6ffd640 1 --2- 172.21.15.7:0/3706064479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4af8101de0 0x7f4af81983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:17:40.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.163+0000 7f4af77fe640 1 --2- 172.21.15.7:0/3706064479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4af8106f10 0x7f4af819ccc0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4af0031a20 tx=0x7f4af0031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:40.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.163+0000 7f4afc987640 1 -- 172.21.15.7:0/3706064479 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af0003b70 con 0x7f4af8106f10 2024-09-19T04:17:40.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.163+0000 7f4afd989640 1 -- 172.21.15.7:0/3706064479 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af819d630 con 0x7f4af8106f10 2024-09-19T04:17:40.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.164+0000 7f4afd989640 1 -- 172.21.15.7:0/3706064479 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af8074420 con 0x7f4af8106f10 2024-09-19T04:17:40.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.164+0000 7f4afc987640 1 -- 172.21.15.7:0/3706064479 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4af0003d10 con 0x7f4af8106f10 2024-09-19T04:17:40.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.164+0000 7f4afc987640 1 -- 172.21.15.7:0/3706064479 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af002f9e0 con 0x7f4af8106f10 2024-09-19T04:17:40.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.167+0000 7f4afc987640 1 -- 172.21.15.7:0/3706064479 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f4af002fb80 con 0x7f4af8106f10 2024-09-19T04:17:40.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.167+0000 7f4affd62740 1 Processor -- start 2024-09-19T04:17:40.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.168+0000 7f4affd62740 1 -- start start 2024-09-19T04:17:40.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.168+0000 7f4affd62740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c0ce527680 0x55c0ce527a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:40.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.168+0000 7f4affd62740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0ce527fa0 0x55c0ce53ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:40.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.168+0000 7f4affd62740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ce53b150 0x55c0ce53d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:40.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.168+0000 7f4affd62740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c0ce48d2a0 con 0x55c0ce527fa0 2024-09-19T04:17:40.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.168+0000 7f4affd62740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c0ce434b10 con 0x55c0ce527680 2024-09-19T04:17:40.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.168+0000 7f4affd62740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c0ce489260 con 0x55c0ce53b150 2024-09-19T04:17:40.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.168+0000 7f4af6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0ce527fa0 0x55c0ce53ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:40.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.168+0000 7f4af6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0ce527fa0 0x55c0ce53ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39628/0 (socket says 172.21.15.7:39628) 2024-09-19T04:17:40.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.168+0000 7f4af6ffd640 1 -- 172.21.15.7:0/4028938356 learned_addr learned my addr 172.21.15.7:0/4028938356 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:40.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.168+0000 7f4af67fc640 1 --2- 172.21.15.7:0/4028938356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c0ce527680 0x55c0ce527a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:40.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.168+0000 7f4af67fc640 1 --2- 172.21.15.7:0/4028938356 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ce53b150 0x55c0ce53d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:40.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.169+0000 7f4afc987640 1 --2- 172.21.15.7:0/3706064479 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4ae00a32d0 0x7f4ae00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:40.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.169+0000 7f4af6ffd640 1 -- 172.21.15.7:0/4028938356 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ce53b150 msgr2=0x55c0ce53d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:40.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.169+0000 7f4af6ffd640 1 --2- 172.21.15.7:0/4028938356 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ce53b150 0x55c0ce53d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.169+0000 7f4af6ffd640 1 -- 172.21.15.7:0/4028938356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c0ce527680 msgr2=0x55c0ce527a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:40.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.169+0000 7f4af6ffd640 1 --2- 172.21.15.7:0/4028938356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c0ce527680 0x55c0ce527a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.169+0000 7f4af6ffd640 1 -- 172.21.15.7:0/4028938356 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0ce1feb90 con 0x55c0ce527fa0 2024-09-19T04:17:40.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.169+0000 7f4af67fc640 1 --2- 172.21.15.7:0/4028938356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c0ce527680 0x55c0ce527a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:17:40.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.169+0000 7f4afc987640 1 -- 172.21.15.7:0/3706064479 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f4af00f1020 con 0x7f4af8106f10 2024-09-19T04:17:40.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.169+0000 7f4af6ffd640 1 --2- 172.21.15.7:0/4028938356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0ce527fa0 0x55c0ce53ac10 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8009c30 tx=0x7f4ae8010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd843c21f3029e02 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:40.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.169+0000 7f4af77fe640 1 --2- 172.21.15.7:0/3706064479 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4ae00a32d0 0x7f4ae00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:40.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.169+0000 7f4addffb640 1 -- 172.21.15.7:0/4028938356 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8004020 con 0x55c0ce527fa0 2024-09-19T04:17:40.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.169+0000 7f4addffb640 1 -- 172.21.15.7:0/4028938356 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ae80041c0 con 0x55c0ce527fa0 2024-09-19T04:17:40.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.169+0000 7f4addffb640 1 -- 172.21.15.7:0/4028938356 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae80126b0 con 0x55c0ce527fa0 2024-09-19T04:17:40.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.170+0000 7f4affd62740 1 -- 172.21.15.7:0/4028938356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0ce527fa0 msgr2=0x55c0ce53ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:40.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.170+0000 7f4affd62740 1 --2- 172.21.15.7:0/4028938356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0ce527fa0 0x55c0ce53ac10 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8009c30 tx=0x7f4ae8010740 comp rx=0 tx=0).stop 2024-09-19T04:17:40.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.170+0000 7f4af77fe640 1 --2- 172.21.15.7:0/3706064479 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4ae00a32d0 0x7f4ae00a5790 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4af00ee740 tx=0x7f4af0033040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:40.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.170+0000 7f4affd62740 1 -- 172.21.15.7:0/4028938356 shutdown_connections 2024-09-19T04:17:40.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.170+0000 7f4affd62740 1 --2- 172.21.15.7:0/4028938356 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ce53b150 0x55c0ce53d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.170+0000 7f4affd62740 1 --2- 172.21.15.7:0/4028938356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0ce527fa0 0x55c0ce53ac10 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.170+0000 7f4affd62740 1 --2- 172.21.15.7:0/4028938356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c0ce527680 0x55c0ce527a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.170+0000 7f4affd62740 1 -- 172.21.15.7:0/4028938356 >> 172.21.15.7:0/4028938356 conn(0x55c0ce523cf0 msgr2=0x55c0ce5240d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:40.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.170+0000 7f4affd62740 1 -- 172.21.15.7:0/4028938356 shutdown_connections 2024-09-19T04:17:40.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.170+0000 7f4affd62740 1 -- 172.21.15.7:0/4028938356 wait complete. 2024-09-19T04:17:40.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.171+0000 7f4affd62740 1 -- start start 2024-09-19T04:17:40.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.171+0000 7f4affd62740 1 Processor -- start 2024-09-19T04:17:40.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.171+0000 7f4affd62740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0ce527680 0x55c0ce538150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:40.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.171+0000 7f4affd62740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ce527fa0 0x55c0ce538690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:40.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.171+0000 7f4affd62740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c0ce53b150 0x55c0ce538bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:40.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.171+0000 7f4affd62740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c0ce53dcc0 con 0x55c0ce527680 2024-09-19T04:17:40.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.171+0000 7f4affd62740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c0ce4156e0 con 0x55c0ce53b150 2024-09-19T04:17:40.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.171+0000 7f4affd62740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c0ce53de40 con 0x55c0ce527fa0 2024-09-19T04:17:40.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.171+0000 7f4affd62740 10 client.0 _ll_register_callbacks cb 0x55c0ce439a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:17:40.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.171+0000 7f4af67fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0ce527680 0x55c0ce538150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:40.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.171+0000 7f4af67fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0ce527680 0x55c0ce538150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39630/0 (socket says 172.21.15.7:39630) 2024-09-19T04:17:40.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.171+0000 7f4af67fc640 1 -- 172.21.15.7:0/3316713132 learned_addr learned my addr 172.21.15.7:0/3316713132 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:40.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.172+0000 7f4af6ffd640 1 --2- 172.21.15.7:0/3316713132 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ce527fa0 0x55c0ce538690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:40.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.172+0000 7f4af67fc640 1 --2- 172.21.15.7:0/3316713132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c0ce53b150 0x55c0ce538bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:40.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.172+0000 7f4af67fc640 1 -- 172.21.15.7:0/3316713132 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ce527fa0 msgr2=0x55c0ce538690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:40.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.172+0000 7f4af67fc640 1 --2- 172.21.15.7:0/3316713132 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ce527fa0 0x55c0ce538690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.172+0000 7f4af67fc640 1 -- 172.21.15.7:0/3316713132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c0ce53b150 msgr2=0x55c0ce538bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:40.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.172+0000 7f4af67fc640 1 --2- 172.21.15.7:0/3316713132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c0ce53b150 0x55c0ce538bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.172+0000 7f4af67fc640 1 -- 172.21.15.7:0/3316713132 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0ce547310 con 0x55c0ce527680 2024-09-19T04:17:40.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.172+0000 7f4af67fc640 1 --2- 172.21.15.7:0/3316713132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0ce527680 0x55c0ce538150 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4aec012cf0 tx=0x7f4aec009a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cdc6e4ee42c1828 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:40.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.172+0000 7f4ad6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:17:40.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.172+0000 7f4ad6ffd640 1 -- 172.21.15.7:0/3316713132 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec020420 con 0x55c0ce527680 2024-09-19T04:17:40.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.172+0000 7f4ad6ffd640 1 -- 172.21.15.7:0/3316713132 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f4aec009040 con 0x55c0ce527680 2024-09-19T04:17:40.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.172+0000 7f4affd62740 1 -- 172.21.15.7:0/3316713132 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ae80041c0 con 0x55c0ce527680 2024-09-19T04:17:40.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.173+0000 7f4ad6ffd640 1 -- 172.21.15.7:0/3316713132 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4aec02b050 con 0x55c0ce527680 2024-09-19T04:17:40.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.173+0000 7f4affd62740 10 client.15507 fetch_fsmap learned FSMap version 28 2024-09-19T04:17:40.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.173+0000 7f4affd62740 1 -- 172.21.15.7:0/3316713132 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c0ce549ca0 con 0x55c0ce527680 2024-09-19T04:17:40.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.173+0000 7f4ad6ffd640 1 -- 172.21.15.7:0/3316713132 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ae80041c0 con 0x55c0ce527680 2024-09-19T04:17:40.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.173+0000 7f4ad6ffd640 1 -- 172.21.15.7:0/3316713132 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4aec01f6d0 con 0x55c0ce527680 2024-09-19T04:17:40.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.173+0000 7f4affd62740 10 client.15507 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:17:40.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.173+0000 7f4affd62740 10 client.15507 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:17:40.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.173+0000 7f4affd62740 20 client.15507 populate_metadata read hostname 'smithi007' 2024-09-19T04:17:40.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.173+0000 7f4affd62740 1 --2- 172.21.15.7:0/3316713132 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55c0ce54b160 0x55c0ce54d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:40.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.173+0000 7f4affd62740 4 client.15507 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:17:40.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.173+0000 7f4affd62740 1 -- 172.21.15.7:0/3316713132 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c0ce49a9d0 con 0x55c0ce54b160 2024-09-19T04:17:40.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.174+0000 7f4af6ffd640 1 --2- 172.21.15.7:0/3316713132 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55c0ce54b160 0x55c0ce54d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:40.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.174+0000 7f4ad6ffd640 10 client.15507 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:17:40.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.174+0000 7f4af6ffd640 1 --2- 172.21.15.7:0/3316713132 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55c0ce54b160 0x55c0ce54d550 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cf8228859663453 server_cookie=9a14a8041bf54865 in_seq=0 out_seq=0 2024-09-19T04:17:40.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.175+0000 7f4ad6ffd640 1 -- 172.21.15.7:0/3316713132 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c0ce49a9d0 con 0x55c0ce54b160 2024-09-19T04:17:40.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.175+0000 7f4ad6ffd640 10 client.15507 handle_command_reply: tid=0 2024-09-19T04:17:40.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.175+0000 7f4affd62740 1 client.15507 shutdown 2024-09-19T04:17:40.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.175+0000 7f4affd62740 1 -- 172.21.15.7:0/3316713132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0ce527680 msgr2=0x55c0ce538150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:40.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.175+0000 7f4affd62740 1 --2- 172.21.15.7:0/3316713132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0ce527680 0x55c0ce538150 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4aec012cf0 tx=0x7f4aec009a40 comp rx=0 tx=0).stop 2024-09-19T04:17:40.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.176+0000 7f4affd62740 1 -- 172.21.15.7:0/3316713132 shutdown_connections 2024-09-19T04:17:40.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.176+0000 7f4affd62740 1 --2- 172.21.15.7:0/3316713132 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55c0ce54b160 0x55c0ce54d550 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.176+0000 7f4ad6ffd640 0 client.15507 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:17:40.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.176+0000 7f4affd62740 1 --2- 172.21.15.7:0/3316713132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c0ce53b150 0x55c0ce538bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.176+0000 7f4affd62740 1 --2- 172.21.15.7:0/3316713132 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ce527fa0 0x55c0ce538690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.176+0000 7f4affd62740 1 --2- 172.21.15.7:0/3316713132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0ce527680 0x55c0ce538150 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.176+0000 7f4affd62740 1 -- 172.21.15.7:0/3316713132 >> 172.21.15.7:0/3316713132 conn(0x55c0ce523cf0 msgr2=0x55c0ce529980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:40.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.176+0000 7f4affd62740 1 -- 172.21.15.7:0/3316713132 shutdown_connections 2024-09-19T04:17:40.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.176+0000 7f4affd62740 1 -- 172.21.15.7:0/3316713132 wait complete. 2024-09-19T04:17:40.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.176+0000 7f4affd62740 20 client.15507 trim_cache size 0 max 16384 2024-09-19T04:17:40.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.199+0000 7f4affd62740 1 Processor -- start 2024-09-19T04:17:40.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.199+0000 7f4affd62740 1 -- start start 2024-09-19T04:17:40.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.200+0000 7f4affd62740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ce527680 0x55c0ce552e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:40.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.200+0000 7f4affd62740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0ce527fa0 0x55c0ce553360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:40.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.200+0000 7f4affd62740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c0ce53b150 0x55c0ce5353d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:40.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.200+0000 7f4affd62740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4af81acc20 con 0x55c0ce527fa0 2024-09-19T04:17:40.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.200+0000 7f4affd62740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4af81ae760 con 0x55c0ce53b150 2024-09-19T04:17:40.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.200+0000 7f4affd62740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4af81ad2f0 con 0x55c0ce527680 2024-09-19T04:17:40.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.200+0000 7f4af6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0ce527fa0 0x55c0ce553360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:40.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.200+0000 7f4af6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0ce527fa0 0x55c0ce553360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39636/0 (socket says 172.21.15.7:39636) 2024-09-19T04:17:40.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.200+0000 7f4af6ffd640 1 -- 172.21.15.7:0/2274558738 learned_addr learned my addr 172.21.15.7:0/2274558738 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:40.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.200+0000 7f4af67fc640 1 --2- 172.21.15.7:0/2274558738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ce527680 0x55c0ce552e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:40.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.200+0000 7f4af67fc640 1 --2- 172.21.15.7:0/2274558738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c0ce53b150 0x55c0ce5353d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:40.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.200+0000 7f4af6ffd640 1 -- 172.21.15.7:0/2274558738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ce527680 msgr2=0x55c0ce552e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:40.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.200+0000 7f4af6ffd640 1 --2- 172.21.15.7:0/2274558738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ce527680 0x55c0ce552e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.200+0000 7f4af6ffd640 1 -- 172.21.15.7:0/2274558738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c0ce53b150 msgr2=0x55c0ce5353d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:40.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.200+0000 7f4af6ffd640 1 --2- 172.21.15.7:0/2274558738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c0ce53b150 0x55c0ce5353d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.200+0000 7f4af6ffd640 1 -- 172.21.15.7:0/2274558738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0ce51f260 con 0x55c0ce527fa0 2024-09-19T04:17:40.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.201+0000 7f4af6ffd640 1 --2- 172.21.15.7:0/2274558738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0ce527fa0 0x55c0ce553360 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8019000 tx=0x7f4ae8010f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80d179b76dd82393 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:40.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.201+0000 7f4add7fa640 1 -- 172.21.15.7:0/2274558738 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8009d20 con 0x55c0ce527fa0 2024-09-19T04:17:40.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.201+0000 7f4add7fa640 1 -- 172.21.15.7:0/2274558738 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ae8005050 con 0x55c0ce527fa0 2024-09-19T04:17:40.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.201+0000 7f4add7fa640 1 -- 172.21.15.7:0/2274558738 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8004a00 con 0x55c0ce527fa0 2024-09-19T04:17:40.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.202+0000 7f4affd62740 1 -- 172.21.15.7:0/2274558738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0ce527fa0 msgr2=0x55c0ce553360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:40.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.202+0000 7f4affd62740 1 --2- 172.21.15.7:0/2274558738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0ce527fa0 0x55c0ce553360 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8019000 tx=0x7f4ae8010f90 comp rx=0 tx=0).stop 2024-09-19T04:17:40.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.202+0000 7f4affd62740 1 -- 172.21.15.7:0/2274558738 shutdown_connections 2024-09-19T04:17:40.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.202+0000 7f4affd62740 1 --2- 172.21.15.7:0/2274558738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c0ce53b150 0x55c0ce5353d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.202+0000 7f4affd62740 1 --2- 172.21.15.7:0/2274558738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0ce527fa0 0x55c0ce553360 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.202+0000 7f4affd62740 1 --2- 172.21.15.7:0/2274558738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ce527680 0x55c0ce552e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.202+0000 7f4affd62740 1 -- 172.21.15.7:0/2274558738 >> 172.21.15.7:0/2274558738 conn(0x55c0ce523cf0 msgr2=0x55c0ce522e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:40.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.202+0000 7f4affd62740 1 -- 172.21.15.7:0/2274558738 shutdown_connections 2024-09-19T04:17:40.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.202+0000 7f4affd62740 1 -- 172.21.15.7:0/2274558738 wait complete. 2024-09-19T04:17:40.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.202+0000 7f4affd62740 1 -- start start 2024-09-19T04:17:40.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.203+0000 7f4affd62740 1 Processor -- start 2024-09-19T04:17:40.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.203+0000 7f4affd62740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c0ce527680 0x55c0ce5430d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:40.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.203+0000 7f4affd62740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ce527fa0 0x55c0ce543610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:40.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.203+0000 7f4affd62740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0ce53b150 0x55c0ce5400a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:40.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.203+0000 7f4affd62740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4af81ae090 con 0x55c0ce53b150 2024-09-19T04:17:40.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.203+0000 7f4affd62740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4af81ad9c0 con 0x55c0ce527680 2024-09-19T04:17:40.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.203+0000 7f4affd62740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4af81aabe0 con 0x55c0ce527fa0 2024-09-19T04:17:40.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.203+0000 7f4affd62740 10 client.0 _ll_register_callbacks cb 0x7f4aec0129b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:17:40.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.203+0000 7f4af67fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0ce53b150 0x55c0ce5400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:40.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.203+0000 7f4af67fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0ce53b150 0x55c0ce5400a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39652/0 (socket says 172.21.15.7:39652) 2024-09-19T04:17:40.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.203+0000 7f4af67fc640 1 -- 172.21.15.7:0/3889527122 learned_addr learned my addr 172.21.15.7:0/3889527122 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:40.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.203+0000 7f4af6ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ce527fa0 0x55c0ce543610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:40.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.203+0000 7f4af67fc640 1 --2- 172.21.15.7:0/3889527122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c0ce527680 0x55c0ce5430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:40.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.204+0000 7f4af67fc640 1 -- 172.21.15.7:0/3889527122 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ce527fa0 msgr2=0x55c0ce543610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:40.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.204+0000 7f4af67fc640 1 --2- 172.21.15.7:0/3889527122 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ce527fa0 0x55c0ce543610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.204+0000 7f4af67fc640 1 -- 172.21.15.7:0/3889527122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c0ce527680 msgr2=0x55c0ce5430d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:40.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.204+0000 7f4af67fc640 1 --2- 172.21.15.7:0/3889527122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c0ce527680 0x55c0ce5430d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.204+0000 7f4af67fc640 1 -- 172.21.15.7:0/3889527122 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0ce5405e0 con 0x55c0ce53b150 2024-09-19T04:17:40.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.204+0000 7f4af67fc640 1 --2- 172.21.15.7:0/3889527122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0ce53b150 0x55c0ce5400a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4aec015040 tx=0x7f4aec012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=131fa886ba64214b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:40.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.204+0000 7f4ad6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:17:40.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.204+0000 7f4ad6ffd640 1 -- 172.21.15.7:0/3889527122 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec037020 con 0x55c0ce53b150 2024-09-19T04:17:40.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.204+0000 7f4ad6ffd640 1 -- 172.21.15.7:0/3889527122 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f4aec01f5e0 con 0x55c0ce53b150 2024-09-19T04:17:40.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.204+0000 7f4affd62740 1 -- 172.21.15.7:0/3889527122 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ae8005050 con 0x55c0ce53b150 2024-09-19T04:17:40.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.204+0000 7f4ad6ffd640 1 -- 172.21.15.7:0/3889527122 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4aec03f050 con 0x55c0ce53b150 2024-09-19T04:17:40.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.204+0000 7f4affd62740 10 client.15513 fetch_fsmap learned FSMap version 28 2024-09-19T04:17:40.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.204+0000 7f4affd62740 1 -- 172.21.15.7:0/3889527122 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c0ce5b6520 con 0x55c0ce53b150 2024-09-19T04:17:40.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.205+0000 7f4ad6ffd640 1 -- 172.21.15.7:0/3889527122 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ae8005050 con 0x55c0ce53b150 2024-09-19T04:17:40.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.205+0000 7f4ad6ffd640 1 -- 172.21.15.7:0/3889527122 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4aec0047f0 con 0x55c0ce53b150 2024-09-19T04:17:40.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.205+0000 7f4affd62740 10 client.15513 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:17:40.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.205+0000 7f4affd62740 10 client.15513 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:17:40.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.205+0000 7f4affd62740 20 client.15513 populate_metadata read hostname 'smithi007' 2024-09-19T04:17:40.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.205+0000 7f4affd62740 1 --2- 172.21.15.7:0/3889527122 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55c0ce5b6bf0 0x55c0ce5b9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:40.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.205+0000 7f4affd62740 4 client.15513 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}] 2024-09-19T04:17:40.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.205+0000 7f4affd62740 1 -- 172.21.15.7:0/3889527122 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}) -- 0x55c0ce494d20 con 0x55c0ce5b6bf0 2024-09-19T04:17:40.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.205+0000 7f4af6ffd640 1 --2- 172.21.15.7:0/3889527122 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55c0ce5b6bf0 0x55c0ce5b9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:40.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.206+0000 7f4ad6ffd640 10 client.15513 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:17:40.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.206+0000 7f4af6ffd640 1 --2- 172.21.15.7:0/3889527122 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55c0ce5b6bf0 0x55c0ce5b9010 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf661420afd1d81f server_cookie=e8c66678cfce0fe in_seq=0 out_seq=0 2024-09-19T04:17:40.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.217+0000 7f4ad6ffd640 1 -- 172.21.15.7:0/3889527122 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55c0ce494d20 con 0x55c0ce5b6bf0 2024-09-19T04:17:40.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.217+0000 7f4ad6ffd640 10 client.15513 handle_command_reply: tid=0 2024-09-19T04:17:40.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.217+0000 7f4affd62740 1 client.15513 shutdown 2024-09-19T04:17:40.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.218+0000 7f4affd62740 1 -- 172.21.15.7:0/3889527122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0ce53b150 msgr2=0x55c0ce5400a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:40.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.218+0000 7f4affd62740 1 --2- 172.21.15.7:0/3889527122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0ce53b150 0x55c0ce5400a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f4aec015040 tx=0x7f4aec012040 comp rx=0 tx=0).stop 2024-09-19T04:17:40.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.218+0000 7f4affd62740 1 -- 172.21.15.7:0/3889527122 shutdown_connections 2024-09-19T04:17:40.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.218+0000 7f4affd62740 1 --2- 172.21.15.7:0/3889527122 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55c0ce5b6bf0 0x55c0ce5b9010 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.218+0000 7f4affd62740 1 --2- 172.21.15.7:0/3889527122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c0ce53b150 0x55c0ce5400a0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.218+0000 7f4affd62740 1 --2- 172.21.15.7:0/3889527122 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c0ce527fa0 0x55c0ce543610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.218+0000 7f4ad6ffd640 0 client.15513 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:17:40.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.218+0000 7f4affd62740 1 --2- 172.21.15.7:0/3889527122 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c0ce527680 0x55c0ce5430d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.218+0000 7f4affd62740 1 -- 172.21.15.7:0/3889527122 >> 172.21.15.7:0/3889527122 conn(0x55c0ce523cf0 msgr2=0x55c0ce538110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:40.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.218+0000 7f4affd62740 1 -- 172.21.15.7:0/3889527122 shutdown_connections 2024-09-19T04:17:40.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.218+0000 7f4affd62740 1 -- 172.21.15.7:0/3889527122 wait complete. 2024-09-19T04:17:40.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.218+0000 7f4affd62740 20 client.15513 trim_cache size 0 max 16384 2024-09-19T04:17:40.221 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:17:40.221 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 28, 2024-09-19T04:17:40.221 INFO:teuthology.orchestra.run.smithi007.stdout: "leader": 24506, 2024-09-19T04:17:40.221 INFO:teuthology.orchestra.run.smithi007.stdout: "set_version": 2, 2024-09-19T04:17:40.221 INFO:teuthology.orchestra.run.smithi007.stdout: "sets": { 2024-09-19T04:17:40.221 INFO:teuthology.orchestra.run.smithi007.stdout: "45afeca9": { 2024-09-19T04:17:40.221 INFO:teuthology.orchestra.run.smithi007.stdout: "version": 2, 2024-09-19T04:17:40.221 INFO:teuthology.orchestra.run.smithi007.stdout: "age_ref": 0.0, 2024-09-19T04:17:40.221 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:17:40.221 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "QUIESCED", 2024-09-19T04:17:40.222 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:17:40.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:17:40.222 INFO:teuthology.orchestra.run.smithi007.stdout: "timeout": 90.0, 2024-09-19T04:17:40.222 INFO:teuthology.orchestra.run.smithi007.stdout: "expiration": 131.2, 2024-09-19T04:17:40.222 INFO:teuthology.orchestra.run.smithi007.stdout: "members": { 2024-09-19T04:17:40.222 INFO:teuthology.orchestra.run.smithi007.stdout: "file:/": { 2024-09-19T04:17:40.222 INFO:teuthology.orchestra.run.smithi007.stdout: "excluded": false, 2024-09-19T04:17:40.222 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:17:40.222 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "QUIESCED", 2024-09-19T04:17:40.222 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:17:40.222 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:17:40.223 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:17:40.223 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:17:40.223 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:17:40.223 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:17:40.223 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:17:40.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.219+0000 7f4afd989640 1 -- 172.21.15.7:0/3706064479 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4ae00a32d0 msgr2=0x7f4ae00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:40.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.219+0000 7f4afd989640 1 --2- 172.21.15.7:0/3706064479 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4ae00a32d0 0x7f4ae00a5790 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4af00ee740 tx=0x7f4af0033040 comp rx=0 tx=0).stop 2024-09-19T04:17:40.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.219+0000 7f4afd989640 1 -- 172.21.15.7:0/3706064479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4af8106f10 msgr2=0x7f4af819ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:40.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.219+0000 7f4afd989640 1 --2- 172.21.15.7:0/3706064479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4af8106f10 0x7f4af819ccc0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4af0031a20 tx=0x7f4af0031a50 comp rx=0 tx=0).stop 2024-09-19T04:17:40.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.219+0000 7f4afd989640 1 -- 172.21.15.7:0/3706064479 shutdown_connections 2024-09-19T04:17:40.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.219+0000 7f4afd989640 1 --2- 172.21.15.7:0/3706064479 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4ae00a32d0 0x7f4ae00a5790 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.219+0000 7f4afd989640 1 --2- 172.21.15.7:0/3706064479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4af8106f10 0x7f4af819ccc0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.219+0000 7f4afd989640 1 --2- 172.21.15.7:0/3706064479 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4af8102790 0x7f4af8198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.219+0000 7f4afd989640 1 --2- 172.21.15.7:0/3706064479 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4af8101de0 0x7f4af81983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:40.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.219+0000 7f4afd989640 1 -- 172.21.15.7:0/3706064479 >> 172.21.15.7:0/3706064479 conn(0x7f4af80fd8e0 msgr2=0x7f4af80fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:40.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.219+0000 7f4afd989640 1 -- 172.21.15.7:0/3706064479 shutdown_connections 2024-09-19T04:17:40.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:40.219+0000 7f4afd989640 1 -- 172.21.15.7:0/3706064479 wait complete. 2024-09-19T04:17:40.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:40 smithi007 ceph-mon[31360]: pgmap v377: 129 pgs: 129 active+clean; 665 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-19T04:17:40.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:17:40.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:17:40.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:17:40.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:40 smithi092 ceph-mon[34940]: pgmap v377: 129 pgs: 129 active+clean; 665 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-19T04:17:40.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:17:40.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:17:40.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:17:40.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:40 smithi102 ceph-mon[35446]: pgmap v377: 129 pgs: 129 active+clean; 665 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 511 B/s wr, 12 op/s 2024-09-19T04:17:40.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:17:40.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:17:40.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:17:40.993 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '45afeca9', quiesce took 7.9 seconds. Will release after: 3.299999999999999 2024-09-19T04:17:42.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:42 smithi092 ceph-mon[34940]: pgmap v378: 129 pgs: 129 active+clean; 665 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T04:17:42.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:42 smithi007 ceph-mon[31360]: pgmap v378: 129 pgs: 129 active+clean; 665 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T04:17:42.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:42 smithi102 ceph-mon[35446]: pgmap v378: 129 pgs: 129 active+clean; 665 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T04:17:44.294 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:17:44.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:44 smithi092 ceph-mon[34940]: pgmap v379: 129 pgs: 129 active+clean; 670 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-19T04:17:44.595 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:17:44.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:44 smithi007 ceph-mon[31360]: pgmap v379: 129 pgs: 129 active+clean; 670 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-19T04:17:44.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:44 smithi102 ceph-mon[35446]: pgmap v379: 129 pgs: 129 active+clean; 670 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-19T04:17:45.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.104+0000 7f18d211c640 1 -- 172.21.15.7:0/704966815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18cc102570 msgr2=0x7f18cc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:45.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.104+0000 7f18d211c640 1 --2- 172.21.15.7:0/704966815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18cc102570 0x7f18cc1029b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f18c0009890 tx=0x7f18c002a410 comp rx=0 tx=0).stop 2024-09-19T04:17:45.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.104+0000 7f18d211c640 1 -- 172.21.15.7:0/704966815 shutdown_connections 2024-09-19T04:17:45.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.104+0000 7f18d211c640 1 --2- 172.21.15.7:0/704966815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18cc102ef0 0x7f18cc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:45.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.105+0000 7f18d211c640 1 --2- 172.21.15.7:0/704966815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18cc102570 0x7f18cc1029b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:45.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.105+0000 7f18d211c640 1 --2- 172.21.15.7:0/704966815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18cc100e20 0x7f18cc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:45.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.105+0000 7f18d211c640 1 -- 172.21.15.7:0/704966815 >> 172.21.15.7:0/704966815 conn(0x7f18cc0fc7d0 msgr2=0x7f18cc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:45.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.105+0000 7f18d211c640 1 -- 172.21.15.7:0/704966815 shutdown_connections 2024-09-19T04:17:45.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.105+0000 7f18d211c640 1 -- 172.21.15.7:0/704966815 wait complete. 2024-09-19T04:17:45.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.105+0000 7f18d211c640 1 Processor -- start 2024-09-19T04:17:45.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.106+0000 7f18d211c640 1 -- start start 2024-09-19T04:17:45.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.106+0000 7f18d211c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18cc100e20 0x7f18cc1993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:45.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.106+0000 7f18d211c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18cc102570 0x7f18cc199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:45.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.106+0000 7f18d211c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18cc102ef0 0x7f18cc1a4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:45.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.106+0000 7f18d211c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc110f80 con 0x7f18cc100e20 2024-09-19T04:17:45.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.106+0000 7f18d211c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc110e00 con 0x7f18cc102ef0 2024-09-19T04:17:45.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.106+0000 7f18d211c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f18cc111100 con 0x7f18cc102570 2024-09-19T04:17:45.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.106+0000 7f18cb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18cc100e20 0x7f18cc1993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:45.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.106+0000 7f18cb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18cc100e20 0x7f18cc1993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39678/0 (socket says 172.21.15.7:39678) 2024-09-19T04:17:45.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.106+0000 7f18cb7fe640 1 -- 172.21.15.7:0/3498843700 learned_addr learned my addr 172.21.15.7:0/3498843700 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:45.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.106+0000 7f18caffd640 1 --2- 172.21.15.7:0/3498843700 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18cc102570 0x7f18cc199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:45.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.106+0000 7f18cbfff640 1 --2- 172.21.15.7:0/3498843700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18cc102ef0 0x7f18cc1a4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:45.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.107+0000 7f18cb7fe640 1 -- 172.21.15.7:0/3498843700 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18cc102570 msgr2=0x7f18cc199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:45.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.107+0000 7f18cb7fe640 1 --2- 172.21.15.7:0/3498843700 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18cc102570 0x7f18cc199930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:45.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.107+0000 7f18cb7fe640 1 -- 172.21.15.7:0/3498843700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18cc102ef0 msgr2=0x7f18cc1a4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:45.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.107+0000 7f18cb7fe640 1 --2- 172.21.15.7:0/3498843700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18cc102ef0 0x7f18cc1a4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:45.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.107+0000 7f18cb7fe640 1 -- 172.21.15.7:0/3498843700 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18cc1a49b0 con 0x7f18cc100e20 2024-09-19T04:17:45.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.107+0000 7f18cb7fe640 1 --2- 172.21.15.7:0/3498843700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18cc100e20 0x7f18cc1993f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f18bc00e9f0 tx=0x7f18bc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:45.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.107+0000 7f18c8ff9640 1 -- 172.21.15.7:0/3498843700 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18bc00cd80 con 0x7f18cc100e20 2024-09-19T04:17:45.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.107+0000 7f18d211c640 1 -- 172.21.15.7:0/3498843700 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18cc1a4b80 con 0x7f18cc100e20 2024-09-19T04:17:45.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.107+0000 7f18c8ff9640 1 -- 172.21.15.7:0/3498843700 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18bc005500 con 0x7f18cc100e20 2024-09-19T04:17:45.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.107+0000 7f18c8ff9640 1 -- 172.21.15.7:0/3498843700 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18bc018630 con 0x7f18cc100e20 2024-09-19T04:17:45.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.107+0000 7f18d211c640 1 -- 172.21.15.7:0/3498843700 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18cc1a5040 con 0x7f18cc100e20 2024-09-19T04:17:45.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.109+0000 7f18d211c640 1 -- 172.21.15.7:0/3498843700 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18cc101200 con 0x7f18cc100e20 2024-09-19T04:17:45.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.110+0000 7f18c8ff9640 1 -- 172.21.15.7:0/3498843700 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f18bc0046c0 con 0x7f18cc100e20 2024-09-19T04:17:45.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.110+0000 7f18c8ff9640 1 --2- 172.21.15.7:0/3498843700 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f18b40a32d0 0x7f18b40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:45.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.111+0000 7f18c8ff9640 1 -- 172.21.15.7:0/3498843700 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f18bc0d0a10 con 0x7f18cc100e20 2024-09-19T04:17:45.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.111+0000 7f18caffd640 1 --2- 172.21.15.7:0/3498843700 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f18b40a32d0 0x7f18b40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:45.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.111+0000 7f18caffd640 1 --2- 172.21.15.7:0/3498843700 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f18b40a32d0 0x7f18b40a5790 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f18cc06aac0 tx=0x7f18c0009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:45.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.118+0000 7f18c8ff9640 1 -- 172.21.15.7:0/3498843700 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f18bc09d200 con 0x7f18cc100e20 2024-09-19T04:17:45.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.344+0000 7f18d211c640 1 -- 172.21.15.7:0/3498843700 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18cc109090 con 0x7f18cc100e20 2024-09-19T04:17:45.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.345+0000 7f18c8ff9640 1 -- 172.21.15.7:0/3498843700 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11962 (secure 0 0 0) 0x7f18bc09cb00 con 0x7f18cc100e20 2024-09-19T04:17:45.348 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:17:45.348 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":28,"btime":"2024-09-19T04:16:57:081835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:16:56.259017+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24496,"mds_2":24482,"mds_3":24478,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24472,24478,24482,24496,24506]},"id":1}]} 2024-09-19T04:17:45.348 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 28 2024-09-19T04:17:45.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.348+0000 7f18d211c640 1 -- 172.21.15.7:0/3498843700 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f18b40a32d0 msgr2=0x7f18b40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:45.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.348+0000 7f18d211c640 1 --2- 172.21.15.7:0/3498843700 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f18b40a32d0 0x7f18b40a5790 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f18cc06aac0 tx=0x7f18c0009520 comp rx=0 tx=0).stop 2024-09-19T04:17:45.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.348+0000 7f18d211c640 1 -- 172.21.15.7:0/3498843700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18cc100e20 msgr2=0x7f18cc1993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:45.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.348+0000 7f18d211c640 1 --2- 172.21.15.7:0/3498843700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18cc100e20 0x7f18cc1993f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f18bc00e9f0 tx=0x7f18bc00edf0 comp rx=0 tx=0).stop 2024-09-19T04:17:45.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.348+0000 7f18d211c640 1 -- 172.21.15.7:0/3498843700 shutdown_connections 2024-09-19T04:17:45.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.348+0000 7f18d211c640 1 --2- 172.21.15.7:0/3498843700 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f18b40a32d0 0x7f18b40a5790 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:45.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.348+0000 7f18d211c640 1 --2- 172.21.15.7:0/3498843700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18cc102ef0 0x7f18cc1a4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:45.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.348+0000 7f18d211c640 1 --2- 172.21.15.7:0/3498843700 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18cc102570 0x7f18cc199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:45.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.348+0000 7f18d211c640 1 --2- 172.21.15.7:0/3498843700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18cc100e20 0x7f18cc1993f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:45.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.348+0000 7f18d211c640 1 -- 172.21.15.7:0/3498843700 >> 172.21.15.7:0/3498843700 conn(0x7f18cc0fc7d0 msgr2=0x7f18cc1048b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:45.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.348+0000 7f18d211c640 1 -- 172.21.15.7:0/3498843700 shutdown_connections 2024-09-19T04:17:45.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:45.348+0000 7f18d211c640 1 -- 172.21.15.7:0/3498843700 wait complete. 2024-09-19T04:17:46.134 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24506 quiesce db --set-id 45afeca9 --release --await' 2024-09-19T04:17:46.135 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24506 quiesce db --set-id 45afeca9 --release --await 2024-09-19T04:17:46.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:46 smithi007 ceph-mon[31360]: pgmap v380: 129 pgs: 129 active+clean; 670 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-19T04:17:46.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:46 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3498843700' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:17:46.433 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:17:46.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:46 smithi092 ceph-mon[34940]: pgmap v380: 129 pgs: 129 active+clean; 670 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-19T04:17:46.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:46 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3498843700' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:17:46.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:46 smithi102 ceph-mon[35446]: pgmap v380: 129 pgs: 129 active+clean; 670 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-19T04:17:46.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:46 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3498843700' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:17:47.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.047+0000 7f891c26f640 1 -- 172.21.15.7:0/4142394778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89141082a0 msgr2=0x7f891410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:47.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.047+0000 7f891c26f640 1 --2- 172.21.15.7:0/4142394778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89141082a0 0x7f891410ec40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f890c009cd0 tx=0x7f890c02a8e0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.047+0000 7f891c26f640 1 -- 172.21.15.7:0/4142394778 shutdown_connections 2024-09-19T04:17:47.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.047+0000 7f891c26f640 1 --2- 172.21.15.7:0/4142394778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89141082a0 0x7f891410ec40 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.047+0000 7f891c26f640 1 --2- 172.21.15.7:0/4142394778 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89141036e0 0x7f8914107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.047+0000 7f891c26f640 1 --2- 172.21.15.7:0/4142394778 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8914102d30 0x7f8914103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.047+0000 7f891c26f640 1 -- 172.21.15.7:0/4142394778 >> 172.21.15.7:0/4142394778 conn(0x7f89140fc7d0 msgr2=0x7f89140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:47.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.048+0000 7f891c26f640 1 -- 172.21.15.7:0/4142394778 shutdown_connections 2024-09-19T04:17:47.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.048+0000 7f891c26f640 1 -- 172.21.15.7:0/4142394778 wait complete. 2024-09-19T04:17:47.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.050+0000 7f891c26f640 1 Processor -- start 2024-09-19T04:17:47.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.050+0000 7f891c26f640 1 -- start start 2024-09-19T04:17:47.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.050+0000 7f891c26f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8914102d30 0x7f8914198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:47.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.050+0000 7f891c26f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89141036e0 0x7f8914198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:47.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.051+0000 7f891a00b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8914102d30 0x7f8914198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:47.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.051+0000 7f891a00b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8914102d30 0x7f8914198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:57616/0 (socket says 172.21.15.7:57616) 2024-09-19T04:17:47.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.051+0000 7f891980a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89141036e0 0x7f8914198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:47.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.051+0000 7f891980a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89141036e0 0x7f8914198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39702/0 (socket says 172.21.15.7:39702) 2024-09-19T04:17:47.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.051+0000 7f891a00b640 1 -- 172.21.15.7:0/3913680011 learned_addr learned my addr 172.21.15.7:0/3913680011 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:47.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.051+0000 7f891c26f640 1 --2- 172.21.15.7:0/3913680011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89141082a0 0x7f891419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:47.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.051+0000 7f891c26f640 1 -- 172.21.15.7:0/3913680011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f89141120a0 con 0x7f89141036e0 2024-09-19T04:17:47.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.051+0000 7f891c26f640 1 -- 172.21.15.7:0/3913680011 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8914111f20 con 0x7f8914102d30 2024-09-19T04:17:47.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.051+0000 7f891c26f640 1 -- 172.21.15.7:0/3913680011 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8914112220 con 0x7f89141082a0 2024-09-19T04:17:47.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.051+0000 7f891a80c640 1 --2- 172.21.15.7:0/3913680011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89141082a0 0x7f891419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:47.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.051+0000 7f891a00b640 1 -- 172.21.15.7:0/3913680011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89141082a0 msgr2=0x7f891419ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:47.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.051+0000 7f891a00b640 1 --2- 172.21.15.7:0/3913680011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89141082a0 0x7f891419ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.051+0000 7f891a00b640 1 -- 172.21.15.7:0/3913680011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89141036e0 msgr2=0x7f8914198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:47.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.051+0000 7f891a00b640 1 --2- 172.21.15.7:0/3913680011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89141036e0 0x7f8914198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.051+0000 7f891a00b640 1 -- 172.21.15.7:0/3913680011 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f891419d500 con 0x7f8914102d30 2024-09-19T04:17:47.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.052+0000 7f891980a640 1 --2- 172.21.15.7:0/3913680011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89141036e0 0x7f8914198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:17:47.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.052+0000 7f891a00b640 1 --2- 172.21.15.7:0/3913680011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8914102d30 0x7f8914198550 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f891000e9f0 tx=0x7f891000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:47.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.052+0000 7f890b7fe640 1 -- 172.21.15.7:0/3913680011 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891000ccc0 con 0x7f8914102d30 2024-09-19T04:17:47.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.052+0000 7f890b7fe640 1 -- 172.21.15.7:0/3913680011 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f891000ce60 con 0x7f8914102d30 2024-09-19T04:17:47.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.052+0000 7f890b7fe640 1 -- 172.21.15.7:0/3913680011 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8910010430 con 0x7f8914102d30 2024-09-19T04:17:47.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.052+0000 7f891c26f640 1 -- 172.21.15.7:0/3913680011 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f891419d7f0 con 0x7f8914102d30 2024-09-19T04:17:47.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.052+0000 7f891c26f640 1 -- 172.21.15.7:0/3913680011 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89141008c0 con 0x7f8914102d30 2024-09-19T04:17:47.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.056+0000 7f890b7fe640 1 -- 172.21.15.7:0/3913680011 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f89100046c0 con 0x7f8914102d30 2024-09-19T04:17:47.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.056+0000 7f891e648740 1 Processor -- start 2024-09-19T04:17:47.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.057+0000 7f891e648740 1 -- start start 2024-09-19T04:17:47.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.057+0000 7f891e648740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a740cb870 0x557a740cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:47.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.057+0000 7f891e648740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a740cc190 0x557a740d6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:47.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.057+0000 7f891e648740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a740d6a50 0x557a740d8e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:47.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.057+0000 7f891e648740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557a74028620 con 0x557a740cc190 2024-09-19T04:17:47.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.057+0000 7f891e648740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557a73fcfe50 con 0x557a740cb870 2024-09-19T04:17:47.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.057+0000 7f891e648740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557a740245e0 con 0x557a740d6a50 2024-09-19T04:17:47.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.057+0000 7f891a80c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a740cb870 0x557a740cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:47.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.057+0000 7f891a80c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a740cb870 0x557a740cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:57624/0 (socket says 172.21.15.7:57624) 2024-09-19T04:17:47.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.057+0000 7f891a80c640 1 -- 172.21.15.7:0/3999169725 learned_addr learned my addr 172.21.15.7:0/3999169725 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:47.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.057+0000 7f891a00b640 1 --2- 172.21.15.7:0/3999169725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a740cc190 0x557a740d6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:47.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.058+0000 7f891980a640 1 --2- 172.21.15.7:0/3999169725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a740d6a50 0x557a740d8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:47.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.058+0000 7f891a80c640 1 -- 172.21.15.7:0/3999169725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a740d6a50 msgr2=0x557a740d8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:47.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.058+0000 7f891a80c640 1 --2- 172.21.15.7:0/3999169725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a740d6a50 0x557a740d8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.058+0000 7f891a80c640 1 -- 172.21.15.7:0/3999169725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a740cc190 msgr2=0x557a740d6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:47.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.058+0000 7f891a80c640 1 --2- 172.21.15.7:0/3999169725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a740cc190 0x557a740d6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.058+0000 7f891a80c640 1 -- 172.21.15.7:0/3999169725 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a73fc0d40 con 0x557a740cb870 2024-09-19T04:17:47.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.058+0000 7f891a80c640 1 --2- 172.21.15.7:0/3999169725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a740cb870 0x557a740cbc50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f890c009cd0 tx=0x7f890c009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52df624fc3e2b6bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:47.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.058+0000 7f8908dea640 1 -- 172.21.15.7:0/3999169725 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890c0318c0 con 0x557a740cb870 2024-09-19T04:17:47.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.058+0000 7f8908dea640 1 -- 172.21.15.7:0/3999169725 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f890c036040 con 0x557a740cb870 2024-09-19T04:17:47.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.058+0000 7f8908dea640 1 -- 172.21.15.7:0/3999169725 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890c004650 con 0x557a740cb870 2024-09-19T04:17:47.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.058+0000 7f890b7fe640 1 --2- 172.21.15.7:0/3913680011 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f89000a3350 0x7f89000a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:47.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.059+0000 7f891a00b640 1 --2- 172.21.15.7:0/3913680011 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f89000a3350 0x7f89000a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:47.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.059+0000 7f890b7fe640 1 -- 172.21.15.7:0/3913680011 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f89100d01c0 con 0x7f8914102d30 2024-09-19T04:17:47.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.059+0000 7f891e648740 1 -- 172.21.15.7:0/3999169725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a740cb870 msgr2=0x557a740cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:47.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.059+0000 7f891e648740 1 --2- 172.21.15.7:0/3999169725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a740cb870 0x557a740cbc50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f890c009cd0 tx=0x7f890c009a20 comp rx=0 tx=0).stop 2024-09-19T04:17:47.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.059+0000 7f891e648740 1 -- 172.21.15.7:0/3999169725 shutdown_connections 2024-09-19T04:17:47.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.059+0000 7f891e648740 1 --2- 172.21.15.7:0/3999169725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a740d6a50 0x557a740d8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.059+0000 7f891e648740 1 --2- 172.21.15.7:0/3999169725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a740cc190 0x557a740d6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.059+0000 7f891e648740 1 --2- 172.21.15.7:0/3999169725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a740cb870 0x557a740cbc50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.059+0000 7f891e648740 1 -- 172.21.15.7:0/3999169725 >> 172.21.15.7:0/3999169725 conn(0x557a740c7e00 msgr2=0x557a740c81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:47.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.059+0000 7f891a00b640 1 --2- 172.21.15.7:0/3913680011 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f89000a3350 0x7f89000a5810 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f891000e9c0 tx=0x7f89100bc040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:47.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.060+0000 7f891e648740 1 -- 172.21.15.7:0/3999169725 shutdown_connections 2024-09-19T04:17:47.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.060+0000 7f891e648740 1 -- 172.21.15.7:0/3999169725 wait complete. 2024-09-19T04:17:47.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.060+0000 7f891e648740 1 -- start start 2024-09-19T04:17:47.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.060+0000 7f891e648740 1 Processor -- start 2024-09-19T04:17:47.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.060+0000 7f891e648740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a740cb870 0x557a740d4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:47.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.061+0000 7f891e648740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a740cc190 0x557a740d4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:47.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.061+0000 7f891e648740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a740d6a50 0x557a740c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:47.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.061+0000 7f891e648740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557a740ea4b0 con 0x557a740cc190 2024-09-19T04:17:47.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.061+0000 7f891e648740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557a73fb0f10 con 0x557a740cb870 2024-09-19T04:17:47.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.061+0000 7f891e648740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557a740ea630 con 0x557a740d6a50 2024-09-19T04:17:47.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.061+0000 7f891e648740 10 client.0 _ll_register_callbacks cb 0x557a73fd4db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:17:47.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.061+0000 7f891a80c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a740cb870 0x557a740d4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:47.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.061+0000 7f891a80c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a740d6a50 0x557a740c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:47.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.061+0000 7f891a80c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a740d6a50 0x557a740c69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:41696/0 (socket says 172.21.15.7:41696) 2024-09-19T04:17:47.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.061+0000 7f891a80c640 1 -- 172.21.15.7:0/653761590 learned_addr learned my addr 172.21.15.7:0/653761590 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:47.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.061+0000 7f891980a640 1 --2- 172.21.15.7:0/653761590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a740cc190 0x557a740d4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:47.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.061+0000 7f891a80c640 1 -- 172.21.15.7:0/653761590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a740cb870 msgr2=0x557a740d4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:47.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.061+0000 7f891a80c640 1 --2- 172.21.15.7:0/653761590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a740cb870 0x557a740d4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.061+0000 7f891a80c640 1 -- 172.21.15.7:0/653761590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a740cc190 msgr2=0x557a740d4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:47.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.061+0000 7f891a80c640 1 --2- 172.21.15.7:0/653761590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a740cc190 0x557a740d4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.061+0000 7f891a80c640 1 -- 172.21.15.7:0/653761590 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a73d37580 con 0x557a740d6a50 2024-09-19T04:17:47.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.061+0000 7f891a80c640 1 --2- 172.21.15.7:0/653761590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a740d6a50 0x557a740c69a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f890c005e30 tx=0x7f890c02a8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bd735812c9820bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:47.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.061+0000 7f88fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-19T04:17:47.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.062+0000 7f88fdffb640 1 -- 172.21.15.7:0/653761590 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890c04b040 con 0x557a740d6a50 2024-09-19T04:17:47.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.062+0000 7f891e648740 1 -- 172.21.15.7:0/653761590 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f890c036040 con 0x557a740d6a50 2024-09-19T04:17:47.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.062+0000 7f88fdffb640 1 -- 172.21.15.7:0/653761590 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f890c003970 con 0x557a740d6a50 2024-09-19T04:17:47.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.062+0000 7f88fdffb640 1 -- 172.21.15.7:0/653761590 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f890c004b40 con 0x557a740d6a50 2024-09-19T04:17:47.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.062+0000 7f891e648740 10 client.25234 fetch_fsmap learned FSMap version 28 2024-09-19T04:17:47.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.062+0000 7f891e648740 1 -- 172.21.15.7:0/653761590 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557a73e01960 con 0x557a740d6a50 2024-09-19T04:17:47.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.062+0000 7f88fdffb640 1 -- 172.21.15.7:0/653761590 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f890c036040 con 0x557a740d6a50 2024-09-19T04:17:47.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.063+0000 7f88fdffb640 1 -- 172.21.15.7:0/653761590 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f890c051040 con 0x557a740d6a50 2024-09-19T04:17:47.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.063+0000 7f891e648740 10 client.25234 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:17:47.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.063+0000 7f891e648740 10 client.25234 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:17:47.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.063+0000 7f891e648740 20 client.25234 populate_metadata read hostname 'smithi007' 2024-09-19T04:17:47.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.063+0000 7f891e648740 1 --2- 172.21.15.7:0/653761590 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557a740da560 0x557a740dc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:47.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.063+0000 7f891e648740 4 client.25234 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:17:47.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.063+0000 7f891e648740 1 -- 172.21.15.7:0/653761590 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a74035b90 con 0x557a740da560 2024-09-19T04:17:47.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.063+0000 7f891980a640 1 --2- 172.21.15.7:0/653761590 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557a740da560 0x557a740dc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:47.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.064+0000 7f891980a640 1 --2- 172.21.15.7:0/653761590 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557a740da560 0x557a740dc9b0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0cffb5749bfd479 server_cookie=a926db50c7785177 in_seq=0 out_seq=0 2024-09-19T04:17:47.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.064+0000 7f88fdffb640 10 client.25234 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:17:47.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.064+0000 7f88fdffb640 1 -- 172.21.15.7:0/653761590 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557a74035b90 con 0x557a740da560 2024-09-19T04:17:47.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.064+0000 7f88fdffb640 10 client.25234 handle_command_reply: tid=0 2024-09-19T04:17:47.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.064+0000 7f891e648740 1 client.25234 shutdown 2024-09-19T04:17:47.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.065+0000 7f891e648740 1 -- 172.21.15.7:0/653761590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a740d6a50 msgr2=0x557a740c69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:47.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.065+0000 7f891e648740 1 --2- 172.21.15.7:0/653761590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a740d6a50 0x557a740c69a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f890c005e30 tx=0x7f890c02a8e0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.065+0000 7f891e648740 1 -- 172.21.15.7:0/653761590 shutdown_connections 2024-09-19T04:17:47.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.065+0000 7f891e648740 1 --2- 172.21.15.7:0/653761590 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557a740da560 0x557a740dc9b0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.065+0000 7f88fdffb640 0 client.25234 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:17:47.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.065+0000 7f891e648740 1 --2- 172.21.15.7:0/653761590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a740d6a50 0x557a740c69a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.065+0000 7f891e648740 1 --2- 172.21.15.7:0/653761590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a740cc190 0x557a740d4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.065+0000 7f891e648740 1 --2- 172.21.15.7:0/653761590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a740cb870 0x557a740d4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.065+0000 7f891e648740 1 -- 172.21.15.7:0/653761590 >> 172.21.15.7:0/653761590 conn(0x557a740c7e00 msgr2=0x557a740cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:47.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.065+0000 7f891e648740 1 -- 172.21.15.7:0/653761590 shutdown_connections 2024-09-19T04:17:47.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.065+0000 7f891e648740 1 -- 172.21.15.7:0/653761590 wait complete. 2024-09-19T04:17:47.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.065+0000 7f891e648740 20 client.25234 trim_cache size 0 max 16384 2024-09-19T04:17:47.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.099+0000 7f891e648740 1 Processor -- start 2024-09-19T04:17:47.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.099+0000 7f891e648740 1 -- start start 2024-09-19T04:17:47.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.099+0000 7f891e648740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a740cb870 0x557a740c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:47.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.099+0000 7f891e648740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a740cc190 0x557a740c0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:47.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.099+0000 7f891e648740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a740d6a50 0x557a740e9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:47.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.099+0000 7f891e648740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8914073630 con 0x557a740cb870 2024-09-19T04:17:47.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.099+0000 7f891e648740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f89141a5e20 con 0x557a740d6a50 2024-09-19T04:17:47.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.099+0000 7f891e648740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8914073d00 con 0x557a740cc190 2024-09-19T04:17:47.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.100+0000 7f891980a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a740cc190 0x557a740c0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:47.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.100+0000 7f891980a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a740cc190 0x557a740c0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:41704/0 (socket says 172.21.15.7:41704) 2024-09-19T04:17:47.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.100+0000 7f891980a640 1 -- 172.21.15.7:0/2220248583 learned_addr learned my addr 172.21.15.7:0/2220248583 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:47.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.100+0000 7f891a80c640 1 --2- 172.21.15.7:0/2220248583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a740cb870 0x557a740c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:47.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.100+0000 7f891980a640 1 -- 172.21.15.7:0/2220248583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a740d6a50 msgr2=0x557a740e9c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T04:17:47.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.100+0000 7f891980a640 1 --2- 172.21.15.7:0/2220248583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a740d6a50 0x557a740e9c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.100+0000 7f891980a640 1 -- 172.21.15.7:0/2220248583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a740cb870 msgr2=0x557a740c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:47.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.100+0000 7f891980a640 1 --2- 172.21.15.7:0/2220248583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a740cb870 0x557a740c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.100+0000 7f891980a640 1 -- 172.21.15.7:0/2220248583 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a740ceb70 con 0x557a740cc190 2024-09-19T04:17:47.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.100+0000 7f891a80c640 1 --2- 172.21.15.7:0/2220248583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a740cb870 0x557a740c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:17:47.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.101+0000 7f891980a640 1 --2- 172.21.15.7:0/2220248583 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a740cc190 0x557a740c0f50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f89140fdcd0 tx=0x7f8904035a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8b187873baf54e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:47.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.101+0000 7f88fffff640 1 -- 172.21.15.7:0/2220248583 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8904045070 con 0x557a740cc190 2024-09-19T04:17:47.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.101+0000 7f88fffff640 1 -- 172.21.15.7:0/2220248583 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8904041be0 con 0x557a740cc190 2024-09-19T04:17:47.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.101+0000 7f88fffff640 1 -- 172.21.15.7:0/2220248583 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890404a460 con 0x557a740cc190 2024-09-19T04:17:47.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.102+0000 7f891e648740 1 -- 172.21.15.7:0/2220248583 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a740cc190 msgr2=0x557a740c0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:47.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.102+0000 7f891e648740 1 --2- 172.21.15.7:0/2220248583 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a740cc190 0x557a740c0f50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f89140fdcd0 tx=0x7f8904035a30 comp rx=0 tx=0).stop 2024-09-19T04:17:47.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.102+0000 7f891e648740 1 -- 172.21.15.7:0/2220248583 shutdown_connections 2024-09-19T04:17:47.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.102+0000 7f891e648740 1 --2- 172.21.15.7:0/2220248583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a740d6a50 0x557a740e9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.102+0000 7f891e648740 1 --2- 172.21.15.7:0/2220248583 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a740cc190 0x557a740c0f50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.102+0000 7f891e648740 1 --2- 172.21.15.7:0/2220248583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a740cb870 0x557a740c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.102+0000 7f891e648740 1 -- 172.21.15.7:0/2220248583 >> 172.21.15.7:0/2220248583 conn(0x557a740c7e00 msgr2=0x557a740c1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:47.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.102+0000 7f891e648740 1 -- 172.21.15.7:0/2220248583 shutdown_connections 2024-09-19T04:17:47.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.102+0000 7f891e648740 1 -- 172.21.15.7:0/2220248583 wait complete. 2024-09-19T04:17:47.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.103+0000 7f891e648740 1 -- start start 2024-09-19T04:17:47.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.103+0000 7f891e648740 1 Processor -- start 2024-09-19T04:17:47.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.103+0000 7f891e648740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a740cb870 0x557a740e0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:47.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.104+0000 7f891e648740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a740cc190 0x557a740dc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:47.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.104+0000 7f891a80c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a740cb870 0x557a740e0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:47.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.104+0000 7f891a80c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a740cb870 0x557a740e0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:57638/0 (socket says 172.21.15.7:57638) 2024-09-19T04:17:47.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.104+0000 7f891980a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a740cc190 0x557a740dc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:47.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.104+0000 7f891980a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a740cc190 0x557a740dc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:41712/0 (socket says 172.21.15.7:41712) 2024-09-19T04:17:47.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.104+0000 7f891e648740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a740d6a50 0x557a740dc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:47.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.104+0000 7f891a80c640 1 -- 172.21.15.7:0/1334754982 learned_addr learned my addr 172.21.15.7:0/1334754982 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:47.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.104+0000 7f891e648740 1 -- 172.21.15.7:0/1334754982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f89141a5750 con 0x557a740d6a50 2024-09-19T04:17:47.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.104+0000 7f891e648740 1 -- 172.21.15.7:0/1334754982 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f89141a50d0 con 0x557a740cb870 2024-09-19T04:17:47.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.104+0000 7f891e648740 1 -- 172.21.15.7:0/1334754982 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f89140715f0 con 0x557a740cc190 2024-09-19T04:17:47.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.104+0000 7f891e648740 10 client.0 _ll_register_callbacks cb 0x7f890c031d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:17:47.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.104+0000 7f891a80c640 1 --2- 172.21.15.7:0/1334754982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a740d6a50 0x557a740dc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:47.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.105+0000 7f891980a640 1 -- 172.21.15.7:0/1334754982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a740cb870 msgr2=0x557a740e0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:47.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.105+0000 7f891980a640 1 --2- 172.21.15.7:0/1334754982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a740cb870 0x557a740e0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.105+0000 7f891980a640 1 -- 172.21.15.7:0/1334754982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a740d6a50 msgr2=0x557a740dc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:47.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.105+0000 7f891980a640 1 --2- 172.21.15.7:0/1334754982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a740d6a50 0x557a740dc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.105+0000 7f891980a640 1 -- 172.21.15.7:0/1334754982 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a740dd0b0 con 0x557a740cc190 2024-09-19T04:17:47.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.105+0000 7f891a80c640 1 --2- 172.21.15.7:0/1334754982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a740d6a50 0x557a740dc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:17:47.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.105+0000 7f891980a640 1 --2- 172.21.15.7:0/1334754982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a740cc190 0x557a740dc370 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x557a740c8be0 tx=0x7f89040315b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87e21f2ffd54eacd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:47.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.105+0000 7f88fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-19T04:17:47.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.106+0000 7f88fdffb640 1 -- 172.21.15.7:0/1334754982 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8904045040 con 0x557a740cc190 2024-09-19T04:17:47.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.106+0000 7f891e648740 1 -- 172.21.15.7:0/1334754982 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8904041be0 con 0x557a740cc190 2024-09-19T04:17:47.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.106+0000 7f88fdffb640 1 -- 172.21.15.7:0/1334754982 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f8904041700 con 0x557a740cc190 2024-09-19T04:17:47.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.106+0000 7f88fdffb640 1 -- 172.21.15.7:0/1334754982 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f890405b050 con 0x557a740cc190 2024-09-19T04:17:47.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.106+0000 7f891e648740 10 client.25240 fetch_fsmap learned FSMap version 28 2024-09-19T04:17:47.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.106+0000 7f891e648740 1 -- 172.21.15.7:0/1334754982 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557a74159e30 con 0x557a740cc190 2024-09-19T04:17:47.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.106+0000 7f88fdffb640 1 -- 172.21.15.7:0/1334754982 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8904041be0 con 0x557a740cc190 2024-09-19T04:17:47.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.106+0000 7f88fdffb640 1 -- 172.21.15.7:0/1334754982 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f8904052070 con 0x557a740cc190 2024-09-19T04:17:47.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.106+0000 7f891e648740 10 client.25240 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:17:47.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.106+0000 7f891e648740 10 client.25240 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:17:47.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.106+0000 7f891e648740 20 client.25240 populate_metadata read hostname 'smithi007' 2024-09-19T04:17:47.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.106+0000 7f891e648740 1 --2- 172.21.15.7:0/1334754982 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557a740da560 0x557a7415c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:47.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.107+0000 7f891e648740 4 client.25240 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "45afeca9", "release": true, "await": true}] 2024-09-19T04:17:47.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.107+0000 7f891e648740 1 -- 172.21.15.7:0/1334754982 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "quiesce db", "set_id": "45afeca9", "release": true, "await": true}) -- 0x557a740300a0 con 0x557a740da560 2024-09-19T04:17:47.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.107+0000 7f891a80c640 1 --2- 172.21.15.7:0/1334754982 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557a740da560 0x557a7415c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:47.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.107+0000 7f88fdffb640 10 client.25240 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:17:47.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.108+0000 7f891a80c640 1 --2- 172.21.15.7:0/1334754982 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557a740da560 0x557a7415c480 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a63261d1d2adc38 server_cookie=36840f17d5e66028 in_seq=0 out_seq=0 2024-09-19T04:17:47.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.110+0000 7f88fdffb640 1 -- 172.21.15.7:0/1334754982 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x557a740300a0 con 0x557a740da560 2024-09-19T04:17:47.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.110+0000 7f88fdffb640 10 client.25240 handle_command_reply: tid=0 2024-09-19T04:17:47.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.110+0000 7f891e648740 1 client.25240 shutdown 2024-09-19T04:17:47.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.110+0000 7f891e648740 1 -- 172.21.15.7:0/1334754982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a740cc190 msgr2=0x557a740dc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:47.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.110+0000 7f891e648740 1 --2- 172.21.15.7:0/1334754982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a740cc190 0x557a740dc370 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x557a740c8be0 tx=0x7f89040315b0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.110+0000 7f891e648740 1 -- 172.21.15.7:0/1334754982 shutdown_connections 2024-09-19T04:17:47.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.110+0000 7f891e648740 1 --2- 172.21.15.7:0/1334754982 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557a740da560 0x557a7415c480 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.110+0000 7f891e648740 1 --2- 172.21.15.7:0/1334754982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a740d6a50 0x557a740dc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.110+0000 7f891e648740 1 --2- 172.21.15.7:0/1334754982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557a740cc190 0x557a740dc370 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.110+0000 7f891e648740 1 --2- 172.21.15.7:0/1334754982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a740cb870 0x557a740e0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.110+0000 7f891e648740 1 -- 172.21.15.7:0/1334754982 >> 172.21.15.7:0/1334754982 conn(0x557a740c7e00 msgr2=0x557a740c2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:47.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.110+0000 7f88fdffb640 0 client.25240 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:17:47.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.110+0000 7f891e648740 1 -- 172.21.15.7:0/1334754982 shutdown_connections 2024-09-19T04:17:47.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.110+0000 7f891e648740 1 -- 172.21.15.7:0/1334754982 wait complete. 2024-09-19T04:17:47.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.110+0000 7f891e648740 20 client.25240 trim_cache size 0 max 16384 2024-09-19T04:17:47.115 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:17:47.115 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 28, 2024-09-19T04:17:47.115 INFO:teuthology.orchestra.run.smithi007.stdout: "leader": 24506, 2024-09-19T04:17:47.115 INFO:teuthology.orchestra.run.smithi007.stdout: "set_version": 4, 2024-09-19T04:17:47.115 INFO:teuthology.orchestra.run.smithi007.stdout: "sets": { 2024-09-19T04:17:47.115 INFO:teuthology.orchestra.run.smithi007.stdout: "45afeca9": { 2024-09-19T04:17:47.115 INFO:teuthology.orchestra.run.smithi007.stdout: "version": 4, 2024-09-19T04:17:47.115 INFO:teuthology.orchestra.run.smithi007.stdout: "age_ref": 0.0, 2024-09-19T04:17:47.115 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:17:47.115 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RELEASED", 2024-09-19T04:17:47.116 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:17:47.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:17:47.116 INFO:teuthology.orchestra.run.smithi007.stdout: "timeout": 90.0, 2024-09-19T04:17:47.116 INFO:teuthology.orchestra.run.smithi007.stdout: "expiration": 131.2, 2024-09-19T04:17:47.116 INFO:teuthology.orchestra.run.smithi007.stdout: "members": { 2024-09-19T04:17:47.116 INFO:teuthology.orchestra.run.smithi007.stdout: "file:/": { 2024-09-19T04:17:47.116 INFO:teuthology.orchestra.run.smithi007.stdout: "excluded": false, 2024-09-19T04:17:47.116 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:17:47.116 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RELEASED", 2024-09-19T04:17:47.116 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:17:47.116 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:17:47.116 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:17:47.116 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:17:47.117 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:17:47.117 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:17:47.117 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:17:47.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.111+0000 7f891c26f640 1 -- 172.21.15.7:0/3913680011 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f89000a3350 msgr2=0x7f89000a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:47.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.111+0000 7f891c26f640 1 --2- 172.21.15.7:0/3913680011 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f89000a3350 0x7f89000a5810 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f891000e9c0 tx=0x7f89100bc040 comp rx=0 tx=0).stop 2024-09-19T04:17:47.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.111+0000 7f891c26f640 1 -- 172.21.15.7:0/3913680011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8914102d30 msgr2=0x7f8914198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:47.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.111+0000 7f891c26f640 1 --2- 172.21.15.7:0/3913680011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8914102d30 0x7f8914198550 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f891000e9f0 tx=0x7f891000edf0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.111+0000 7f891c26f640 1 -- 172.21.15.7:0/3913680011 shutdown_connections 2024-09-19T04:17:47.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.111+0000 7f891c26f640 1 --2- 172.21.15.7:0/3913680011 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f89000a3350 0x7f89000a5810 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.111+0000 7f891c26f640 1 --2- 172.21.15.7:0/3913680011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f89141082a0 0x7f891419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.111+0000 7f891c26f640 1 --2- 172.21.15.7:0/3913680011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89141036e0 0x7f8914198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.111+0000 7f891c26f640 1 --2- 172.21.15.7:0/3913680011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8914102d30 0x7f8914198550 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:47.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.111+0000 7f891c26f640 1 -- 172.21.15.7:0/3913680011 >> 172.21.15.7:0/3913680011 conn(0x7f89140fc7d0 msgr2=0x7f89140fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:47.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.111+0000 7f891c26f640 1 -- 172.21.15.7:0/3913680011 shutdown_connections 2024-09-19T04:17:47.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:17:47.111+0000 7f891c26f640 1 -- 172.21.15.7:0/3913680011 wait complete. 2024-09-19T04:17:47.956 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '45afeca9', total seconds elapsed: 14.9 2024-09-19T04:17:48.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:48 smithi092 ceph-mon[34940]: pgmap v381: 129 pgs: 129 active+clean; 670 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T04:17:48.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:48 smithi007 ceph-mon[31360]: pgmap v381: 129 pgs: 129 active+clean; 670 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T04:17:48.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:48 smithi102 ceph-mon[35446]: pgmap v381: 129 pgs: 129 active+clean; 670 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T04:17:50.078 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.075+0000 7f80fb3e4640 1 -- 172.21.15.7:0/3472837054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80f4104f50 msgr2=0x7f80f4107340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.075+0000 7f80fb3e4640 1 --2- 172.21.15.7:0/3472837054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80f4104f50 0x7f80f4107340 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f80e4009900 tx=0x7f80e402a3f0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.076+0000 7f80fb3e4640 1 -- 172.21.15.7:0/3472837054 shutdown_connections 2024-09-19T04:17:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.076+0000 7f80fb3e4640 1 --2- 172.21.15.7:0/3472837054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80f4107880 0x7f80f4109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.076+0000 7f80fb3e4640 1 --2- 172.21.15.7:0/3472837054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80f4104f50 0x7f80f4107340 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.076+0000 7f80fb3e4640 1 --2- 172.21.15.7:0/3472837054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80f4102620 0x7f80f4104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.076+0000 7f80fb3e4640 1 -- 172.21.15.7:0/3472837054 >> 172.21.15.7:0/3472837054 conn(0x7f80f40fc1c0 msgr2=0x7f80f40fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.076+0000 7f80fb3e4640 1 -- 172.21.15.7:0/3472837054 shutdown_connections 2024-09-19T04:17:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.076+0000 7f80fb3e4640 1 -- 172.21.15.7:0/3472837054 wait complete. 2024-09-19T04:17:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.076+0000 7f80fb3e4640 1 Processor -- start 2024-09-19T04:17:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.076+0000 7f80fb3e4640 1 -- start start 2024-09-19T04:17:50.079 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.077+0000 7f80fb3e4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80f4102620 0x7f80f4197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:50.080 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.077+0000 7f80fb3e4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80f4104f50 0x7f80f4198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:50.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.077+0000 7f80fb3e4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80f4107880 0x7f80f419f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:50.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.077+0000 7f80f897f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80f4104f50 0x7f80f4198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:50.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.077+0000 7f80fb3e4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f80f410d7e0 con 0x7f80f4104f50 2024-09-19T04:17:50.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.077+0000 7f80fb3e4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f80f410d660 con 0x7f80f4107880 2024-09-19T04:17:50.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.077+0000 7f80fb3e4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f80f410d960 con 0x7f80f4102620 2024-09-19T04:17:50.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.077+0000 7f80f897f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80f4104f50 0x7f80f4198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54692/0 (socket says 172.21.15.7:54692) 2024-09-19T04:17:50.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.077+0000 7f80f897f640 1 -- 172.21.15.7:0/2353854073 learned_addr learned my addr 172.21.15.7:0/2353854073 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:50.081 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.077+0000 7f80f9180640 1 --2- 172.21.15.7:0/2353854073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80f4102620 0x7f80f4197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:50.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.077+0000 7f80f9981640 1 --2- 172.21.15.7:0/2353854073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80f4107880 0x7f80f419f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:50.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.077+0000 7f80f897f640 1 -- 172.21.15.7:0/2353854073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80f4102620 msgr2=0x7f80f4197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:50.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.077+0000 7f80f897f640 1 --2- 172.21.15.7:0/2353854073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80f4102620 0x7f80f4197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.077+0000 7f80f897f640 1 -- 172.21.15.7:0/2353854073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80f4107880 msgr2=0x7f80f419f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:50.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.077+0000 7f80f897f640 1 --2- 172.21.15.7:0/2353854073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80f4107880 0x7f80f419f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.077+0000 7f80f897f640 1 -- 172.21.15.7:0/2353854073 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f419fb50 con 0x7f80f4104f50 2024-09-19T04:17:50.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.077+0000 7f80f897f640 1 --2- 172.21.15.7:0/2353854073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80f4104f50 0x7f80f4198470 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f80e4031610 tx=0x7f80e4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:50.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.078+0000 7f80ea7fc640 1 -- 172.21.15.7:0/2353854073 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e403f030 con 0x7f80f4104f50 2024-09-19T04:17:50.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.078+0000 7f80fb3e4640 1 -- 172.21.15.7:0/2353854073 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80f419fde0 con 0x7f80f4104f50 2024-09-19T04:17:50.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.078+0000 7f80ea7fc640 1 -- 172.21.15.7:0/2353854073 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80e4003ad0 con 0x7f80f4104f50 2024-09-19T04:17:50.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.078+0000 7f80ea7fc640 1 -- 172.21.15.7:0/2353854073 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e4049060 con 0x7f80f4104f50 2024-09-19T04:17:50.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.078+0000 7f80fb3e4640 1 -- 172.21.15.7:0/2353854073 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80f41a0250 con 0x7f80f4104f50 2024-09-19T04:17:50.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.081+0000 7f80fe258740 1 Processor -- start 2024-09-19T04:17:50.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.081+0000 7f80fe258740 1 -- start start 2024-09-19T04:17:50.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.081+0000 7f80fe258740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f960efdb0 0x559f960f01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:50.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.081+0000 7f80fe258740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f960f06f0 0x559f960f51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:50.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.081+0000 7f80fe258740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f960f5780 0x559f960f7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.081+0000 7f80fe258740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559f9604f2f0 con 0x559f960f5780 2024-09-19T04:17:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.081+0000 7f80fe258740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559f95ff7270 con 0x559f960efdb0 2024-09-19T04:17:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.081+0000 7f80fe258740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559f9604b2b0 con 0x559f960f06f0 2024-09-19T04:17:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.081+0000 7f80ea7fc640 1 -- 172.21.15.7:0/2353854073 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f80e4042030 con 0x7f80f4104f50 2024-09-19T04:17:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.081+0000 7f80f9981640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f960efdb0 0x559f960f01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.082+0000 7f80f9981640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f960efdb0 0x559f960f01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:53674/0 (socket says 172.21.15.7:53674) 2024-09-19T04:17:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.082+0000 7f80f9981640 1 -- 172.21.15.7:0/3417535430 learned_addr learned my addr 172.21.15.7:0/3417535430 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.082+0000 7f80f9180640 1 --2- 172.21.15.7:0/3417535430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f960f06f0 0x559f960f51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.082+0000 7f80f897f640 1 --2- 172.21.15.7:0/3417535430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f960f5780 0x559f960f7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.082+0000 7f80f9981640 1 -- 172.21.15.7:0/3417535430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f960f06f0 msgr2=0x559f960f51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.082+0000 7f80f9981640 1 --2- 172.21.15.7:0/3417535430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f960f06f0 0x559f960f51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.082+0000 7f80f9981640 1 -- 172.21.15.7:0/3417535430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f960f5780 msgr2=0x559f960f7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.082+0000 7f80f9981640 1 --2- 172.21.15.7:0/3417535430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f960f5780 0x559f960f7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.082+0000 7f80f9981640 1 -- 172.21.15.7:0/3417535430 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f95ff6340 con 0x559f960efdb0 2024-09-19T04:17:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.082+0000 7f80f897f640 1 --2- 172.21.15.7:0/3417535430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f960f5780 0x559f960f7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:17:50.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.082+0000 7f80f9981640 1 --2- 172.21.15.7:0/3417535430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f960efdb0 0x559f960f01b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f80ec009f80 tx=0x7f80ec010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d0686935ac1129f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.082+0000 7f80df7fe640 1 -- 172.21.15.7:0/3417535430 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ec004d20 con 0x559f960efdb0 2024-09-19T04:17:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.082+0000 7f80df7fe640 1 -- 172.21.15.7:0/3417535430 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80ec0119e0 con 0x559f960efdb0 2024-09-19T04:17:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.082+0000 7f80df7fe640 1 -- 172.21.15.7:0/3417535430 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ec005660 con 0x559f960efdb0 2024-09-19T04:17:50.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.082+0000 7f80ea7fc640 1 --2- 172.21.15.7:0/2353854073 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f80e00a32d0 0x7f80e00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:50.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.083+0000 7f80f9180640 1 --2- 172.21.15.7:0/2353854073 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f80e00a32d0 0x7f80e00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:50.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.083+0000 7f80ea7fc640 1 -- 172.21.15.7:0/2353854073 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f80e40f0860 con 0x7f80f4104f50 2024-09-19T04:17:50.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.084+0000 7f80f9180640 1 --2- 172.21.15.7:0/2353854073 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f80e00a32d0 0x7f80e00a5790 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x559f960f1120 tx=0x7f80f0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:50.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.084+0000 7f80fe258740 1 -- 172.21.15.7:0/3417535430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f960efdb0 msgr2=0x559f960f01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:50.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.084+0000 7f80fe258740 1 --2- 172.21.15.7:0/3417535430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f960efdb0 0x559f960f01b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f80ec009f80 tx=0x7f80ec010860 comp rx=0 tx=0).stop 2024-09-19T04:17:50.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.084+0000 7f80fe258740 1 -- 172.21.15.7:0/3417535430 shutdown_connections 2024-09-19T04:17:50.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.084+0000 7f80fe258740 1 --2- 172.21.15.7:0/3417535430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f960f5780 0x559f960f7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.084+0000 7f80fe258740 1 --2- 172.21.15.7:0/3417535430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f960f06f0 0x559f960f51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.084+0000 7f80fe258740 1 --2- 172.21.15.7:0/3417535430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f960efdb0 0x559f960f01b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.084+0000 7f80fe258740 1 -- 172.21.15.7:0/3417535430 >> 172.21.15.7:0/3417535430 conn(0x559f960eb420 msgr2=0x559f960eb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:50.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.084+0000 7f80fe258740 1 -- 172.21.15.7:0/3417535430 shutdown_connections 2024-09-19T04:17:50.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.084+0000 7f80fe258740 1 -- 172.21.15.7:0/3417535430 wait complete. 2024-09-19T04:17:50.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.084+0000 7f80fe258740 1 -- start start 2024-09-19T04:17:50.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.085+0000 7f80fe258740 1 Processor -- start 2024-09-19T04:17:50.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.085+0000 7f80fe258740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f960efdb0 0x559f960fa040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.085+0000 7f80fe258740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f960f06f0 0x559f960fa580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.085+0000 7f80fe258740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f960f5780 0x559f96101550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.085+0000 7f80fe258740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559f960f8750 con 0x559f960efdb0 2024-09-19T04:17:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.085+0000 7f80fe258740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559f95fd8290 con 0x559f960f06f0 2024-09-19T04:17:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.085+0000 7f80fe258740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559f960f88d0 con 0x559f960f5780 2024-09-19T04:17:50.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.085+0000 7f80fe258740 10 client.0 _ll_register_callbacks cb 0x559f96009140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:17:50.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.085+0000 7f80f9180640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f960efdb0 0x559f960fa040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:50.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.085+0000 7f80f9180640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f960efdb0 0x559f960fa040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54702/0 (socket says 172.21.15.7:54702) 2024-09-19T04:17:50.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.085+0000 7f80f9180640 1 -- 172.21.15.7:0/2964368579 learned_addr learned my addr 172.21.15.7:0/2964368579 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:50.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.085+0000 7f80f9981640 1 --2- 172.21.15.7:0/2964368579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f960f5780 0x559f96101550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:50.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.086+0000 7f80f9180640 1 -- 172.21.15.7:0/2964368579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f960f5780 msgr2=0x559f96101550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:50.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.086+0000 7f80f9180640 1 --2- 172.21.15.7:0/2964368579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f960f5780 0x559f96101550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.086+0000 7f80f9180640 1 -- 172.21.15.7:0/2964368579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f960f06f0 msgr2=0x559f960fa580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T04:17:50.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.086+0000 7f80f9180640 1 --2- 172.21.15.7:0/2964368579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f960f06f0 0x559f960fa580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.086+0000 7f80f9180640 1 -- 172.21.15.7:0/2964368579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f95d62210 con 0x559f960efdb0 2024-09-19T04:17:50.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.086+0000 7f80f9180640 1 --2- 172.21.15.7:0/2964368579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f960efdb0 0x559f960fa040 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f80f00045f0 tx=0x7f80f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41f441290e2f164 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:50.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.086+0000 7f80dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:17:50.092 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.086+0000 7f80dcff9640 1 -- 172.21.15.7:0/2964368579 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f0029a60 con 0x559f960efdb0 2024-09-19T04:17:50.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.086+0000 7f80dcff9640 1 -- 172.21.15.7:0/2964368579 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f80f0029c00 con 0x559f960efdb0 2024-09-19T04:17:50.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.086+0000 7f80fe258740 1 -- 172.21.15.7:0/2964368579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80ec0119e0 con 0x559f960efdb0 2024-09-19T04:17:50.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.086+0000 7f80dcff9640 1 -- 172.21.15.7:0/2964368579 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f80f0029e00 con 0x559f960efdb0 2024-09-19T04:17:50.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.086+0000 7f80fe258740 10 client.15546 fetch_fsmap learned FSMap version 28 2024-09-19T04:17:50.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.086+0000 7f80fe258740 1 -- 172.21.15.7:0/2964368579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559f95e2e620 con 0x559f960efdb0 2024-09-19T04:17:50.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.086+0000 7f80dcff9640 1 -- 172.21.15.7:0/2964368579 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80ec0119e0 con 0x559f960efdb0 2024-09-19T04:17:50.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.087+0000 7f80dcff9640 1 -- 172.21.15.7:0/2964368579 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f80f001f700 con 0x559f960efdb0 2024-09-19T04:17:50.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.087+0000 7f80fe258740 10 client.15546 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:17:50.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.087+0000 7f80fe258740 10 client.15546 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:17:50.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.087+0000 7f80fe258740 20 client.15546 populate_metadata read hostname 'smithi007' 2024-09-19T04:17:50.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.087+0000 7f80fe258740 1 --2- 172.21.15.7:0/2964368579 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x559f960e8040 0x559f960ea4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:50.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.087+0000 7f80fe258740 4 client.15546 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:17:50.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.087+0000 7f80fe258740 1 -- 172.21.15.7:0/2964368579 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f9605ca20 con 0x559f960e8040 2024-09-19T04:17:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.087+0000 7f80f897f640 1 --2- 172.21.15.7:0/2964368579 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x559f960e8040 0x559f960ea4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.088+0000 7f80dcff9640 10 client.15546 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:17:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.088+0000 7f80f897f640 1 --2- 172.21.15.7:0/2964368579 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x559f960e8040 0x559f960ea4c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=970780b0ff082ca0 server_cookie=7aaede69f25e4eba in_seq=0 out_seq=0 2024-09-19T04:17:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.088+0000 7f80dcff9640 1 -- 172.21.15.7:0/2964368579 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559f9605ca20 con 0x559f960e8040 2024-09-19T04:17:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.088+0000 7f80dcff9640 10 client.15546 handle_command_reply: tid=0 2024-09-19T04:17:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.088+0000 7f80fe258740 1 client.15546 shutdown 2024-09-19T04:17:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.089+0000 7f80fe258740 1 -- 172.21.15.7:0/2964368579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f960efdb0 msgr2=0x559f960fa040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.089+0000 7f80fe258740 1 --2- 172.21.15.7:0/2964368579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f960efdb0 0x559f960fa040 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f80f00045f0 tx=0x7f80f0004730 comp rx=0 tx=0).stop 2024-09-19T04:17:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.089+0000 7f80fe258740 1 -- 172.21.15.7:0/2964368579 shutdown_connections 2024-09-19T04:17:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.089+0000 7f80fe258740 1 --2- 172.21.15.7:0/2964368579 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x559f960e8040 0x559f960ea4c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.089+0000 7f80fe258740 1 --2- 172.21.15.7:0/2964368579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f960f5780 0x559f96101550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.089+0000 7f80fe258740 1 --2- 172.21.15.7:0/2964368579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f960f06f0 0x559f960fa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.089+0000 7f80fe258740 1 --2- 172.21.15.7:0/2964368579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f960efdb0 0x559f960fa040 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.089+0000 7f80dcff9640 0 client.15546 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:17:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.089+0000 7f80fe258740 1 -- 172.21.15.7:0/2964368579 >> 172.21.15.7:0/2964368579 conn(0x559f960eb420 msgr2=0x559f960ecc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.089+0000 7f80fe258740 1 -- 172.21.15.7:0/2964368579 shutdown_connections 2024-09-19T04:17:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.089+0000 7f80fe258740 1 -- 172.21.15.7:0/2964368579 wait complete. 2024-09-19T04:17:50.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.089+0000 7f80fe258740 20 client.15546 trim_cache size 0 max 16384 2024-09-19T04:17:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.104+0000 7f80fe258740 1 Processor -- start 2024-09-19T04:17:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.104+0000 7f80fe258740 1 -- start start 2024-09-19T04:17:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.104+0000 7f80fe258740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f960f06f0 0x559f960e61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.104+0000 7f80fe258740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f960f5780 0x559f960ec810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.104+0000 7f80fe258740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f960e6700 0x559f960ecd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.104+0000 7f80fe258740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f80f41a8700 con 0x559f960f06f0 2024-09-19T04:17:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.104+0000 7f80fe258740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f80f41aa240 con 0x559f960e6700 2024-09-19T04:17:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.104+0000 7f80fe258740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f80f41a8dd0 con 0x559f960f5780 2024-09-19T04:17:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.104+0000 7f80f9180640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f960f06f0 0x559f960e61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.104+0000 7f80f9180640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f960f06f0 0x559f960e61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54714/0 (socket says 172.21.15.7:54714) 2024-09-19T04:17:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.104+0000 7f80f9180640 1 -- 172.21.15.7:0/1945723220 learned_addr learned my addr 172.21.15.7:0/1945723220 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.104+0000 7f80f897f640 1 --2- 172.21.15.7:0/1945723220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f960f5780 0x559f960ec810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.104+0000 7f80f9981640 1 --2- 172.21.15.7:0/1945723220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f960e6700 0x559f960ecd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.105+0000 7f80f9180640 1 -- 172.21.15.7:0/1945723220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f960f5780 msgr2=0x559f960ec810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.105+0000 7f80f9180640 1 --2- 172.21.15.7:0/1945723220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f960f5780 0x559f960ec810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.105+0000 7f80f9180640 1 -- 172.21.15.7:0/1945723220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f960e6700 msgr2=0x559f960ecd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.105+0000 7f80f9180640 1 --2- 172.21.15.7:0/1945723220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f960e6700 0x559f960ecd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.105+0000 7f80f9180640 1 -- 172.21.15.7:0/1945723220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f960fa4d0 con 0x559f960f06f0 2024-09-19T04:17:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.105+0000 7f80f9180640 1 --2- 172.21.15.7:0/1945723220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f960f06f0 0x559f960e61c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f80f001fba0 tx=0x7f80f00092a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9c3c8eb62720d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.105+0000 7f80deffd640 1 -- 172.21.15.7:0/1945723220 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f0029a60 con 0x559f960f06f0 2024-09-19T04:17:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.105+0000 7f80deffd640 1 -- 172.21.15.7:0/1945723220 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80f002d070 con 0x559f960f06f0 2024-09-19T04:17:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.105+0000 7f80deffd640 1 -- 172.21.15.7:0/1945723220 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f00047a0 con 0x559f960f06f0 2024-09-19T04:17:50.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.106+0000 7f80fe258740 1 -- 172.21.15.7:0/1945723220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f960f06f0 msgr2=0x559f960e61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:50.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.106+0000 7f80fe258740 1 --2- 172.21.15.7:0/1945723220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f960f06f0 0x559f960e61c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f80f001fba0 tx=0x7f80f00092a0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.106+0000 7f80fe258740 1 -- 172.21.15.7:0/1945723220 shutdown_connections 2024-09-19T04:17:50.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.106+0000 7f80fe258740 1 --2- 172.21.15.7:0/1945723220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f960e6700 0x559f960ecd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.106+0000 7f80fe258740 1 --2- 172.21.15.7:0/1945723220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f960f5780 0x559f960ec810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.113 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.106+0000 7f80fe258740 1 --2- 172.21.15.7:0/1945723220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f960f06f0 0x559f960e61c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.106+0000 7f80fe258740 1 -- 172.21.15.7:0/1945723220 >> 172.21.15.7:0/1945723220 conn(0x559f960eb420 msgr2=0x559f960f4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.106+0000 7f80fe258740 1 -- 172.21.15.7:0/1945723220 shutdown_connections 2024-09-19T04:17:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.106+0000 7f80fe258740 1 -- 172.21.15.7:0/1945723220 wait complete. 2024-09-19T04:17:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.107+0000 7f80fe258740 1 -- start start 2024-09-19T04:17:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.107+0000 7f80fe258740 1 Processor -- start 2024-09-19T04:17:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.108+0000 7f80fe258740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f960e6700 0x559f96164850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.108+0000 7f80fe258740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f960f06f0 0x559f96164d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.108+0000 7f80fe258740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f960f5780 0x559f9616b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.108+0000 7f80fe258740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f80f41a9b70 con 0x559f960e6700 2024-09-19T04:17:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.108+0000 7f80fe258740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f80f41a94a0 con 0x559f960f5780 2024-09-19T04:17:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.108+0000 7f80fe258740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f80f41a66c0 con 0x559f960f06f0 2024-09-19T04:17:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.108+0000 7f80f9180640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f960e6700 0x559f96164850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.108+0000 7f80f897f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f960f06f0 0x559f96164d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.108+0000 7f80fe258740 10 client.0 _ll_register_callbacks cb 0x7f80f0009ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:17:50.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.108+0000 7f80f897f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f960f06f0 0x559f96164d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:34050/0 (socket says 172.21.15.7:34050) 2024-09-19T04:17:50.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.108+0000 7f80f897f640 1 -- 172.21.15.7:0/1918143620 learned_addr learned my addr 172.21.15.7:0/1918143620 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:17:50.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.108+0000 7f80f9180640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f960e6700 0x559f96164850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54720/0 (socket says 172.21.15.7:54720) 2024-09-19T04:17:50.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.108+0000 7f80f9981640 1 --2- 172.21.15.7:0/1918143620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f960f5780 0x559f9616b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:50.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.108+0000 7f80f897f640 1 -- 172.21.15.7:0/1918143620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f960f5780 msgr2=0x559f9616b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:50.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.108+0000 7f80f897f640 1 --2- 172.21.15.7:0/1918143620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f960f5780 0x559f9616b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.108+0000 7f80f897f640 1 -- 172.21.15.7:0/1918143620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f960e6700 msgr2=0x559f96164850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:17:50.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.108+0000 7f80f897f640 1 --2- 172.21.15.7:0/1918143620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f960e6700 0x559f96164850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.108+0000 7f80f897f640 1 -- 172.21.15.7:0/1918143620 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f9616bfd0 con 0x559f960f06f0 2024-09-19T04:17:50.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.108+0000 7f80f9180640 1 --2- 172.21.15.7:0/1918143620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f960e6700 0x559f96164850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:17:50.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.109+0000 7f80f897f640 1 --2- 172.21.15.7:0/1918143620 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f960f06f0 0x559f96164d90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f80e40ee3c0 tx=0x7f80e40f0c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b399b9f594afec7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:17:50.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.109+0000 7f80dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-19T04:17:50.115 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.109+0000 7f80dcff9640 1 -- 172.21.15.7:0/1918143620 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e4035040 con 0x559f960f06f0 2024-09-19T04:17:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.109+0000 7f80fe258740 1 -- 172.21.15.7:0/1918143620 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80f002d070 con 0x559f960f06f0 2024-09-19T04:17:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.109+0000 7f80dcff9640 1 -- 172.21.15.7:0/1918143620 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f80e40ee090 con 0x559f960f06f0 2024-09-19T04:17:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.109+0000 7f80dcff9640 1 -- 172.21.15.7:0/1918143620 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f80e40bc950 con 0x559f960f06f0 2024-09-19T04:17:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.109+0000 7f80fe258740 10 client.25258 fetch_fsmap learned FSMap version 28 2024-09-19T04:17:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.109+0000 7f80fe258740 1 -- 172.21.15.7:0/1918143620 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559f9616d400 con 0x559f960f06f0 2024-09-19T04:17:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.109+0000 7f80dcff9640 1 -- 172.21.15.7:0/1918143620 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80f002d070 con 0x559f960f06f0 2024-09-19T04:17:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.109+0000 7f80dcff9640 1 -- 172.21.15.7:0/1918143620 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f80e40db1e0 con 0x559f960f06f0 2024-09-19T04:17:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.109+0000 7f80fe258740 10 client.25258 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:17:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.109+0000 7f80fe258740 10 client.25258 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:17:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.109+0000 7f80fe258740 20 client.25258 populate_metadata read hostname 'smithi007' 2024-09-19T04:17:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.110+0000 7f80fe258740 1 --2- 172.21.15.7:0/1918143620 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x559f9616dd00 0x559f961700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:17:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.110+0000 7f80fe258740 4 client.25258 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:17:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.110+0000 7f80fe258740 1 -- 172.21.15.7:0/1918143620 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559f96056d70 con 0x559f9616dd00 2024-09-19T04:17:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.110+0000 7f80f9180640 1 --2- 172.21.15.7:0/1918143620 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x559f9616dd00 0x559f961700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:17:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.110+0000 7f80dcff9640 10 client.25258 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:17:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.110+0000 7f80f9180640 1 --2- 172.21.15.7:0/1918143620 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x559f9616dd00 0x559f961700f0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e56b3d07b13e3821 server_cookie=87ee227326792537 in_seq=0 out_seq=0 2024-09-19T04:17:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.118+0000 7f80dcff9640 1 -- 172.21.15.7:0/1918143620 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559f96056d70 con 0x559f9616dd00 2024-09-19T04:17:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.118+0000 7f80dcff9640 10 client.25258 handle_command_reply: tid=0 2024-09-19T04:17:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.118+0000 7f80fe258740 1 client.25258 shutdown 2024-09-19T04:17:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.118+0000 7f80fe258740 1 -- 172.21.15.7:0/1918143620 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f960f06f0 msgr2=0x559f96164d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.118+0000 7f80fe258740 1 --2- 172.21.15.7:0/1918143620 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f960f06f0 0x559f96164d90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f80e40ee3c0 tx=0x7f80e40f0c00 comp rx=0 tx=0).stop 2024-09-19T04:17:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.118+0000 7f80fe258740 1 -- 172.21.15.7:0/1918143620 shutdown_connections 2024-09-19T04:17:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.118+0000 7f80fe258740 1 --2- 172.21.15.7:0/1918143620 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x559f9616dd00 0x559f961700f0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.118+0000 7f80fe258740 1 --2- 172.21.15.7:0/1918143620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f960f5780 0x559f9616b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.118+0000 7f80dcff9640 0 client.25258 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:17:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.118+0000 7f80fe258740 1 --2- 172.21.15.7:0/1918143620 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f960f06f0 0x559f96164d90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.118+0000 7f80fe258740 1 --2- 172.21.15.7:0/1918143620 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f960e6700 0x559f96164850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.118+0000 7f80fe258740 1 -- 172.21.15.7:0/1918143620 >> 172.21.15.7:0/1918143620 conn(0x559f960eb420 msgr2=0x559f960eb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.118+0000 7f80fe258740 1 -- 172.21.15.7:0/1918143620 shutdown_connections 2024-09-19T04:17:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.118+0000 7f80fe258740 1 -- 172.21.15.7:0/1918143620 wait complete. 2024-09-19T04:17:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.118+0000 7f80fe258740 20 client.25258 trim_cache size 0 max 16384 2024-09-19T04:17:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:17:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:17:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:17:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:17:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.119+0000 7f80fb3e4640 1 -- 172.21.15.7:0/2353854073 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f80e00a32d0 msgr2=0x7f80e00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.119+0000 7f80fb3e4640 1 --2- 172.21.15.7:0/2353854073 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f80e00a32d0 0x7f80e00a5790 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x559f960f1120 tx=0x7f80f0005f90 comp rx=0 tx=0).stop 2024-09-19T04:17:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.119+0000 7f80fb3e4640 1 -- 172.21.15.7:0/2353854073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80f4104f50 msgr2=0x7f80f4198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:17:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.119+0000 7f80fb3e4640 1 --2- 172.21.15.7:0/2353854073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80f4104f50 0x7f80f4198470 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f80e4031610 tx=0x7f80e4004270 comp rx=0 tx=0).stop 2024-09-19T04:17:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.119+0000 7f80fb3e4640 1 -- 172.21.15.7:0/2353854073 shutdown_connections 2024-09-19T04:17:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.119+0000 7f80fb3e4640 1 --2- 172.21.15.7:0/2353854073 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f80e00a32d0 0x7f80e00a5790 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.119+0000 7f80fb3e4640 1 --2- 172.21.15.7:0/2353854073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80f4107880 0x7f80f419f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.119+0000 7f80fb3e4640 1 --2- 172.21.15.7:0/2353854073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f80f4104f50 0x7f80f4198470 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.119+0000 7f80fb3e4640 1 --2- 172.21.15.7:0/2353854073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80f4102620 0x7f80f4197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:17:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.119+0000 7f80fb3e4640 1 -- 172.21.15.7:0/2353854073 >> 172.21.15.7:0/2353854073 conn(0x7f80f40fc1c0 msgr2=0x7f80f4102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:17:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.119+0000 7f80fb3e4640 1 -- 172.21.15.7:0/2353854073 shutdown_connections 2024-09-19T04:17:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:17:50.119+0000 7f80fb3e4640 1 -- 172.21.15.7:0/2353854073 wait complete. 2024-09-19T04:17:50.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:50 smithi092 ceph-mon[34940]: pgmap v382: 129 pgs: 129 active+clean; 670 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-19T04:17:50.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:50 smithi007 ceph-mon[31360]: pgmap v382: 129 pgs: 129 active+clean; 670 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-19T04:17:50.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:50 smithi102 ceph-mon[35446]: pgmap v382: 129 pgs: 129 active+clean; 670 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 767 B/s wr, 12 op/s 2024-09-19T04:17:52.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:52 smithi092 ceph-mon[34940]: pgmap v383: 129 pgs: 129 active+clean; 670 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-19T04:17:52.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:52 smithi007 ceph-mon[31360]: pgmap v383: 129 pgs: 129 active+clean; 670 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-19T04:17:52.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:52 smithi102 ceph-mon[35446]: pgmap v383: 129 pgs: 129 active+clean; 670 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 8 op/s 2024-09-19T04:17:54.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:54 smithi092 ceph-mon[34940]: pgmap v384: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-19T04:17:54.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:54 smithi007 ceph-mon[31360]: pgmap v384: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-19T04:17:54.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:54 smithi102 ceph-mon[35446]: pgmap v384: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 938 B/s wr, 11 op/s 2024-09-19T04:17:56.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:56 smithi092 ceph-mon[34940]: pgmap v385: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-19T04:17:56.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:56 smithi007 ceph-mon[31360]: pgmap v385: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-19T04:17:56.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:56 smithi102 ceph-mon[35446]: pgmap v385: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-19T04:17:58.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:17:58 smithi092 ceph-mon[34940]: pgmap v386: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-19T04:17:58.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:17:58 smithi007 ceph-mon[31360]: pgmap v386: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-19T04:17:58.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:17:58 smithi102 ceph-mon[35446]: pgmap v386: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-19T04:18:00.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:00 smithi092 ceph-mon[34940]: pgmap v387: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 13 op/s 2024-09-19T04:18:00.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:00 smithi007 ceph-mon[31360]: pgmap v387: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 13 op/s 2024-09-19T04:18:00.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:00 smithi102 ceph-mon[35446]: pgmap v387: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 13 op/s 2024-09-19T04:18:02.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:02 smithi092 ceph-mon[34940]: pgmap v388: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-19T04:18:02.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:02 smithi007 ceph-mon[31360]: pgmap v388: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-19T04:18:02.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:02 smithi102 ceph-mon[35446]: pgmap v388: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-19T04:18:03.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.246+0000 7f5282a50640 1 -- 172.21.15.7:0/77140231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f527c103710 msgr2=0x7f527c109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:03.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.246+0000 7f5282a50640 1 --2- 172.21.15.7:0/77140231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f527c103710 0x7f527c109fa0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5274009ca0 tx=0x7f527402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.247+0000 7f5282a50640 1 -- 172.21.15.7:0/77140231 shutdown_connections 2024-09-19T04:18:03.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.247+0000 7f5282a50640 1 --2- 172.21.15.7:0/77140231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f527c103710 0x7f527c109fa0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.247+0000 7f5282a50640 1 --2- 172.21.15.7:0/77140231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f527c102d50 0x7f527c1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.247+0000 7f5282a50640 1 --2- 172.21.15.7:0/77140231 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f527c101b60 0x7f527c101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.247+0000 7f5282a50640 1 -- 172.21.15.7:0/77140231 >> 172.21.15.7:0/77140231 conn(0x7f527c0fd2e0 msgr2=0x7f527c0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.247+0000 7f5282a50640 1 -- 172.21.15.7:0/77140231 shutdown_connections 2024-09-19T04:18:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.247+0000 7f5282a50640 1 -- 172.21.15.7:0/77140231 wait complete. 2024-09-19T04:18:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.247+0000 7f5282a50640 1 Processor -- start 2024-09-19T04:18:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.247+0000 7f5282a50640 1 -- start start 2024-09-19T04:18:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.248+0000 7f5282a50640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f527c101b60 0x7f527c197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:03.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.248+0000 7f5282a50640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f527c102d50 0x7f527c1983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.248+0000 7f5282a50640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f527c103710 0x7f527c19f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.248+0000 7f5282a50640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f527c10d7e0 con 0x7f527c101b60 2024-09-19T04:18:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.248+0000 7f5282a50640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f527c10d660 con 0x7f527c102d50 2024-09-19T04:18:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.248+0000 7f5282a50640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f527c10d960 con 0x7f527c103710 2024-09-19T04:18:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.248+0000 7f527bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f527c101b60 0x7f527c197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.248+0000 7f527bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f527c101b60 0x7f527c197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57054/0 (socket says 172.21.15.7:57054) 2024-09-19T04:18:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.248+0000 7f527bfff640 1 -- 172.21.15.7:0/2788521251 learned_addr learned my addr 172.21.15.7:0/2788521251 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.248+0000 7f527b7fe640 1 --2- 172.21.15.7:0/2788521251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f527c102d50 0x7f527c1983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:03.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.248+0000 7f5280fed640 1 --2- 172.21.15.7:0/2788521251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f527c103710 0x7f527c19f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:03.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.248+0000 7f527bfff640 1 -- 172.21.15.7:0/2788521251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f527c103710 msgr2=0x7f527c19f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:03.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.248+0000 7f527bfff640 1 --2- 172.21.15.7:0/2788521251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f527c103710 0x7f527c19f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.248+0000 7f527bfff640 1 -- 172.21.15.7:0/2788521251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f527c102d50 msgr2=0x7f527c1983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:03.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.248+0000 7f527bfff640 1 --2- 172.21.15.7:0/2788521251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f527c102d50 0x7f527c1983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.248+0000 7f527bfff640 1 -- 172.21.15.7:0/2788521251 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f527c19fa80 con 0x7f527c101b60 2024-09-19T04:18:03.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.248+0000 7f527bfff640 1 --2- 172.21.15.7:0/2788521251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f527c101b60 0x7f527c197e60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f526c00d950 tx=0x7f526c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:03.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.249+0000 7f52797fa640 1 -- 172.21.15.7:0/2788521251 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c017070 con 0x7f527c101b60 2024-09-19T04:18:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.249+0000 7f52797fa640 1 -- 172.21.15.7:0/2788521251 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f526c009c30 con 0x7f527c101b60 2024-09-19T04:18:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.249+0000 7f5282a50640 1 -- 172.21.15.7:0/2788521251 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f527c19fd70 con 0x7f527c101b60 2024-09-19T04:18:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.249+0000 7f5282a50640 1 -- 172.21.15.7:0/2788521251 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f527c1a01b0 con 0x7f527c101b60 2024-09-19T04:18:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.249+0000 7f52797fa640 1 -- 172.21.15.7:0/2788521251 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c00f600 con 0x7f527c101b60 2024-09-19T04:18:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.251+0000 7f52797fa640 1 -- 172.21.15.7:0/2788521251 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f526c01a070 con 0x7f527c101b60 2024-09-19T04:18:03.256 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.252+0000 7f52797fa640 1 --2- 172.21.15.7:0/2788521251 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f52640a3350 0x7f52640a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:03.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.253+0000 7f52857e2740 1 Processor -- start 2024-09-19T04:18:03.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.253+0000 7f52797fa640 1 -- 172.21.15.7:0/2788521251 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f526c0cf970 con 0x7f527c101b60 2024-09-19T04:18:03.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.253+0000 7f527b7fe640 1 --2- 172.21.15.7:0/2788521251 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f52640a3350 0x7f52640a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:03.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.253+0000 7f52857e2740 1 -- start start 2024-09-19T04:18:03.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.253+0000 7f527b7fe640 1 --2- 172.21.15.7:0/2788521251 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f52640a3350 0x7f52640a5810 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5270005fd0 tx=0x7f5270005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:03.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.253+0000 7f52857e2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56449400c9a0 0x56449400cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:03.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.253+0000 7f52857e2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449400d2e0 0x564494011da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:03.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.254+0000 7f52857e2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564494012370 0x564494014830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:03.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.254+0000 7f52857e2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564493f702f0 con 0x564494012370 2024-09-19T04:18:03.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.254+0000 7f52857e2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564493f18270 con 0x56449400d2e0 2024-09-19T04:18:03.257 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.254+0000 7f527b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449400d2e0 0x564494011da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.254+0000 7f527b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449400d2e0 0x564494011da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:47364/0 (socket says 172.21.15.7:47364) 2024-09-19T04:18:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.254+0000 7f527bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56449400c9a0 0x56449400cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.254+0000 7f527b7fe640 1 -- 172.21.15.7:0/3283998890 learned_addr learned my addr 172.21.15.7:0/3283998890 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.254+0000 7f5280fed640 1 --2- 172.21.15.7:0/3283998890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564494012370 0x564494014830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.254+0000 7f52857e2740 1 -- 172.21.15.7:0/3283998890 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564493f6c2b0 con 0x56449400c9a0 2024-09-19T04:18:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.254+0000 7f5280fed640 1 -- 172.21.15.7:0/3283998890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56449400c9a0 msgr2=0x56449400cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.254+0000 7f5280fed640 1 --2- 172.21.15.7:0/3283998890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56449400c9a0 0x56449400cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.254+0000 7f5280fed640 1 -- 172.21.15.7:0/3283998890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449400d2e0 msgr2=0x564494011da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.254+0000 7f5280fed640 1 --2- 172.21.15.7:0/3283998890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449400d2e0 0x564494011da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.254+0000 7f5280fed640 1 -- 172.21.15.7:0/3283998890 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564493f17340 con 0x564494012370 2024-09-19T04:18:03.258 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.255+0000 7f5280fed640 1 --2- 172.21.15.7:0/3283998890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564494012370 0x564494014830 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5274031ae0 tx=0x7f52740093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a89d318f2de962a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:03.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.255+0000 7f52627fc640 1 -- 172.21.15.7:0/3283998890 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5274031cb0 con 0x564494012370 2024-09-19T04:18:03.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.255+0000 7f52627fc640 1 -- 172.21.15.7:0/3283998890 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5274036050 con 0x564494012370 2024-09-19T04:18:03.259 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.255+0000 7f52627fc640 1 -- 172.21.15.7:0/3283998890 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52740042a0 con 0x564494012370 2024-09-19T04:18:03.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.256+0000 7f52857e2740 1 -- 172.21.15.7:0/3283998890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564494012370 msgr2=0x564494014830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:03.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.256+0000 7f52857e2740 1 --2- 172.21.15.7:0/3283998890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564494012370 0x564494014830 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5274031ae0 tx=0x7f52740093e0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.256+0000 7f52857e2740 1 -- 172.21.15.7:0/3283998890 shutdown_connections 2024-09-19T04:18:03.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.256+0000 7f52857e2740 1 --2- 172.21.15.7:0/3283998890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564494012370 0x564494014830 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.256+0000 7f52857e2740 1 --2- 172.21.15.7:0/3283998890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449400d2e0 0x564494011da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.257+0000 7f52857e2740 1 --2- 172.21.15.7:0/3283998890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56449400c9a0 0x56449400cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.257+0000 7f52857e2740 1 -- 172.21.15.7:0/3283998890 >> 172.21.15.7:0/3283998890 conn(0x564494008010 msgr2=0x564494008410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:03.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.257+0000 7f52857e2740 1 -- 172.21.15.7:0/3283998890 shutdown_connections 2024-09-19T04:18:03.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.257+0000 7f52857e2740 1 -- 172.21.15.7:0/3283998890 wait complete. 2024-09-19T04:18:03.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.257+0000 7f52857e2740 1 -- start start 2024-09-19T04:18:03.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.258+0000 7f52857e2740 1 Processor -- start 2024-09-19T04:18:03.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.258+0000 7f52857e2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449400c9a0 0x564494016a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:03.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.258+0000 7f52857e2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56449400d2e0 0x564494016f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:03.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.258+0000 7f52857e2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564494012370 0x56449401dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:03.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.259+0000 7f52857e2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564494015160 con 0x56449400d2e0 2024-09-19T04:18:03.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.259+0000 7f527bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449400c9a0 0x564494016a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:03.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.259+0000 7f527b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56449400d2e0 0x564494016f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:03.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.259+0000 7f527bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449400c9a0 0x564494016a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:47372/0 (socket says 172.21.15.7:47372) 2024-09-19T04:18:03.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.259+0000 7f527bfff640 1 -- 172.21.15.7:0/1203792427 learned_addr learned my addr 172.21.15.7:0/1203792427 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:03.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.259+0000 7f52857e2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564493ef9290 con 0x56449400c9a0 2024-09-19T04:18:03.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.259+0000 7f5280fed640 1 --2- 172.21.15.7:0/1203792427 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564494012370 0x56449401dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:03.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.259+0000 7f52857e2740 1 -- 172.21.15.7:0/1203792427 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5644940152e0 con 0x564494012370 2024-09-19T04:18:03.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.259+0000 7f52857e2740 10 client.0 _ll_register_callbacks cb 0x564493f2a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:18:03.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.259+0000 7f527b7fe640 1 -- 172.21.15.7:0/1203792427 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564494012370 msgr2=0x56449401dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:03.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.259+0000 7f527b7fe640 1 --2- 172.21.15.7:0/1203792427 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564494012370 0x56449401dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.259+0000 7f527b7fe640 1 -- 172.21.15.7:0/1203792427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449400c9a0 msgr2=0x564494016a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:03.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.259+0000 7f527b7fe640 1 --2- 172.21.15.7:0/1203792427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449400c9a0 0x564494016a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.259+0000 7f527b7fe640 1 -- 172.21.15.7:0/1203792427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564493c83210 con 0x56449400d2e0 2024-09-19T04:18:03.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.259+0000 7f527bfff640 1 --2- 172.21.15.7:0/1203792427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449400c9a0 0x564494016a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:18:03.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.260+0000 7f527b7fe640 1 --2- 172.21.15.7:0/1203792427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56449400d2e0 0x564494016f90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x56449400dd10 tx=0x7f52700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d831fd28130213d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:03.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.260+0000 7f525b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:18:03.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.260+0000 7f525b7fe640 1 -- 172.21.15.7:0/1203792427 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527001f840 con 0x56449400d2e0 2024-09-19T04:18:03.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.260+0000 7f525b7fe640 1 -- 172.21.15.7:0/1203792427 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f527001f9e0 con 0x56449400d2e0 2024-09-19T04:18:03.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.260+0000 7f52857e2740 1 -- 172.21.15.7:0/1203792427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5274036050 con 0x56449400d2e0 2024-09-19T04:18:03.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.260+0000 7f525b7fe640 1 -- 172.21.15.7:0/1203792427 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f527001fbe0 con 0x56449400d2e0 2024-09-19T04:18:03.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.260+0000 7f52857e2740 10 client.15564 fetch_fsmap learned FSMap version 28 2024-09-19T04:18:03.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.260+0000 7f52857e2740 1 -- 172.21.15.7:0/1203792427 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564493d4f620 con 0x56449400d2e0 2024-09-19T04:18:03.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.261+0000 7f525b7fe640 1 -- 172.21.15.7:0/1203792427 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5274036050 con 0x56449400d2e0 2024-09-19T04:18:03.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.261+0000 7f525b7fe640 1 -- 172.21.15.7:0/1203792427 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5270032420 con 0x56449400d2e0 2024-09-19T04:18:03.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.261+0000 7f52857e2740 10 client.15564 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:18:03.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.261+0000 7f52857e2740 10 client.15564 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:18:03.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.261+0000 7f52857e2740 20 client.15564 populate_metadata read hostname 'smithi007' 2024-09-19T04:18:03.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.261+0000 7f52857e2740 1 --2- 172.21.15.7:0/1203792427 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564494022690 0x564494024ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:03.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.261+0000 7f52857e2740 4 client.15564 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:18:03.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.261+0000 7f52857e2740 1 -- 172.21.15.7:0/1203792427 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564493f7da20 con 0x564494022690 2024-09-19T04:18:03.267 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.262+0000 7f527bfff640 1 --2- 172.21.15.7:0/1203792427 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564494022690 0x564494024ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:03.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.262+0000 7f527bfff640 1 --2- 172.21.15.7:0/1203792427 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564494022690 0x564494024ac0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4efe467ef394b556 server_cookie=dcaa03ff49345931 in_seq=0 out_seq=0 2024-09-19T04:18:03.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.262+0000 7f525b7fe640 10 client.15564 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:03.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.263+0000 7f525b7fe640 1 -- 172.21.15.7:0/1203792427 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564493f7da20 con 0x564494022690 2024-09-19T04:18:03.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.263+0000 7f525b7fe640 10 client.15564 handle_command_reply: tid=0 2024-09-19T04:18:03.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.263+0000 7f52857e2740 1 client.15564 shutdown 2024-09-19T04:18:03.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.263+0000 7f52857e2740 1 -- 172.21.15.7:0/1203792427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56449400d2e0 msgr2=0x564494016f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:03.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.263+0000 7f52857e2740 1 --2- 172.21.15.7:0/1203792427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56449400d2e0 0x564494016f90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x56449400dd10 tx=0x7f52700046c0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.263+0000 7f52857e2740 1 -- 172.21.15.7:0/1203792427 shutdown_connections 2024-09-19T04:18:03.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.263+0000 7f52857e2740 1 --2- 172.21.15.7:0/1203792427 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564494022690 0x564494024ac0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.263+0000 7f525b7fe640 0 client.15564 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:03.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.263+0000 7f52857e2740 1 --2- 172.21.15.7:0/1203792427 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564494012370 0x56449401dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.268 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.263+0000 7f52857e2740 1 --2- 172.21.15.7:0/1203792427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56449400d2e0 0x564494016f90 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.263+0000 7f52857e2740 1 --2- 172.21.15.7:0/1203792427 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449400c9a0 0x564494016a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.263+0000 7f52857e2740 1 -- 172.21.15.7:0/1203792427 >> 172.21.15.7:0/1203792427 conn(0x564494008010 msgr2=0x564494009820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:03.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.263+0000 7f52857e2740 1 -- 172.21.15.7:0/1203792427 shutdown_connections 2024-09-19T04:18:03.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.263+0000 7f52857e2740 1 -- 172.21.15.7:0/1203792427 wait complete. 2024-09-19T04:18:03.269 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.263+0000 7f52857e2740 20 client.15564 trim_cache size 0 max 16384 2024-09-19T04:18:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.278+0000 7f52857e2740 1 Processor -- start 2024-09-19T04:18:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.278+0000 7f52857e2740 1 -- start start 2024-09-19T04:18:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.278+0000 7f52857e2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56449400c9a0 0x564494015750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.278+0000 7f52857e2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564494012370 0x5644940070b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.278+0000 7f52857e2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644940075f0 0x56449400f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.278+0000 7f52857e2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f527c1aa890 con 0x5644940075f0 2024-09-19T04:18:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.278+0000 7f52857e2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f527c1ac3d0 con 0x564494012370 2024-09-19T04:18:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.278+0000 7f52857e2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f527c1aaf60 con 0x56449400c9a0 2024-09-19T04:18:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.278+0000 7f5280fed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644940075f0 0x56449400f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.278+0000 7f5280fed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644940075f0 0x56449400f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57082/0 (socket says 172.21.15.7:57082) 2024-09-19T04:18:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.278+0000 7f5280fed640 1 -- 172.21.15.7:0/1940618047 learned_addr learned my addr 172.21.15.7:0/1940618047 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.278+0000 7f527b7fe640 1 --2- 172.21.15.7:0/1940618047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564494012370 0x5644940070b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.278+0000 7f527bfff640 1 --2- 172.21.15.7:0/1940618047 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56449400c9a0 0x564494015750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.279+0000 7f527b7fe640 1 -- 172.21.15.7:0/1940618047 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56449400c9a0 msgr2=0x564494015750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.279+0000 7f527b7fe640 1 --2- 172.21.15.7:0/1940618047 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56449400c9a0 0x564494015750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.279+0000 7f527b7fe640 1 -- 172.21.15.7:0/1940618047 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644940075f0 msgr2=0x56449400f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.279+0000 7f527b7fe640 1 --2- 172.21.15.7:0/1940618047 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644940075f0 0x56449400f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.279+0000 7f527b7fe640 1 -- 172.21.15.7:0/1940618047 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56449400d7c0 con 0x564494012370 2024-09-19T04:18:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.279+0000 7f527b7fe640 1 --2- 172.21.15.7:0/1940618047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564494012370 0x5644940070b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5270018000 tx=0x7f5270005c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=830aa064d1281c82 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.279+0000 7f5261ffb640 1 -- 172.21.15.7:0/1940618047 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5270040070 con 0x564494012370 2024-09-19T04:18:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.279+0000 7f5261ffb640 1 -- 172.21.15.7:0/1940618047 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5270023070 con 0x564494012370 2024-09-19T04:18:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.279+0000 7f5261ffb640 1 -- 172.21.15.7:0/1940618047 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5270032a10 con 0x564494012370 2024-09-19T04:18:03.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.280+0000 7f52857e2740 1 -- 172.21.15.7:0/1940618047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564494012370 msgr2=0x5644940070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:03.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.280+0000 7f52857e2740 1 --2- 172.21.15.7:0/1940618047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564494012370 0x5644940070b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5270018000 tx=0x7f5270005c50 comp rx=0 tx=0).stop 2024-09-19T04:18:03.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.280+0000 7f52857e2740 1 -- 172.21.15.7:0/1940618047 shutdown_connections 2024-09-19T04:18:03.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.280+0000 7f52857e2740 1 --2- 172.21.15.7:0/1940618047 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644940075f0 0x56449400f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.280+0000 7f52857e2740 1 --2- 172.21.15.7:0/1940618047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564494012370 0x5644940070b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.280+0000 7f52857e2740 1 --2- 172.21.15.7:0/1940618047 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56449400c9a0 0x564494015750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.287 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.280+0000 7f52857e2740 1 -- 172.21.15.7:0/1940618047 >> 172.21.15.7:0/1940618047 conn(0x564494008010 msgr2=0x5644940069a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:03.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.280+0000 7f52857e2740 1 -- 172.21.15.7:0/1940618047 shutdown_connections 2024-09-19T04:18:03.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.280+0000 7f52857e2740 1 -- 172.21.15.7:0/1940618047 wait complete. 2024-09-19T04:18:03.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.280+0000 7f52857e2740 1 -- start start 2024-09-19T04:18:03.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.281+0000 7f52857e2740 1 Processor -- start 2024-09-19T04:18:03.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.281+0000 7f52857e2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5644940075f0 0x56449408b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:03.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.281+0000 7f52857e2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449400c9a0 0x56449408dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:03.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.281+0000 7f52857e2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564494012370 0x564494090480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:03.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.281+0000 7f52857e2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f527c1abd00 con 0x564494012370 2024-09-19T04:18:03.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.281+0000 7f52857e2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f527c1ab630 con 0x56449400c9a0 2024-09-19T04:18:03.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.281+0000 7f52857e2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f527c1a8850 con 0x5644940075f0 2024-09-19T04:18:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.281+0000 7f52857e2740 10 client.0 _ll_register_callbacks cb 0x7f527000fb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:18:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.281+0000 7f5280fed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564494012370 0x564494090480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.281+0000 7f5280fed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564494012370 0x564494090480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57096/0 (socket says 172.21.15.7:57096) 2024-09-19T04:18:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.281+0000 7f5280fed640 1 -- 172.21.15.7:0/2372707259 learned_addr learned my addr 172.21.15.7:0/2372707259 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.281+0000 7f527b7fe640 1 --2- 172.21.15.7:0/2372707259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449400c9a0 0x56449408dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.281+0000 7f527bfff640 1 --2- 172.21.15.7:0/2372707259 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5644940075f0 0x56449408b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.282+0000 7f5280fed640 1 -- 172.21.15.7:0/2372707259 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5644940075f0 msgr2=0x56449408b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.282+0000 7f5280fed640 1 --2- 172.21.15.7:0/2372707259 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5644940075f0 0x56449408b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.282+0000 7f5280fed640 1 -- 172.21.15.7:0/2372707259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449400c9a0 msgr2=0x56449408dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.282+0000 7f5280fed640 1 --2- 172.21.15.7:0/2372707259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449400c9a0 0x56449408dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.282+0000 7f5280fed640 1 -- 172.21.15.7:0/2372707259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564494090cb0 con 0x564494012370 2024-09-19T04:18:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.282+0000 7f5280fed640 1 --2- 172.21.15.7:0/2372707259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564494012370 0x564494090480 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f5274005e30 tx=0x7f5274009b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19028f480a0f9e1e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:03.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.282+0000 7f525b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:18:03.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.282+0000 7f525b7fe640 1 -- 172.21.15.7:0/2372707259 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5274049040 con 0x564494012370 2024-09-19T04:18:03.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.282+0000 7f525b7fe640 1 -- 172.21.15.7:0/2372707259 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f5274031650 con 0x564494012370 2024-09-19T04:18:03.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.282+0000 7f52857e2740 1 -- 172.21.15.7:0/2372707259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5270023070 con 0x564494012370 2024-09-19T04:18:03.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.282+0000 7f525b7fe640 1 -- 172.21.15.7:0/2372707259 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5274031850 con 0x564494012370 2024-09-19T04:18:03.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.282+0000 7f52857e2740 10 client.15570 fetch_fsmap learned FSMap version 28 2024-09-19T04:18:03.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.282+0000 7f52857e2740 1 -- 172.21.15.7:0/2372707259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564494091fc0 con 0x564494012370 2024-09-19T04:18:03.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.283+0000 7f525b7fe640 1 -- 172.21.15.7:0/2372707259 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5270023070 con 0x564494012370 2024-09-19T04:18:03.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.283+0000 7f525b7fe640 1 -- 172.21.15.7:0/2372707259 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5274042070 con 0x564494012370 2024-09-19T04:18:03.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.283+0000 7f52857e2740 10 client.15570 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:18:03.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.283+0000 7f52857e2740 10 client.15570 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:18:03.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.283+0000 7f52857e2740 20 client.15570 populate_metadata read hostname 'smithi007' 2024-09-19T04:18:03.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.283+0000 7f52857e2740 1 --2- 172.21.15.7:0/2372707259 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564494092690 0x564494094ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:03.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.283+0000 7f52857e2740 4 client.15570 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:18:03.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.283+0000 7f52857e2740 1 -- 172.21.15.7:0/2372707259 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564493f77d70 con 0x564494092690 2024-09-19T04:18:03.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.283+0000 7f527bfff640 1 --2- 172.21.15.7:0/2372707259 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564494092690 0x564494094ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:03.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.284+0000 7f525b7fe640 10 client.15570 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:03.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.284+0000 7f527bfff640 1 --2- 172.21.15.7:0/2372707259 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564494092690 0x564494094ab0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d39a0dffffb5758a server_cookie=3cc415dfe7e0b461 in_seq=0 out_seq=0 2024-09-19T04:18:03.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.287+0000 7f525b7fe640 1 -- 172.21.15.7:0/2372707259 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564493f77d70 con 0x564494092690 2024-09-19T04:18:03.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.287+0000 7f525b7fe640 10 client.15570 handle_command_reply: tid=0 2024-09-19T04:18:03.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.287+0000 7f52857e2740 1 client.15570 shutdown 2024-09-19T04:18:03.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.288+0000 7f52857e2740 1 -- 172.21.15.7:0/2372707259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564494012370 msgr2=0x564494090480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:03.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.288+0000 7f52857e2740 1 --2- 172.21.15.7:0/2372707259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564494012370 0x564494090480 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f5274005e30 tx=0x7f5274009b40 comp rx=0 tx=0).stop 2024-09-19T04:18:03.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.288+0000 7f52857e2740 1 -- 172.21.15.7:0/2372707259 shutdown_connections 2024-09-19T04:18:03.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.288+0000 7f52857e2740 1 --2- 172.21.15.7:0/2372707259 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564494092690 0x564494094ab0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.288+0000 7f525b7fe640 0 client.15570 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:03.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.288+0000 7f52857e2740 1 --2- 172.21.15.7:0/2372707259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564494012370 0x564494090480 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.288+0000 7f52857e2740 1 --2- 172.21.15.7:0/2372707259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56449400c9a0 0x56449408dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.288+0000 7f52857e2740 1 --2- 172.21.15.7:0/2372707259 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5644940075f0 0x56449408b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.288+0000 7f52857e2740 1 -- 172.21.15.7:0/2372707259 >> 172.21.15.7:0/2372707259 conn(0x564494008010 msgr2=0x564494008ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:03.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.288+0000 7f52857e2740 1 -- 172.21.15.7:0/2372707259 shutdown_connections 2024-09-19T04:18:03.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.288+0000 7f52857e2740 1 -- 172.21.15.7:0/2372707259 wait complete. 2024-09-19T04:18:03.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.288+0000 7f52857e2740 20 client.15570 trim_cache size 0 max 16384 2024-09-19T04:18:03.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:18:03.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:18:03.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:18:03.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:18:03.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.289+0000 7f5282a50640 1 -- 172.21.15.7:0/2788521251 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f52640a3350 msgr2=0x7f52640a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:03.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.289+0000 7f5282a50640 1 --2- 172.21.15.7:0/2788521251 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f52640a3350 0x7f52640a5810 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5270005fd0 tx=0x7f5270005850 comp rx=0 tx=0).stop 2024-09-19T04:18:03.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.289+0000 7f5282a50640 1 -- 172.21.15.7:0/2788521251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f527c101b60 msgr2=0x7f527c197e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:03.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.289+0000 7f5282a50640 1 --2- 172.21.15.7:0/2788521251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f527c101b60 0x7f527c197e60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f526c00d950 tx=0x7f526c00de10 comp rx=0 tx=0).stop 2024-09-19T04:18:03.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.289+0000 7f5282a50640 1 -- 172.21.15.7:0/2788521251 shutdown_connections 2024-09-19T04:18:03.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.289+0000 7f5282a50640 1 --2- 172.21.15.7:0/2788521251 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f52640a3350 0x7f52640a5810 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.289+0000 7f5282a50640 1 --2- 172.21.15.7:0/2788521251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f527c103710 0x7f527c19f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.289+0000 7f5282a50640 1 --2- 172.21.15.7:0/2788521251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f527c102d50 0x7f527c1983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.289+0000 7f5282a50640 1 --2- 172.21.15.7:0/2788521251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f527c101b60 0x7f527c197e60 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:03.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.289+0000 7f5282a50640 1 -- 172.21.15.7:0/2788521251 >> 172.21.15.7:0/2788521251 conn(0x7f527c0fd2e0 msgr2=0x7f527c106120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:03.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.289+0000 7f5282a50640 1 -- 172.21.15.7:0/2788521251 shutdown_connections 2024-09-19T04:18:03.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:03.289+0000 7f5282a50640 1 -- 172.21.15.7:0/2788521251 wait complete. 2024-09-19T04:18:04.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:04 smithi092 ceph-mon[34940]: pgmap v389: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-19T04:18:04.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:04 smithi007 ceph-mon[31360]: pgmap v389: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-19T04:18:04.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:04 smithi102 ceph-mon[35446]: pgmap v389: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-19T04:18:06.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:06 smithi092 ceph-mon[34940]: pgmap v390: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-19T04:18:06.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:06 smithi007 ceph-mon[31360]: pgmap v390: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-19T04:18:06.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:06 smithi102 ceph-mon[35446]: pgmap v390: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-19T04:18:08.323 INFO:tasks.workunit.client.0.smithi007.stderr:Updating files: 93% (12098/12896) Updating files: 94% (12123/12896) Updating files: 95% (12252/12896) Updating files: 96% (12381/12896) Updating files: 97% (12510/12896) Updating files: 98% (12639/12896) Updating files: 99% (12768/12896) Updating files: 100% (12896/12896) Updating files: 100% (12896/12896), done. 2024-09-19T04:18:08.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:08 smithi092 ceph-mon[34940]: pgmap v391: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-19T04:18:08.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:08 smithi007 ceph-mon[31360]: pgmap v391: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-19T04:18:08.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:08 smithi102 ceph-mon[35446]: pgmap v391: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-19T04:18:08.758 INFO:tasks.quiescer.fs.[cephfs]:Total duration (40.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T04:18:08.758 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T04:18:08.758 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:18:08.942 INFO:tasks.workunit.client.0.smithi007.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T04:18:08.942 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-19T04:18:08.942 INFO:tasks.workunit.client.0.smithi007.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T04:18:08.942 INFO:tasks.workunit.client.0.smithi007.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T04:18:08.942 INFO:tasks.workunit.client.0.smithi007.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T04:18:08.942 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-19T04:18:08.942 INFO:tasks.workunit.client.0.smithi007.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T04:18:08.942 INFO:tasks.workunit.client.0.smithi007.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T04:18:08.942 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-19T04:18:08.943 INFO:tasks.workunit.client.0.smithi007.stderr: git switch -c 2024-09-19T04:18:08.943 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-19T04:18:08.943 INFO:tasks.workunit.client.0.smithi007.stderr:Or undo this operation with: 2024-09-19T04:18:08.943 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-19T04:18:08.943 INFO:tasks.workunit.client.0.smithi007.stderr: git switch - 2024-09-19T04:18:08.943 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-19T04:18:08.943 INFO:tasks.workunit.client.0.smithi007.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T04:18:08.943 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-19T04:18:08.943 INFO:tasks.workunit.client.0.smithi007.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T04:18:08.947 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T04:18:08.978 INFO:tasks.workunit.client.0.smithi007.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T04:18:08.981 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T04:18:08.981 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T04:18:09.022 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:18:09.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.713+0000 7f52b7025640 1 -- 172.21.15.7:0/2071368349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52b01036e0 msgr2=0x7f52b0107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:09.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.713+0000 7f52b7025640 1 --2- 172.21.15.7:0/2071368349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52b01036e0 0x7f52b0107b90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f5298009930 tx=0x7f529802a420 comp rx=0 tx=0).stop 2024-09-19T04:18:09.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.713+0000 7f52b7025640 1 -- 172.21.15.7:0/2071368349 shutdown_connections 2024-09-19T04:18:09.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.713+0000 7f52b7025640 1 --2- 172.21.15.7:0/2071368349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52b01082a0 0x7f52b010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:09.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.713+0000 7f52b7025640 1 --2- 172.21.15.7:0/2071368349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52b01036e0 0x7f52b0107b90 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:09.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.713+0000 7f52b7025640 1 --2- 172.21.15.7:0/2071368349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52b0102d30 0x7f52b0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:09.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.713+0000 7f52b7025640 1 -- 172.21.15.7:0/2071368349 >> 172.21.15.7:0/2071368349 conn(0x7f52b00fc7d0 msgr2=0x7f52b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:09.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.713+0000 7f52b7025640 1 -- 172.21.15.7:0/2071368349 shutdown_connections 2024-09-19T04:18:09.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.713+0000 7f52b7025640 1 -- 172.21.15.7:0/2071368349 wait complete. 2024-09-19T04:18:09.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.714+0000 7f52b7025640 1 Processor -- start 2024-09-19T04:18:09.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.714+0000 7f52b7025640 1 -- start start 2024-09-19T04:18:09.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.714+0000 7f52b7025640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52b0102d30 0x7f52b019a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:09.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.714+0000 7f52b7025640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52b01036e0 0x7f52b019ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:09.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.714+0000 7f52b7025640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52b01082a0 0x7f52b019f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:09.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.714+0000 7f52b7025640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f52b01120a0 con 0x7f52b01036e0 2024-09-19T04:18:09.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.714+0000 7f52b7025640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f52b0111f20 con 0x7f52b01082a0 2024-09-19T04:18:09.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.714+0000 7f52b7025640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f52b0112220 con 0x7f52b0102d30 2024-09-19T04:18:09.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.714+0000 7f52affff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52b01036e0 0x7f52b019ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:09.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.714+0000 7f52affff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52b01036e0 0x7f52b019ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56612/0 (socket says 172.21.15.7:56612) 2024-09-19T04:18:09.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.714+0000 7f52affff640 1 -- 172.21.15.7:0/2817218341 learned_addr learned my addr 172.21.15.7:0/2817218341 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:09.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.714+0000 7f52b4dc1640 1 --2- 172.21.15.7:0/2817218341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52b0102d30 0x7f52b019a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:09.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.714+0000 7f52b55c2640 1 --2- 172.21.15.7:0/2817218341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52b01082a0 0x7f52b019f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:09.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.714+0000 7f52affff640 1 -- 172.21.15.7:0/2817218341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52b0102d30 msgr2=0x7f52b019a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:09.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.714+0000 7f52affff640 1 --2- 172.21.15.7:0/2817218341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52b0102d30 0x7f52b019a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:09.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.714+0000 7f52affff640 1 -- 172.21.15.7:0/2817218341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52b01082a0 msgr2=0x7f52b019f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:09.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.714+0000 7f52affff640 1 --2- 172.21.15.7:0/2817218341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52b01082a0 0x7f52b019f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:09.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.714+0000 7f52affff640 1 -- 172.21.15.7:0/2817218341 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b019f700 con 0x7f52b01036e0 2024-09-19T04:18:09.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.715+0000 7f52affff640 1 --2- 172.21.15.7:0/2817218341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52b01036e0 0x7f52b019ac90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5298005940 tx=0x7f52980042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:09.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.715+0000 7f52adffb640 1 -- 172.21.15.7:0/2817218341 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529803f030 con 0x7f52b01036e0 2024-09-19T04:18:09.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.715+0000 7f52adffb640 1 -- 172.21.15.7:0/2817218341 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5298003ce0 con 0x7f52b01036e0 2024-09-19T04:18:09.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.715+0000 7f52b7025640 1 -- 172.21.15.7:0/2817218341 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52b019f990 con 0x7f52b01036e0 2024-09-19T04:18:09.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.715+0000 7f52adffb640 1 -- 172.21.15.7:0/2817218341 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5298035070 con 0x7f52b01036e0 2024-09-19T04:18:09.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.715+0000 7f52b7025640 1 -- 172.21.15.7:0/2817218341 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52b01a72d0 con 0x7f52b01036e0 2024-09-19T04:18:09.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.716+0000 7f52b7025640 1 -- 172.21.15.7:0/2817218341 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52b0103110 con 0x7f52b01036e0 2024-09-19T04:18:09.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.717+0000 7f52adffb640 1 -- 172.21.15.7:0/2817218341 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7f5298042030 con 0x7f52b01036e0 2024-09-19T04:18:09.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.718+0000 7f52adffb640 1 --2- 172.21.15.7:0/2817218341 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f529c0a32d0 0x7f529c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:09.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.718+0000 7f52b4dc1640 1 --2- 172.21.15.7:0/2817218341 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f529c0a32d0 0x7f529c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:09.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.718+0000 7f52adffb640 1 -- 172.21.15.7:0/2817218341 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f52980f02f0 con 0x7f52b01036e0 2024-09-19T04:18:09.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.719+0000 7f52b4dc1640 1 --2- 172.21.15.7:0/2817218341 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f529c0a32d0 0x7f529c0a5790 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f52a8005fd0 tx=0x7f52a8009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:09.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.723+0000 7f52adffb640 1 -- 172.21.15.7:0/2817218341 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f52980bcae0 con 0x7f52b01036e0 2024-09-19T04:18:09.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.936+0000 7f52b7025640 1 -- 172.21.15.7:0/2817218341 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52b010c2c0 con 0x7f52b01036e0 2024-09-19T04:18:09.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.937+0000 7f52adffb640 1 -- 172.21.15.7:0/2817218341 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11962 (secure 0 0 0) 0x7f52980bc3e0 con 0x7f52b01036e0 2024-09-19T04:18:09.939 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:18:09.939 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":28,"btime":"2024-09-19T04:16:57:081835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:16:56.259017+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24496,"mds_2":24482,"mds_3":24478,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24472,24478,24482,24496,24506]},"id":1}]} 2024-09-19T04:18:09.939 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 28 2024-09-19T04:18:09.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.939+0000 7f52b7025640 1 -- 172.21.15.7:0/2817218341 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f529c0a32d0 msgr2=0x7f529c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:09.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.939+0000 7f52b7025640 1 --2- 172.21.15.7:0/2817218341 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f529c0a32d0 0x7f529c0a5790 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f52a8005fd0 tx=0x7f52a8009760 comp rx=0 tx=0).stop 2024-09-19T04:18:09.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.939+0000 7f52b7025640 1 -- 172.21.15.7:0/2817218341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52b01036e0 msgr2=0x7f52b019ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:09.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.939+0000 7f52b7025640 1 --2- 172.21.15.7:0/2817218341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52b01036e0 0x7f52b019ac90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5298005940 tx=0x7f52980042f0 comp rx=0 tx=0).stop 2024-09-19T04:18:09.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.939+0000 7f52b7025640 1 -- 172.21.15.7:0/2817218341 shutdown_connections 2024-09-19T04:18:09.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.939+0000 7f52b7025640 1 --2- 172.21.15.7:0/2817218341 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f529c0a32d0 0x7f529c0a5790 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:09.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.939+0000 7f52b7025640 1 --2- 172.21.15.7:0/2817218341 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52b01082a0 0x7f52b019f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:09.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.939+0000 7f52b7025640 1 --2- 172.21.15.7:0/2817218341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52b01036e0 0x7f52b019ac90 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:09.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.939+0000 7f52b7025640 1 --2- 172.21.15.7:0/2817218341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52b0102d30 0x7f52b019a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:09.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.939+0000 7f52b7025640 1 -- 172.21.15.7:0/2817218341 >> 172.21.15.7:0/2817218341 conn(0x7f52b00fc7d0 msgr2=0x7f52b0100ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:09.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.939+0000 7f52b7025640 1 -- 172.21.15.7:0/2817218341 shutdown_connections 2024-09-19T04:18:09.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:09.939+0000 7f52b7025640 1 -- 172.21.15.7:0/2817218341 wait complete. 2024-09-19T04:18:10.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:10 smithi007 ceph-mon[31360]: pgmap v392: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-19T04:18:10.438 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:10 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2817218341' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:18:10.627 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T04:18:10.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:10 smithi102 ceph-mon[35446]: pgmap v392: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-19T04:18:10.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:10 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2817218341' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:18:10.758 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T04:18:10.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:10 smithi092 ceph-mon[34940]: pgmap v392: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-19T04:18:10.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:10 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2817218341' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:18:10.800 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T04:18:10.802 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T04:18:10.802 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T04:18:10.842 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T04:18:10.846 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T04:18:10.846 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T04:18:10.903 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2024-09-19T04:18:10.904 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2024-09-19T04:18:10.904 DEBUG:teuthology.orchestra.run.smithi007:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2024-09-19T04:18:10.952 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24506 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T04:18:10.952 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24506 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T04:18:10.967 INFO:tasks.workunit.client.0.smithi007.stdout:getting blogbench 2024-09-19T04:18:10.967 INFO:tasks.workunit.client.0.smithi007.stderr:+ echo 'getting blogbench' 2024-09-19T04:18:10.967 INFO:tasks.workunit.client.0.smithi007.stderr:+ wget http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-09-19T04:18:10.987 INFO:tasks.workunit.client.0.smithi007.stderr:--2024-09-19 04:18:10-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-09-19T04:18:10.995 INFO:tasks.workunit.client.0.smithi007.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-19T04:18:11.062 INFO:tasks.workunit.client.0.smithi007.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-19T04:18:11.126 INFO:tasks.workunit.client.0.smithi007.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-19T04:18:11.127 INFO:tasks.workunit.client.0.smithi007.stderr:Length: 103355 (101K) [application/octet-stream] 2024-09-19T04:18:11.127 INFO:tasks.workunit.client.0.smithi007.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2024-09-19T04:18:11.130 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-19T04:18:11.224 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:18:11.260 INFO:tasks.workunit.client.0.smithi007.stderr: 0K .......... .......... .......... .......... .......... 49% 377K 0s 2024-09-19T04:18:11.330 INFO:tasks.workunit.client.0.smithi007.stderr: 50K .......... .......... .......... .......... .......... 99% 727K 0s 2024-09-19T04:18:11.330 INFO:tasks.workunit.client.0.smithi007.stderr: 100K 100% 3.96M=0.2s 2024-09-19T04:18:11.330 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-19T04:18:11.330 INFO:tasks.workunit.client.0.smithi007.stderr:2024-09-19 04:18:11 (501 KB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2024-09-19T04:18:11.330 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-19T04:18:11.330 INFO:tasks.workunit.client.0.smithi007.stderr:+ tar -xvf blogbench-1.0.tar.bz2 2024-09-19T04:18:11.427 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/ 2024-09-19T04:18:11.428 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/m4/ 2024-09-19T04:18:11.429 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/m4/acx_pthread.m4 2024-09-19T04:18:11.430 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/man/ 2024-09-19T04:18:11.431 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/man/blogbench.8 2024-09-19T04:18:11.432 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/man/Makefile.am 2024-09-19T04:18:11.433 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/man/Makefile.in 2024-09-19T04:18:11.436 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/src/ 2024-09-19T04:18:11.436 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/src/mysnprintf.c 2024-09-19T04:18:11.436 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/src/mysnprintf.h 2024-09-19T04:18:11.437 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/src/blogbench.c 2024-09-19T04:18:11.438 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/src/blogbench.h 2024-09-19T04:18:11.439 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/src/fakesnprintf.c 2024-09-19T04:18:11.440 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/src/fakesnprintf.h 2024-09-19T04:18:11.441 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/src/blogbench_p.h 2024-09-19T04:18:11.442 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/src/bsd-getopt_long.c 2024-09-19T04:18:11.443 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/src/bsd-getopt_long.h 2024-09-19T04:18:11.444 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/src/Makefile.am 2024-09-19T04:18:11.445 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/src/Makefile.in 2024-09-19T04:18:11.446 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/src/process.c 2024-09-19T04:18:11.447 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/src/globals.h 2024-09-19T04:18:11.448 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/src/commenter.c 2024-09-19T04:18:11.449 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/src/rewriter.c 2024-09-19T04:18:11.450 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/src/reader.c 2024-09-19T04:18:11.451 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/src/writer.c 2024-09-19T04:18:11.452 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/src/helpers.c 2024-09-19T04:18:11.453 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/NEWS 2024-09-19T04:18:11.454 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/compile 2024-09-19T04:18:11.455 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/depcomp 2024-09-19T04:18:11.456 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/aclocal.m4 2024-09-19T04:18:11.457 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/README 2024-09-19T04:18:11.458 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/configure 2024-09-19T04:18:11.461 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/configure.ac 2024-09-19T04:18:11.462 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/config.guess 2024-09-19T04:18:11.462 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/install-sh 2024-09-19T04:18:11.463 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/config.sub 2024-09-19T04:18:11.465 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/missing 2024-09-19T04:18:11.465 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/mkinstalldirs 2024-09-19T04:18:11.466 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/Makefile.am 2024-09-19T04:18:11.467 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/Makefile.in 2024-09-19T04:18:11.468 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/config.h.in 2024-09-19T04:18:11.469 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/AUTHORS 2024-09-19T04:18:11.470 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/INSTALL 2024-09-19T04:18:11.471 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/ChangeLog 2024-09-19T04:18:11.472 INFO:tasks.workunit.client.0.smithi007.stdout:blogbench-1.0/COPYING 2024-09-19T04:18:11.474 INFO:tasks.workunit.client.0.smithi007.stderr:+ cd blogbench-1.0/ 2024-09-19T04:18:11.474 INFO:tasks.workunit.client.0.smithi007.stdout:making blogbench 2024-09-19T04:18:11.474 INFO:tasks.workunit.client.0.smithi007.stderr:+ echo 'making blogbench' 2024-09-19T04:18:11.474 INFO:tasks.workunit.client.0.smithi007.stderr:+ ./configure 2024-09-19T04:18:11.591 INFO:tasks.workunit.client.0.smithi007.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-19T04:18:11.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.728+0000 7fa2fcf51640 1 -- 172.21.15.7:0/3231293743 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f002f310 con 0x7fa2f8106f10 2024-09-19T04:18:11.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.729+0000 7fa3001b7640 1 -- 172.21.15.7:0/3231293743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2f8106f10 msgr2=0x7fa2f810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:11.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.729+0000 7fa3001b7640 1 --2- 172.21.15.7:0/3231293743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2f8106f10 0x7fa2f810ea90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009ca0 tx=0x7fa2f002a8c0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.729+0000 7fa3001b7640 1 -- 172.21.15.7:0/3231293743 shutdown_connections 2024-09-19T04:18:11.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.729+0000 7fa3001b7640 1 --2- 172.21.15.7:0/3231293743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2f8106f10 0x7fa2f810ea90 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.729+0000 7fa3001b7640 1 --2- 172.21.15.7:0/3231293743 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2f8102790 0x7fa2f81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.729+0000 7fa3001b7640 1 --2- 172.21.15.7:0/3231293743 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2f8101de0 0x7fa2f81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.729+0000 7fa3001b7640 1 -- 172.21.15.7:0/3231293743 >> 172.21.15.7:0/3231293743 conn(0x7fa2f80fd8c0 msgr2=0x7fa2f80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:11.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.729+0000 7fa3001b7640 1 -- 172.21.15.7:0/3231293743 shutdown_connections 2024-09-19T04:18:11.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.729+0000 7fa3001b7640 1 -- 172.21.15.7:0/3231293743 wait complete. 2024-09-19T04:18:11.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.730+0000 7fa3001b7640 1 Processor -- start 2024-09-19T04:18:11.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.730+0000 7fa3001b7640 1 -- start start 2024-09-19T04:18:11.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.730+0000 7fa3001b7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2f8101de0 0x7fa2f80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:11.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.730+0000 7fa3001b7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2f8102790 0x7fa2f8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:11.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.730+0000 7fa3001b7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2f8106f10 0x7fa2f8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:11.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.730+0000 7fa3001b7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f8111f70 con 0x7fa2f8101de0 2024-09-19T04:18:11.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.730+0000 7fa3001b7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f8111df0 con 0x7fa2f8106f10 2024-09-19T04:18:11.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.730+0000 7fa3001b7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f81120f0 con 0x7fa2f8102790 2024-09-19T04:18:11.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.730+0000 7fa2fdf53640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2f8101de0 0x7fa2f80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:11.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.730+0000 7fa2fdf53640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2f8101de0 0x7fa2f80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56618/0 (socket says 172.21.15.7:56618) 2024-09-19T04:18:11.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.730+0000 7fa2fdf53640 1 -- 172.21.15.7:0/3142198107 learned_addr learned my addr 172.21.15.7:0/3142198107 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:11.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.730+0000 7fa2fd752640 1 --2- 172.21.15.7:0/3142198107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2f8102790 0x7fa2f8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:11.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.730+0000 7fa2fe754640 1 --2- 172.21.15.7:0/3142198107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2f8106f10 0x7fa2f8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:11.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.731+0000 7fa2fdf53640 1 -- 172.21.15.7:0/3142198107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2f8102790 msgr2=0x7fa2f8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:11.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.731+0000 7fa2fdf53640 1 --2- 172.21.15.7:0/3142198107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2f8102790 0x7fa2f8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.731+0000 7fa2fdf53640 1 -- 172.21.15.7:0/3142198107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2f8106f10 msgr2=0x7fa2f8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:11.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.731+0000 7fa2fdf53640 1 --2- 172.21.15.7:0/3142198107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2f8106f10 0x7fa2f8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.731+0000 7fa2fdf53640 1 -- 172.21.15.7:0/3142198107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f81a6800 con 0x7fa2f8101de0 2024-09-19T04:18:11.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.731+0000 7fa2fdf53640 1 --2- 172.21.15.7:0/3142198107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2f8101de0 0x7fa2f80744f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa2f400c920 tx=0x7fa2f400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:11.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.731+0000 7fa2eeffd640 1 -- 172.21.15.7:0/3142198107 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4007c70 con 0x7fa2f8101de0 2024-09-19T04:18:11.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.731+0000 7fa2eeffd640 1 -- 172.21.15.7:0/3142198107 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2f4007e10 con 0x7fa2f8101de0 2024-09-19T04:18:11.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.731+0000 7fa3001b7640 1 -- 172.21.15.7:0/3142198107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2f81a6af0 con 0x7fa2f8101de0 2024-09-19T04:18:11.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.731+0000 7fa2eeffd640 1 -- 172.21.15.7:0/3142198107 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4018890 con 0x7fa2f8101de0 2024-09-19T04:18:11.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.731+0000 7fa3001b7640 1 -- 172.21.15.7:0/3142198107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2f81a7080 con 0x7fa2f8101de0 2024-09-19T04:18:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.733+0000 7fa2eeffd640 1 -- 172.21.15.7:0/3142198107 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 138405+0+0 (secure 0 0 0) 0x7fa2f4018a70 con 0x7fa2f8101de0 2024-09-19T04:18:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.734+0000 7fa302590740 1 Processor -- start 2024-09-19T04:18:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.734+0000 7fa302590740 1 -- start start 2024-09-19T04:18:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.734+0000 7fa302590740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5645e118b850 0x5645e118bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.734+0000 7fa302590740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645e118c170 0x5645e11964f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.734+0000 7fa302590740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645e1196a30 0x5645e1198e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.734+0000 7fa302590740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5645e10f0160 con 0x5645e1196a30 2024-09-19T04:18:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.734+0000 7fa302590740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5645e1097720 con 0x5645e118c170 2024-09-19T04:18:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.734+0000 7fa302590740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5645e10ec120 con 0x5645e118b850 2024-09-19T04:18:11.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.734+0000 7fa2eeffd640 1 --2- 172.21.15.7:0/3142198107 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa2e40a3350 0x7fa2e40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:11.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.734+0000 7fa2fd752640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645e1196a30 0x5645e1198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:11.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.735+0000 7fa2fe754640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5645e118b850 0x5645e118bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:11.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.735+0000 7fa2fdf53640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645e118c170 0x5645e11964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:11.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.735+0000 7fa2fe754640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5645e118b850 0x5645e118bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:35270/0 (socket says 172.21.15.7:35270) 2024-09-19T04:18:11.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.735+0000 7fa2fe754640 1 -- 172.21.15.7:0/3922187670 learned_addr learned my addr 172.21.15.7:0/3922187670 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:11.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.735+0000 7fa2fe754640 1 --2- 172.21.15.7:0/3142198107 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa2e40a3350 0x7fa2e40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:11.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.735+0000 7fa2eeffd640 1 -- 172.21.15.7:0/3142198107 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fa2f40cfe80 con 0x7fa2f8101de0 2024-09-19T04:18:11.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.735+0000 7fa2fe754640 1 -- 172.21.15.7:0/3922187670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645e118c170 msgr2=0x5645e11964f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:11.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.735+0000 7fa2fe754640 1 --2- 172.21.15.7:0/3922187670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645e118c170 0x5645e11964f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.735+0000 7fa2fe754640 1 -- 172.21.15.7:0/3922187670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645e1196a30 msgr2=0x5645e1198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:11.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.735+0000 7fa2fe754640 1 --2- 172.21.15.7:0/3922187670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645e1196a30 0x5645e1198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.735+0000 7fa2fe754640 1 -- 172.21.15.7:0/3922187670 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645e0e61ba0 con 0x5645e118b850 2024-09-19T04:18:11.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.735+0000 7fa2fe754640 1 --2- 172.21.15.7:0/3142198107 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa2e40a3350 0x7fa2e40a5810 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009a60 tx=0x7fa2f0036000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:11.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.735+0000 7fa2fe754640 1 --2- 172.21.15.7:0/3922187670 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5645e118b850 0x5645e118bc30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009ca0 tx=0x7fa2f0031760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a18d0ff4e1f36d13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:11.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.735+0000 7fa2e3fff640 1 -- 172.21.15.7:0/3922187670 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0055070 con 0x5645e118b850 2024-09-19T04:18:11.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.735+0000 7fa2e3fff640 1 -- 172.21.15.7:0/3922187670 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2f0036070 con 0x5645e118b850 2024-09-19T04:18:11.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.735+0000 7fa2e3fff640 1 -- 172.21.15.7:0/3922187670 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0049660 con 0x5645e118b850 2024-09-19T04:18:11.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.736+0000 7fa302590740 1 -- 172.21.15.7:0/3922187670 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5645e118b850 msgr2=0x5645e118bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:11.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.736+0000 7fa302590740 1 --2- 172.21.15.7:0/3922187670 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5645e118b850 0x5645e118bc30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009ca0 tx=0x7fa2f0031760 comp rx=0 tx=0).stop 2024-09-19T04:18:11.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.736+0000 7fa302590740 1 -- 172.21.15.7:0/3922187670 shutdown_connections 2024-09-19T04:18:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.736+0000 7fa302590740 1 --2- 172.21.15.7:0/3922187670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645e1196a30 0x5645e1198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.736+0000 7fa302590740 1 --2- 172.21.15.7:0/3922187670 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645e118c170 0x5645e11964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.736+0000 7fa302590740 1 --2- 172.21.15.7:0/3922187670 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5645e118b850 0x5645e118bc30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.736+0000 7fa302590740 1 -- 172.21.15.7:0/3922187670 >> 172.21.15.7:0/3922187670 conn(0x5645e1187de0 msgr2=0x5645e11881c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.736+0000 7fa302590740 1 -- 172.21.15.7:0/3922187670 shutdown_connections 2024-09-19T04:18:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.736+0000 7fa302590740 1 -- 172.21.15.7:0/3922187670 wait complete. 2024-09-19T04:18:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.737+0000 7fa302590740 1 -- start start 2024-09-19T04:18:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.737+0000 7fa302590740 1 Processor -- start 2024-09-19T04:18:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.737+0000 7fa302590740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645e118b850 0x5645e11938d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.737+0000 7fa302590740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645e118c170 0x5645e1193e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.737+0000 7fa302590740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5645e1196a30 0x5645e1194350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.737+0000 7fa302590740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5645e1199480 con 0x5645e118c170 2024-09-19T04:18:11.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.737+0000 7fa302590740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5645e1078900 con 0x5645e118b850 2024-09-19T04:18:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.737+0000 7fa302590740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5645e1199600 con 0x5645e1196a30 2024-09-19T04:18:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.737+0000 7fa302590740 10 client.0 _ll_register_callbacks cb 0x5645e1076780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:18:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.738+0000 7fa2fd752640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645e118c170 0x5645e1193e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.738+0000 7fa2fd752640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645e118c170 0x5645e1193e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56636/0 (socket says 172.21.15.7:56636) 2024-09-19T04:18:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.738+0000 7fa2fd752640 1 -- 172.21.15.7:0/3363184300 learned_addr learned my addr 172.21.15.7:0/3363184300 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.738+0000 7fa2fdf53640 1 --2- 172.21.15.7:0/3363184300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645e118b850 0x5645e11938d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.738+0000 7fa2fe754640 1 --2- 172.21.15.7:0/3363184300 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5645e1196a30 0x5645e1194350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.738+0000 7fa2fd752640 1 -- 172.21.15.7:0/3363184300 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5645e1196a30 msgr2=0x5645e1194350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.738+0000 7fa2fd752640 1 --2- 172.21.15.7:0/3363184300 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5645e1196a30 0x5645e1194350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.738+0000 7fa2fd752640 1 -- 172.21.15.7:0/3363184300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645e118b850 msgr2=0x5645e11938d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.738+0000 7fa2fd752640 1 --2- 172.21.15.7:0/3363184300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645e118b850 0x5645e11938d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.738+0000 7fa2fd752640 1 -- 172.21.15.7:0/3363184300 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645e10b8c50 con 0x5645e118c170 2024-09-19T04:18:11.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.738+0000 7fa2fdf53640 1 --2- 172.21.15.7:0/3363184300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645e118b850 0x5645e11938d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:18:11.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.738+0000 7fa2fd752640 1 --2- 172.21.15.7:0/3363184300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645e118c170 0x5645e1193e10 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800bf30 tx=0x7fa2e80118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=322af43a7b678e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:11.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.738+0000 7fa2e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:18:11.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.738+0000 7fa2e17fa640 1 -- 172.21.15.7:0/3363184300 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8004020 con 0x5645e118c170 2024-09-19T04:18:11.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.738+0000 7fa2e17fa640 1 -- 172.21.15.7:0/3363184300 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fa2e80041c0 con 0x5645e118c170 2024-09-19T04:18:11.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.738+0000 7fa302590740 1 -- 172.21.15.7:0/3363184300 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2f0036070 con 0x5645e118c170 2024-09-19T04:18:11.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.738+0000 7fa2e17fa640 1 -- 172.21.15.7:0/3363184300 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa2e8024050 con 0x5645e118c170 2024-09-19T04:18:11.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.738+0000 7fa302590740 10 client.15588 fetch_fsmap learned FSMap version 28 2024-09-19T04:18:11.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.738+0000 7fa302590740 1 -- 172.21.15.7:0/3363184300 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5645e11a50e0 con 0x5645e118c170 2024-09-19T04:18:11.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.739+0000 7fa2e17fa640 1 -- 172.21.15.7:0/3363184300 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2f0036070 con 0x5645e118c170 2024-09-19T04:18:11.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.739+0000 7fa2e17fa640 1 -- 172.21.15.7:0/3363184300 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fa2e8004be0 con 0x5645e118c170 2024-09-19T04:18:11.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.739+0000 7fa302590740 10 client.15588 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:18:11.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.739+0000 7fa302590740 10 client.15588 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:18:11.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.739+0000 7fa302590740 20 client.15588 populate_metadata read hostname 'smithi007' 2024-09-19T04:18:11.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.739+0000 7fa302590740 1 --2- 172.21.15.7:0/3363184300 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5645e11a65a0 0x5645e11a8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:11.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.739+0000 7fa302590740 4 client.15588 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:18:11.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.739+0000 7fa302590740 1 -- 172.21.15.7:0/3363184300 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5645e10fd890 con 0x5645e11a65a0 2024-09-19T04:18:11.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.739+0000 7fa2fdf53640 1 --2- 172.21.15.7:0/3363184300 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5645e11a65a0 0x5645e11a8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:11.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.739+0000 7fa2e17fa640 10 client.15588 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:11.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.739+0000 7fa2fdf53640 1 --2- 172.21.15.7:0/3363184300 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5645e11a65a0 0x5645e11a8a40 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe4493bf17718acf server_cookie=32aafa86a39ff5a6 in_seq=0 out_seq=0 2024-09-19T04:18:11.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.740+0000 7fa2e17fa640 1 -- 172.21.15.7:0/3363184300 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5645e10fd890 con 0x5645e11a65a0 2024-09-19T04:18:11.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.740+0000 7fa2e17fa640 10 client.15588 handle_command_reply: tid=0 2024-09-19T04:18:11.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.740+0000 7fa302590740 1 client.15588 shutdown 2024-09-19T04:18:11.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.740+0000 7fa302590740 1 -- 172.21.15.7:0/3363184300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645e118c170 msgr2=0x5645e1193e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:11.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.740+0000 7fa302590740 1 --2- 172.21.15.7:0/3363184300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645e118c170 0x5645e1193e10 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800bf30 tx=0x7fa2e80118d0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.740+0000 7fa302590740 1 -- 172.21.15.7:0/3363184300 shutdown_connections 2024-09-19T04:18:11.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.740+0000 7fa302590740 1 --2- 172.21.15.7:0/3363184300 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5645e11a65a0 0x5645e11a8a40 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.740+0000 7fa302590740 1 --2- 172.21.15.7:0/3363184300 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5645e1196a30 0x5645e1194350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.740+0000 7fa302590740 1 --2- 172.21.15.7:0/3363184300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645e118c170 0x5645e1193e10 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.740+0000 7fa302590740 1 --2- 172.21.15.7:0/3363184300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645e118b850 0x5645e11938d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.740+0000 7fa2e17fa640 0 client.15588 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:11.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.740+0000 7fa302590740 1 -- 172.21.15.7:0/3363184300 >> 172.21.15.7:0/3363184300 conn(0x5645e1187de0 msgr2=0x5645e118db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:11.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.740+0000 7fa302590740 1 -- 172.21.15.7:0/3363184300 shutdown_connections 2024-09-19T04:18:11.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.741+0000 7fa302590740 1 -- 172.21.15.7:0/3363184300 wait complete. 2024-09-19T04:18:11.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.741+0000 7fa302590740 20 client.15588 trim_cache size 0 max 16384 2024-09-19T04:18:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.757+0000 7fa302590740 1 Processor -- start 2024-09-19T04:18:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.758+0000 7fa302590740 1 -- start start 2024-09-19T04:18:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.758+0000 7fa302590740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645e118b850 0x5645e11ae310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.758+0000 7fa302590740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645e118c170 0x5645e11ae850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.758+0000 7fa302590740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5645e1196a30 0x5645e1190b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.758+0000 7fa302590740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f81acb00 con 0x5645e118b850 2024-09-19T04:18:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.758+0000 7fa302590740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f81ae640 con 0x5645e118c170 2024-09-19T04:18:11.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.758+0000 7fa302590740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f81ad1d0 con 0x5645e1196a30 2024-09-19T04:18:11.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.758+0000 7fa2fdf53640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645e118b850 0x5645e11ae310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:11.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.758+0000 7fa2fdf53640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645e118b850 0x5645e11ae310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56644/0 (socket says 172.21.15.7:56644) 2024-09-19T04:18:11.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.758+0000 7fa2fdf53640 1 -- 172.21.15.7:0/1150006320 learned_addr learned my addr 172.21.15.7:0/1150006320 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:11.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.758+0000 7fa2fe754640 1 --2- 172.21.15.7:0/1150006320 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5645e1196a30 0x5645e1190b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:11.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.758+0000 7fa2fd752640 1 --2- 172.21.15.7:0/1150006320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645e118c170 0x5645e11ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:11.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.758+0000 7fa2fdf53640 1 -- 172.21.15.7:0/1150006320 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5645e1196a30 msgr2=0x5645e1190b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:11.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.758+0000 7fa2fdf53640 1 --2- 172.21.15.7:0/1150006320 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5645e1196a30 0x5645e1190b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.758+0000 7fa2fdf53640 1 -- 172.21.15.7:0/1150006320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645e118c170 msgr2=0x5645e11ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:11.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.758+0000 7fa2fdf53640 1 --2- 172.21.15.7:0/1150006320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645e118c170 0x5645e11ae850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.758+0000 7fa2fdf53640 1 -- 172.21.15.7:0/1150006320 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645e11833f0 con 0x5645e118b850 2024-09-19T04:18:11.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.758+0000 7fa2fdf53640 1 --2- 172.21.15.7:0/1150006320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645e118b850 0x5645e11ae310 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa2f400c8f0 tx=0x7fa2f406bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b3d20c2a7722f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:11.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.758+0000 7fa2e37fe640 1 -- 172.21.15.7:0/1150006320 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f40a0320 con 0x5645e118b850 2024-09-19T04:18:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.759+0000 7fa2e37fe640 1 -- 172.21.15.7:0/1150006320 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2f40a4be0 con 0x5645e118b850 2024-09-19T04:18:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.759+0000 7fa2e37fe640 1 -- 172.21.15.7:0/1150006320 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f40985e0 con 0x5645e118b850 2024-09-19T04:18:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.759+0000 7fa302590740 1 -- 172.21.15.7:0/1150006320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645e118b850 msgr2=0x5645e11ae310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.759+0000 7fa302590740 1 --2- 172.21.15.7:0/1150006320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645e118b850 0x5645e11ae310 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa2f400c8f0 tx=0x7fa2f406bbe0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.759+0000 7fa302590740 1 -- 172.21.15.7:0/1150006320 shutdown_connections 2024-09-19T04:18:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.759+0000 7fa302590740 1 --2- 172.21.15.7:0/1150006320 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5645e1196a30 0x5645e1190b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.759+0000 7fa302590740 1 --2- 172.21.15.7:0/1150006320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645e118c170 0x5645e11ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.759+0000 7fa302590740 1 --2- 172.21.15.7:0/1150006320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645e118b850 0x5645e11ae310 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.759+0000 7fa302590740 1 -- 172.21.15.7:0/1150006320 >> 172.21.15.7:0/1150006320 conn(0x5645e1187de0 msgr2=0x5645e11921a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.759+0000 7fa302590740 1 -- 172.21.15.7:0/1150006320 shutdown_connections 2024-09-19T04:18:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.759+0000 7fa302590740 1 -- 172.21.15.7:0/1150006320 wait complete. 2024-09-19T04:18:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.760+0000 7fa302590740 1 -- start start 2024-09-19T04:18:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.760+0000 7fa302590740 1 Processor -- start 2024-09-19T04:18:11.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.760+0000 7fa302590740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645e118b850 0x5645e119aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:11.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.760+0000 7fa302590740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645e118c170 0x5645e119b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:11.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.760+0000 7fa302590740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5645e1196a30 0x5645e120a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:11.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.760+0000 7fa302590740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f81adf70 con 0x5645e118b850 2024-09-19T04:18:11.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.760+0000 7fa302590740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f81ad8a0 con 0x5645e118c170 2024-09-19T04:18:11.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.760+0000 7fa302590740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f81aaac0 con 0x5645e1196a30 2024-09-19T04:18:11.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.760+0000 7fa302590740 10 client.0 _ll_register_callbacks cb 0x7fa2e800bb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:18:11.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.760+0000 7fa2fdf53640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645e118b850 0x5645e119aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:11.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.760+0000 7fa2fdf53640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645e118b850 0x5645e119aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56646/0 (socket says 172.21.15.7:56646) 2024-09-19T04:18:11.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.760+0000 7fa2fdf53640 1 -- 172.21.15.7:0/3722470579 learned_addr learned my addr 172.21.15.7:0/3722470579 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:11.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.760+0000 7fa2fe754640 1 --2- 172.21.15.7:0/3722470579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5645e1196a30 0x5645e120a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:11.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.760+0000 7fa2fd752640 1 --2- 172.21.15.7:0/3722470579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645e118c170 0x5645e119b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:11.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.761+0000 7fa2fdf53640 1 -- 172.21.15.7:0/3722470579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5645e1196a30 msgr2=0x5645e120a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.761+0000 7fa2fdf53640 1 --2- 172.21.15.7:0/3722470579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5645e1196a30 0x5645e120a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.761+0000 7fa2fdf53640 1 -- 172.21.15.7:0/3722470579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645e118c170 msgr2=0x5645e119b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.761+0000 7fa2fdf53640 1 --2- 172.21.15.7:0/3722470579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645e118c170 0x5645e119b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.761+0000 7fa2fdf53640 1 -- 172.21.15.7:0/3722470579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645e120a9d0 con 0x5645e118b850 2024-09-19T04:18:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.761+0000 7fa2fdf53640 1 --2- 172.21.15.7:0/3722470579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645e118b850 0x5645e119aea0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa2f409c130 tx=0x7fa2f40cd400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab34db9b09aa889c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.761+0000 7fa2e17fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:18:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.761+0000 7fa2e17fa640 1 -- 172.21.15.7:0/3722470579 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f40b6070 con 0x5645e118b850 2024-09-19T04:18:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.761+0000 7fa2e17fa640 1 -- 172.21.15.7:0/3722470579 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fa2f409a270 con 0x5645e118b850 2024-09-19T04:18:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.761+0000 7fa302590740 1 -- 172.21.15.7:0/3722470579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2f40a4be0 con 0x5645e118b850 2024-09-19T04:18:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.761+0000 7fa2e17fa640 1 -- 172.21.15.7:0/3722470579 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa2f40a0320 con 0x5645e118b850 2024-09-19T04:18:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.761+0000 7fa302590740 10 client.15594 fetch_fsmap learned FSMap version 28 2024-09-19T04:18:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.761+0000 7fa302590740 1 -- 172.21.15.7:0/3722470579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5645e1211d40 con 0x5645e118b850 2024-09-19T04:18:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.761+0000 7fa2e17fa640 1 -- 172.21.15.7:0/3722470579 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2f40a4be0 con 0x5645e118b850 2024-09-19T04:18:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.761+0000 7fa2e17fa640 1 -- 172.21.15.7:0/3722470579 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fa2f40b9020 con 0x5645e118b850 2024-09-19T04:18:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.761+0000 7fa302590740 10 client.15594 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:18:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.761+0000 7fa302590740 10 client.15594 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:18:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.761+0000 7fa302590740 20 client.15594 populate_metadata read hostname 'smithi007' 2024-09-19T04:18:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.762+0000 7fa302590740 1 --2- 172.21.15.7:0/3722470579 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5645e1212420 0x5645e1214840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.762+0000 7fa302590740 4 client.15594 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T04:18:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.762+0000 7fa302590740 1 -- 172.21.15.7:0/3722470579 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x5645e10f7be0 con 0x5645e1212420 2024-09-19T04:18:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.762+0000 7fa2fd752640 1 --2- 172.21.15.7:0/3722470579 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5645e1212420 0x5645e1214840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.762+0000 7fa2fd752640 1 --2- 172.21.15.7:0/3722470579 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5645e1212420 0x5645e1214840 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4222c3e7684d2035 server_cookie=a066d79a7e10d23c in_seq=0 out_seq=0 2024-09-19T04:18:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.762+0000 7fa2e17fa640 10 client.15594 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:11.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.838+0000 7fa2e17fa640 1 -- 172.21.15.7:0/3722470579 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5645e10f7be0 con 0x5645e1212420 2024-09-19T04:18:11.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.838+0000 7fa2e17fa640 10 client.15594 handle_command_reply: tid=0 2024-09-19T04:18:11.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.838+0000 7fa302590740 1 client.15594 shutdown 2024-09-19T04:18:11.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.839+0000 7fa302590740 1 -- 172.21.15.7:0/3722470579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645e118b850 msgr2=0x5645e119aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:11.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.839+0000 7fa302590740 1 --2- 172.21.15.7:0/3722470579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645e118b850 0x5645e119aea0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa2f409c130 tx=0x7fa2f40cd400 comp rx=0 tx=0).stop 2024-09-19T04:18:11.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.839+0000 7fa302590740 1 -- 172.21.15.7:0/3722470579 shutdown_connections 2024-09-19T04:18:11.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.839+0000 7fa302590740 1 --2- 172.21.15.7:0/3722470579 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5645e1212420 0x5645e1214840 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.839+0000 7fa302590740 1 --2- 172.21.15.7:0/3722470579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5645e1196a30 0x5645e120a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.839+0000 7fa302590740 1 --2- 172.21.15.7:0/3722470579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5645e118c170 0x5645e119b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.839+0000 7fa302590740 1 --2- 172.21.15.7:0/3722470579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645e118b850 0x5645e119aea0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.839+0000 7fa302590740 1 -- 172.21.15.7:0/3722470579 >> 172.21.15.7:0/3722470579 conn(0x5645e1187de0 msgr2=0x5645e11866a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:11.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.839+0000 7fa2e17fa640 0 client.15594 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:11.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.839+0000 7fa302590740 1 -- 172.21.15.7:0/3722470579 shutdown_connections 2024-09-19T04:18:11.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.839+0000 7fa302590740 1 -- 172.21.15.7:0/3722470579 wait complete. 2024-09-19T04:18:11.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.839+0000 7fa302590740 20 client.15594 trim_cache size 0 max 16384 2024-09-19T04:18:11.842 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:18:11.842 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 28, 2024-09-19T04:18:11.842 INFO:teuthology.orchestra.run.smithi007.stdout: "leader": 24506, 2024-09-19T04:18:11.842 INFO:teuthology.orchestra.run.smithi007.stdout: "set_version": 6, 2024-09-19T04:18:11.842 INFO:teuthology.orchestra.run.smithi007.stdout: "sets": { 2024-09-19T04:18:11.842 INFO:teuthology.orchestra.run.smithi007.stdout: "396f943": { 2024-09-19T04:18:11.842 INFO:teuthology.orchestra.run.smithi007.stdout: "version": 6, 2024-09-19T04:18:11.842 INFO:teuthology.orchestra.run.smithi007.stdout: "age_ref": 0.0, 2024-09-19T04:18:11.842 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:18:11.843 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "QUIESCED", 2024-09-19T04:18:11.843 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:18:11.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:18:11.843 INFO:teuthology.orchestra.run.smithi007.stdout: "timeout": 90.0, 2024-09-19T04:18:11.843 INFO:teuthology.orchestra.run.smithi007.stdout: "expiration": 140.3, 2024-09-19T04:18:11.843 INFO:teuthology.orchestra.run.smithi007.stdout: "members": { 2024-09-19T04:18:11.843 INFO:teuthology.orchestra.run.smithi007.stdout: "file:/": { 2024-09-19T04:18:11.843 INFO:teuthology.orchestra.run.smithi007.stdout: "excluded": false, 2024-09-19T04:18:11.843 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:18:11.843 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "QUIESCED", 2024-09-19T04:18:11.843 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:18:11.843 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:18:11.844 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:18:11.844 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:18:11.844 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:18:11.844 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:18:11.844 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:18:11.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.839+0000 7fa3001b7640 1 -- 172.21.15.7:0/3142198107 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa2e40a3350 msgr2=0x7fa2e40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:11.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.839+0000 7fa3001b7640 1 --2- 172.21.15.7:0/3142198107 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa2e40a3350 0x7fa2e40a5810 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009a60 tx=0x7fa2f0036000 comp rx=0 tx=0).stop 2024-09-19T04:18:11.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.839+0000 7fa3001b7640 1 -- 172.21.15.7:0/3142198107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2f8101de0 msgr2=0x7fa2f80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:11.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.839+0000 7fa3001b7640 1 --2- 172.21.15.7:0/3142198107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2f8101de0 0x7fa2f80744f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa2f400c920 tx=0x7fa2f400cde0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.839+0000 7fa3001b7640 1 -- 172.21.15.7:0/3142198107 shutdown_connections 2024-09-19T04:18:11.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.839+0000 7fa3001b7640 1 --2- 172.21.15.7:0/3142198107 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa2e40a3350 0x7fa2e40a5810 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.839+0000 7fa3001b7640 1 --2- 172.21.15.7:0/3142198107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2f8106f10 0x7fa2f8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.839+0000 7fa3001b7640 1 --2- 172.21.15.7:0/3142198107 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2f8102790 0x7fa2f8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.839+0000 7fa3001b7640 1 --2- 172.21.15.7:0/3142198107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2f8101de0 0x7fa2f80744f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:11.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.839+0000 7fa3001b7640 1 -- 172.21.15.7:0/3142198107 >> 172.21.15.7:0/3142198107 conn(0x7fa2f80fd8c0 msgr2=0x7fa2f80febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:11.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.840+0000 7fa3001b7640 1 -- 172.21.15.7:0/3142198107 shutdown_connections 2024-09-19T04:18:11.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:11.840+0000 7fa3001b7640 1 -- 172.21.15.7:0/3142198107 wait complete. 2024-09-19T04:18:12.537 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:12 smithi007 ceph-mon[31360]: pgmap v393: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T04:18:12.565 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '396f943', quiesce took 3.8 seconds. Will release after: 16.55 2024-09-19T04:18:12.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:12 smithi102 ceph-mon[35446]: pgmap v393: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T04:18:12.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:12 smithi092 ceph-mon[34940]: pgmap v393: 129 pgs: 129 active+clean; 671 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T04:18:14.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:14 smithi007 ceph-mon[31360]: pgmap v394: 129 pgs: 129 active+clean; 896 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-09-19T04:18:14.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:14 smithi102 ceph-mon[35446]: pgmap v394: 129 pgs: 129 active+clean; 896 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-09-19T04:18:14.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:14 smithi092 ceph-mon[34940]: pgmap v394: 129 pgs: 129 active+clean; 896 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-09-19T04:18:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.393+0000 7f8152d03640 1 -- 172.21.15.7:0/2116761775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f814c101b70 msgr2=0x7f814c101f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.393+0000 7f8152d03640 1 --2- 172.21.15.7:0/2116761775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f814c101b70 0x7f814c101f70 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8148009900 tx=0x7f814802a410 comp rx=0 tx=0).stop 2024-09-19T04:18:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.393+0000 7f8152d03640 1 -- 172.21.15.7:0/2116761775 shutdown_connections 2024-09-19T04:18:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.393+0000 7f8152d03640 1 --2- 172.21.15.7:0/2116761775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814c103720 0x7f814c109fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.393+0000 7f8152d03640 1 --2- 172.21.15.7:0/2116761775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f814c102d60 0x7f814c1031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.393+0000 7f8152d03640 1 --2- 172.21.15.7:0/2116761775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f814c101b70 0x7f814c101f70 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.393+0000 7f8152d03640 1 -- 172.21.15.7:0/2116761775 >> 172.21.15.7:0/2116761775 conn(0x7f814c0fd2f0 msgr2=0x7f814c0ff710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.393+0000 7f8152d03640 1 -- 172.21.15.7:0/2116761775 shutdown_connections 2024-09-19T04:18:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.393+0000 7f8152d03640 1 -- 172.21.15.7:0/2116761775 wait complete. 2024-09-19T04:18:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.394+0000 7f8152d03640 1 Processor -- start 2024-09-19T04:18:16.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.394+0000 7f8152d03640 1 -- start start 2024-09-19T04:18:16.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.394+0000 7f8152d03640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814c101b70 0x7f814c197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:16.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.394+0000 7f8152d03640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f814c102d60 0x7f814c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:16.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.394+0000 7f8152d03640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f814c103720 0x7f814c19f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:16.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.394+0000 7f8152d03640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f814c10d7f0 con 0x7f814c103720 2024-09-19T04:18:16.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.394+0000 7f8152d03640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f814c10d670 con 0x7f814c101b70 2024-09-19T04:18:16.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.394+0000 7f8152d03640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f814c10d970 con 0x7f814c102d60 2024-09-19T04:18:16.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.394+0000 7f81512a0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f814c103720 0x7f814c19f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:16.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.394+0000 7f81512a0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f814c103720 0x7f814c19f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56668/0 (socket says 172.21.15.7:56668) 2024-09-19T04:18:16.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.394+0000 7f81512a0640 1 -- 172.21.15.7:0/3168340466 learned_addr learned my addr 172.21.15.7:0/3168340466 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:16.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.394+0000 7f8150a9f640 1 --2- 172.21.15.7:0/3168340466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814c101b70 0x7f814c197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:16.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.394+0000 7f8143fff640 1 --2- 172.21.15.7:0/3168340466 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f814c102d60 0x7f814c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:16.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.395+0000 7f81512a0640 1 -- 172.21.15.7:0/3168340466 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f814c102d60 msgr2=0x7f814c198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:16.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.395+0000 7f81512a0640 1 --2- 172.21.15.7:0/3168340466 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f814c102d60 0x7f814c198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.395+0000 7f81512a0640 1 -- 172.21.15.7:0/3168340466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814c101b70 msgr2=0x7f814c197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:16.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.395+0000 7f81512a0640 1 --2- 172.21.15.7:0/3168340466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814c101b70 0x7f814c197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.395+0000 7f81512a0640 1 -- 172.21.15.7:0/3168340466 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f814c19faf0 con 0x7f814c103720 2024-09-19T04:18:16.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.395+0000 7f81512a0640 1 --2- 172.21.15.7:0/3168340466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f814c103720 0x7f814c19f480 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f814400eb10 tx=0x7f814400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:16.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.395+0000 7f8141ffb640 1 -- 172.21.15.7:0/3168340466 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8144004b20 con 0x7f814c103720 2024-09-19T04:18:16.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.395+0000 7f8141ffb640 1 -- 172.21.15.7:0/3168340466 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8144004cc0 con 0x7f814c103720 2024-09-19T04:18:16.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.395+0000 7f8152d03640 1 -- 172.21.15.7:0/3168340466 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f814c19fde0 con 0x7f814c103720 2024-09-19T04:18:16.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.395+0000 7f8141ffb640 1 -- 172.21.15.7:0/3168340466 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8144010760 con 0x7f814c103720 2024-09-19T04:18:16.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.395+0000 7f8152d03640 1 -- 172.21.15.7:0/3168340466 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f814c1a0250 con 0x7f814c103720 2024-09-19T04:18:16.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.397+0000 7f8141ffb640 1 -- 172.21.15.7:0/3168340466 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f8144005020 con 0x7f814c103720 2024-09-19T04:18:16.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.398+0000 7f8155a99740 1 Processor -- start 2024-09-19T04:18:16.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.398+0000 7f8155a99740 1 -- start start 2024-09-19T04:18:16.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.398+0000 7f8141ffb640 1 --2- 172.21.15.7:0/3168340466 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f81340a3240 0x7f81340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:16.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.398+0000 7f8155a99740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb469699a0 0x55eb46969da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:16.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.398+0000 7f8155a99740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55eb4696a2e0 0x55eb4696eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:16.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.398+0000 7f8155a99740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb4696f370 0x55eb46971830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.398+0000 7f8155a99740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55eb468cd2f0 con 0x55eb469699a0 2024-09-19T04:18:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.398+0000 7f8155a99740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55eb46875270 con 0x55eb4696f370 2024-09-19T04:18:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.398+0000 7f8155a99740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55eb468c92b0 con 0x55eb4696a2e0 2024-09-19T04:18:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.398+0000 7f8143fff640 1 --2- 172.21.15.7:0/3168340466 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f81340a3240 0x7f81340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.398+0000 7f8150a9f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb469699a0 0x55eb46969da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.398+0000 7f8150a9f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb469699a0 0x55eb46969da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56672/0 (socket says 172.21.15.7:56672) 2024-09-19T04:18:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.398+0000 7f8150a9f640 1 -- 172.21.15.7:0/3270695655 learned_addr learned my addr 172.21.15.7:0/3270695655 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.398+0000 7f8141ffb640 1 -- 172.21.15.7:0/3168340466 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f81440d02d0 con 0x7f814c103720 2024-09-19T04:18:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.398+0000 7f81512a0640 1 --2- 172.21.15.7:0/3270695655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb4696f370 0x55eb46971830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.398+0000 7f8143fff640 1 --2- 172.21.15.7:0/3270695655 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55eb4696a2e0 0x55eb4696eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.399+0000 7f8150a9f640 1 -- 172.21.15.7:0/3270695655 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55eb4696a2e0 msgr2=0x55eb4696eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.399+0000 7f8150a9f640 1 --2- 172.21.15.7:0/3270695655 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55eb4696a2e0 0x55eb4696eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.399+0000 7f8150a9f640 1 -- 172.21.15.7:0/3270695655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb4696f370 msgr2=0x55eb46971830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.399+0000 7f8150a9f640 1 --2- 172.21.15.7:0/3270695655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb4696f370 0x55eb46971830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.399+0000 7f8150a9f640 1 -- 172.21.15.7:0/3270695655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb46874340 con 0x55eb469699a0 2024-09-19T04:18:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.399+0000 7f8143fff640 1 --2- 172.21.15.7:0/3168340466 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f81340a3240 0x7f81340a5700 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f813c009710 tx=0x7f813c013880 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.399+0000 7f8150a9f640 1 --2- 172.21.15.7:0/3270695655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb469699a0 0x55eb46969da0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8148031610 tx=0x7f8148005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a565e33d72bedf20 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.399+0000 7f8132ffd640 1 -- 172.21.15.7:0/3270695655 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8148040070 con 0x55eb469699a0 2024-09-19T04:18:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.399+0000 7f8132ffd640 1 -- 172.21.15.7:0/3270695655 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8148004030 con 0x55eb469699a0 2024-09-19T04:18:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.399+0000 7f8132ffd640 1 -- 172.21.15.7:0/3270695655 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8148035040 con 0x55eb469699a0 2024-09-19T04:18:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.400+0000 7f8155a99740 1 -- 172.21.15.7:0/3270695655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb469699a0 msgr2=0x55eb46969da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.400+0000 7f8155a99740 1 --2- 172.21.15.7:0/3270695655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb469699a0 0x55eb46969da0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8148031610 tx=0x7f8148005de0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.400+0000 7f8155a99740 1 -- 172.21.15.7:0/3270695655 shutdown_connections 2024-09-19T04:18:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.400+0000 7f8155a99740 1 --2- 172.21.15.7:0/3270695655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb4696f370 0x55eb46971830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.400+0000 7f8155a99740 1 --2- 172.21.15.7:0/3270695655 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55eb4696a2e0 0x55eb4696eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.400+0000 7f8155a99740 1 --2- 172.21.15.7:0/3270695655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb469699a0 0x55eb46969da0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.400+0000 7f8155a99740 1 -- 172.21.15.7:0/3270695655 >> 172.21.15.7:0/3270695655 conn(0x55eb46965010 msgr2=0x55eb46965410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.400+0000 7f8155a99740 1 -- 172.21.15.7:0/3270695655 shutdown_connections 2024-09-19T04:18:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.400+0000 7f8155a99740 1 -- 172.21.15.7:0/3270695655 wait complete. 2024-09-19T04:18:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.400+0000 7f8155a99740 1 -- start start 2024-09-19T04:18:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.400+0000 7f8155a99740 1 Processor -- start 2024-09-19T04:18:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.401+0000 7f8155a99740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb469699a0 0x55eb46973b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.401+0000 7f8155a99740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb4696a2e0 0x55eb469740a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.401+0000 7f8155a99740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55eb4696f370 0x55eb4697b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.401+0000 7f8155a99740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55eb469722e0 con 0x55eb4696a2e0 2024-09-19T04:18:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.401+0000 7f8155a99740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55eb46856290 con 0x55eb469699a0 2024-09-19T04:18:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.401+0000 7f8155a99740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55eb46972460 con 0x55eb4696f370 2024-09-19T04:18:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.401+0000 7f8155a99740 10 client.0 _ll_register_callbacks cb 0x55eb46887140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:18:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.401+0000 7f8143fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb4696a2e0 0x55eb469740a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.401+0000 7f8143fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb4696a2e0 0x55eb469740a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56684/0 (socket says 172.21.15.7:56684) 2024-09-19T04:18:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.401+0000 7f8143fff640 1 -- 172.21.15.7:0/2441964798 learned_addr learned my addr 172.21.15.7:0/2441964798 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.401+0000 7f81512a0640 1 --2- 172.21.15.7:0/2441964798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55eb4696f370 0x55eb4697b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.401+0000 7f8150a9f640 1 --2- 172.21.15.7:0/2441964798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb469699a0 0x55eb46973b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.401+0000 7f8143fff640 1 -- 172.21.15.7:0/2441964798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55eb4696f370 msgr2=0x55eb4697b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.401+0000 7f8143fff640 1 --2- 172.21.15.7:0/2441964798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55eb4696f370 0x55eb4697b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.401+0000 7f8143fff640 1 -- 172.21.15.7:0/2441964798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb469699a0 msgr2=0x55eb46973b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.401+0000 7f8143fff640 1 --2- 172.21.15.7:0/2441964798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb469699a0 0x55eb46973b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.401+0000 7f8143fff640 1 -- 172.21.15.7:0/2441964798 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb465e0210 con 0x55eb4696a2e0 2024-09-19T04:18:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.401+0000 7f81512a0640 1 --2- 172.21.15.7:0/2441964798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55eb4696f370 0x55eb4697b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:18:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.401+0000 7f8143fff640 1 --2- 172.21.15.7:0/2441964798 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb4696a2e0 0x55eb469740a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f813c0123a0 tx=0x7f813c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cedca20232b13f41 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.401+0000 7f812bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:18:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.402+0000 7f812bfff640 1 -- 172.21.15.7:0/2441964798 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813c024070 con 0x55eb4696a2e0 2024-09-19T04:18:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.402+0000 7f8155a99740 1 -- 172.21.15.7:0/2441964798 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8148004030 con 0x55eb4696a2e0 2024-09-19T04:18:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.402+0000 7f812bfff640 1 -- 172.21.15.7:0/2441964798 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f813c00f8f0 con 0x55eb4696a2e0 2024-09-19T04:18:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.402+0000 7f812bfff640 1 -- 172.21.15.7:0/2441964798 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f813c030050 con 0x55eb4696a2e0 2024-09-19T04:18:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.402+0000 7f8155a99740 10 client.15606 fetch_fsmap learned FSMap version 28 2024-09-19T04:18:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.402+0000 7f8155a99740 1 -- 172.21.15.7:0/2441964798 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55eb466ac620 con 0x55eb4696a2e0 2024-09-19T04:18:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.402+0000 7f812bfff640 1 -- 172.21.15.7:0/2441964798 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8148004030 con 0x55eb4696a2e0 2024-09-19T04:18:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.402+0000 7f812bfff640 1 -- 172.21.15.7:0/2441964798 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f813c01f070 con 0x55eb4696a2e0 2024-09-19T04:18:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.402+0000 7f8155a99740 10 client.15606 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:18:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.402+0000 7f8155a99740 10 client.15606 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:18:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.402+0000 7f8155a99740 20 client.15606 populate_metadata read hostname 'smithi007' 2024-09-19T04:18:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.402+0000 7f8155a99740 1 --2- 172.21.15.7:0/2441964798 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55eb4697f7f0 0x55eb46981c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.402+0000 7f8155a99740 4 client.15606 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:18:16.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.402+0000 7f8155a99740 1 -- 172.21.15.7:0/2441964798 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb468daa20 con 0x55eb4697f7f0 2024-09-19T04:18:16.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.403+0000 7f8150a9f640 1 --2- 172.21.15.7:0/2441964798 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55eb4697f7f0 0x55eb46981c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:16.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.403+0000 7f812bfff640 10 client.15606 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:16.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.403+0000 7f8150a9f640 1 --2- 172.21.15.7:0/2441964798 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55eb4697f7f0 0x55eb46981c60 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8d9e5f4cfac5728 server_cookie=b8e4ea3016050cb8 in_seq=0 out_seq=0 2024-09-19T04:18:16.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.404+0000 7f812bfff640 1 -- 172.21.15.7:0/2441964798 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eb468daa20 con 0x55eb4697f7f0 2024-09-19T04:18:16.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.404+0000 7f812bfff640 10 client.15606 handle_command_reply: tid=0 2024-09-19T04:18:16.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.404+0000 7f8155a99740 1 client.15606 shutdown 2024-09-19T04:18:16.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.404+0000 7f8155a99740 1 -- 172.21.15.7:0/2441964798 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb4696a2e0 msgr2=0x55eb469740a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:16.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.404+0000 7f8155a99740 1 --2- 172.21.15.7:0/2441964798 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb4696a2e0 0x55eb469740a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f813c0123a0 tx=0x7f813c004730 comp rx=0 tx=0).stop 2024-09-19T04:18:16.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.404+0000 7f8155a99740 1 -- 172.21.15.7:0/2441964798 shutdown_connections 2024-09-19T04:18:16.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.404+0000 7f8155a99740 1 --2- 172.21.15.7:0/2441964798 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55eb4697f7f0 0x55eb46981c60 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.404+0000 7f8155a99740 1 --2- 172.21.15.7:0/2441964798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55eb4696f370 0x55eb4697b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.404+0000 7f8155a99740 1 --2- 172.21.15.7:0/2441964798 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb4696a2e0 0x55eb469740a0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.404+0000 7f8155a99740 1 --2- 172.21.15.7:0/2441964798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb469699a0 0x55eb46973b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.404+0000 7f8155a99740 1 -- 172.21.15.7:0/2441964798 >> 172.21.15.7:0/2441964798 conn(0x55eb46965010 msgr2=0x55eb46966820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:16.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.404+0000 7f812bfff640 0 client.15606 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:16.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.404+0000 7f8155a99740 1 -- 172.21.15.7:0/2441964798 shutdown_connections 2024-09-19T04:18:16.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.404+0000 7f8155a99740 1 -- 172.21.15.7:0/2441964798 wait complete. 2024-09-19T04:18:16.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.404+0000 7f8155a99740 20 client.15606 trim_cache size 0 max 16384 2024-09-19T04:18:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.419+0000 7f8155a99740 1 Processor -- start 2024-09-19T04:18:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.420+0000 7f8155a99740 1 -- start start 2024-09-19T04:18:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.420+0000 7f8155a99740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55eb469699a0 0x55eb46986560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.420+0000 7f8155a99740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb4696a2e0 0x55eb46986aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.420+0000 7f8155a99740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb4696f370 0x55eb46986fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.420+0000 7f8155a99740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f814c1aa8f0 con 0x55eb4696a2e0 2024-09-19T04:18:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.420+0000 7f8155a99740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f814c1ac430 con 0x55eb4696f370 2024-09-19T04:18:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.420+0000 7f8155a99740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f814c1aafc0 con 0x55eb469699a0 2024-09-19T04:18:16.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.420+0000 7f8143fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb4696a2e0 0x55eb46986aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:16.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.420+0000 7f8143fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb4696a2e0 0x55eb46986aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56688/0 (socket says 172.21.15.7:56688) 2024-09-19T04:18:16.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.420+0000 7f8143fff640 1 -- 172.21.15.7:0/1390795027 learned_addr learned my addr 172.21.15.7:0/1390795027 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:16.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.420+0000 7f8150a9f640 1 --2- 172.21.15.7:0/1390795027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55eb469699a0 0x55eb46986560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:16.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.420+0000 7f81512a0640 1 --2- 172.21.15.7:0/1390795027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb4696f370 0x55eb46986fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:16.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.420+0000 7f8143fff640 1 -- 172.21.15.7:0/1390795027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55eb469699a0 msgr2=0x55eb46986560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:16.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.420+0000 7f8143fff640 1 --2- 172.21.15.7:0/1390795027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55eb469699a0 0x55eb46986560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.420+0000 7f8143fff640 1 -- 172.21.15.7:0/1390795027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb4696f370 msgr2=0x55eb46986fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:16.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.420+0000 7f8143fff640 1 --2- 172.21.15.7:0/1390795027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb4696f370 0x55eb46986fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.420+0000 7f8143fff640 1 -- 172.21.15.7:0/1390795027 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb46965ca0 con 0x55eb4696a2e0 2024-09-19T04:18:16.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.420+0000 7f8143fff640 1 --2- 172.21.15.7:0/1390795027 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb4696a2e0 0x55eb46986aa0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f813c013da0 tx=0x7f813c003e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174c65aed41e4b23 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:16.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.420+0000 7f81327fc640 1 -- 172.21.15.7:0/1390795027 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813c024040 con 0x55eb4696a2e0 2024-09-19T04:18:16.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.421+0000 7f81327fc640 1 -- 172.21.15.7:0/1390795027 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f813c004540 con 0x55eb4696a2e0 2024-09-19T04:18:16.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.421+0000 7f81327fc640 1 -- 172.21.15.7:0/1390795027 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813c004a00 con 0x55eb4696a2e0 2024-09-19T04:18:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.421+0000 7f8155a99740 1 -- 172.21.15.7:0/1390795027 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb4696a2e0 msgr2=0x55eb46986aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.421+0000 7f8155a99740 1 --2- 172.21.15.7:0/1390795027 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb4696a2e0 0x55eb46986aa0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f813c013da0 tx=0x7f813c003e10 comp rx=0 tx=0).stop 2024-09-19T04:18:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.421+0000 7f8155a99740 1 -- 172.21.15.7:0/1390795027 shutdown_connections 2024-09-19T04:18:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.421+0000 7f8155a99740 1 --2- 172.21.15.7:0/1390795027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb4696f370 0x55eb46986fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.421+0000 7f8155a99740 1 --2- 172.21.15.7:0/1390795027 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb4696a2e0 0x55eb46986aa0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.421+0000 7f8155a99740 1 --2- 172.21.15.7:0/1390795027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55eb469699a0 0x55eb46986560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.421+0000 7f8155a99740 1 -- 172.21.15.7:0/1390795027 >> 172.21.15.7:0/1390795027 conn(0x55eb46965010 msgr2=0x55eb469641c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.421+0000 7f8155a99740 1 -- 172.21.15.7:0/1390795027 shutdown_connections 2024-09-19T04:18:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.421+0000 7f8155a99740 1 -- 172.21.15.7:0/1390795027 wait complete. 2024-09-19T04:18:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.422+0000 7f8155a99740 1 -- start start 2024-09-19T04:18:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.422+0000 7f8155a99740 1 Processor -- start 2024-09-19T04:18:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.422+0000 7f8155a99740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55eb469699a0 0x55eb469e66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.422+0000 7f8155a99740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb4696a2e0 0x55eb469e6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.422+0000 7f8155a99740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb4696f370 0x55eb469edbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.422+0000 7f8155a99740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f814c1abd60 con 0x55eb4696f370 2024-09-19T04:18:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.422+0000 7f8155a99740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f814c1ab690 con 0x55eb4696a2e0 2024-09-19T04:18:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.422+0000 7f8155a99740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f814c1a88b0 con 0x55eb469699a0 2024-09-19T04:18:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.422+0000 7f8155a99740 10 client.0 _ll_register_callbacks cb 0x7f813c009d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:18:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.422+0000 7f81512a0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb4696f370 0x55eb469edbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.422+0000 7f81512a0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb4696f370 0x55eb469edbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56704/0 (socket says 172.21.15.7:56704) 2024-09-19T04:18:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.422+0000 7f81512a0640 1 -- 172.21.15.7:0/1991859196 learned_addr learned my addr 172.21.15.7:0/1991859196 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.422+0000 7f8143fff640 1 --2- 172.21.15.7:0/1991859196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb4696a2e0 0x55eb469e6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.422+0000 7f8150a9f640 1 --2- 172.21.15.7:0/1991859196 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55eb469699a0 0x55eb469e66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.422+0000 7f81512a0640 1 -- 172.21.15.7:0/1991859196 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55eb469699a0 msgr2=0x55eb469e66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.422+0000 7f81512a0640 1 --2- 172.21.15.7:0/1991859196 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55eb469699a0 0x55eb469e66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.422+0000 7f81512a0640 1 -- 172.21.15.7:0/1991859196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb4696a2e0 msgr2=0x55eb469e6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.422+0000 7f81512a0640 1 --2- 172.21.15.7:0/1991859196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb4696a2e0 0x55eb469e6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.423+0000 7f81512a0640 1 -- 172.21.15.7:0/1991859196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb469ee1d0 con 0x55eb4696f370 2024-09-19T04:18:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.423+0000 7f8143fff640 1 --2- 172.21.15.7:0/1991859196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb4696a2e0 0x55eb469e6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:18:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.423+0000 7f81512a0640 1 --2- 172.21.15.7:0/1991859196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb4696f370 0x55eb469edbc0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f814400cfb0 tx=0x7f814409c150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b622fd870ddc260a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.423+0000 7f812bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:18:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.423+0000 7f812bfff640 1 -- 172.21.15.7:0/1991859196 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8144081020 con 0x55eb4696f370 2024-09-19T04:18:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.423+0000 7f812bfff640 1 -- 172.21.15.7:0/1991859196 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f81440cdad0 con 0x55eb4696f370 2024-09-19T04:18:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.423+0000 7f8155a99740 1 -- 172.21.15.7:0/1991859196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f813c004540 con 0x55eb4696f370 2024-09-19T04:18:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.423+0000 7f812bfff640 1 -- 172.21.15.7:0/1991859196 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f81440a0890 con 0x55eb4696f370 2024-09-19T04:18:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.423+0000 7f8155a99740 10 client.15612 fetch_fsmap learned FSMap version 28 2024-09-19T04:18:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.423+0000 7f8155a99740 1 -- 172.21.15.7:0/1991859196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55eb469ef5b0 con 0x55eb4696f370 2024-09-19T04:18:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.423+0000 7f812bfff640 1 -- 172.21.15.7:0/1991859196 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f813c004540 con 0x55eb4696f370 2024-09-19T04:18:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.423+0000 7f812bfff640 1 -- 172.21.15.7:0/1991859196 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f81440a4cc0 con 0x55eb4696f370 2024-09-19T04:18:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.423+0000 7f8155a99740 10 client.15612 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:18:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.423+0000 7f8155a99740 10 client.15612 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:18:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.423+0000 7f8155a99740 20 client.15612 populate_metadata read hostname 'smithi007' 2024-09-19T04:18:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.424+0000 7f8155a99740 1 --2- 172.21.15.7:0/1991859196 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55eb469eff30 0x55eb469f2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.424+0000 7f8155a99740 4 client.15612 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:18:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.424+0000 7f8155a99740 1 -- 172.21.15.7:0/1991859196 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55eb468d4d70 con 0x55eb469eff30 2024-09-19T04:18:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.424+0000 7f8150a9f640 1 --2- 172.21.15.7:0/1991859196 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55eb469eff30 0x55eb469f2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.424+0000 7f8150a9f640 1 --2- 172.21.15.7:0/1991859196 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55eb469eff30 0x55eb469f2350 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6eab1cdd8d74ce6 server_cookie=3e4676ae0f1a5d1f in_seq=0 out_seq=0 2024-09-19T04:18:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.424+0000 7f812bfff640 10 client.15612 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.459+0000 7f812bfff640 1 -- 172.21.15.7:0/1991859196 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55eb468d4d70 con 0x55eb469eff30 2024-09-19T04:18:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.459+0000 7f812bfff640 10 client.15612 handle_command_reply: tid=0 2024-09-19T04:18:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.459+0000 7f8155a99740 1 client.15612 shutdown 2024-09-19T04:18:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.459+0000 7f8155a99740 1 -- 172.21.15.7:0/1991859196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb4696f370 msgr2=0x55eb469edbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.459+0000 7f8155a99740 1 --2- 172.21.15.7:0/1991859196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb4696f370 0x55eb469edbc0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f814400cfb0 tx=0x7f814409c150 comp rx=0 tx=0).stop 2024-09-19T04:18:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.459+0000 7f8155a99740 1 -- 172.21.15.7:0/1991859196 shutdown_connections 2024-09-19T04:18:16.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.459+0000 7f8155a99740 1 --2- 172.21.15.7:0/1991859196 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55eb469eff30 0x55eb469f2350 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.459+0000 7f8155a99740 1 --2- 172.21.15.7:0/1991859196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55eb4696f370 0x55eb469edbc0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.459+0000 7f812bfff640 0 client.15612 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:16.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.459+0000 7f8155a99740 1 --2- 172.21.15.7:0/1991859196 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eb4696a2e0 0x55eb469e6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.459+0000 7f8155a99740 1 --2- 172.21.15.7:0/1991859196 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55eb469699a0 0x55eb469e66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.459+0000 7f8155a99740 1 -- 172.21.15.7:0/1991859196 >> 172.21.15.7:0/1991859196 conn(0x55eb46965010 msgr2=0x55eb46965ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:16.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.459+0000 7f8155a99740 1 -- 172.21.15.7:0/1991859196 shutdown_connections 2024-09-19T04:18:16.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.459+0000 7f8155a99740 1 -- 172.21.15.7:0/1991859196 wait complete. 2024-09-19T04:18:16.462 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.459+0000 7f8155a99740 20 client.15612 trim_cache size 0 max 16384 2024-09-19T04:18:16.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:18:16.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:18:16.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:18:16.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:18:16.463 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.460+0000 7f8152d03640 1 -- 172.21.15.7:0/3168340466 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f81340a3240 msgr2=0x7f81340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:16.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.460+0000 7f8152d03640 1 --2- 172.21.15.7:0/3168340466 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f81340a3240 0x7f81340a5700 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f813c009710 tx=0x7f813c013880 comp rx=0 tx=0).stop 2024-09-19T04:18:16.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.460+0000 7f8152d03640 1 -- 172.21.15.7:0/3168340466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f814c103720 msgr2=0x7f814c19f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:16.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.460+0000 7f8152d03640 1 --2- 172.21.15.7:0/3168340466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f814c103720 0x7f814c19f480 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f814400eb10 tx=0x7f814400c2d0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.460+0000 7f8152d03640 1 -- 172.21.15.7:0/3168340466 shutdown_connections 2024-09-19T04:18:16.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.460+0000 7f8152d03640 1 --2- 172.21.15.7:0/3168340466 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f81340a3240 0x7f81340a5700 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.460+0000 7f8152d03640 1 --2- 172.21.15.7:0/3168340466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f814c103720 0x7f814c19f480 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.460+0000 7f8152d03640 1 --2- 172.21.15.7:0/3168340466 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f814c102d60 0x7f814c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.460+0000 7f8152d03640 1 --2- 172.21.15.7:0/3168340466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f814c101b70 0x7f814c197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:16.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.460+0000 7f8152d03640 1 -- 172.21.15.7:0/3168340466 >> 172.21.15.7:0/3168340466 conn(0x7f814c0fd2f0 msgr2=0x7f814c106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:16.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.460+0000 7f8152d03640 1 -- 172.21.15.7:0/3168340466 shutdown_connections 2024-09-19T04:18:16.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:16.460+0000 7f8152d03640 1 -- 172.21.15.7:0/3168340466 wait complete. 2024-09-19T04:18:16.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:16 smithi007 ceph-mon[31360]: pgmap v395: 129 pgs: 129 active+clean; 896 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-09-19T04:18:16.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:16 smithi007 ceph-mon[31360]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-19T04:18:16.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:16 smithi102 ceph-mon[35446]: pgmap v395: 129 pgs: 129 active+clean; 896 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-09-19T04:18:16.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:16 smithi102 ceph-mon[35446]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-19T04:18:16.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:16 smithi092 ceph-mon[34940]: pgmap v395: 129 pgs: 129 active+clean; 896 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-09-19T04:18:16.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:16 smithi092 ceph-mon[34940]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-19T04:18:18.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:18 smithi007 ceph-mon[31360]: pgmap v396: 129 pgs: 129 active+clean; 896 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 KiB/s wr, 13 op/s 2024-09-19T04:18:18.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:18 smithi102 ceph-mon[35446]: pgmap v396: 129 pgs: 129 active+clean; 896 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 KiB/s wr, 13 op/s 2024-09-19T04:18:18.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:18 smithi092 ceph-mon[34940]: pgmap v396: 129 pgs: 129 active+clean; 896 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 KiB/s wr, 13 op/s 2024-09-19T04:18:20.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:20 smithi007 ceph-mon[31360]: pgmap v397: 129 pgs: 129 active+clean; 1.5 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 79 KiB/s wr, 35 op/s 2024-09-19T04:18:20.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:20 smithi102 ceph-mon[35446]: pgmap v397: 129 pgs: 129 active+clean; 1.5 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 79 KiB/s wr, 35 op/s 2024-09-19T04:18:20.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:20 smithi092 ceph-mon[34940]: pgmap v397: 129 pgs: 129 active+clean; 1.5 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 79 KiB/s wr, 35 op/s 2024-09-19T04:18:22.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:22 smithi007 ceph-mon[31360]: pgmap v398: 129 pgs: 129 active+clean; 1.7 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 97 KiB/s wr, 35 op/s 2024-09-19T04:18:22.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:22 smithi102 ceph-mon[35446]: pgmap v398: 129 pgs: 129 active+clean; 1.7 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 97 KiB/s wr, 35 op/s 2024-09-19T04:18:22.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:22 smithi092 ceph-mon[34940]: pgmap v398: 129 pgs: 129 active+clean; 1.7 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 97 KiB/s wr, 35 op/s 2024-09-19T04:18:24.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:24 smithi007 ceph-mon[31360]: pgmap v399: 129 pgs: 129 active+clean; 1.7 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 99 KiB/s wr, 39 op/s 2024-09-19T04:18:24.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:24 smithi102 ceph-mon[35446]: pgmap v399: 129 pgs: 129 active+clean; 1.7 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 99 KiB/s wr, 39 op/s 2024-09-19T04:18:24.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:24 smithi092 ceph-mon[34940]: pgmap v399: 129 pgs: 129 active+clean; 1.7 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 99 KiB/s wr, 39 op/s 2024-09-19T04:18:26.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:26 smithi007 ceph-mon[31360]: pgmap v400: 129 pgs: 129 active+clean; 1.7 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 77 KiB/s wr, 34 op/s 2024-09-19T04:18:26.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:26 smithi102 ceph-mon[35446]: pgmap v400: 129 pgs: 129 active+clean; 1.7 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 77 KiB/s wr, 34 op/s 2024-09-19T04:18:26.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:26 smithi092 ceph-mon[34940]: pgmap v400: 129 pgs: 129 active+clean; 1.7 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 77 KiB/s wr, 34 op/s 2024-09-19T04:18:28.598 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:28 smithi092 ceph-mon[34940]: pgmap v401: 129 pgs: 129 active+clean; 1.7 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 76 KiB/s wr, 32 op/s 2024-09-19T04:18:28.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:28 smithi007 ceph-mon[31360]: pgmap v401: 129 pgs: 129 active+clean; 1.7 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 76 KiB/s wr, 32 op/s 2024-09-19T04:18:28.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:28 smithi102 ceph-mon[35446]: pgmap v401: 129 pgs: 129 active+clean; 1.7 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 76 KiB/s wr, 32 op/s 2024-09-19T04:18:29.117 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:18:29.395 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:18:29.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.549+0000 7f65caac9640 1 -- 172.21.15.7:0/254107067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65c4103720 msgr2=0x7f65c4109fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:29.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.549+0000 7f65caac9640 1 --2- 172.21.15.7:0/254107067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65c4103720 0x7f65c4109fb0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f65bc009ca0 tx=0x7f65bc02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.550+0000 7f65caac9640 1 -- 172.21.15.7:0/254107067 shutdown_connections 2024-09-19T04:18:29.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.550+0000 7f65caac9640 1 --2- 172.21.15.7:0/254107067 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65c4103720 0x7f65c4109fb0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.550+0000 7f65caac9640 1 --2- 172.21.15.7:0/254107067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65c4102d60 0x7f65c41031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.550+0000 7f65caac9640 1 --2- 172.21.15.7:0/254107067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65c4101b70 0x7f65c4101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.550+0000 7f65caac9640 1 -- 172.21.15.7:0/254107067 >> 172.21.15.7:0/254107067 conn(0x7f65c40fd2f0 msgr2=0x7f65c40ff710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:29.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.550+0000 7f65caac9640 1 -- 172.21.15.7:0/254107067 shutdown_connections 2024-09-19T04:18:29.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.550+0000 7f65caac9640 1 -- 172.21.15.7:0/254107067 wait complete. 2024-09-19T04:18:29.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.550+0000 7f65caac9640 1 Processor -- start 2024-09-19T04:18:29.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.550+0000 7f65caac9640 1 -- start start 2024-09-19T04:18:29.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.550+0000 7f65caac9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65c4101b70 0x7f65c4197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:29.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.550+0000 7f65caac9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65c4102d60 0x7f65c4198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:29.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.550+0000 7f65caac9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65c4103720 0x7f65c419f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:29.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.550+0000 7f65caac9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f65c410d7d0 con 0x7f65c4101b70 2024-09-19T04:18:29.554 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.550+0000 7f65caac9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f65c410d650 con 0x7f65c4103720 2024-09-19T04:18:29.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.550+0000 7f65caac9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f65c410d950 con 0x7f65c4102d60 2024-09-19T04:18:29.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.550+0000 7f65c8865640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65c4101b70 0x7f65c4197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:29.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.550+0000 7f65c8865640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65c4101b70 0x7f65c4197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47948/0 (socket says 172.21.15.7:47948) 2024-09-19T04:18:29.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.550+0000 7f65c8865640 1 -- 172.21.15.7:0/3552142796 learned_addr learned my addr 172.21.15.7:0/3552142796 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:29.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.551+0000 7f65c9066640 1 --2- 172.21.15.7:0/3552142796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65c4103720 0x7f65c419f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:29.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.551+0000 7f65c3fff640 1 --2- 172.21.15.7:0/3552142796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65c4102d60 0x7f65c4198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:29.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.551+0000 7f65c8865640 1 -- 172.21.15.7:0/3552142796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65c4102d60 msgr2=0x7f65c4198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:29.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.551+0000 7f65c8865640 1 --2- 172.21.15.7:0/3552142796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65c4102d60 0x7f65c4198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.551+0000 7f65c8865640 1 -- 172.21.15.7:0/3552142796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65c4103720 msgr2=0x7f65c419f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:29.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.551+0000 7f65c8865640 1 --2- 172.21.15.7:0/3552142796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65c4103720 0x7f65c419f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.551+0000 7f65c8865640 1 -- 172.21.15.7:0/3552142796 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65c419fa30 con 0x7f65c4101b70 2024-09-19T04:18:29.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.551+0000 7f65c9066640 1 --2- 172.21.15.7:0/3552142796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65c4103720 0x7f65c419f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:18:29.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.551+0000 7f65c8865640 1 --2- 172.21.15.7:0/3552142796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65c4101b70 0x7f65c4197e10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f65b400d950 tx=0x7f65b400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:29.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.551+0000 7f65c1ffb640 1 -- 172.21.15.7:0/3552142796 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b4017020 con 0x7f65c4101b70 2024-09-19T04:18:29.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.551+0000 7f65c1ffb640 1 -- 172.21.15.7:0/3552142796 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65b4009c30 con 0x7f65c4101b70 2024-09-19T04:18:29.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.551+0000 7f65caac9640 1 -- 172.21.15.7:0/3552142796 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65c419fd20 con 0x7f65c4101b70 2024-09-19T04:18:29.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.551+0000 7f65c1ffb640 1 -- 172.21.15.7:0/3552142796 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b400f720 con 0x7f65c4101b70 2024-09-19T04:18:29.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.551+0000 7f65caac9640 1 -- 172.21.15.7:0/3552142796 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65c41a0200 con 0x7f65c4101b70 2024-09-19T04:18:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.554+0000 7f65c1ffb640 1 -- 172.21.15.7:0/3552142796 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f65b401a020 con 0x7f65c4101b70 2024-09-19T04:18:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.554+0000 7f65cd85f740 1 Processor -- start 2024-09-19T04:18:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.554+0000 7f65cd85f740 1 -- start start 2024-09-19T04:18:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.554+0000 7f65cd85f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555db79219a0 0x555db7921da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.554+0000 7f65cd85f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555db79222e0 0x555db7926da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.554+0000 7f65cd85f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555db7927370 0x555db7929830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.554+0000 7f65cd85f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555db78852f0 con 0x555db79222e0 2024-09-19T04:18:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.554+0000 7f65cd85f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555db782d270 con 0x555db79219a0 2024-09-19T04:18:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.554+0000 7f65cd85f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555db78812b0 con 0x555db7927370 2024-09-19T04:18:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.555+0000 7f65c1ffb640 1 --2- 172.21.15.7:0/3552142796 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f65b00a32c0 0x7f65b00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.555+0000 7f65c8865640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555db79222e0 0x555db7926da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.555+0000 7f65c8865640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555db79222e0 0x555db7926da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47950/0 (socket says 172.21.15.7:47950) 2024-09-19T04:18:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.555+0000 7f65c8865640 1 -- 172.21.15.7:0/3485056035 learned_addr learned my addr 172.21.15.7:0/3485056035 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.555+0000 7f65c9066640 1 --2- 172.21.15.7:0/3485056035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555db79219a0 0x555db7921da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.555+0000 7f65c3fff640 1 --2- 172.21.15.7:0/3485056035 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555db7927370 0x555db7929830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.555+0000 7f65c9066640 1 --2- 172.21.15.7:0/3552142796 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f65b00a32c0 0x7f65b00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.555+0000 7f65c3fff640 1 -- 172.21.15.7:0/3485056035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555db79219a0 msgr2=0x555db7921da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.555+0000 7f65c3fff640 1 --2- 172.21.15.7:0/3485056035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555db79219a0 0x555db7921da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.555+0000 7f65c3fff640 1 -- 172.21.15.7:0/3485056035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555db79222e0 msgr2=0x555db7926da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.555+0000 7f65c3fff640 1 --2- 172.21.15.7:0/3485056035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555db79222e0 0x555db7926da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.555+0000 7f65c3fff640 1 -- 172.21.15.7:0/3485056035 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555db782c340 con 0x555db7927370 2024-09-19T04:18:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.555+0000 7f65c8865640 1 --2- 172.21.15.7:0/3485056035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555db79222e0 0x555db7926da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:18:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.556+0000 7f65c9066640 1 --2- 172.21.15.7:0/3552142796 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f65b00a32c0 0x7f65b00a5780 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f65bc005cc0 tx=0x7f65bc004a60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.556+0000 7f65c1ffb640 1 -- 172.21.15.7:0/3552142796 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f65b40cfc70 con 0x7f65c4101b70 2024-09-19T04:18:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.556+0000 7f65c3fff640 1 --2- 172.21.15.7:0/3485056035 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555db7927370 0x555db7929830 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f65ac005fd0 tx=0x7f65ac00df80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4ef3f077a6c7993 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.556+0000 7f65baffd640 1 -- 172.21.15.7:0/3485056035 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac00fd20 con 0x555db7927370 2024-09-19T04:18:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.556+0000 7f65baffd640 1 -- 172.21.15.7:0/3485056035 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65ac005500 con 0x555db7927370 2024-09-19T04:18:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.556+0000 7f65baffd640 1 -- 172.21.15.7:0/3485056035 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac0116a0 con 0x555db7927370 2024-09-19T04:18:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.557+0000 7f65cd85f740 1 -- 172.21.15.7:0/3485056035 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555db7927370 msgr2=0x555db7929830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.557+0000 7f65cd85f740 1 --2- 172.21.15.7:0/3485056035 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555db7927370 0x555db7929830 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f65ac005fd0 tx=0x7f65ac00df80 comp rx=0 tx=0).stop 2024-09-19T04:18:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.557+0000 7f65cd85f740 1 -- 172.21.15.7:0/3485056035 shutdown_connections 2024-09-19T04:18:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.557+0000 7f65cd85f740 1 --2- 172.21.15.7:0/3485056035 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555db7927370 0x555db7929830 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.557+0000 7f65cd85f740 1 --2- 172.21.15.7:0/3485056035 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555db79222e0 0x555db7926da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.557+0000 7f65cd85f740 1 --2- 172.21.15.7:0/3485056035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555db79219a0 0x555db7921da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.557+0000 7f65cd85f740 1 -- 172.21.15.7:0/3485056035 >> 172.21.15.7:0/3485056035 conn(0x555db791d010 msgr2=0x555db791d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.557+0000 7f65cd85f740 1 -- 172.21.15.7:0/3485056035 shutdown_connections 2024-09-19T04:18:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.557+0000 7f65cd85f740 1 -- 172.21.15.7:0/3485056035 wait complete. 2024-09-19T04:18:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.557+0000 7f65cd85f740 1 -- start start 2024-09-19T04:18:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.557+0000 7f65cd85f740 1 Processor -- start 2024-09-19T04:18:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.558+0000 7f65cd85f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555db79219a0 0x555db792bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.558+0000 7f65cd85f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555db79222e0 0x555db792c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.558+0000 7f65cd85f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555db7927370 0x555db79330b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.558+0000 7f65cd85f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555db792a340 con 0x555db79219a0 2024-09-19T04:18:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.558+0000 7f65cd85f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555db780e290 con 0x555db7927370 2024-09-19T04:18:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.558+0000 7f65cd85f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555db792a4c0 con 0x555db79222e0 2024-09-19T04:18:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.558+0000 7f65cd85f740 10 client.0 _ll_register_callbacks cb 0x555db783f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:18:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.558+0000 7f65c8865640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555db79219a0 0x555db792bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.558+0000 7f65c8865640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555db79219a0 0x555db792bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47962/0 (socket says 172.21.15.7:47962) 2024-09-19T04:18:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.558+0000 7f65c8865640 1 -- 172.21.15.7:0/271991976 learned_addr learned my addr 172.21.15.7:0/271991976 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.558+0000 7f65c3fff640 1 --2- 172.21.15.7:0/271991976 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555db79222e0 0x555db792c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.558+0000 7f65c9066640 1 --2- 172.21.15.7:0/271991976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555db7927370 0x555db79330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.558+0000 7f65c8865640 1 -- 172.21.15.7:0/271991976 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555db79222e0 msgr2=0x555db792c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.558+0000 7f65c8865640 1 --2- 172.21.15.7:0/271991976 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555db79222e0 0x555db792c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.558+0000 7f65c8865640 1 -- 172.21.15.7:0/271991976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555db7927370 msgr2=0x555db79330b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.558+0000 7f65c8865640 1 --2- 172.21.15.7:0/271991976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555db7927370 0x555db79330b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.558+0000 7f65c8865640 1 -- 172.21.15.7:0/271991976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555db7598210 con 0x555db79219a0 2024-09-19T04:18:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.558+0000 7f65c9066640 1 --2- 172.21.15.7:0/271991976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555db7927370 0x555db79330b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:18:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.558+0000 7f65c8865640 1 --2- 172.21.15.7:0/271991976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555db79219a0 0x555db792bb30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f65b4005fd0 tx=0x7f65b409bc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba0119805479494 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.558+0000 7f65a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:18:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.559+0000 7f65a3fff640 1 -- 172.21.15.7:0/271991976 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b40a4b30 con 0x555db79219a0 2024-09-19T04:18:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.559+0000 7f65a3fff640 1 -- 172.21.15.7:0/271991976 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f65b4010a60 con 0x555db79219a0 2024-09-19T04:18:29.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.559+0000 7f65cd85f740 1 -- 172.21.15.7:0/271991976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65ac005500 con 0x555db79219a0 2024-09-19T04:18:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.559+0000 7f65a3fff640 1 -- 172.21.15.7:0/271991976 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f65b409bec0 con 0x555db79219a0 2024-09-19T04:18:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.559+0000 7f65cd85f740 10 client.15624 fetch_fsmap learned FSMap version 28 2024-09-19T04:18:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.559+0000 7f65cd85f740 1 -- 172.21.15.7:0/271991976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555db7664620 con 0x555db79219a0 2024-09-19T04:18:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.559+0000 7f65a3fff640 1 -- 172.21.15.7:0/271991976 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65ac005500 con 0x555db79219a0 2024-09-19T04:18:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.559+0000 7f65a3fff640 1 -- 172.21.15.7:0/271991976 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f65b409b310 con 0x555db79219a0 2024-09-19T04:18:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.559+0000 7f65cd85f740 10 client.15624 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:18:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.559+0000 7f65cd85f740 10 client.15624 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:18:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.559+0000 7f65cd85f740 20 client.15624 populate_metadata read hostname 'smithi007' 2024-09-19T04:18:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.559+0000 7f65cd85f740 1 --2- 172.21.15.7:0/271991976 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x555db7937810 0x555db7939c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.559+0000 7f65cd85f740 4 client.15624 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:18:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.559+0000 7f65cd85f740 1 -- 172.21.15.7:0/271991976 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555db7892a20 con 0x555db7937810 2024-09-19T04:18:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.560+0000 7f65c3fff640 1 --2- 172.21.15.7:0/271991976 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x555db7937810 0x555db7939c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.560+0000 7f65a3fff640 10 client.15624 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.560+0000 7f65c3fff640 1 --2- 172.21.15.7:0/271991976 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x555db7937810 0x555db7939c00 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d85441e3a616264c server_cookie=77fb3a99bd9d81d5 in_seq=0 out_seq=0 2024-09-19T04:18:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.561+0000 7f65a3fff640 1 -- 172.21.15.7:0/271991976 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555db7892a20 con 0x555db7937810 2024-09-19T04:18:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.561+0000 7f65a3fff640 10 client.15624 handle_command_reply: tid=0 2024-09-19T04:18:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.561+0000 7f65cd85f740 1 client.15624 shutdown 2024-09-19T04:18:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.561+0000 7f65cd85f740 1 -- 172.21.15.7:0/271991976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555db79219a0 msgr2=0x555db792bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.561+0000 7f65cd85f740 1 --2- 172.21.15.7:0/271991976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555db79219a0 0x555db792bb30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f65b4005fd0 tx=0x7f65b409bc90 comp rx=0 tx=0).stop 2024-09-19T04:18:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.561+0000 7f65cd85f740 1 -- 172.21.15.7:0/271991976 shutdown_connections 2024-09-19T04:18:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.561+0000 7f65cd85f740 1 --2- 172.21.15.7:0/271991976 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x555db7937810 0x555db7939c00 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.561+0000 7f65cd85f740 1 --2- 172.21.15.7:0/271991976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555db7927370 0x555db79330b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.561+0000 7f65cd85f740 1 --2- 172.21.15.7:0/271991976 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555db79222e0 0x555db792c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.561+0000 7f65a3fff640 0 client.15624 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.561+0000 7f65cd85f740 1 --2- 172.21.15.7:0/271991976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555db79219a0 0x555db792bb30 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.561+0000 7f65cd85f740 1 -- 172.21.15.7:0/271991976 >> 172.21.15.7:0/271991976 conn(0x555db791d010 msgr2=0x555db791e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.561+0000 7f65cd85f740 1 -- 172.21.15.7:0/271991976 shutdown_connections 2024-09-19T04:18:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.561+0000 7f65cd85f740 1 -- 172.21.15.7:0/271991976 wait complete. 2024-09-19T04:18:29.569 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.561+0000 7f65cd85f740 20 client.15624 trim_cache size 0 max 16384 2024-09-19T04:18:29.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.575+0000 7f65cd85f740 1 Processor -- start 2024-09-19T04:18:29.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.576+0000 7f65cd85f740 1 -- start start 2024-09-19T04:18:29.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.576+0000 7f65cd85f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555db79219a0 0x555db792bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:29.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.576+0000 7f65cd85f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555db79222e0 0x555db7933070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:29.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.576+0000 7f65cd85f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555db7927370 0x555db793e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:29.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.576+0000 7f65cd85f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f65c41aa970 con 0x555db79222e0 2024-09-19T04:18:29.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.576+0000 7f65cd85f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f65c41ac4b0 con 0x555db79219a0 2024-09-19T04:18:29.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.576+0000 7f65cd85f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f65c41ab040 con 0x555db7927370 2024-09-19T04:18:29.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.576+0000 7f65c3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555db79222e0 0x555db7933070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.576+0000 7f65c3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555db79222e0 0x555db7933070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47970/0 (socket says 172.21.15.7:47970) 2024-09-19T04:18:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.576+0000 7f65c3fff640 1 -- 172.21.15.7:0/223103209 learned_addr learned my addr 172.21.15.7:0/223103209 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.576+0000 7f65c9066640 1 --2- 172.21.15.7:0/223103209 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555db7927370 0x555db793e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.576+0000 7f65c3fff640 1 -- 172.21.15.7:0/223103209 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555db7927370 msgr2=0x555db793e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.576+0000 7f65c3fff640 1 --2- 172.21.15.7:0/223103209 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555db7927370 0x555db793e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.576+0000 7f65c3fff640 1 -- 172.21.15.7:0/223103209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555db79219a0 msgr2=0x555db792bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.576+0000 7f65c3fff640 1 --2- 172.21.15.7:0/223103209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555db79219a0 0x555db792bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.576+0000 7f65c3fff640 1 -- 172.21.15.7:0/223103209 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555db792b670 con 0x555db79222e0 2024-09-19T04:18:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.576+0000 7f65c3fff640 1 --2- 172.21.15.7:0/223103209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555db79222e0 0x555db7933070 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f65ac005fd0 tx=0x7f65ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c7ec2637a2b42c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.576+0000 7f65ba7fc640 1 -- 172.21.15.7:0/223103209 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac02c020 con 0x555db79222e0 2024-09-19T04:18:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.576+0000 7f65ba7fc640 1 -- 172.21.15.7:0/223103209 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65ac00fd20 con 0x555db79222e0 2024-09-19T04:18:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.577+0000 7f65ba7fc640 1 -- 172.21.15.7:0/223103209 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac003de0 con 0x555db79222e0 2024-09-19T04:18:29.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.577+0000 7f65cd85f740 1 -- 172.21.15.7:0/223103209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555db79222e0 msgr2=0x555db7933070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:29.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.577+0000 7f65cd85f740 1 --2- 172.21.15.7:0/223103209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555db79222e0 0x555db7933070 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f65ac005fd0 tx=0x7f65ac0046c0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.577+0000 7f65cd85f740 1 -- 172.21.15.7:0/223103209 shutdown_connections 2024-09-19T04:18:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.577+0000 7f65cd85f740 1 --2- 172.21.15.7:0/223103209 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555db7927370 0x555db793e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.577+0000 7f65cd85f740 1 --2- 172.21.15.7:0/223103209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555db79222e0 0x555db7933070 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.577+0000 7f65cd85f740 1 --2- 172.21.15.7:0/223103209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555db79219a0 0x555db792bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.577+0000 7f65cd85f740 1 -- 172.21.15.7:0/223103209 >> 172.21.15.7:0/223103209 conn(0x555db791d010 msgr2=0x555db791c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.577+0000 7f65cd85f740 1 -- 172.21.15.7:0/223103209 shutdown_connections 2024-09-19T04:18:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.577+0000 7f65cd85f740 1 -- 172.21.15.7:0/223103209 wait complete. 2024-09-19T04:18:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.577+0000 7f65cd85f740 1 -- start start 2024-09-19T04:18:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.577+0000 7f65cd85f740 1 Processor -- start 2024-09-19T04:18:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.578+0000 7f65cd85f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555db79219a0 0x555db7932bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.578+0000 7f65cd85f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555db79222e0 0x555db79311d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.578+0000 7f65cd85f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555db7927370 0x555db7931710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.578+0000 7f65cd85f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f65c41abde0 con 0x555db79219a0 2024-09-19T04:18:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.578+0000 7f65cd85f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f65c41ab710 con 0x555db79222e0 2024-09-19T04:18:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.578+0000 7f65cd85f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f65c41a8930 con 0x555db7927370 2024-09-19T04:18:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.578+0000 7f65cd85f740 10 client.0 _ll_register_callbacks cb 0x7f65b40bc0b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:18:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.578+0000 7f65c8865640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555db79219a0 0x555db7932bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.578+0000 7f65c8865640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555db79219a0 0x555db7932bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47974/0 (socket says 172.21.15.7:47974) 2024-09-19T04:18:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.578+0000 7f65c8865640 1 -- 172.21.15.7:0/2948879719 learned_addr learned my addr 172.21.15.7:0/2948879719 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.578+0000 7f65c9066640 1 --2- 172.21.15.7:0/2948879719 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555db7927370 0x555db7931710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.578+0000 7f65c3fff640 1 --2- 172.21.15.7:0/2948879719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555db79222e0 0x555db79311d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.578+0000 7f65c8865640 1 -- 172.21.15.7:0/2948879719 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555db7927370 msgr2=0x555db7931710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.578+0000 7f65c8865640 1 --2- 172.21.15.7:0/2948879719 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555db7927370 0x555db7931710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.578+0000 7f65c8865640 1 -- 172.21.15.7:0/2948879719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555db79222e0 msgr2=0x555db79311d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.578+0000 7f65c8865640 1 --2- 172.21.15.7:0/2948879719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555db79222e0 0x555db79311d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.578+0000 7f65c8865640 1 -- 172.21.15.7:0/2948879719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555db7931c50 con 0x555db79219a0 2024-09-19T04:18:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.578+0000 7f65c8865640 1 --2- 172.21.15.7:0/2948879719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555db79219a0 0x555db7932bc0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f65b401e040 tx=0x7f65b4010e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b4866304f4e334 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.578+0000 7f65a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:18:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.579+0000 7f65a3fff640 1 -- 172.21.15.7:0/2948879719 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b40a4b30 con 0x555db79219a0 2024-09-19T04:18:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.579+0000 7f65a3fff640 1 -- 172.21.15.7:0/2948879719 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f65b4098530 con 0x555db79219a0 2024-09-19T04:18:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.579+0000 7f65cd85f740 1 -- 172.21.15.7:0/2948879719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65ac00fd20 con 0x555db79219a0 2024-09-19T04:18:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.579+0000 7f65a3fff640 1 -- 172.21.15.7:0/2948879719 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f65b40ad050 con 0x555db79219a0 2024-09-19T04:18:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.579+0000 7f65cd85f740 10 client.15630 fetch_fsmap learned FSMap version 28 2024-09-19T04:18:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.579+0000 7f65cd85f740 1 -- 172.21.15.7:0/2948879719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555db79a3210 con 0x555db79219a0 2024-09-19T04:18:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.579+0000 7f65a3fff640 1 -- 172.21.15.7:0/2948879719 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65ac00fd20 con 0x555db79219a0 2024-09-19T04:18:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.579+0000 7f65a3fff640 1 -- 172.21.15.7:0/2948879719 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f65b4097c10 con 0x555db79219a0 2024-09-19T04:18:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.579+0000 7f65cd85f740 10 client.15630 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:18:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.579+0000 7f65cd85f740 10 client.15630 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:18:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.579+0000 7f65cd85f740 20 client.15630 populate_metadata read hostname 'smithi007' 2024-09-19T04:18:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.579+0000 7f65cd85f740 1 --2- 172.21.15.7:0/2948879719 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x555db79a3bc0 0x555db79a5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.579+0000 7f65cd85f740 4 client.15630 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:18:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.579+0000 7f65cd85f740 1 -- 172.21.15.7:0/2948879719 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555db788cd70 con 0x555db79a3bc0 2024-09-19T04:18:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.579+0000 7f65c3fff640 1 --2- 172.21.15.7:0/2948879719 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x555db79a3bc0 0x555db79a5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.580+0000 7f65c3fff640 1 --2- 172.21.15.7:0/2948879719 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x555db79a3bc0 0x555db79a5fe0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff45a3126c9772d4 server_cookie=4e5a34494ed610b7 in_seq=0 out_seq=0 2024-09-19T04:18:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.580+0000 7f65a3fff640 10 client.15630 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.594+0000 7f65a3fff640 1 -- 172.21.15.7:0/2948879719 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555db788cd70 con 0x555db79a3bc0 2024-09-19T04:18:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.594+0000 7f65a3fff640 10 client.15630 handle_command_reply: tid=0 2024-09-19T04:18:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.594+0000 7f65cd85f740 1 client.15630 shutdown 2024-09-19T04:18:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.594+0000 7f65cd85f740 1 -- 172.21.15.7:0/2948879719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555db79219a0 msgr2=0x555db7932bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.594+0000 7f65cd85f740 1 --2- 172.21.15.7:0/2948879719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555db79219a0 0x555db7932bc0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f65b401e040 tx=0x7f65b4010e30 comp rx=0 tx=0).stop 2024-09-19T04:18:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.594+0000 7f65cd85f740 1 -- 172.21.15.7:0/2948879719 shutdown_connections 2024-09-19T04:18:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.594+0000 7f65cd85f740 1 --2- 172.21.15.7:0/2948879719 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x555db79a3bc0 0x555db79a5fe0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.594+0000 7f65cd85f740 1 --2- 172.21.15.7:0/2948879719 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555db7927370 0x555db7931710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.594+0000 7f65a3fff640 0 client.15630 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.594+0000 7f65cd85f740 1 --2- 172.21.15.7:0/2948879719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555db79222e0 0x555db79311d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.594+0000 7f65cd85f740 1 --2- 172.21.15.7:0/2948879719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555db79219a0 0x555db7932bc0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.594+0000 7f65cd85f740 1 -- 172.21.15.7:0/2948879719 >> 172.21.15.7:0/2948879719 conn(0x555db791d010 msgr2=0x555db791de90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.594+0000 7f65cd85f740 1 -- 172.21.15.7:0/2948879719 shutdown_connections 2024-09-19T04:18:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.594+0000 7f65cd85f740 1 -- 172.21.15.7:0/2948879719 wait complete. 2024-09-19T04:18:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.594+0000 7f65cd85f740 20 client.15630 trim_cache size 0 max 16384 2024-09-19T04:18:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:18:29.597 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:18:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:18:29.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:18:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.595+0000 7f65caac9640 1 -- 172.21.15.7:0/3552142796 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f65b00a32c0 msgr2=0x7f65b00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.595+0000 7f65caac9640 1 --2- 172.21.15.7:0/3552142796 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f65b00a32c0 0x7f65b00a5780 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f65bc005cc0 tx=0x7f65bc004a60 comp rx=0 tx=0).stop 2024-09-19T04:18:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.595+0000 7f65caac9640 1 -- 172.21.15.7:0/3552142796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65c4101b70 msgr2=0x7f65c4197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.595+0000 7f65caac9640 1 --2- 172.21.15.7:0/3552142796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65c4101b70 0x7f65c4197e10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f65b400d950 tx=0x7f65b400de10 comp rx=0 tx=0).stop 2024-09-19T04:18:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.595+0000 7f65caac9640 1 -- 172.21.15.7:0/3552142796 shutdown_connections 2024-09-19T04:18:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.595+0000 7f65caac9640 1 --2- 172.21.15.7:0/3552142796 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f65b00a32c0 0x7f65b00a5780 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.595+0000 7f65caac9640 1 --2- 172.21.15.7:0/3552142796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65c4103720 0x7f65c419f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.595+0000 7f65caac9640 1 --2- 172.21.15.7:0/3552142796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65c4102d60 0x7f65c4198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.595+0000 7f65caac9640 1 --2- 172.21.15.7:0/3552142796 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65c4101b70 0x7f65c4197e10 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.595+0000 7f65caac9640 1 -- 172.21.15.7:0/3552142796 >> 172.21.15.7:0/3552142796 conn(0x7f65c40fd2f0 msgr2=0x7f65c41060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:29.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.595+0000 7f65caac9640 1 -- 172.21.15.7:0/3552142796 shutdown_connections 2024-09-19T04:18:29.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:29.595+0000 7f65caac9640 1 -- 172.21.15.7:0/3552142796 wait complete. 2024-09-19T04:18:29.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.898+0000 7faf2fdae640 1 -- 172.21.15.7:0/3082706365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf28101400 msgr2=0x7faf2810d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:29.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.898+0000 7faf2fdae640 1 --2- 172.21.15.7:0/3082706365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf28101400 0x7faf2810d930 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7faf20009930 tx=0x7faf2002a420 comp rx=0 tx=0).stop 2024-09-19T04:18:29.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.898+0000 7faf2fdae640 1 -- 172.21.15.7:0/3082706365 shutdown_connections 2024-09-19T04:18:29.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.898+0000 7faf2fdae640 1 --2- 172.21.15.7:0/3082706365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf28101400 0x7faf2810d930 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.898+0000 7faf2fdae640 1 --2- 172.21.15.7:0/3082706365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf28100a60 0x7faf28100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.898+0000 7faf2fdae640 1 --2- 172.21.15.7:0/3082706365 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf28106a60 0x7faf28106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.898+0000 7faf2fdae640 1 -- 172.21.15.7:0/3082706365 >> 172.21.15.7:0/3082706365 conn(0x7faf280fc780 msgr2=0x7faf280feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:29.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.898+0000 7faf2fdae640 1 -- 172.21.15.7:0/3082706365 shutdown_connections 2024-09-19T04:18:29.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.898+0000 7faf2fdae640 1 -- 172.21.15.7:0/3082706365 wait complete. 2024-09-19T04:18:29.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.899+0000 7faf2fdae640 1 Processor -- start 2024-09-19T04:18:29.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.899+0000 7faf2fdae640 1 -- start start 2024-09-19T04:18:29.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.899+0000 7faf2fdae640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf28100a60 0x7faf281992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:29.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.899+0000 7faf2fdae640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf28101400 0x7faf28199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:29.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.899+0000 7faf2fdae640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf28106a60 0x7faf281a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:29.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.899+0000 7faf2fdae640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faf28110e60 con 0x7faf28100a60 2024-09-19T04:18:29.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.899+0000 7faf2fdae640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faf28110ce0 con 0x7faf28106a60 2024-09-19T04:18:29.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.899+0000 7faf2fdae640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7faf28110fe0 con 0x7faf28101400 2024-09-19T04:18:29.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.899+0000 7faf2db4a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf28100a60 0x7faf281992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:29.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.899+0000 7faf2db4a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf28100a60 0x7faf281992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47982/0 (socket says 172.21.15.7:47982) 2024-09-19T04:18:29.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.899+0000 7faf2db4a640 1 -- 172.21.15.7:0/1866737630 learned_addr learned my addr 172.21.15.7:0/1866737630 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:29.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.899+0000 7faf2e34b640 1 --2- 172.21.15.7:0/1866737630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf28106a60 0x7faf281a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:29.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.899+0000 7faf2d349640 1 --2- 172.21.15.7:0/1866737630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf28101400 0x7faf28199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:29.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.899+0000 7faf2db4a640 1 -- 172.21.15.7:0/1866737630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf28101400 msgr2=0x7faf28199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:29.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.899+0000 7faf2db4a640 1 --2- 172.21.15.7:0/1866737630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf28101400 0x7faf28199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.899+0000 7faf2db4a640 1 -- 172.21.15.7:0/1866737630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf28106a60 msgr2=0x7faf281a4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:29.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.899+0000 7faf2db4a640 1 --2- 172.21.15.7:0/1866737630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf28106a60 0x7faf281a4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:29.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.899+0000 7faf2db4a640 1 -- 172.21.15.7:0/1866737630 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf281a4890 con 0x7faf28100a60 2024-09-19T04:18:29.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.899+0000 7faf2e34b640 1 --2- 172.21.15.7:0/1866737630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf28106a60 0x7faf281a4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:18:29.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.900+0000 7faf2db4a640 1 --2- 172.21.15.7:0/1866737630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf28100a60 0x7faf281992d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00cce0 tx=0x7faf1c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:29.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.900+0000 7faf1affd640 1 -- 172.21.15.7:0/1866737630 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c004b20 con 0x7faf28100a60 2024-09-19T04:18:29.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.900+0000 7faf2fdae640 1 -- 172.21.15.7:0/1866737630 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf281a4a60 con 0x7faf28100a60 2024-09-19T04:18:29.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.900+0000 7faf1affd640 1 -- 172.21.15.7:0/1866737630 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf1c004cc0 con 0x7faf28100a60 2024-09-19T04:18:29.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.900+0000 7faf1affd640 1 -- 172.21.15.7:0/1866737630 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c00f7d0 con 0x7faf28100a60 2024-09-19T04:18:29.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.900+0000 7faf2fdae640 1 -- 172.21.15.7:0/1866737630 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf281a4f70 con 0x7faf28100a60 2024-09-19T04:18:29.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.901+0000 7faf2fdae640 1 -- 172.21.15.7:0/1866737630 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf28100ec0 con 0x7faf28100a60 2024-09-19T04:18:29.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.902+0000 7faf1affd640 1 -- 172.21.15.7:0/1866737630 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7faf1c00f970 con 0x7faf28100a60 2024-09-19T04:18:29.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.903+0000 7faf1affd640 1 --2- 172.21.15.7:0/1866737630 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7faf140a3240 0x7faf140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:29.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.903+0000 7faf1affd640 1 -- 172.21.15.7:0/1866737630 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7faf1c0d01b0 con 0x7faf28100a60 2024-09-19T04:18:29.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.903+0000 7faf2d349640 1 --2- 172.21.15.7:0/1866737630 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7faf140a3240 0x7faf140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:29.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.903+0000 7faf2d349640 1 --2- 172.21.15.7:0/1866737630 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7faf140a3240 0x7faf140a5700 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7faf24005fd0 tx=0x7faf24005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:29.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:29.906+0000 7faf1affd640 1 -- 172.21.15.7:0/1866737630 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faf1c014030 con 0x7faf28100a60 2024-09-19T04:18:30.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:30.121+0000 7faf2fdae640 1 -- 172.21.15.7:0/1866737630 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf28109000 con 0x7faf28100a60 2024-09-19T04:18:30.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:30.122+0000 7faf1affd640 1 -- 172.21.15.7:0/1866737630 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11962 (secure 0 0 0) 0x7faf1c09cac0 con 0x7faf28100a60 2024-09-19T04:18:30.124 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:18:30.124 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":28,"btime":"2024-09-19T04:16:57:081835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:16:56.259017+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24496,"mds_2":24482,"mds_3":24478,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24472,24478,24482,24496,24506]},"id":1}]} 2024-09-19T04:18:30.124 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 28 2024-09-19T04:18:30.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:30.125+0000 7faf2fdae640 1 -- 172.21.15.7:0/1866737630 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7faf140a3240 msgr2=0x7faf140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:30.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:30.125+0000 7faf2fdae640 1 --2- 172.21.15.7:0/1866737630 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7faf140a3240 0x7faf140a5700 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7faf24005fd0 tx=0x7faf24005850 comp rx=0 tx=0).stop 2024-09-19T04:18:30.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:30.125+0000 7faf2fdae640 1 -- 172.21.15.7:0/1866737630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf28100a60 msgr2=0x7faf281992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:30.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:30.125+0000 7faf2fdae640 1 --2- 172.21.15.7:0/1866737630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf28100a60 0x7faf281992d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00cce0 tx=0x7faf1c00a620 comp rx=0 tx=0).stop 2024-09-19T04:18:30.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:30.125+0000 7faf2fdae640 1 -- 172.21.15.7:0/1866737630 shutdown_connections 2024-09-19T04:18:30.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:30.125+0000 7faf2fdae640 1 --2- 172.21.15.7:0/1866737630 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7faf140a3240 0x7faf140a5700 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:30.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:30.125+0000 7faf2fdae640 1 --2- 172.21.15.7:0/1866737630 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faf28106a60 0x7faf281a4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:30.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:30.125+0000 7faf2fdae640 1 --2- 172.21.15.7:0/1866737630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf28101400 0x7faf28199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:30.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:30.125+0000 7faf2fdae640 1 --2- 172.21.15.7:0/1866737630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf28100a60 0x7faf281992d0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:30.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:30.125+0000 7faf2fdae640 1 -- 172.21.15.7:0/1866737630 >> 172.21.15.7:0/1866737630 conn(0x7faf280fc780 msgr2=0x7faf280fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:30.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:30.125+0000 7faf2fdae640 1 -- 172.21.15.7:0/1866737630 shutdown_connections 2024-09-19T04:18:30.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:30.125+0000 7faf2fdae640 1 -- 172.21.15.7:0/1866737630 wait complete. 2024-09-19T04:18:30.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:30 smithi007 ceph-mon[31360]: pgmap v402: 129 pgs: 129 active+clean; 1.7 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 76 KiB/s wr, 35 op/s 2024-09-19T04:18:30.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:30 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1866737630' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:18:30.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:30 smithi102 ceph-mon[35446]: pgmap v402: 129 pgs: 129 active+clean; 1.7 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 76 KiB/s wr, 35 op/s 2024-09-19T04:18:30.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:30 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1866737630' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:18:30.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:30 smithi092 ceph-mon[34940]: pgmap v402: 129 pgs: 129 active+clean; 1.7 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 76 KiB/s wr, 35 op/s 2024-09-19T04:18:30.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:30 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1866737630' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:18:30.821 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24506 quiesce db --set-id 396f943 --release --await' 2024-09-19T04:18:30.821 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24506 quiesce db --set-id 396f943 --release --await 2024-09-19T04:18:31.081 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:18:31.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.558+0000 7f039bdcf640 1 -- 172.21.15.7:0/287707971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0394106f10 msgr2=0x7f039410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:31.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.558+0000 7f039bdcf640 1 --2- 172.21.15.7:0/287707971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0394106f10 0x7f039410ea90 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0384009ca0 tx=0x7f038402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.558+0000 7f039bdcf640 1 -- 172.21.15.7:0/287707971 shutdown_connections 2024-09-19T04:18:31.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.558+0000 7f039bdcf640 1 --2- 172.21.15.7:0/287707971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0394106f10 0x7f039410ea90 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.558+0000 7f039bdcf640 1 --2- 172.21.15.7:0/287707971 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0394102790 0x7f03941067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.558+0000 7f039bdcf640 1 --2- 172.21.15.7:0/287707971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0394101de0 0x7f03941021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.558+0000 7f039bdcf640 1 -- 172.21.15.7:0/287707971 >> 172.21.15.7:0/287707971 conn(0x7f03940fd8c0 msgr2=0x7f03940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:31.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.558+0000 7f039bdcf640 1 -- 172.21.15.7:0/287707971 shutdown_connections 2024-09-19T04:18:31.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.558+0000 7f039bdcf640 1 -- 172.21.15.7:0/287707971 wait complete. 2024-09-19T04:18:31.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.558+0000 7f039bdcf640 1 Processor -- start 2024-09-19T04:18:31.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.558+0000 7f039bdcf640 1 -- start start 2024-09-19T04:18:31.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.559+0000 7f039bdcf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0394101de0 0x7f03940744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:31.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.559+0000 7f039bdcf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0394102790 0x7f0394074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:31.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.559+0000 7f039bdcf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0394106f10 0x7f0394074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:31.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.559+0000 7f039bdcf640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0394111f70 con 0x7f0394102790 2024-09-19T04:18:31.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.559+0000 7f039bdcf640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0394111df0 con 0x7f0394106f10 2024-09-19T04:18:31.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.559+0000 7f039bdcf640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f03941120f0 con 0x7f0394101de0 2024-09-19T04:18:31.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.559+0000 7f039936a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0394102790 0x7f0394074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:31.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.559+0000 7f039936a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0394102790 0x7f0394074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48014/0 (socket says 172.21.15.7:48014) 2024-09-19T04:18:31.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.559+0000 7f039936a640 1 -- 172.21.15.7:0/347376614 learned_addr learned my addr 172.21.15.7:0/347376614 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:31.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.559+0000 7f039a36c640 1 --2- 172.21.15.7:0/347376614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0394106f10 0x7f0394074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:31.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.559+0000 7f0399b6b640 1 --2- 172.21.15.7:0/347376614 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0394101de0 0x7f03940744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:31.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.559+0000 7f039936a640 1 -- 172.21.15.7:0/347376614 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0394101de0 msgr2=0x7f03940744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:31.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.559+0000 7f039936a640 1 --2- 172.21.15.7:0/347376614 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0394101de0 0x7f03940744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.559+0000 7f039936a640 1 -- 172.21.15.7:0/347376614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0394106f10 msgr2=0x7f0394074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:31.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.559+0000 7f039936a640 1 --2- 172.21.15.7:0/347376614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0394106f10 0x7f0394074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.559+0000 7f039936a640 1 -- 172.21.15.7:0/347376614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03941a68d0 con 0x7f0394102790 2024-09-19T04:18:31.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.559+0000 7f039936a640 1 --2- 172.21.15.7:0/347376614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0394102790 0x7f0394074a30 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f038800e9f0 tx=0x7f038800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:31.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.560+0000 7f0392ffd640 1 -- 172.21.15.7:0/347376614 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038800cd80 con 0x7f0394102790 2024-09-19T04:18:31.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.560+0000 7f0392ffd640 1 -- 172.21.15.7:0/347376614 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0388010910 con 0x7f0394102790 2024-09-19T04:18:31.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.560+0000 7f039bdcf640 1 -- 172.21.15.7:0/347376614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03941a6bc0 con 0x7f0394102790 2024-09-19T04:18:31.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.560+0000 7f0392ffd640 1 -- 172.21.15.7:0/347376614 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0388018990 con 0x7f0394102790 2024-09-19T04:18:31.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.560+0000 7f039bdcf640 1 -- 172.21.15.7:0/347376614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03941a7100 con 0x7f0394102790 2024-09-19T04:18:31.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.562+0000 7f0392ffd640 1 -- 172.21.15.7:0/347376614 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f0388010ac0 con 0x7f0394102790 2024-09-19T04:18:31.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.562+0000 7f039e1a8740 1 Processor -- start 2024-09-19T04:18:31.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.563+0000 7f039e1a8740 1 -- start start 2024-09-19T04:18:31.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.563+0000 7f039e1a8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56099fb05060 0x56099fb05440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:31.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.563+0000 7f039e1a8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56099fb05980 0x56099fb0fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:31.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.563+0000 7f039e1a8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56099fb10240 0x56099fb12630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:31.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.563+0000 7f039e1a8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56099fa6a620 con 0x56099fb05060 2024-09-19T04:18:31.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.563+0000 7f039e1a8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56099fa11e50 con 0x56099fb05980 2024-09-19T04:18:31.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.563+0000 7f039e1a8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56099fa665e0 con 0x56099fb10240 2024-09-19T04:18:31.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.563+0000 7f0392ffd640 1 --2- 172.21.15.7:0/347376614 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f037c0a3240 0x7f037c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:31.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.563+0000 7f039a36c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56099fb05060 0x56099fb05440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:31.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.563+0000 7f039a36c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56099fb05060 0x56099fb05440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48024/0 (socket says 172.21.15.7:48024) 2024-09-19T04:18:31.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.563+0000 7f039a36c640 1 -- 172.21.15.7:0/1440192190 learned_addr learned my addr 172.21.15.7:0/1440192190 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:31.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.563+0000 7f039a36c640 1 --2- 172.21.15.7:0/347376614 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f037c0a3240 0x7f037c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:31.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.563+0000 7f0399b6b640 1 --2- 172.21.15.7:0/1440192190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56099fb05980 0x56099fb0fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:31.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.563+0000 7f039936a640 1 --2- 172.21.15.7:0/1440192190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56099fb10240 0x56099fb12630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:31.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.563+0000 7f0392ffd640 1 -- 172.21.15.7:0/347376614 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f03880cff60 con 0x7f0394102790 2024-09-19T04:18:31.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.563+0000 7f039a36c640 1 -- 172.21.15.7:0/1440192190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56099fb10240 msgr2=0x56099fb12630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:31.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.563+0000 7f039a36c640 1 --2- 172.21.15.7:0/1440192190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56099fb10240 0x56099fb12630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.563+0000 7f039a36c640 1 -- 172.21.15.7:0/1440192190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56099fb05980 msgr2=0x56099fb0fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:31.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.563+0000 7f039a36c640 1 --2- 172.21.15.7:0/1440192190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56099fb05980 0x56099fb0fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.563+0000 7f039a36c640 1 -- 172.21.15.7:0/1440192190 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56099fa02d40 con 0x56099fb05060 2024-09-19T04:18:31.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.563+0000 7f0399b6b640 1 --2- 172.21.15.7:0/1440192190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56099fb05980 0x56099fb0fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:18:31.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.564+0000 7f039a36c640 1 --2- 172.21.15.7:0/1440192190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56099fb05060 0x56099fb05440 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0384005fe0 tx=0x7f0384031f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95b0d3c1c17be12b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:31.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.564+0000 7f039a36c640 1 --2- 172.21.15.7:0/347376614 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f037c0a3240 0x7f037c0a5700 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0384004af0 tx=0x7f0384036000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:31.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.564+0000 7f037bfff640 1 -- 172.21.15.7:0/1440192190 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0384056070 con 0x56099fb05060 2024-09-19T04:18:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.564+0000 7f037bfff640 1 -- 172.21.15.7:0/1440192190 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0384036070 con 0x56099fb05060 2024-09-19T04:18:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.564+0000 7f037bfff640 1 -- 172.21.15.7:0/1440192190 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0384051450 con 0x56099fb05060 2024-09-19T04:18:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.565+0000 7f039e1a8740 1 -- 172.21.15.7:0/1440192190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56099fb05060 msgr2=0x56099fb05440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.565+0000 7f039e1a8740 1 --2- 172.21.15.7:0/1440192190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56099fb05060 0x56099fb05440 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0384005fe0 tx=0x7f0384031f40 comp rx=0 tx=0).stop 2024-09-19T04:18:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.565+0000 7f039e1a8740 1 -- 172.21.15.7:0/1440192190 shutdown_connections 2024-09-19T04:18:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.565+0000 7f039e1a8740 1 --2- 172.21.15.7:0/1440192190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56099fb10240 0x56099fb12630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.565+0000 7f039e1a8740 1 --2- 172.21.15.7:0/1440192190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56099fb05980 0x56099fb0fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.565+0000 7f039e1a8740 1 --2- 172.21.15.7:0/1440192190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56099fb05060 0x56099fb05440 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.565+0000 7f039e1a8740 1 -- 172.21.15.7:0/1440192190 >> 172.21.15.7:0/1440192190 conn(0x56099fb015f0 msgr2=0x56099fb019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.565+0000 7f039e1a8740 1 -- 172.21.15.7:0/1440192190 shutdown_connections 2024-09-19T04:18:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.565+0000 7f039e1a8740 1 -- 172.21.15.7:0/1440192190 wait complete. 2024-09-19T04:18:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.565+0000 7f039e1a8740 1 -- start start 2024-09-19T04:18:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.565+0000 7f039e1a8740 1 Processor -- start 2024-09-19T04:18:31.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.566+0000 7f039e1a8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56099fb05060 0x56099fb0d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:31.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.566+0000 7f039e1a8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56099fb05980 0x56099fb0d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:31.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.566+0000 7f039e1a8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56099fb10240 0x56099fb0dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:31.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.566+0000 7f039e1a8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56099fb12c90 con 0x56099fb10240 2024-09-19T04:18:31.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.566+0000 7f039e1a8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56099f9f2f10 con 0x56099fb05980 2024-09-19T04:18:31.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.566+0000 7f039e1a8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56099fb12e10 con 0x56099fb05060 2024-09-19T04:18:31.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.566+0000 7f039e1a8740 10 client.0 _ll_register_callbacks cb 0x56099fa16db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:18:31.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.566+0000 7f039a36c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56099fb10240 0x56099fb0dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:31.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.566+0000 7f039a36c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56099fb10240 0x56099fb0dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48036/0 (socket says 172.21.15.7:48036) 2024-09-19T04:18:31.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.566+0000 7f039a36c640 1 -- 172.21.15.7:0/459751721 learned_addr learned my addr 172.21.15.7:0/459751721 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:31.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.566+0000 7f0399b6b640 1 --2- 172.21.15.7:0/459751721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56099fb05060 0x56099fb0d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:31.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.566+0000 7f039936a640 1 --2- 172.21.15.7:0/459751721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56099fb05980 0x56099fb0d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:31.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.566+0000 7f039a36c640 1 -- 172.21.15.7:0/459751721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56099fb05060 msgr2=0x56099fb0d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:31.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.566+0000 7f039a36c640 1 --2- 172.21.15.7:0/459751721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56099fb05060 0x56099fb0d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.566+0000 7f039a36c640 1 -- 172.21.15.7:0/459751721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56099fb05980 msgr2=0x56099fb0d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:31.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.566+0000 7f039a36c640 1 --2- 172.21.15.7:0/459751721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56099fb05980 0x56099fb0d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.566+0000 7f039a36c640 1 -- 172.21.15.7:0/459751721 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56099f779580 con 0x56099fb10240 2024-09-19T04:18:31.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.566+0000 7f039936a640 1 --2- 172.21.15.7:0/459751721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56099fb05980 0x56099fb0d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:18:31.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.566+0000 7f039a36c640 1 --2- 172.21.15.7:0/459751721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56099fb10240 0x56099fb0dbf0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f038402ade0 tx=0x7f0384030b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2e37c1a1e7e5ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:31.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.566+0000 7f03797fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:18:31.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.566+0000 7f03797fa640 1 -- 172.21.15.7:0/459751721 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038405f060 con 0x56099fb10240 2024-09-19T04:18:31.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.566+0000 7f03797fa640 1 -- 172.21.15.7:0/459751721 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f038405a450 con 0x56099fb10240 2024-09-19T04:18:31.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.566+0000 7f039e1a8740 1 -- 172.21.15.7:0/459751721 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0384036070 con 0x56099fb10240 2024-09-19T04:18:31.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.567+0000 7f03797fa640 1 -- 172.21.15.7:0/459751721 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0384066050 con 0x56099fb10240 2024-09-19T04:18:31.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.567+0000 7f039e1a8740 10 client.15648 fetch_fsmap learned FSMap version 28 2024-09-19T04:18:31.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.567+0000 7f039e1a8740 1 -- 172.21.15.7:0/459751721 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56099f843960 con 0x56099fb10240 2024-09-19T04:18:31.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.567+0000 7f03797fa640 1 -- 172.21.15.7:0/459751721 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0384036070 con 0x56099fb10240 2024-09-19T04:18:31.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.567+0000 7f03797fa640 1 -- 172.21.15.7:0/459751721 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f038405acd0 con 0x56099fb10240 2024-09-19T04:18:31.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.567+0000 7f039e1a8740 10 client.15648 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:18:31.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.567+0000 7f039e1a8740 10 client.15648 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:18:31.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.567+0000 7f039e1a8740 20 client.15648 populate_metadata read hostname 'smithi007' 2024-09-19T04:18:31.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.567+0000 7f039e1a8740 1 --2- 172.21.15.7:0/459751721 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x56099fb1fb40 0x56099fb21f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:31.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.567+0000 7f039e1a8740 4 client.15648 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:18:31.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.567+0000 7f039e1a8740 1 -- 172.21.15.7:0/459751721 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56099fa77b90 con 0x56099fb1fb40 2024-09-19T04:18:31.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.567+0000 7f0399b6b640 1 --2- 172.21.15.7:0/459751721 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x56099fb1fb40 0x56099fb21f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:31.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.568+0000 7f0399b6b640 1 --2- 172.21.15.7:0/459751721 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x56099fb1fb40 0x56099fb21f30 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c318b9e70c4a4a62 server_cookie=f2c5a3f5d00c1245 in_seq=0 out_seq=0 2024-09-19T04:18:31.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.568+0000 7f03797fa640 10 client.15648 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:31.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.568+0000 7f03797fa640 1 -- 172.21.15.7:0/459751721 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56099fa77b90 con 0x56099fb1fb40 2024-09-19T04:18:31.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.568+0000 7f03797fa640 10 client.15648 handle_command_reply: tid=0 2024-09-19T04:18:31.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.568+0000 7f039e1a8740 1 client.15648 shutdown 2024-09-19T04:18:31.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.569+0000 7f039e1a8740 1 -- 172.21.15.7:0/459751721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56099fb10240 msgr2=0x56099fb0dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:31.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.569+0000 7f039e1a8740 1 --2- 172.21.15.7:0/459751721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56099fb10240 0x56099fb0dbf0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f038402ade0 tx=0x7f0384030b40 comp rx=0 tx=0).stop 2024-09-19T04:18:31.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.569+0000 7f039e1a8740 1 -- 172.21.15.7:0/459751721 shutdown_connections 2024-09-19T04:18:31.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.569+0000 7f039e1a8740 1 --2- 172.21.15.7:0/459751721 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x56099fb1fb40 0x56099fb21f30 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.569+0000 7f039e1a8740 1 --2- 172.21.15.7:0/459751721 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56099fb10240 0x56099fb0dbf0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.569+0000 7f039e1a8740 1 --2- 172.21.15.7:0/459751721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56099fb05980 0x56099fb0d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.569+0000 7f039e1a8740 1 --2- 172.21.15.7:0/459751721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56099fb05060 0x56099fb0d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.569+0000 7f03797fa640 0 client.15648 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:31.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.569+0000 7f039e1a8740 1 -- 172.21.15.7:0/459751721 >> 172.21.15.7:0/459751721 conn(0x56099fb015f0 msgr2=0x56099fb07320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:31.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.569+0000 7f039e1a8740 1 -- 172.21.15.7:0/459751721 shutdown_connections 2024-09-19T04:18:31.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.569+0000 7f039e1a8740 1 -- 172.21.15.7:0/459751721 wait complete. 2024-09-19T04:18:31.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.569+0000 7f039e1a8740 20 client.15648 trim_cache size 0 max 16384 2024-09-19T04:18:31.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.586+0000 7f039e1a8740 1 Processor -- start 2024-09-19T04:18:31.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.586+0000 7f039e1a8740 1 -- start start 2024-09-19T04:18:31.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.586+0000 7f039e1a8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56099fb05060 0x56099fb07ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:31.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.586+0000 7f039e1a8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56099fb05980 0x56099fb00640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:31.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.586+0000 7f039e1a8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56099fb10240 0x56099fb275c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:31.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.586+0000 7f039e1a8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f03941b0fe0 con 0x56099fb05980 2024-09-19T04:18:31.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.586+0000 7f039e1a8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f03941b2b20 con 0x56099fb10240 2024-09-19T04:18:31.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.586+0000 7f039e1a8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f03941b16b0 con 0x56099fb05060 2024-09-19T04:18:31.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.587+0000 7f039936a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56099fb05980 0x56099fb00640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:31.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.587+0000 7f039936a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56099fb05980 0x56099fb00640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48048/0 (socket says 172.21.15.7:48048) 2024-09-19T04:18:31.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.587+0000 7f039936a640 1 -- 172.21.15.7:0/1642213786 learned_addr learned my addr 172.21.15.7:0/1642213786 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:31.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.587+0000 7f0399b6b640 1 --2- 172.21.15.7:0/1642213786 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56099fb05060 0x56099fb07ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:31.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.587+0000 7f039a36c640 1 --2- 172.21.15.7:0/1642213786 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56099fb10240 0x56099fb275c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:31.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.587+0000 7f039936a640 1 -- 172.21.15.7:0/1642213786 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56099fb05060 msgr2=0x56099fb07ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:31.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.587+0000 7f039936a640 1 --2- 172.21.15.7:0/1642213786 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56099fb05060 0x56099fb07ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.587+0000 7f039936a640 1 -- 172.21.15.7:0/1642213786 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56099fb10240 msgr2=0x56099fb275c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:31.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.587+0000 7f039936a640 1 --2- 172.21.15.7:0/1642213786 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56099fb10240 0x56099fb275c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.587+0000 7f039936a640 1 -- 172.21.15.7:0/1642213786 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56099fb04e90 con 0x56099fb05980 2024-09-19T04:18:31.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.587+0000 7f039a36c640 1 --2- 172.21.15.7:0/1642213786 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56099fb10240 0x56099fb275c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:18:31.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.587+0000 7f039936a640 1 --2- 172.21.15.7:0/1642213786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56099fb05980 0x56099fb00640 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f038809c1f0 tx=0x7f038801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f3e57054e8f5691 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:31.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.587+0000 7f037b7fe640 1 -- 172.21.15.7:0/1642213786 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0388026040 con 0x56099fb05980 2024-09-19T04:18:31.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.587+0000 7f037b7fe640 1 -- 172.21.15.7:0/1642213786 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03880a0560 con 0x56099fb05980 2024-09-19T04:18:31.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.587+0000 7f037b7fe640 1 -- 172.21.15.7:0/1642213786 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03880a4990 con 0x56099fb05980 2024-09-19T04:18:31.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.588+0000 7f039e1a8740 1 -- 172.21.15.7:0/1642213786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56099fb05980 msgr2=0x56099fb00640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:31.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.588+0000 7f039e1a8740 1 --2- 172.21.15.7:0/1642213786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56099fb05980 0x56099fb00640 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f038809c1f0 tx=0x7f038801f000 comp rx=0 tx=0).stop 2024-09-19T04:18:31.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.588+0000 7f039e1a8740 1 -- 172.21.15.7:0/1642213786 shutdown_connections 2024-09-19T04:18:31.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.588+0000 7f039e1a8740 1 --2- 172.21.15.7:0/1642213786 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56099fb10240 0x56099fb275c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.588+0000 7f039e1a8740 1 --2- 172.21.15.7:0/1642213786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56099fb05980 0x56099fb00640 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.588+0000 7f039e1a8740 1 --2- 172.21.15.7:0/1642213786 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56099fb05060 0x56099fb07ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.588+0000 7f039e1a8740 1 -- 172.21.15.7:0/1642213786 >> 172.21.15.7:0/1642213786 conn(0x56099fb015f0 msgr2=0x56099fafff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:31.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.588+0000 7f039e1a8740 1 -- 172.21.15.7:0/1642213786 shutdown_connections 2024-09-19T04:18:31.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.588+0000 7f039e1a8740 1 -- 172.21.15.7:0/1642213786 wait complete. 2024-09-19T04:18:31.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.589+0000 7f039e1a8740 1 -- start start 2024-09-19T04:18:31.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.589+0000 7f039e1a8740 1 Processor -- start 2024-09-19T04:18:31.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.589+0000 7f039e1a8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56099fb05060 0x56099fb18870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:31.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.589+0000 7f039e1a8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56099fb05980 0x56099fb15060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:31.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.589+0000 7f039e1a8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56099fb10240 0x56099fb155a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:31.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.589+0000 7f039e1a8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f03941b2450 con 0x56099fb10240 2024-09-19T04:18:31.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.589+0000 7f039e1a8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f03941b1d80 con 0x56099fb05980 2024-09-19T04:18:31.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.589+0000 7f039e1a8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f03941aefa0 con 0x56099fb05060 2024-09-19T04:18:31.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.589+0000 7f039e1a8740 10 client.0 _ll_register_callbacks cb 0x7f0384031450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:18:31.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.589+0000 7f0399b6b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56099fb05060 0x56099fb18870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:31.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.589+0000 7f039a36c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56099fb10240 0x56099fb155a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:31.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.589+0000 7f0399b6b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56099fb05060 0x56099fb18870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:32916/0 (socket says 172.21.15.7:32916) 2024-09-19T04:18:31.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.589+0000 7f0399b6b640 1 -- 172.21.15.7:0/3325717596 learned_addr learned my addr 172.21.15.7:0/3325717596 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:31.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.589+0000 7f039936a640 1 --2- 172.21.15.7:0/3325717596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56099fb05980 0x56099fb15060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:31.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.590+0000 7f0399b6b640 1 -- 172.21.15.7:0/3325717596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56099fb05980 msgr2=0x56099fb15060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:31.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.590+0000 7f0399b6b640 1 --2- 172.21.15.7:0/3325717596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56099fb05980 0x56099fb15060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.590+0000 7f0399b6b640 1 -- 172.21.15.7:0/3325717596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56099fb10240 msgr2=0x56099fb155a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:31.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.590+0000 7f0399b6b640 1 --2- 172.21.15.7:0/3325717596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56099fb10240 0x56099fb155a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.590+0000 7f0399b6b640 1 -- 172.21.15.7:0/3325717596 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56099fb026a0 con 0x56099fb05060 2024-09-19T04:18:31.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.590+0000 7f039a36c640 1 --2- 172.21.15.7:0/3325717596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56099fb10240 0x56099fb155a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:18:31.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.590+0000 7f0399b6b640 1 --2- 172.21.15.7:0/3325717596 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56099fb05060 0x56099fb18870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x56099fb22530 tx=0x7f038c00bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfe413a4cdfe826e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:31.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.590+0000 7f03797fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-19T04:18:31.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.590+0000 7f03797fa640 1 -- 172.21.15.7:0/3325717596 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038c011440 con 0x56099fb05060 2024-09-19T04:18:31.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.590+0000 7f039e1a8740 1 -- 172.21.15.7:0/3325717596 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03880a0560 con 0x56099fb05060 2024-09-19T04:18:31.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.590+0000 7f03797fa640 1 -- 172.21.15.7:0/3325717596 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f038c0115e0 con 0x56099fb05060 2024-09-19T04:18:31.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.590+0000 7f03797fa640 1 -- 172.21.15.7:0/3325717596 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f038c0117e0 con 0x56099fb05060 2024-09-19T04:18:31.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.590+0000 7f039e1a8740 10 client.25351 fetch_fsmap learned FSMap version 28 2024-09-19T04:18:31.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.590+0000 7f039e1a8740 1 -- 172.21.15.7:0/3325717596 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56099fb8b400 con 0x56099fb05060 2024-09-19T04:18:31.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.590+0000 7f03797fa640 1 -- 172.21.15.7:0/3325717596 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03880a0560 con 0x56099fb05060 2024-09-19T04:18:31.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.591+0000 7f03797fa640 1 -- 172.21.15.7:0/3325717596 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f038c01d960 con 0x56099fb05060 2024-09-19T04:18:31.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.591+0000 7f039e1a8740 10 client.25351 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:18:31.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.591+0000 7f039e1a8740 10 client.25351 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:18:31.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.591+0000 7f039e1a8740 20 client.25351 populate_metadata read hostname 'smithi007' 2024-09-19T04:18:31.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.591+0000 7f039e1a8740 1 --2- 172.21.15.7:0/3325717596 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x56099fb8bb80 0x56099fb8dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:31.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.591+0000 7f039e1a8740 4 client.25351 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "396f943", "release": true, "await": true}] 2024-09-19T04:18:31.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.591+0000 7f039e1a8740 1 -- 172.21.15.7:0/3325717596 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "quiesce db", "set_id": "396f943", "release": true, "await": true}) -- 0x56099fa720a0 con 0x56099fb8bb80 2024-09-19T04:18:31.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.591+0000 7f039936a640 1 --2- 172.21.15.7:0/3325717596 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x56099fb8bb80 0x56099fb8dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:31.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.591+0000 7f039936a640 1 --2- 172.21.15.7:0/3325717596 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x56099fb8bb80 0x56099fb8dfa0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91fd2072bac89b89 server_cookie=1c0d2b885915cd62 in_seq=0 out_seq=0 2024-09-19T04:18:31.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.591+0000 7f03797fa640 10 client.25351 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:31.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.601+0000 7f03797fa640 1 -- 172.21.15.7:0/3325717596 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x56099fa720a0 con 0x56099fb8bb80 2024-09-19T04:18:31.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.601+0000 7f03797fa640 10 client.25351 handle_command_reply: tid=0 2024-09-19T04:18:31.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.601+0000 7f039e1a8740 1 client.25351 shutdown 2024-09-19T04:18:31.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.601+0000 7f039e1a8740 1 -- 172.21.15.7:0/3325717596 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56099fb05060 msgr2=0x56099fb18870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:31.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.601+0000 7f039e1a8740 1 --2- 172.21.15.7:0/3325717596 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56099fb05060 0x56099fb18870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x56099fb22530 tx=0x7f038c00bd80 comp rx=0 tx=0).stop 2024-09-19T04:18:31.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.601+0000 7f039e1a8740 1 -- 172.21.15.7:0/3325717596 shutdown_connections 2024-09-19T04:18:31.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.601+0000 7f039e1a8740 1 --2- 172.21.15.7:0/3325717596 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x56099fb8bb80 0x56099fb8dfa0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.601+0000 7f039e1a8740 1 --2- 172.21.15.7:0/3325717596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56099fb10240 0x56099fb155a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.601+0000 7f03797fa640 0 client.25351 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:31.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.601+0000 7f039e1a8740 1 --2- 172.21.15.7:0/3325717596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56099fb05980 0x56099fb15060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.601+0000 7f039e1a8740 1 --2- 172.21.15.7:0/3325717596 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56099fb05060 0x56099fb18870 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.601+0000 7f039e1a8740 1 -- 172.21.15.7:0/3325717596 >> 172.21.15.7:0/3325717596 conn(0x56099fb015f0 msgr2=0x56099fb00750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:31.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.601+0000 7f039e1a8740 1 -- 172.21.15.7:0/3325717596 shutdown_connections 2024-09-19T04:18:31.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.601+0000 7f039e1a8740 1 -- 172.21.15.7:0/3325717596 wait complete. 2024-09-19T04:18:31.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.601+0000 7f039e1a8740 20 client.25351 trim_cache size 0 max 16384 2024-09-19T04:18:31.610 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:18:31.610 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 28, 2024-09-19T04:18:31.610 INFO:teuthology.orchestra.run.smithi007.stdout: "leader": 24506, 2024-09-19T04:18:31.610 INFO:teuthology.orchestra.run.smithi007.stdout: "set_version": 8, 2024-09-19T04:18:31.610 INFO:teuthology.orchestra.run.smithi007.stdout: "sets": { 2024-09-19T04:18:31.610 INFO:teuthology.orchestra.run.smithi007.stdout: "396f943": { 2024-09-19T04:18:31.611 INFO:teuthology.orchestra.run.smithi007.stdout: "version": 8, 2024-09-19T04:18:31.611 INFO:teuthology.orchestra.run.smithi007.stdout: "age_ref": 0.0, 2024-09-19T04:18:31.611 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:18:31.611 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RELEASED", 2024-09-19T04:18:31.611 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:18:31.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:18:31.611 INFO:teuthology.orchestra.run.smithi007.stdout: "timeout": 90.0, 2024-09-19T04:18:31.611 INFO:teuthology.orchestra.run.smithi007.stdout: "expiration": 140.3, 2024-09-19T04:18:31.611 INFO:teuthology.orchestra.run.smithi007.stdout: "members": { 2024-09-19T04:18:31.611 INFO:teuthology.orchestra.run.smithi007.stdout: "file:/": { 2024-09-19T04:18:31.611 INFO:teuthology.orchestra.run.smithi007.stdout: "excluded": false, 2024-09-19T04:18:31.612 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:18:31.612 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RELEASED", 2024-09-19T04:18:31.612 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:18:31.612 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:18:31.612 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:18:31.612 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:18:31.612 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:18:31.612 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:18:31.612 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:18:31.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.602+0000 7f039bdcf640 1 -- 172.21.15.7:0/347376614 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f037c0a3240 msgr2=0x7f037c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:31.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.602+0000 7f039bdcf640 1 --2- 172.21.15.7:0/347376614 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f037c0a3240 0x7f037c0a5700 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0384004af0 tx=0x7f0384036000 comp rx=0 tx=0).stop 2024-09-19T04:18:31.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.602+0000 7f039bdcf640 1 -- 172.21.15.7:0/347376614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0394102790 msgr2=0x7f0394074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:31.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.602+0000 7f039bdcf640 1 --2- 172.21.15.7:0/347376614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0394102790 0x7f0394074a30 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f038800e9f0 tx=0x7f038800eeb0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.602+0000 7f039bdcf640 1 -- 172.21.15.7:0/347376614 shutdown_connections 2024-09-19T04:18:31.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.602+0000 7f039bdcf640 1 --2- 172.21.15.7:0/347376614 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f037c0a3240 0x7f037c0a5700 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.602+0000 7f039bdcf640 1 --2- 172.21.15.7:0/347376614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0394106f10 0x7f0394074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.602+0000 7f039bdcf640 1 --2- 172.21.15.7:0/347376614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0394102790 0x7f0394074a30 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.602+0000 7f039bdcf640 1 --2- 172.21.15.7:0/347376614 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0394101de0 0x7f03940744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:31.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.602+0000 7f039bdcf640 1 -- 172.21.15.7:0/347376614 >> 172.21.15.7:0/347376614 conn(0x7f03940fd8c0 msgr2=0x7f03940fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:31.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.602+0000 7f039bdcf640 1 -- 172.21.15.7:0/347376614 shutdown_connections 2024-09-19T04:18:31.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:31.602+0000 7f039bdcf640 1 -- 172.21.15.7:0/347376614 wait complete. 2024-09-19T04:18:31.614 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether build environment is sane... yes 2024-09-19T04:18:31.619 INFO:tasks.workunit.client.0.smithi007.stdout:checking for gawk... gawk 2024-09-19T04:18:31.635 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether make sets $(MAKE)... yes 2024-09-19T04:18:31.649 INFO:tasks.workunit.client.0.smithi007.stdout:checking for gcc... gcc 2024-09-19T04:18:31.694 INFO:tasks.workunit.client.0.smithi007.stdout:checking for C compiler default output file name... a.out 2024-09-19T04:18:31.696 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether the C compiler works... yes 2024-09-19T04:18:31.698 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether we are cross compiling... no 2024-09-19T04:18:31.734 INFO:tasks.workunit.client.0.smithi007.stdout:checking for suffix of executables... 2024-09-19T04:18:31.767 INFO:tasks.workunit.client.0.smithi007.stdout:checking for suffix of object files... o 2024-09-19T04:18:31.808 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether we are using the GNU C compiler... yes 2024-09-19T04:18:31.849 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether gcc accepts -g... yes 2024-09-19T04:18:32.107 INFO:tasks.workunit.client.0.smithi007.stdout:checking for gcc option to accept ANSI C... none needed 2024-09-19T04:18:32.181 INFO:tasks.workunit.client.0.smithi007.stdout:checking for style of include used by make... GNU 2024-09-19T04:18:32.269 INFO:tasks.workunit.client.0.smithi007.stdout:checking dependency style of gcc... gcc3 2024-09-19T04:18:32.269 INFO:tasks.workunit.client.0.smithi007.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-19T04:18:32.439 INFO:tasks.workunit.client.0.smithi007.stdout:checking how to run the C preprocessor... gcc -E 2024-09-19T04:18:32.441 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '396f943', total seconds elapsed: 23.7 2024-09-19T04:18:32.441 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T04:18:32.441 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:18:32.478 INFO:tasks.workunit.client.0.smithi007.stdout:checking for egrep... grep -E 2024-09-19T04:18:32.487 INFO:tasks.workunit.client.0.smithi007.stdout:checking for AIX... no 2024-09-19T04:18:32.550 INFO:tasks.workunit.client.0.smithi007.stdout:checking for library containing strerror... none required 2024-09-19T04:18:32.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:32 smithi007 ceph-mon[31360]: pgmap v403: 129 pgs: 129 active+clean; 1.7 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-19T04:18:32.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:32 smithi102 ceph-mon[35446]: pgmap v403: 129 pgs: 129 active+clean; 1.7 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-19T04:18:32.710 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:18:32.724 INFO:tasks.workunit.client.0.smithi007.stdout:checking for ANSI C header files... yes 2024-09-19T04:18:32.775 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-19T04:18:32.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:32 smithi092 ceph-mon[34940]: pgmap v403: 129 pgs: 129 active+clean; 1.7 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-19T04:18:32.826 INFO:tasks.workunit.client.0.smithi007.stdout:checking for sys/types.h... yes 2024-09-19T04:18:32.879 INFO:tasks.workunit.client.0.smithi007.stdout:checking for sys/stat.h... yes 2024-09-19T04:18:32.925 INFO:tasks.workunit.client.0.smithi007.stdout:checking for stdlib.h... yes 2024-09-19T04:18:32.973 INFO:tasks.workunit.client.0.smithi007.stdout:checking for string.h... yes 2024-09-19T04:18:33.022 INFO:tasks.workunit.client.0.smithi007.stdout:checking for memory.h... yes 2024-09-19T04:18:33.091 INFO:tasks.workunit.client.0.smithi007.stdout:checking for strings.h... yes 2024-09-19T04:18:33.139 INFO:tasks.workunit.client.0.smithi007.stdout:checking for inttypes.h... yes 2024-09-19T04:18:33.186 INFO:tasks.workunit.client.0.smithi007.stdout:checking for stdint.h... yes 2024-09-19T04:18:33.237 INFO:tasks.workunit.client.0.smithi007.stdout:checking for unistd.h... yes 2024-09-19T04:18:33.249 INFO:tasks.workunit.client.0.smithi007.stdout:checking for memory.h... (cached) yes 2024-09-19T04:18:33.254 INFO:tasks.workunit.client.0.smithi007.stdout:checking for strings.h... (cached) yes 2024-09-19T04:18:33.260 INFO:tasks.workunit.client.0.smithi007.stdout:checking for unistd.h... (cached) yes 2024-09-19T04:18:33.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.259+0000 7f029f0b2640 1 -- 172.21.15.7:0/1258342171 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0298102d40 msgr2=0x7f0298103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:33.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.259+0000 7f029f0b2640 1 --2- 172.21.15.7:0/1258342171 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0298102d40 0x7f0298103120 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0294009900 tx=0x7f029402a480 comp rx=0 tx=0).stop 2024-09-19T04:18:33.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.259+0000 7f029f0b2640 1 -- 172.21.15.7:0/1258342171 shutdown_connections 2024-09-19T04:18:33.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.259+0000 7f029f0b2640 1 --2- 172.21.15.7:0/1258342171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f029810c170 0x7f029810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:33.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.259+0000 7f029f0b2640 1 --2- 172.21.15.7:0/1258342171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0298103660 0x7f029810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:33.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.259+0000 7f029f0b2640 1 --2- 172.21.15.7:0/1258342171 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0298102d40 0x7f0298103120 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:33.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.259+0000 7f029f0b2640 1 -- 172.21.15.7:0/1258342171 >> 172.21.15.7:0/1258342171 conn(0x7f02980fc7a0 msgr2=0x7f02980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:33.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.259+0000 7f029f0b2640 1 -- 172.21.15.7:0/1258342171 shutdown_connections 2024-09-19T04:18:33.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.259+0000 7f029f0b2640 1 -- 172.21.15.7:0/1258342171 wait complete. 2024-09-19T04:18:33.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.260+0000 7f029f0b2640 1 Processor -- start 2024-09-19T04:18:33.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.260+0000 7f029f0b2640 1 -- start start 2024-09-19T04:18:33.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.260+0000 7f029f0b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0298102d40 0x7f0298198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:33.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.260+0000 7f029f0b2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0298103660 0x7f0298198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:33.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.260+0000 7f029f0b2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f029810c170 0x7f029819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:33.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.260+0000 7f029f0b2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0298111f70 con 0x7f029810c170 2024-09-19T04:18:33.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.260+0000 7f029f0b2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0298111df0 con 0x7f0298103660 2024-09-19T04:18:33.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.260+0000 7f029f0b2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f02981120f0 con 0x7f0298102d40 2024-09-19T04:18:33.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.260+0000 7f029d64f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f029810c170 0x7f029819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:33.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.260+0000 7f029d64f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f029810c170 0x7f029819cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48082/0 (socket says 172.21.15.7:48082) 2024-09-19T04:18:33.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.260+0000 7f029d64f640 1 -- 172.21.15.7:0/2134597412 learned_addr learned my addr 172.21.15.7:0/2134597412 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:33.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.260+0000 7f028ffff640 1 --2- 172.21.15.7:0/2134597412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0298103660 0x7f0298198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:33.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.260+0000 7f029ce4e640 1 --2- 172.21.15.7:0/2134597412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0298102d40 0x7f0298198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:33.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.261+0000 7f029d64f640 1 -- 172.21.15.7:0/2134597412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0298102d40 msgr2=0x7f0298198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:33.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.261+0000 7f029d64f640 1 --2- 172.21.15.7:0/2134597412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0298102d40 0x7f0298198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:33.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.261+0000 7f029d64f640 1 -- 172.21.15.7:0/2134597412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0298103660 msgr2=0x7f0298198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:33.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.261+0000 7f029d64f640 1 --2- 172.21.15.7:0/2134597412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0298103660 0x7f0298198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:33.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.261+0000 7f029d64f640 1 -- 172.21.15.7:0/2134597412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f029819d3e0 con 0x7f029810c170 2024-09-19T04:18:33.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.261+0000 7f029d64f640 1 --2- 172.21.15.7:0/2134597412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f029810c170 0x7f029819cd00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f029000eaa0 tx=0x7f029000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:33.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.261+0000 7f028dffb640 1 -- 172.21.15.7:0/2134597412 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f029000cdb0 con 0x7f029810c170 2024-09-19T04:18:33.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.261+0000 7f028dffb640 1 -- 172.21.15.7:0/2134597412 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0290005020 con 0x7f029810c170 2024-09-19T04:18:33.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.261+0000 7f029f0b2640 1 -- 172.21.15.7:0/2134597412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f029819d6d0 con 0x7f029810c170 2024-09-19T04:18:33.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.261+0000 7f028dffb640 1 -- 172.21.15.7:0/2134597412 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02900116b0 con 0x7f029810c170 2024-09-19T04:18:33.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.261+0000 7f029f0b2640 1 -- 172.21.15.7:0/2134597412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02981a4fb0 con 0x7f029810c170 2024-09-19T04:18:33.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.262+0000 7f029f0b2640 1 -- 172.21.15.7:0/2134597412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0298103120 con 0x7f029810c170 2024-09-19T04:18:33.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.264+0000 7f028dffb640 1 -- 172.21.15.7:0/2134597412 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f0290005560 con 0x7f029810c170 2024-09-19T04:18:33.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.265+0000 7f028dffb640 1 --2- 172.21.15.7:0/2134597412 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f02800a32c0 0x7f02800a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:33.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.265+0000 7f029ce4e640 1 --2- 172.21.15.7:0/2134597412 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f02800a32c0 0x7f02800a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:33.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.265+0000 7f028dffb640 1 -- 172.21.15.7:0/2134597412 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f02900d0170 con 0x7f029810c170 2024-09-19T04:18:33.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.265+0000 7f029ce4e640 1 --2- 172.21.15.7:0/2134597412 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f02800a32c0 0x7f02800a5780 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0294009230 tx=0x7f02940058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:33.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.268+0000 7f028dffb640 1 -- 172.21.15.7:0/2134597412 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0290016030 con 0x7f029810c170 2024-09-19T04:18:33.304 INFO:tasks.workunit.client.0.smithi007.stdout:checking locale.h usability... yes 2024-09-19T04:18:33.324 INFO:tasks.workunit.client.0.smithi007.stdout:checking locale.h presence... yes 2024-09-19T04:18:33.325 INFO:tasks.workunit.client.0.smithi007.stdout:checking for locale.h... yes 2024-09-19T04:18:33.339 INFO:tasks.workunit.client.0.smithi007.stdout:checking for stdlib.h... (cached) yes 2024-09-19T04:18:33.344 INFO:tasks.workunit.client.0.smithi007.stdout:checking for string.h... (cached) yes 2024-09-19T04:18:33.416 INFO:tasks.workunit.client.0.smithi007.stdout:checking sys/socket.h usability... yes 2024-09-19T04:18:33.437 INFO:tasks.workunit.client.0.smithi007.stdout:checking sys/socket.h presence... yes 2024-09-19T04:18:33.438 INFO:tasks.workunit.client.0.smithi007.stdout:checking for sys/socket.h... yes 2024-09-19T04:18:33.489 INFO:tasks.workunit.client.0.smithi007.stdout:checking sys/time.h usability... yes 2024-09-19T04:18:33.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.498+0000 7f029f0b2640 1 -- 172.21.15.7:0/2134597412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f029802d7c0 con 0x7f029810c170 2024-09-19T04:18:33.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.498+0000 7f028dffb640 1 -- 172.21.15.7:0/2134597412 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11962 (secure 0 0 0) 0x7f029009c4b0 con 0x7f029810c170 2024-09-19T04:18:33.500 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:18:33.500 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":28,"btime":"2024-09-19T04:16:57:081835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:16:56.259017+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24496,"mds_2":24482,"mds_3":24478,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24472,24478,24482,24496,24506]},"id":1}]} 2024-09-19T04:18:33.500 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 28 2024-09-19T04:18:33.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.501+0000 7f029f0b2640 1 -- 172.21.15.7:0/2134597412 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f02800a32c0 msgr2=0x7f02800a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:33.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.501+0000 7f029f0b2640 1 --2- 172.21.15.7:0/2134597412 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f02800a32c0 0x7f02800a5780 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0294009230 tx=0x7f02940058d0 comp rx=0 tx=0).stop 2024-09-19T04:18:33.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.501+0000 7f029f0b2640 1 -- 172.21.15.7:0/2134597412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f029810c170 msgr2=0x7f029819cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:33.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.501+0000 7f029f0b2640 1 --2- 172.21.15.7:0/2134597412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f029810c170 0x7f029819cd00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f029000eaa0 tx=0x7f029000ef60 comp rx=0 tx=0).stop 2024-09-19T04:18:33.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.501+0000 7f029f0b2640 1 -- 172.21.15.7:0/2134597412 shutdown_connections 2024-09-19T04:18:33.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.501+0000 7f029f0b2640 1 --2- 172.21.15.7:0/2134597412 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f02800a32c0 0x7f02800a5780 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:33.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.501+0000 7f029f0b2640 1 --2- 172.21.15.7:0/2134597412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f029810c170 0x7f029819cd00 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:33.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.501+0000 7f029f0b2640 1 --2- 172.21.15.7:0/2134597412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0298103660 0x7f0298198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:33.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.501+0000 7f029f0b2640 1 --2- 172.21.15.7:0/2134597412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0298102d40 0x7f0298198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:33.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.501+0000 7f029f0b2640 1 -- 172.21.15.7:0/2134597412 >> 172.21.15.7:0/2134597412 conn(0x7f02980fc7a0 msgr2=0x7f02980fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:33.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.501+0000 7f029f0b2640 1 -- 172.21.15.7:0/2134597412 shutdown_connections 2024-09-19T04:18:33.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:33.501+0000 7f029f0b2640 1 -- 172.21.15.7:0/2134597412 wait complete. 2024-09-19T04:18:33.510 INFO:tasks.workunit.client.0.smithi007.stdout:checking sys/time.h presence... yes 2024-09-19T04:18:33.510 INFO:tasks.workunit.client.0.smithi007.stdout:checking for sys/time.h... yes 2024-09-19T04:18:33.571 INFO:tasks.workunit.client.0.smithi007.stdout:checking fcntl.h usability... yes 2024-09-19T04:18:33.592 INFO:tasks.workunit.client.0.smithi007.stdout:checking fcntl.h presence... yes 2024-09-19T04:18:33.593 INFO:tasks.workunit.client.0.smithi007.stdout:checking for fcntl.h... yes 2024-09-19T04:18:33.665 INFO:tasks.workunit.client.0.smithi007.stdout:checking sys/fcntl.h usability... yes 2024-09-19T04:18:33.685 INFO:tasks.workunit.client.0.smithi007.stdout:checking sys/fcntl.h presence... yes 2024-09-19T04:18:33.686 INFO:tasks.workunit.client.0.smithi007.stdout:checking for sys/fcntl.h... yes 2024-09-19T04:18:33.807 INFO:tasks.workunit.client.0.smithi007.stdout:checking sys/param.h usability... yes 2024-09-19T04:18:33.830 INFO:tasks.workunit.client.0.smithi007.stdout:checking sys/param.h presence... yes 2024-09-19T04:18:33.831 INFO:tasks.workunit.client.0.smithi007.stdout:checking for sys/param.h... yes 2024-09-19T04:18:33.881 INFO:tasks.workunit.client.0.smithi007.stdout:checking ioctl.h usability... no 2024-09-19T04:18:33.901 INFO:tasks.workunit.client.0.smithi007.stdout:checking ioctl.h presence... no 2024-09-19T04:18:33.902 INFO:tasks.workunit.client.0.smithi007.stdout:checking for ioctl.h... no 2024-09-19T04:18:33.952 INFO:tasks.workunit.client.0.smithi007.stdout:checking sys/ioctl.h usability... yes 2024-09-19T04:18:33.972 INFO:tasks.workunit.client.0.smithi007.stdout:checking sys/ioctl.h presence... yes 2024-09-19T04:18:33.973 INFO:tasks.workunit.client.0.smithi007.stdout:checking for sys/ioctl.h... yes 2024-09-19T04:18:34.023 INFO:tasks.workunit.client.0.smithi007.stdout:checking return type of signal handlers... void 2024-09-19T04:18:34.069 INFO:tasks.workunit.client.0.smithi007.stdout:checking for size_t... yes 2024-09-19T04:18:34.106 INFO:tasks.workunit.client.0.smithi007.stdout:checking for dev_t... yes 2024-09-19T04:18:34.150 INFO:tasks.workunit.client.0.smithi007.stdout:checking for short... yes 2024-09-19T04:18:34.228 INFO:tasks.workunit.client.0.smithi007.stdout:checking size of short... 2 2024-09-19T04:18:34.272 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24506 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T04:18:34.273 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24506 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T04:18:34.273 INFO:tasks.workunit.client.0.smithi007.stdout:checking for int... yes 2024-09-19T04:18:34.341 INFO:tasks.workunit.client.0.smithi007.stdout:checking size of int... 4 2024-09-19T04:18:34.386 INFO:tasks.workunit.client.0.smithi007.stdout:checking for long... yes 2024-09-19T04:18:34.453 INFO:tasks.workunit.client.0.smithi007.stdout:checking size of long... 8 2024-09-19T04:18:34.499 INFO:tasks.workunit.client.0.smithi007.stdout:checking for long long... yes 2024-09-19T04:18:34.536 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:18:34.573 INFO:tasks.workunit.client.0.smithi007.stdout:checking size of long long... 8 2024-09-19T04:18:34.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:34 smithi007 ceph-mon[31360]: pgmap v404: 129 pgs: 129 active+clean; 2.2 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 49 KiB/s wr, 16 op/s 2024-09-19T04:18:34.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:34 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2134597412' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:18:34.652 INFO:tasks.workunit.client.0.smithi007.stdout:checking for ssize_t... yes 2024-09-19T04:18:34.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:34 smithi102 ceph-mon[35446]: pgmap v404: 129 pgs: 129 active+clean; 2.2 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 49 KiB/s wr, 16 op/s 2024-09-19T04:18:34.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:34 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2134597412' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:18:34.699 INFO:tasks.workunit.client.0.smithi007.stdout:checking for sig_atomic_t... yes 2024-09-19T04:18:34.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:34 smithi092 ceph-mon[34940]: pgmap v404: 129 pgs: 129 active+clean; 2.2 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 49 KiB/s wr, 16 op/s 2024-09-19T04:18:34.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:34 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2134597412' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:18:34.862 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether gcc needs -traditional... no 2024-09-19T04:18:34.934 INFO:tasks.workunit.client.0.smithi007.stdout:checking for an ANSI C-conforming const... yes 2024-09-19T04:18:34.958 INFO:tasks.workunit.client.0.smithi007.stdout:checking for inline... inline 2024-09-19T04:18:35.036 INFO:tasks.workunit.client.0.smithi007.stdout:checking for working alloca.h... yes 2024-09-19T04:18:35.085 INFO:tasks.workunit.client.0.smithi007.stdout:checking for alloca... yes 2024-09-19T04:18:35.151 INFO:tasks.workunit.client.0.smithi007.stdout:checking for working memcmp... yes 2024-09-19T04:18:35.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.143+0000 7f9d95d21640 1 -- 172.21.15.7:0/3080263020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d90102d40 msgr2=0x7f9d90103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:35.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.143+0000 7f9d95d21640 1 --2- 172.21.15.7:0/3080263020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d90102d40 0x7f9d90103120 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f9d80009ca0 tx=0x7f9d8002a950 comp rx=0 tx=0).stop 2024-09-19T04:18:35.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.143+0000 7f9d95d21640 1 -- 172.21.15.7:0/3080263020 shutdown_connections 2024-09-19T04:18:35.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.143+0000 7f9d95d21640 1 --2- 172.21.15.7:0/3080263020 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d9010c170 0x7f9d9010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:35.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.143+0000 7f9d95d21640 1 --2- 172.21.15.7:0/3080263020 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d90103660 0x7f9d9010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:35.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.143+0000 7f9d95d21640 1 --2- 172.21.15.7:0/3080263020 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d90102d40 0x7f9d90103120 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:35.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.143+0000 7f9d95d21640 1 -- 172.21.15.7:0/3080263020 >> 172.21.15.7:0/3080263020 conn(0x7f9d900fc7a0 msgr2=0x7f9d900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:35.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.143+0000 7f9d95d21640 1 -- 172.21.15.7:0/3080263020 shutdown_connections 2024-09-19T04:18:35.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.143+0000 7f9d95d21640 1 -- 172.21.15.7:0/3080263020 wait complete. 2024-09-19T04:18:35.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.144+0000 7f9d95d21640 1 Processor -- start 2024-09-19T04:18:35.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.144+0000 7f9d95d21640 1 -- start start 2024-09-19T04:18:35.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.144+0000 7f9d95d21640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d90102d40 0x7f9d901009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:35.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.144+0000 7f9d95d21640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d90103660 0x7f9d90100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:35.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.144+0000 7f9d95d21640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d9010c170 0x7f9d90101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:35.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.144+0000 7f9d95d21640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9d90111f70 con 0x7f9d9010c170 2024-09-19T04:18:35.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.144+0000 7f9d95d21640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9d90111df0 con 0x7f9d90103660 2024-09-19T04:18:35.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.144+0000 7f9d95d21640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9d901120f0 con 0x7f9d90102d40 2024-09-19T04:18:35.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.145+0000 7f9d8ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d9010c170 0x7f9d90101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:35.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.145+0000 7f9d8ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d9010c170 0x7f9d90101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48098/0 (socket says 172.21.15.7:48098) 2024-09-19T04:18:35.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.145+0000 7f9d8ffff640 1 -- 172.21.15.7:0/1396132361 learned_addr learned my addr 172.21.15.7:0/1396132361 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:35.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.145+0000 7f9d8effd640 1 --2- 172.21.15.7:0/1396132361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d90103660 0x7f9d90100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:35.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.145+0000 7f9d8f7fe640 1 --2- 172.21.15.7:0/1396132361 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d90102d40 0x7f9d901009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:35.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.145+0000 7f9d8ffff640 1 -- 172.21.15.7:0/1396132361 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d90102d40 msgr2=0x7f9d901009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:35.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.145+0000 7f9d8ffff640 1 --2- 172.21.15.7:0/1396132361 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d90102d40 0x7f9d901009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:35.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.145+0000 7f9d8ffff640 1 -- 172.21.15.7:0/1396132361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d90103660 msgr2=0x7f9d90100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:35.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.145+0000 7f9d8ffff640 1 --2- 172.21.15.7:0/1396132361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d90103660 0x7f9d90100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:35.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.145+0000 7f9d8ffff640 1 -- 172.21.15.7:0/1396132361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d901a69b0 con 0x7f9d9010c170 2024-09-19T04:18:35.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.145+0000 7f9d8ffff640 1 --2- 172.21.15.7:0/1396132361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d9010c170 0x7f9d90101420 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800e970 tx=0x7f9d8800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:35.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.145+0000 7f9d8cff9640 1 -- 172.21.15.7:0/1396132361 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8800ccc0 con 0x7f9d9010c170 2024-09-19T04:18:35.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.145+0000 7f9d8cff9640 1 -- 172.21.15.7:0/1396132361 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d8800ce60 con 0x7f9d9010c170 2024-09-19T04:18:35.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.145+0000 7f9d95d21640 1 -- 172.21.15.7:0/1396132361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d901a6ca0 con 0x7f9d9010c170 2024-09-19T04:18:35.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.145+0000 7f9d8cff9640 1 -- 172.21.15.7:0/1396132361 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d88010490 con 0x7f9d9010c170 2024-09-19T04:18:35.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.145+0000 7f9d95d21640 1 -- 172.21.15.7:0/1396132361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d901a7190 con 0x7f9d9010c170 2024-09-19T04:18:35.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.148+0000 7f9d8cff9640 1 -- 172.21.15.7:0/1396132361 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f9d88005020 con 0x7f9d9010c170 2024-09-19T04:18:35.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.148+0000 7f9d980fa740 1 Processor -- start 2024-09-19T04:18:35.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.148+0000 7f9d980fa740 1 -- start start 2024-09-19T04:18:35.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.148+0000 7f9d980fa740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b44368850 0x564b44368c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:35.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.148+0000 7f9d980fa740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b44369170 0x564b443734f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:35.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.148+0000 7f9d980fa740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b44373a30 0x564b44375e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:35.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.148+0000 7f9d980fa740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564b442cd160 con 0x564b44368850 2024-09-19T04:18:35.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.148+0000 7f9d980fa740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564b44274720 con 0x564b44373a30 2024-09-19T04:18:35.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.148+0000 7f9d980fa740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564b442c9120 con 0x564b44369170 2024-09-19T04:18:35.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.148+0000 7f9d8effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b44368850 0x564b44368c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:35.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.148+0000 7f9d8effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b44368850 0x564b44368c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48100/0 (socket says 172.21.15.7:48100) 2024-09-19T04:18:35.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.148+0000 7f9d8effd640 1 -- 172.21.15.7:0/1527083031 learned_addr learned my addr 172.21.15.7:0/1527083031 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:35.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.148+0000 7f9d8effd640 1 --2- 172.21.15.7:0/1527083031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b44373a30 0x564b44375e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:35.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.148+0000 7f9d8f7fe640 1 --2- 172.21.15.7:0/1527083031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b44369170 0x564b443734f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:35.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.148+0000 7f9d8cff9640 1 --2- 172.21.15.7:0/1396132361 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9d780a3240 0x7f9d780a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:35.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.149+0000 7f9d8effd640 1 -- 172.21.15.7:0/1527083031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b44369170 msgr2=0x564b443734f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:35.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.149+0000 7f9d8effd640 1 --2- 172.21.15.7:0/1527083031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b44369170 0x564b443734f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:35.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.149+0000 7f9d8effd640 1 -- 172.21.15.7:0/1527083031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b44373a30 msgr2=0x564b44375e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:35.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.149+0000 7f9d8effd640 1 --2- 172.21.15.7:0/1527083031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b44373a30 0x564b44375e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:35.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.149+0000 7f9d8effd640 1 -- 172.21.15.7:0/1527083031 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b4403eba0 con 0x564b44368850 2024-09-19T04:18:35.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.149+0000 7f9d8ffff640 1 --2- 172.21.15.7:0/1396132361 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9d780a3240 0x7f9d780a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:35.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.149+0000 7f9d8cff9640 1 -- 172.21.15.7:0/1396132361 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f9d880d0140 con 0x7f9d9010c170 2024-09-19T04:18:35.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.149+0000 7f9d8effd640 1 --2- 172.21.15.7:0/1527083031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b44368850 0x564b44368c30 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f9d84012790 tx=0x7f9d8400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88df8f70f708a19b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:35.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.149+0000 7f9d75ffb640 1 -- 172.21.15.7:0/1527083031 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d84012dd0 con 0x564b44368850 2024-09-19T04:18:35.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.149+0000 7f9d75ffb640 1 -- 172.21.15.7:0/1527083031 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d84010c50 con 0x564b44368850 2024-09-19T04:18:35.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.149+0000 7f9d75ffb640 1 -- 172.21.15.7:0/1527083031 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8401eaa0 con 0x564b44368850 2024-09-19T04:18:35.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.150+0000 7f9d980fa740 1 -- 172.21.15.7:0/1527083031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b44368850 msgr2=0x564b44368c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:35.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.150+0000 7f9d8ffff640 1 --2- 172.21.15.7:0/1396132361 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9d780a3240 0x7f9d780a5700 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9d880987f0 tx=0x7f9d880c7160 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:35.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.150+0000 7f9d980fa740 1 --2- 172.21.15.7:0/1527083031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b44368850 0x564b44368c30 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f9d84012790 tx=0x7f9d8400b780 comp rx=0 tx=0).stop 2024-09-19T04:18:35.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.150+0000 7f9d980fa740 1 -- 172.21.15.7:0/1527083031 shutdown_connections 2024-09-19T04:18:35.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.150+0000 7f9d980fa740 1 --2- 172.21.15.7:0/1527083031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b44373a30 0x564b44375e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:35.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.150+0000 7f9d980fa740 1 --2- 172.21.15.7:0/1527083031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b44369170 0x564b443734f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:35.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.150+0000 7f9d980fa740 1 --2- 172.21.15.7:0/1527083031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b44368850 0x564b44368c30 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:35.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.150+0000 7f9d980fa740 1 -- 172.21.15.7:0/1527083031 >> 172.21.15.7:0/1527083031 conn(0x564b44364de0 msgr2=0x564b443651c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:35.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.150+0000 7f9d980fa740 1 -- 172.21.15.7:0/1527083031 shutdown_connections 2024-09-19T04:18:35.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.150+0000 7f9d980fa740 1 -- 172.21.15.7:0/1527083031 wait complete. 2024-09-19T04:18:35.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.150+0000 7f9d980fa740 1 -- start start 2024-09-19T04:18:35.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.151+0000 7f9d980fa740 1 Processor -- start 2024-09-19T04:18:35.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.151+0000 7f9d980fa740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b44368850 0x564b443708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:35.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.151+0000 7f9d980fa740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b44369170 0x564b44370de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:35.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.151+0000 7f9d980fa740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b44373a30 0x564b44371320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:35.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.151+0000 7f9d980fa740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564b44376600 con 0x564b44368850 2024-09-19T04:18:35.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.151+0000 7f9d980fa740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564b44255900 con 0x564b44373a30 2024-09-19T04:18:35.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.151+0000 7f9d980fa740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564b44376780 con 0x564b44369170 2024-09-19T04:18:35.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.151+0000 7f9d980fa740 10 client.0 _ll_register_callbacks cb 0x564b44253780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:18:35.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.151+0000 7f9d8effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b44368850 0x564b443708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:35.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.151+0000 7f9d8f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b44369170 0x564b44370de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:35.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.151+0000 7f9d8effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b44368850 0x564b443708a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48106/0 (socket says 172.21.15.7:48106) 2024-09-19T04:18:35.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.151+0000 7f9d8effd640 1 -- 172.21.15.7:0/2986090942 learned_addr learned my addr 172.21.15.7:0/2986090942 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:35.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.151+0000 7f9d8f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b44369170 0x564b44370de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:32960/0 (socket says 172.21.15.7:32960) 2024-09-19T04:18:35.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.151+0000 7f9d8effd640 1 --2- 172.21.15.7:0/2986090942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b44373a30 0x564b44371320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:35.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.152+0000 7f9d8f7fe640 1 -- 172.21.15.7:0/2986090942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b44373a30 msgr2=0x564b44371320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:35.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.152+0000 7f9d8f7fe640 1 --2- 172.21.15.7:0/2986090942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b44373a30 0x564b44371320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:35.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.152+0000 7f9d8f7fe640 1 -- 172.21.15.7:0/2986090942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b44368850 msgr2=0x564b443708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:35.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.152+0000 7f9d8f7fe640 1 --2- 172.21.15.7:0/2986090942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b44368850 0x564b443708a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:35.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.152+0000 7f9d8f7fe640 1 -- 172.21.15.7:0/2986090942 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b44295c50 con 0x564b44369170 2024-09-19T04:18:35.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.152+0000 7f9d8effd640 1 --2- 172.21.15.7:0/2986090942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b44368850 0x564b443708a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:18:35.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.152+0000 7f9d8f7fe640 1 --2- 172.21.15.7:0/2986090942 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b44369170 0x564b44370de0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9d80000f80 tx=0x7f9d80009380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1240c19469c746cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:35.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.152+0000 7f9d6effd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-19T04:18:35.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.152+0000 7f9d6effd640 1 -- 172.21.15.7:0/2986090942 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d80034040 con 0x564b44369170 2024-09-19T04:18:35.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.152+0000 7f9d980fa740 1 -- 172.21.15.7:0/2986090942 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d84010c50 con 0x564b44369170 2024-09-19T04:18:35.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.152+0000 7f9d6effd640 1 -- 172.21.15.7:0/2986090942 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f9d8002f670 con 0x564b44369170 2024-09-19T04:18:35.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.152+0000 7f9d6effd640 1 -- 172.21.15.7:0/2986090942 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9d8004f050 con 0x564b44369170 2024-09-19T04:18:35.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.152+0000 7f9d980fa740 10 client.25369 fetch_fsmap learned FSMap version 28 2024-09-19T04:18:35.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.152+0000 7f9d980fa740 1 -- 172.21.15.7:0/2986090942 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564b443822b0 con 0x564b44369170 2024-09-19T04:18:35.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.153+0000 7f9d6effd640 1 -- 172.21.15.7:0/2986090942 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d84010c50 con 0x564b44369170 2024-09-19T04:18:35.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.153+0000 7f9d6effd640 1 -- 172.21.15.7:0/2986090942 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f9d80030440 con 0x564b44369170 2024-09-19T04:18:35.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.153+0000 7f9d980fa740 10 client.25369 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:18:35.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.153+0000 7f9d980fa740 10 client.25369 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:18:35.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.153+0000 7f9d980fa740 20 client.25369 populate_metadata read hostname 'smithi007' 2024-09-19T04:18:35.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.153+0000 7f9d980fa740 1 --2- 172.21.15.7:0/2986090942 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564b443836c0 0x564b44385ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:35.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.153+0000 7f9d980fa740 4 client.25369 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:18:35.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.153+0000 7f9d980fa740 1 -- 172.21.15.7:0/2986090942 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b442da890 con 0x564b443836c0 2024-09-19T04:18:35.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.153+0000 7f9d8effd640 1 --2- 172.21.15.7:0/2986090942 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564b443836c0 0x564b44385ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:35.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.153+0000 7f9d6effd640 10 client.25369 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:35.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.153+0000 7f9d8effd640 1 --2- 172.21.15.7:0/2986090942 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564b443836c0 0x564b44385ad0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e67cdc1e84e2e1b server_cookie=b48b1477dbb01912 in_seq=0 out_seq=0 2024-09-19T04:18:35.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.155+0000 7f9d6effd640 1 -- 172.21.15.7:0/2986090942 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564b442da890 con 0x564b443836c0 2024-09-19T04:18:35.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.155+0000 7f9d6effd640 10 client.25369 handle_command_reply: tid=0 2024-09-19T04:18:35.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.155+0000 7f9d980fa740 1 client.25369 shutdown 2024-09-19T04:18:35.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.155+0000 7f9d980fa740 1 -- 172.21.15.7:0/2986090942 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b44369170 msgr2=0x564b44370de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:35.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.155+0000 7f9d980fa740 1 --2- 172.21.15.7:0/2986090942 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b44369170 0x564b44370de0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9d80000f80 tx=0x7f9d80009380 comp rx=0 tx=0).stop 2024-09-19T04:18:35.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.156+0000 7f9d980fa740 1 -- 172.21.15.7:0/2986090942 shutdown_connections 2024-09-19T04:18:35.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.156+0000 7f9d980fa740 1 --2- 172.21.15.7:0/2986090942 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564b443836c0 0x564b44385ad0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:35.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.156+0000 7f9d980fa740 1 --2- 172.21.15.7:0/2986090942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b44373a30 0x564b44371320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:35.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.156+0000 7f9d980fa740 1 --2- 172.21.15.7:0/2986090942 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b44369170 0x564b44370de0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:35.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.156+0000 7f9d6effd640 0 client.25369 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:35.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.156+0000 7f9d980fa740 1 --2- 172.21.15.7:0/2986090942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b44368850 0x564b443708a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:35.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.156+0000 7f9d980fa740 1 -- 172.21.15.7:0/2986090942 >> 172.21.15.7:0/2986090942 conn(0x564b44364de0 msgr2=0x564b4436ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:35.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.156+0000 7f9d980fa740 1 -- 172.21.15.7:0/2986090942 shutdown_connections 2024-09-19T04:18:35.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.156+0000 7f9d980fa740 1 -- 172.21.15.7:0/2986090942 wait complete. 2024-09-19T04:18:35.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.156+0000 7f9d980fa740 20 client.25369 trim_cache size 0 max 16384 2024-09-19T04:18:35.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.173+0000 7f9d980fa740 1 Processor -- start 2024-09-19T04:18:35.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.173+0000 7f9d980fa740 1 -- start start 2024-09-19T04:18:35.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.173+0000 7f9d980fa740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b44368850 0x564b4436b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:35.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.173+0000 7f9d980fa740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b44369170 0x564b44370f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:35.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.173+0000 7f9d980fa740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b44373a30 0x564b4438b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:35.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.173+0000 7f9d980fa740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9d901b1060 con 0x564b44369170 2024-09-19T04:18:35.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.173+0000 7f9d980fa740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9d901b2ba0 con 0x564b44368850 2024-09-19T04:18:35.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.173+0000 7f9d980fa740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9d901b1730 con 0x564b44373a30 2024-09-19T04:18:35.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.174+0000 7f9d8f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b44369170 0x564b44370f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:35.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.174+0000 7f9d8f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b44369170 0x564b44370f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48122/0 (socket says 172.21.15.7:48122) 2024-09-19T04:18:35.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.174+0000 7f9d8f7fe640 1 -- 172.21.15.7:0/2719393799 learned_addr learned my addr 172.21.15.7:0/2719393799 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:35.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.174+0000 7f9d8effd640 1 --2- 172.21.15.7:0/2719393799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b44368850 0x564b4436b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:35.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.174+0000 7f9d8effd640 1 --2- 172.21.15.7:0/2719393799 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b44373a30 0x564b4438b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:35.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.174+0000 7f9d8f7fe640 1 -- 172.21.15.7:0/2719393799 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b44373a30 msgr2=0x564b4438b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:35.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.174+0000 7f9d8f7fe640 1 --2- 172.21.15.7:0/2719393799 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b44373a30 0x564b4438b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:35.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.174+0000 7f9d8f7fe640 1 -- 172.21.15.7:0/2719393799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b44368850 msgr2=0x564b4436b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:35.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.174+0000 7f9d8f7fe640 1 --2- 172.21.15.7:0/2719393799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b44368850 0x564b4436b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:35.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.174+0000 7f9d8f7fe640 1 -- 172.21.15.7:0/2719393799 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b44368fa0 con 0x564b44369170 2024-09-19T04:18:35.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.174+0000 7f9d8effd640 1 --2- 172.21.15.7:0/2719393799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b44368850 0x564b4436b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:18:35.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.174+0000 7f9d8f7fe640 1 --2- 172.21.15.7:0/2719393799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b44369170 0x564b44370f70 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9d80004af0 tx=0x7f9d80009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67bb7a29ebb680ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:35.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.174+0000 7f9d757fa640 1 -- 172.21.15.7:0/2719393799 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d80034040 con 0x564b44369170 2024-09-19T04:18:35.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.174+0000 7f9d757fa640 1 -- 172.21.15.7:0/2719393799 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d80003e50 con 0x564b44369170 2024-09-19T04:18:35.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.174+0000 7f9d757fa640 1 -- 172.21.15.7:0/2719393799 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d80030440 con 0x564b44369170 2024-09-19T04:18:35.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.175+0000 7f9d980fa740 1 -- 172.21.15.7:0/2719393799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b44369170 msgr2=0x564b44370f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:35.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.175+0000 7f9d980fa740 1 --2- 172.21.15.7:0/2719393799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b44369170 0x564b44370f70 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9d80004af0 tx=0x7f9d80009540 comp rx=0 tx=0).stop 2024-09-19T04:18:35.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.175+0000 7f9d980fa740 1 -- 172.21.15.7:0/2719393799 shutdown_connections 2024-09-19T04:18:35.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.175+0000 7f9d980fa740 1 --2- 172.21.15.7:0/2719393799 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b44373a30 0x564b4438b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:35.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.175+0000 7f9d980fa740 1 --2- 172.21.15.7:0/2719393799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b44369170 0x564b44370f70 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:35.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.175+0000 7f9d980fa740 1 --2- 172.21.15.7:0/2719393799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b44368850 0x564b4436b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:35.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.175+0000 7f9d980fa740 1 -- 172.21.15.7:0/2719393799 >> 172.21.15.7:0/2719393799 conn(0x564b44364de0 msgr2=0x564b44370860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:35.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.175+0000 7f9d980fa740 1 -- 172.21.15.7:0/2719393799 shutdown_connections 2024-09-19T04:18:35.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.175+0000 7f9d980fa740 1 -- 172.21.15.7:0/2719393799 wait complete. 2024-09-19T04:18:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.176+0000 7f9d980fa740 1 -- start start 2024-09-19T04:18:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.176+0000 7f9d980fa740 1 Processor -- start 2024-09-19T04:18:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.176+0000 7f9d980fa740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b44368850 0x564b44377970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.176+0000 7f9d980fa740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b44369170 0x564b44377eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.176+0000 7f9d980fa740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b44373a30 0x564b443783f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.176+0000 7f9d980fa740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9d901b24d0 con 0x564b44373a30 2024-09-19T04:18:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.176+0000 7f9d980fa740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9d901b1e00 con 0x564b44368850 2024-09-19T04:18:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.176+0000 7f9d980fa740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9d901af040 con 0x564b44369170 2024-09-19T04:18:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.176+0000 7f9d980fa740 10 client.0 _ll_register_callbacks cb 0x7f9d80009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:18:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.176+0000 7f9d8f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b44369170 0x564b44377eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.176+0000 7f9d8effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b44373a30 0x564b443783f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.176+0000 7f9d8f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b44369170 0x564b44377eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:32970/0 (socket says 172.21.15.7:32970) 2024-09-19T04:18:35.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.176+0000 7f9d8f7fe640 1 -- 172.21.15.7:0/2865796730 learned_addr learned my addr 172.21.15.7:0/2865796730 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:35.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.176+0000 7f9d8effd640 1 --2- 172.21.15.7:0/2865796730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b44368850 0x564b44377970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:35.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.177+0000 7f9d8effd640 1 -- 172.21.15.7:0/2865796730 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b44369170 msgr2=0x564b44377eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:35.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.177+0000 7f9d8effd640 1 --2- 172.21.15.7:0/2865796730 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b44369170 0x564b44377eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:35.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.177+0000 7f9d8effd640 1 -- 172.21.15.7:0/2865796730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b44373a30 msgr2=0x564b443783f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:35.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.177+0000 7f9d8effd640 1 --2- 172.21.15.7:0/2865796730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b44373a30 0x564b443783f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:35.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.177+0000 7f9d8effd640 1 -- 172.21.15.7:0/2865796730 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b443ed520 con 0x564b44368850 2024-09-19T04:18:35.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.177+0000 7f9d8f7fe640 1 --2- 172.21.15.7:0/2865796730 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b44369170 0x564b44377eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:18:35.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.177+0000 7f9d8effd640 1 --2- 172.21.15.7:0/2865796730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b44368850 0x564b44377970 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x564b44386290 tx=0x7f9d8401e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7352e64f41d30005 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:35.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.177+0000 7f9d6effd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T04:18:35.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.177+0000 7f9d6effd640 1 -- 172.21.15.7:0/2865796730 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d84024040 con 0x564b44368850 2024-09-19T04:18:35.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.177+0000 7f9d980fa740 1 -- 172.21.15.7:0/2865796730 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d80003e50 con 0x564b44368850 2024-09-19T04:18:35.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.177+0000 7f9d6effd640 1 -- 172.21.15.7:0/2865796730 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f9d84010bf0 con 0x564b44368850 2024-09-19T04:18:35.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.178+0000 7f9d6effd640 1 -- 172.21.15.7:0/2865796730 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9d84040050 con 0x564b44368850 2024-09-19T04:18:35.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.178+0000 7f9d980fa740 10 client.25277 fetch_fsmap learned FSMap version 28 2024-09-19T04:18:35.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.178+0000 7f9d980fa740 1 -- 172.21.15.7:0/2865796730 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564b443ee7e0 con 0x564b44368850 2024-09-19T04:18:35.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.178+0000 7f9d6effd640 1 -- 172.21.15.7:0/2865796730 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d80003e50 con 0x564b44368850 2024-09-19T04:18:35.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.178+0000 7f9d6effd640 1 -- 172.21.15.7:0/2865796730 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f9d8402a040 con 0x564b44368850 2024-09-19T04:18:35.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.178+0000 7f9d980fa740 10 client.25277 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:18:35.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.178+0000 7f9d980fa740 10 client.25277 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:18:35.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.178+0000 7f9d980fa740 20 client.25277 populate_metadata read hostname 'smithi007' 2024-09-19T04:18:35.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.178+0000 7f9d980fa740 1 --2- 172.21.15.7:0/2865796730 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564b443836c0 0x564b443f0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:35.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.178+0000 7f9d980fa740 4 client.25277 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T04:18:35.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.178+0000 7f9d980fa740 1 -- 172.21.15.7:0/2865796730 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x564b442d4be0 con 0x564b443836c0 2024-09-19T04:18:35.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.178+0000 7f9d8f7fe640 1 --2- 172.21.15.7:0/2865796730 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564b443836c0 0x564b443f0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:35.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.179+0000 7f9d8f7fe640 1 --2- 172.21.15.7:0/2865796730 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564b443836c0 0x564b443f0d90 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8242e890e45b7c6d server_cookie=e8b70f16f1a6e27e in_seq=0 out_seq=0 2024-09-19T04:18:35.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:35.179+0000 7f9d6effd640 10 client.25277 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:36.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:36 smithi007 ceph-mon[31360]: pgmap v405: 129 pgs: 129 active+clean; 2.2 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 49 KiB/s wr, 16 op/s 2024-09-19T04:18:36.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:36 smithi102 ceph-mon[35446]: pgmap v405: 129 pgs: 129 active+clean; 2.2 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 49 KiB/s wr, 16 op/s 2024-09-19T04:18:36.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:36.691+0000 7f9d6effd640 1 -- 172.21.15.7:0/2865796730 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x564b442d4be0 con 0x564b443836c0 2024-09-19T04:18:36.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:36.691+0000 7f9d6effd640 10 client.25277 handle_command_reply: tid=0 2024-09-19T04:18:36.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:36.691+0000 7f9d980fa740 1 client.25277 shutdown 2024-09-19T04:18:36.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:36.692+0000 7f9d980fa740 1 -- 172.21.15.7:0/2865796730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b44368850 msgr2=0x564b44377970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:36.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:36.692+0000 7f9d980fa740 1 --2- 172.21.15.7:0/2865796730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b44368850 0x564b44377970 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x564b44386290 tx=0x7f9d8401e3c0 comp rx=0 tx=0).stop 2024-09-19T04:18:36.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:36.692+0000 7f9d980fa740 1 -- 172.21.15.7:0/2865796730 shutdown_connections 2024-09-19T04:18:36.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:36.692+0000 7f9d980fa740 1 --2- 172.21.15.7:0/2865796730 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564b443836c0 0x564b443f0d90 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:36.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:36.692+0000 7f9d980fa740 1 --2- 172.21.15.7:0/2865796730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564b44373a30 0x564b443783f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:36.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:36.692+0000 7f9d980fa740 1 --2- 172.21.15.7:0/2865796730 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b44369170 0x564b44377eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:36.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:36.692+0000 7f9d980fa740 1 --2- 172.21.15.7:0/2865796730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564b44368850 0x564b44377970 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:36.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:36.692+0000 7f9d6effd640 0 client.25277 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:36.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:36.692+0000 7f9d980fa740 1 -- 172.21.15.7:0/2865796730 >> 172.21.15.7:0/2865796730 conn(0x564b44364de0 msgr2=0x564b44371060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:36.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:36.692+0000 7f9d980fa740 1 -- 172.21.15.7:0/2865796730 shutdown_connections 2024-09-19T04:18:36.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:36.692+0000 7f9d980fa740 1 -- 172.21.15.7:0/2865796730 wait complete. 2024-09-19T04:18:36.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:36.692+0000 7f9d980fa740 20 client.25277 trim_cache size 0 max 16384 2024-09-19T04:18:36.695 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:18:36.695 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 28, 2024-09-19T04:18:36.695 INFO:teuthology.orchestra.run.smithi007.stdout: "leader": 24506, 2024-09-19T04:18:36.695 INFO:teuthology.orchestra.run.smithi007.stdout: "set_version": 10, 2024-09-19T04:18:36.695 INFO:teuthology.orchestra.run.smithi007.stdout: "sets": { 2024-09-19T04:18:36.695 INFO:teuthology.orchestra.run.smithi007.stdout: "2759e76d": { 2024-09-19T04:18:36.696 INFO:teuthology.orchestra.run.smithi007.stdout: "version": 10, 2024-09-19T04:18:36.696 INFO:teuthology.orchestra.run.smithi007.stdout: "age_ref": 0.0, 2024-09-19T04:18:36.696 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:18:36.696 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "QUIESCED", 2024-09-19T04:18:36.696 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:18:36.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:18:36.696 INFO:teuthology.orchestra.run.smithi007.stdout: "timeout": 90.0, 2024-09-19T04:18:36.696 INFO:teuthology.orchestra.run.smithi007.stdout: "expiration": 140.3, 2024-09-19T04:18:36.696 INFO:teuthology.orchestra.run.smithi007.stdout: "members": { 2024-09-19T04:18:36.696 INFO:teuthology.orchestra.run.smithi007.stdout: "file:/": { 2024-09-19T04:18:36.696 INFO:teuthology.orchestra.run.smithi007.stdout: "excluded": false, 2024-09-19T04:18:36.696 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:18:36.696 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "QUIESCED", 2024-09-19T04:18:36.697 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:18:36.697 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:18:36.697 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:18:36.697 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:18:36.697 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:18:36.697 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:18:36.697 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:18:36.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:36.693+0000 7f9d95d21640 1 -- 172.21.15.7:0/1396132361 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9d780a3240 msgr2=0x7f9d780a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:36.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:36.693+0000 7f9d95d21640 1 --2- 172.21.15.7:0/1396132361 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9d780a3240 0x7f9d780a5700 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9d880987f0 tx=0x7f9d880c7160 comp rx=0 tx=0).stop 2024-09-19T04:18:36.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:36.693+0000 7f9d95d21640 1 -- 172.21.15.7:0/1396132361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d9010c170 msgr2=0x7f9d90101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:36.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:36.693+0000 7f9d95d21640 1 --2- 172.21.15.7:0/1396132361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d9010c170 0x7f9d90101420 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800e970 tx=0x7f9d8800ed70 comp rx=0 tx=0).stop 2024-09-19T04:18:36.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:36.693+0000 7f9d95d21640 1 -- 172.21.15.7:0/1396132361 shutdown_connections 2024-09-19T04:18:36.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:36.693+0000 7f9d95d21640 1 --2- 172.21.15.7:0/1396132361 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f9d780a3240 0x7f9d780a5700 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:36.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:36.693+0000 7f9d95d21640 1 --2- 172.21.15.7:0/1396132361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d9010c170 0x7f9d90101420 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:36.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:36.693+0000 7f9d95d21640 1 --2- 172.21.15.7:0/1396132361 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d90103660 0x7f9d90100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:36.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:36.693+0000 7f9d95d21640 1 --2- 172.21.15.7:0/1396132361 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d90102d40 0x7f9d901009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:36.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:36.693+0000 7f9d95d21640 1 -- 172.21.15.7:0/1396132361 >> 172.21.15.7:0/1396132361 conn(0x7f9d900fc7a0 msgr2=0x7f9d900fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:36.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:36.693+0000 7f9d95d21640 1 -- 172.21.15.7:0/1396132361 shutdown_connections 2024-09-19T04:18:36.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:36.693+0000 7f9d95d21640 1 -- 172.21.15.7:0/1396132361 wait complete. 2024-09-19T04:18:36.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:36 smithi092 ceph-mon[34940]: pgmap v405: 129 pgs: 129 active+clean; 2.2 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 49 KiB/s wr, 16 op/s 2024-09-19T04:18:37.385 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '2759e76d', quiesce took 4.9 seconds. Will release after: 15.450000000000001 2024-09-19T04:18:38.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:38 smithi007 ceph-mon[31360]: pgmap v406: 129 pgs: 129 active+clean; 2.2 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 49 KiB/s wr, 14 op/s 2024-09-19T04:18:38.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:38 smithi102 ceph-mon[35446]: pgmap v406: 129 pgs: 129 active+clean; 2.2 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 49 KiB/s wr, 14 op/s 2024-09-19T04:18:38.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:38 smithi092 ceph-mon[34940]: pgmap v406: 129 pgs: 129 active+clean; 2.2 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 49 KiB/s wr, 14 op/s 2024-09-19T04:18:40.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:40 smithi007 ceph-mon[31360]: pgmap v407: 129 pgs: 129 active+clean; 3.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 193 KiB/s wr, 42 op/s 2024-09-19T04:18:40.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:18:40.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:18:40.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:18:40.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:18:40.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:18:40.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:18:40.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:18:40.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:18:40.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:18:40.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:18:40.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:40 smithi102 ceph-mon[35446]: pgmap v407: 129 pgs: 129 active+clean; 3.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 193 KiB/s wr, 42 op/s 2024-09-19T04:18:40.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:18:40.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:18:40.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:18:40.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:18:40.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:18:40.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:18:40.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:18:40.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:18:40.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:18:40.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:18:40.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:40 smithi092 ceph-mon[34940]: pgmap v407: 129 pgs: 129 active+clean; 3.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 193 KiB/s wr, 42 op/s 2024-09-19T04:18:40.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:18:40.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:18:40.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:18:40.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:18:40.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:18:40.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:18:40.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:18:40.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:18:40.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:18:40.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:18:42.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:42 smithi007 ceph-mon[31360]: pgmap v408: 129 pgs: 129 active+clean; 3.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 196 KiB/s wr, 42 op/s 2024-09-19T04:18:42.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:42 smithi102 ceph-mon[35446]: pgmap v408: 129 pgs: 129 active+clean; 3.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 196 KiB/s wr, 42 op/s 2024-09-19T04:18:42.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.695+0000 7fdde8fbd640 1 -- 172.21.15.7:0/1755768562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdde4104f20 msgr2=0x7fdde4107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:42.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.695+0000 7fdde8fbd640 1 --2- 172.21.15.7:0/1755768562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdde4104f20 0x7fdde4107310 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fddd8009900 tx=0x7fddd802a410 comp rx=0 tx=0).stop 2024-09-19T04:18:42.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.696+0000 7fdde8fbd640 1 -- 172.21.15.7:0/1755768562 shutdown_connections 2024-09-19T04:18:42.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.696+0000 7fdde8fbd640 1 --2- 172.21.15.7:0/1755768562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdde4107850 0x7fdde4109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.696+0000 7fdde8fbd640 1 --2- 172.21.15.7:0/1755768562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdde4104f20 0x7fdde4107310 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.696+0000 7fdde8fbd640 1 --2- 172.21.15.7:0/1755768562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdde41025f0 0x7fdde41049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.696+0000 7fdde8fbd640 1 -- 172.21.15.7:0/1755768562 >> 172.21.15.7:0/1755768562 conn(0x7fdde40fc1f0 msgr2=0x7fdde40fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:42.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.696+0000 7fdde8fbd640 1 -- 172.21.15.7:0/1755768562 shutdown_connections 2024-09-19T04:18:42.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.696+0000 7fdde8fbd640 1 -- 172.21.15.7:0/1755768562 wait complete. 2024-09-19T04:18:42.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.696+0000 7fdde8fbd640 1 Processor -- start 2024-09-19T04:18:42.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.697+0000 7fdde8fbd640 1 -- start start 2024-09-19T04:18:42.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.697+0000 7fdde8fbd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdde41025f0 0x7fdde4197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:42.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.697+0000 7fdde8fbd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdde4104f20 0x7fdde41984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:42.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.697+0000 7fdde8fbd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdde4107850 0x7fdde419f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:42.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.697+0000 7fdde8fbd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdde410d820 con 0x7fdde4107850 2024-09-19T04:18:42.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.697+0000 7fdde8fbd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdde410d6a0 con 0x7fdde41025f0 2024-09-19T04:18:42.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.697+0000 7fdde8fbd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdde410d9a0 con 0x7fdde4104f20 2024-09-19T04:18:42.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.697+0000 7fdde2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdde4107850 0x7fdde419f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:42.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.697+0000 7fdde2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdde4107850 0x7fdde419f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58770/0 (socket says 172.21.15.7:58770) 2024-09-19T04:18:42.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.697+0000 7fdde2d9d640 1 -- 172.21.15.7:0/1552854464 learned_addr learned my addr 172.21.15.7:0/1552854464 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:42.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.697+0000 7fdde1d9b640 1 --2- 172.21.15.7:0/1552854464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdde4104f20 0x7fdde41984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:42.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.697+0000 7fdde259c640 1 --2- 172.21.15.7:0/1552854464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdde41025f0 0x7fdde4197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:42.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.697+0000 7fdde2d9d640 1 -- 172.21.15.7:0/1552854464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdde4104f20 msgr2=0x7fdde41984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:42.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.697+0000 7fdde2d9d640 1 --2- 172.21.15.7:0/1552854464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdde4104f20 0x7fdde41984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.697+0000 7fdde2d9d640 1 -- 172.21.15.7:0/1552854464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdde41025f0 msgr2=0x7fdde4197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:42.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.697+0000 7fdde2d9d640 1 --2- 172.21.15.7:0/1552854464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdde41025f0 0x7fdde4197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.697+0000 7fdde2d9d640 1 -- 172.21.15.7:0/1552854464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde419fb90 con 0x7fdde4107850 2024-09-19T04:18:42.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.697+0000 7fdde2d9d640 1 --2- 172.21.15.7:0/1552854464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdde4107850 0x7fdde419f520 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fdddc00dac0 tx=0x7fdddc00df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:42.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.698+0000 7fddd37fe640 1 -- 172.21.15.7:0/1552854464 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdddc017070 con 0x7fdde4107850 2024-09-19T04:18:42.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.698+0000 7fddd37fe640 1 -- 172.21.15.7:0/1552854464 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdddc003e50 con 0x7fdde4107850 2024-09-19T04:18:42.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.698+0000 7fdde8fbd640 1 -- 172.21.15.7:0/1552854464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdde419fe80 con 0x7fdde4107850 2024-09-19T04:18:42.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.698+0000 7fddd37fe640 1 -- 172.21.15.7:0/1552854464 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdddc0106c0 con 0x7fdde4107850 2024-09-19T04:18:42.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.698+0000 7fdde8fbd640 1 -- 172.21.15.7:0/1552854464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdde41a02f0 con 0x7fdde4107850 2024-09-19T04:18:42.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.700+0000 7fddd37fe640 1 -- 172.21.15.7:0/1552854464 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fdddc003970 con 0x7fdde4107850 2024-09-19T04:18:42.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.701+0000 7fddebe35740 1 Processor -- start 2024-09-19T04:18:42.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.701+0000 7fddebe35740 1 -- start start 2024-09-19T04:18:42.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.701+0000 7fddebe35740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558650c219a0 0x558650c21da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:42.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.701+0000 7fddebe35740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558650c222e0 0x558650c26da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:42.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.701+0000 7fddebe35740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558650c27370 0x558650c29830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:42.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.701+0000 7fddebe35740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558650b852f0 con 0x558650c27370 2024-09-19T04:18:42.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.701+0000 7fddebe35740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558650b2d270 con 0x558650c222e0 2024-09-19T04:18:42.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.701+0000 7fddebe35740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558650b812b0 con 0x558650c219a0 2024-09-19T04:18:42.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.701+0000 7fddd37fe640 1 --2- 172.21.15.7:0/1552854464 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fddcc0a3240 0x7fddcc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:42.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.701+0000 7fdde1d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558650c27370 0x558650c29830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:42.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.701+0000 7fdde1d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558650c27370 0x558650c29830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58782/0 (socket says 172.21.15.7:58782) 2024-09-19T04:18:42.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.701+0000 7fdde1d9b640 1 -- 172.21.15.7:0/2397495163 learned_addr learned my addr 172.21.15.7:0/2397495163 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:42.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.701+0000 7fdde259c640 1 --2- 172.21.15.7:0/2397495163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558650c222e0 0x558650c26da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:42.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.701+0000 7fdde1d9b640 1 --2- 172.21.15.7:0/2397495163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558650c219a0 0x558650c21da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:42.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.701+0000 7fdde2d9d640 1 --2- 172.21.15.7:0/1552854464 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fddcc0a3240 0x7fddcc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:42.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.702+0000 7fddd37fe640 1 -- 172.21.15.7:0/1552854464 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fdddc0cfa90 con 0x7fdde4107850 2024-09-19T04:18:42.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.702+0000 7fdde259c640 1 -- 172.21.15.7:0/2397495163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558650c219a0 msgr2=0x558650c21da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:42.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.702+0000 7fdde259c640 1 --2- 172.21.15.7:0/2397495163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558650c219a0 0x558650c21da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.702+0000 7fdde259c640 1 -- 172.21.15.7:0/2397495163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558650c27370 msgr2=0x558650c29830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:42.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.702+0000 7fdde259c640 1 --2- 172.21.15.7:0/2397495163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558650c27370 0x558650c29830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.702+0000 7fdde259c640 1 -- 172.21.15.7:0/2397495163 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558650b2c340 con 0x558650c222e0 2024-09-19T04:18:42.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.702+0000 7fdde259c640 1 --2- 172.21.15.7:0/2397495163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558650c222e0 0x558650c26da0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fddd400bbe0 tx=0x7fddd400f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad2a70f5c6150647 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:42.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.702+0000 7fdde2d9d640 1 --2- 172.21.15.7:0/1552854464 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fddcc0a3240 0x7fddcc0a5700 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdddc00da90 tx=0x7fdddc06b950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:42.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.702+0000 7fddd0ff9640 1 -- 172.21.15.7:0/2397495163 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd4015070 con 0x558650c222e0 2024-09-19T04:18:42.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.702+0000 7fddd0ff9640 1 -- 172.21.15.7:0/2397495163 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddd4005500 con 0x558650c222e0 2024-09-19T04:18:42.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.702+0000 7fddd0ff9640 1 -- 172.21.15.7:0/2397495163 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd4011640 con 0x558650c222e0 2024-09-19T04:18:42.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.703+0000 7fddebe35740 1 -- 172.21.15.7:0/2397495163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558650c222e0 msgr2=0x558650c26da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:42.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.703+0000 7fddebe35740 1 --2- 172.21.15.7:0/2397495163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558650c222e0 0x558650c26da0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fddd400bbe0 tx=0x7fddd400f730 comp rx=0 tx=0).stop 2024-09-19T04:18:42.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.703+0000 7fddebe35740 1 -- 172.21.15.7:0/2397495163 shutdown_connections 2024-09-19T04:18:42.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.703+0000 7fddebe35740 1 --2- 172.21.15.7:0/2397495163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558650c27370 0x558650c29830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.703+0000 7fddebe35740 1 --2- 172.21.15.7:0/2397495163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558650c222e0 0x558650c26da0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.703+0000 7fddebe35740 1 --2- 172.21.15.7:0/2397495163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558650c219a0 0x558650c21da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.703+0000 7fddebe35740 1 -- 172.21.15.7:0/2397495163 >> 172.21.15.7:0/2397495163 conn(0x558650c1d010 msgr2=0x558650c1d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:42.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.703+0000 7fddebe35740 1 -- 172.21.15.7:0/2397495163 shutdown_connections 2024-09-19T04:18:42.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.703+0000 7fddebe35740 1 -- 172.21.15.7:0/2397495163 wait complete. 2024-09-19T04:18:42.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.704+0000 7fddebe35740 1 -- start start 2024-09-19T04:18:42.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.704+0000 7fddebe35740 1 Processor -- start 2024-09-19T04:18:42.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.704+0000 7fddebe35740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558650c219a0 0x558650c2bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:42.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.704+0000 7fddebe35740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558650c222e0 0x558650c2c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:42.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.704+0000 7fddebe35740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558650c27370 0x558650c33130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:42.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.704+0000 7fddebe35740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558650c2a340 con 0x558650c222e0 2024-09-19T04:18:42.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.704+0000 7fddebe35740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558650b0e290 con 0x558650c27370 2024-09-19T04:18:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.704+0000 7fddebe35740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558650c2a4c0 con 0x558650c219a0 2024-09-19T04:18:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.704+0000 7fddebe35740 10 client.0 _ll_register_callbacks cb 0x558650b3f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:18:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.704+0000 7fdde259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558650c222e0 0x558650c2c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.704+0000 7fdde259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558650c222e0 0x558650c2c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58792/0 (socket says 172.21.15.7:58792) 2024-09-19T04:18:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.704+0000 7fdde259c640 1 -- 172.21.15.7:0/3362995418 learned_addr learned my addr 172.21.15.7:0/3362995418 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.704+0000 7fdde1d9b640 1 --2- 172.21.15.7:0/3362995418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558650c27370 0x558650c33130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.704+0000 7fdde1d9b640 1 --2- 172.21.15.7:0/3362995418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558650c219a0 0x558650c2bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.704+0000 7fdde259c640 1 -- 172.21.15.7:0/3362995418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558650c219a0 msgr2=0x558650c2bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.704+0000 7fdde259c640 1 --2- 172.21.15.7:0/3362995418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558650c219a0 0x558650c2bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.704+0000 7fdde259c640 1 -- 172.21.15.7:0/3362995418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558650c27370 msgr2=0x558650c33130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.704+0000 7fdde259c640 1 --2- 172.21.15.7:0/3362995418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558650c27370 0x558650c33130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.704+0000 7fdde259c640 1 -- 172.21.15.7:0/3362995418 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558650898210 con 0x558650c222e0 2024-09-19T04:18:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.705+0000 7fdde259c640 1 --2- 172.21.15.7:0/3362995418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558650c222e0 0x558650c2c160 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fddd400bf00 tx=0x7fddd400bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320489aec7c5104 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.705+0000 7fddc9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:18:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.705+0000 7fddc9ffb640 1 -- 172.21.15.7:0/3362995418 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd4015070 con 0x558650c222e0 2024-09-19T04:18:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.705+0000 7fddc9ffb640 1 -- 172.21.15.7:0/3362995418 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fddd4004de0 con 0x558650c222e0 2024-09-19T04:18:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.705+0000 7fddebe35740 1 -- 172.21.15.7:0/3362995418 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddd4005500 con 0x558650c222e0 2024-09-19T04:18:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.705+0000 7fddc9ffb640 1 -- 172.21.15.7:0/3362995418 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fddd4004fe0 con 0x558650c222e0 2024-09-19T04:18:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.705+0000 7fddebe35740 10 client.15690 fetch_fsmap learned FSMap version 28 2024-09-19T04:18:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.705+0000 7fddebe35740 1 -- 172.21.15.7:0/3362995418 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558650964620 con 0x558650c222e0 2024-09-19T04:18:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.705+0000 7fddc9ffb640 1 -- 172.21.15.7:0/3362995418 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddd4005500 con 0x558650c222e0 2024-09-19T04:18:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.705+0000 7fddc9ffb640 1 -- 172.21.15.7:0/3362995418 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fddd4011b80 con 0x558650c222e0 2024-09-19T04:18:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.705+0000 7fddebe35740 10 client.15690 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:18:42.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.705+0000 7fddebe35740 10 client.15690 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:18:42.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.706+0000 7fddebe35740 20 client.15690 populate_metadata read hostname 'smithi007' 2024-09-19T04:18:42.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.706+0000 7fddebe35740 1 --2- 172.21.15.7:0/3362995418 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x558650c37650 0x558650c39a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:42.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.706+0000 7fddebe35740 4 client.15690 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:18:42.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.706+0000 7fddebe35740 1 -- 172.21.15.7:0/3362995418 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558650b92a20 con 0x558650c37650 2024-09-19T04:18:42.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.706+0000 7fdde1d9b640 1 --2- 172.21.15.7:0/3362995418 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x558650c37650 0x558650c39a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:42.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.706+0000 7fddc9ffb640 10 client.15690 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:42.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.706+0000 7fdde1d9b640 1 --2- 172.21.15.7:0/3362995418 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x558650c37650 0x558650c39a90 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd42a2a24e7ef9cc server_cookie=6e89b073e91a1729 in_seq=0 out_seq=0 2024-09-19T04:18:42.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.707+0000 7fddc9ffb640 1 -- 172.21.15.7:0/3362995418 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558650b92a20 con 0x558650c37650 2024-09-19T04:18:42.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.707+0000 7fddc9ffb640 10 client.15690 handle_command_reply: tid=0 2024-09-19T04:18:42.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.707+0000 7fddebe35740 1 client.15690 shutdown 2024-09-19T04:18:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.707+0000 7fddebe35740 1 -- 172.21.15.7:0/3362995418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558650c222e0 msgr2=0x558650c2c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.707+0000 7fddebe35740 1 --2- 172.21.15.7:0/3362995418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558650c222e0 0x558650c2c160 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fddd400bf00 tx=0x7fddd400bf30 comp rx=0 tx=0).stop 2024-09-19T04:18:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.707+0000 7fddebe35740 1 -- 172.21.15.7:0/3362995418 shutdown_connections 2024-09-19T04:18:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.707+0000 7fddebe35740 1 --2- 172.21.15.7:0/3362995418 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x558650c37650 0x558650c39a90 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.707+0000 7fddebe35740 1 --2- 172.21.15.7:0/3362995418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558650c27370 0x558650c33130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.707+0000 7fddc9ffb640 0 client.15690 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.707+0000 7fddebe35740 1 --2- 172.21.15.7:0/3362995418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558650c222e0 0x558650c2c160 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.707+0000 7fddebe35740 1 --2- 172.21.15.7:0/3362995418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558650c219a0 0x558650c2bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.707+0000 7fddebe35740 1 -- 172.21.15.7:0/3362995418 >> 172.21.15.7:0/3362995418 conn(0x558650c1d010 msgr2=0x558650c1e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.707+0000 7fddebe35740 1 -- 172.21.15.7:0/3362995418 shutdown_connections 2024-09-19T04:18:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.707+0000 7fddebe35740 1 -- 172.21.15.7:0/3362995418 wait complete. 2024-09-19T04:18:42.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.707+0000 7fddebe35740 20 client.15690 trim_cache size 0 max 16384 2024-09-19T04:18:42.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.722+0000 7fddebe35740 1 Processor -- start 2024-09-19T04:18:42.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.722+0000 7fddebe35740 1 -- start start 2024-09-19T04:18:42.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.722+0000 7fddebe35740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558650c219a0 0x558650c2b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:42.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.722+0000 7fddebe35740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558650c222e0 0x558650c1e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.722+0000 7fddebe35740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558650c27370 0x558650c1e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.722+0000 7fddebe35740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdde41aa8e0 con 0x558650c27370 2024-09-19T04:18:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.722+0000 7fddebe35740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdde41ac420 con 0x558650c222e0 2024-09-19T04:18:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.722+0000 7fddebe35740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdde41aafb0 con 0x558650c219a0 2024-09-19T04:18:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.722+0000 7fdde1d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558650c27370 0x558650c1e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.722+0000 7fdde1d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558650c27370 0x558650c1e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58808/0 (socket says 172.21.15.7:58808) 2024-09-19T04:18:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.722+0000 7fdde1d9b640 1 -- 172.21.15.7:0/1722834274 learned_addr learned my addr 172.21.15.7:0/1722834274 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.723+0000 7fdde1d9b640 1 --2- 172.21.15.7:0/1722834274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558650c219a0 0x558650c2b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.723+0000 7fdde1d9b640 1 -- 172.21.15.7:0/1722834274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558650c219a0 msgr2=0x558650c2b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.723+0000 7fdde1d9b640 1 --2- 172.21.15.7:0/1722834274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558650c219a0 0x558650c2b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.723+0000 7fdde1d9b640 1 -- 172.21.15.7:0/1722834274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558650c222e0 msgr2=0x558650c1e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.723+0000 7fdde259c640 1 --2- 172.21.15.7:0/1722834274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558650c222e0 0x558650c1e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.723+0000 7fdde1d9b640 1 --2- 172.21.15.7:0/1722834274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558650c222e0 0x558650c1e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.723+0000 7fdde1d9b640 1 -- 172.21.15.7:0/1722834274 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558650c2a220 con 0x558650c27370 2024-09-19T04:18:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.723+0000 7fdde1d9b640 1 --2- 172.21.15.7:0/1722834274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558650c27370 0x558650c1e940 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fddd8032fd0 tx=0x7fddd8040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a5fd06a076c04a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.723+0000 7fddcbfff640 1 -- 172.21.15.7:0/1722834274 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd8035040 con 0x558650c27370 2024-09-19T04:18:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.723+0000 7fddcbfff640 1 -- 172.21.15.7:0/1722834274 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddd8005500 con 0x558650c27370 2024-09-19T04:18:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.723+0000 7fddcbfff640 1 -- 172.21.15.7:0/1722834274 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd80035f0 con 0x558650c27370 2024-09-19T04:18:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.724+0000 7fddebe35740 1 -- 172.21.15.7:0/1722834274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558650c27370 msgr2=0x558650c1e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.724+0000 7fddebe35740 1 --2- 172.21.15.7:0/1722834274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558650c27370 0x558650c1e940 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fddd8032fd0 tx=0x7fddd8040040 comp rx=0 tx=0).stop 2024-09-19T04:18:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.724+0000 7fddebe35740 1 -- 172.21.15.7:0/1722834274 shutdown_connections 2024-09-19T04:18:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.724+0000 7fddebe35740 1 --2- 172.21.15.7:0/1722834274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558650c27370 0x558650c1e940 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.724+0000 7fddebe35740 1 --2- 172.21.15.7:0/1722834274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558650c222e0 0x558650c1e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.724+0000 7fddebe35740 1 --2- 172.21.15.7:0/1722834274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558650c219a0 0x558650c2b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.724+0000 7fddebe35740 1 -- 172.21.15.7:0/1722834274 >> 172.21.15.7:0/1722834274 conn(0x558650c1d010 msgr2=0x558650c1c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:42.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.724+0000 7fddebe35740 1 -- 172.21.15.7:0/1722834274 shutdown_connections 2024-09-19T04:18:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.724+0000 7fddebe35740 1 -- 172.21.15.7:0/1722834274 wait complete. 2024-09-19T04:18:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.724+0000 7fddebe35740 1 -- start start 2024-09-19T04:18:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.724+0000 7fddebe35740 1 Processor -- start 2024-09-19T04:18:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.724+0000 7fddebe35740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558650c219a0 0x558650c9d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.724+0000 7fddebe35740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558650c222e0 0x558650c9dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.724+0000 7fddebe35740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558650c27370 0x558650ca4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.724+0000 7fddebe35740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdde41abd50 con 0x558650c222e0 2024-09-19T04:18:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.724+0000 7fddebe35740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdde41ab680 con 0x558650c219a0 2024-09-19T04:18:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.724+0000 7fddebe35740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdde41a88a0 con 0x558650c27370 2024-09-19T04:18:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.724+0000 7fddebe35740 10 client.0 _ll_register_callbacks cb 0x7fddd8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:18:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.724+0000 7fdde259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558650c222e0 0x558650c9dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.724+0000 7fdde259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558650c222e0 0x558650c9dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58818/0 (socket says 172.21.15.7:58818) 2024-09-19T04:18:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.724+0000 7fdde259c640 1 -- 172.21.15.7:0/345281491 learned_addr learned my addr 172.21.15.7:0/345281491 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:42.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.724+0000 7fdde1d9b640 1 --2- 172.21.15.7:0/345281491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558650c27370 0x558650ca4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:42.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.725+0000 7fdde1d9b640 1 --2- 172.21.15.7:0/345281491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558650c219a0 0x558650c9d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:42.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.725+0000 7fdde259c640 1 -- 172.21.15.7:0/345281491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558650c27370 msgr2=0x558650ca4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:42.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.725+0000 7fdde259c640 1 --2- 172.21.15.7:0/345281491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558650c27370 0x558650ca4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.725+0000 7fdde259c640 1 -- 172.21.15.7:0/345281491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558650c219a0 msgr2=0x558650c9d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:42.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.725+0000 7fdde259c640 1 --2- 172.21.15.7:0/345281491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558650c219a0 0x558650c9d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.725+0000 7fdde259c640 1 -- 172.21.15.7:0/345281491 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558650ca5350 con 0x558650c222e0 2024-09-19T04:18:42.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.725+0000 7fdde1d9b640 1 --2- 172.21.15.7:0/345281491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558650c219a0 0x558650c9d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:18:42.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.725+0000 7fdde259c640 1 --2- 172.21.15.7:0/345281491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558650c222e0 0x558650c9dd00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fddd4024cb0 tx=0x7fddd4024ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435bc5906ea11750 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:42.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.725+0000 7fddc9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:18:42.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.725+0000 7fddc9ffb640 1 -- 172.21.15.7:0/345281491 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd4037060 con 0x558650c222e0 2024-09-19T04:18:42.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.725+0000 7fddc9ffb640 1 -- 172.21.15.7:0/345281491 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fddd4005390 con 0x558650c222e0 2024-09-19T04:18:42.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.725+0000 7fddebe35740 1 -- 172.21.15.7:0/345281491 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddd8005500 con 0x558650c222e0 2024-09-19T04:18:42.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.725+0000 7fddc9ffb640 1 -- 172.21.15.7:0/345281491 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fddd403e050 con 0x558650c222e0 2024-09-19T04:18:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.725+0000 7fddebe35740 10 client.15696 fetch_fsmap learned FSMap version 28 2024-09-19T04:18:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.725+0000 7fddebe35740 1 -- 172.21.15.7:0/345281491 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558650ca6660 con 0x558650c222e0 2024-09-19T04:18:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.725+0000 7fddc9ffb640 1 -- 172.21.15.7:0/345281491 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddd8005500 con 0x558650c222e0 2024-09-19T04:18:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.726+0000 7fddc9ffb640 1 -- 172.21.15.7:0/345281491 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fddd4011440 con 0x558650c222e0 2024-09-19T04:18:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.726+0000 7fddebe35740 10 client.15696 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:18:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.726+0000 7fddebe35740 10 client.15696 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:18:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.726+0000 7fddebe35740 20 client.15696 populate_metadata read hostname 'smithi007' 2024-09-19T04:18:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.726+0000 7fddebe35740 1 --2- 172.21.15.7:0/345281491 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x558650ca6fa0 0x558650ca93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.726+0000 7fddebe35740 4 client.15696 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:18:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.726+0000 7fddebe35740 1 -- 172.21.15.7:0/345281491 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558650b8cd70 con 0x558650ca6fa0 2024-09-19T04:18:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.726+0000 7fdde1d9b640 1 --2- 172.21.15.7:0/345281491 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x558650ca6fa0 0x558650ca93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.726+0000 7fdde1d9b640 1 --2- 172.21.15.7:0/345281491 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x558650ca6fa0 0x558650ca93c0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4581b142f533d443 server_cookie=8aa2e6966f1804c1 in_seq=0 out_seq=0 2024-09-19T04:18:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.726+0000 7fddc9ffb640 10 client.15696 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.738+0000 7fddc9ffb640 1 -- 172.21.15.7:0/345281491 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558650b8cd70 con 0x558650ca6fa0 2024-09-19T04:18:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.738+0000 7fddc9ffb640 10 client.15696 handle_command_reply: tid=0 2024-09-19T04:18:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.738+0000 7fddebe35740 1 client.15696 shutdown 2024-09-19T04:18:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.738+0000 7fddebe35740 1 -- 172.21.15.7:0/345281491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558650c222e0 msgr2=0x558650c9dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.738+0000 7fddebe35740 1 --2- 172.21.15.7:0/345281491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558650c222e0 0x558650c9dd00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fddd4024cb0 tx=0x7fddd4024ce0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.738+0000 7fddebe35740 1 -- 172.21.15.7:0/345281491 shutdown_connections 2024-09-19T04:18:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.738+0000 7fddebe35740 1 --2- 172.21.15.7:0/345281491 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x558650ca6fa0 0x558650ca93c0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.738+0000 7fddebe35740 1 --2- 172.21.15.7:0/345281491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558650c27370 0x558650ca4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.738+0000 7fddebe35740 1 --2- 172.21.15.7:0/345281491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558650c222e0 0x558650c9dd00 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.738+0000 7fddc9ffb640 0 client.15696 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.738+0000 7fddebe35740 1 --2- 172.21.15.7:0/345281491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558650c219a0 0x558650c9d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.738+0000 7fddebe35740 1 -- 172.21.15.7:0/345281491 >> 172.21.15.7:0/345281491 conn(0x558650c1d010 msgr2=0x558650c1d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.739+0000 7fddebe35740 1 -- 172.21.15.7:0/345281491 shutdown_connections 2024-09-19T04:18:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.739+0000 7fddebe35740 1 -- 172.21.15.7:0/345281491 wait complete. 2024-09-19T04:18:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.739+0000 7fddebe35740 20 client.15696 trim_cache size 0 max 16384 2024-09-19T04:18:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:18:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:18:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:18:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:18:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.739+0000 7fdde8fbd640 1 -- 172.21.15.7:0/1552854464 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fddcc0a3240 msgr2=0x7fddcc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.739+0000 7fdde8fbd640 1 --2- 172.21.15.7:0/1552854464 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fddcc0a3240 0x7fddcc0a5700 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdddc00da90 tx=0x7fdddc06b950 comp rx=0 tx=0).stop 2024-09-19T04:18:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.739+0000 7fdde8fbd640 1 -- 172.21.15.7:0/1552854464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdde4107850 msgr2=0x7fdde419f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.739+0000 7fdde8fbd640 1 --2- 172.21.15.7:0/1552854464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdde4107850 0x7fdde419f520 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fdddc00dac0 tx=0x7fdddc00df80 comp rx=0 tx=0).stop 2024-09-19T04:18:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.739+0000 7fdde8fbd640 1 -- 172.21.15.7:0/1552854464 shutdown_connections 2024-09-19T04:18:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.739+0000 7fdde8fbd640 1 --2- 172.21.15.7:0/1552854464 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fddcc0a3240 0x7fddcc0a5700 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.739+0000 7fdde8fbd640 1 --2- 172.21.15.7:0/1552854464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdde4107850 0x7fdde419f520 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.739+0000 7fdde8fbd640 1 --2- 172.21.15.7:0/1552854464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdde4104f20 0x7fdde41984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.739+0000 7fdde8fbd640 1 --2- 172.21.15.7:0/1552854464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdde41025f0 0x7fdde4197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.739+0000 7fdde8fbd640 1 -- 172.21.15.7:0/1552854464 >> 172.21.15.7:0/1552854464 conn(0x7fdde40fc1f0 msgr2=0x7fdde4102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.739+0000 7fdde8fbd640 1 -- 172.21.15.7:0/1552854464 shutdown_connections 2024-09-19T04:18:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:42.739+0000 7fdde8fbd640 1 -- 172.21.15.7:0/1552854464 wait complete. 2024-09-19T04:18:42.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:42 smithi092 ceph-mon[34940]: pgmap v408: 129 pgs: 129 active+clean; 3.4 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 196 KiB/s wr, 42 op/s 2024-09-19T04:18:44.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:44 smithi007 ceph-mon[31360]: pgmap v409: 129 pgs: 129 active+clean; 3.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 198 KiB/s wr, 44 op/s 2024-09-19T04:18:44.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:44 smithi102 ceph-mon[35446]: pgmap v409: 129 pgs: 129 active+clean; 3.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 198 KiB/s wr, 44 op/s 2024-09-19T04:18:44.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:44 smithi092 ceph-mon[34940]: pgmap v409: 129 pgs: 129 active+clean; 3.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 198 KiB/s wr, 44 op/s 2024-09-19T04:18:46.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:46 smithi007 ceph-mon[31360]: pgmap v410: 129 pgs: 129 active+clean; 3.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 152 KiB/s wr, 42 op/s 2024-09-19T04:18:46.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:46 smithi102 ceph-mon[35446]: pgmap v410: 129 pgs: 129 active+clean; 3.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 152 KiB/s wr, 42 op/s 2024-09-19T04:18:46.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:46 smithi092 ceph-mon[34940]: pgmap v410: 129 pgs: 129 active+clean; 3.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 152 KiB/s wr, 42 op/s 2024-09-19T04:18:48.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:48 smithi007 ceph-mon[31360]: pgmap v411: 129 pgs: 129 active+clean; 3.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 150 KiB/s wr, 39 op/s 2024-09-19T04:18:48.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:48 smithi102 ceph-mon[35446]: pgmap v411: 129 pgs: 129 active+clean; 3.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 150 KiB/s wr, 39 op/s 2024-09-19T04:18:48.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:48 smithi092 ceph-mon[34940]: pgmap v411: 129 pgs: 129 active+clean; 3.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 150 KiB/s wr, 39 op/s 2024-09-19T04:18:50.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:50 smithi007 ceph-mon[31360]: pgmap v412: 129 pgs: 129 active+clean; 3.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 151 KiB/s wr, 44 op/s 2024-09-19T04:18:50.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:50 smithi102 ceph-mon[35446]: pgmap v412: 129 pgs: 129 active+clean; 3.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 151 KiB/s wr, 44 op/s 2024-09-19T04:18:50.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:50 smithi092 ceph-mon[34940]: pgmap v412: 129 pgs: 129 active+clean; 3.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 151 KiB/s wr, 44 op/s 2024-09-19T04:18:52.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:52 smithi007 ceph-mon[31360]: pgmap v413: 129 pgs: 129 active+clean; 3.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 KiB/s wr, 16 op/s 2024-09-19T04:18:52.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:52 smithi102 ceph-mon[35446]: pgmap v413: 129 pgs: 129 active+clean; 3.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 KiB/s wr, 16 op/s 2024-09-19T04:18:52.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:52 smithi092 ceph-mon[34940]: pgmap v413: 129 pgs: 129 active+clean; 3.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 KiB/s wr, 16 op/s 2024-09-19T04:18:52.837 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:18:53.113 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:18:53.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.641+0000 7fd5f0353640 1 -- 172.21.15.7:0/1419731372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5e8101de0 msgr2=0x7fd5e81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:53.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.641+0000 7fd5f0353640 1 --2- 172.21.15.7:0/1419731372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5e8101de0 0x7fd5e81021c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4009900 tx=0x7fd5e402a410 comp rx=0 tx=0).stop 2024-09-19T04:18:53.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.641+0000 7fd5f0353640 1 -- 172.21.15.7:0/1419731372 shutdown_connections 2024-09-19T04:18:53.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.641+0000 7fd5f0353640 1 --2- 172.21.15.7:0/1419731372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5e8106f10 0x7fd5e810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:53.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.641+0000 7fd5f0353640 1 --2- 172.21.15.7:0/1419731372 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5e8102790 0x7fd5e81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:53.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.641+0000 7fd5f0353640 1 --2- 172.21.15.7:0/1419731372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5e8101de0 0x7fd5e81021c0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.641+0000 7fd5f0353640 1 -- 172.21.15.7:0/1419731372 >> 172.21.15.7:0/1419731372 conn(0x7fd5e80fd8c0 msgr2=0x7fd5e80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.641+0000 7fd5f0353640 1 -- 172.21.15.7:0/1419731372 shutdown_connections 2024-09-19T04:18:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.641+0000 7fd5f0353640 1 -- 172.21.15.7:0/1419731372 wait complete. 2024-09-19T04:18:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.642+0000 7fd5f0353640 1 Processor -- start 2024-09-19T04:18:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.642+0000 7fd5f0353640 1 -- start start 2024-09-19T04:18:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.642+0000 7fd5f0353640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5e8101de0 0x7fd5e8198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:53.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.642+0000 7fd5f0353640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5e8102790 0x7fd5e8198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:53.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.642+0000 7fd5f0353640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5e8106f10 0x7fd5e819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:53.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.642+0000 7fd5f0353640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e8111f30 con 0x7fd5e8106f10 2024-09-19T04:18:53.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.642+0000 7fd5f0353640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e8111db0 con 0x7fd5e8101de0 2024-09-19T04:18:53.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.642+0000 7fd5f0353640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e81120b0 con 0x7fd5e8102790 2024-09-19T04:18:53.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.642+0000 7fd5ee8f0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5e8106f10 0x7fd5e819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:53.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.642+0000 7fd5ee8f0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5e8106f10 0x7fd5e819ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41404/0 (socket says 172.21.15.7:41404) 2024-09-19T04:18:53.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.642+0000 7fd5ee8f0640 1 -- 172.21.15.7:0/1570294403 learned_addr learned my addr 172.21.15.7:0/1570294403 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:53.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.642+0000 7fd5ee0ef640 1 --2- 172.21.15.7:0/1570294403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5e8101de0 0x7fd5e8198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:53.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.643+0000 7fd5ed8ee640 1 --2- 172.21.15.7:0/1570294403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5e8102790 0x7fd5e8198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:53.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.643+0000 7fd5ee8f0640 1 -- 172.21.15.7:0/1570294403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5e8102790 msgr2=0x7fd5e8198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:53.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.643+0000 7fd5ee8f0640 1 --2- 172.21.15.7:0/1570294403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5e8102790 0x7fd5e8198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:53.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.643+0000 7fd5ee8f0640 1 -- 172.21.15.7:0/1570294403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5e8101de0 msgr2=0x7fd5e8198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.643+0000 7fd5ee8f0640 1 --2- 172.21.15.7:0/1570294403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5e8101de0 0x7fd5e8198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.643+0000 7fd5ee8f0640 1 -- 172.21.15.7:0/1570294403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e819d3b0 con 0x7fd5e8106f10 2024-09-19T04:18:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.643+0000 7fd5ee8f0640 1 --2- 172.21.15.7:0/1570294403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5e8106f10 0x7fd5e819ccd0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0009fd0 tx=0x7fd5e000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.643+0000 7fd5df7fe640 1 -- 172.21.15.7:0/1570294403 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e0017070 con 0x7fd5e8106f10 2024-09-19T04:18:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.643+0000 7fd5f0353640 1 -- 172.21.15.7:0/1570294403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e819d6a0 con 0x7fd5e8106f10 2024-09-19T04:18:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.643+0000 7fd5df7fe640 1 -- 172.21.15.7:0/1570294403 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5e0003e50 con 0x7fd5e8106f10 2024-09-19T04:18:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.643+0000 7fd5df7fe640 1 -- 172.21.15.7:0/1570294403 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e00106c0 con 0x7fd5e8106f10 2024-09-19T04:18:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.643+0000 7fd5f0353640 1 -- 172.21.15.7:0/1570294403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e81a4f80 con 0x7fd5e8106f10 2024-09-19T04:18:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.644+0000 7fd5f0353640 1 -- 172.21.15.7:0/1570294403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5e81021c0 con 0x7fd5e8106f10 2024-09-19T04:18:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.645+0000 7fd5df7fe640 1 -- 172.21.15.7:0/1570294403 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fd5e0003970 con 0x7fd5e8106f10 2024-09-19T04:18:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.646+0000 7fd5df7fe640 1 --2- 172.21.15.7:0/1570294403 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd5d40a3240 0x7fd5d40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:53.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.646+0000 7fd5df7fe640 1 -- 172.21.15.7:0/1570294403 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fd5e00cf9a0 con 0x7fd5e8106f10 2024-09-19T04:18:53.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.646+0000 7fd5ee0ef640 1 --2- 172.21.15.7:0/1570294403 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd5d40a3240 0x7fd5d40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:53.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.647+0000 7fd5ee0ef640 1 --2- 172.21.15.7:0/1570294403 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd5d40a3240 0x7fd5d40a5700 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4009230 tx=0x7fd5e40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:53.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.649+0000 7fd5df7fe640 1 -- 172.21.15.7:0/1570294403 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd5e009c2f0 con 0x7fd5e8106f10 2024-09-19T04:18:53.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.863+0000 7fd5f0353640 1 -- 172.21.15.7:0/1570294403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5e8199760 con 0x7fd5e8106f10 2024-09-19T04:18:53.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.864+0000 7fd5df7fe640 1 -- 172.21.15.7:0/1570294403 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11962 (secure 0 0 0) 0x7fd5e8199760 con 0x7fd5e8106f10 2024-09-19T04:18:53.866 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:18:53.866 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":28,"btime":"2024-09-19T04:16:57:081835+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:16:56.259017+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24496,"mds_2":24482,"mds_3":24478,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24472,24478,24482,24496,24506]},"id":1}]} 2024-09-19T04:18:53.867 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 28 2024-09-19T04:18:53.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.866+0000 7fd5f0353640 1 -- 172.21.15.7:0/1570294403 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd5d40a3240 msgr2=0x7fd5d40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:53.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.866+0000 7fd5f0353640 1 --2- 172.21.15.7:0/1570294403 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd5d40a3240 0x7fd5d40a5700 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4009230 tx=0x7fd5e40058d0 comp rx=0 tx=0).stop 2024-09-19T04:18:53.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.866+0000 7fd5f0353640 1 -- 172.21.15.7:0/1570294403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5e8106f10 msgr2=0x7fd5e819ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:53.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.866+0000 7fd5f0353640 1 --2- 172.21.15.7:0/1570294403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5e8106f10 0x7fd5e819ccd0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0009fd0 tx=0x7fd5e000b260 comp rx=0 tx=0).stop 2024-09-19T04:18:53.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.866+0000 7fd5f0353640 1 -- 172.21.15.7:0/1570294403 shutdown_connections 2024-09-19T04:18:53.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.866+0000 7fd5f0353640 1 --2- 172.21.15.7:0/1570294403 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd5d40a3240 0x7fd5d40a5700 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:53.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.866+0000 7fd5f0353640 1 --2- 172.21.15.7:0/1570294403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5e8106f10 0x7fd5e819ccd0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:53.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.866+0000 7fd5f0353640 1 --2- 172.21.15.7:0/1570294403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5e8102790 0x7fd5e8198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:53.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.866+0000 7fd5f0353640 1 --2- 172.21.15.7:0/1570294403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5e8101de0 0x7fd5e8198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:53.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.866+0000 7fd5f0353640 1 -- 172.21.15.7:0/1570294403 >> 172.21.15.7:0/1570294403 conn(0x7fd5e80fd8c0 msgr2=0x7fd5e80fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:53.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.866+0000 7fd5f0353640 1 -- 172.21.15.7:0/1570294403 shutdown_connections 2024-09-19T04:18:53.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:53.866+0000 7fd5f0353640 1 -- 172.21.15.7:0/1570294403 wait complete. 2024-09-19T04:18:54.608 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:54 smithi007 ceph-mon[31360]: pgmap v414: 129 pgs: 129 active+clean; 3.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.2 KiB/s wr, 15 op/s 2024-09-19T04:18:54.609 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:54 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1570294403' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:18:54.637 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24506 quiesce db --set-id 2759e76d --release --await' 2024-09-19T04:18:54.637 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24506 quiesce db --set-id 2759e76d --release --await 2024-09-19T04:18:54.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:54 smithi102 ceph-mon[35446]: pgmap v414: 129 pgs: 129 active+clean; 3.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.2 KiB/s wr, 15 op/s 2024-09-19T04:18:54.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:54 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1570294403' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:18:54.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:54 smithi092 ceph-mon[34940]: pgmap v414: 129 pgs: 129 active+clean; 3.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.2 KiB/s wr, 15 op/s 2024-09-19T04:18:54.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:54 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1570294403' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:18:54.898 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:18:55.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.385+0000 7f00aae84640 1 -- 172.21.15.7:0/1940601697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a4106f10 msgr2=0x7f00a410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:55.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.385+0000 7f00aae84640 1 --2- 172.21.15.7:0/1940601697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a4106f10 0x7f00a410ea90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f009c009ca0 tx=0x7f009c02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.385+0000 7f00aae84640 1 -- 172.21.15.7:0/1940601697 shutdown_connections 2024-09-19T04:18:55.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.385+0000 7f00aae84640 1 --2- 172.21.15.7:0/1940601697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a4106f10 0x7f00a410ea90 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.385+0000 7f00aae84640 1 --2- 172.21.15.7:0/1940601697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00a4102790 0x7f00a41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.385+0000 7f00aae84640 1 --2- 172.21.15.7:0/1940601697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00a4101de0 0x7f00a41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.385+0000 7f00aae84640 1 -- 172.21.15.7:0/1940601697 >> 172.21.15.7:0/1940601697 conn(0x7f00a40fd8c0 msgr2=0x7f00a40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:55.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.385+0000 7f00aae84640 1 -- 172.21.15.7:0/1940601697 shutdown_connections 2024-09-19T04:18:55.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.385+0000 7f00aae84640 1 -- 172.21.15.7:0/1940601697 wait complete. 2024-09-19T04:18:55.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.385+0000 7f00aae84640 1 Processor -- start 2024-09-19T04:18:55.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.386+0000 7f00aae84640 1 -- start start 2024-09-19T04:18:55.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.386+0000 7f00aae84640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a4101de0 0x7f00a41983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.386+0000 7f00aae84640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00a4102790 0x7f00a41988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.386+0000 7f00aae84640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00a4106f10 0x7f00a419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.386+0000 7f00aae84640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f00a4111fc0 con 0x7f00a4101de0 2024-09-19T04:18:55.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.386+0000 7f00aae84640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f00a4111e40 con 0x7f00a4102790 2024-09-19T04:18:55.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.386+0000 7f00aae84640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f00a4112140 con 0x7f00a4106f10 2024-09-19T04:18:55.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.386+0000 7f00a8c20640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a4101de0 0x7f00a41983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.386+0000 7f00a8c20640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a4101de0 0x7f00a41983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41426/0 (socket says 172.21.15.7:41426) 2024-09-19T04:18:55.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.386+0000 7f00a8c20640 1 -- 172.21.15.7:0/386189318 learned_addr learned my addr 172.21.15.7:0/386189318 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:55.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.386+0000 7f00a9421640 1 --2- 172.21.15.7:0/386189318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00a4106f10 0x7f00a419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.386+0000 7f00a3fff640 1 --2- 172.21.15.7:0/386189318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00a4102790 0x7f00a41988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.386+0000 7f00a8c20640 1 -- 172.21.15.7:0/386189318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00a4106f10 msgr2=0x7f00a419cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:55.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.386+0000 7f00a8c20640 1 --2- 172.21.15.7:0/386189318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00a4106f10 0x7f00a419cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.386+0000 7f00a8c20640 1 -- 172.21.15.7:0/386189318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00a4102790 msgr2=0x7f00a41988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:55.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.386+0000 7f00a8c20640 1 --2- 172.21.15.7:0/386189318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00a4102790 0x7f00a41988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.386+0000 7f00a8c20640 1 -- 172.21.15.7:0/386189318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a419d350 con 0x7f00a4101de0 2024-09-19T04:18:55.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.386+0000 7f00a8c20640 1 --2- 172.21.15.7:0/386189318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a4101de0 0x7f00a41983a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f009800d950 tx=0x7f009800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:55.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.387+0000 7f00a1ffb640 1 -- 172.21.15.7:0/386189318 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0098017070 con 0x7f00a4101de0 2024-09-19T04:18:55.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.387+0000 7f00a1ffb640 1 -- 172.21.15.7:0/386189318 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0098009c30 con 0x7f00a4101de0 2024-09-19T04:18:55.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.387+0000 7f00aae84640 1 -- 172.21.15.7:0/386189318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00a419d640 con 0x7f00a4101de0 2024-09-19T04:18:55.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.387+0000 7f00a1ffb640 1 -- 172.21.15.7:0/386189318 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009800f6b0 con 0x7f00a4101de0 2024-09-19T04:18:55.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.387+0000 7f00aae84640 1 -- 172.21.15.7:0/386189318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00a41a4f20 con 0x7f00a4101de0 2024-09-19T04:18:55.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.389+0000 7f00a1ffb640 1 -- 172.21.15.7:0/386189318 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f00980109d0 con 0x7f00a4101de0 2024-09-19T04:18:55.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.389+0000 7f00ad25d740 1 Processor -- start 2024-09-19T04:18:55.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.389+0000 7f00ad25d740 1 -- start start 2024-09-19T04:18:55.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.390+0000 7f00ad25d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e5d6da470 0x558e5d6da850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.390+0000 7f00ad25d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e5d6dad90 0x558e5d6e5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.390+0000 7f00ad25d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e5d6e5650 0x558e5d6e7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.390+0000 7f00ad25d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558e5d63b620 con 0x558e5d6da470 2024-09-19T04:18:55.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.390+0000 7f00ad25d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558e5d5e2e50 con 0x558e5d6e5650 2024-09-19T04:18:55.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.390+0000 7f00ad25d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558e5d6375e0 con 0x558e5d6dad90 2024-09-19T04:18:55.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.390+0000 7f00a1ffb640 1 --2- 172.21.15.7:0/386189318 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f00940a32c0 0x7f00940a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.390+0000 7f00a9421640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e5d6da470 0x558e5d6da850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.390+0000 7f00a8c20640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e5d6dad90 0x558e5d6e5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.390+0000 7f00a9421640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e5d6da470 0x558e5d6da850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41432/0 (socket says 172.21.15.7:41432) 2024-09-19T04:18:55.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.390+0000 7f00a9421640 1 -- 172.21.15.7:0/2515049103 learned_addr learned my addr 172.21.15.7:0/2515049103 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:55.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.390+0000 7f00a9421640 1 --2- 172.21.15.7:0/386189318 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f00940a32c0 0x7f00940a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.390+0000 7f00a3fff640 1 --2- 172.21.15.7:0/2515049103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e5d6e5650 0x558e5d6e7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.390+0000 7f00a1ffb640 1 -- 172.21.15.7:0/386189318 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f00980cf9c0 con 0x7f00a4101de0 2024-09-19T04:18:55.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.390+0000 7f00a9421640 1 -- 172.21.15.7:0/2515049103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e5d6dad90 msgr2=0x558e5d6e5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:55.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.390+0000 7f00a9421640 1 --2- 172.21.15.7:0/2515049103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e5d6dad90 0x558e5d6e5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.390+0000 7f00a9421640 1 -- 172.21.15.7:0/2515049103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e5d6e5650 msgr2=0x558e5d6e7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:55.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.390+0000 7f00a9421640 1 --2- 172.21.15.7:0/2515049103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e5d6e5650 0x558e5d6e7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.390+0000 7f00a9421640 1 -- 172.21.15.7:0/2515049103 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e5d5d3d40 con 0x558e5d6da470 2024-09-19T04:18:55.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.390+0000 7f00a8c20640 1 --2- 172.21.15.7:0/2515049103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e5d6dad90 0x558e5d6e5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:18:55.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.390+0000 7f00a3fff640 1 --2- 172.21.15.7:0/2515049103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e5d6e5650 0x558e5d6e7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:18:55.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.391+0000 7f00a9421640 1 --2- 172.21.15.7:0/2515049103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e5d6da470 0x558e5d6da850 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f009c035000 tx=0x7f009c003c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa9ee1e09fb8f0b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:55.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.391+0000 7f00a9421640 1 --2- 172.21.15.7:0/386189318 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f00940a32c0 0x7f00940a5780 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f009c003cc0 tx=0x7f009c036000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:55.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.391+0000 7f008effd640 1 -- 172.21.15.7:0/2515049103 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c04d070 con 0x558e5d6da470 2024-09-19T04:18:55.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.391+0000 7f008effd640 1 -- 172.21.15.7:0/2515049103 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f009c036070 con 0x558e5d6da470 2024-09-19T04:18:55.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.391+0000 7f008effd640 1 -- 172.21.15.7:0/2515049103 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c02f870 con 0x558e5d6da470 2024-09-19T04:18:55.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.391+0000 7f00ad25d740 1 -- 172.21.15.7:0/2515049103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e5d6da470 msgr2=0x558e5d6da850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:55.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.391+0000 7f00ad25d740 1 --2- 172.21.15.7:0/2515049103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e5d6da470 0x558e5d6da850 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f009c035000 tx=0x7f009c003c50 comp rx=0 tx=0).stop 2024-09-19T04:18:55.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.391+0000 7f00ad25d740 1 -- 172.21.15.7:0/2515049103 shutdown_connections 2024-09-19T04:18:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.391+0000 7f00ad25d740 1 --2- 172.21.15.7:0/2515049103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e5d6e5650 0x558e5d6e7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.391+0000 7f00ad25d740 1 --2- 172.21.15.7:0/2515049103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e5d6dad90 0x558e5d6e5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.391+0000 7f00ad25d740 1 --2- 172.21.15.7:0/2515049103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e5d6da470 0x558e5d6da850 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.392+0000 7f00ad25d740 1 -- 172.21.15.7:0/2515049103 >> 172.21.15.7:0/2515049103 conn(0x558e5d6d6a00 msgr2=0x558e5d6d6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.392+0000 7f00ad25d740 1 -- 172.21.15.7:0/2515049103 shutdown_connections 2024-09-19T04:18:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.392+0000 7f00ad25d740 1 -- 172.21.15.7:0/2515049103 wait complete. 2024-09-19T04:18:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.392+0000 7f00ad25d740 1 -- start start 2024-09-19T04:18:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.392+0000 7f00ad25d740 1 Processor -- start 2024-09-19T04:18:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.392+0000 7f00ad25d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e5d6da470 0x558e5d6e25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.393+0000 7f00ad25d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e5d6dad90 0x558e5d6e2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.393+0000 7f00ad25d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e5d6e5650 0x558e5d6e3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.393+0000 7f00ad25d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558e5d6e8220 con 0x558e5d6dad90 2024-09-19T04:18:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.393+0000 7f00ad25d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558e5d5c3f10 con 0x558e5d6e5650 2024-09-19T04:18:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.393+0000 7f00ad25d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558e5d6e83a0 con 0x558e5d6da470 2024-09-19T04:18:55.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.393+0000 7f00ad25d740 10 client.0 _ll_register_callbacks cb 0x558e5d5e7db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:18:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.393+0000 7f00a3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e5d6dad90 0x558e5d6e2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.393+0000 7f00a3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e5d6dad90 0x558e5d6e2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41442/0 (socket says 172.21.15.7:41442) 2024-09-19T04:18:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.393+0000 7f00a3fff640 1 -- 172.21.15.7:0/542435242 learned_addr learned my addr 172.21.15.7:0/542435242 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.393+0000 7f00a8c20640 1 --2- 172.21.15.7:0/542435242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e5d6da470 0x558e5d6e25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.393+0000 7f00a9421640 1 --2- 172.21.15.7:0/542435242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e5d6e5650 0x558e5d6e3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.393+0000 7f00a3fff640 1 -- 172.21.15.7:0/542435242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e5d6da470 msgr2=0x558e5d6e25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.393+0000 7f00a3fff640 1 --2- 172.21.15.7:0/542435242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e5d6da470 0x558e5d6e25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.393+0000 7f00a3fff640 1 -- 172.21.15.7:0/542435242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e5d6e5650 msgr2=0x558e5d6e3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.393+0000 7f00a3fff640 1 --2- 172.21.15.7:0/542435242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e5d6e5650 0x558e5d6e3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.393+0000 7f00a3fff640 1 -- 172.21.15.7:0/542435242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e5d34a580 con 0x558e5d6dad90 2024-09-19T04:18:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.393+0000 7f00a3fff640 1 --2- 172.21.15.7:0/542435242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e5d6dad90 0x558e5d6e2b20 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f00900116f0 tx=0x7f0090011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=213796948c2029cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:55.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.393+0000 7f0083fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:18:55.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.393+0000 7f0083fff640 1 -- 172.21.15.7:0/542435242 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009000fc70 con 0x558e5d6dad90 2024-09-19T04:18:55.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.393+0000 7f0083fff640 1 -- 172.21.15.7:0/542435242 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f009000fe10 con 0x558e5d6dad90 2024-09-19T04:18:55.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.393+0000 7f00ad25d740 1 -- 172.21.15.7:0/542435242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f009c036070 con 0x558e5d6dad90 2024-09-19T04:18:55.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.394+0000 7f0083fff640 1 -- 172.21.15.7:0/542435242 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0090024050 con 0x558e5d6dad90 2024-09-19T04:18:55.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.394+0000 7f00ad25d740 10 client.15714 fetch_fsmap learned FSMap version 28 2024-09-19T04:18:55.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.394+0000 7f00ad25d740 1 -- 172.21.15.7:0/542435242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558e5d414960 con 0x558e5d6dad90 2024-09-19T04:18:55.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.394+0000 7f0083fff640 1 -- 172.21.15.7:0/542435242 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f009c036070 con 0x558e5d6dad90 2024-09-19T04:18:55.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.394+0000 7f0083fff640 1 -- 172.21.15.7:0/542435242 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f0090018030 con 0x558e5d6dad90 2024-09-19T04:18:55.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.394+0000 7f00ad25d740 10 client.15714 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:18:55.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.394+0000 7f00ad25d740 10 client.15714 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:18:55.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.394+0000 7f00ad25d740 20 client.15714 populate_metadata read hostname 'smithi007' 2024-09-19T04:18:55.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.394+0000 7f00ad25d740 1 --2- 172.21.15.7:0/542435242 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x558e5d6f5310 0x558e5d6f7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.394+0000 7f00ad25d740 4 client.15714 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:18:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.394+0000 7f00ad25d740 1 -- 172.21.15.7:0/542435242 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e5d648b90 con 0x558e5d6f5310 2024-09-19T04:18:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.394+0000 7f00a8c20640 1 --2- 172.21.15.7:0/542435242 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x558e5d6f5310 0x558e5d6f7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.395+0000 7f00a8c20640 1 --2- 172.21.15.7:0/542435242 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x558e5d6f5310 0x558e5d6f7750 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5235478e0705b3f8 server_cookie=b7dc0d944091b436 in_seq=0 out_seq=0 2024-09-19T04:18:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.395+0000 7f0083fff640 10 client.15714 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.395+0000 7f0083fff640 1 -- 172.21.15.7:0/542435242 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558e5d648b90 con 0x558e5d6f5310 2024-09-19T04:18:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.395+0000 7f0083fff640 10 client.15714 handle_command_reply: tid=0 2024-09-19T04:18:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.396+0000 7f00ad25d740 1 client.15714 shutdown 2024-09-19T04:18:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.396+0000 7f00ad25d740 1 -- 172.21.15.7:0/542435242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e5d6dad90 msgr2=0x558e5d6e2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.396+0000 7f00ad25d740 1 --2- 172.21.15.7:0/542435242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e5d6dad90 0x558e5d6e2b20 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f00900116f0 tx=0x7f0090011bb0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.396+0000 7f00ad25d740 1 -- 172.21.15.7:0/542435242 shutdown_connections 2024-09-19T04:18:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.396+0000 7f00ad25d740 1 --2- 172.21.15.7:0/542435242 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x558e5d6f5310 0x558e5d6f7750 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.396+0000 7f00ad25d740 1 --2- 172.21.15.7:0/542435242 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e5d6e5650 0x558e5d6e3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.396+0000 7f00ad25d740 1 --2- 172.21.15.7:0/542435242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e5d6dad90 0x558e5d6e2b20 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.396+0000 7f00ad25d740 1 --2- 172.21.15.7:0/542435242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e5d6da470 0x558e5d6e25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.396+0000 7f0083fff640 0 client.15714 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:55.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.396+0000 7f00ad25d740 1 -- 172.21.15.7:0/542435242 >> 172.21.15.7:0/542435242 conn(0x558e5d6d6a00 msgr2=0x558e5d6d1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:55.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.396+0000 7f00ad25d740 1 -- 172.21.15.7:0/542435242 shutdown_connections 2024-09-19T04:18:55.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.396+0000 7f00ad25d740 1 -- 172.21.15.7:0/542435242 wait complete. 2024-09-19T04:18:55.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.396+0000 7f00ad25d740 20 client.15714 trim_cache size 0 max 16384 2024-09-19T04:18:55.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.413+0000 7f00ad25d740 1 Processor -- start 2024-09-19T04:18:55.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.413+0000 7f00ad25d740 1 -- start start 2024-09-19T04:18:55.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.413+0000 7f00ad25d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e5d6da470 0x558e5d6fd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.413+0000 7f00ad25d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e5d6dad90 0x558e5d6fd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.413+0000 7f00ad25d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e5d6e5650 0x558e5d6df8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.413+0000 7f00ad25d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f00a41acc60 con 0x558e5d6e5650 2024-09-19T04:18:55.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.413+0000 7f00ad25d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f00a41ae7a0 con 0x558e5d6dad90 2024-09-19T04:18:55.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.413+0000 7f00ad25d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f00a41ad330 con 0x558e5d6da470 2024-09-19T04:18:55.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.413+0000 7f00a9421640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e5d6e5650 0x558e5d6df8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.413+0000 7f00a9421640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e5d6e5650 0x558e5d6df8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41448/0 (socket says 172.21.15.7:41448) 2024-09-19T04:18:55.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.413+0000 7f00a9421640 1 -- 172.21.15.7:0/2101273312 learned_addr learned my addr 172.21.15.7:0/2101273312 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:55.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.414+0000 7f00a3fff640 1 --2- 172.21.15.7:0/2101273312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e5d6dad90 0x558e5d6fd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.414+0000 7f00a8c20640 1 --2- 172.21.15.7:0/2101273312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e5d6da470 0x558e5d6fd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.414+0000 7f00a9421640 1 -- 172.21.15.7:0/2101273312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e5d6da470 msgr2=0x558e5d6fd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:55.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.414+0000 7f00a9421640 1 --2- 172.21.15.7:0/2101273312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e5d6da470 0x558e5d6fd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.414+0000 7f00a9421640 1 -- 172.21.15.7:0/2101273312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e5d6dad90 msgr2=0x558e5d6fd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:55.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.414+0000 7f00a9421640 1 --2- 172.21.15.7:0/2101273312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e5d6dad90 0x558e5d6fd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.414+0000 7f00a9421640 1 -- 172.21.15.7:0/2101273312 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e5d6d0bb0 con 0x558e5d6e5650 2024-09-19T04:18:55.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.414+0000 7f00a3fff640 1 --2- 172.21.15.7:0/2101273312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e5d6dad90 0x558e5d6fd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:18:55.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.414+0000 7f00a9421640 1 --2- 172.21.15.7:0/2101273312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e5d6e5650 0x558e5d6df8c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f009c0046d0 tx=0x7f009c004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9415f5938b05da94 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:55.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.414+0000 7f008e7fc640 1 -- 172.21.15.7:0/2101273312 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c046040 con 0x558e5d6e5650 2024-09-19T04:18:55.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.414+0000 7f008e7fc640 1 -- 172.21.15.7:0/2101273312 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f009c031820 con 0x558e5d6e5650 2024-09-19T04:18:55.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.414+0000 7f008e7fc640 1 -- 172.21.15.7:0/2101273312 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c04d040 con 0x558e5d6e5650 2024-09-19T04:18:55.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.415+0000 7f00ad25d740 1 -- 172.21.15.7:0/2101273312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e5d6e5650 msgr2=0x558e5d6df8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:55.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.415+0000 7f00ad25d740 1 --2- 172.21.15.7:0/2101273312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e5d6e5650 0x558e5d6df8c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f009c0046d0 tx=0x7f009c004660 comp rx=0 tx=0).stop 2024-09-19T04:18:55.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.415+0000 7f00ad25d740 1 -- 172.21.15.7:0/2101273312 shutdown_connections 2024-09-19T04:18:55.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.415+0000 7f00ad25d740 1 --2- 172.21.15.7:0/2101273312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e5d6e5650 0x558e5d6df8c0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.415+0000 7f00ad25d740 1 --2- 172.21.15.7:0/2101273312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e5d6dad90 0x558e5d6fd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.415+0000 7f00ad25d740 1 --2- 172.21.15.7:0/2101273312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e5d6da470 0x558e5d6fd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.415+0000 7f00ad25d740 1 -- 172.21.15.7:0/2101273312 >> 172.21.15.7:0/2101273312 conn(0x558e5d6d6a00 msgr2=0x558e5d6e0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:55.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.415+0000 7f00ad25d740 1 -- 172.21.15.7:0/2101273312 shutdown_connections 2024-09-19T04:18:55.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.415+0000 7f00ad25d740 1 -- 172.21.15.7:0/2101273312 wait complete. 2024-09-19T04:18:55.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.415+0000 7f00ad25d740 1 -- start start 2024-09-19T04:18:55.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.415+0000 7f00ad25d740 1 Processor -- start 2024-09-19T04:18:55.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.416+0000 7f00ad25d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e5d6da470 0x558e5d6ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.416+0000 7f00ad25d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e5d6dad90 0x558e5d6edb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.416+0000 7f00ad25d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e5d6e5650 0x558e5d6ea5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.416+0000 7f00ad25d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f00a41ae0d0 con 0x558e5d6e5650 2024-09-19T04:18:55.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.416+0000 7f00ad25d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f00a41ada00 con 0x558e5d6da470 2024-09-19T04:18:55.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.416+0000 7f00ad25d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f00a41aac20 con 0x558e5d6dad90 2024-09-19T04:18:55.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.416+0000 7f00ad25d740 10 client.0 _ll_register_callbacks cb 0x7f009000ce80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:18:55.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.416+0000 7f00a9421640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e5d6e5650 0x558e5d6ea5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.416+0000 7f00a9421640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e5d6e5650 0x558e5d6ea5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41458/0 (socket says 172.21.15.7:41458) 2024-09-19T04:18:55.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.416+0000 7f00a9421640 1 -- 172.21.15.7:0/2958226078 learned_addr learned my addr 172.21.15.7:0/2958226078 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:55.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.416+0000 7f00a8c20640 1 --2- 172.21.15.7:0/2958226078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e5d6da470 0x558e5d6ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.416+0000 7f00a3fff640 1 --2- 172.21.15.7:0/2958226078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e5d6dad90 0x558e5d6edb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.416+0000 7f00a9421640 1 -- 172.21.15.7:0/2958226078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e5d6dad90 msgr2=0x558e5d6edb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:55.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.416+0000 7f00a9421640 1 --2- 172.21.15.7:0/2958226078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e5d6dad90 0x558e5d6edb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.416+0000 7f00a9421640 1 -- 172.21.15.7:0/2958226078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e5d6da470 msgr2=0x558e5d6ed5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:55.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.416+0000 7f00a9421640 1 --2- 172.21.15.7:0/2958226078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e5d6da470 0x558e5d6ed5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.416+0000 7f00a9421640 1 -- 172.21.15.7:0/2958226078 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e5d6eab00 con 0x558e5d6e5650 2024-09-19T04:18:55.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.416+0000 7f00a3fff640 1 --2- 172.21.15.7:0/2958226078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e5d6dad90 0x558e5d6edb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:18:55.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.416+0000 7f00a9421640 1 --2- 172.21.15.7:0/2958226078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e5d6e5650 0x558e5d6ea5c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f009c031c70 tx=0x7f009c031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a412fd352521ec1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:55.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.416+0000 7f0083fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:18:55.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.417+0000 7f0083fff640 1 -- 172.21.15.7:0/2958226078 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009c04d070 con 0x558e5d6e5650 2024-09-19T04:18:55.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.417+0000 7f0083fff640 1 -- 172.21.15.7:0/2958226078 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f009c004700 con 0x558e5d6e5650 2024-09-19T04:18:55.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.417+0000 7f00ad25d740 1 -- 172.21.15.7:0/2958226078 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f009c031820 con 0x558e5d6e5650 2024-09-19T04:18:55.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.417+0000 7f0083fff640 1 -- 172.21.15.7:0/2958226078 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f009c0319d0 con 0x558e5d6e5650 2024-09-19T04:18:55.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.417+0000 7f00ad25d740 10 client.15720 fetch_fsmap learned FSMap version 28 2024-09-19T04:18:55.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.417+0000 7f00ad25d740 1 -- 172.21.15.7:0/2958226078 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558e5d760840 con 0x558e5d6e5650 2024-09-19T04:18:55.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.417+0000 7f0083fff640 1 -- 172.21.15.7:0/2958226078 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f009c031820 con 0x558e5d6e5650 2024-09-19T04:18:55.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.417+0000 7f0083fff640 1 -- 172.21.15.7:0/2958226078 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f009c0306e0 con 0x558e5d6e5650 2024-09-19T04:18:55.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.417+0000 7f00ad25d740 10 client.15720 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:18:55.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.417+0000 7f00ad25d740 10 client.15720 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:18:55.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.417+0000 7f00ad25d740 20 client.15720 populate_metadata read hostname 'smithi007' 2024-09-19T04:18:55.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.417+0000 7f00ad25d740 1 --2- 172.21.15.7:0/2958226078 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x558e5d760ac0 0x558e5d762eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.417+0000 7f00ad25d740 4 client.15720 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "2759e76d", "release": true, "await": true}] 2024-09-19T04:18:55.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.417+0000 7f00ad25d740 1 -- 172.21.15.7:0/2958226078 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "quiesce db", "set_id": "2759e76d", "release": true, "await": true}) -- 0x558e5d6430a0 con 0x558e5d760ac0 2024-09-19T04:18:55.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.418+0000 7f00a8c20640 1 --2- 172.21.15.7:0/2958226078 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x558e5d760ac0 0x558e5d762eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.418+0000 7f00a8c20640 1 --2- 172.21.15.7:0/2958226078 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x558e5d760ac0 0x558e5d762eb0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=643ba5dbff1f34a7 server_cookie=e59a5b53db5dde49 in_seq=0 out_seq=0 2024-09-19T04:18:55.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.418+0000 7f0083fff640 10 client.15720 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:55.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.424+0000 7f0083fff640 1 -- 172.21.15.7:0/2958226078 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x558e5d6430a0 con 0x558e5d760ac0 2024-09-19T04:18:55.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.424+0000 7f0083fff640 10 client.15720 handle_command_reply: tid=0 2024-09-19T04:18:55.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.424+0000 7f00ad25d740 1 client.15720 shutdown 2024-09-19T04:18:55.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.424+0000 7f00ad25d740 1 -- 172.21.15.7:0/2958226078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e5d6e5650 msgr2=0x558e5d6ea5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:55.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.424+0000 7f00ad25d740 1 --2- 172.21.15.7:0/2958226078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e5d6e5650 0x558e5d6ea5c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f009c031c70 tx=0x7f009c031ca0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.424+0000 7f00ad25d740 1 -- 172.21.15.7:0/2958226078 shutdown_connections 2024-09-19T04:18:55.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.424+0000 7f00ad25d740 1 --2- 172.21.15.7:0/2958226078 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x558e5d760ac0 0x558e5d762eb0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.424+0000 7f00ad25d740 1 --2- 172.21.15.7:0/2958226078 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e5d6e5650 0x558e5d6ea5c0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.424+0000 7f00ad25d740 1 --2- 172.21.15.7:0/2958226078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e5d6dad90 0x558e5d6edb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.424+0000 7f00ad25d740 1 --2- 172.21.15.7:0/2958226078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558e5d6da470 0x558e5d6ed5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.424+0000 7f00ad25d740 1 -- 172.21.15.7:0/2958226078 >> 172.21.15.7:0/2958226078 conn(0x558e5d6d6a00 msgr2=0x558e5d6d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:55.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.424+0000 7f0083fff640 0 client.15720 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:55.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.424+0000 7f00ad25d740 1 -- 172.21.15.7:0/2958226078 shutdown_connections 2024-09-19T04:18:55.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.424+0000 7f00ad25d740 1 -- 172.21.15.7:0/2958226078 wait complete. 2024-09-19T04:18:55.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.424+0000 7f00ad25d740 20 client.15720 trim_cache size 0 max 16384 2024-09-19T04:18:55.428 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:18:55.428 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 28, 2024-09-19T04:18:55.428 INFO:teuthology.orchestra.run.smithi007.stdout: "leader": 24506, 2024-09-19T04:18:55.428 INFO:teuthology.orchestra.run.smithi007.stdout: "set_version": 12, 2024-09-19T04:18:55.428 INFO:teuthology.orchestra.run.smithi007.stdout: "sets": { 2024-09-19T04:18:55.429 INFO:teuthology.orchestra.run.smithi007.stdout: "2759e76d": { 2024-09-19T04:18:55.429 INFO:teuthology.orchestra.run.smithi007.stdout: "version": 12, 2024-09-19T04:18:55.429 INFO:teuthology.orchestra.run.smithi007.stdout: "age_ref": 0.0, 2024-09-19T04:18:55.429 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:18:55.429 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RELEASED", 2024-09-19T04:18:55.429 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:18:55.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:18:55.429 INFO:teuthology.orchestra.run.smithi007.stdout: "timeout": 90.0, 2024-09-19T04:18:55.429 INFO:teuthology.orchestra.run.smithi007.stdout: "expiration": 140.3, 2024-09-19T04:18:55.429 INFO:teuthology.orchestra.run.smithi007.stdout: "members": { 2024-09-19T04:18:55.429 INFO:teuthology.orchestra.run.smithi007.stdout: "file:/": { 2024-09-19T04:18:55.429 INFO:teuthology.orchestra.run.smithi007.stdout: "excluded": false, 2024-09-19T04:18:55.429 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:18:55.430 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RELEASED", 2024-09-19T04:18:55.430 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:18:55.430 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:18:55.430 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:18:55.430 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:18:55.430 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:18:55.430 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:18:55.430 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:18:55.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.425+0000 7f00aae84640 1 -- 172.21.15.7:0/386189318 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f00940a32c0 msgr2=0x7f00940a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:55.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.425+0000 7f00aae84640 1 --2- 172.21.15.7:0/386189318 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f00940a32c0 0x7f00940a5780 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f009c003cc0 tx=0x7f009c036000 comp rx=0 tx=0).stop 2024-09-19T04:18:55.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.425+0000 7f00aae84640 1 -- 172.21.15.7:0/386189318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a4101de0 msgr2=0x7f00a41983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:55.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.425+0000 7f00aae84640 1 --2- 172.21.15.7:0/386189318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a4101de0 0x7f00a41983a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f009800d950 tx=0x7f009800de10 comp rx=0 tx=0).stop 2024-09-19T04:18:55.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.425+0000 7f00aae84640 1 -- 172.21.15.7:0/386189318 shutdown_connections 2024-09-19T04:18:55.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.425+0000 7f00aae84640 1 --2- 172.21.15.7:0/386189318 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f00940a32c0 0x7f00940a5780 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.425+0000 7f00aae84640 1 --2- 172.21.15.7:0/386189318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00a4106f10 0x7f00a419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.425+0000 7f00aae84640 1 --2- 172.21.15.7:0/386189318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00a4102790 0x7f00a41988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.425+0000 7f00aae84640 1 --2- 172.21.15.7:0/386189318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f00a4101de0 0x7f00a41983a0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.425+0000 7f00aae84640 1 -- 172.21.15.7:0/386189318 >> 172.21.15.7:0/386189318 conn(0x7f00a40fd8c0 msgr2=0x7f00a40febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:55.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.425+0000 7f00aae84640 1 -- 172.21.15.7:0/386189318 shutdown_connections 2024-09-19T04:18:55.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:18:55.425+0000 7f00aae84640 1 -- 172.21.15.7:0/386189318 wait complete. 2024-09-19T04:18:55.442 INFO:tasks.workunit.client.0.smithi007.stdout:checking for strftime... yes 2024-09-19T04:18:55.563 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2024-09-19T04:18:55.623 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether stat accepts an empty string... no 2024-09-19T04:18:55.679 INFO:tasks.workunit.client.0.smithi007.stdout:checking for vprintf... yes 2024-09-19T04:18:55.738 INFO:tasks.workunit.client.0.smithi007.stdout:checking for _doprnt... no 2024-09-19T04:18:55.765 INFO:tasks.workunit.client.0.smithi007.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-19T04:18:55.777 INFO:tasks.workunit.client.0.smithi007.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-19T04:18:55.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.830+0000 7f97b2add640 1 -- 172.21.15.7:0/3734779220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97ac104f90 msgr2=0x7f97ac107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:55.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.830+0000 7f97b2add640 1 --2- 172.21.15.7:0/3734779220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97ac104f90 0x7f97ac107380 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f979c009ca0 tx=0x7f979c02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.830+0000 7f97b2add640 1 -- 172.21.15.7:0/3734779220 shutdown_connections 2024-09-19T04:18:55.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.830+0000 7f97b2add640 1 --2- 172.21.15.7:0/3734779220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97ac1078c0 0x7f97ac109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.830+0000 7f97b2add640 1 --2- 172.21.15.7:0/3734779220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97ac104f90 0x7f97ac107380 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.830+0000 7f97b2add640 1 --2- 172.21.15.7:0/3734779220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97ac102660 0x7f97ac104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.830+0000 7f97b2add640 1 -- 172.21.15.7:0/3734779220 >> 172.21.15.7:0/3734779220 conn(0x7f97ac0fc1c0 msgr2=0x7f97ac0fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:55.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.830+0000 7f97b2add640 1 -- 172.21.15.7:0/3734779220 shutdown_connections 2024-09-19T04:18:55.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.830+0000 7f97b2add640 1 -- 172.21.15.7:0/3734779220 wait complete. 2024-09-19T04:18:55.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.831+0000 7f97b2add640 1 Processor -- start 2024-09-19T04:18:55.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.831+0000 7f97b2add640 1 -- start start 2024-09-19T04:18:55.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.831+0000 7f97b2add640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97ac102660 0x7f97ac197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.831+0000 7f97b2add640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97ac104f90 0x7f97ac198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.831+0000 7f97b2add640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97ac1078c0 0x7f97ac19f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.831+0000 7f97b2add640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac10d7d0 con 0x7f97ac104f90 2024-09-19T04:18:55.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.831+0000 7f97b2add640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac10d650 con 0x7f97ac1078c0 2024-09-19T04:18:55.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.831+0000 7f97b2add640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac10d950 con 0x7f97ac102660 2024-09-19T04:18:55.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.831+0000 7f97abfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97ac104f90 0x7f97ac198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.831+0000 7f97abfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97ac104f90 0x7f97ac198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41474/0 (socket says 172.21.15.7:41474) 2024-09-19T04:18:55.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.831+0000 7f97abfff640 1 -- 172.21.15.7:0/1644392074 learned_addr learned my addr 172.21.15.7:0/1644392074 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:55.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.831+0000 7f97b0879640 1 --2- 172.21.15.7:0/1644392074 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97ac102660 0x7f97ac197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.831+0000 7f97b107a640 1 --2- 172.21.15.7:0/1644392074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97ac1078c0 0x7f97ac19f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.831+0000 7f97abfff640 1 -- 172.21.15.7:0/1644392074 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97ac102660 msgr2=0x7f97ac197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:55.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.831+0000 7f97abfff640 1 --2- 172.21.15.7:0/1644392074 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97ac102660 0x7f97ac197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.831+0000 7f97abfff640 1 -- 172.21.15.7:0/1644392074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97ac1078c0 msgr2=0x7f97ac19f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:55.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.831+0000 7f97abfff640 1 --2- 172.21.15.7:0/1644392074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97ac1078c0 0x7f97ac19f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.831+0000 7f97abfff640 1 -- 172.21.15.7:0/1644392074 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97ac19fb00 con 0x7f97ac104f90 2024-09-19T04:18:55.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.831+0000 7f97b107a640 1 --2- 172.21.15.7:0/1644392074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97ac1078c0 0x7f97ac19f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:18:55.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.831+0000 7f97b0879640 1 --2- 172.21.15.7:0/1644392074 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97ac102660 0x7f97ac197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:18:55.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.831+0000 7f97abfff640 1 --2- 172.21.15.7:0/1644392074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97ac104f90 0x7f97ac198420 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f979c009bf0 tx=0x7f979c031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:55.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.832+0000 7f97a9ffb640 1 -- 172.21.15.7:0/1644392074 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c02fa20 con 0x7f97ac104f90 2024-09-19T04:18:55.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.832+0000 7f97a9ffb640 1 -- 172.21.15.7:0/1644392074 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f979c02fbc0 con 0x7f97ac104f90 2024-09-19T04:18:55.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.832+0000 7f97b2add640 1 -- 172.21.15.7:0/1644392074 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97ac19fd90 con 0x7f97ac104f90 2024-09-19T04:18:55.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.832+0000 7f97a9ffb640 1 -- 172.21.15.7:0/1644392074 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979c046750 con 0x7f97ac104f90 2024-09-19T04:18:55.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.832+0000 7f97b2add640 1 -- 172.21.15.7:0/1644392074 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97ac1a0260 con 0x7f97ac104f90 2024-09-19T04:18:55.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.835+0000 7f97b5875740 1 Processor -- start 2024-09-19T04:18:55.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.835+0000 7f97b5875740 1 -- start start 2024-09-19T04:18:55.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.835+0000 7f97a9ffb640 1 -- 172.21.15.7:0/1644392074 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f979c02fd70 con 0x7f97ac104f90 2024-09-19T04:18:55.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.835+0000 7f97b5875740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab844ae9a0 0x55ab844aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.835+0000 7f97b5875740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ab844af2e0 0x55ab844b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.835+0000 7f97b5875740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab844b4370 0x55ab844b6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.835+0000 7f97b5875740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ab844122f0 con 0x55ab844ae9a0 2024-09-19T04:18:55.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.835+0000 7f97b5875740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ab843ba270 con 0x55ab844b4370 2024-09-19T04:18:55.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.835+0000 7f97b5875740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ab8440e2b0 con 0x55ab844af2e0 2024-09-19T04:18:55.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.835+0000 7f97b107a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab844ae9a0 0x55ab844aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.835+0000 7f97b107a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab844ae9a0 0x55ab844aeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41488/0 (socket says 172.21.15.7:41488) 2024-09-19T04:18:55.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.835+0000 7f97b107a640 1 -- 172.21.15.7:0/353891762 learned_addr learned my addr 172.21.15.7:0/353891762 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:55.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.835+0000 7f97b0879640 1 --2- 172.21.15.7:0/353891762 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ab844af2e0 0x55ab844b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.835+0000 7f97abfff640 1 --2- 172.21.15.7:0/353891762 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab844b4370 0x55ab844b6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.836+0000 7f97b107a640 1 -- 172.21.15.7:0/353891762 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ab844af2e0 msgr2=0x55ab844b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:55.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.836+0000 7f97b107a640 1 --2- 172.21.15.7:0/353891762 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ab844af2e0 0x55ab844b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.836+0000 7f97b107a640 1 -- 172.21.15.7:0/353891762 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab844b4370 msgr2=0x55ab844b6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:55.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.836+0000 7f97b107a640 1 --2- 172.21.15.7:0/353891762 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab844b4370 0x55ab844b6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.836+0000 7f97b107a640 1 -- 172.21.15.7:0/353891762 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab843b9340 con 0x55ab844ae9a0 2024-09-19T04:18:55.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.836+0000 7f97b0879640 1 --2- 172.21.15.7:0/353891762 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ab844af2e0 0x55ab844b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:18:55.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.836+0000 7f97abfff640 1 --2- 172.21.15.7:0/353891762 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab844b4370 0x55ab844b6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:18:55.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.836+0000 7f97b107a640 1 --2- 172.21.15.7:0/353891762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab844ae9a0 0x55ab844aeda0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f9794009b80 tx=0x7f9794010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824a48702c8c9190 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:55.848 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.836+0000 7f97a9ffb640 1 --2- 172.21.15.7:0/1644392074 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f97980a32c0 0x7f97980a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.836+0000 7f97a2ffd640 1 -- 172.21.15.7:0/353891762 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9794004030 con 0x55ab844ae9a0 2024-09-19T04:18:55.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.836+0000 7f97a2ffd640 1 -- 172.21.15.7:0/353891762 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97940041d0 con 0x55ab844ae9a0 2024-09-19T04:18:55.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.836+0000 7f97a2ffd640 1 -- 172.21.15.7:0/353891762 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97940126b0 con 0x55ab844ae9a0 2024-09-19T04:18:55.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.836+0000 7f97b0879640 1 --2- 172.21.15.7:0/1644392074 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f97980a32c0 0x7f97980a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.836+0000 7f97a9ffb640 1 -- 172.21.15.7:0/1644392074 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f979c0f10d0 con 0x7f97ac104f90 2024-09-19T04:18:55.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.837+0000 7f97b5875740 1 -- 172.21.15.7:0/353891762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab844ae9a0 msgr2=0x55ab844aeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:55.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.837+0000 7f97b0879640 1 --2- 172.21.15.7:0/1644392074 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f97980a32c0 0x7f97980a5780 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55ab844afd10 tx=0x7f97a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:55.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.837+0000 7f97b5875740 1 --2- 172.21.15.7:0/353891762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab844ae9a0 0x55ab844aeda0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f9794009b80 tx=0x7f9794010740 comp rx=0 tx=0).stop 2024-09-19T04:18:55.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.837+0000 7f97b5875740 1 -- 172.21.15.7:0/353891762 shutdown_connections 2024-09-19T04:18:55.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.837+0000 7f97b5875740 1 --2- 172.21.15.7:0/353891762 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab844b4370 0x55ab844b6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.849 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.837+0000 7f97b5875740 1 --2- 172.21.15.7:0/353891762 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ab844af2e0 0x55ab844b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.837+0000 7f97b5875740 1 --2- 172.21.15.7:0/353891762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab844ae9a0 0x55ab844aeda0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.837+0000 7f97b5875740 1 -- 172.21.15.7:0/353891762 >> 172.21.15.7:0/353891762 conn(0x55ab844aa010 msgr2=0x55ab844aa410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:55.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.837+0000 7f97b5875740 1 -- 172.21.15.7:0/353891762 shutdown_connections 2024-09-19T04:18:55.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.837+0000 7f97b5875740 1 -- 172.21.15.7:0/353891762 wait complete. 2024-09-19T04:18:55.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.837+0000 7f97b5875740 1 -- start start 2024-09-19T04:18:55.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.837+0000 7f97b5875740 1 Processor -- start 2024-09-19T04:18:55.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.838+0000 7f97b5875740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab844ae9a0 0x55ab844b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.838+0000 7f97b5875740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ab844af2e0 0x55ab844b90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.838+0000 7f97b5875740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab844b4370 0x55ab844c00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.838+0000 7f97b5875740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ab844b7340 con 0x55ab844b4370 2024-09-19T04:18:55.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.838+0000 7f97b5875740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ab8439b290 con 0x55ab844ae9a0 2024-09-19T04:18:55.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.838+0000 7f97b5875740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ab844b74c0 con 0x55ab844af2e0 2024-09-19T04:18:55.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.838+0000 7f97b5875740 10 client.0 _ll_register_callbacks cb 0x55ab843cc140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:18:55.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.838+0000 7f97b107a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab844b4370 0x55ab844c00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.838+0000 7f97b107a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab844b4370 0x55ab844c00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41494/0 (socket says 172.21.15.7:41494) 2024-09-19T04:18:55.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.838+0000 7f97b107a640 1 -- 172.21.15.7:0/2871115574 learned_addr learned my addr 172.21.15.7:0/2871115574 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:55.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.838+0000 7f97abfff640 1 --2- 172.21.15.7:0/2871115574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ab844af2e0 0x55ab844b90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.838+0000 7f97b0879640 1 --2- 172.21.15.7:0/2871115574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab844ae9a0 0x55ab844b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.838+0000 7f97b107a640 1 -- 172.21.15.7:0/2871115574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ab844af2e0 msgr2=0x55ab844b90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:55.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.838+0000 7f97b107a640 1 --2- 172.21.15.7:0/2871115574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ab844af2e0 0x55ab844b90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.838+0000 7f97b107a640 1 -- 172.21.15.7:0/2871115574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab844ae9a0 msgr2=0x55ab844b8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:55.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.838+0000 7f97b107a640 1 --2- 172.21.15.7:0/2871115574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab844ae9a0 0x55ab844b8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.838+0000 7f97b107a640 1 -- 172.21.15.7:0/2871115574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab84125210 con 0x55ab844b4370 2024-09-19T04:18:55.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.838+0000 7f97abfff640 1 --2- 172.21.15.7:0/2871115574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ab844af2e0 0x55ab844b90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:18:55.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.838+0000 7f97b107a640 1 --2- 172.21.15.7:0/2871115574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab844b4370 0x55ab844c00f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f97940043a0 tx=0x7f97940043d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf72f3f1ca2ef49 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:55.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.838+0000 7f978bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:18:55.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.838+0000 7f978bfff640 1 -- 172.21.15.7:0/2871115574 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97940035f0 con 0x55ab844b4370 2024-09-19T04:18:55.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.838+0000 7f978bfff640 1 -- 172.21.15.7:0/2871115574 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f9794003790 con 0x55ab844b4370 2024-09-19T04:18:55.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.838+0000 7f97b5875740 1 -- 172.21.15.7:0/2871115574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97940041d0 con 0x55ab844b4370 2024-09-19T04:18:55.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.839+0000 7f978bfff640 1 -- 172.21.15.7:0/2871115574 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9794030050 con 0x55ab844b4370 2024-09-19T04:18:55.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.839+0000 7f97b5875740 10 client.15732 fetch_fsmap learned FSMap version 28 2024-09-19T04:18:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.839+0000 7f97b5875740 1 -- 172.21.15.7:0/2871115574 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ab841f1620 con 0x55ab844b4370 2024-09-19T04:18:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.839+0000 7f978bfff640 1 -- 172.21.15.7:0/2871115574 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97940041d0 con 0x55ab844b4370 2024-09-19T04:18:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.839+0000 7f978bfff640 1 -- 172.21.15.7:0/2871115574 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f979400f040 con 0x55ab844b4370 2024-09-19T04:18:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.839+0000 7f97b5875740 10 client.15732 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:18:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.839+0000 7f97b5875740 10 client.15732 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:18:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.839+0000 7f97b5875740 20 client.15732 populate_metadata read hostname 'smithi007' 2024-09-19T04:18:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.839+0000 7f97b5875740 1 --2- 172.21.15.7:0/2871115574 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55ab844c4470 0x55ab844c6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.839+0000 7f97b5875740 4 client.15732 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:18:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.839+0000 7f97b5875740 1 -- 172.21.15.7:0/2871115574 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab8441fa20 con 0x55ab844c4470 2024-09-19T04:18:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.839+0000 7f97b0879640 1 --2- 172.21.15.7:0/2871115574 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55ab844c4470 0x55ab844c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.840+0000 7f978bfff640 10 client.15732 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.840+0000 7f97b0879640 1 --2- 172.21.15.7:0/2871115574 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55ab844c4470 0x55ab844c6860 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e09b80467f9ae068 server_cookie=ef5377a8e45fd97a in_seq=0 out_seq=0 2024-09-19T04:18:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.840+0000 7f978bfff640 1 -- 172.21.15.7:0/2871115574 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ab8441fa20 con 0x55ab844c4470 2024-09-19T04:18:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.840+0000 7f978bfff640 10 client.15732 handle_command_reply: tid=0 2024-09-19T04:18:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.840+0000 7f97b5875740 1 client.15732 shutdown 2024-09-19T04:18:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.841+0000 7f97b5875740 1 -- 172.21.15.7:0/2871115574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab844b4370 msgr2=0x55ab844c00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.841+0000 7f97b5875740 1 --2- 172.21.15.7:0/2871115574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab844b4370 0x55ab844c00f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f97940043a0 tx=0x7f97940043d0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.841+0000 7f97b5875740 1 -- 172.21.15.7:0/2871115574 shutdown_connections 2024-09-19T04:18:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.841+0000 7f97b5875740 1 --2- 172.21.15.7:0/2871115574 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55ab844c4470 0x55ab844c6860 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.841+0000 7f97b5875740 1 --2- 172.21.15.7:0/2871115574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab844b4370 0x55ab844c00f0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.841+0000 7f97b5875740 1 --2- 172.21.15.7:0/2871115574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ab844af2e0 0x55ab844b90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.841+0000 7f978bfff640 0 client.15732 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.841+0000 7f97b5875740 1 --2- 172.21.15.7:0/2871115574 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab844ae9a0 0x55ab844b8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.841+0000 7f97b5875740 1 -- 172.21.15.7:0/2871115574 >> 172.21.15.7:0/2871115574 conn(0x55ab844aa010 msgr2=0x55ab844ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.841+0000 7f97b5875740 1 -- 172.21.15.7:0/2871115574 shutdown_connections 2024-09-19T04:18:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.841+0000 7f97b5875740 1 -- 172.21.15.7:0/2871115574 wait complete. 2024-09-19T04:18:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.841+0000 7f97b5875740 20 client.15732 trim_cache size 0 max 16384 2024-09-19T04:18:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.855+0000 7f97b5875740 1 Processor -- start 2024-09-19T04:18:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.855+0000 7f97b5875740 1 -- start start 2024-09-19T04:18:55.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.855+0000 7f97b5875740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab844ae9a0 0x55ab844aed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.855+0000 7f97b5875740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ab844af2e0 0x55ab844aaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.855+0000 7f97b5875740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab844b4370 0x55ab844ab400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.855+0000 7f97b5875740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac1aa910 con 0x55ab844b4370 2024-09-19T04:18:55.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.855+0000 7f97b5875740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac1ac450 con 0x55ab844ae9a0 2024-09-19T04:18:55.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.855+0000 7f97b5875740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac1aafe0 con 0x55ab844af2e0 2024-09-19T04:18:55.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.856+0000 7f97b107a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab844b4370 0x55ab844ab400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.856+0000 7f97b107a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab844b4370 0x55ab844ab400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41502/0 (socket says 172.21.15.7:41502) 2024-09-19T04:18:55.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.856+0000 7f97b107a640 1 -- 172.21.15.7:0/3903729776 learned_addr learned my addr 172.21.15.7:0/3903729776 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:55.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.856+0000 7f97b0879640 1 --2- 172.21.15.7:0/3903729776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab844ae9a0 0x55ab844aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.856+0000 7f97b107a640 1 -- 172.21.15.7:0/3903729776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ab844af2e0 msgr2=0x55ab844aaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:55.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.856+0000 7f97b107a640 1 --2- 172.21.15.7:0/3903729776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ab844af2e0 0x55ab844aaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.856+0000 7f97b107a640 1 -- 172.21.15.7:0/3903729776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab844ae9a0 msgr2=0x55ab844aed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:55.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.856+0000 7f97b107a640 1 --2- 172.21.15.7:0/3903729776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab844ae9a0 0x55ab844aed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.856+0000 7f97b107a640 1 -- 172.21.15.7:0/3903729776 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab844c6bd0 con 0x55ab844b4370 2024-09-19T04:18:55.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.856+0000 7f97b107a640 1 --2- 172.21.15.7:0/3903729776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab844b4370 0x55ab844ab400 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f97940058c0 tx=0x7f97940128d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c9e53792a861fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:55.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.856+0000 7f97a27fc640 1 -- 172.21.15.7:0/3903729776 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9794010080 con 0x55ab844b4370 2024-09-19T04:18:55.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.856+0000 7f97a27fc640 1 -- 172.21.15.7:0/3903729776 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9794003fc0 con 0x55ab844b4370 2024-09-19T04:18:55.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.856+0000 7f97a27fc640 1 -- 172.21.15.7:0/3903729776 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9794012d40 con 0x55ab844b4370 2024-09-19T04:18:55.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.857+0000 7f97b5875740 1 -- 172.21.15.7:0/3903729776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab844b4370 msgr2=0x55ab844ab400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:55.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.857+0000 7f97b5875740 1 --2- 172.21.15.7:0/3903729776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab844b4370 0x55ab844ab400 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f97940058c0 tx=0x7f97940128d0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.857+0000 7f97b5875740 1 -- 172.21.15.7:0/3903729776 shutdown_connections 2024-09-19T04:18:55.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.857+0000 7f97b5875740 1 --2- 172.21.15.7:0/3903729776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab844b4370 0x55ab844ab400 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.857+0000 7f97b5875740 1 --2- 172.21.15.7:0/3903729776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ab844af2e0 0x55ab844aaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.857+0000 7f97b5875740 1 --2- 172.21.15.7:0/3903729776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab844ae9a0 0x55ab844aed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.857+0000 7f97b5875740 1 -- 172.21.15.7:0/3903729776 >> 172.21.15.7:0/3903729776 conn(0x55ab844aa010 msgr2=0x55ab844b8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:55.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.857+0000 7f97b5875740 1 -- 172.21.15.7:0/3903729776 shutdown_connections 2024-09-19T04:18:55.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.857+0000 7f97b5875740 1 -- 172.21.15.7:0/3903729776 wait complete. 2024-09-19T04:18:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.857+0000 7f97b5875740 1 -- start start 2024-09-19T04:18:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.857+0000 7f97b5875740 1 Processor -- start 2024-09-19T04:18:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.858+0000 7f97b5875740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab844ae9a0 0x55ab84529f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.858+0000 7f97b5875740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ab844af2e0 0x55ab8452a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.858+0000 7f97b5875740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab844b4370 0x55ab845314c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.858+0000 7f97b5875740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac1abd80 con 0x55ab844b4370 2024-09-19T04:18:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.858+0000 7f97b5875740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac1ab6b0 con 0x55ab844ae9a0 2024-09-19T04:18:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.858+0000 7f97b5875740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f97ac1a88d0 con 0x55ab844af2e0 2024-09-19T04:18:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.858+0000 7f97b5875740 10 client.0 _ll_register_callbacks cb 0x7f9794009a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:18:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.858+0000 7f97b107a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab844b4370 0x55ab845314c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.858+0000 7f97b107a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab844b4370 0x55ab845314c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41512/0 (socket says 172.21.15.7:41512) 2024-09-19T04:18:55.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.858+0000 7f97b107a640 1 -- 172.21.15.7:0/2505131474 learned_addr learned my addr 172.21.15.7:0/2505131474 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:18:55.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.858+0000 7f97b0879640 1 --2- 172.21.15.7:0/2505131474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab844ae9a0 0x55ab84529f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.858+0000 7f97abfff640 1 --2- 172.21.15.7:0/2505131474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ab844af2e0 0x55ab8452a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.858+0000 7f97b107a640 1 -- 172.21.15.7:0/2505131474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ab844af2e0 msgr2=0x55ab8452a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:55.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.858+0000 7f97b107a640 1 --2- 172.21.15.7:0/2505131474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ab844af2e0 0x55ab8452a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.858+0000 7f97b107a640 1 -- 172.21.15.7:0/2505131474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab844ae9a0 msgr2=0x55ab84529f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:18:55.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.858+0000 7f97b107a640 1 --2- 172.21.15.7:0/2505131474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab844ae9a0 0x55ab84529f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.858+0000 7f97b107a640 1 -- 172.21.15.7:0/2505131474 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab84531ad0 con 0x55ab844b4370 2024-09-19T04:18:55.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.858+0000 7f97b107a640 1 --2- 172.21.15.7:0/2505131474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab844b4370 0x55ab845314c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9794009b80 tx=0x7f9794010260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83cf2ef51eed4491 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:18:55.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.858+0000 7f978bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:18:55.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.858+0000 7f978bfff640 1 -- 172.21.15.7:0/2505131474 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9794004380 con 0x55ab844b4370 2024-09-19T04:18:55.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.858+0000 7f978bfff640 1 -- 172.21.15.7:0/2505131474 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f9794012ac0 con 0x55ab844b4370 2024-09-19T04:18:55.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.858+0000 7f97b5875740 1 -- 172.21.15.7:0/2505131474 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9794003fc0 con 0x55ab844b4370 2024-09-19T04:18:55.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.858+0000 7f978bfff640 1 -- 172.21.15.7:0/2505131474 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9794045050 con 0x55ab844b4370 2024-09-19T04:18:55.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.859+0000 7f97b5875740 10 client.15738 fetch_fsmap learned FSMap version 28 2024-09-19T04:18:55.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.859+0000 7f97b5875740 1 -- 172.21.15.7:0/2505131474 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ab84532e50 con 0x55ab844b4370 2024-09-19T04:18:55.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.859+0000 7f978bfff640 1 -- 172.21.15.7:0/2505131474 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9794003fc0 con 0x55ab844b4370 2024-09-19T04:18:55.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.859+0000 7f978bfff640 1 -- 172.21.15.7:0/2505131474 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f9794004640 con 0x55ab844b4370 2024-09-19T04:18:55.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.859+0000 7f97b5875740 10 client.15738 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:18:55.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.859+0000 7f97b5875740 10 client.15738 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:18:55.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.859+0000 7f97b5875740 20 client.15738 populate_metadata read hostname 'smithi007' 2024-09-19T04:18:55.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.859+0000 7f97b5875740 1 --2- 172.21.15.7:0/2505131474 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55ab84533850 0x55ab84535c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:18:55.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.859+0000 7f97b5875740 4 client.15738 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:18:55.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.859+0000 7f97b5875740 1 -- 172.21.15.7:0/2505131474 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ab84419d70 con 0x55ab84533850 2024-09-19T04:18:55.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.859+0000 7f97b0879640 1 --2- 172.21.15.7:0/2505131474 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55ab84533850 0x55ab84535c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:18:55.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.860+0000 7f978bfff640 10 client.15738 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:55.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.860+0000 7f97b0879640 1 --2- 172.21.15.7:0/2505131474 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55ab84533850 0x55ab84535c70 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7b2fe9b920aeb40 server_cookie=24bd373071f06e81 in_seq=0 out_seq=0 2024-09-19T04:18:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.887+0000 7f978bfff640 1 -- 172.21.15.7:0/2505131474 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ab84419d70 con 0x55ab84533850 2024-09-19T04:18:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.887+0000 7f978bfff640 10 client.15738 handle_command_reply: tid=0 2024-09-19T04:18:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.887+0000 7f97b5875740 1 client.15738 shutdown 2024-09-19T04:18:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.887+0000 7f97b5875740 1 -- 172.21.15.7:0/2505131474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab844b4370 msgr2=0x55ab845314c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.887+0000 7f97b5875740 1 --2- 172.21.15.7:0/2505131474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab844b4370 0x55ab845314c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9794009b80 tx=0x7f9794010260 comp rx=0 tx=0).stop 2024-09-19T04:18:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.887+0000 7f97b5875740 1 -- 172.21.15.7:0/2505131474 shutdown_connections 2024-09-19T04:18:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.887+0000 7f97b5875740 1 --2- 172.21.15.7:0/2505131474 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55ab84533850 0x55ab84535c70 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.887+0000 7f97b5875740 1 --2- 172.21.15.7:0/2505131474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ab844b4370 0x55ab845314c0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.887+0000 7f97b5875740 1 --2- 172.21.15.7:0/2505131474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ab844af2e0 0x55ab8452a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.887+0000 7f97b5875740 1 --2- 172.21.15.7:0/2505131474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab844ae9a0 0x55ab84529f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.887+0000 7f978bfff640 0 client.15738 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:18:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.887+0000 7f97b5875740 1 -- 172.21.15.7:0/2505131474 >> 172.21.15.7:0/2505131474 conn(0x55ab844aa010 msgr2=0x55ab844a89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.887+0000 7f97b5875740 1 -- 172.21.15.7:0/2505131474 shutdown_connections 2024-09-19T04:18:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.887+0000 7f97b5875740 1 -- 172.21.15.7:0/2505131474 wait complete. 2024-09-19T04:18:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.888+0000 7f97b5875740 20 client.15738 trim_cache size 0 max 16384 2024-09-19T04:18:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:18:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:18:55.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:18:55.892 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:18:55.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.888+0000 7f97b2add640 1 -- 172.21.15.7:0/1644392074 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f97980a32c0 msgr2=0x7f97980a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:55.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.888+0000 7f97b2add640 1 --2- 172.21.15.7:0/1644392074 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f97980a32c0 0x7f97980a5780 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55ab844afd10 tx=0x7f97a4005f90 comp rx=0 tx=0).stop 2024-09-19T04:18:55.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.888+0000 7f97b2add640 1 -- 172.21.15.7:0/1644392074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97ac104f90 msgr2=0x7f97ac198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:18:55.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.888+0000 7f97b2add640 1 --2- 172.21.15.7:0/1644392074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97ac104f90 0x7f97ac198420 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f979c009bf0 tx=0x7f979c031ee0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.888+0000 7f97b2add640 1 -- 172.21.15.7:0/1644392074 shutdown_connections 2024-09-19T04:18:55.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.888+0000 7f97b2add640 1 --2- 172.21.15.7:0/1644392074 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f97980a32c0 0x7f97980a5780 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.888+0000 7f97b2add640 1 --2- 172.21.15.7:0/1644392074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97ac1078c0 0x7f97ac19f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.888+0000 7f97b2add640 1 --2- 172.21.15.7:0/1644392074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97ac104f90 0x7f97ac198420 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.888+0000 7f97b2add640 1 --2- 172.21.15.7:0/1644392074 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97ac102660 0x7f97ac197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:18:55.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.888+0000 7f97b2add640 1 -- 172.21.15.7:0/1644392074 >> 172.21.15.7:0/1644392074 conn(0x7f97ac0fc1c0 msgr2=0x7f97ac1030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:18:55.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.888+0000 7f97b2add640 1 -- 172.21.15.7:0/1644392074 shutdown_connections 2024-09-19T04:18:55.894 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:18:55.888+0000 7f97b2add640 1 -- 172.21.15.7:0/1644392074 wait complete. 2024-09-19T04:18:55.946 INFO:tasks.workunit.client.0.smithi007.stdout:checking for the pthreads library -lpthreads... no 2024-09-19T04:18:56.001 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether pthreads work without any flags... yes 2024-09-19T04:18:56.048 INFO:tasks.workunit.client.0.smithi007.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2024-09-19T04:18:56.048 INFO:tasks.workunit.client.0.smithi007.stdout:checking if more special flags are required for pthreads... no 2024-09-19T04:18:56.048 INFO:tasks.workunit.client.0.smithi007.stdout:checking for cc_r... gcc 2024-09-19T04:18:56.129 INFO:tasks.workunit.client.0.smithi007.stdout:checking for setrlimit... yes 2024-09-19T04:18:56.189 INFO:tasks.workunit.client.0.smithi007.stdout:checking for setproctitle... no 2024-09-19T04:18:56.245 INFO:tasks.workunit.client.0.smithi007.stdout:checking for getopt_long... yes 2024-09-19T04:18:56.304 INFO:tasks.workunit.client.0.smithi007.stdout:checking for strtoull... yes 2024-09-19T04:18:56.365 INFO:tasks.workunit.client.0.smithi007.stdout:checking for strtoq... yes 2024-09-19T04:18:56.426 INFO:tasks.workunit.client.0.smithi007.stdout:checking for snprintf... yes 2024-09-19T04:18:56.505 INFO:tasks.workunit.client.0.smithi007.stdout:checking for vsnprintf... yes 2024-09-19T04:18:56.546 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '2759e76d', total seconds elapsed: 24.1 2024-09-19T04:18:56.567 INFO:tasks.workunit.client.0.smithi007.stdout:checking for vfprintf... yes 2024-09-19T04:18:56.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:56 smithi007 ceph-mon[31360]: pgmap v415: 129 pgs: 129 active+clean; 3.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.0 KiB/s wr, 14 op/s 2024-09-19T04:18:56.627 INFO:tasks.workunit.client.0.smithi007.stdout:checking for gethostname... yes 2024-09-19T04:18:56.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:56 smithi102 ceph-mon[35446]: pgmap v415: 129 pgs: 129 active+clean; 3.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.0 KiB/s wr, 14 op/s 2024-09-19T04:18:56.687 INFO:tasks.workunit.client.0.smithi007.stdout:checking for setlocale... yes 2024-09-19T04:18:56.746 INFO:tasks.workunit.client.0.smithi007.stdout:checking for sync... yes 2024-09-19T04:18:56.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:56 smithi092 ceph-mon[34940]: pgmap v415: 129 pgs: 129 active+clean; 3.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.0 KiB/s wr, 14 op/s 2024-09-19T04:18:56.809 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether snprintf is C99 conformant... done 2024-09-19T04:18:56.820 INFO:tasks.workunit.client.0.smithi007.stdout:configure: creating ./config.status 2024-09-19T04:18:56.969 INFO:tasks.workunit.client.0.smithi007.stdout:config.status: creating Makefile 2024-09-19T04:18:56.987 INFO:tasks.workunit.client.0.smithi007.stdout:config.status: creating src/Makefile 2024-09-19T04:18:57.008 INFO:tasks.workunit.client.0.smithi007.stdout:config.status: creating man/Makefile 2024-09-19T04:18:57.020 INFO:tasks.workunit.client.0.smithi007.stdout:config.status: creating config.h 2024-09-19T04:18:57.072 INFO:tasks.workunit.client.0.smithi007.stdout:config.status: executing depfiles commands 2024-09-19T04:18:57.201 INFO:tasks.workunit.client.0.smithi007.stderr:+ make 2024-09-19T04:18:57.208 INFO:tasks.workunit.client.0.smithi007.stdout:make all-recursive 2024-09-19T04:18:57.210 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-19T04:18:57.212 INFO:tasks.workunit.client.0.smithi007.stdout:Making all in src 2024-09-19T04:18:57.216 INFO:tasks.workunit.client.0.smithi007.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-09-19T04:18:57.216 INFO:tasks.workunit.client.0.smithi007.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2024-09-19T04:18:57.216 INFO:tasks.workunit.client.0.smithi007.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2024-09-19T04:18:57.311 INFO:tasks.workunit.client.0.smithi007.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2024-09-19T04:18:57.311 INFO:tasks.workunit.client.0.smithi007.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2024-09-19T04:18:57.381 INFO:tasks.workunit.client.0.smithi007.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2024-09-19T04:18:57.381 INFO:tasks.workunit.client.0.smithi007.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2024-09-19T04:18:57.434 INFO:tasks.workunit.client.0.smithi007.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2024-09-19T04:18:57.434 INFO:tasks.workunit.client.0.smithi007.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2024-09-19T04:18:57.492 INFO:tasks.workunit.client.0.smithi007.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2024-09-19T04:18:57.492 INFO:tasks.workunit.client.0.smithi007.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2024-09-19T04:18:57.545 INFO:tasks.workunit.client.0.smithi007.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2024-09-19T04:18:57.545 INFO:tasks.workunit.client.0.smithi007.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2024-09-19T04:18:57.593 INFO:tasks.workunit.client.0.smithi007.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2024-09-19T04:18:57.593 INFO:tasks.workunit.client.0.smithi007.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2024-09-19T04:18:57.673 INFO:tasks.workunit.client.0.smithi007.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2024-09-19T04:18:57.673 INFO:tasks.workunit.client.0.smithi007.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2024-09-19T04:18:57.708 INFO:tasks.workunit.client.0.smithi007.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2024-09-19T04:18:57.708 INFO:tasks.workunit.client.0.smithi007.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2024-09-19T04:18:57.743 INFO:tasks.workunit.client.0.smithi007.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2024-09-19T04:18:57.744 INFO:tasks.workunit.client.0.smithi007.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2024-09-19T04:18:57.781 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -g -O2 -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2024-09-19T04:18:57.800 INFO:tasks.workunit.client.0.smithi007.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-09-19T04:18:57.800 INFO:tasks.workunit.client.0.smithi007.stdout:Making all in man 2024-09-19T04:18:57.802 INFO:tasks.workunit.client.0.smithi007.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-09-19T04:18:57.802 INFO:tasks.workunit.client.0.smithi007.stdout:make[2]: Nothing to be done for 'all'. 2024-09-19T04:18:57.802 INFO:tasks.workunit.client.0.smithi007.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-09-19T04:18:57.803 INFO:tasks.workunit.client.0.smithi007.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-19T04:18:57.805 INFO:tasks.workunit.client.0.smithi007.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-19T04:18:57.805 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-19T04:18:57.805 INFO:tasks.workunit.client.0.smithi007.stderr:+ cd src 2024-09-19T04:18:57.806 INFO:tasks.workunit.client.0.smithi007.stderr:+ mkdir blogtest_in 2024-09-19T04:18:57.807 INFO:tasks.workunit.client.0.smithi007.stdout:running blogbench 2024-09-19T04:18:57.807 INFO:tasks.workunit.client.0.smithi007.stderr:+ echo 'running blogbench' 2024-09-19T04:18:57.807 INFO:tasks.workunit.client.0.smithi007.stderr:+ ./blogbench -d blogtest_in 2024-09-19T04:18:57.808 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-19T04:18:57.808 INFO:tasks.workunit.client.0.smithi007.stdout:Frequency = 10 secs 2024-09-19T04:18:57.808 INFO:tasks.workunit.client.0.smithi007.stdout:Scratch dir = [blogtest_in] 2024-09-19T04:18:58.154 INFO:tasks.workunit.client.0.smithi007.stdout:Spawning 3 writers... 2024-09-19T04:18:58.154 INFO:tasks.workunit.client.0.smithi007.stdout:Spawning 1 rewriters... 2024-09-19T04:18:58.155 INFO:tasks.workunit.client.0.smithi007.stdout:Spawning 5 commenters... 2024-09-19T04:18:58.155 INFO:tasks.workunit.client.0.smithi007.stdout:Spawning 100 readers... 2024-09-19T04:18:58.156 INFO:tasks.workunit.client.0.smithi007.stdout:Benchmarking for 30 iterations. 2024-09-19T04:18:58.157 INFO:tasks.workunit.client.0.smithi007.stdout:The test will run during 5 minutes. 2024-09-19T04:18:58.157 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-19T04:18:58.157 INFO:tasks.workunit.client.0.smithi007.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2024-09-19T04:18:58.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:18:58 smithi007 ceph-mon[31360]: pgmap v416: 129 pgs: 129 active+clean; 3.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.4 KiB/s wr, 9 op/s 2024-09-19T04:18:58.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:18:58 smithi102 ceph-mon[35446]: pgmap v416: 129 pgs: 129 active+clean; 3.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.4 KiB/s wr, 9 op/s 2024-09-19T04:18:58.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:18:58 smithi092 ceph-mon[34940]: pgmap v416: 129 pgs: 129 active+clean; 3.5 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.4 KiB/s wr, 9 op/s 2024-09-19T04:19:01.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:00 smithi007 ceph-mon[31360]: pgmap v417: 129 pgs: 129 active+clean; 4.8 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 133 KiB/s wr, 34 op/s 2024-09-19T04:19:01.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:00 smithi102 ceph-mon[35446]: pgmap v417: 129 pgs: 129 active+clean; 4.8 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 133 KiB/s wr, 34 op/s 2024-09-19T04:19:01.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:00 smithi092 ceph-mon[34940]: pgmap v417: 129 pgs: 129 active+clean; 4.8 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 133 KiB/s wr, 34 op/s 2024-09-19T04:19:03.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:02 smithi007 ceph-mon[31360]: pgmap v418: 129 pgs: 129 active+clean; 4.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 140 KiB/s wr, 32 op/s 2024-09-19T04:19:03.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:02 smithi102 ceph-mon[35446]: pgmap v418: 129 pgs: 129 active+clean; 4.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 140 KiB/s wr, 32 op/s 2024-09-19T04:19:03.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:02 smithi092 ceph-mon[34940]: pgmap v418: 129 pgs: 129 active+clean; 4.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 140 KiB/s wr, 32 op/s 2024-09-19T04:19:04.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:03 smithi007 ceph-mon[31360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:19:04.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:03 smithi102 ceph-mon[35446]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:19:04.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:03 smithi092 ceph-mon[34940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:19:05.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:04 smithi007 ceph-mon[31360]: pgmap v419: 129 pgs: 129 active+clean; 14 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 956 KiB/s wr, 47 op/s 2024-09-19T04:19:05.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:04 smithi102 ceph-mon[35446]: pgmap v419: 129 pgs: 129 active+clean; 14 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 956 KiB/s wr, 47 op/s 2024-09-19T04:19:05.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:04 smithi092 ceph-mon[34940]: pgmap v419: 129 pgs: 129 active+clean; 14 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 956 KiB/s wr, 47 op/s 2024-09-19T04:19:07.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:06 smithi007 ceph-mon[31360]: pgmap v420: 129 pgs: 129 active+clean; 33 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 2.6 MiB/s wr, 143 op/s 2024-09-19T04:19:07.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:06 smithi102 ceph-mon[35446]: pgmap v420: 129 pgs: 129 active+clean; 33 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 2.6 MiB/s wr, 143 op/s 2024-09-19T04:19:07.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:06 smithi092 ceph-mon[34940]: pgmap v420: 129 pgs: 129 active+clean; 33 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 2.6 MiB/s wr, 143 op/s 2024-09-19T04:19:08.157 INFO:tasks.workunit.client.0.smithi007.stdout: 13 233137 833 136784 817 101533 1394 2024-09-19T04:19:09.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.051+0000 7fd3b00af640 1 -- 172.21.15.7:0/2234762549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3a8100410 msgr2=0x7fd3a8100810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:19:09.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.051+0000 7fd3b00af640 1 --2- 172.21.15.7:0/2234762549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3a8100410 0x7fd3a8100810 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009900 tx=0x7fd3a402a410 comp rx=0 tx=0).stop 2024-09-19T04:19:09.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.051+0000 7fd3b00af640 1 -- 172.21.15.7:0/2234762549 shutdown_connections 2024-09-19T04:19:09.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.051+0000 7fd3b00af640 1 --2- 172.21.15.7:0/2234762549 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3a81016f0 0x7fd3a8101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:09.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.051+0000 7fd3b00af640 1 --2- 172.21.15.7:0/2234762549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3a8100d50 0x7fd3a81011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:09.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.051+0000 7fd3b00af640 1 --2- 172.21.15.7:0/2234762549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3a8100410 0x7fd3a8100810 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:09.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.051+0000 7fd3b00af640 1 -- 172.21.15.7:0/2234762549 >> 172.21.15.7:0/2234762549 conn(0x7fd3a80fc1c0 msgr2=0x7fd3a80fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:19:09.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.051+0000 7fd3b00af640 1 -- 172.21.15.7:0/2234762549 shutdown_connections 2024-09-19T04:19:09.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.051+0000 7fd3b00af640 1 -- 172.21.15.7:0/2234762549 wait complete. 2024-09-19T04:19:09.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.052+0000 7fd3b00af640 1 Processor -- start 2024-09-19T04:19:09.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.052+0000 7fd3b00af640 1 -- start start 2024-09-19T04:19:09.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.052+0000 7fd3b00af640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3a8100410 0x7fd3a819a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:09.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.052+0000 7fd3b00af640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3a8100d50 0x7fd3a819a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:09.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.052+0000 7fd3b00af640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3a81016f0 0x7fd3a81a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:09.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.052+0000 7fd3b00af640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a810f950 con 0x7fd3a8100410 2024-09-19T04:19:09.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.052+0000 7fd3b00af640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a810f7d0 con 0x7fd3a81016f0 2024-09-19T04:19:09.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.052+0000 7fd3b00af640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a810fad0 con 0x7fd3a8100d50 2024-09-19T04:19:09.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.052+0000 7fd3ade4b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3a8100410 0x7fd3a819a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:09.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.052+0000 7fd3ade4b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3a8100410 0x7fd3a819a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38622/0 (socket says 172.21.15.7:38622) 2024-09-19T04:19:09.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.052+0000 7fd3ade4b640 1 -- 172.21.15.7:0/3808641256 learned_addr learned my addr 172.21.15.7:0/3808641256 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:19:09.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.052+0000 7fd3ae64c640 1 --2- 172.21.15.7:0/3808641256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3a81016f0 0x7fd3a81a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:09.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.053+0000 7fd3ad64a640 1 --2- 172.21.15.7:0/3808641256 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3a8100d50 0x7fd3a819a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:09.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.053+0000 7fd3ade4b640 1 -- 172.21.15.7:0/3808641256 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3a8100d50 msgr2=0x7fd3a819a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:19:09.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.053+0000 7fd3ade4b640 1 --2- 172.21.15.7:0/3808641256 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3a8100d50 0x7fd3a819a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:09.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.053+0000 7fd3ade4b640 1 -- 172.21.15.7:0/3808641256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3a81016f0 msgr2=0x7fd3a81a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:19:09.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.053+0000 7fd3ade4b640 1 --2- 172.21.15.7:0/3808641256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3a81016f0 0x7fd3a81a15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:09.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.053+0000 7fd3ade4b640 1 -- 172.21.15.7:0/3808641256 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3a81a1c40 con 0x7fd3a8100410 2024-09-19T04:19:09.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.053+0000 7fd3ae64c640 1 --2- 172.21.15.7:0/3808641256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3a81016f0 0x7fd3a81a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:19:09.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.053+0000 7fd3ade4b640 1 --2- 172.21.15.7:0/3808641256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3a8100410 0x7fd3a819a020 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009230 tx=0x7fd3a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:19:09.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.053+0000 7fd39effd640 1 -- 172.21.15.7:0/3808641256 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a403f030 con 0x7fd3a8100410 2024-09-19T04:19:09.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.053+0000 7fd39effd640 1 -- 172.21.15.7:0/3808641256 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3a4003ce0 con 0x7fd3a8100410 2024-09-19T04:19:09.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.053+0000 7fd3b00af640 1 -- 172.21.15.7:0/3808641256 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3a81a1ed0 con 0x7fd3a8100410 2024-09-19T04:19:09.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.053+0000 7fd39effd640 1 -- 172.21.15.7:0/3808641256 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4035070 con 0x7fd3a8100410 2024-09-19T04:19:09.057 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.053+0000 7fd3b00af640 1 -- 172.21.15.7:0/3808641256 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3a81a2330 con 0x7fd3a8100410 2024-09-19T04:19:09.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.055+0000 7fd39effd640 1 -- 172.21.15.7:0/3808641256 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fd3a4042030 con 0x7fd3a8100410 2024-09-19T04:19:09.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.056+0000 7fd3b2e40740 1 Processor -- start 2024-09-19T04:19:09.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.056+0000 7fd3b2e40740 1 -- start start 2024-09-19T04:19:09.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.056+0000 7fd3b2e40740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aefc7a09a0 0x55aefc7a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:09.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.056+0000 7fd3b2e40740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aefc7a12e0 0x55aefc7a5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:09.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.056+0000 7fd3b2e40740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aefc7a6370 0x55aefc7a8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:09.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.056+0000 7fd3b2e40740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55aefc7042f0 con 0x55aefc7a12e0 2024-09-19T04:19:09.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.056+0000 7fd3b2e40740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55aefc6ac270 con 0x55aefc7a6370 2024-09-19T04:19:09.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.056+0000 7fd3b2e40740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55aefc7002b0 con 0x55aefc7a09a0 2024-09-19T04:19:09.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.056+0000 7fd3ade4b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aefc7a12e0 0x55aefc7a5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:09.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.056+0000 7fd3ad64a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aefc7a6370 0x55aefc7a8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:09.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.056+0000 7fd3ade4b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aefc7a12e0 0x55aefc7a5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38628/0 (socket says 172.21.15.7:38628) 2024-09-19T04:19:09.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.057+0000 7fd3ad64a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aefc7a6370 0x55aefc7a8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:55526/0 (socket says 172.21.15.7:55526) 2024-09-19T04:19:09.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.057+0000 7fd3ade4b640 1 -- 172.21.15.7:0/2786076651 learned_addr learned my addr 172.21.15.7:0/2786076651 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:19:09.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.057+0000 7fd3ae64c640 1 --2- 172.21.15.7:0/2786076651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aefc7a09a0 0x55aefc7a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:09.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.057+0000 7fd3ade4b640 1 -- 172.21.15.7:0/2786076651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aefc7a09a0 msgr2=0x55aefc7a0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:19:09.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.057+0000 7fd3ade4b640 1 --2- 172.21.15.7:0/2786076651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aefc7a09a0 0x55aefc7a0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:09.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.057+0000 7fd3ade4b640 1 -- 172.21.15.7:0/2786076651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aefc7a6370 msgr2=0x55aefc7a8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:19:09.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.057+0000 7fd3ade4b640 1 --2- 172.21.15.7:0/2786076651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aefc7a6370 0x55aefc7a8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:09.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.057+0000 7fd3ade4b640 1 -- 172.21.15.7:0/2786076651 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aefc6ab340 con 0x55aefc7a12e0 2024-09-19T04:19:09.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.057+0000 7fd3ad64a640 1 --2- 172.21.15.7:0/2786076651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aefc7a6370 0x55aefc7a8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:19:09.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.057+0000 7fd39effd640 1 --2- 172.21.15.7:0/3808641256 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd3940a3240 0x7fd3940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:09.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.057+0000 7fd3ade4b640 1 --2- 172.21.15.7:0/2786076651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aefc7a12e0 0x55aefc7a5da0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40f3fc0 tx=0x7fd3a40f81a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986fe5df52fc3903 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:19:09.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.057+0000 7fd3ae64c640 1 --2- 172.21.15.7:0/3808641256 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd3940a3240 0x7fd3940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:09.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.057+0000 7fd39effd640 1 -- 172.21.15.7:0/3808641256 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fd3a40efee0 con 0x7fd3a8100410 2024-09-19T04:19:09.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.057+0000 7fd393fff640 1 -- 172.21.15.7:0/2786076651 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4049070 con 0x55aefc7a12e0 2024-09-19T04:19:09.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.057+0000 7fd393fff640 1 -- 172.21.15.7:0/2786076651 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3a40bc830 con 0x55aefc7a12e0 2024-09-19T04:19:09.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.057+0000 7fd393fff640 1 -- 172.21.15.7:0/2786076651 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4081020 con 0x55aefc7a12e0 2024-09-19T04:19:09.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.058+0000 7fd3b2e40740 1 -- 172.21.15.7:0/2786076651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aefc7a12e0 msgr2=0x55aefc7a5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:19:09.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.058+0000 7fd3b2e40740 1 --2- 172.21.15.7:0/2786076651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aefc7a12e0 0x55aefc7a5da0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40f3fc0 tx=0x7fd3a40f81a0 comp rx=0 tx=0).stop 2024-09-19T04:19:09.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.058+0000 7fd3ae64c640 1 --2- 172.21.15.7:0/3808641256 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd3940a3240 0x7fd3940a5700 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0009fd0 tx=0x7fd3a0009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:19:09.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.058+0000 7fd3b2e40740 1 -- 172.21.15.7:0/2786076651 shutdown_connections 2024-09-19T04:19:09.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.058+0000 7fd3b2e40740 1 --2- 172.21.15.7:0/2786076651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aefc7a6370 0x55aefc7a8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:09.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.058+0000 7fd3b2e40740 1 --2- 172.21.15.7:0/2786076651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aefc7a12e0 0x55aefc7a5da0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:09.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.058+0000 7fd3b2e40740 1 --2- 172.21.15.7:0/2786076651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aefc7a09a0 0x55aefc7a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:09.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.058+0000 7fd3b2e40740 1 -- 172.21.15.7:0/2786076651 >> 172.21.15.7:0/2786076651 conn(0x55aefc79c010 msgr2=0x55aefc79c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:19:09.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.058+0000 7fd3b2e40740 1 -- 172.21.15.7:0/2786076651 shutdown_connections 2024-09-19T04:19:09.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.058+0000 7fd3b2e40740 1 -- 172.21.15.7:0/2786076651 wait complete. 2024-09-19T04:19:09.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.059+0000 7fd3b2e40740 1 -- start start 2024-09-19T04:19:09.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.059+0000 7fd3b2e40740 1 Processor -- start 2024-09-19T04:19:09.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.059+0000 7fd3b2e40740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aefc7a09a0 0x55aefc7aa860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:09.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.059+0000 7fd3b2e40740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aefc7a12e0 0x55aefc7aada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:09.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.059+0000 7fd3b2e40740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aefc7a6370 0x55aefc7b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:09.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.059+0000 7fd3b2e40740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55aefc7a9100 con 0x55aefc7a12e0 2024-09-19T04:19:09.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.059+0000 7fd3b2e40740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55aefc68d290 con 0x55aefc7a09a0 2024-09-19T04:19:09.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.059+0000 7fd3b2e40740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55aefc7a9280 con 0x55aefc7a6370 2024-09-19T04:19:09.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.059+0000 7fd3b2e40740 10 client.0 _ll_register_callbacks cb 0x55aefc6be140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:19:09.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.059+0000 7fd3ad64a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aefc7a12e0 0x55aefc7aada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:09.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.059+0000 7fd3ad64a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aefc7a12e0 0x55aefc7aada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38634/0 (socket says 172.21.15.7:38634) 2024-09-19T04:19:09.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.059+0000 7fd3ad64a640 1 -- 172.21.15.7:0/584326389 learned_addr learned my addr 172.21.15.7:0/584326389 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:19:09.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.059+0000 7fd3ade4b640 1 --2- 172.21.15.7:0/584326389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aefc7a09a0 0x55aefc7aa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:09.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.059+0000 7fd3ae64c640 1 --2- 172.21.15.7:0/584326389 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aefc7a6370 0x55aefc7b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:09.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.059+0000 7fd3ad64a640 1 -- 172.21.15.7:0/584326389 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aefc7a6370 msgr2=0x55aefc7b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:19:09.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.059+0000 7fd3ad64a640 1 --2- 172.21.15.7:0/584326389 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aefc7a6370 0x55aefc7b1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:09.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.059+0000 7fd3ad64a640 1 -- 172.21.15.7:0/584326389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aefc7a09a0 msgr2=0x55aefc7aa860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:19:09.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.059+0000 7fd3ad64a640 1 --2- 172.21.15.7:0/584326389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aefc7a09a0 0x55aefc7aa860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:09.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.059+0000 7fd3ad64a640 1 -- 172.21.15.7:0/584326389 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aefc417210 con 0x55aefc7a12e0 2024-09-19T04:19:09.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.059+0000 7fd3ae64c640 1 --2- 172.21.15.7:0/584326389 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aefc7a6370 0x55aefc7b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:19:09.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.060+0000 7fd3ad64a640 1 --2- 172.21.15.7:0/584326389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aefc7a12e0 0x55aefc7aada0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd398012700 tx=0x7fd398012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e934c2f5e907fe75 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:19:09.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.060+0000 7fd3917fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:19:09.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.060+0000 7fd3917fa640 1 -- 172.21.15.7:0/584326389 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd398011bb0 con 0x55aefc7a12e0 2024-09-19T04:19:09.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.060+0000 7fd3917fa640 1 -- 172.21.15.7:0/584326389 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fd398011d50 con 0x55aefc7a12e0 2024-09-19T04:19:09.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.060+0000 7fd3b2e40740 1 -- 172.21.15.7:0/584326389 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3a40bc830 con 0x55aefc7a12e0 2024-09-19T04:19:09.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.060+0000 7fd3917fa640 1 -- 172.21.15.7:0/584326389 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd39800f460 con 0x55aefc7a12e0 2024-09-19T04:19:09.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.060+0000 7fd3b2e40740 10 client.15750 fetch_fsmap learned FSMap version 29 2024-09-19T04:19:09.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.060+0000 7fd3b2e40740 1 -- 172.21.15.7:0/584326389 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55aefc4e3620 con 0x55aefc7a12e0 2024-09-19T04:19:09.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.060+0000 7fd3917fa640 1 -- 172.21.15.7:0/584326389 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3a40bc830 con 0x55aefc7a12e0 2024-09-19T04:19:09.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.060+0000 7fd3917fa640 1 -- 172.21.15.7:0/584326389 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 29) ==== 8374+0+0 (secure 0 0 0) 0x7fd39801c780 con 0x55aefc7a12e0 2024-09-19T04:19:09.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.060+0000 7fd3b2e40740 10 client.15750 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T04:19:09.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.061+0000 7fd3b2e40740 10 client.15750 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:19:09.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.061+0000 7fd3b2e40740 20 client.15750 populate_metadata read hostname 'smithi007' 2024-09-19T04:19:09.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.061+0000 7fd3b2e40740 1 --2- 172.21.15.7:0/584326389 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55aefc7b65a0 0x55aefc7b8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:09.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.061+0000 7fd3b2e40740 4 client.15750 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:19:09.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.061+0000 7fd3b2e40740 1 -- 172.21.15.7:0/584326389 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aefc711a20 con 0x55aefc7b65a0 2024-09-19T04:19:09.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.061+0000 7fd3ade4b640 1 --2- 172.21.15.7:0/584326389 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55aefc7b65a0 0x55aefc7b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:09.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.061+0000 7fd3917fa640 10 client.15750 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:19:09.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.061+0000 7fd3ade4b640 1 --2- 172.21.15.7:0/584326389 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55aefc7b65a0 0x55aefc7b8990 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39e18b6ba58b4fe4 server_cookie=72f5fdbb1bf3c738 in_seq=0 out_seq=0 2024-09-19T04:19:09.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.064+0000 7fd3917fa640 1 -- 172.21.15.7:0/584326389 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aefc711a20 con 0x55aefc7b65a0 2024-09-19T04:19:09.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.064+0000 7fd3917fa640 10 client.15750 handle_command_reply: tid=0 2024-09-19T04:19:09.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.065+0000 7fd3b2e40740 1 client.15750 shutdown 2024-09-19T04:19:09.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.065+0000 7fd3b2e40740 1 -- 172.21.15.7:0/584326389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aefc7a12e0 msgr2=0x55aefc7aada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:19:09.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.065+0000 7fd3b2e40740 1 --2- 172.21.15.7:0/584326389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aefc7a12e0 0x55aefc7aada0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd398012700 tx=0x7fd398012bc0 comp rx=0 tx=0).stop 2024-09-19T04:19:09.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.065+0000 7fd3b2e40740 1 -- 172.21.15.7:0/584326389 shutdown_connections 2024-09-19T04:19:09.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.065+0000 7fd3b2e40740 1 --2- 172.21.15.7:0/584326389 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55aefc7b65a0 0x55aefc7b8990 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:09.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.065+0000 7fd3b2e40740 1 --2- 172.21.15.7:0/584326389 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aefc7a6370 0x55aefc7b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:09.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.065+0000 7fd3917fa640 0 client.15750 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:19:09.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.065+0000 7fd3b2e40740 1 --2- 172.21.15.7:0/584326389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aefc7a12e0 0x55aefc7aada0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:09.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.065+0000 7fd3b2e40740 1 --2- 172.21.15.7:0/584326389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aefc7a09a0 0x55aefc7aa860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:09.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.065+0000 7fd3b2e40740 1 -- 172.21.15.7:0/584326389 >> 172.21.15.7:0/584326389 conn(0x55aefc79c010 msgr2=0x55aefc79d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:19:09.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.065+0000 7fd3b2e40740 1 -- 172.21.15.7:0/584326389 shutdown_connections 2024-09-19T04:19:09.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.065+0000 7fd3b2e40740 1 -- 172.21.15.7:0/584326389 wait complete. 2024-09-19T04:19:09.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.065+0000 7fd3b2e40740 20 client.15750 trim_cache size 0 max 16384 2024-09-19T04:19:09.082 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.080+0000 7fd3b2e40740 1 Processor -- start 2024-09-19T04:19:09.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.080+0000 7fd3b2e40740 1 -- start start 2024-09-19T04:19:09.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.080+0000 7fd3b2e40740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aefc7a09a0 0x55aefc7aa860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:09.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.080+0000 7fd3b2e40740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aefc7a12e0 0x55aefc7aada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:09.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.080+0000 7fd3b2e40740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aefc7a6370 0x55aefc7b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:09.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.080+0000 7fd3b2e40740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a81acb40 con 0x55aefc7a09a0 2024-09-19T04:19:09.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.080+0000 7fd3b2e40740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a81ae6b0 con 0x55aefc7a12e0 2024-09-19T04:19:09.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.080+0000 7fd3b2e40740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a81ad210 con 0x55aefc7a6370 2024-09-19T04:19:09.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.080+0000 7fd3ade4b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aefc7a09a0 0x55aefc7aa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:09.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.080+0000 7fd3ade4b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aefc7a09a0 0x55aefc7aa860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38640/0 (socket says 172.21.15.7:38640) 2024-09-19T04:19:09.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.080+0000 7fd3ade4b640 1 -- 172.21.15.7:0/1919363738 learned_addr learned my addr 172.21.15.7:0/1919363738 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:19:09.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.080+0000 7fd3ad64a640 1 --2- 172.21.15.7:0/1919363738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aefc7a12e0 0x55aefc7aada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:09.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.081+0000 7fd3ae64c640 1 --2- 172.21.15.7:0/1919363738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aefc7a6370 0x55aefc7b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:09.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.081+0000 7fd3ade4b640 1 -- 172.21.15.7:0/1919363738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aefc7a6370 msgr2=0x55aefc7b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:19:09.083 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.081+0000 7fd3ade4b640 1 --2- 172.21.15.7:0/1919363738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aefc7a6370 0x55aefc7b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:09.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.081+0000 7fd3ade4b640 1 -- 172.21.15.7:0/1919363738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aefc7a12e0 msgr2=0x55aefc7aada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:19:09.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.081+0000 7fd3ade4b640 1 --2- 172.21.15.7:0/1919363738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aefc7a12e0 0x55aefc7aada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:09.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.081+0000 7fd3ade4b640 1 -- 172.21.15.7:0/1919363738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aefc79cca0 con 0x55aefc7a09a0 2024-09-19T04:19:09.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.081+0000 7fd3ade4b640 1 --2- 172.21.15.7:0/1919363738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aefc7a09a0 0x55aefc7aa860 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4000c00 tx=0x7fd3a40f3960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f27e4e66be2672 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:19:09.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.081+0000 7fd3937fe640 1 -- 172.21.15.7:0/1919363738 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4049040 con 0x55aefc7a09a0 2024-09-19T04:19:09.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.081+0000 7fd3937fe640 1 -- 172.21.15.7:0/1919363738 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3a40f3730 con 0x55aefc7a09a0 2024-09-19T04:19:09.084 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.081+0000 7fd3937fe640 1 -- 172.21.15.7:0/1919363738 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a40bc130 con 0x55aefc7a09a0 2024-09-19T04:19:09.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.082+0000 7fd3b2e40740 1 -- 172.21.15.7:0/1919363738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aefc7a09a0 msgr2=0x55aefc7aa860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:19:09.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.082+0000 7fd3b2e40740 1 --2- 172.21.15.7:0/1919363738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aefc7a09a0 0x55aefc7aa860 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4000c00 tx=0x7fd3a40f3960 comp rx=0 tx=0).stop 2024-09-19T04:19:09.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.082+0000 7fd3b2e40740 1 -- 172.21.15.7:0/1919363738 shutdown_connections 2024-09-19T04:19:09.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.082+0000 7fd3b2e40740 1 --2- 172.21.15.7:0/1919363738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aefc7a6370 0x55aefc7b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:09.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.082+0000 7fd3b2e40740 1 --2- 172.21.15.7:0/1919363738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aefc7a12e0 0x55aefc7aada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:09.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.082+0000 7fd3b2e40740 1 --2- 172.21.15.7:0/1919363738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aefc7a09a0 0x55aefc7aa860 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:09.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.082+0000 7fd3b2e40740 1 -- 172.21.15.7:0/1919363738 >> 172.21.15.7:0/1919363738 conn(0x55aefc79c010 msgr2=0x55aefc7a2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:19:09.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.082+0000 7fd3b2e40740 1 -- 172.21.15.7:0/1919363738 shutdown_connections 2024-09-19T04:19:09.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.082+0000 7fd3b2e40740 1 -- 172.21.15.7:0/1919363738 wait complete. 2024-09-19T04:19:09.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.082+0000 7fd3b2e40740 1 -- start start 2024-09-19T04:19:09.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.082+0000 7fd3b2e40740 1 Processor -- start 2024-09-19T04:19:09.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.083+0000 7fd3b2e40740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aefc7a09a0 0x55aefc7af240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:09.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.083+0000 7fd3b2e40740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aefc7a12e0 0x55aefc7af780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:09.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.083+0000 7fd3b2e40740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aefc7a6370 0x55aefc7b0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:09.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.083+0000 7fd3b2e40740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a81adfb0 con 0x55aefc7a6370 2024-09-19T04:19:09.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.083+0000 7fd3b2e40740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a81ad8e0 con 0x55aefc7a09a0 2024-09-19T04:19:09.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.083+0000 7fd3b2e40740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a81aab00 con 0x55aefc7a12e0 2024-09-19T04:19:09.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.083+0000 7fd3ade4b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aefc7a09a0 0x55aefc7af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:09.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.083+0000 7fd3b2e40740 10 client.0 _ll_register_callbacks cb 0x7fd3980096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:19:09.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.083+0000 7fd3ade4b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aefc7a09a0 0x55aefc7af240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:55552/0 (socket says 172.21.15.7:55552) 2024-09-19T04:19:09.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.083+0000 7fd3ade4b640 1 -- 172.21.15.7:0/2945737867 learned_addr learned my addr 172.21.15.7:0/2945737867 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:19:09.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.083+0000 7fd3ae64c640 1 --2- 172.21.15.7:0/2945737867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aefc7a6370 0x55aefc7b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:09.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.083+0000 7fd3ad64a640 1 --2- 172.21.15.7:0/2945737867 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aefc7a12e0 0x55aefc7af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:09.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.083+0000 7fd3ade4b640 1 -- 172.21.15.7:0/2945737867 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aefc7a12e0 msgr2=0x55aefc7af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:19:09.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.083+0000 7fd3ade4b640 1 --2- 172.21.15.7:0/2945737867 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aefc7a12e0 0x55aefc7af780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:09.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.083+0000 7fd3ade4b640 1 -- 172.21.15.7:0/2945737867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aefc7a6370 msgr2=0x55aefc7b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:19:09.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.083+0000 7fd3ade4b640 1 --2- 172.21.15.7:0/2945737867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aefc7a6370 0x55aefc7b0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:09.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.083+0000 7fd3ade4b640 1 -- 172.21.15.7:0/2945737867 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aefc7a1f70 con 0x55aefc7a09a0 2024-09-19T04:19:09.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.083+0000 7fd3ade4b640 1 --2- 172.21.15.7:0/2945737867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aefc7a09a0 0x55aefc7af240 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4004500 tx=0x7fd3a4009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce73f168020f6452 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:19:09.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.083+0000 7fd3917fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T04:19:09.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.083+0000 7fd3917fa640 1 -- 172.21.15.7:0/2945737867 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4049030 con 0x55aefc7a09a0 2024-09-19T04:19:09.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.083+0000 7fd3b2e40740 1 -- 172.21.15.7:0/2945737867 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3a40f3730 con 0x55aefc7a09a0 2024-09-19T04:19:09.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.084+0000 7fd3917fa640 1 -- 172.21.15.7:0/2945737867 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fd3a403b460 con 0x55aefc7a09a0 2024-09-19T04:19:09.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.084+0000 7fd3917fa640 1 -- 172.21.15.7:0/2945737867 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd3a40bbc70 con 0x55aefc7a09a0 2024-09-19T04:19:09.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.084+0000 7fd3b2e40740 10 client.25346 fetch_fsmap learned FSMap version 29 2024-09-19T04:19:09.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.084+0000 7fd3b2e40740 1 -- 172.21.15.7:0/2945737867 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55aefc7b1e70 con 0x55aefc7a09a0 2024-09-19T04:19:09.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.084+0000 7fd3917fa640 1 -- 172.21.15.7:0/2945737867 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3a40f3730 con 0x55aefc7a09a0 2024-09-19T04:19:09.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.084+0000 7fd3917fa640 1 -- 172.21.15.7:0/2945737867 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 29) ==== 8374+0+0 (secure 0 0 0) 0x7fd3a40dc0b0 con 0x55aefc7a09a0 2024-09-19T04:19:09.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.084+0000 7fd3b2e40740 10 client.25346 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T04:19:09.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.084+0000 7fd3b2e40740 10 client.25346 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:19:09.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.084+0000 7fd3b2e40740 20 client.25346 populate_metadata read hostname 'smithi007' 2024-09-19T04:19:09.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.084+0000 7fd3b2e40740 1 --2- 172.21.15.7:0/2945737867 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55aefc821540 0x55aefc823930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:09.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.084+0000 7fd3b2e40740 4 client.25346 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:19:09.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.084+0000 7fd3b2e40740 1 -- 172.21.15.7:0/2945737867 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55aefc70bd70 con 0x55aefc821540 2024-09-19T04:19:09.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.084+0000 7fd3ad64a640 1 --2- 172.21.15.7:0/2945737867 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55aefc821540 0x55aefc823930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:09.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.085+0000 7fd3917fa640 10 client.25346 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:19:09.090 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:09.085+0000 7fd3ad64a640 1 --2- 172.21.15.7:0/2945737867 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55aefc821540 0x55aefc823930 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28c0379924040a53 server_cookie=ddd2267ca8748b28 in_seq=0 out_seq=0 2024-09-19T04:19:09.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:08 smithi007 ceph-mon[31360]: pgmap v421: 129 pgs: 129 active+clean; 35 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 2.8 MiB/s wr, 153 op/s 2024-09-19T04:19:09.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:08 smithi102 ceph-mon[35446]: pgmap v421: 129 pgs: 129 active+clean; 35 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 2.8 MiB/s wr, 153 op/s 2024-09-19T04:19:09.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:08 smithi092 ceph-mon[34940]: pgmap v421: 129 pgs: 129 active+clean; 35 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 2.8 MiB/s wr, 153 op/s 2024-09-19T04:19:11.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:10 smithi007 ceph-mon[31360]: pgmap v422: 129 pgs: 129 active+clean; 55 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.8 MiB/s wr, 293 op/s 2024-09-19T04:19:11.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:10 smithi102 ceph-mon[35446]: pgmap v422: 129 pgs: 129 active+clean; 55 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.8 MiB/s wr, 293 op/s 2024-09-19T04:19:11.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:10 smithi092 ceph-mon[34940]: pgmap v422: 129 pgs: 129 active+clean; 55 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.8 MiB/s wr, 293 op/s 2024-09-19T04:19:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:12.874+0000 7fd3917fa640 1 -- 172.21.15.7:0/2945737867 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55aefc70bd70 con 0x55aefc821540 2024-09-19T04:19:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:12.874+0000 7fd3917fa640 10 client.25346 handle_command_reply: tid=0 2024-09-19T04:19:12.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:12.877+0000 7fd3b2e40740 1 client.25346 shutdown 2024-09-19T04:19:12.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:12.878+0000 7fd3b2e40740 1 -- 172.21.15.7:0/2945737867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aefc7a09a0 msgr2=0x55aefc7af240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:19:12.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:12.878+0000 7fd3b2e40740 1 --2- 172.21.15.7:0/2945737867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aefc7a09a0 0x55aefc7af240 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4004500 tx=0x7fd3a4009260 comp rx=0 tx=0).stop 2024-09-19T04:19:12.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:12.878+0000 7fd3b2e40740 1 -- 172.21.15.7:0/2945737867 shutdown_connections 2024-09-19T04:19:12.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:12.878+0000 7fd3b2e40740 1 --2- 172.21.15.7:0/2945737867 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55aefc821540 0x55aefc823930 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:12.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:12.878+0000 7fd3b2e40740 1 --2- 172.21.15.7:0/2945737867 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aefc7a6370 0x55aefc7b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:12.878+0000 7fd3b2e40740 1 --2- 172.21.15.7:0/2945737867 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aefc7a12e0 0x55aefc7af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:12.878+0000 7fd3b2e40740 1 --2- 172.21.15.7:0/2945737867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aefc7a09a0 0x55aefc7af240 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:12.878+0000 7fd3b2e40740 1 -- 172.21.15.7:0/2945737867 >> 172.21.15.7:0/2945737867 conn(0x55aefc79c010 msgr2=0x55aefc7a2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:19:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:12.878+0000 7fd3917fa640 0 client.25346 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:19:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:12.879+0000 7fd3b2e40740 1 -- 172.21.15.7:0/2945737867 shutdown_connections 2024-09-19T04:19:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:12.879+0000 7fd3b2e40740 1 -- 172.21.15.7:0/2945737867 wait complete. 2024-09-19T04:19:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:12.879+0000 7fd3b2e40740 20 client.25346 trim_cache size 0 max 16384 2024-09-19T04:19:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:19:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:19:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:19:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:19:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:12.880+0000 7fd3b00af640 1 -- 172.21.15.7:0/3808641256 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd3940a3240 msgr2=0x7fd3940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:19:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:12.880+0000 7fd3b00af640 1 --2- 172.21.15.7:0/3808641256 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd3940a3240 0x7fd3940a5700 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0009fd0 tx=0x7fd3a0009500 comp rx=0 tx=0).stop 2024-09-19T04:19:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:12.880+0000 7fd3b00af640 1 -- 172.21.15.7:0/3808641256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3a8100410 msgr2=0x7fd3a819a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:19:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:12.880+0000 7fd3b00af640 1 --2- 172.21.15.7:0/3808641256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3a8100410 0x7fd3a819a020 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009230 tx=0x7fd3a40042f0 comp rx=0 tx=0).stop 2024-09-19T04:19:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:12.880+0000 7fd3b00af640 1 -- 172.21.15.7:0/3808641256 shutdown_connections 2024-09-19T04:19:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:12.880+0000 7fd3b00af640 1 --2- 172.21.15.7:0/3808641256 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd3940a3240 0x7fd3940a5700 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:12.880+0000 7fd3b00af640 1 --2- 172.21.15.7:0/3808641256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3a81016f0 0x7fd3a81a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:12.880+0000 7fd3b00af640 1 --2- 172.21.15.7:0/3808641256 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3a8100d50 0x7fd3a819a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:12.880+0000 7fd3b00af640 1 --2- 172.21.15.7:0/3808641256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3a8100410 0x7fd3a819a020 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:12.880+0000 7fd3b00af640 1 -- 172.21.15.7:0/3808641256 >> 172.21.15.7:0/3808641256 conn(0x7fd3a80fc1c0 msgr2=0x7fd3a80fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:19:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:12.880+0000 7fd3b00af640 1 -- 172.21.15.7:0/3808641256 shutdown_connections 2024-09-19T04:19:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:12.880+0000 7fd3b00af640 1 -- 172.21.15.7:0/3808641256 wait complete. 2024-09-19T04:19:13.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:12 smithi007 ceph-mon[31360]: pgmap v423: 129 pgs: 129 active+clean; 54 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.7 MiB/s wr, 276 op/s 2024-09-19T04:19:13.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:12 smithi102 ceph-mon[35446]: pgmap v423: 129 pgs: 129 active+clean; 54 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.7 MiB/s wr, 276 op/s 2024-09-19T04:19:13.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:12 smithi092 ceph-mon[34940]: pgmap v423: 129 pgs: 129 active+clean; 54 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.7 MiB/s wr, 276 op/s 2024-09-19T04:19:15.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:14 smithi007 ceph-mon[31360]: pgmap v424: 129 pgs: 129 active+clean; 55 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.2 MiB/s wr, 569 op/s 2024-09-19T04:19:15.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:14 smithi102 ceph-mon[35446]: pgmap v424: 129 pgs: 129 active+clean; 55 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.2 MiB/s wr, 569 op/s 2024-09-19T04:19:15.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:14 smithi092 ceph-mon[34940]: pgmap v424: 129 pgs: 129 active+clean; 55 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 5.2 MiB/s wr, 569 op/s 2024-09-19T04:19:17.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:16 smithi007 ceph-mon[31360]: pgmap v425: 129 pgs: 129 active+clean; 47 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.5 MiB/s wr, 888 op/s 2024-09-19T04:19:17.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:16 smithi102 ceph-mon[35446]: pgmap v425: 129 pgs: 129 active+clean; 47 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.5 MiB/s wr, 888 op/s 2024-09-19T04:19:17.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:16 smithi092 ceph-mon[34940]: pgmap v425: 129 pgs: 129 active+clean; 47 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.5 MiB/s wr, 888 op/s 2024-09-19T04:19:18.157 INFO:tasks.workunit.client.0.smithi007.stdout: 29 885811 794 535656 756 344491 1384 2024-09-19T04:19:19.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:18 smithi102 ceph-mon[35446]: pgmap v426: 129 pgs: 129 active+clean; 47 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 844 op/s 2024-09-19T04:19:19.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:18 smithi102 ceph-mon[35446]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:19:19.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:18 smithi092 ceph-mon[34940]: pgmap v426: 129 pgs: 129 active+clean; 47 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 844 op/s 2024-09-19T04:19:19.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:18 smithi092 ceph-mon[34940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:19:19.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:18 smithi007 ceph-mon[31360]: pgmap v426: 129 pgs: 129 active+clean; 47 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 844 op/s 2024-09-19T04:19:19.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:18 smithi007 ceph-mon[31360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:19:21.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:20 smithi102 ceph-mon[35446]: pgmap v427: 129 pgs: 129 active+clean; 49 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 896 op/s 2024-09-19T04:19:21.177 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:20 smithi007 ceph-mon[31360]: pgmap v427: 129 pgs: 129 active+clean; 49 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 896 op/s 2024-09-19T04:19:21.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:20 smithi092 ceph-mon[34940]: pgmap v427: 129 pgs: 129 active+clean; 49 MiB data, 459 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 896 op/s 2024-09-19T04:19:23.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:22 smithi102 ceph-mon[35446]: pgmap v428: 129 pgs: 129 active+clean; 64 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 819 op/s 2024-09-19T04:19:23.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:22 smithi092 ceph-mon[34940]: pgmap v428: 129 pgs: 129 active+clean; 64 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 819 op/s 2024-09-19T04:19:23.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:22 smithi007 ceph-mon[31360]: pgmap v428: 129 pgs: 129 active+clean; 64 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 819 op/s 2024-09-19T04:19:24.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:23 smithi102 ceph-mon[35446]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:19:24.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:23 smithi092 ceph-mon[34940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:19:24.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:23 smithi007 ceph-mon[31360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:19:25.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:24 smithi102 ceph-mon[35446]: pgmap v429: 129 pgs: 129 active+clean; 84 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.1 MiB/s wr, 998 op/s 2024-09-19T04:19:25.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:24 smithi092 ceph-mon[34940]: pgmap v429: 129 pgs: 129 active+clean; 84 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.1 MiB/s wr, 998 op/s 2024-09-19T04:19:25.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:24 smithi007 ceph-mon[31360]: pgmap v429: 129 pgs: 129 active+clean; 84 MiB data, 511 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.1 MiB/s wr, 998 op/s 2024-09-19T04:19:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.994+0000 7f1998d6f640 1 -- 172.21.15.7:0/1091849091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1994100a40 msgr2=0x7f1994100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:19:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.994+0000 7f1998d6f640 1 --2- 172.21.15.7:0/1091849091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1994100a40 0x7f1994100e40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1984009900 tx=0x7f198402a410 comp rx=0 tx=0).stop 2024-09-19T04:19:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.994+0000 7f1998d6f640 1 -- 172.21.15.7:0/1091849091 shutdown_connections 2024-09-19T04:19:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.994+0000 7f1998d6f640 1 --2- 172.21.15.7:0/1091849091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19941025f0 0x7f1994108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.994+0000 7f1998d6f640 1 --2- 172.21.15.7:0/1091849091 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1994101c30 0x7f19941020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.994+0000 7f1998d6f640 1 --2- 172.21.15.7:0/1091849091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1994100a40 0x7f1994100e40 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.995+0000 7f1998d6f640 1 -- 172.21.15.7:0/1091849091 >> 172.21.15.7:0/1091849091 conn(0x7f19940fc1c0 msgr2=0x7f19940fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:19:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.995+0000 7f1998d6f640 1 -- 172.21.15.7:0/1091849091 shutdown_connections 2024-09-19T04:19:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.995+0000 7f1998d6f640 1 -- 172.21.15.7:0/1091849091 wait complete. 2024-09-19T04:19:25.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.995+0000 7f1998d6f640 1 Processor -- start 2024-09-19T04:19:25.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.995+0000 7f1998d6f640 1 -- start start 2024-09-19T04:19:25.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.995+0000 7f1998d6f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1994100a40 0x7f1994197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:25.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.995+0000 7f1998d6f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1994101c30 0x7f1994198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:26.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.995+0000 7f1998d6f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19941025f0 0x7f199419f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:26.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.995+0000 7f1998d6f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f199410c6a0 con 0x7f1994101c30 2024-09-19T04:19:26.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.995+0000 7f1998d6f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f199410c520 con 0x7f19941025f0 2024-09-19T04:19:26.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.995+0000 7f1998d6f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f199410c820 con 0x7f1994100a40 2024-09-19T04:19:26.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.996+0000 7f1991d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1994101c30 0x7f1994198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:26.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.996+0000 7f1992d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19941025f0 0x7f199419f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:26.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.996+0000 7f1991d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1994101c30 0x7f1994198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56094/0 (socket says 172.21.15.7:56094) 2024-09-19T04:19:26.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.996+0000 7f1991d9b640 1 -- 172.21.15.7:0/1368711450 learned_addr learned my addr 172.21.15.7:0/1368711450 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:19:26.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.996+0000 7f1992d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19941025f0 0x7f199419f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:60802/0 (socket says 172.21.15.7:60802) 2024-09-19T04:19:26.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.996+0000 7f199259c640 1 --2- 172.21.15.7:0/1368711450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1994100a40 0x7f1994197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:26.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.996+0000 7f1992d9d640 1 -- 172.21.15.7:0/1368711450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1994100a40 msgr2=0x7f1994197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:19:26.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.996+0000 7f1992d9d640 1 --2- 172.21.15.7:0/1368711450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1994100a40 0x7f1994197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.996+0000 7f1992d9d640 1 -- 172.21.15.7:0/1368711450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1994101c30 msgr2=0x7f1994198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:19:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.996+0000 7f1992d9d640 1 --2- 172.21.15.7:0/1368711450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1994101c30 0x7f1994198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.996+0000 7f1992d9d640 1 -- 172.21.15.7:0/1368711450 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f199419fb00 con 0x7f19941025f0 2024-09-19T04:19:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.996+0000 7f1991d9b640 1 --2- 172.21.15.7:0/1368711450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1994101c30 0x7f1994198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:19:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.996+0000 7f1992d9d640 1 --2- 172.21.15.7:0/1368711450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19941025f0 0x7f199419f490 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f198c00ec50 tx=0x7f198c00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:19:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.996+0000 7f198b7fe640 1 -- 172.21.15.7:0/1368711450 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c003b70 con 0x7f19941025f0 2024-09-19T04:19:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.996+0000 7f1998d6f640 1 -- 172.21.15.7:0/1368711450 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f199419fdf0 con 0x7f19941025f0 2024-09-19T04:19:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.996+0000 7f198b7fe640 1 -- 172.21.15.7:0/1368711450 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f198c003d10 con 0x7f19941025f0 2024-09-19T04:19:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.996+0000 7f198b7fe640 1 -- 172.21.15.7:0/1368711450 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c010890 con 0x7f19941025f0 2024-09-19T04:19:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.996+0000 7f1998d6f640 1 -- 172.21.15.7:0/1368711450 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19941a0260 con 0x7f19941025f0 2024-09-19T04:19:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.999+0000 7f198b7fe640 1 -- 172.21.15.7:0/1368711450 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f198c003ec0 con 0x7f19941025f0 2024-09-19T04:19:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.999+0000 7f199bbe1740 1 Processor -- start 2024-09-19T04:19:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.999+0000 7f199bbe1740 1 -- start start 2024-09-19T04:19:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.999+0000 7f199bbe1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a8fd179a0 0x564a8fd17da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.999+0000 7f199bbe1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a8fd182e0 0x564a8fd1cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.999+0000 7f199bbe1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8fd1d370 0x564a8fd1f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.999+0000 7f199bbe1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564a8fc7b2f0 con 0x564a8fd1d370 2024-09-19T04:19:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.999+0000 7f199bbe1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564a8fc23270 con 0x564a8fd182e0 2024-09-19T04:19:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.999+0000 7f199bbe1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564a8fc772b0 con 0x564a8fd179a0 2024-09-19T04:19:26.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.999+0000 7f199259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a8fd182e0 0x564a8fd1cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.999+0000 7f1991d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a8fd179a0 0x564a8fd17da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.999+0000 7f199259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a8fd182e0 0x564a8fd1cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:60818/0 (socket says 172.21.15.7:60818) 2024-09-19T04:19:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.999+0000 7f1991d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a8fd179a0 0x564a8fd17da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:32856/0 (socket says 172.21.15.7:32856) 2024-09-19T04:19:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:25.999+0000 7f199259c640 1 -- 172.21.15.7:0/3090816828 learned_addr learned my addr 172.21.15.7:0/3090816828 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:19:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.000+0000 7f198b7fe640 1 --2- 172.21.15.7:0/1368711450 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f19800a3240 0x7f19800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.000+0000 7f1991d9b640 1 --2- 172.21.15.7:0/3090816828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8fd1d370 0x564a8fd1f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.000+0000 7f1992d9d640 1 --2- 172.21.15.7:0/1368711450 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f19800a3240 0x7f19800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.000+0000 7f199259c640 1 -- 172.21.15.7:0/3090816828 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a8fd179a0 msgr2=0x564a8fd17da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:19:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.000+0000 7f199259c640 1 --2- 172.21.15.7:0/3090816828 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a8fd179a0 0x564a8fd17da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.000+0000 7f199259c640 1 -- 172.21.15.7:0/3090816828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8fd1d370 msgr2=0x564a8fd1f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:19:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.000+0000 7f199259c640 1 --2- 172.21.15.7:0/3090816828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8fd1d370 0x564a8fd1f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.000+0000 7f199259c640 1 -- 172.21.15.7:0/3090816828 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a8fc22340 con 0x564a8fd182e0 2024-09-19T04:19:26.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.000+0000 7f198b7fe640 1 -- 172.21.15.7:0/1368711450 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f198c0d0340 con 0x7f19941025f0 2024-09-19T04:19:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.000+0000 7f199259c640 1 --2- 172.21.15.7:0/3090816828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a8fd182e0 0x564a8fd1cda0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1984031440 tx=0x7f1984005e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=746a0b896a9071e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:19:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.000+0000 7f1988ff9640 1 -- 172.21.15.7:0/3090816828 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198403f070 con 0x564a8fd182e0 2024-09-19T04:19:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.000+0000 7f1992d9d640 1 --2- 172.21.15.7:0/1368711450 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f19800a3240 0x7f19800a5700 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f198c09c290 tx=0x7f198c06c200 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:19:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.000+0000 7f1988ff9640 1 -- 172.21.15.7:0/3090816828 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1984004030 con 0x564a8fd182e0 2024-09-19T04:19:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.000+0000 7f1988ff9640 1 -- 172.21.15.7:0/3090816828 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1984035070 con 0x564a8fd182e0 2024-09-19T04:19:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.001+0000 7f199bbe1740 1 -- 172.21.15.7:0/3090816828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a8fd182e0 msgr2=0x564a8fd1cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:19:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.001+0000 7f199bbe1740 1 --2- 172.21.15.7:0/3090816828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a8fd182e0 0x564a8fd1cda0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1984031440 tx=0x7f1984005e60 comp rx=0 tx=0).stop 2024-09-19T04:19:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.001+0000 7f199bbe1740 1 -- 172.21.15.7:0/3090816828 shutdown_connections 2024-09-19T04:19:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.001+0000 7f199bbe1740 1 --2- 172.21.15.7:0/3090816828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8fd1d370 0x564a8fd1f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.001+0000 7f199bbe1740 1 --2- 172.21.15.7:0/3090816828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a8fd182e0 0x564a8fd1cda0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.001+0000 7f199bbe1740 1 --2- 172.21.15.7:0/3090816828 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a8fd179a0 0x564a8fd17da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:26.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.001+0000 7f199bbe1740 1 -- 172.21.15.7:0/3090816828 >> 172.21.15.7:0/3090816828 conn(0x564a8fd13010 msgr2=0x564a8fd13410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:19:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.001+0000 7f199bbe1740 1 -- 172.21.15.7:0/3090816828 shutdown_connections 2024-09-19T04:19:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.001+0000 7f199bbe1740 1 -- 172.21.15.7:0/3090816828 wait complete. 2024-09-19T04:19:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.001+0000 7f199bbe1740 1 -- start start 2024-09-19T04:19:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.002+0000 7f199bbe1740 1 Processor -- start 2024-09-19T04:19:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.002+0000 7f199bbe1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a8fd179a0 0x564a8fd21c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.002+0000 7f199bbe1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8fd182e0 0x564a8fd22160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.002+0000 7f199bbe1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a8fd1d370 0x564a8fd29130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.002+0000 7f199bbe1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564a8fd202e0 con 0x564a8fd182e0 2024-09-19T04:19:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.002+0000 7f199bbe1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564a8fc04290 con 0x564a8fd179a0 2024-09-19T04:19:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.002+0000 7f199bbe1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564a8fd20460 con 0x564a8fd1d370 2024-09-19T04:19:26.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.002+0000 7f199bbe1740 10 client.0 _ll_register_callbacks cb 0x564a8fc35140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:19:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.002+0000 7f199259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8fd182e0 0x564a8fd22160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.002+0000 7f199259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8fd182e0 0x564a8fd22160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56112/0 (socket says 172.21.15.7:56112) 2024-09-19T04:19:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.002+0000 7f199259c640 1 -- 172.21.15.7:0/4080121513 learned_addr learned my addr 172.21.15.7:0/4080121513 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:19:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.002+0000 7f1991d9b640 1 --2- 172.21.15.7:0/4080121513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a8fd179a0 0x564a8fd21c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.002+0000 7f1991d9b640 1 --2- 172.21.15.7:0/4080121513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a8fd1d370 0x564a8fd29130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.002+0000 7f199259c640 1 -- 172.21.15.7:0/4080121513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a8fd1d370 msgr2=0x564a8fd29130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:19:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.002+0000 7f199259c640 1 --2- 172.21.15.7:0/4080121513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a8fd1d370 0x564a8fd29130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.002+0000 7f199259c640 1 -- 172.21.15.7:0/4080121513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a8fd179a0 msgr2=0x564a8fd21c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:19:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.002+0000 7f199259c640 1 --2- 172.21.15.7:0/4080121513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a8fd179a0 0x564a8fd21c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.002+0000 7f199259c640 1 -- 172.21.15.7:0/4080121513 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a8f98e210 con 0x564a8fd182e0 2024-09-19T04:19:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.003+0000 7f199259c640 1 --2- 172.21.15.7:0/4080121513 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8fd182e0 0x564a8fd22160 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f19840314e0 tx=0x7f1984009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f73abd668602a12 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:19:26.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.003+0000 7f1979ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:19:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.003+0000 7f1979ffb640 1 -- 172.21.15.7:0/4080121513 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1984035070 con 0x564a8fd182e0 2024-09-19T04:19:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.003+0000 7f1979ffb640 1 -- 172.21.15.7:0/4080121513 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f19840318b0 con 0x564a8fd182e0 2024-09-19T04:19:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.003+0000 7f199bbe1740 1 -- 172.21.15.7:0/4080121513 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1984004030 con 0x564a8fd182e0 2024-09-19T04:19:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.003+0000 7f1979ffb640 1 -- 172.21.15.7:0/4080121513 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f1984055050 con 0x564a8fd182e0 2024-09-19T04:19:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.003+0000 7f199bbe1740 10 client.15768 fetch_fsmap learned FSMap version 31 2024-09-19T04:19:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.003+0000 7f199bbe1740 1 -- 172.21.15.7:0/4080121513 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564a8fa5a620 con 0x564a8fd182e0 2024-09-19T04:19:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.003+0000 7f1979ffb640 1 -- 172.21.15.7:0/4080121513 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1984004030 con 0x564a8fd182e0 2024-09-19T04:19:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.003+0000 7f1979ffb640 1 -- 172.21.15.7:0/4080121513 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f1984004880 con 0x564a8fd182e0 2024-09-19T04:19:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.003+0000 7f199bbe1740 10 client.15768 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T04:19:26.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.003+0000 7f199bbe1740 10 client.15768 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:19:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.004+0000 7f199bbe1740 20 client.15768 populate_metadata read hostname 'smithi007' 2024-09-19T04:19:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.004+0000 7f199bbe1740 1 --2- 172.21.15.7:0/4080121513 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564a8fd2d430 0x564a8fd2f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.004+0000 7f199bbe1740 4 client.15768 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:19:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.004+0000 7f199bbe1740 1 -- 172.21.15.7:0/4080121513 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a8fc88a20 con 0x564a8fd2d430 2024-09-19T04:19:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.004+0000 7f1991d9b640 1 --2- 172.21.15.7:0/4080121513 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564a8fd2d430 0x564a8fd2f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.004+0000 7f1979ffb640 10 client.15768 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:19:26.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.004+0000 7f1991d9b640 1 --2- 172.21.15.7:0/4080121513 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564a8fd2d430 0x564a8fd2f820 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6caaee53e15f97fe server_cookie=a78be70d05af29cf in_seq=0 out_seq=0 2024-09-19T04:19:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.008+0000 7f1979ffb640 1 -- 172.21.15.7:0/4080121513 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564a8fc88a20 con 0x564a8fd2d430 2024-09-19T04:19:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.008+0000 7f1979ffb640 10 client.15768 handle_command_reply: tid=0 2024-09-19T04:19:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.008+0000 7f199bbe1740 1 client.15768 shutdown 2024-09-19T04:19:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.008+0000 7f199bbe1740 1 -- 172.21.15.7:0/4080121513 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8fd182e0 msgr2=0x564a8fd22160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:19:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.008+0000 7f199bbe1740 1 --2- 172.21.15.7:0/4080121513 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8fd182e0 0x564a8fd22160 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f19840314e0 tx=0x7f1984009520 comp rx=0 tx=0).stop 2024-09-19T04:19:26.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.008+0000 7f199bbe1740 1 -- 172.21.15.7:0/4080121513 shutdown_connections 2024-09-19T04:19:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.008+0000 7f199bbe1740 1 --2- 172.21.15.7:0/4080121513 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564a8fd2d430 0x564a8fd2f820 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.008+0000 7f199bbe1740 1 --2- 172.21.15.7:0/4080121513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a8fd1d370 0x564a8fd29130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.008+0000 7f199bbe1740 1 --2- 172.21.15.7:0/4080121513 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8fd182e0 0x564a8fd22160 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.008+0000 7f1979ffb640 0 client.15768 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:19:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.008+0000 7f199bbe1740 1 --2- 172.21.15.7:0/4080121513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a8fd179a0 0x564a8fd21c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.008+0000 7f199bbe1740 1 -- 172.21.15.7:0/4080121513 >> 172.21.15.7:0/4080121513 conn(0x564a8fd13010 msgr2=0x564a8fd14820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:19:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.008+0000 7f199bbe1740 1 -- 172.21.15.7:0/4080121513 shutdown_connections 2024-09-19T04:19:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.008+0000 7f199bbe1740 1 -- 172.21.15.7:0/4080121513 wait complete. 2024-09-19T04:19:26.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.008+0000 7f199bbe1740 20 client.15768 trim_cache size 0 max 16384 2024-09-19T04:19:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.023+0000 7f199bbe1740 1 Processor -- start 2024-09-19T04:19:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.023+0000 7f199bbe1740 1 -- start start 2024-09-19T04:19:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.023+0000 7f199bbe1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8fd179a0 0x564a8fd13e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.023+0000 7f199bbe1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a8fd182e0 0x564a8fd290f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:26.025 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.023+0000 7f199bbe1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a8fd1d370 0x564a8fd143d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.023+0000 7f199bbe1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f19941aa900 con 0x564a8fd179a0 2024-09-19T04:19:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.023+0000 7f199bbe1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f19941ac4d0 con 0x564a8fd1d370 2024-09-19T04:19:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.023+0000 7f199bbe1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f19941aafd0 con 0x564a8fd182e0 2024-09-19T04:19:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.023+0000 7f1991d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8fd179a0 0x564a8fd13e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.023+0000 7f1991d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8fd179a0 0x564a8fd13e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56120/0 (socket says 172.21.15.7:56120) 2024-09-19T04:19:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.023+0000 7f1991d9b640 1 -- 172.21.15.7:0/1708240621 learned_addr learned my addr 172.21.15.7:0/1708240621 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:19:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.023+0000 7f1991d9b640 1 --2- 172.21.15.7:0/1708240621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a8fd1d370 0x564a8fd143d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.023+0000 7f199259c640 1 --2- 172.21.15.7:0/1708240621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a8fd182e0 0x564a8fd290f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.023+0000 7f1991d9b640 1 -- 172.21.15.7:0/1708240621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a8fd182e0 msgr2=0x564a8fd290f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:19:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.023+0000 7f1991d9b640 1 --2- 172.21.15.7:0/1708240621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a8fd182e0 0x564a8fd290f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.023+0000 7f1991d9b640 1 -- 172.21.15.7:0/1708240621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a8fd1d370 msgr2=0x564a8fd143d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:19:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.023+0000 7f1991d9b640 1 --2- 172.21.15.7:0/1708240621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a8fd1d370 0x564a8fd143d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:26.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.023+0000 7f1991d9b640 1 -- 172.21.15.7:0/1708240621 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a8fd2fe00 con 0x564a8fd179a0 2024-09-19T04:19:26.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.023+0000 7f1991d9b640 1 --2- 172.21.15.7:0/1708240621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8fd179a0 0x564a8fd13e90 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f19941993f0 tx=0x7f197c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59f323ad6bc3214 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:19:26.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.024+0000 7f197bfff640 1 -- 172.21.15.7:0/1708240621 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197c010e50 con 0x564a8fd179a0 2024-09-19T04:19:26.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.024+0000 7f197bfff640 1 -- 172.21.15.7:0/1708240621 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f197c005020 con 0x564a8fd179a0 2024-09-19T04:19:26.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.024+0000 7f197bfff640 1 -- 172.21.15.7:0/1708240621 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197c004b20 con 0x564a8fd179a0 2024-09-19T04:19:26.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.024+0000 7f199bbe1740 1 -- 172.21.15.7:0/1708240621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8fd179a0 msgr2=0x564a8fd13e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:19:26.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.024+0000 7f199bbe1740 1 --2- 172.21.15.7:0/1708240621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8fd179a0 0x564a8fd13e90 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f19941993f0 tx=0x7f197c004730 comp rx=0 tx=0).stop 2024-09-19T04:19:26.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.024+0000 7f199bbe1740 1 -- 172.21.15.7:0/1708240621 shutdown_connections 2024-09-19T04:19:26.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.024+0000 7f199bbe1740 1 --2- 172.21.15.7:0/1708240621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a8fd1d370 0x564a8fd143d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:26.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.024+0000 7f199bbe1740 1 --2- 172.21.15.7:0/1708240621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a8fd182e0 0x564a8fd290f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:26.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.024+0000 7f199bbe1740 1 --2- 172.21.15.7:0/1708240621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8fd179a0 0x564a8fd13e90 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.024+0000 7f199bbe1740 1 -- 172.21.15.7:0/1708240621 >> 172.21.15.7:0/1708240621 conn(0x564a8fd13010 msgr2=0x564a8fd19520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:19:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.024+0000 7f199bbe1740 1 -- 172.21.15.7:0/1708240621 shutdown_connections 2024-09-19T04:19:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.024+0000 7f199bbe1740 1 -- 172.21.15.7:0/1708240621 wait complete. 2024-09-19T04:19:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.025+0000 7f199bbe1740 1 -- start start 2024-09-19T04:19:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.025+0000 7f199bbe1740 1 Processor -- start 2024-09-19T04:19:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.025+0000 7f199bbe1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8fd179a0 0x564a8fd26c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.025+0000 7f199bbe1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a8fd182e0 0x564a8fd27160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.025+0000 7f199bbe1740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a8fd1d370 0x564a8fd28170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.025+0000 7f199bbe1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f19941abd70 con 0x564a8fd179a0 2024-09-19T04:19:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.025+0000 7f199bbe1740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f19941ab6a0 con 0x564a8fd1d370 2024-09-19T04:19:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.025+0000 7f199bbe1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f19941a88c0 con 0x564a8fd182e0 2024-09-19T04:19:26.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.025+0000 7f199bbe1740 10 client.0 _ll_register_callbacks cb 0x7f197c012700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:19:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.025+0000 7f1991d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8fd179a0 0x564a8fd26c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.025+0000 7f1991d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8fd179a0 0x564a8fd26c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56128/0 (socket says 172.21.15.7:56128) 2024-09-19T04:19:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.025+0000 7f1991d9b640 1 -- 172.21.15.7:0/3771083770 learned_addr learned my addr 172.21.15.7:0/3771083770 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:19:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.025+0000 7f1991d9b640 1 --2- 172.21.15.7:0/3771083770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a8fd1d370 0x564a8fd28170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.025+0000 7f199259c640 1 --2- 172.21.15.7:0/3771083770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a8fd182e0 0x564a8fd27160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.026+0000 7f1991d9b640 1 -- 172.21.15.7:0/3771083770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a8fd182e0 msgr2=0x564a8fd27160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:19:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.026+0000 7f1991d9b640 1 --2- 172.21.15.7:0/3771083770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a8fd182e0 0x564a8fd27160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.026+0000 7f1991d9b640 1 -- 172.21.15.7:0/3771083770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a8fd1d370 msgr2=0x564a8fd28170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:19:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.026+0000 7f1991d9b640 1 --2- 172.21.15.7:0/3771083770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a8fd1d370 0x564a8fd28170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.026+0000 7f1991d9b640 1 -- 172.21.15.7:0/3771083770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a8fd28780 con 0x564a8fd179a0 2024-09-19T04:19:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.026+0000 7f199259c640 1 --2- 172.21.15.7:0/3771083770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a8fd182e0 0x564a8fd27160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:19:26.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.026+0000 7f1991d9b640 1 --2- 172.21.15.7:0/3771083770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8fd179a0 0x564a8fd26c20 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f197c004650 tx=0x7f197c00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45eb5055202205e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:19:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.026+0000 7f1979ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:19:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.026+0000 7f1979ffb640 1 -- 172.21.15.7:0/3771083770 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197c005540 con 0x564a8fd179a0 2024-09-19T04:19:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.026+0000 7f1979ffb640 1 -- 172.21.15.7:0/3771083770 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f197c0048a0 con 0x564a8fd179a0 2024-09-19T04:19:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.026+0000 7f199bbe1740 1 -- 172.21.15.7:0/3771083770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f197c005020 con 0x564a8fd179a0 2024-09-19T04:19:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.026+0000 7f1979ffb640 1 -- 172.21.15.7:0/3771083770 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f197c004aa0 con 0x564a8fd179a0 2024-09-19T04:19:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.026+0000 7f199bbe1740 10 client.15774 fetch_fsmap learned FSMap version 31 2024-09-19T04:19:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.026+0000 7f199bbe1740 1 -- 172.21.15.7:0/3771083770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564a8fd98420 con 0x564a8fd179a0 2024-09-19T04:19:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.026+0000 7f1979ffb640 1 -- 172.21.15.7:0/3771083770 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f197c005020 con 0x564a8fd179a0 2024-09-19T04:19:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.026+0000 7f1979ffb640 1 -- 172.21.15.7:0/3771083770 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 31) ==== 8382+0+0 (secure 0 0 0) 0x7f197c037070 con 0x564a8fd179a0 2024-09-19T04:19:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.026+0000 7f199bbe1740 10 client.15774 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T04:19:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.027+0000 7f199bbe1740 10 client.15774 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:19:26.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.027+0000 7f199bbe1740 20 client.15774 populate_metadata read hostname 'smithi007' 2024-09-19T04:19:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.027+0000 7f199bbe1740 1 --2- 172.21.15.7:0/3771083770 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564a8fd98d90 0x564a8fd9b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.027+0000 7f199bbe1740 4 client.15774 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:19:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.027+0000 7f199bbe1740 1 -- 172.21.15.7:0/3771083770 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564a8fc82d70 con 0x564a8fd98d90 2024-09-19T04:19:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.027+0000 7f199259c640 1 --2- 172.21.15.7:0/3771083770 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564a8fd98d90 0x564a8fd9b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.027+0000 7f1979ffb640 10 client.15774 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:19:26.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:26.027+0000 7f199259c640 1 --2- 172.21.15.7:0/3771083770 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564a8fd98d90 0x564a8fd9b1b0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcd825acb1c64080 server_cookie=6ebce4232b5994f3 in_seq=0 out_seq=0 2024-09-19T04:19:27.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:26 smithi102 ceph-mon[35446]: pgmap v430: 129 pgs: 129 active+clean; 117 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 7.8 MiB/s wr, 960 op/s 2024-09-19T04:19:27.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:26 smithi092 ceph-mon[34940]: pgmap v430: 129 pgs: 129 active+clean; 117 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 7.8 MiB/s wr, 960 op/s 2024-09-19T04:19:27.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:26 smithi007 ceph-mon[31360]: pgmap v430: 129 pgs: 129 active+clean; 117 MiB data, 529 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 7.8 MiB/s wr, 960 op/s 2024-09-19T04:19:28.157 INFO:tasks.workunit.client.0.smithi007.stdout: 37 692038 403 460078 580 294018 958 2024-09-19T04:19:29.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:28 smithi102 ceph-mon[35446]: pgmap v431: 129 pgs: 129 active+clean; 117 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.7 MiB/s wr, 636 op/s 2024-09-19T04:19:29.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:28 smithi092 ceph-mon[34940]: pgmap v431: 129 pgs: 129 active+clean; 117 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.7 MiB/s wr, 636 op/s 2024-09-19T04:19:29.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:28 smithi007 ceph-mon[31360]: pgmap v431: 129 pgs: 129 active+clean; 117 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.7 MiB/s wr, 636 op/s 2024-09-19T04:19:30.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:30.562+0000 7f1979ffb640 1 -- 172.21.15.7:0/3771083770 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564a8fc82d70 con 0x564a8fd98d90 2024-09-19T04:19:30.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:30.562+0000 7f1979ffb640 10 client.15774 handle_command_reply: tid=0 2024-09-19T04:19:30.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:30.562+0000 7f199bbe1740 1 client.15774 shutdown 2024-09-19T04:19:30.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:30.562+0000 7f199bbe1740 1 -- 172.21.15.7:0/3771083770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8fd179a0 msgr2=0x564a8fd26c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:19:30.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:30.562+0000 7f199bbe1740 1 --2- 172.21.15.7:0/3771083770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8fd179a0 0x564a8fd26c20 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f197c004650 tx=0x7f197c00b700 comp rx=0 tx=0).stop 2024-09-19T04:19:30.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:30.563+0000 7f199bbe1740 1 -- 172.21.15.7:0/3771083770 shutdown_connections 2024-09-19T04:19:30.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:30.563+0000 7f199bbe1740 1 --2- 172.21.15.7:0/3771083770 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564a8fd98d90 0x564a8fd9b1b0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:30.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:30.563+0000 7f199bbe1740 1 --2- 172.21.15.7:0/3771083770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a8fd1d370 0x564a8fd28170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:30.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:30.563+0000 7f199bbe1740 1 --2- 172.21.15.7:0/3771083770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a8fd182e0 0x564a8fd27160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:30.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:30.563+0000 7f199bbe1740 1 --2- 172.21.15.7:0/3771083770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564a8fd179a0 0x564a8fd26c20 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:30.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:30.563+0000 7f199bbe1740 1 -- 172.21.15.7:0/3771083770 >> 172.21.15.7:0/3771083770 conn(0x564a8fd13010 msgr2=0x564a8fd119a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:19:30.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:30.563+0000 7f1979ffb640 0 client.15774 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:19:30.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:30.563+0000 7f199bbe1740 1 -- 172.21.15.7:0/3771083770 shutdown_connections 2024-09-19T04:19:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:30.563+0000 7f199bbe1740 1 -- 172.21.15.7:0/3771083770 wait complete. 2024-09-19T04:19:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:30.563+0000 7f199bbe1740 20 client.15774 trim_cache size 0 max 16384 2024-09-19T04:19:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:19:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:19:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:19:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:19:30.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:30.588+0000 7f1998d6f640 1 -- 172.21.15.7:0/1368711450 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f19800a3240 msgr2=0x7f19800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:19:30.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:30.588+0000 7f1998d6f640 1 --2- 172.21.15.7:0/1368711450 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f19800a3240 0x7f19800a5700 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f198c09c290 tx=0x7f198c06c200 comp rx=0 tx=0).stop 2024-09-19T04:19:30.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:30.588+0000 7f1998d6f640 1 -- 172.21.15.7:0/1368711450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19941025f0 msgr2=0x7f199419f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:19:30.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:30.588+0000 7f1998d6f640 1 --2- 172.21.15.7:0/1368711450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19941025f0 0x7f199419f490 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f198c00ec50 tx=0x7f198c00c6a0 comp rx=0 tx=0).stop 2024-09-19T04:19:30.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:30.588+0000 7f1998d6f640 1 -- 172.21.15.7:0/1368711450 shutdown_connections 2024-09-19T04:19:30.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:30.588+0000 7f1998d6f640 1 --2- 172.21.15.7:0/1368711450 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f19800a3240 0x7f19800a5700 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:30.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:30.588+0000 7f1998d6f640 1 --2- 172.21.15.7:0/1368711450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19941025f0 0x7f199419f490 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:30.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:30.588+0000 7f1998d6f640 1 --2- 172.21.15.7:0/1368711450 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1994101c30 0x7f1994198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:30.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:30.588+0000 7f1998d6f640 1 --2- 172.21.15.7:0/1368711450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1994100a40 0x7f1994197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:30.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:30.588+0000 7f1998d6f640 1 -- 172.21.15.7:0/1368711450 >> 172.21.15.7:0/1368711450 conn(0x7f19940fc1c0 msgr2=0x7f1994069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:19:30.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:30.592+0000 7f1998d6f640 1 -- 172.21.15.7:0/1368711450 shutdown_connections 2024-09-19T04:19:30.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:30.592+0000 7f1998d6f640 1 -- 172.21.15.7:0/1368711450 wait complete. 2024-09-19T04:19:31.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:30 smithi102 ceph-mon[35446]: pgmap v432: 129 pgs: 129 active+clean; 124 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 8.5 MiB/s wr, 856 op/s 2024-09-19T04:19:31.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:30 smithi092 ceph-mon[34940]: pgmap v432: 129 pgs: 129 active+clean; 124 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 8.5 MiB/s wr, 856 op/s 2024-09-19T04:19:31.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:30 smithi007 ceph-mon[31360]: pgmap v432: 129 pgs: 129 active+clean; 124 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 8.5 MiB/s wr, 856 op/s 2024-09-19T04:19:33.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:32 smithi092 ceph-mon[34940]: pgmap v433: 129 pgs: 129 active+clean; 124 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 7.3 MiB/s wr, 970 op/s 2024-09-19T04:19:33.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:32 smithi007 ceph-mon[31360]: pgmap v433: 129 pgs: 129 active+clean; 124 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 7.3 MiB/s wr, 970 op/s 2024-09-19T04:19:33.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:32 smithi102 ceph-mon[35446]: pgmap v433: 129 pgs: 129 active+clean; 124 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 7.3 MiB/s wr, 970 op/s 2024-09-19T04:19:35.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:34 smithi007 ceph-mon[31360]: pgmap v434: 129 pgs: 129 active+clean; 122 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 6.7 MiB/s wr, 1.36k op/s 2024-09-19T04:19:35.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:34 smithi007 ceph-mon[31360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:19:35.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:34 smithi092 ceph-mon[34940]: pgmap v434: 129 pgs: 129 active+clean; 122 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 6.7 MiB/s wr, 1.36k op/s 2024-09-19T04:19:35.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:34 smithi092 ceph-mon[34940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:19:35.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:34 smithi102 ceph-mon[35446]: pgmap v434: 129 pgs: 129 active+clean; 122 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 6.7 MiB/s wr, 1.36k op/s 2024-09-19T04:19:35.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:34 smithi102 ceph-mon[35446]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:19:37.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:36 smithi092 ceph-mon[34940]: pgmap v435: 129 pgs: 129 active+clean; 102 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 5.0 MiB/s wr, 1.44k op/s 2024-09-19T04:19:37.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:36 smithi007 ceph-mon[31360]: pgmap v435: 129 pgs: 129 active+clean; 102 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 5.0 MiB/s wr, 1.44k op/s 2024-09-19T04:19:37.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:36 smithi102 ceph-mon[35446]: pgmap v435: 129 pgs: 129 active+clean; 102 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 5.0 MiB/s wr, 1.44k op/s 2024-09-19T04:19:38.157 INFO:tasks.workunit.client.0.smithi007.stdout: 45 983279 554 702874 451 503058 1190 2024-09-19T04:19:39.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:38 smithi092 ceph-mon[34940]: pgmap v436: 129 pgs: 129 active+clean; 102 MiB data, 498 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 1.8 MiB/s wr, 1.18k op/s 2024-09-19T04:19:39.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:38 smithi007 ceph-mon[31360]: pgmap v436: 129 pgs: 129 active+clean; 102 MiB data, 498 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 1.8 MiB/s wr, 1.18k op/s 2024-09-19T04:19:39.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:38 smithi102 ceph-mon[35446]: pgmap v436: 129 pgs: 129 active+clean; 102 MiB data, 498 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 1.8 MiB/s wr, 1.18k op/s 2024-09-19T04:19:41.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:40 smithi092 ceph-mon[34940]: pgmap v437: 129 pgs: 129 active+clean; 108 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 2.4 MiB/s wr, 1.36k op/s 2024-09-19T04:19:41.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:19:41.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:19:41.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:19:41.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:40 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:19:41.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:40 smithi007 ceph-mon[31360]: pgmap v437: 129 pgs: 129 active+clean; 108 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 2.4 MiB/s wr, 1.36k op/s 2024-09-19T04:19:41.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:19:41.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:19:41.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:19:41.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:40 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:19:41.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:40 smithi102 ceph-mon[35446]: pgmap v437: 129 pgs: 129 active+clean; 108 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 2.4 MiB/s wr, 1.36k op/s 2024-09-19T04:19:41.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:19:41.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:19:41.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:19:41.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:40 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:19:43.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:42 smithi092 ceph-mon[34940]: pgmap v438: 129 pgs: 129 active+clean; 117 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 2.4 MiB/s wr, 1.23k op/s 2024-09-19T04:19:43.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:42 smithi007 ceph-mon[31360]: pgmap v438: 129 pgs: 129 active+clean; 117 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 2.4 MiB/s wr, 1.23k op/s 2024-09-19T04:19:43.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:42 smithi102 ceph-mon[35446]: pgmap v438: 129 pgs: 129 active+clean; 117 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 2.4 MiB/s wr, 1.23k op/s 2024-09-19T04:19:44.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.083+0000 7f6caaf31640 1 -- 172.21.15.7:0/34529746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ca4100a40 msgr2=0x7f6ca4100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:19:44.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.083+0000 7f6caaf31640 1 --2- 172.21.15.7:0/34529746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ca4100a40 0x7f6ca4100e40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009900 tx=0x7f6c9002a400 comp rx=0 tx=0).stop 2024-09-19T04:19:44.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.083+0000 7f6caaf31640 1 -- 172.21.15.7:0/34529746 shutdown_connections 2024-09-19T04:19:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.083+0000 7f6caaf31640 1 --2- 172.21.15.7:0/34529746 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ca41025f0 0x7f6ca4108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.083+0000 7f6caaf31640 1 --2- 172.21.15.7:0/34529746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ca4101c30 0x7f6ca41020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.083+0000 7f6caaf31640 1 --2- 172.21.15.7:0/34529746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ca4100a40 0x7f6ca4100e40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.083+0000 7f6caaf31640 1 -- 172.21.15.7:0/34529746 >> 172.21.15.7:0/34529746 conn(0x7f6ca40fc1c0 msgr2=0x7f6ca40fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:19:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.083+0000 7f6caaf31640 1 -- 172.21.15.7:0/34529746 shutdown_connections 2024-09-19T04:19:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.083+0000 7f6caaf31640 1 -- 172.21.15.7:0/34529746 wait complete. 2024-09-19T04:19:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.084+0000 7f6caaf31640 1 Processor -- start 2024-09-19T04:19:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.084+0000 7f6caaf31640 1 -- start start 2024-09-19T04:19:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.085+0000 7f6caaf31640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ca4100a40 0x7f6ca4195cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.085+0000 7f6caaf31640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ca4101c30 0x7f6ca41961f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.085+0000 7f6caaf31640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ca41025f0 0x7f6ca419d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.085+0000 7f6caaf31640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca410b640 con 0x7f6ca4101c30 2024-09-19T04:19:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.085+0000 7f6caaf31640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca410b4c0 con 0x7f6ca41025f0 2024-09-19T04:19:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.085+0000 7f6caaf31640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca410b7c0 con 0x7f6ca4100a40 2024-09-19T04:19:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.085+0000 7f6ca8ccd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ca4100a40 0x7f6ca4195cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.085+0000 7f6ca3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ca4101c30 0x7f6ca41961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.085+0000 7f6ca8ccd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ca4100a40 0x7f6ca4195cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:43822/0 (socket says 172.21.15.7:43822) 2024-09-19T04:19:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.085+0000 7f6ca94ce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ca41025f0 0x7f6ca419d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.085+0000 7f6ca8ccd640 1 -- 172.21.15.7:0/2734107791 learned_addr learned my addr 172.21.15.7:0/2734107791 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:19:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.085+0000 7f6ca8ccd640 1 -- 172.21.15.7:0/2734107791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ca41025f0 msgr2=0x7f6ca419d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:19:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.085+0000 7f6ca8ccd640 1 --2- 172.21.15.7:0/2734107791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ca41025f0 0x7f6ca419d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.085+0000 7f6ca8ccd640 1 -- 172.21.15.7:0/2734107791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ca4101c30 msgr2=0x7f6ca41961f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:19:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.085+0000 7f6ca8ccd640 1 --2- 172.21.15.7:0/2734107791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ca4101c30 0x7f6ca41961f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.085+0000 7f6ca8ccd640 1 -- 172.21.15.7:0/2734107791 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca419d8f0 con 0x7f6ca4100a40 2024-09-19T04:19:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.086+0000 7f6ca8ccd640 1 --2- 172.21.15.7:0/2734107791 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ca4100a40 0x7f6ca4195cb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6c90031440 tx=0x7f6c90032ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:19:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.086+0000 7f6ca1ffb640 1 -- 172.21.15.7:0/2734107791 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9003f030 con 0x7f6ca4100a40 2024-09-19T04:19:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.086+0000 7f6ca1ffb640 1 -- 172.21.15.7:0/2734107791 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c90003ce0 con 0x7f6ca4100a40 2024-09-19T04:19:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.086+0000 7f6ca1ffb640 1 -- 172.21.15.7:0/2734107791 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c90035070 con 0x7f6ca4100a40 2024-09-19T04:19:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.086+0000 7f6caaf31640 1 -- 172.21.15.7:0/2734107791 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca419db80 con 0x7f6ca4100a40 2024-09-19T04:19:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.086+0000 7f6caaf31640 1 -- 172.21.15.7:0/2734107791 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ca419e0c0 con 0x7f6ca4100a40 2024-09-19T04:19:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.090+0000 7f6ca1ffb640 1 -- 172.21.15.7:0/2734107791 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f6c90042030 con 0x7f6ca4100a40 2024-09-19T04:19:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.092+0000 7f6ca1ffb640 1 --2- 172.21.15.7:0/2734107791 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6c940a76d0 0x7f6c940a9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.092+0000 7f6ca3fff640 1 --2- 172.21.15.7:0/2734107791 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6c940a76d0 0x7f6c940a9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.092+0000 7f6cadcd3740 1 Processor -- start 2024-09-19T04:19:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.093+0000 7f6cadcd3740 1 -- start start 2024-09-19T04:19:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.093+0000 7f6cadcd3740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55676ffed1b0 0x55676ffed5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.093+0000 7f6cadcd3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55676ffedaf0 0x55676fff25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.093+0000 7f6ca1ffb640 1 -- 172.21.15.7:0/2734107791 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f6c900f01c0 con 0x7f6ca4100a40 2024-09-19T04:19:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.093+0000 7f6ca3fff640 1 --2- 172.21.15.7:0/2734107791 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6c940a76d0 0x7f6c940a9b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6ca41971b0 tx=0x7f6c98005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:19:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.093+0000 7f6cadcd3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55676fff2b80 0x55676fff5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.093+0000 7f6cadcd3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55676ff482f0 con 0x55676ffedaf0 2024-09-19T04:19:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.093+0000 7f6cadcd3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55676fef0270 con 0x55676fff2b80 2024-09-19T04:19:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.093+0000 7f6cadcd3740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55676ff442b0 con 0x55676ffed1b0 2024-09-19T04:19:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.093+0000 7f6ca8ccd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55676ffed1b0 0x55676ffed5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.093+0000 7f6ca8ccd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55676ffed1b0 0x55676ffed5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:43824/0 (socket says 172.21.15.7:43824) 2024-09-19T04:19:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.093+0000 7f6ca8ccd640 1 -- 172.21.15.7:0/3516306547 learned_addr learned my addr 172.21.15.7:0/3516306547 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:19:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.093+0000 7f6ca94ce640 1 --2- 172.21.15.7:0/3516306547 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55676fff2b80 0x55676fff5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.094+0000 7f6ca3fff640 1 --2- 172.21.15.7:0/3516306547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55676ffedaf0 0x55676fff25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.094+0000 7f6ca8ccd640 1 -- 172.21.15.7:0/3516306547 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55676fff2b80 msgr2=0x55676fff5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:19:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.094+0000 7f6ca8ccd640 1 --2- 172.21.15.7:0/3516306547 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55676fff2b80 0x55676fff5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.094+0000 7f6ca8ccd640 1 -- 172.21.15.7:0/3516306547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55676ffedaf0 msgr2=0x55676fff25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:19:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.094+0000 7f6ca8ccd640 1 --2- 172.21.15.7:0/3516306547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55676ffedaf0 0x55676fff25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:44.096 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.094+0000 7f6ca8ccd640 1 -- 172.21.15.7:0/3516306547 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55676feef340 con 0x55676ffed1b0 2024-09-19T04:19:44.097 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.094+0000 7f6ca3fff640 1 --2- 172.21.15.7:0/3516306547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55676ffedaf0 0x55676fff25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:19:44.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.094+0000 7f6ca8ccd640 1 --2- 172.21.15.7:0/3516306547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55676ffed1b0 0x55676ffed5b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6c90005ec0 tx=0x7f6c90032f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83d53d25b9f0301c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:19:44.101 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.095+0000 7f6c8effd640 1 -- 172.21.15.7:0/3516306547 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c90049040 con 0x55676ffed1b0 2024-09-19T04:19:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.095+0000 7f6c8effd640 1 -- 172.21.15.7:0/3516306547 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c900c07c0 con 0x55676ffed1b0 2024-09-19T04:19:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.095+0000 7f6c8effd640 1 -- 172.21.15.7:0/3516306547 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c900b8b30 con 0x55676ffed1b0 2024-09-19T04:19:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.096+0000 7f6cadcd3740 1 -- 172.21.15.7:0/3516306547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55676ffed1b0 msgr2=0x55676ffed5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:19:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.096+0000 7f6cadcd3740 1 --2- 172.21.15.7:0/3516306547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55676ffed1b0 0x55676ffed5b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6c90005ec0 tx=0x7f6c90032f90 comp rx=0 tx=0).stop 2024-09-19T04:19:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.096+0000 7f6cadcd3740 1 -- 172.21.15.7:0/3516306547 shutdown_connections 2024-09-19T04:19:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.096+0000 7f6cadcd3740 1 --2- 172.21.15.7:0/3516306547 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55676fff2b80 0x55676fff5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.096+0000 7f6cadcd3740 1 --2- 172.21.15.7:0/3516306547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55676ffedaf0 0x55676fff25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.096+0000 7f6cadcd3740 1 --2- 172.21.15.7:0/3516306547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55676ffed1b0 0x55676ffed5b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.096+0000 7f6cadcd3740 1 -- 172.21.15.7:0/3516306547 >> 172.21.15.7:0/3516306547 conn(0x55676ffe0010 msgr2=0x55676ffe0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:19:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.096+0000 7f6cadcd3740 1 -- 172.21.15.7:0/3516306547 shutdown_connections 2024-09-19T04:19:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.096+0000 7f6cadcd3740 1 -- 172.21.15.7:0/3516306547 wait complete. 2024-09-19T04:19:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.097+0000 7f6cadcd3740 1 -- start start 2024-09-19T04:19:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.097+0000 7f6cadcd3740 1 Processor -- start 2024-09-19T04:19:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.097+0000 7f6cadcd3740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55676ffed1b0 0x55676fff70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.097+0000 7f6cadcd3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55676ffedaf0 0x55676fff7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.098+0000 7f6ca8ccd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55676ffed1b0 0x55676fff70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.098+0000 7f6ca8ccd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55676ffed1b0 0x55676fff70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:43836/0 (socket says 172.21.15.7:43836) 2024-09-19T04:19:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.098+0000 7f6ca3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55676ffedaf0 0x55676fff7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.098+0000 7f6ca3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55676ffedaf0 0x55676fff7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:43256/0 (socket says 172.21.15.7:43256) 2024-09-19T04:19:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.098+0000 7f6cadcd3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55676fff2b80 0x55676fffe670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.098+0000 7f6ca8ccd640 1 -- 172.21.15.7:0/1774651557 learned_addr learned my addr 172.21.15.7:0/1774651557 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:19:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.098+0000 7f6cadcd3740 1 -- 172.21.15.7:0/1774651557 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55676fff5910 con 0x55676fff2b80 2024-09-19T04:19:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.098+0000 7f6cadcd3740 1 -- 172.21.15.7:0/1774651557 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55676fed1290 con 0x55676ffedaf0 2024-09-19T04:19:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.098+0000 7f6cadcd3740 1 -- 172.21.15.7:0/1774651557 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55676fff5a90 con 0x55676ffed1b0 2024-09-19T04:19:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.098+0000 7f6ca94ce640 1 --2- 172.21.15.7:0/1774651557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55676fff2b80 0x55676fffe670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.098+0000 7f6ca8ccd640 1 -- 172.21.15.7:0/1774651557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55676ffedaf0 msgr2=0x55676fff7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:19:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.098+0000 7f6ca8ccd640 1 --2- 172.21.15.7:0/1774651557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55676ffedaf0 0x55676fff7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:44.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.098+0000 7f6ca8ccd640 1 -- 172.21.15.7:0/1774651557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55676fff2b80 msgr2=0x55676fffe670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:19:44.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.098+0000 7f6ca8ccd640 1 --2- 172.21.15.7:0/1774651557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55676fff2b80 0x55676fffe670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:44.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.098+0000 7f6ca8ccd640 1 -- 172.21.15.7:0/1774651557 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55676fc5b210 con 0x55676ffed1b0 2024-09-19T04:19:44.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.098+0000 7f6ca94ce640 1 --2- 172.21.15.7:0/1774651557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55676fff2b80 0x55676fffe670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:19:44.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.098+0000 7f6cadcd3740 10 client.0 _ll_register_callbacks cb 0x55676ff02140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:19:44.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.098+0000 7f6cadcd3740 1 -- 172.21.15.7:0/1774651557 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c900c07c0 con 0x55676ffed1b0 2024-09-19T04:19:44.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.099+0000 7f6ca8ccd640 1 --2- 172.21.15.7:0/1774651557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55676ffed1b0 0x55676fff70f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6c9002a920 tx=0x7f6c90009560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c8066bc71b086e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:19:44.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.099+0000 7f6c83fff640 10 client.25471 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-19T04:19:44.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.099+0000 7f6c83fff640 1 -- 172.21.15.7:0/1774651557 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c90049070 con 0x55676ffed1b0 2024-09-19T04:19:44.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.099+0000 7f6c83fff640 1 -- 172.21.15.7:0/1774651557 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f6c900ba7c0 con 0x55676ffed1b0 2024-09-19T04:19:44.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.099+0000 7f6c83fff640 1 -- 172.21.15.7:0/1774651557 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6c900b8b30 con 0x55676ffed1b0 2024-09-19T04:19:44.104 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.099+0000 7f6cadcd3740 10 client.25471 fetch_fsmap learned FSMap version 32 2024-09-19T04:19:44.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.099+0000 7f6cadcd3740 1 -- 172.21.15.7:0/1774651557 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({fsmap=32}) -- 0x55676fd27620 con 0x55676ffed1b0 2024-09-19T04:19:44.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.099+0000 7f6c83fff640 1 -- 172.21.15.7:0/1774651557 <== mon.1 v2:172.21.15.102:3300/0 4 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f6c900d5260 con 0x55676ffed1b0 2024-09-19T04:19:44.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.099+0000 7f6cadcd3740 10 client.25471 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T04:19:44.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.099+0000 7f6cadcd3740 10 client.25471 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:19:44.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.100+0000 7f6cadcd3740 20 client.25471 populate_metadata read hostname 'smithi007' 2024-09-19T04:19:44.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.100+0000 7f6cadcd3740 1 --2- 172.21.15.7:0/1774651557 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x556770002850 0x556770004ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:44.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.100+0000 7f6cadcd3740 4 client.25471 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:19:44.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.100+0000 7f6cadcd3740 1 -- 172.21.15.7:0/1774651557 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55676ff55a20 con 0x556770002850 2024-09-19T04:19:44.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.100+0000 7f6ca3fff640 1 --2- 172.21.15.7:0/1774651557 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x556770002850 0x556770004ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:44.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.100+0000 7f6c83fff640 10 client.25471 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:19:44.105 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.100+0000 7f6ca3fff640 1 --2- 172.21.15.7:0/1774651557 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x556770002850 0x556770004ca0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19c8a5e020e2307f server_cookie=c1e1a87784733068 in_seq=0 out_seq=0 2024-09-19T04:19:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.103+0000 7f6c83fff640 1 -- 172.21.15.7:0/1774651557 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55676ff55a20 con 0x556770002850 2024-09-19T04:19:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.103+0000 7f6c83fff640 10 client.25471 handle_command_reply: tid=0 2024-09-19T04:19:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.103+0000 7f6cadcd3740 1 client.25471 shutdown 2024-09-19T04:19:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.103+0000 7f6cadcd3740 1 -- 172.21.15.7:0/1774651557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55676ffed1b0 msgr2=0x55676fff70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:19:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.103+0000 7f6cadcd3740 1 --2- 172.21.15.7:0/1774651557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55676ffed1b0 0x55676fff70f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6c9002a920 tx=0x7f6c90009560 comp rx=0 tx=0).stop 2024-09-19T04:19:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.104+0000 7f6cadcd3740 1 -- 172.21.15.7:0/1774651557 shutdown_connections 2024-09-19T04:19:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.104+0000 7f6cadcd3740 1 --2- 172.21.15.7:0/1774651557 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x556770002850 0x556770004ca0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.104+0000 7f6c83fff640 0 client.25471 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:19:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.104+0000 7f6cadcd3740 1 --2- 172.21.15.7:0/1774651557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55676fff2b80 0x55676fffe670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.104+0000 7f6cadcd3740 1 --2- 172.21.15.7:0/1774651557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55676ffedaf0 0x55676fff7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.104+0000 7f6cadcd3740 1 --2- 172.21.15.7:0/1774651557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55676ffed1b0 0x55676fff70f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.104+0000 7f6cadcd3740 1 -- 172.21.15.7:0/1774651557 >> 172.21.15.7:0/1774651557 conn(0x55676ffe0010 msgr2=0x55676ffe1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:19:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.105+0000 7f6cadcd3740 1 -- 172.21.15.7:0/1774651557 shutdown_connections 2024-09-19T04:19:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.105+0000 7f6cadcd3740 1 -- 172.21.15.7:0/1774651557 wait complete. 2024-09-19T04:19:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.105+0000 7f6cadcd3740 20 client.25471 trim_cache size 0 max 16384 2024-09-19T04:19:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.129+0000 7f6cadcd3740 1 Processor -- start 2024-09-19T04:19:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.129+0000 7f6cadcd3740 1 -- start start 2024-09-19T04:19:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.129+0000 7f6cadcd3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55676ffed1b0 0x55676ffeec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.129+0000 7f6cadcd3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55676ffedaf0 0x55676ffef1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.129+0000 7f6cadcd3740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55676fff2b80 0x55676fffe590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.130+0000 7f6cadcd3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca41a86a0 con 0x55676ffedaf0 2024-09-19T04:19:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.130+0000 7f6cadcd3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca41aa2a0 con 0x55676ffed1b0 2024-09-19T04:19:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.130+0000 7f6cadcd3740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca41a8d70 con 0x55676fff2b80 2024-09-19T04:19:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.130+0000 7f6ca3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55676ffedaf0 0x55676ffef1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.130+0000 7f6ca3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55676ffedaf0 0x55676ffef1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47192/0 (socket says 172.21.15.7:47192) 2024-09-19T04:19:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.130+0000 7f6ca3fff640 1 -- 172.21.15.7:0/2623505881 learned_addr learned my addr 172.21.15.7:0/2623505881 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:19:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.130+0000 7f6ca8ccd640 1 --2- 172.21.15.7:0/2623505881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55676ffed1b0 0x55676ffeec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.130+0000 7f6ca94ce640 1 --2- 172.21.15.7:0/2623505881 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55676fff2b80 0x55676fffe590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.130+0000 7f6ca8ccd640 1 -- 172.21.15.7:0/2623505881 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55676fff2b80 msgr2=0x55676fffe590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:19:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.130+0000 7f6ca8ccd640 1 --2- 172.21.15.7:0/2623505881 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55676fff2b80 0x55676fffe590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.130+0000 7f6ca8ccd640 1 -- 172.21.15.7:0/2623505881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55676ffedaf0 msgr2=0x55676ffef1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:19:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.130+0000 7f6ca8ccd640 1 --2- 172.21.15.7:0/2623505881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55676ffedaf0 0x55676ffef1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.130+0000 7f6ca8ccd640 1 -- 172.21.15.7:0/2623505881 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55676ffe0ca0 con 0x55676ffed1b0 2024-09-19T04:19:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.130+0000 7f6ca3fff640 1 --2- 172.21.15.7:0/2623505881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55676ffedaf0 0x55676ffef1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:19:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.131+0000 7f6ca8ccd640 1 --2- 172.21.15.7:0/2623505881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55676ffed1b0 0x55676ffeec90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6c900b8e90 tx=0x7f6c90045000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f678d2d612d442d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:19:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.131+0000 7f6c8e7fc640 1 -- 172.21.15.7:0/2623505881 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c900ba7c0 con 0x55676ffed1b0 2024-09-19T04:19:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.131+0000 7f6c8e7fc640 1 -- 172.21.15.7:0/2623505881 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c900c07c0 con 0x55676ffed1b0 2024-09-19T04:19:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.131+0000 7f6c8e7fc640 1 -- 172.21.15.7:0/2623505881 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c900c4bf0 con 0x55676ffed1b0 2024-09-19T04:19:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.131+0000 7f6cadcd3740 1 -- 172.21.15.7:0/2623505881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55676ffed1b0 msgr2=0x55676ffeec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:19:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.131+0000 7f6cadcd3740 1 --2- 172.21.15.7:0/2623505881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55676ffed1b0 0x55676ffeec90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6c900b8e90 tx=0x7f6c90045000 comp rx=0 tx=0).stop 2024-09-19T04:19:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.132+0000 7f6cadcd3740 1 -- 172.21.15.7:0/2623505881 shutdown_connections 2024-09-19T04:19:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.132+0000 7f6cadcd3740 1 --2- 172.21.15.7:0/2623505881 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55676fff2b80 0x55676fffe590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.132+0000 7f6cadcd3740 1 --2- 172.21.15.7:0/2623505881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55676ffedaf0 0x55676ffef1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.132+0000 7f6cadcd3740 1 --2- 172.21.15.7:0/2623505881 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55676ffed1b0 0x55676ffeec90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.132+0000 7f6cadcd3740 1 -- 172.21.15.7:0/2623505881 >> 172.21.15.7:0/2623505881 conn(0x55676ffe0010 msgr2=0x55676fff70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:19:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.135+0000 7f6cadcd3740 1 -- 172.21.15.7:0/2623505881 shutdown_connections 2024-09-19T04:19:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.135+0000 7f6cadcd3740 1 -- 172.21.15.7:0/2623505881 wait complete. 2024-09-19T04:19:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.135+0000 7f6cadcd3740 1 -- start start 2024-09-19T04:19:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.135+0000 7f6cadcd3740 1 Processor -- start 2024-09-19T04:19:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.136+0000 7f6cadcd3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55676ffed1b0 0x55676fffb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.136+0000 7f6cadcd3740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55676ffedaf0 0x55676fffbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.136+0000 7f6cadcd3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55676fff2b80 0x55677006b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.136+0000 7f6cadcd3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca41a9b10 con 0x55676ffed1b0 2024-09-19T04:19:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.136+0000 7f6cadcd3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca41a9440 con 0x55676fff2b80 2024-09-19T04:19:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.136+0000 7f6cadcd3740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca41a6660 con 0x55676ffedaf0 2024-09-19T04:19:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.136+0000 7f6cadcd3740 10 client.0 _ll_register_callbacks cb 0x7f6c9c009ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:19:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.136+0000 7f6ca8ccd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55676ffed1b0 0x55676fffb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.136+0000 7f6ca94ce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55676fff2b80 0x55677006b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.136+0000 7f6ca94ce640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55676fff2b80 0x55677006b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:43272/0 (socket says 172.21.15.7:43272) 2024-09-19T04:19:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.136+0000 7f6ca94ce640 1 -- 172.21.15.7:0/867335040 learned_addr learned my addr 172.21.15.7:0/867335040 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:19:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.136+0000 7f6ca94ce640 1 -- 172.21.15.7:0/867335040 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55676ffedaf0 msgr2=0x55676fffbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:19:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.136+0000 7f6ca94ce640 1 --2- 172.21.15.7:0/867335040 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55676ffedaf0 0x55676fffbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.136+0000 7f6ca94ce640 1 -- 172.21.15.7:0/867335040 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55676ffed1b0 msgr2=0x55676fffb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:19:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.136+0000 7f6ca94ce640 1 --2- 172.21.15.7:0/867335040 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55676ffed1b0 0x55676fffb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.136+0000 7f6ca94ce640 1 -- 172.21.15.7:0/867335040 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55677006bb60 con 0x55676fff2b80 2024-09-19T04:19:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.136+0000 7f6ca8ccd640 1 --2- 172.21.15.7:0/867335040 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55676ffed1b0 0x55676fffb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:19:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.137+0000 7f6ca94ce640 1 --2- 172.21.15.7:0/867335040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55676fff2b80 0x55677006b570 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c003c90 tx=0x7f6c9c004410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17e506cb9aae737c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:19:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.137+0000 7f6c83fff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T04:19:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.137+0000 7f6c83fff640 1 -- 172.21.15.7:0/867335040 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9c004b20 con 0x55676fff2b80 2024-09-19T04:19:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.137+0000 7f6cadcd3740 1 -- 172.21.15.7:0/867335040 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c900c07c0 con 0x55676fff2b80 2024-09-19T04:19:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.137+0000 7f6c83fff640 1 -- 172.21.15.7:0/867335040 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f6c9c004cc0 con 0x55676fff2b80 2024-09-19T04:19:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.137+0000 7f6c83fff640 1 -- 172.21.15.7:0/867335040 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6c9c028050 con 0x55676fff2b80 2024-09-19T04:19:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.137+0000 7f6cadcd3740 10 client.25382 fetch_fsmap learned FSMap version 32 2024-09-19T04:19:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.137+0000 7f6cadcd3740 1 -- 172.21.15.7:0/867335040 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55677006cf30 con 0x55676fff2b80 2024-09-19T04:19:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.137+0000 7f6c83fff640 1 -- 172.21.15.7:0/867335040 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c900c07c0 con 0x55676fff2b80 2024-09-19T04:19:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.137+0000 7f6c83fff640 1 -- 172.21.15.7:0/867335040 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f6c9c005350 con 0x55676fff2b80 2024-09-19T04:19:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.137+0000 7f6cadcd3740 10 client.25382 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T04:19:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.138+0000 7f6cadcd3740 10 client.25382 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:19:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.138+0000 7f6cadcd3740 20 client.25382 populate_metadata read hostname 'smithi007' 2024-09-19T04:19:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.138+0000 7f6cadcd3740 1 --2- 172.21.15.7:0/867335040 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x556770002850 0x55677006f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:19:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.138+0000 7f6cadcd3740 4 client.25382 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:19:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.138+0000 7f6cadcd3740 1 -- 172.21.15.7:0/867335040 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55676ff4fd70 con 0x556770002850 2024-09-19T04:19:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.138+0000 7f6ca8ccd640 1 --2- 172.21.15.7:0/867335040 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x556770002850 0x55677006f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:19:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.138+0000 7f6ca8ccd640 1 --2- 172.21.15.7:0/867335040 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x556770002850 0x55677006f9d0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df6a25c3e605291 server_cookie=a8fa6c507dd33b4a in_seq=0 out_seq=0 2024-09-19T04:19:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:44.138+0000 7f6c83fff640 10 client.25382 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:19:45.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:44 smithi092 ceph-mon[34940]: pgmap v439: 129 pgs: 129 active+clean; 142 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 4.7 MiB/s wr, 1.24k op/s 2024-09-19T04:19:45.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:44 smithi007 ceph-mon[31360]: pgmap v439: 129 pgs: 129 active+clean; 142 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 4.7 MiB/s wr, 1.24k op/s 2024-09-19T04:19:45.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:44 smithi102 ceph-mon[35446]: pgmap v439: 129 pgs: 129 active+clean; 142 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 4.7 MiB/s wr, 1.24k op/s 2024-09-19T04:19:46.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:46.861+0000 7f6c83fff640 1 -- 172.21.15.7:0/867335040 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55676ff4fd70 con 0x556770002850 2024-09-19T04:19:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:46.861+0000 7f6c83fff640 10 client.25382 handle_command_reply: tid=0 2024-09-19T04:19:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:46.861+0000 7f6cadcd3740 1 client.25382 shutdown 2024-09-19T04:19:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:46.861+0000 7f6cadcd3740 1 -- 172.21.15.7:0/867335040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55676fff2b80 msgr2=0x55677006b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:19:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:46.861+0000 7f6cadcd3740 1 --2- 172.21.15.7:0/867335040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55676fff2b80 0x55677006b570 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c003c90 tx=0x7f6c9c004410 comp rx=0 tx=0).stop 2024-09-19T04:19:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:46.861+0000 7f6cadcd3740 1 -- 172.21.15.7:0/867335040 shutdown_connections 2024-09-19T04:19:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:46.861+0000 7f6cadcd3740 1 --2- 172.21.15.7:0/867335040 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x556770002850 0x55677006f9d0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:46.861+0000 7f6cadcd3740 1 --2- 172.21.15.7:0/867335040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55676fff2b80 0x55677006b570 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:46.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:46.861+0000 7f6cadcd3740 1 --2- 172.21.15.7:0/867335040 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55676ffedaf0 0x55676fffbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:46.861+0000 7f6c83fff640 0 client.25382 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:19:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:46.861+0000 7f6cadcd3740 1 --2- 172.21.15.7:0/867335040 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55676ffed1b0 0x55676fffb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:46.861+0000 7f6cadcd3740 1 -- 172.21.15.7:0/867335040 >> 172.21.15.7:0/867335040 conn(0x55676ffe0010 msgr2=0x55676fff59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:19:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:46.861+0000 7f6cadcd3740 1 -- 172.21.15.7:0/867335040 shutdown_connections 2024-09-19T04:19:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:46.861+0000 7f6cadcd3740 1 -- 172.21.15.7:0/867335040 wait complete. 2024-09-19T04:19:46.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:46.861+0000 7f6cadcd3740 20 client.25382 trim_cache size 0 max 16384 2024-09-19T04:19:46.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:19:46.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:19:46.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:19:46.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:19:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:46.862+0000 7f6caaf31640 1 -- 172.21.15.7:0/2734107791 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6c940a76d0 msgr2=0x7f6c940a9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:19:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:46.862+0000 7f6caaf31640 1 --2- 172.21.15.7:0/2734107791 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6c940a76d0 0x7f6c940a9b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6ca41971b0 tx=0x7f6c98005f90 comp rx=0 tx=0).stop 2024-09-19T04:19:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:46.862+0000 7f6caaf31640 1 -- 172.21.15.7:0/2734107791 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ca4100a40 msgr2=0x7f6ca4195cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:19:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:46.862+0000 7f6caaf31640 1 --2- 172.21.15.7:0/2734107791 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ca4100a40 0x7f6ca4195cb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6c90031440 tx=0x7f6c90032ce0 comp rx=0 tx=0).stop 2024-09-19T04:19:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:46.862+0000 7f6caaf31640 1 -- 172.21.15.7:0/2734107791 shutdown_connections 2024-09-19T04:19:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:46.862+0000 7f6caaf31640 1 --2- 172.21.15.7:0/2734107791 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6c940a76d0 0x7f6c940a9b90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:46.862+0000 7f6caaf31640 1 --2- 172.21.15.7:0/2734107791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ca41025f0 0x7f6ca419d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:46.862+0000 7f6caaf31640 1 --2- 172.21.15.7:0/2734107791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ca4101c30 0x7f6ca41961f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:46.862+0000 7f6caaf31640 1 --2- 172.21.15.7:0/2734107791 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ca4100a40 0x7f6ca4195cb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:19:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:46.862+0000 7f6caaf31640 1 -- 172.21.15.7:0/2734107791 >> 172.21.15.7:0/2734107791 conn(0x7f6ca40fc1c0 msgr2=0x7f6ca4105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:19:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:46.862+0000 7f6caaf31640 1 -- 172.21.15.7:0/2734107791 shutdown_connections 2024-09-19T04:19:46.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:19:46.862+0000 7f6caaf31640 1 -- 172.21.15.7:0/2734107791 wait complete. 2024-09-19T04:19:47.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:46 smithi092 ceph-mon[34940]: pgmap v440: 129 pgs: 129 active+clean; 166 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 6.3 MiB/s wr, 1.01k op/s 2024-09-19T04:19:47.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:46 smithi007 ceph-mon[31360]: pgmap v440: 129 pgs: 129 active+clean; 166 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 6.3 MiB/s wr, 1.01k op/s 2024-09-19T04:19:47.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:46 smithi102 ceph-mon[35446]: pgmap v440: 129 pgs: 129 active+clean; 166 MiB data, 641 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 6.3 MiB/s wr, 1.01k op/s 2024-09-19T04:19:48.157 INFO:tasks.workunit.client.0.smithi007.stdout: 49 759221 274 543150 330 388602 808 2024-09-19T04:19:49.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:48 smithi092 ceph-mon[34940]: pgmap v441: 129 pgs: 129 active+clean; 167 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 6.2 MiB/s wr, 756 op/s 2024-09-19T04:19:49.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:48 smithi007 ceph-mon[31360]: pgmap v441: 129 pgs: 129 active+clean; 167 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 6.2 MiB/s wr, 756 op/s 2024-09-19T04:19:49.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:48 smithi102 ceph-mon[35446]: pgmap v441: 129 pgs: 129 active+clean; 167 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 6.2 MiB/s wr, 756 op/s 2024-09-19T04:19:51.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:50 smithi092 ceph-mon[34940]: pgmap v442: 129 pgs: 129 active+clean; 153 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 7.8 MiB/s wr, 1.47k op/s 2024-09-19T04:19:51.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:50 smithi007 ceph-mon[31360]: pgmap v442: 129 pgs: 129 active+clean; 153 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 7.8 MiB/s wr, 1.47k op/s 2024-09-19T04:19:51.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:50 smithi102 ceph-mon[35446]: pgmap v442: 129 pgs: 129 active+clean; 153 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 7.8 MiB/s wr, 1.47k op/s 2024-09-19T04:19:53.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:52 smithi092 ceph-mon[34940]: pgmap v443: 129 pgs: 129 active+clean; 153 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 7.3 MiB/s wr, 1.55k op/s 2024-09-19T04:19:53.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:52 smithi007 ceph-mon[31360]: pgmap v443: 129 pgs: 129 active+clean; 153 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 7.3 MiB/s wr, 1.55k op/s 2024-09-19T04:19:53.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:52 smithi102 ceph-mon[35446]: pgmap v443: 129 pgs: 129 active+clean; 153 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 7.3 MiB/s wr, 1.55k op/s 2024-09-19T04:19:55.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:54 smithi092 ceph-mon[34940]: pgmap v444: 129 pgs: 129 active+clean; 160 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.2 MiB/s wr, 1.46k op/s 2024-09-19T04:19:55.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:54 smithi007 ceph-mon[31360]: pgmap v444: 129 pgs: 129 active+clean; 160 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.2 MiB/s wr, 1.46k op/s 2024-09-19T04:19:55.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:54 smithi102 ceph-mon[35446]: pgmap v444: 129 pgs: 129 active+clean; 160 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 7.2 MiB/s wr, 1.46k op/s 2024-09-19T04:19:57.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:56 smithi092 ceph-mon[34940]: pgmap v445: 129 pgs: 129 active+clean; 158 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.9 MiB/s wr, 1.33k op/s 2024-09-19T04:19:57.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:56 smithi007 ceph-mon[31360]: pgmap v445: 129 pgs: 129 active+clean; 158 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.9 MiB/s wr, 1.33k op/s 2024-09-19T04:19:57.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:56 smithi102 ceph-mon[35446]: pgmap v445: 129 pgs: 129 active+clean; 158 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.9 MiB/s wr, 1.33k op/s 2024-09-19T04:19:58.157 INFO:tasks.workunit.client.0.smithi007.stdout: 61 1489761 678 1054202 578 761496 1655 2024-09-19T04:19:59.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:19:58 smithi092 ceph-mon[34940]: pgmap v446: 129 pgs: 129 active+clean; 158 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 1.11k op/s 2024-09-19T04:19:59.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:19:58 smithi007 ceph-mon[31360]: pgmap v446: 129 pgs: 129 active+clean; 158 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 1.11k op/s 2024-09-19T04:19:59.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:19:58 smithi102 ceph-mon[35446]: pgmap v446: 129 pgs: 129 active+clean; 158 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 1.11k op/s 2024-09-19T04:20:00.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.136+0000 7f2ed9c01640 1 -- 172.21.15.7:0/1765574764 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ed40736b0 msgr2=0x7f2ed4119130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.136+0000 7f2ed9c01640 1 --2- 172.21.15.7:0/1765574764 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ed40736b0 0x7f2ed4119130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2ec401a910 tx=0x7f2ec403b470 comp rx=0 tx=0).stop 2024-09-19T04:20:00.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.139+0000 7f2ed9c01640 1 -- 172.21.15.7:0/1765574764 shutdown_connections 2024-09-19T04:20:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.139+0000 7f2ed9c01640 1 --2- 172.21.15.7:0/1765574764 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ed40736b0 0x7f2ed4119130 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.139+0000 7f2ed9c01640 1 --2- 172.21.15.7:0/1765574764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ed4072d10 0x7f2ed4073170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.139+0000 7f2ed9c01640 1 --2- 172.21.15.7:0/1765574764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ed4109700 0x7f2ed4109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:00.142 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.139+0000 7f2ed9c01640 1 -- 172.21.15.7:0/1765574764 >> 172.21.15.7:0/1765574764 conn(0x7f2ed406ecd0 msgr2=0x7f2ed4071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:00.164 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.162+0000 7f2ed9c01640 1 -- 172.21.15.7:0/1765574764 shutdown_connections 2024-09-19T04:20:00.166 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.162+0000 7f2ed9c01640 1 -- 172.21.15.7:0/1765574764 wait complete. 2024-09-19T04:20:00.166 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.163+0000 7f2ed9c01640 1 Processor -- start 2024-09-19T04:20:00.166 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.163+0000 7f2ed9c01640 1 -- start start 2024-09-19T04:20:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.164+0000 7f2ed9c01640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ed4072d10 0x7f2ed419e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.164+0000 7f2ed9c01640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ed40736b0 0x7f2ed419ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.164+0000 7f2ed9c01640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ed4078440 0x7f2ed407a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.164+0000 7f2ed9c01640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed4113680 con 0x7f2ed4072d10 2024-09-19T04:20:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.164+0000 7f2ed9c01640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed4113500 con 0x7f2ed40736b0 2024-09-19T04:20:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.164+0000 7f2ed9c01640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed4113800 con 0x7f2ed4078440 2024-09-19T04:20:00.170 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.164+0000 7f2ed3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ed4078440 0x7f2ed407a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.164+0000 7f2ed3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ed4078440 0x7f2ed407a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:33436/0 (socket says 172.21.15.7:33436) 2024-09-19T04:20:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.164+0000 7f2ed3fff640 1 -- 172.21.15.7:0/1360673872 learned_addr learned my addr 172.21.15.7:0/1360673872 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.164+0000 7f2ed37fe640 1 --2- 172.21.15.7:0/1360673872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ed4072d10 0x7f2ed419e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.166+0000 7f2ed2ffd640 1 --2- 172.21.15.7:0/1360673872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ed40736b0 0x7f2ed419ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.166+0000 7f2ed3fff640 1 -- 172.21.15.7:0/1360673872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ed40736b0 msgr2=0x7f2ed419ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.167+0000 7f2ed3fff640 1 --2- 172.21.15.7:0/1360673872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ed40736b0 0x7f2ed419ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.167+0000 7f2ed3fff640 1 -- 172.21.15.7:0/1360673872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ed4072d10 msgr2=0x7f2ed419e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.167+0000 7f2ed3fff640 1 --2- 172.21.15.7:0/1360673872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ed4072d10 0x7f2ed419e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.167+0000 7f2ed3fff640 1 -- 172.21.15.7:0/1360673872 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ed407aec0 con 0x7f2ed4078440 2024-09-19T04:20:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.167+0000 7f2ed37fe640 1 --2- 172.21.15.7:0/1360673872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ed4072d10 0x7f2ed419e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:20:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.167+0000 7f2ed2ffd640 1 --2- 172.21.15.7:0/1360673872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ed40736b0 0x7f2ed419ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:20:00.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.167+0000 7f2ed3fff640 1 --2- 172.21.15.7:0/1360673872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ed4078440 0x7f2ed407a900 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2ec403ba60 tx=0x7f2ec40048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.169+0000 7f2ed0ff9640 1 -- 172.21.15.7:0/1360673872 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec404f020 con 0x7f2ed4078440 2024-09-19T04:20:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.169+0000 7f2ed9c01640 1 -- 172.21.15.7:0/1360673872 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ed407b150 con 0x7f2ed4078440 2024-09-19T04:20:00.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.169+0000 7f2ed9c01640 1 -- 172.21.15.7:0/1360673872 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ed407b6c0 con 0x7f2ed4078440 2024-09-19T04:20:00.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.170+0000 7f2ed0ff9640 1 -- 172.21.15.7:0/1360673872 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ec4004bf0 con 0x7f2ed4078440 2024-09-19T04:20:00.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.170+0000 7f2ed0ff9640 1 -- 172.21.15.7:0/1360673872 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec4046030 con 0x7f2ed4078440 2024-09-19T04:20:00.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.175+0000 7f2edca72740 1 Processor -- start 2024-09-19T04:20:00.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.179+0000 7f2edca72740 1 -- start start 2024-09-19T04:20:00.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.179+0000 7f2edca72740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4968ab9a0 0x55d4968abda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:00.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.179+0000 7f2edca72740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d4968ac2e0 0x55d4968b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:00.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.179+0000 7f2edca72740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4968b1370 0x55d4968b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:00.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.179+0000 7f2edca72740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d49680f2f0 con 0x55d4968b1370 2024-09-19T04:20:00.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.179+0000 7f2edca72740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d4967b7270 con 0x55d4968ab9a0 2024-09-19T04:20:00.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.179+0000 7f2edca72740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d49680b2b0 con 0x55d4968ac2e0 2024-09-19T04:20:00.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.179+0000 7f2ed37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d4968ac2e0 0x55d4968b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:00.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.179+0000 7f2ed37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d4968ac2e0 0x55d4968b0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:33446/0 (socket says 172.21.15.7:33446) 2024-09-19T04:20:00.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.179+0000 7f2ed37fe640 1 -- 172.21.15.7:0/4162522308 learned_addr learned my addr 172.21.15.7:0/4162522308 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:00.186 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.183+0000 7f2ed37fe640 1 -- 172.21.15.7:0/4162522308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4968ab9a0 msgr2=0x55d4968abda0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T04:20:00.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.183+0000 7f2ed37fe640 1 --2- 172.21.15.7:0/4162522308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4968ab9a0 0x55d4968abda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:00.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.183+0000 7f2ed37fe640 1 -- 172.21.15.7:0/4162522308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4968b1370 msgr2=0x55d4968b3830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T04:20:00.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.183+0000 7f2ed37fe640 1 --2- 172.21.15.7:0/4162522308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4968b1370 0x55d4968b3830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:00.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.183+0000 7f2ed37fe640 1 -- 172.21.15.7:0/4162522308 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4967b6340 con 0x55d4968ac2e0 2024-09-19T04:20:00.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.184+0000 7f2ed37fe640 1 --2- 172.21.15.7:0/4162522308 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d4968ac2e0 0x55d4968b0da0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc009f50 tx=0x7f2ecc00c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a50a89f219c2251 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:00.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.187+0000 7f2eb9ffb640 1 -- 172.21.15.7:0/4162522308 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc01a070 con 0x55d4968ac2e0 2024-09-19T04:20:00.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.187+0000 7f2eb9ffb640 1 -- 172.21.15.7:0/4162522308 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ecc0158f0 con 0x55d4968ac2e0 2024-09-19T04:20:00.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.188+0000 7f2edca72740 1 -- 172.21.15.7:0/4162522308 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d4968ac2e0 msgr2=0x55d4968b0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:00.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.188+0000 7f2edca72740 1 --2- 172.21.15.7:0/4162522308 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d4968ac2e0 0x55d4968b0da0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc009f50 tx=0x7f2ecc00c8b0 comp rx=0 tx=0).stop 2024-09-19T04:20:00.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.189+0000 7f2ed0ff9640 1 -- 172.21.15.7:0/1360673872 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f2ec4052020 con 0x7f2ed4078440 2024-09-19T04:20:00.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.190+0000 7f2edca72740 1 -- 172.21.15.7:0/4162522308 shutdown_connections 2024-09-19T04:20:00.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.190+0000 7f2edca72740 1 --2- 172.21.15.7:0/4162522308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4968b1370 0x55d4968b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:00.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.190+0000 7f2edca72740 1 --2- 172.21.15.7:0/4162522308 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d4968ac2e0 0x55d4968b0da0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:00.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.190+0000 7f2edca72740 1 --2- 172.21.15.7:0/4162522308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4968ab9a0 0x55d4968abda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:00.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.190+0000 7f2edca72740 1 -- 172.21.15.7:0/4162522308 >> 172.21.15.7:0/4162522308 conn(0x55d4968a7010 msgr2=0x55d4968a7410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:00.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.191+0000 7f2ed0ff9640 1 --2- 172.21.15.7:0/1360673872 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2ebc0a3450 0x7f2ebc0a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:00.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.191+0000 7f2ed0ff9640 1 -- 172.21.15.7:0/1360673872 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f2ec4100cd0 con 0x7f2ed4078440 2024-09-19T04:20:00.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.195+0000 7f2ed37fe640 1 --2- 172.21.15.7:0/1360673872 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2ebc0a3450 0x7f2ebc0a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:00.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.209+0000 7f2ed37fe640 1 --2- 172.21.15.7:0/1360673872 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2ebc0a3450 0x7f2ebc0a5910 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc009f20 tx=0x7f2ecc004b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:00.218 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.214+0000 7f2edca72740 1 -- 172.21.15.7:0/4162522308 shutdown_connections 2024-09-19T04:20:00.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.218+0000 7f2edca72740 1 -- 172.21.15.7:0/4162522308 wait complete. 2024-09-19T04:20:00.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.218+0000 7f2edca72740 1 -- start start 2024-09-19T04:20:00.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.218+0000 7f2edca72740 1 Processor -- start 2024-09-19T04:20:00.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.219+0000 7f2edca72740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d4968ac2e0 0x55d4968b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:00.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.219+0000 7f2edca72740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4968b6330 0x55d4968bb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:00.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.219+0000 7f2edca72740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4968b67b0 0x55d4968bd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:00.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.219+0000 7f2edca72740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d4968b4390 con 0x55d4968b6330 2024-09-19T04:20:00.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.219+0000 7f2edca72740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d496798290 con 0x55d4968b67b0 2024-09-19T04:20:00.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.219+0000 7f2edca72740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d4968b4510 con 0x55d4968ac2e0 2024-09-19T04:20:00.225 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.219+0000 7f2edca72740 10 client.0 _ll_register_callbacks cb 0x55d4967c9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:20:00.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.219+0000 7f2ed3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4968b67b0 0x55d4968bd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:00.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.219+0000 7f2ed3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4968b67b0 0x55d4968bd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:42188/0 (socket says 172.21.15.7:42188) 2024-09-19T04:20:00.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.220+0000 7f2ed3fff640 1 -- 172.21.15.7:0/3512232617 learned_addr learned my addr 172.21.15.7:0/3512232617 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:00.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.220+0000 7f2ed3fff640 1 -- 172.21.15.7:0/3512232617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d4968ac2e0 msgr2=0x55d4968b5df0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T04:20:00.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.220+0000 7f2ed3fff640 1 --2- 172.21.15.7:0/3512232617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d4968ac2e0 0x55d4968b5df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:00.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.220+0000 7f2ed3fff640 1 -- 172.21.15.7:0/3512232617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4968b6330 msgr2=0x55d4968bb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:00.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.220+0000 7f2ed3fff640 1 --2- 172.21.15.7:0/3512232617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4968b6330 0x55d4968bb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:00.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.220+0000 7f2ed3fff640 1 -- 172.21.15.7:0/3512232617 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d496522210 con 0x55d4968b67b0 2024-09-19T04:20:00.226 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.220+0000 7f2ed3fff640 1 --2- 172.21.15.7:0/3512232617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4968b67b0 0x55d4968bd910 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2ec40cce70 tx=0x7f2ec40cd5e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cafe8834ed49df08 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:00.227 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.222+0000 7f2eb2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T04:20:00.227 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.222+0000 7f2eb2ffd640 1 -- 172.21.15.7:0/3512232617 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec40d1290 con 0x55d4968b67b0 2024-09-19T04:20:00.227 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.223+0000 7f2edca72740 1 -- 172.21.15.7:0/3512232617 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ecc0158f0 con 0x55d4968b67b0 2024-09-19T04:20:00.227 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.223+0000 7f2eb2ffd640 1 -- 172.21.15.7:0/3512232617 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f2ec40d56c0 con 0x55d4968b67b0 2024-09-19T04:20:00.227 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.224+0000 7f2eb2ffd640 1 -- 172.21.15.7:0/3512232617 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2ec40d5b50 con 0x55d4968b67b0 2024-09-19T04:20:00.227 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.225+0000 7f2edca72740 10 client.25385 fetch_fsmap learned FSMap version 32 2024-09-19T04:20:00.227 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.225+0000 7f2edca72740 1 -- 172.21.15.7:0/3512232617 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d4965ee620 con 0x55d4968b67b0 2024-09-19T04:20:00.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.226+0000 7f2eb2ffd640 1 -- 172.21.15.7:0/3512232617 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ecc0158f0 con 0x55d4968b67b0 2024-09-19T04:20:00.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.226+0000 7f2eb2ffd640 1 -- 172.21.15.7:0/3512232617 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f2ec40cc330 con 0x55d4968b67b0 2024-09-19T04:20:00.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.226+0000 7f2edca72740 10 client.25385 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T04:20:00.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.226+0000 7f2edca72740 10 client.25385 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:20:00.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.226+0000 7f2edca72740 20 client.25385 populate_metadata read hostname 'smithi007' 2024-09-19T04:20:00.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.226+0000 7f2edca72740 1 --2- 172.21.15.7:0/3512232617 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d4968e43a0 0x55d4968e6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:00.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.226+0000 7f2edca72740 4 client.25385 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:20:00.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.226+0000 7f2edca72740 1 -- 172.21.15.7:0/3512232617 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d49681ca20 con 0x55d4968e43a0 2024-09-19T04:20:00.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.228+0000 7f2ed37fe640 1 --2- 172.21.15.7:0/3512232617 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d4968e43a0 0x55d4968e6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:00.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.230+0000 7f2eb2ffd640 10 client.25385 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:20:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.230+0000 7f2ed37fe640 1 --2- 172.21.15.7:0/3512232617 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d4968e43a0 0x55d4968e6840 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47e5cc46dff67039 server_cookie=1ace9614f6847e38 in_seq=0 out_seq=0 2024-09-19T04:20:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.235+0000 7f2eb2ffd640 1 -- 172.21.15.7:0/3512232617 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d49681ca20 con 0x55d4968e43a0 2024-09-19T04:20:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.235+0000 7f2eb2ffd640 10 client.25385 handle_command_reply: tid=0 2024-09-19T04:20:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.237+0000 7f2edca72740 1 client.25385 shutdown 2024-09-19T04:20:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.268+0000 7f2edca72740 1 -- 172.21.15.7:0/3512232617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4968b67b0 msgr2=0x55d4968bd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:00.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.268+0000 7f2edca72740 1 --2- 172.21.15.7:0/3512232617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4968b67b0 0x55d4968bd910 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2ec40cce70 tx=0x7f2ec40cd5e0 comp rx=0 tx=0).stop 2024-09-19T04:20:00.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.272+0000 7f2edca72740 1 -- 172.21.15.7:0/3512232617 shutdown_connections 2024-09-19T04:20:00.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.272+0000 7f2edca72740 1 --2- 172.21.15.7:0/3512232617 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d4968e43a0 0x55d4968e6840 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:00.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.273+0000 7f2edca72740 1 --2- 172.21.15.7:0/3512232617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4968b67b0 0x55d4968bd910 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:00.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.273+0000 7f2edca72740 1 --2- 172.21.15.7:0/3512232617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4968b6330 0x55d4968bb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:00.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.273+0000 7f2edca72740 1 --2- 172.21.15.7:0/3512232617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d4968ac2e0 0x55d4968b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:00.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.273+0000 7f2edca72740 1 -- 172.21.15.7:0/3512232617 >> 172.21.15.7:0/3512232617 conn(0x55d4968a7010 msgr2=0x55d4968a8820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:00.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.273+0000 7f2eb2ffd640 0 client.25385 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:20:00.278 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.276+0000 7f2edca72740 1 -- 172.21.15.7:0/3512232617 shutdown_connections 2024-09-19T04:20:00.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.278+0000 7f2edca72740 1 -- 172.21.15.7:0/3512232617 wait complete. 2024-09-19T04:20:00.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.279+0000 7f2edca72740 20 client.25385 trim_cache size 0 max 16384 2024-09-19T04:20:00.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.352+0000 7f2edca72740 1 Processor -- start 2024-09-19T04:20:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.356+0000 7f2edca72740 1 -- start start 2024-09-19T04:20:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.357+0000 7f2edca72740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4968ac2e0 0x55d4968b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.357+0000 7f2edca72740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d4968b6330 0x55d4968a60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.357+0000 7f2edca72740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4968b67b0 0x55d4968bd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.357+0000 7f2ed37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4968ac2e0 0x55d4968b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.357+0000 7f2edca72740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec000fdb0 con 0x55d4968b67b0 2024-09-19T04:20:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.357+0000 7f2edca72740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec00119b0 con 0x55d4968ac2e0 2024-09-19T04:20:00.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.357+0000 7f2edca72740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec0010480 con 0x55d4968b6330 2024-09-19T04:20:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.357+0000 7f2ed37fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4968ac2e0 0x55d4968b57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:42196/0 (socket says 172.21.15.7:42196) 2024-09-19T04:20:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.357+0000 7f2ed37fe640 1 -- 172.21.15.7:0/3538116324 learned_addr learned my addr 172.21.15.7:0/3538116324 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.357+0000 7f2ed2ffd640 1 --2- 172.21.15.7:0/3538116324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d4968b6330 0x55d4968a60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.357+0000 7f2ed37fe640 1 -- 172.21.15.7:0/3538116324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d4968b6330 msgr2=0x55d4968a60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.357+0000 7f2ed37fe640 1 --2- 172.21.15.7:0/3538116324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d4968b6330 0x55d4968a60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.357+0000 7f2ed37fe640 1 -- 172.21.15.7:0/3538116324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4968b67b0 msgr2=0x55d4968bd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.357+0000 7f2ed37fe640 1 --2- 172.21.15.7:0/3538116324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4968b67b0 0x55d4968bd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.358+0000 7f2ed37fe640 1 -- 172.21.15.7:0/3538116324 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4968a6e30 con 0x55d4968ac2e0 2024-09-19T04:20:00.362 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.358+0000 7f2ed37fe640 1 --2- 172.21.15.7:0/3538116324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4968ac2e0 0x55d4968b57f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc00cdb0 tx=0x7f2ecc01e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22ee73fc1e4821f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.360+0000 7f2eb97fa640 1 -- 172.21.15.7:0/3538116324 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc027040 con 0x55d4968ac2e0 2024-09-19T04:20:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.360+0000 7f2eb97fa640 1 -- 172.21.15.7:0/3538116324 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ecc020da0 con 0x55d4968ac2e0 2024-09-19T04:20:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.361+0000 7f2edca72740 1 -- 172.21.15.7:0/3538116324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4968ac2e0 msgr2=0x55d4968b57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:00.363 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.361+0000 7f2edca72740 1 --2- 172.21.15.7:0/3538116324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4968ac2e0 0x55d4968b57f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc00cdb0 tx=0x7f2ecc01e000 comp rx=0 tx=0).stop 2024-09-19T04:20:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.362+0000 7f2edca72740 1 -- 172.21.15.7:0/3538116324 shutdown_connections 2024-09-19T04:20:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.362+0000 7f2edca72740 1 --2- 172.21.15.7:0/3538116324 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4968b67b0 0x55d4968bd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.362+0000 7f2edca72740 1 --2- 172.21.15.7:0/3538116324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d4968b6330 0x55d4968a60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.362+0000 7f2edca72740 1 --2- 172.21.15.7:0/3538116324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4968ac2e0 0x55d4968b57f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:00.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.362+0000 7f2edca72740 1 -- 172.21.15.7:0/3538116324 >> 172.21.15.7:0/3538116324 conn(0x55d4968a7010 msgr2=0x55d4968a59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:00.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.385+0000 7f2edca72740 1 -- 172.21.15.7:0/3538116324 shutdown_connections 2024-09-19T04:20:00.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.387+0000 7f2edca72740 1 -- 172.21.15.7:0/3538116324 wait complete. 2024-09-19T04:20:00.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.388+0000 7f2edca72740 1 -- start start 2024-09-19T04:20:00.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.388+0000 7f2edca72740 1 Processor -- start 2024-09-19T04:20:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.389+0000 7f2edca72740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d4968ac2e0 0x55d4968bad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.389+0000 7f2edca72740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4968b6330 0x55d4968bb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.389+0000 7f2edca72740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4968b67b0 0x55d4968bc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.389+0000 7f2edca72740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec0011220 con 0x55d4968b6330 2024-09-19T04:20:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.389+0000 7f2edca72740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec0010b50 con 0x55d4968b67b0 2024-09-19T04:20:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.390+0000 7f2ed37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d4968ac2e0 0x55d4968bad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.390+0000 7f2edca72740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec000dd70 con 0x55d4968ac2e0 2024-09-19T04:20:00.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.390+0000 7f2edca72740 10 client.0 _ll_register_callbacks cb 0x7f2ec401a5f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:20:00.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.390+0000 7f2ed3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4968b67b0 0x55d4968bc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:00.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.390+0000 7f2ed3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4968b67b0 0x55d4968bc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:42208/0 (socket says 172.21.15.7:42208) 2024-09-19T04:20:00.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.390+0000 7f2ed3fff640 1 -- 172.21.15.7:0/1391286011 learned_addr learned my addr 172.21.15.7:0/1391286011 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:00.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.394+0000 7f2ed2ffd640 1 --2- 172.21.15.7:0/1391286011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4968b6330 0x55d4968bb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:00.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.396+0000 7f2ed3fff640 1 -- 172.21.15.7:0/1391286011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d4968ac2e0 msgr2=0x55d4968bad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:00.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.396+0000 7f2ed3fff640 1 --2- 172.21.15.7:0/1391286011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d4968ac2e0 0x55d4968bad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:00.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.396+0000 7f2ed3fff640 1 -- 172.21.15.7:0/1391286011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4968b6330 msgr2=0x55d4968bb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:00.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.396+0000 7f2ed3fff640 1 --2- 172.21.15.7:0/1391286011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4968b6330 0x55d4968bb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:00.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.396+0000 7f2ed3fff640 1 -- 172.21.15.7:0/1391286011 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4968bc8d0 con 0x55d4968b67b0 2024-09-19T04:20:00.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.398+0000 7f2ed3fff640 1 --2- 172.21.15.7:0/1391286011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4968b67b0 0x55d4968bc2c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2ec40ccbe0 tx=0x7f2ec40057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccaa5dfb575a3fa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:00.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.400+0000 7f2eb2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T04:20:00.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.401+0000 7f2eb2ffd640 1 -- 172.21.15.7:0/1391286011 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec40cc840 con 0x55d4968b67b0 2024-09-19T04:20:00.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.401+0000 7f2eb2ffd640 1 -- 172.21.15.7:0/1391286011 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f2ec40d56c0 con 0x55d4968b67b0 2024-09-19T04:20:00.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.401+0000 7f2edca72740 1 -- 172.21.15.7:0/1391286011 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ecc020da0 con 0x55d4968b67b0 2024-09-19T04:20:00.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.402+0000 7f2eb2ffd640 1 -- 172.21.15.7:0/1391286011 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f2ec40d58c0 con 0x55d4968b67b0 2024-09-19T04:20:00.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.405+0000 7f2edca72740 10 client.25391 fetch_fsmap learned FSMap version 32 2024-09-19T04:20:00.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.405+0000 7f2edca72740 1 -- 172.21.15.7:0/1391286011 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d4968bdbe0 con 0x55d4968b67b0 2024-09-19T04:20:00.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.409+0000 7f2eb2ffd640 1 -- 172.21.15.7:0/1391286011 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ecc020da0 con 0x55d4968b67b0 2024-09-19T04:20:00.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.409+0000 7f2eb2ffd640 1 -- 172.21.15.7:0/1391286011 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f2ec40cbda0 con 0x55d4968b67b0 2024-09-19T04:20:00.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.409+0000 7f2edca72740 10 client.25391 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T04:20:00.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.409+0000 7f2edca72740 10 client.25391 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:20:00.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.409+0000 7f2edca72740 20 client.25391 populate_metadata read hostname 'smithi007' 2024-09-19T04:20:00.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.409+0000 7f2edca72740 1 --2- 172.21.15.7:0/1391286011 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d49694f770 0x55d496951b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:00.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.409+0000 7f2edca72740 4 client.25391 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:20:00.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.409+0000 7f2edca72740 1 -- 172.21.15.7:0/1391286011 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d496816d70 con 0x55d49694f770 2024-09-19T04:20:00.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.411+0000 7f2ed37fe640 1 --2- 172.21.15.7:0/1391286011 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d49694f770 0x55d496951b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:00.415 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.413+0000 7f2eb2ffd640 10 client.25391 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:20:00.415 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:00.413+0000 7f2ed37fe640 1 --2- 172.21.15.7:0/1391286011 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d49694f770 0x55d496951b90 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4a417e34fab6acf server_cookie=b3939251ec8b0718 in_seq=0 out_seq=0 2024-09-19T04:20:01.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:00 smithi092 ceph-mon[34940]: pgmap v447: 129 pgs: 129 active+clean; 164 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.2 MiB/s wr, 1.15k op/s 2024-09-19T04:20:01.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:00 smithi092 ceph-mon[34940]: overall HEALTH_OK 2024-09-19T04:20:01.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:00 smithi007 ceph-mon[31360]: pgmap v447: 129 pgs: 129 active+clean; 164 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.2 MiB/s wr, 1.15k op/s 2024-09-19T04:20:01.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:00 smithi007 ceph-mon[31360]: overall HEALTH_OK 2024-09-19T04:20:01.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:00 smithi102 ceph-mon[35446]: pgmap v447: 129 pgs: 129 active+clean; 164 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.2 MiB/s wr, 1.15k op/s 2024-09-19T04:20:01.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:00 smithi102 ceph-mon[35446]: overall HEALTH_OK 2024-09-19T04:20:03.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:02 smithi092 ceph-mon[34940]: pgmap v448: 129 pgs: 129 active+clean; 168 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 488 op/s 2024-09-19T04:20:03.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:02 smithi007 ceph-mon[31360]: pgmap v448: 129 pgs: 129 active+clean; 168 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 488 op/s 2024-09-19T04:20:03.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:02 smithi102 ceph-mon[35446]: pgmap v448: 129 pgs: 129 active+clean; 168 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 488 op/s 2024-09-19T04:20:03.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:03.561+0000 7f2eb2ffd640 1 -- 172.21.15.7:0/1391286011 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d496816d70 con 0x55d49694f770 2024-09-19T04:20:03.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:03.562+0000 7f2eb2ffd640 10 client.25391 handle_command_reply: tid=0 2024-09-19T04:20:03.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:03.562+0000 7f2edca72740 1 client.25391 shutdown 2024-09-19T04:20:03.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:03.562+0000 7f2edca72740 1 -- 172.21.15.7:0/1391286011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4968b67b0 msgr2=0x55d4968bc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:03.562+0000 7f2edca72740 1 --2- 172.21.15.7:0/1391286011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4968b67b0 0x55d4968bc2c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2ec40ccbe0 tx=0x7f2ec40057c0 comp rx=0 tx=0).stop 2024-09-19T04:20:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:03.562+0000 7f2edca72740 1 -- 172.21.15.7:0/1391286011 shutdown_connections 2024-09-19T04:20:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:03.562+0000 7f2edca72740 1 --2- 172.21.15.7:0/1391286011 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d49694f770 0x55d496951b90 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:03.562+0000 7f2edca72740 1 --2- 172.21.15.7:0/1391286011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d4968b67b0 0x55d4968bc2c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:03.562+0000 7f2edca72740 1 --2- 172.21.15.7:0/1391286011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d4968b6330 0x55d4968bb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:03.562+0000 7f2edca72740 1 --2- 172.21.15.7:0/1391286011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d4968ac2e0 0x55d4968bad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:03.562+0000 7f2edca72740 1 -- 172.21.15.7:0/1391286011 >> 172.21.15.7:0/1391286011 conn(0x55d4968a7010 msgr2=0x55d4968a61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:03.563+0000 7f2eb2ffd640 0 client.25391 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:20:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:03.563+0000 7f2edca72740 1 -- 172.21.15.7:0/1391286011 shutdown_connections 2024-09-19T04:20:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:03.563+0000 7f2edca72740 1 -- 172.21.15.7:0/1391286011 wait complete. 2024-09-19T04:20:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:03.563+0000 7f2edca72740 20 client.25391 trim_cache size 0 max 16384 2024-09-19T04:20:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:20:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:20:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:20:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:20:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:03.564+0000 7f2ed9c01640 1 -- 172.21.15.7:0/1360673872 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2ebc0a3450 msgr2=0x7f2ebc0a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:03.564+0000 7f2ed9c01640 1 --2- 172.21.15.7:0/1360673872 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2ebc0a3450 0x7f2ebc0a5910 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc009f20 tx=0x7f2ecc004b50 comp rx=0 tx=0).stop 2024-09-19T04:20:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:03.564+0000 7f2ed9c01640 1 -- 172.21.15.7:0/1360673872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ed4078440 msgr2=0x7f2ed407a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:03.564+0000 7f2ed9c01640 1 --2- 172.21.15.7:0/1360673872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ed4078440 0x7f2ed407a900 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2ec403ba60 tx=0x7f2ec40048f0 comp rx=0 tx=0).stop 2024-09-19T04:20:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:03.564+0000 7f2ed9c01640 1 -- 172.21.15.7:0/1360673872 shutdown_connections 2024-09-19T04:20:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:03.564+0000 7f2ed9c01640 1 --2- 172.21.15.7:0/1360673872 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f2ebc0a3450 0x7f2ebc0a5910 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:03.564+0000 7f2ed9c01640 1 --2- 172.21.15.7:0/1360673872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ed4078440 0x7f2ed407a900 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:03.564+0000 7f2ed9c01640 1 --2- 172.21.15.7:0/1360673872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ed40736b0 0x7f2ed419ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:03.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:03.564+0000 7f2ed9c01640 1 --2- 172.21.15.7:0/1360673872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2ed4072d10 0x7f2ed419e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:03.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:03.564+0000 7f2ed9c01640 1 -- 172.21.15.7:0/1360673872 >> 172.21.15.7:0/1360673872 conn(0x7f2ed406ecd0 msgr2=0x7f2ed41161f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:03.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:03.564+0000 7f2ed9c01640 1 -- 172.21.15.7:0/1360673872 shutdown_connections 2024-09-19T04:20:03.568 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:03.564+0000 7f2ed9c01640 1 -- 172.21.15.7:0/1360673872 wait complete. 2024-09-19T04:20:05.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:04 smithi092 ceph-mon[34940]: pgmap v449: 129 pgs: 129 active+clean; 191 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 794 op/s 2024-09-19T04:20:05.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:04 smithi007 ceph-mon[31360]: pgmap v449: 129 pgs: 129 active+clean; 191 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 794 op/s 2024-09-19T04:20:05.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:04 smithi102 ceph-mon[35446]: pgmap v449: 129 pgs: 129 active+clean; 191 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 794 op/s 2024-09-19T04:20:07.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:07 smithi092 ceph-mon[34940]: pgmap v450: 129 pgs: 129 active+clean; 219 MiB data, 816 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.9 MiB/s wr, 1.44k op/s 2024-09-19T04:20:07.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:06 smithi007 ceph-mon[31360]: pgmap v450: 129 pgs: 129 active+clean; 219 MiB data, 816 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.9 MiB/s wr, 1.44k op/s 2024-09-19T04:20:07.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:06 smithi102 ceph-mon[35446]: pgmap v450: 129 pgs: 129 active+clean; 219 MiB data, 816 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.9 MiB/s wr, 1.44k op/s 2024-09-19T04:20:08.157 INFO:tasks.workunit.client.0.smithi007.stdout: 65 1086489 267 772438 242 621519 855 2024-09-19T04:20:09.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:09 smithi092 ceph-mon[34940]: pgmap v451: 129 pgs: 129 active+clean; 221 MiB data, 809 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.0 MiB/s wr, 1.48k op/s 2024-09-19T04:20:09.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:09 smithi007 ceph-mon[31360]: pgmap v451: 129 pgs: 129 active+clean; 221 MiB data, 809 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.0 MiB/s wr, 1.48k op/s 2024-09-19T04:20:09.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:09 smithi102 ceph-mon[35446]: pgmap v451: 129 pgs: 129 active+clean; 221 MiB data, 809 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.0 MiB/s wr, 1.48k op/s 2024-09-19T04:20:11.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:11 smithi092 ceph-mon[34940]: pgmap v452: 129 pgs: 129 active+clean; 210 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.8 MiB/s wr, 1.67k op/s 2024-09-19T04:20:11.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:11 smithi007 ceph-mon[31360]: pgmap v452: 129 pgs: 129 active+clean; 210 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.8 MiB/s wr, 1.67k op/s 2024-09-19T04:20:11.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:11 smithi102 ceph-mon[35446]: pgmap v452: 129 pgs: 129 active+clean; 210 MiB data, 829 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.8 MiB/s wr, 1.67k op/s 2024-09-19T04:20:12.133 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 16.6 2024-09-19T04:20:12.134 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:20:13.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:13 smithi092 ceph-mon[34940]: pgmap v453: 129 pgs: 129 active+clean; 212 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.4 MiB/s wr, 1.68k op/s 2024-09-19T04:20:13.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:13 smithi007 ceph-mon[31360]: pgmap v453: 129 pgs: 129 active+clean; 212 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.4 MiB/s wr, 1.68k op/s 2024-09-19T04:20:13.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:13 smithi102 ceph-mon[35446]: pgmap v453: 129 pgs: 129 active+clean; 212 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.4 MiB/s wr, 1.68k op/s 2024-09-19T04:20:13.486 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:20:14.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.082+0000 7f339688b640 1 -- 172.21.15.7:0/1200683033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3390109830 msgr2=0x7f3390109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:14.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.082+0000 7f339688b640 1 --2- 172.21.15.7:0/1200683033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3390109830 0x7f3390109c90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3388009ca0 tx=0x7f338802a8c0 comp rx=0 tx=0).stop 2024-09-19T04:20:14.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.090+0000 7f339688b640 1 -- 172.21.15.7:0/1200683033 shutdown_connections 2024-09-19T04:20:14.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.090+0000 7f339688b640 1 --2- 172.21.15.7:0/1200683033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f339011b140 0x7f339011d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:14.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.090+0000 7f339688b640 1 --2- 172.21.15.7:0/1200683033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3390109830 0x7f3390109c90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:14.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.090+0000 7f339688b640 1 --2- 172.21.15.7:0/1200683033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3390109450 0x7f3390110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:14.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.090+0000 7f339688b640 1 -- 172.21.15.7:0/1200683033 >> 172.21.15.7:0/1200683033 conn(0x7f339006e140 msgr2=0x7f339006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:14.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.090+0000 7f339688b640 1 -- 172.21.15.7:0/1200683033 shutdown_connections 2024-09-19T04:20:14.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.092+0000 7f339688b640 1 -- 172.21.15.7:0/1200683033 wait complete. 2024-09-19T04:20:14.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.093+0000 7f339688b640 1 Processor -- start 2024-09-19T04:20:14.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.093+0000 7f339688b640 1 -- start start 2024-09-19T04:20:14.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.094+0000 7f339688b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3390109450 0x7f33901a7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:14.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.094+0000 7f339688b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3390109830 0x7f33901a77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:14.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.094+0000 7f339688b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f339011b140 0x7f33901abb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:14.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.094+0000 7f339688b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3390120df0 con 0x7f3390109450 2024-09-19T04:20:14.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.094+0000 7f339688b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3390120c70 con 0x7f339011b140 2024-09-19T04:20:14.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.094+0000 7f339688b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3390120f70 con 0x7f3390109830 2024-09-19T04:20:14.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.094+0000 7f3394e28640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f339011b140 0x7f33901abb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:14.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.094+0000 7f3394e28640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f339011b140 0x7f33901abb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:51226/0 (socket says 172.21.15.7:51226) 2024-09-19T04:20:14.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.094+0000 7f3394e28640 1 -- 172.21.15.7:0/3730734756 learned_addr learned my addr 172.21.15.7:0/3730734756 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:14.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.094+0000 7f338f7fe640 1 --2- 172.21.15.7:0/3730734756 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3390109830 0x7f33901a77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:14.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.096+0000 7f3394e28640 1 -- 172.21.15.7:0/3730734756 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3390109830 msgr2=0x7f33901a77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:14.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.096+0000 7f3394e28640 1 --2- 172.21.15.7:0/3730734756 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3390109830 0x7f33901a77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:14.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.096+0000 7f3394e28640 1 -- 172.21.15.7:0/3730734756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3390109450 msgr2=0x7f33901a7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:14.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.096+0000 7f3394e28640 1 --2- 172.21.15.7:0/3730734756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3390109450 0x7f33901a7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:14.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.096+0000 7f3394e28640 1 -- 172.21.15.7:0/3730734756 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33901ac240 con 0x7f339011b140 2024-09-19T04:20:14.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.108+0000 7f3394e28640 1 --2- 172.21.15.7:0/3730734756 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f339011b140 0x7f33901abb60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f338400c970 tx=0x7f338400ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:14.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.110+0000 7f338d7fa640 1 -- 172.21.15.7:0/3730734756 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3384007bb0 con 0x7f339011b140 2024-09-19T04:20:14.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.111+0000 7f339688b640 1 -- 172.21.15.7:0/3730734756 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33901ac530 con 0x7f339011b140 2024-09-19T04:20:14.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.111+0000 7f339688b640 1 -- 172.21.15.7:0/3730734756 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33901b3e10 con 0x7f339011b140 2024-09-19T04:20:14.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.111+0000 7f338d7fa640 1 -- 172.21.15.7:0/3730734756 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3384007d50 con 0x7f339011b140 2024-09-19T04:20:14.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.111+0000 7f338d7fa640 1 -- 172.21.15.7:0/3730734756 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338400f450 con 0x7f339011b140 2024-09-19T04:20:14.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.115+0000 7f339688b640 1 -- 172.21.15.7:0/3730734756 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f337c005290 con 0x7f339011b140 2024-09-19T04:20:14.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.118+0000 7f338d7fa640 1 -- 172.21.15.7:0/3730734756 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f3384004f60 con 0x7f339011b140 2024-09-19T04:20:14.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.120+0000 7f338d7fa640 1 --2- 172.21.15.7:0/3730734756 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f33780a3300 0x7f33780a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:14.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.120+0000 7f338d7fa640 1 -- 172.21.15.7:0/3730734756 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f33840cf800 con 0x7f339011b140 2024-09-19T04:20:14.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.122+0000 7f338ffff640 1 --2- 172.21.15.7:0/3730734756 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f33780a3300 0x7f33780a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:14.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.123+0000 7f338ffff640 1 --2- 172.21.15.7:0/3730734756 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f33780a3300 0x7f33780a57c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f33800058c0 tx=0x7f3380005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:14.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.124+0000 7f338d7fa640 1 -- 172.21.15.7:0/3730734756 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3384014030 con 0x7f339011b140 2024-09-19T04:20:14.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.526+0000 7f339688b640 1 -- 172.21.15.7:0/3730734756 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f337c005580 con 0x7f339011b140 2024-09-19T04:20:14.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.527+0000 7f338d7fa640 1 -- 172.21.15.7:0/3730734756 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11969 (secure 0 0 0) 0x7f338409c150 con 0x7f339011b140 2024-09-19T04:20:14.528 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:20:14.528 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":32,"btime":"2024-09-19T04:19:33:910404+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:19:32.925740+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24496,"mds_2":24482,"mds_3":24478,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24472,24478,24482,24496,24506]},"id":1}]} 2024-09-19T04:20:14.529 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 32 2024-09-19T04:20:14.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.530+0000 7f339688b640 1 -- 172.21.15.7:0/3730734756 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f33780a3300 msgr2=0x7f33780a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:14.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.530+0000 7f339688b640 1 --2- 172.21.15.7:0/3730734756 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f33780a3300 0x7f33780a57c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f33800058c0 tx=0x7f3380005850 comp rx=0 tx=0).stop 2024-09-19T04:20:14.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.531+0000 7f339688b640 1 -- 172.21.15.7:0/3730734756 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f339011b140 msgr2=0x7f33901abb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:14.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.531+0000 7f339688b640 1 --2- 172.21.15.7:0/3730734756 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f339011b140 0x7f33901abb60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f338400c970 tx=0x7f338400ce30 comp rx=0 tx=0).stop 2024-09-19T04:20:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.531+0000 7f339688b640 1 -- 172.21.15.7:0/3730734756 shutdown_connections 2024-09-19T04:20:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.531+0000 7f339688b640 1 --2- 172.21.15.7:0/3730734756 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f33780a3300 0x7f33780a57c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.531+0000 7f339688b640 1 --2- 172.21.15.7:0/3730734756 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f339011b140 0x7f33901abb60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.531+0000 7f339688b640 1 --2- 172.21.15.7:0/3730734756 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3390109830 0x7f33901a77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.531+0000 7f339688b640 1 --2- 172.21.15.7:0/3730734756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3390109450 0x7f33901a7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.531+0000 7f339688b640 1 -- 172.21.15.7:0/3730734756 >> 172.21.15.7:0/3730734756 conn(0x7f339006e140 msgr2=0x7f339011bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.531+0000 7f339688b640 1 -- 172.21.15.7:0/3730734756 shutdown_connections 2024-09-19T04:20:14.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:14.531+0000 7f339688b640 1 -- 172.21.15.7:0/3730734756 wait complete. 2024-09-19T04:20:15.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:15 smithi007 ceph-mon[31360]: pgmap v454: 129 pgs: 129 active+clean; 220 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.8 MiB/s wr, 1.67k op/s 2024-09-19T04:20:15.128 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:15 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3730734756' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:20:15.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:15 smithi092 ceph-mon[34940]: pgmap v454: 129 pgs: 129 active+clean; 220 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.8 MiB/s wr, 1.67k op/s 2024-09-19T04:20:15.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:15 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3730734756' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:20:15.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:15 smithi102 ceph-mon[35446]: pgmap v454: 129 pgs: 129 active+clean; 220 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.8 MiB/s wr, 1.67k op/s 2024-09-19T04:20:15.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:15 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3730734756' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:20:15.848 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24506 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0' 2024-09-19T04:20:15.848 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24506 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0 2024-09-19T04:20:17.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:17 smithi007 ceph-mon[31360]: pgmap v455: 129 pgs: 129 active+clean; 218 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.7 MiB/s wr, 1.14k op/s 2024-09-19T04:20:17.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.127+0000 7fbac4b9f640 1 -- 172.21.15.7:0/740028632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbac0101ab0 msgr2=0x7fbac0101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:17.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.127+0000 7fbac4b9f640 1 --2- 172.21.15.7:0/740028632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbac0101ab0 0x7fbac0101f30 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fbab0009900 tx=0x7fbab002a410 comp rx=0 tx=0).stop 2024-09-19T04:20:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.129+0000 7fbac4b9f640 1 -- 172.21.15.7:0/740028632 shutdown_connections 2024-09-19T04:20:17.130 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.129+0000 7fbac4b9f640 1 --2- 172.21.15.7:0/740028632 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbac0102470 0x7fbac0108d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.129+0000 7fbac4b9f640 1 --2- 172.21.15.7:0/740028632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbac0101ab0 0x7fbac0101f30 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.129+0000 7fbac4b9f640 1 --2- 172.21.15.7:0/740028632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbac01008c0 0x7fbac0100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.129+0000 7fbac4b9f640 1 -- 172.21.15.7:0/740028632 >> 172.21.15.7:0/740028632 conn(0x7fbac00fc020 msgr2=0x7fbac00fe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.129+0000 7fbac4b9f640 1 -- 172.21.15.7:0/740028632 shutdown_connections 2024-09-19T04:20:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.129+0000 7fbac4b9f640 1 -- 172.21.15.7:0/740028632 wait complete. 2024-09-19T04:20:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.130+0000 7fbac4b9f640 1 Processor -- start 2024-09-19T04:20:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.130+0000 7fbac4b9f640 1 -- start start 2024-09-19T04:20:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.131+0000 7fbac4b9f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbac01008c0 0x7fbac019e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.131+0000 7fbac4b9f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbac0101ab0 0x7fbac019e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.131+0000 7fbac4b9f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbac0102470 0x7fbac01a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.131+0000 7fbac4b9f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbac010b410 con 0x7fbac01008c0 2024-09-19T04:20:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.131+0000 7fbac4b9f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbac010b290 con 0x7fbac0102470 2024-09-19T04:20:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.131+0000 7fbac4b9f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbac010b590 con 0x7fbac0101ab0 2024-09-19T04:20:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.131+0000 7fbabed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbac0102470 0x7fbac01a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.131+0000 7fbabdd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbac0101ab0 0x7fbac019e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.131+0000 7fbabe59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbac01008c0 0x7fbac019e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.131+0000 7fbabdd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbac0101ab0 0x7fbac019e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:43962/0 (socket says 172.21.15.7:43962) 2024-09-19T04:20:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.131+0000 7fbabed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbac0102470 0x7fbac01a5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:51250/0 (socket says 172.21.15.7:51250) 2024-09-19T04:20:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.131+0000 7fbabdd9b640 1 -- 172.21.15.7:0/724636510 learned_addr learned my addr 172.21.15.7:0/724636510 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.131+0000 7fbabdd9b640 1 -- 172.21.15.7:0/724636510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbac0102470 msgr2=0x7fbac01a5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.131+0000 7fbabdd9b640 1 --2- 172.21.15.7:0/724636510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbac0102470 0x7fbac01a5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.131+0000 7fbabdd9b640 1 -- 172.21.15.7:0/724636510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbac01008c0 msgr2=0x7fbac019e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.132+0000 7fbabdd9b640 1 --2- 172.21.15.7:0/724636510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbac01008c0 0x7fbac019e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.132+0000 7fbabdd9b640 1 -- 172.21.15.7:0/724636510 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac01a5ea0 con 0x7fbac0101ab0 2024-09-19T04:20:17.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.132+0000 7fbabe59c640 1 --2- 172.21.15.7:0/724636510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbac01008c0 0x7fbac019e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:20:17.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.132+0000 7fbabdd9b640 1 --2- 172.21.15.7:0/724636510 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbac0101ab0 0x7fbac019e7f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbab0009230 tx=0x7fbab00042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:17.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.132+0000 7fbaaf7fe640 1 -- 172.21.15.7:0/724636510 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab003f030 con 0x7fbac0101ab0 2024-09-19T04:20:17.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.132+0000 7fbaaf7fe640 1 -- 172.21.15.7:0/724636510 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbab0003ce0 con 0x7fbac0101ab0 2024-09-19T04:20:17.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.132+0000 7fbaaf7fe640 1 -- 172.21.15.7:0/724636510 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab0035070 con 0x7fbac0101ab0 2024-09-19T04:20:17.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.132+0000 7fbac4b9f640 1 -- 172.21.15.7:0/724636510 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbac01a6130 con 0x7fbac0101ab0 2024-09-19T04:20:17.135 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.132+0000 7fbac4b9f640 1 -- 172.21.15.7:0/724636510 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbac01a65d0 con 0x7fbac0101ab0 2024-09-19T04:20:17.136 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.135+0000 7fbac7a17740 1 Processor -- start 2024-09-19T04:20:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.136+0000 7fbac7a17740 1 -- start start 2024-09-19T04:20:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.136+0000 7fbac7a17740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561738967b70 0x561738967f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.136+0000 7fbac7a17740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617389684b0 0x56173896cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.136+0000 7fbac7a17740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56173896d540 0x56173896fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.136+0000 7fbac7a17740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5617388cb2f0 con 0x56173896d540 2024-09-19T04:20:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.136+0000 7fbac7a17740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561738873270 con 0x5617389684b0 2024-09-19T04:20:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.136+0000 7fbac7a17740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5617388c72b0 con 0x561738967b70 2024-09-19T04:20:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.136+0000 7fbabed9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561738967b70 0x561738967f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.136+0000 7fbabed9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561738967b70 0x561738967f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:43974/0 (socket says 172.21.15.7:43974) 2024-09-19T04:20:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.136+0000 7fbabed9d640 1 -- 172.21.15.7:0/558003293 learned_addr learned my addr 172.21.15.7:0/558003293 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.136+0000 7fbabe59c640 1 --2- 172.21.15.7:0/558003293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617389684b0 0x56173896cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.136+0000 7fbaaf7fe640 1 -- 172.21.15.7:0/724636510 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fbab0042030 con 0x7fbac0101ab0 2024-09-19T04:20:17.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.136+0000 7fbabed9d640 1 -- 172.21.15.7:0/558003293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617389684b0 msgr2=0x56173896cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:17.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.136+0000 7fbabed9d640 1 --2- 172.21.15.7:0/558003293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617389684b0 0x56173896cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.136+0000 7fbabed9d640 1 -- 172.21.15.7:0/558003293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56173896d540 msgr2=0x56173896fa00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T04:20:17.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.136+0000 7fbabdd9b640 1 --2- 172.21.15.7:0/558003293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56173896d540 0x56173896fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:17.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.137+0000 7fbabed9d640 1 --2- 172.21.15.7:0/558003293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56173896d540 0x56173896fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.137+0000 7fbabed9d640 1 -- 172.21.15.7:0/558003293 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561738872340 con 0x561738967b70 2024-09-19T04:20:17.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.137+0000 7fbabdd9b640 1 --2- 172.21.15.7:0/558003293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56173896d540 0x56173896fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:20:17.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.137+0000 7fbabed9d640 1 --2- 172.21.15.7:0/558003293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561738967b70 0x561738967f70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbab8009fd0 tx=0x7fbab80118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9402264e623ba18e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:17.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.137+0000 7fbaacff9640 1 -- 172.21.15.7:0/558003293 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab8004d20 con 0x561738967b70 2024-09-19T04:20:17.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.137+0000 7fbaacff9640 1 -- 172.21.15.7:0/558003293 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbab8004050 con 0x561738967b70 2024-09-19T04:20:17.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.137+0000 7fbaacff9640 1 -- 172.21.15.7:0/558003293 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab8005260 con 0x561738967b70 2024-09-19T04:20:17.140 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.137+0000 7fbaaf7fe640 1 --2- 172.21.15.7:0/724636510 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fbaa80a32b0 0x7fbaa80a5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:17.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.137+0000 7fbabe59c640 1 --2- 172.21.15.7:0/724636510 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fbaa80a32b0 0x7fbaa80a5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:17.141 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.137+0000 7fbaaf7fe640 1 -- 172.21.15.7:0/724636510 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fbab00f00f0 con 0x7fbac0101ab0 2024-09-19T04:20:17.143 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.138+0000 7fbabe59c640 1 --2- 172.21.15.7:0/724636510 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fbaa80a32b0 0x7fbaa80a5770 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x561738968ee0 tx=0x7fbab4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:17.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.138+0000 7fbac7a17740 1 -- 172.21.15.7:0/558003293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561738967b70 msgr2=0x561738967f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:17.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.138+0000 7fbac7a17740 1 --2- 172.21.15.7:0/558003293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561738967b70 0x561738967f70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbab8009fd0 tx=0x7fbab80118d0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.139+0000 7fbac7a17740 1 -- 172.21.15.7:0/558003293 shutdown_connections 2024-09-19T04:20:17.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.139+0000 7fbac7a17740 1 --2- 172.21.15.7:0/558003293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56173896d540 0x56173896fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.139+0000 7fbac7a17740 1 --2- 172.21.15.7:0/558003293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5617389684b0 0x56173896cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.139+0000 7fbac7a17740 1 --2- 172.21.15.7:0/558003293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561738967b70 0x561738967f70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.139+0000 7fbac7a17740 1 -- 172.21.15.7:0/558003293 >> 172.21.15.7:0/558003293 conn(0x5617389631e0 msgr2=0x5617389635e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:17.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.139+0000 7fbac7a17740 1 -- 172.21.15.7:0/558003293 shutdown_connections 2024-09-19T04:20:17.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.139+0000 7fbac7a17740 1 -- 172.21.15.7:0/558003293 wait complete. 2024-09-19T04:20:17.144 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.139+0000 7fbac7a17740 1 -- start start 2024-09-19T04:20:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.139+0000 7fbac7a17740 1 Processor -- start 2024-09-19T04:20:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.139+0000 7fbac7a17740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561738967b70 0x561738971dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.140+0000 7fbac7a17740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617389684b0 0x561738972300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.140+0000 7fbac7a17740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56173896d540 0x561738979340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.140+0000 7fbac7a17740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561738970510 con 0x56173896d540 2024-09-19T04:20:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.140+0000 7fbac7a17740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561738854290 con 0x561738967b70 2024-09-19T04:20:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.140+0000 7fbac7a17740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561738970690 con 0x5617389684b0 2024-09-19T04:20:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.140+0000 7fbac7a17740 10 client.0 _ll_register_callbacks cb 0x561738885140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:20:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.140+0000 7fbabe59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561738967b70 0x561738971dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.140+0000 7fbabe59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561738967b70 0x561738971dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:51278/0 (socket says 172.21.15.7:51278) 2024-09-19T04:20:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.140+0000 7fbabe59c640 1 -- 172.21.15.7:0/2045540747 learned_addr learned my addr 172.21.15.7:0/2045540747 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.140+0000 7fbabed9d640 1 --2- 172.21.15.7:0/2045540747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56173896d540 0x561738979340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:17.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.140+0000 7fbabe59c640 1 -- 172.21.15.7:0/2045540747 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617389684b0 msgr2=0x561738972300 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T04:20:17.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.140+0000 7fbabe59c640 1 --2- 172.21.15.7:0/2045540747 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617389684b0 0x561738972300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.140+0000 7fbabe59c640 1 -- 172.21.15.7:0/2045540747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56173896d540 msgr2=0x561738979340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:17.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.140+0000 7fbabe59c640 1 --2- 172.21.15.7:0/2045540747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56173896d540 0x561738979340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.140+0000 7fbabe59c640 1 -- 172.21.15.7:0/2045540747 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617385de210 con 0x561738967b70 2024-09-19T04:20:17.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.141+0000 7fbabe59c640 1 --2- 172.21.15.7:0/2045540747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561738967b70 0x561738971dc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbab4013010 tx=0x7fbab4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34be8632bdbf9d25 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:17.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.141+0000 7fbaa5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T04:20:17.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.141+0000 7fbaa5ffb640 1 -- 172.21.15.7:0/2045540747 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab400f8f0 con 0x561738967b70 2024-09-19T04:20:17.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.141+0000 7fbac7a17740 1 -- 172.21.15.7:0/2045540747 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbab8004050 con 0x561738967b70 2024-09-19T04:20:17.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.141+0000 7fbaa5ffb640 1 -- 172.21.15.7:0/2045540747 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fbab400fa90 con 0x561738967b70 2024-09-19T04:20:17.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.141+0000 7fbaa5ffb640 1 -- 172.21.15.7:0/2045540747 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbab400fc90 con 0x561738967b70 2024-09-19T04:20:17.146 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.141+0000 7fbac7a17740 10 client.25409 fetch_fsmap learned FSMap version 32 2024-09-19T04:20:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.141+0000 7fbac7a17740 1 -- 172.21.15.7:0/2045540747 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5617386aa620 con 0x561738967b70 2024-09-19T04:20:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.141+0000 7fbaa5ffb640 1 -- 172.21.15.7:0/2045540747 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbab8004050 con 0x561738967b70 2024-09-19T04:20:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.141+0000 7fbaa5ffb640 1 -- 172.21.15.7:0/2045540747 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fbab4027070 con 0x561738967b70 2024-09-19T04:20:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.142+0000 7fbac7a17740 10 client.25409 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T04:20:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.142+0000 7fbac7a17740 10 client.25409 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:20:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.142+0000 7fbac7a17740 20 client.25409 populate_metadata read hostname 'smithi007' 2024-09-19T04:20:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.142+0000 7fbac7a17740 1 --2- 172.21.15.7:0/2045540747 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x56173897db40 0x56173897ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.142+0000 7fbac7a17740 4 client.25409 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:20:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.142+0000 7fbac7a17740 1 -- 172.21.15.7:0/2045540747 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617388d8a20 con 0x56173897db40 2024-09-19T04:20:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.142+0000 7fbabdd9b640 1 --2- 172.21.15.7:0/2045540747 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x56173897db40 0x56173897ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.142+0000 7fbaa5ffb640 10 client.25409 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:20:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.142+0000 7fbabdd9b640 1 --2- 172.21.15.7:0/2045540747 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x56173897db40 0x56173897ffa0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b30e78fcaa1af358 server_cookie=1933021462d0fce in_seq=0 out_seq=0 2024-09-19T04:20:17.148 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.144+0000 7fbaa5ffb640 1 -- 172.21.15.7:0/2045540747 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5617388d8a20 con 0x56173897db40 2024-09-19T04:20:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.144+0000 7fbaa5ffb640 10 client.25409 handle_command_reply: tid=0 2024-09-19T04:20:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.145+0000 7fbac7a17740 1 client.25409 shutdown 2024-09-19T04:20:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.145+0000 7fbac7a17740 1 -- 172.21.15.7:0/2045540747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561738967b70 msgr2=0x561738971dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.145+0000 7fbac7a17740 1 --2- 172.21.15.7:0/2045540747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561738967b70 0x561738971dc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbab4013010 tx=0x7fbab4004730 comp rx=0 tx=0).stop 2024-09-19T04:20:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.145+0000 7fbac7a17740 1 -- 172.21.15.7:0/2045540747 shutdown_connections 2024-09-19T04:20:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.145+0000 7fbac7a17740 1 --2- 172.21.15.7:0/2045540747 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x56173897db40 0x56173897ffa0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.145+0000 7fbac7a17740 1 --2- 172.21.15.7:0/2045540747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56173896d540 0x561738979340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.145+0000 7fbac7a17740 1 --2- 172.21.15.7:0/2045540747 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617389684b0 0x561738972300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.145+0000 7fbaa5ffb640 0 client.25409 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:20:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.145+0000 7fbac7a17740 1 --2- 172.21.15.7:0/2045540747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561738967b70 0x561738971dc0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.145+0000 7fbac7a17740 1 -- 172.21.15.7:0/2045540747 >> 172.21.15.7:0/2045540747 conn(0x5617389631e0 msgr2=0x5617389649f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.145+0000 7fbac7a17740 1 -- 172.21.15.7:0/2045540747 shutdown_connections 2024-09-19T04:20:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.145+0000 7fbac7a17740 1 -- 172.21.15.7:0/2045540747 wait complete. 2024-09-19T04:20:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.145+0000 7fbac7a17740 20 client.25409 trim_cache size 0 max 16384 2024-09-19T04:20:17.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.169+0000 7fbac7a17740 1 Processor -- start 2024-09-19T04:20:17.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.169+0000 7fbac7a17740 1 -- start start 2024-09-19T04:20:17.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.169+0000 7fbac7a17740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561738967b70 0x561738967f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:17.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.169+0000 7fbac7a17740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617389684b0 0x561738972390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:17.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.169+0000 7fbac7a17740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56173896d540 0x561738979300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:17.171 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.169+0000 7fbac7a17740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbac01b0d10 con 0x561738967b70 2024-09-19T04:20:17.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.169+0000 7fbac7a17740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbac01b2910 con 0x56173896d540 2024-09-19T04:20:17.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.169+0000 7fbac7a17740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbac01b13e0 con 0x5617389684b0 2024-09-19T04:20:17.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.169+0000 7fbabdd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617389684b0 0x561738972390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:17.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.169+0000 7fbabed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56173896d540 0x561738979300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:17.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.169+0000 7fbabdd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617389684b0 0x561738972390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:43986/0 (socket says 172.21.15.7:43986) 2024-09-19T04:20:17.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.169+0000 7fbabdd9b640 1 -- 172.21.15.7:0/1479172360 learned_addr learned my addr 172.21.15.7:0/1479172360 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:17.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.169+0000 7fbabe59c640 1 --2- 172.21.15.7:0/1479172360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561738967b70 0x561738967f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:17.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.170+0000 7fbabdd9b640 1 -- 172.21.15.7:0/1479172360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56173896d540 msgr2=0x561738979300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:17.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.170+0000 7fbabdd9b640 1 --2- 172.21.15.7:0/1479172360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56173896d540 0x561738979300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.170+0000 7fbabdd9b640 1 -- 172.21.15.7:0/1479172360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561738967b70 msgr2=0x561738967f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:17.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.170+0000 7fbabdd9b640 1 --2- 172.21.15.7:0/1479172360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561738967b70 0x561738967f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.172 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.170+0000 7fbabdd9b640 1 -- 172.21.15.7:0/1479172360 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561738968990 con 0x5617389684b0 2024-09-19T04:20:17.173 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.170+0000 7fbabdd9b640 1 --2- 172.21.15.7:0/1479172360 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617389684b0 0x561738972390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbab0000c00 tx=0x7fbab00f2540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c190b6900143ccaa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:17.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.170+0000 7fbaa7fff640 1 -- 172.21.15.7:0/1479172360 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab0049040 con 0x5617389684b0 2024-09-19T04:20:17.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.170+0000 7fbaa7fff640 1 -- 172.21.15.7:0/1479172360 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbab00c4f70 con 0x5617389684b0 2024-09-19T04:20:17.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.170+0000 7fbaa7fff640 1 -- 172.21.15.7:0/1479172360 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab0003800 con 0x5617389684b0 2024-09-19T04:20:17.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.171+0000 7fbac7a17740 1 -- 172.21.15.7:0/1479172360 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617389684b0 msgr2=0x561738972390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:17.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.171+0000 7fbac7a17740 1 --2- 172.21.15.7:0/1479172360 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617389684b0 0x561738972390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbab0000c00 tx=0x7fbab00f2540 comp rx=0 tx=0).stop 2024-09-19T04:20:17.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.171+0000 7fbac7a17740 1 -- 172.21.15.7:0/1479172360 shutdown_connections 2024-09-19T04:20:17.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.171+0000 7fbac7a17740 1 --2- 172.21.15.7:0/1479172360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56173896d540 0x561738979300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.171+0000 7fbac7a17740 1 --2- 172.21.15.7:0/1479172360 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617389684b0 0x561738972390 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.171+0000 7fbac7a17740 1 --2- 172.21.15.7:0/1479172360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561738967b70 0x561738967f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.171+0000 7fbac7a17740 1 -- 172.21.15.7:0/1479172360 >> 172.21.15.7:0/1479172360 conn(0x5617389631e0 msgr2=0x561738961a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:17.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.171+0000 7fbac7a17740 1 -- 172.21.15.7:0/1479172360 shutdown_connections 2024-09-19T04:20:17.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.171+0000 7fbac7a17740 1 -- 172.21.15.7:0/1479172360 wait complete. 2024-09-19T04:20:17.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.172+0000 7fbac7a17740 1 -- start start 2024-09-19T04:20:17.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.172+0000 7fbac7a17740 1 Processor -- start 2024-09-19T04:20:17.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.172+0000 7fbac7a17740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561738967b70 0x5617389766e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:17.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.172+0000 7fbac7a17740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617389684b0 0x561738976c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:17.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.172+0000 7fbac7a17740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56173896d540 0x561738977c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:17.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.172+0000 7fbac7a17740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbac01b2180 con 0x5617389684b0 2024-09-19T04:20:17.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.172+0000 7fbac7a17740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbac01b1ab0 con 0x561738967b70 2024-09-19T04:20:17.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.172+0000 7fbac7a17740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbac01aecd0 con 0x56173896d540 2024-09-19T04:20:17.178 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.172+0000 7fbac7a17740 10 client.0 _ll_register_callbacks cb 0x7fbab4009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:20:17.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.172+0000 7fbabdd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617389684b0 0x561738976c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:17.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.172+0000 7fbabe59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561738967b70 0x5617389766e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:17.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.172+0000 7fbabe59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561738967b70 0x5617389766e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:51298/0 (socket says 172.21.15.7:51298) 2024-09-19T04:20:17.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.172+0000 7fbabdd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617389684b0 0x561738976c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44582/0 (socket says 172.21.15.7:44582) 2024-09-19T04:20:17.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.172+0000 7fbabe59c640 1 -- 172.21.15.7:0/270917411 learned_addr learned my addr 172.21.15.7:0/270917411 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:17.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.172+0000 7fbabed9d640 1 --2- 172.21.15.7:0/270917411 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56173896d540 0x561738977c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:17.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.172+0000 7fbabe59c640 1 -- 172.21.15.7:0/270917411 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56173896d540 msgr2=0x561738977c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:17.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.172+0000 7fbabe59c640 1 --2- 172.21.15.7:0/270917411 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56173896d540 0x561738977c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.172+0000 7fbabe59c640 1 -- 172.21.15.7:0/270917411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617389684b0 msgr2=0x561738976c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:17.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.172+0000 7fbabe59c640 1 --2- 172.21.15.7:0/270917411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617389684b0 0x561738976c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.172+0000 7fbabe59c640 1 -- 172.21.15.7:0/270917411 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561738978240 con 0x561738967b70 2024-09-19T04:20:17.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.172+0000 7fbabdd9b640 1 --2- 172.21.15.7:0/270917411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617389684b0 0x561738976c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:20:17.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.173+0000 7fbabe59c640 1 --2- 172.21.15.7:0/270917411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561738967b70 0x5617389766e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbab4000c00 tx=0x7fbab4003f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53e5a10dc1cc14b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:17.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.173+0000 7fbaa5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T04:20:17.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.173+0000 7fbaa5ffb640 1 -- 172.21.15.7:0/270917411 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab400fe30 con 0x561738967b70 2024-09-19T04:20:17.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.173+0000 7fbaa5ffb640 1 -- 172.21.15.7:0/270917411 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fbab4012250 con 0x561738967b70 2024-09-19T04:20:17.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.173+0000 7fbac7a17740 1 -- 172.21.15.7:0/270917411 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbab00c4f70 con 0x561738967b70 2024-09-19T04:20:17.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.173+0000 7fbaa5ffb640 1 -- 172.21.15.7:0/270917411 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fbab4004450 con 0x561738967b70 2024-09-19T04:20:17.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.173+0000 7fbac7a17740 10 client.25415 fetch_fsmap learned FSMap version 32 2024-09-19T04:20:17.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.173+0000 7fbac7a17740 1 -- 172.21.15.7:0/270917411 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x561738979550 con 0x561738967b70 2024-09-19T04:20:17.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.173+0000 7fbaa5ffb640 1 -- 172.21.15.7:0/270917411 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbab00c4f70 con 0x561738967b70 2024-09-19T04:20:17.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.174+0000 7fbaa5ffb640 1 -- 172.21.15.7:0/270917411 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fbab4027040 con 0x561738967b70 2024-09-19T04:20:17.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.174+0000 7fbac7a17740 10 client.25415 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T04:20:17.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.174+0000 7fbac7a17740 10 client.25415 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:20:17.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.174+0000 7fbac7a17740 20 client.25415 populate_metadata read hostname 'smithi007' 2024-09-19T04:20:17.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.174+0000 7fbac7a17740 1 --2- 172.21.15.7:0/270917411 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5617389e8f00 0x5617389eb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:17.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.174+0000 7fbac7a17740 4 client.25415 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:20:17.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.174+0000 7fbac7a17740 1 -- 172.21.15.7:0/270917411 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5617388d2d70 con 0x5617389e8f00 2024-09-19T04:20:17.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.174+0000 7fbabdd9b640 1 --2- 172.21.15.7:0/270917411 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5617389e8f00 0x5617389eb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:17.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.174+0000 7fbaa5ffb640 10 client.25415 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:20:17.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:17.174+0000 7fbabdd9b640 1 --2- 172.21.15.7:0/270917411 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5617389e8f00 0x5617389eb320 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2698bf315239808 server_cookie=f33d750642a9f305 in_seq=0 out_seq=0 2024-09-19T04:20:17.281 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:20:17.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:17 smithi092 ceph-mon[34940]: pgmap v455: 129 pgs: 129 active+clean; 218 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.7 MiB/s wr, 1.14k op/s 2024-09-19T04:20:17.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:17 smithi102 ceph-mon[35446]: pgmap v455: 129 pgs: 129 active+clean; 218 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.7 MiB/s wr, 1.14k op/s 2024-09-19T04:20:17.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.883+0000 7fa3e6b21640 1 -- 172.21.15.7:0/684929470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3e011b140 msgr2=0x7fa3e011d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:17.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.883+0000 7fa3e6b21640 1 --2- 172.21.15.7:0/684929470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3e011b140 0x7fa3e011d530 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4009be0 tx=0x7fa3d402a710 comp rx=0 tx=0).stop 2024-09-19T04:20:17.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.886+0000 7fa3e6b21640 1 -- 172.21.15.7:0/684929470 shutdown_connections 2024-09-19T04:20:17.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.886+0000 7fa3e6b21640 1 --2- 172.21.15.7:0/684929470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3e011b140 0x7fa3e011d530 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.886+0000 7fa3e6b21640 1 --2- 172.21.15.7:0/684929470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3e006ea30 0x7fa3e006ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.886+0000 7fa3e6b21640 1 --2- 172.21.15.7:0/684929470 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3e0110190 0x7fa3e006e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.886+0000 7fa3e6b21640 1 -- 172.21.15.7:0/684929470 >> 172.21.15.7:0/684929470 conn(0x7fa3e0073180 msgr2=0x7fa3e0073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:17.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.889+0000 7fa3e6b21640 1 -- 172.21.15.7:0/684929470 shutdown_connections 2024-09-19T04:20:17.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.891+0000 7fa3e6b21640 1 -- 172.21.15.7:0/684929470 wait complete. 2024-09-19T04:20:17.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.892+0000 7fa3e6b21640 1 Processor -- start 2024-09-19T04:20:17.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.892+0000 7fa3e6b21640 1 -- start start 2024-09-19T04:20:17.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.892+0000 7fa3e6b21640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3e006ea30 0x7fa3e0119660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:17.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.892+0000 7fa3e6b21640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3e0110190 0x7fa3e0119ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:17.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.892+0000 7fa3e6b21640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3e011b140 0x7fa3e01128d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:17.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.892+0000 7fa3e6b21640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e0120be0 con 0x7fa3e006ea30 2024-09-19T04:20:17.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.892+0000 7fa3e6b21640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e0120a60 con 0x7fa3e0110190 2024-09-19T04:20:17.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.892+0000 7fa3e6b21640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e0120d60 con 0x7fa3e011b140 2024-09-19T04:20:17.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.893+0000 7fa3e531e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3e0110190 0x7fa3e0119ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:17.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.893+0000 7fa3e531e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3e0110190 0x7fa3e0119ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:40984/0 (socket says 172.21.15.7:40984) 2024-09-19T04:20:17.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.893+0000 7fa3e531e640 1 -- 172.21.15.7:0/653200371 learned_addr learned my addr 172.21.15.7:0/653200371 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:17.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.893+0000 7fa3e5b1f640 1 --2- 172.21.15.7:0/653200371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3e006ea30 0x7fa3e0119660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:17.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.893+0000 7fa3e6320640 1 --2- 172.21.15.7:0/653200371 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3e011b140 0x7fa3e01128d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:17.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.894+0000 7fa3e5b1f640 1 -- 172.21.15.7:0/653200371 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3e011b140 msgr2=0x7fa3e01128d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.894+0000 7fa3e5b1f640 1 --2- 172.21.15.7:0/653200371 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3e011b140 0x7fa3e01128d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.894+0000 7fa3e5b1f640 1 -- 172.21.15.7:0/653200371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3e0110190 msgr2=0x7fa3e0119ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.894+0000 7fa3e5b1f640 1 --2- 172.21.15.7:0/653200371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3e0110190 0x7fa3e0119ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.894+0000 7fa3e5b1f640 1 -- 172.21.15.7:0/653200371 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e0113190 con 0x7fa3e006ea30 2024-09-19T04:20:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.894+0000 7fa3e5b1f640 1 --2- 172.21.15.7:0/653200371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3e006ea30 0x7fa3e0119660 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc00e790 tx=0x7fa3dc00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.895+0000 7fa3d2ffd640 1 -- 172.21.15.7:0/653200371 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc00eea0 con 0x7fa3e006ea30 2024-09-19T04:20:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.895+0000 7fa3d2ffd640 1 -- 172.21.15.7:0/653200371 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3dc00ccc0 con 0x7fa3e006ea30 2024-09-19T04:20:17.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.895+0000 7fa3d2ffd640 1 -- 172.21.15.7:0/653200371 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc018820 con 0x7fa3e006ea30 2024-09-19T04:20:17.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.897+0000 7fa3e6b21640 1 -- 172.21.15.7:0/653200371 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e0113420 con 0x7fa3e006ea30 2024-09-19T04:20:17.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.897+0000 7fa3e6b21640 1 -- 172.21.15.7:0/653200371 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e01173c0 con 0x7fa3e006ea30 2024-09-19T04:20:17.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.902+0000 7fa3ea15c740 1 Processor -- start 2024-09-19T04:20:17.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.904+0000 7fa3ea15c740 1 -- start start 2024-09-19T04:20:17.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.905+0000 7fa3ea15c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564987825900 0x564987825ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:17.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.905+0000 7fa3ea15c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564987826220 0x5649878305a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:17.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.905+0000 7fa3ea15c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564987830ae0 0x564987832ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:17.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.905+0000 7fa3e6320640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564987825900 0x564987825ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:17.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.905+0000 7fa3e6320640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564987825900 0x564987825ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47294/0 (socket says 172.21.15.7:47294) 2024-09-19T04:20:17.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.906+0000 7fa3e531e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564987830ae0 0x564987832ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:17.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.906+0000 7fa3e531e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564987830ae0 0x564987832ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:40998/0 (socket says 172.21.15.7:40998) 2024-09-19T04:20:17.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.906+0000 7fa3e531e640 1 -- 172.21.15.7:0/3011541335 learned_addr learned my addr 172.21.15.7:0/3011541335 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:17.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.906+0000 7fa3ea15c740 1 -- 172.21.15.7:0/3011541335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56498778b2a0 con 0x564987825900 2024-09-19T04:20:17.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.906+0000 7fa3ea15c740 1 -- 172.21.15.7:0/3011541335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564987732b10 con 0x564987830ae0 2024-09-19T04:20:17.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.906+0000 7fa3ea15c740 1 -- 172.21.15.7:0/3011541335 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564987787260 con 0x564987826220 2024-09-19T04:20:17.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.907+0000 7fa3d2ffd640 1 -- 172.21.15.7:0/653200371 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fa3dc0189c0 con 0x7fa3e006ea30 2024-09-19T04:20:17.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.908+0000 7fa3e5b1f640 1 --2- 172.21.15.7:0/3011541335 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564987826220 0x5649878305a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:17.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.913+0000 7fa3e531e640 1 -- 172.21.15.7:0/3011541335 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564987826220 msgr2=0x5649878305a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:17.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.913+0000 7fa3e531e640 1 --2- 172.21.15.7:0/3011541335 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564987826220 0x5649878305a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.913+0000 7fa3e531e640 1 -- 172.21.15.7:0/3011541335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564987825900 msgr2=0x564987825ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:17.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.913+0000 7fa3e531e640 1 --2- 172.21.15.7:0/3011541335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564987825900 0x564987825ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.913+0000 7fa3e531e640 1 -- 172.21.15.7:0/3011541335 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649874fcb90 con 0x564987830ae0 2024-09-19T04:20:17.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.913+0000 7fa3e531e640 1 --2- 172.21.15.7:0/3011541335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564987830ae0 0x564987832ed0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009d00 tx=0x7fa3d8011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=884d747c09017733 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:17.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.913+0000 7fa3e5b1f640 1 --2- 172.21.15.7:0/3011541335 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564987826220 0x5649878305a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:20:17.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.914+0000 7fa3d2ffd640 1 --2- 172.21.15.7:0/653200371 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa3cc0a3450 0x7fa3cc0a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:17.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.914+0000 7fa3e6320640 1 --2- 172.21.15.7:0/653200371 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa3cc0a3450 0x7fa3cc0a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:17.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.914+0000 7fa3cbfff640 1 -- 172.21.15.7:0/3011541335 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8004220 con 0x564987830ae0 2024-09-19T04:20:17.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.915+0000 7fa3cbfff640 1 -- 172.21.15.7:0/3011541335 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3d80043c0 con 0x564987830ae0 2024-09-19T04:20:17.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.915+0000 7fa3d2ffd640 1 -- 172.21.15.7:0/653200371 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fa3dc0cfe90 con 0x7fa3e006ea30 2024-09-19T04:20:17.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.916+0000 7fa3ea15c740 1 -- 172.21.15.7:0/3011541335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564987830ae0 msgr2=0x564987832ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:17.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.916+0000 7fa3ea15c740 1 --2- 172.21.15.7:0/3011541335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564987830ae0 0x564987832ed0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009d00 tx=0x7fa3d8011810 comp rx=0 tx=0).stop 2024-09-19T04:20:17.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.916+0000 7fa3e6320640 1 --2- 172.21.15.7:0/653200371 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa3cc0a3450 0x7fa3cc0a5910 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4009b30 tx=0x7fa3d4030fa0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:17.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.919+0000 7fa3ea15c740 1 -- 172.21.15.7:0/3011541335 shutdown_connections 2024-09-19T04:20:17.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.919+0000 7fa3ea15c740 1 --2- 172.21.15.7:0/3011541335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564987830ae0 0x564987832ed0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.919+0000 7fa3ea15c740 1 --2- 172.21.15.7:0/3011541335 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564987826220 0x5649878305a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.919+0000 7fa3ea15c740 1 --2- 172.21.15.7:0/3011541335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564987825900 0x564987825ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.919+0000 7fa3ea15c740 1 -- 172.21.15.7:0/3011541335 >> 172.21.15.7:0/3011541335 conn(0x564987821e90 msgr2=0x564987822270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:17.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.919+0000 7fa3ea15c740 1 -- 172.21.15.7:0/3011541335 shutdown_connections 2024-09-19T04:20:17.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.919+0000 7fa3ea15c740 1 -- 172.21.15.7:0/3011541335 wait complete. 2024-09-19T04:20:17.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.920+0000 7fa3ea15c740 1 -- start start 2024-09-19T04:20:17.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.920+0000 7fa3ea15c740 1 Processor -- start 2024-09-19T04:20:17.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.921+0000 7fa3ea15c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564987825900 0x56498782d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:17.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.921+0000 7fa3ea15c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564987826220 0x56498782de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:17.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.921+0000 7fa3ea15c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564987830ae0 0x56498782e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:17.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.921+0000 7fa3ea15c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564987833700 con 0x564987826220 2024-09-19T04:20:17.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.921+0000 7fa3ea15c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5649877136e0 con 0x564987830ae0 2024-09-19T04:20:17.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.921+0000 7fa3ea15c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564987833880 con 0x564987825900 2024-09-19T04:20:17.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.921+0000 7fa3ea15c740 10 client.0 _ll_register_callbacks cb 0x564987737a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:20:17.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.922+0000 7fa3e531e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564987826220 0x56498782de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:17.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.922+0000 7fa3e531e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564987826220 0x56498782de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47298/0 (socket says 172.21.15.7:47298) 2024-09-19T04:20:17.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.922+0000 7fa3e531e640 1 -- 172.21.15.7:0/911986810 learned_addr learned my addr 172.21.15.7:0/911986810 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:17.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.922+0000 7fa3e531e640 1 -- 172.21.15.7:0/911986810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564987825900 msgr2=0x56498782d8c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T04:20:17.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.922+0000 7fa3e531e640 1 --2- 172.21.15.7:0/911986810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564987825900 0x56498782d8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.923+0000 7fa3e531e640 1 -- 172.21.15.7:0/911986810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564987830ae0 msgr2=0x56498782e340 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T04:20:17.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.923+0000 7fa3e531e640 1 --2- 172.21.15.7:0/911986810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564987830ae0 0x56498782e340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:17.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.923+0000 7fa3e531e640 1 -- 172.21.15.7:0/911986810 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56498783cc50 con 0x564987826220 2024-09-19T04:20:17.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.923+0000 7fa3e531e640 1 --2- 172.21.15.7:0/911986810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564987826220 0x56498782de00 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa3d801b040 tx=0x7fa3d8005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8cd4b0918ccf93 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:17.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.924+0000 7fa3c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:20:17.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.924+0000 7fa3c97fa640 1 -- 172.21.15.7:0/911986810 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8027030 con 0x564987826220 2024-09-19T04:20:17.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.924+0000 7fa3c97fa640 1 -- 172.21.15.7:0/911986810 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fa3d8004570 con 0x564987826220 2024-09-19T04:20:17.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.924+0000 7fa3ea15c740 1 -- 172.21.15.7:0/911986810 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3d80043c0 con 0x564987826220 2024-09-19T04:20:17.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.927+0000 7fa3c97fa640 1 -- 172.21.15.7:0/911986810 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa3d8032050 con 0x564987826220 2024-09-19T04:20:17.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.931+0000 7fa3ea15c740 10 client.15825 fetch_fsmap learned FSMap version 32 2024-09-19T04:20:17.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.931+0000 7fa3ea15c740 1 -- 172.21.15.7:0/911986810 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x56498783f560 con 0x564987826220 2024-09-19T04:20:17.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.936+0000 7fa3c97fa640 1 -- 172.21.15.7:0/911986810 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3d80043c0 con 0x564987826220 2024-09-19T04:20:17.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.936+0000 7fa3c97fa640 1 -- 172.21.15.7:0/911986810 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fa3d802e4f0 con 0x564987826220 2024-09-19T04:20:17.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.937+0000 7fa3ea15c740 10 client.15825 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T04:20:17.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.937+0000 7fa3ea15c740 10 client.15825 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:20:17.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.937+0000 7fa3ea15c740 20 client.15825 populate_metadata read hostname 'smithi007' 2024-09-19T04:20:17.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.937+0000 7fa3ea15c740 1 --2- 172.21.15.7:0/911986810 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564987840e30 0x5649878432f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:17.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.937+0000 7fa3ea15c740 4 client.15825 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:20:17.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.937+0000 7fa3ea15c740 1 -- 172.21.15.7:0/911986810 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649877989d0 con 0x564987840e30 2024-09-19T04:20:17.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.940+0000 7fa3e5b1f640 1 --2- 172.21.15.7:0/911986810 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564987840e30 0x5649878432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:17.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.949+0000 7fa3e5b1f640 1 --2- 172.21.15.7:0/911986810 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564987840e30 0x5649878432f0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bb4e04c5110bc28 server_cookie=2b303a46a9c39b7a in_seq=0 out_seq=0 2024-09-19T04:20:17.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:17.949+0000 7fa3c97fa640 10 client.15825 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:20:18.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.008+0000 7fa3c97fa640 1 -- 172.21.15.7:0/911986810 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5649877989d0 con 0x564987840e30 2024-09-19T04:20:18.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.008+0000 7fa3c97fa640 10 client.15825 handle_command_reply: tid=0 2024-09-19T04:20:18.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.008+0000 7fa3ea15c740 1 client.15825 shutdown 2024-09-19T04:20:18.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.010+0000 7fa3ea15c740 1 -- 172.21.15.7:0/911986810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564987826220 msgr2=0x56498782de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:18.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.010+0000 7fa3ea15c740 1 --2- 172.21.15.7:0/911986810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564987826220 0x56498782de00 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa3d801b040 tx=0x7fa3d8005590 comp rx=0 tx=0).stop 2024-09-19T04:20:18.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.011+0000 7fa3ea15c740 1 -- 172.21.15.7:0/911986810 shutdown_connections 2024-09-19T04:20:18.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.011+0000 7fa3ea15c740 1 --2- 172.21.15.7:0/911986810 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564987840e30 0x5649878432f0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:18.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.011+0000 7fa3ea15c740 1 --2- 172.21.15.7:0/911986810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564987830ae0 0x56498782e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:18.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.011+0000 7fa3ea15c740 1 --2- 172.21.15.7:0/911986810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564987826220 0x56498782de00 secure :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa3d801b040 tx=0x7fa3d8005590 comp rx=0 tx=0).stop 2024-09-19T04:20:18.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.011+0000 7fa3ea15c740 1 --2- 172.21.15.7:0/911986810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564987825900 0x56498782d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:18.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.011+0000 7fa3ea15c740 1 -- 172.21.15.7:0/911986810 >> 172.21.15.7:0/911986810 conn(0x564987821e90 msgr2=0x564987827bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:18.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.011+0000 7fa3c97fa640 0 client.15825 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:20:18.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.012+0000 7fa3ea15c740 1 -- 172.21.15.7:0/911986810 shutdown_connections 2024-09-19T04:20:18.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.012+0000 7fa3ea15c740 1 -- 172.21.15.7:0/911986810 wait complete. 2024-09-19T04:20:18.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.012+0000 7fa3ea15c740 20 client.15825 trim_cache size 0 max 16384 2024-09-19T04:20:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.056+0000 7fa3ea15c740 1 Processor -- start 2024-09-19T04:20:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.056+0000 7fa3ea15c740 1 -- start start 2024-09-19T04:20:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.056+0000 7fa3ea15c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564987825900 0x56498782f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.057+0000 7fa3ea15c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564987830ae0 0x564987848c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:18.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.057+0000 7fa3e5b1f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564987825900 0x56498782f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:18.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.057+0000 7fa3e5b1f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564987825900 0x56498782f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:51208/0 (socket says 172.21.15.7:51208) 2024-09-19T04:20:18.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.057+0000 7fa3e5b1f640 1 -- 172.21.15.7:0/1925132992 learned_addr learned my addr 172.21.15.7:0/1925132992 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:18.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.057+0000 7fa3ea15c740 1 --2- 172.21.15.7:0/1925132992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56498782c9b0 0x564987849140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:18.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.058+0000 7fa3ea15c740 1 -- 172.21.15.7:0/1925132992 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c400fe50 con 0x564987830ae0 2024-09-19T04:20:18.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.058+0000 7fa3ea15c740 1 -- 172.21.15.7:0/1925132992 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c4011a50 con 0x56498782c9b0 2024-09-19T04:20:18.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.058+0000 7fa3e6320640 1 --2- 172.21.15.7:0/1925132992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56498782c9b0 0x564987849140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:18.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.058+0000 7fa3ea15c740 1 -- 172.21.15.7:0/1925132992 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c4010520 con 0x564987825900 2024-09-19T04:20:18.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.059+0000 7fa3e531e640 1 --2- 172.21.15.7:0/1925132992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564987830ae0 0x564987848c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:18.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.059+0000 7fa3e6320640 1 -- 172.21.15.7:0/1925132992 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564987825900 msgr2=0x56498782f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:18.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.059+0000 7fa3e6320640 1 --2- 172.21.15.7:0/1925132992 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564987825900 0x56498782f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:18.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.059+0000 7fa3e6320640 1 -- 172.21.15.7:0/1925132992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564987830ae0 msgr2=0x564987848c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:18.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.059+0000 7fa3e6320640 1 --2- 172.21.15.7:0/1925132992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564987830ae0 0x564987848c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:18.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.059+0000 7fa3e6320640 1 -- 172.21.15.7:0/1925132992 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564987821cc0 con 0x56498782c9b0 2024-09-19T04:20:18.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.059+0000 7fa3e6320640 1 --2- 172.21.15.7:0/1925132992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56498782c9b0 0x564987849140 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4034040 tx=0x7fa3d403e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccb5c1a0aea27c5d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:18.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.059+0000 7fa3e5b1f640 1 --2- 172.21.15.7:0/1925132992 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564987825900 0x56498782f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:20:18.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.061+0000 7fa3cb7fe640 1 -- 172.21.15.7:0/1925132992 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4050070 con 0x56498782c9b0 2024-09-19T04:20:18.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.061+0000 7fa3cb7fe640 1 -- 172.21.15.7:0/1925132992 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3d4037040 con 0x56498782c9b0 2024-09-19T04:20:18.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.061+0000 7fa3cb7fe640 1 -- 172.21.15.7:0/1925132992 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4044070 con 0x56498782c9b0 2024-09-19T04:20:18.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.062+0000 7fa3ea15c740 1 -- 172.21.15.7:0/1925132992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56498782c9b0 msgr2=0x564987849140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:18.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.062+0000 7fa3ea15c740 1 --2- 172.21.15.7:0/1925132992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56498782c9b0 0x564987849140 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4034040 tx=0x7fa3d403e000 comp rx=0 tx=0).stop 2024-09-19T04:20:18.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.062+0000 7fa3ea15c740 1 -- 172.21.15.7:0/1925132992 shutdown_connections 2024-09-19T04:20:18.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.062+0000 7fa3ea15c740 1 --2- 172.21.15.7:0/1925132992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56498782c9b0 0x564987849140 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:18.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.062+0000 7fa3ea15c740 1 --2- 172.21.15.7:0/1925132992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564987830ae0 0x564987848c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:18.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.062+0000 7fa3ea15c740 1 --2- 172.21.15.7:0/1925132992 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564987825900 0x56498782f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:18.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.062+0000 7fa3ea15c740 1 -- 172.21.15.7:0/1925132992 >> 172.21.15.7:0/1925132992 conn(0x564987821e90 msgr2=0x56498782f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:18.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.063+0000 7fa3ea15c740 1 -- 172.21.15.7:0/1925132992 shutdown_connections 2024-09-19T04:20:18.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.063+0000 7fa3ea15c740 1 -- 172.21.15.7:0/1925132992 wait complete. 2024-09-19T04:20:18.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.064+0000 7fa3ea15c740 1 -- start start 2024-09-19T04:20:18.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.065+0000 7fa3ea15c740 1 Processor -- start 2024-09-19T04:20:18.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.066+0000 7fa3ea15c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564987825900 0x56498782aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:18.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.066+0000 7fa3ea15c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56498782c9b0 0x56498782af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:18.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.067+0000 7fa3e5b1f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564987825900 0x56498782aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:18.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.067+0000 7fa3e5b1f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564987825900 0x56498782aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:51212/0 (socket says 172.21.15.7:51212) 2024-09-19T04:20:18.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.067+0000 7fa3e5b1f640 1 -- 172.21.15.7:0/3052932251 learned_addr learned my addr 172.21.15.7:0/3052932251 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:18.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.067+0000 7fa3e531e640 1 --2- 172.21.15.7:0/3052932251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56498782c9b0 0x56498782af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:18.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.068+0000 7fa3ea15c740 1 --2- 172.21.15.7:0/3052932251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564987830ae0 0x56498782b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:18.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.068+0000 7fa3ea15c740 1 -- 172.21.15.7:0/3052932251 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c40112c0 con 0x56498782c9b0 2024-09-19T04:20:18.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.068+0000 7fa3e6320640 1 --2- 172.21.15.7:0/3052932251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564987830ae0 0x56498782b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:18.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.068+0000 7fa3ea15c740 1 -- 172.21.15.7:0/3052932251 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c4010bf0 con 0x564987830ae0 2024-09-19T04:20:18.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.068+0000 7fa3ea15c740 1 -- 172.21.15.7:0/3052932251 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c400de10 con 0x564987825900 2024-09-19T04:20:18.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.069+0000 7fa3ea15c740 10 client.0 _ll_register_callbacks cb 0x7fa3d8005220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:20:18.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.074+0000 7fa3e6320640 1 -- 172.21.15.7:0/3052932251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564987825900 msgr2=0x56498782aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:18.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.074+0000 7fa3e6320640 1 --2- 172.21.15.7:0/3052932251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564987825900 0x56498782aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:18.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.074+0000 7fa3e6320640 1 -- 172.21.15.7:0/3052932251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56498782c9b0 msgr2=0x56498782af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:18.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.074+0000 7fa3e6320640 1 --2- 172.21.15.7:0/3052932251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56498782c9b0 0x56498782af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:18.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.074+0000 7fa3e6320640 1 -- 172.21.15.7:0/3052932251 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649878373f0 con 0x564987830ae0 2024-09-19T04:20:18.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.075+0000 7fa3e6320640 1 --2- 172.21.15.7:0/3052932251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564987830ae0 0x56498782b4c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4006010 tx=0x7fa3d4003dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a58f1e8c98037120 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:18.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.075+0000 7fa3c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T04:20:18.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.078+0000 7fa3c97fa640 1 -- 172.21.15.7:0/3052932251 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4044050 con 0x564987830ae0 2024-09-19T04:20:18.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.078+0000 7fa3c97fa640 1 -- 172.21.15.7:0/3052932251 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fa3d4004230 con 0x564987830ae0 2024-09-19T04:20:18.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.079+0000 7fa3ea15c740 1 -- 172.21.15.7:0/3052932251 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3d4037040 con 0x564987830ae0 2024-09-19T04:20:18.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.085+0000 7fa3c97fa640 1 -- 172.21.15.7:0/3052932251 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fa3d4050040 con 0x564987830ae0 2024-09-19T04:20:18.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.085+0000 7fa3ea15c740 10 client.25430 fetch_fsmap learned FSMap version 32 2024-09-19T04:20:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.086+0000 7fa3ea15c740 1 -- 172.21.15.7:0/3052932251 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5649878ac010 con 0x564987830ae0 2024-09-19T04:20:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.090+0000 7fa3c97fa640 1 -- 172.21.15.7:0/3052932251 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3d4004430 con 0x564987830ae0 2024-09-19T04:20:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.090+0000 7fa3c97fa640 1 -- 172.21.15.7:0/3052932251 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fa3d405c030 con 0x564987830ae0 2024-09-19T04:20:18.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.092+0000 7fa3ea15c740 10 client.25430 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T04:20:18.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.092+0000 7fa3ea15c740 10 client.25430 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:20:18.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.092+0000 7fa3ea15c740 20 client.25430 populate_metadata read hostname 'smithi007' 2024-09-19T04:20:18.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.092+0000 7fa3ea15c740 1 --2- 172.21.15.7:0/3052932251 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5649878ac720 0x5649878aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:18.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.092+0000 7fa3ea15c740 4 client.25430 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}] 2024-09-19T04:20:18.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.092+0000 7fa3ea15c740 1 -- 172.21.15.7:0/3052932251 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}) -- 0x7fa3d4037040 con 0x5649878ac720 2024-09-19T04:20:18.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.094+0000 7fa3e5b1f640 1 --2- 172.21.15.7:0/3052932251 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5649878ac720 0x5649878aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:18.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.095+0000 7fa3e5b1f640 1 --2- 172.21.15.7:0/3052932251 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5649878ac720 0x5649878aeb40 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3534ff237fe1a4a3 server_cookie=1cc81595b4e25e89 in_seq=0 out_seq=0 2024-09-19T04:20:18.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:18.096+0000 7fa3c97fa640 10 client.25430 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:20:18.158 INFO:tasks.workunit.client.0.smithi007.stdout: 77 1640384 614 1174907 656 925872 1469 2024-09-19T04:20:19.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:19 smithi092 ceph-mon[34940]: pgmap v456: 129 pgs: 129 active+clean; 218 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 451 op/s 2024-09-19T04:20:19.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:19 smithi007 ceph-mon[31360]: pgmap v456: 129 pgs: 129 active+clean; 218 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 451 op/s 2024-09-19T04:20:19.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:19 smithi102 ceph-mon[35446]: pgmap v456: 129 pgs: 129 active+clean; 218 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 451 op/s 2024-09-19T04:20:20.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:20.735+0000 7fbaa5ffb640 1 -- 172.21.15.7:0/270917411 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5617388d2d70 con 0x5617389e8f00 2024-09-19T04:20:20.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:20.735+0000 7fbaa5ffb640 10 client.25415 handle_command_reply: tid=0 2024-09-19T04:20:20.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:20.736+0000 7fbac7a17740 1 client.25415 shutdown 2024-09-19T04:20:20.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:20.736+0000 7fbac7a17740 1 -- 172.21.15.7:0/270917411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561738967b70 msgr2=0x5617389766e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:20.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:20.736+0000 7fbac7a17740 1 --2- 172.21.15.7:0/270917411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561738967b70 0x5617389766e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbab4000c00 tx=0x7fbab4003f90 comp rx=0 tx=0).stop 2024-09-19T04:20:20.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:20.736+0000 7fbac7a17740 1 -- 172.21.15.7:0/270917411 shutdown_connections 2024-09-19T04:20:20.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:20.736+0000 7fbac7a17740 1 --2- 172.21.15.7:0/270917411 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5617389e8f00 0x5617389eb320 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:20.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:20.736+0000 7fbac7a17740 1 --2- 172.21.15.7:0/270917411 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56173896d540 0x561738977c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:20.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:20.736+0000 7fbac7a17740 1 --2- 172.21.15.7:0/270917411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617389684b0 0x561738976c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:20.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:20.736+0000 7fbaa5ffb640 0 client.25415 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:20:20.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:20.736+0000 7fbac7a17740 1 --2- 172.21.15.7:0/270917411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561738967b70 0x5617389766e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:20.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:20.736+0000 7fbac7a17740 1 -- 172.21.15.7:0/270917411 >> 172.21.15.7:0/270917411 conn(0x5617389631e0 msgr2=0x561738961a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:20.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:20.736+0000 7fbac7a17740 1 -- 172.21.15.7:0/270917411 shutdown_connections 2024-09-19T04:20:20.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:20.736+0000 7fbac7a17740 1 -- 172.21.15.7:0/270917411 wait complete. 2024-09-19T04:20:20.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:20.736+0000 7fbac7a17740 20 client.25415 trim_cache size 0 max 16384 2024-09-19T04:20:20.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:20:20.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:20:20.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:20:20.739 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:20:20.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:20.737+0000 7fbac4b9f640 1 -- 172.21.15.7:0/724636510 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fbaa80a32b0 msgr2=0x7fbaa80a5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:20.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:20.737+0000 7fbac4b9f640 1 --2- 172.21.15.7:0/724636510 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fbaa80a32b0 0x7fbaa80a5770 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x561738968ee0 tx=0x7fbab4005f90 comp rx=0 tx=0).stop 2024-09-19T04:20:20.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:20.737+0000 7fbac4b9f640 1 -- 172.21.15.7:0/724636510 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbac0101ab0 msgr2=0x7fbac019e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:20.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:20.737+0000 7fbac4b9f640 1 --2- 172.21.15.7:0/724636510 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbac0101ab0 0x7fbac019e7f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbab0009230 tx=0x7fbab00042f0 comp rx=0 tx=0).stop 2024-09-19T04:20:20.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:20.737+0000 7fbac4b9f640 1 -- 172.21.15.7:0/724636510 shutdown_connections 2024-09-19T04:20:20.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:20.737+0000 7fbac4b9f640 1 --2- 172.21.15.7:0/724636510 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fbaa80a32b0 0x7fbaa80a5770 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:20.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:20.737+0000 7fbac4b9f640 1 --2- 172.21.15.7:0/724636510 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbac0102470 0x7fbac01a5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:20.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:20.737+0000 7fbac4b9f640 1 --2- 172.21.15.7:0/724636510 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbac0101ab0 0x7fbac019e7f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:20.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:20.737+0000 7fbac4b9f640 1 --2- 172.21.15.7:0/724636510 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbac01008c0 0x7fbac019e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:20.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:20.737+0000 7fbac4b9f640 1 -- 172.21.15.7:0/724636510 >> 172.21.15.7:0/724636510 conn(0x7fbac00fc020 msgr2=0x7fbac010dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:20.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:20.737+0000 7fbac4b9f640 1 -- 172.21.15.7:0/724636510 shutdown_connections 2024-09-19T04:20:20.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:20.737+0000 7fbac4b9f640 1 -- 172.21.15.7:0/724636510 wait complete. 2024-09-19T04:20:21.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:21 smithi092 ceph-mon[34940]: pgmap v457: 129 pgs: 129 active+clean; 226 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.8 MiB/s wr, 595 op/s 2024-09-19T04:20:21.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:21 smithi007 ceph-mon[31360]: pgmap v457: 129 pgs: 129 active+clean; 226 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.8 MiB/s wr, 595 op/s 2024-09-19T04:20:21.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:21 smithi102 ceph-mon[35446]: pgmap v457: 129 pgs: 129 active+clean; 226 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.8 MiB/s wr, 595 op/s 2024-09-19T04:20:23.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:23 smithi092 ceph-mon[34940]: pgmap v458: 129 pgs: 129 active+clean; 225 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 691 op/s 2024-09-19T04:20:23.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:23 smithi007 ceph-mon[31360]: pgmap v458: 129 pgs: 129 active+clean; 225 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 691 op/s 2024-09-19T04:20:23.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:23 smithi102 ceph-mon[35446]: pgmap v458: 129 pgs: 129 active+clean; 225 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 691 op/s 2024-09-19T04:20:25.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:25 smithi092 ceph-mon[34940]: pgmap v459: 129 pgs: 129 active+clean; 203 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 1.09k op/s 2024-09-19T04:20:25.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:25 smithi007 ceph-mon[31360]: pgmap v459: 129 pgs: 129 active+clean; 203 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 1.09k op/s 2024-09-19T04:20:25.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:25 smithi102 ceph-mon[35446]: pgmap v459: 129 pgs: 129 active+clean; 203 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 1.09k op/s 2024-09-19T04:20:27.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:27 smithi092 ceph-mon[34940]: pgmap v460: 129 pgs: 129 active+clean; 207 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 1.31k op/s 2024-09-19T04:20:27.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:27 smithi007 ceph-mon[31360]: pgmap v460: 129 pgs: 129 active+clean; 207 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 1.31k op/s 2024-09-19T04:20:27.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:27 smithi102 ceph-mon[35446]: pgmap v460: 129 pgs: 129 active+clean; 207 MiB data, 986 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 1.31k op/s 2024-09-19T04:20:28.158 INFO:tasks.workunit.client.0.smithi007.stdout: 77 21627 5 16676 12 12767 29 2024-09-19T04:20:29.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:29 smithi007 ceph-mon[31360]: pgmap v461: 129 pgs: 129 active+clean; 207 MiB data, 982 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 1.27k op/s 2024-09-19T04:20:29.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:29 smithi102 ceph-mon[35446]: pgmap v461: 129 pgs: 129 active+clean; 207 MiB data, 982 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 1.27k op/s 2024-09-19T04:20:29.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:29 smithi092 ceph-mon[34940]: pgmap v461: 129 pgs: 129 active+clean; 207 MiB data, 982 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 1.27k op/s 2024-09-19T04:20:31.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:31 smithi007 ceph-mon[31360]: pgmap v462: 129 pgs: 129 active+clean; 212 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 1.39k op/s 2024-09-19T04:20:31.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:31 smithi102 ceph-mon[35446]: pgmap v462: 129 pgs: 129 active+clean; 212 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 1.39k op/s 2024-09-19T04:20:31.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:31 smithi092 ceph-mon[34940]: pgmap v462: 129 pgs: 129 active+clean; 212 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 1.39k op/s 2024-09-19T04:20:33.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:33 smithi007 ceph-mon[31360]: pgmap v463: 129 pgs: 129 active+clean; 217 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 KiB/s rd, 2.2 MiB/s wr, 1.15k op/s 2024-09-19T04:20:33.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:33 smithi102 ceph-mon[35446]: pgmap v463: 129 pgs: 129 active+clean; 217 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 KiB/s rd, 2.2 MiB/s wr, 1.15k op/s 2024-09-19T04:20:33.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:33 smithi092 ceph-mon[34940]: pgmap v463: 129 pgs: 129 active+clean; 217 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 KiB/s rd, 2.2 MiB/s wr, 1.15k op/s 2024-09-19T04:20:33.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.830+0000 7f29062c9640 1 -- 172.21.15.7:0/1699024640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29001036f0 msgr2=0x7f2900109f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:33.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.830+0000 7f29062c9640 1 --2- 172.21.15.7:0/1699024640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29001036f0 0x7f2900109f80 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009ca0 tx=0x7f28f802a8c0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.830+0000 7f29062c9640 1 -- 172.21.15.7:0/1699024640 shutdown_connections 2024-09-19T04:20:33.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.830+0000 7f29062c9640 1 --2- 172.21.15.7:0/1699024640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29001036f0 0x7f2900109f80 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.830+0000 7f29062c9640 1 --2- 172.21.15.7:0/1699024640 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2900102d30 0x7f29001031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.830+0000 7f29062c9640 1 --2- 172.21.15.7:0/1699024640 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2900101b40 0x7f2900101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.830+0000 7f29062c9640 1 -- 172.21.15.7:0/1699024640 >> 172.21.15.7:0/1699024640 conn(0x7f29000fd2e0 msgr2=0x7f29000ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:33.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.830+0000 7f29062c9640 1 -- 172.21.15.7:0/1699024640 shutdown_connections 2024-09-19T04:20:33.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.830+0000 7f29062c9640 1 -- 172.21.15.7:0/1699024640 wait complete. 2024-09-19T04:20:33.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.831+0000 7f29062c9640 1 Processor -- start 2024-09-19T04:20:33.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.831+0000 7f29062c9640 1 -- start start 2024-09-19T04:20:33.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.831+0000 7f29062c9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2900101b40 0x7f2900197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:33.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.831+0000 7f29062c9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2900102d30 0x7f2900198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:33.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.831+0000 7f29062c9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29001036f0 0x7f290019f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:33.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.831+0000 7f29062c9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f290010d7c0 con 0x7f2900101b40 2024-09-19T04:20:33.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.831+0000 7f29062c9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f290010d640 con 0x7f29001036f0 2024-09-19T04:20:33.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.831+0000 7f29062c9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f290010d940 con 0x7f2900102d30 2024-09-19T04:20:33.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.831+0000 7f28fffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2900101b40 0x7f2900197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:33.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.831+0000 7f28fffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2900101b40 0x7f2900197e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51106/0 (socket says 172.21.15.7:51106) 2024-09-19T04:20:33.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.831+0000 7f28fffff640 1 -- 172.21.15.7:0/3050141825 learned_addr learned my addr 172.21.15.7:0/3050141825 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:33.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.831+0000 7f2904866640 1 --2- 172.21.15.7:0/3050141825 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29001036f0 0x7f290019f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:33.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.831+0000 7f28ff7fe640 1 --2- 172.21.15.7:0/3050141825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2900102d30 0x7f2900198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:33.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.832+0000 7f28fffff640 1 -- 172.21.15.7:0/3050141825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2900102d30 msgr2=0x7f2900198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:33.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.832+0000 7f28fffff640 1 --2- 172.21.15.7:0/3050141825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2900102d30 0x7f2900198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.832+0000 7f28fffff640 1 -- 172.21.15.7:0/3050141825 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29001036f0 msgr2=0x7f290019f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:33.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.832+0000 7f28fffff640 1 --2- 172.21.15.7:0/3050141825 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29001036f0 0x7f290019f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.832+0000 7f28fffff640 1 -- 172.21.15.7:0/3050141825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f290019fa60 con 0x7f2900101b40 2024-09-19T04:20:33.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.832+0000 7f2904866640 1 --2- 172.21.15.7:0/3050141825 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29001036f0 0x7f290019f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:20:33.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.832+0000 7f28fffff640 1 --2- 172.21.15.7:0/3050141825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2900101b40 0x7f2900197e40 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f28f000e9c0 tx=0x7f28f000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:33.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.832+0000 7f28fd7fa640 1 -- 172.21.15.7:0/3050141825 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f000cd80 con 0x7f2900101b40 2024-09-19T04:20:33.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.832+0000 7f29062c9640 1 -- 172.21.15.7:0/3050141825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f290019fd50 con 0x7f2900101b40 2024-09-19T04:20:33.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.832+0000 7f28fd7fa640 1 -- 172.21.15.7:0/3050141825 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28f00035f0 con 0x7f2900101b40 2024-09-19T04:20:33.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.832+0000 7f28fd7fa640 1 -- 172.21.15.7:0/3050141825 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f0010690 con 0x7f2900101b40 2024-09-19T04:20:33.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.832+0000 7f29062c9640 1 -- 172.21.15.7:0/3050141825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29001a0210 con 0x7f2900101b40 2024-09-19T04:20:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.834+0000 7f28fd7fa640 1 -- 172.21.15.7:0/3050141825 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f28f00037a0 con 0x7f2900101b40 2024-09-19T04:20:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.834+0000 7f290905f740 1 Processor -- start 2024-09-19T04:20:33.838 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.835+0000 7f290905f740 1 -- start start 2024-09-19T04:20:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.835+0000 7f290905f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5570485ea9a0 0x5570485eada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.835+0000 7f290905f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570485eb2e0 0x5570485efda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.835+0000 7f290905f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570485f0370 0x5570485f2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.835+0000 7f290905f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55704854e2f0 con 0x5570485f0370 2024-09-19T04:20:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.835+0000 7f290905f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5570484f6270 con 0x5570485eb2e0 2024-09-19T04:20:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.835+0000 7f290905f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55704854a2b0 con 0x5570485ea9a0 2024-09-19T04:20:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.835+0000 7f28ff7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570485f0370 0x5570485f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.835+0000 7f2904866640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5570485ea9a0 0x5570485eada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.835+0000 7f28fffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570485eb2e0 0x5570485efda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.835+0000 7f28ff7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570485f0370 0x5570485f2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51118/0 (socket says 172.21.15.7:51118) 2024-09-19T04:20:33.839 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.835+0000 7f2904866640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5570485ea9a0 0x5570485eada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:48770/0 (socket says 172.21.15.7:48770) 2024-09-19T04:20:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.835+0000 7f28fffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570485eb2e0 0x5570485efda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:57150/0 (socket says 172.21.15.7:57150) 2024-09-19T04:20:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.835+0000 7f28ff7fe640 1 -- 172.21.15.7:0/173277768 learned_addr learned my addr 172.21.15.7:0/173277768 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.835+0000 7f28fd7fa640 1 --2- 172.21.15.7:0/3050141825 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f28e80a3240 0x7f28e80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.835+0000 7f28ff7fe640 1 -- 172.21.15.7:0/173277768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5570485ea9a0 msgr2=0x5570485eada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.835+0000 7f28ff7fe640 1 --2- 172.21.15.7:0/173277768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5570485ea9a0 0x5570485eada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.835+0000 7f28ff7fe640 1 -- 172.21.15.7:0/173277768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570485eb2e0 msgr2=0x5570485efda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.835+0000 7f28ff7fe640 1 --2- 172.21.15.7:0/173277768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570485eb2e0 0x5570485efda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.835+0000 7f28ff7fe640 1 -- 172.21.15.7:0/173277768 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570484f5340 con 0x5570485f0370 2024-09-19T04:20:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.835+0000 7f28fffff640 1 --2- 172.21.15.7:0/173277768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570485eb2e0 0x5570485efda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:20:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.835+0000 7f2904866640 1 --2- 172.21.15.7:0/3050141825 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f28e80a3240 0x7f28e80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.835+0000 7f28fd7fa640 1 -- 172.21.15.7:0/3050141825 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f28f00d00b0 con 0x7f2900101b40 2024-09-19T04:20:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.835+0000 7f28ff7fe640 1 --2- 172.21.15.7:0/173277768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570485f0370 0x5570485f2830 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f28f4009ca0 tx=0x7f28f4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e270c334a8800515 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:33.840 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.836+0000 7f28e67fc640 1 -- 172.21.15.7:0/173277768 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f4005220 con 0x5570485f0370 2024-09-19T04:20:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.836+0000 7f28e67fc640 1 -- 172.21.15.7:0/173277768 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28f4004c80 con 0x5570485f0370 2024-09-19T04:20:33.841 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.836+0000 7f28e67fc640 1 -- 172.21.15.7:0/173277768 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f4019810 con 0x5570485f0370 2024-09-19T04:20:33.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:33.835+0000 7fa3c97fa640 1 -- 172.21.15.7:0/3052932251 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7fa3d4037040 con 0x5649878ac720 2024-09-19T04:20:33.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:33.835+0000 7fa3c97fa640 10 client.25430 handle_command_reply: tid=0 2024-09-19T04:20:33.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:33.835+0000 7fa3ea15c740 1 client.25430 shutdown 2024-09-19T04:20:33.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:33.836+0000 7fa3ea15c740 1 -- 172.21.15.7:0/3052932251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564987830ae0 msgr2=0x56498782b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:33.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:33.836+0000 7fa3ea15c740 1 --2- 172.21.15.7:0/3052932251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564987830ae0 0x56498782b4c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4006010 tx=0x7fa3d4003dc0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:33.836+0000 7fa3ea15c740 1 -- 172.21.15.7:0/3052932251 shutdown_connections 2024-09-19T04:20:33.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:33.836+0000 7fa3ea15c740 1 --2- 172.21.15.7:0/3052932251 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5649878ac720 0x5649878aeb40 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:33.836+0000 7fa3ea15c740 1 --2- 172.21.15.7:0/3052932251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564987830ae0 0x56498782b4c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:33.836+0000 7fa3ea15c740 1 --2- 172.21.15.7:0/3052932251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56498782c9b0 0x56498782af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:33.836+0000 7fa3c97fa640 0 client.25430 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:20:33.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:33.836+0000 7fa3ea15c740 1 --2- 172.21.15.7:0/3052932251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564987825900 0x56498782aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:33.836+0000 7fa3ea15c740 1 -- 172.21.15.7:0/3052932251 >> 172.21.15.7:0/3052932251 conn(0x564987821e90 msgr2=0x564987821000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:33.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:33.836+0000 7fa3ea15c740 1 -- 172.21.15.7:0/3052932251 shutdown_connections 2024-09-19T04:20:33.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:33.836+0000 7fa3ea15c740 1 -- 172.21.15.7:0/3052932251 wait complete. 2024-09-19T04:20:33.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:33.836+0000 7fa3ea15c740 20 client.25430 trim_cache size 0 max 16384 2024-09-19T04:20:33.842 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:20:33.843 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 32, 2024-09-19T04:20:33.843 INFO:teuthology.orchestra.run.smithi007.stdout: "leader": 24506, 2024-09-19T04:20:33.843 INFO:teuthology.orchestra.run.smithi007.stdout: "set_version": 14, 2024-09-19T04:20:33.843 INFO:teuthology.orchestra.run.smithi007.stdout: "sets": { 2024-09-19T04:20:33.843 INFO:teuthology.orchestra.run.smithi007.stdout: "eab6828c": { 2024-09-19T04:20:33.843 INFO:teuthology.orchestra.run.smithi007.stdout: "version": 14, 2024-09-19T04:20:33.843 INFO:teuthology.orchestra.run.smithi007.stdout: "age_ref": 0.0, 2024-09-19T04:20:33.843 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:20:33.843 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "QUIESCED", 2024-09-19T04:20:33.843 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:20:33.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:20:33.843 INFO:teuthology.orchestra.run.smithi007.stdout: "timeout": 90.0, 2024-09-19T04:20:33.844 INFO:teuthology.orchestra.run.smithi007.stdout: "expiration": 136.6, 2024-09-19T04:20:33.844 INFO:teuthology.orchestra.run.smithi007.stdout: "members": { 2024-09-19T04:20:33.844 INFO:teuthology.orchestra.run.smithi007.stdout: "file:/": { 2024-09-19T04:20:33.844 INFO:teuthology.orchestra.run.smithi007.stdout: "excluded": false, 2024-09-19T04:20:33.844 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:20:33.844 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "QUIESCED", 2024-09-19T04:20:33.844 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:20:33.844 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:20:33.844 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:20:33.844 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:20:33.844 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:20:33.844 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:20:33.845 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:20:33.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.837+0000 7f2904866640 1 --2- 172.21.15.7:0/3050141825 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f28e80a3240 0x7f28e80a5700 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f28f8005e30 tx=0x7f28f80095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:33.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.837+0000 7f290905f740 1 -- 172.21.15.7:0/173277768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570485f0370 msgr2=0x5570485f2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:33.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.837+0000 7f290905f740 1 --2- 172.21.15.7:0/173277768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570485f0370 0x5570485f2830 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f28f4009ca0 tx=0x7f28f4011810 comp rx=0 tx=0).stop 2024-09-19T04:20:33.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.837+0000 7f290905f740 1 -- 172.21.15.7:0/173277768 shutdown_connections 2024-09-19T04:20:33.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.837+0000 7f290905f740 1 --2- 172.21.15.7:0/173277768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570485f0370 0x5570485f2830 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.845 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.837+0000 7f290905f740 1 --2- 172.21.15.7:0/173277768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570485eb2e0 0x5570485efda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.837+0000 7f290905f740 1 --2- 172.21.15.7:0/173277768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5570485ea9a0 0x5570485eada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.846 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.837+0000 7f290905f740 1 -- 172.21.15.7:0/173277768 >> 172.21.15.7:0/173277768 conn(0x5570485e6010 msgr2=0x5570485e6410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:33.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:33.837+0000 7fa3e6b21640 1 -- 172.21.15.7:0/653200371 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa3cc0a3450 msgr2=0x7fa3cc0a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:33.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:33.837+0000 7fa3e6b21640 1 --2- 172.21.15.7:0/653200371 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa3cc0a3450 0x7fa3cc0a5910 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4009b30 tx=0x7fa3d4030fa0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:33.837+0000 7fa3e6b21640 1 -- 172.21.15.7:0/653200371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3e006ea30 msgr2=0x7fa3e0119660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:33.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:33.837+0000 7fa3e6b21640 1 --2- 172.21.15.7:0/653200371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3e006ea30 0x7fa3e0119660 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc00e790 tx=0x7fa3dc00ec50 comp rx=0 tx=0).stop 2024-09-19T04:20:33.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:33.837+0000 7fa3e6b21640 1 -- 172.21.15.7:0/653200371 shutdown_connections 2024-09-19T04:20:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.837+0000 7f290905f740 1 -- 172.21.15.7:0/173277768 shutdown_connections 2024-09-19T04:20:33.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:33.837+0000 7fa3e6b21640 1 --2- 172.21.15.7:0/653200371 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa3cc0a3450 0x7fa3cc0a5910 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:33.837+0000 7fa3e6b21640 1 --2- 172.21.15.7:0/653200371 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3e011b140 0x7fa3e01128d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:33.837+0000 7fa3e6b21640 1 --2- 172.21.15.7:0/653200371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3e0110190 0x7fa3e0119ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:33.837+0000 7fa3e6b21640 1 --2- 172.21.15.7:0/653200371 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3e006ea30 0x7fa3e0119660 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:33.837+0000 7fa3e6b21640 1 -- 172.21.15.7:0/653200371 >> 172.21.15.7:0/653200371 conn(0x7fa3e0073180 msgr2=0x7fa3e006b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:33.847 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.837+0000 7f290905f740 1 -- 172.21.15.7:0/173277768 wait complete. 2024-09-19T04:20:33.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:33.837+0000 7fa3e6b21640 1 -- 172.21.15.7:0/653200371 shutdown_connections 2024-09-19T04:20:33.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:33.837+0000 7fa3e6b21640 1 -- 172.21.15.7:0/653200371 wait complete. 2024-09-19T04:20:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.837+0000 7f290905f740 1 -- start start 2024-09-19T04:20:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.838+0000 7f290905f740 1 Processor -- start 2024-09-19T04:20:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.838+0000 7f290905f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570485ea9a0 0x5570485f4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.838+0000 7f290905f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5570485eb2e0 0x5570485f5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.838+0000 7f290905f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570485f0370 0x5570485fc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.838+0000 7f290905f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5570485f3340 con 0x5570485ea9a0 2024-09-19T04:20:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.838+0000 7f290905f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5570484d7290 con 0x5570485f0370 2024-09-19T04:20:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.838+0000 7f290905f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5570485f34c0 con 0x5570485eb2e0 2024-09-19T04:20:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.838+0000 7f290905f740 10 client.0 _ll_register_callbacks cb 0x557048508140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:20:33.852 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.838+0000 7f28fffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570485ea9a0 0x5570485f4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:33.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.838+0000 7f28fffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570485ea9a0 0x5570485f4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51120/0 (socket says 172.21.15.7:51120) 2024-09-19T04:20:33.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.838+0000 7f28fffff640 1 -- 172.21.15.7:0/2068608511 learned_addr learned my addr 172.21.15.7:0/2068608511 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:33.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.838+0000 7f2904866640 1 --2- 172.21.15.7:0/2068608511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570485f0370 0x5570485fc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:33.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.838+0000 7f28ff7fe640 1 --2- 172.21.15.7:0/2068608511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5570485eb2e0 0x5570485f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:33.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.838+0000 7f28fffff640 1 -- 172.21.15.7:0/2068608511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5570485eb2e0 msgr2=0x5570485f5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:33.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.838+0000 7f28fffff640 1 --2- 172.21.15.7:0/2068608511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5570485eb2e0 0x5570485f5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.839+0000 7f28fffff640 1 -- 172.21.15.7:0/2068608511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570485f0370 msgr2=0x5570485fc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:33.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.839+0000 7f28fffff640 1 --2- 172.21.15.7:0/2068608511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570485f0370 0x5570485fc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.839+0000 7f28fffff640 1 -- 172.21.15.7:0/2068608511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557048261210 con 0x5570485ea9a0 2024-09-19T04:20:33.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.839+0000 7f2904866640 1 --2- 172.21.15.7:0/2068608511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570485f0370 0x5570485fc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:20:33.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.839+0000 7f28fffff640 1 --2- 172.21.15.7:0/2068608511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570485ea9a0 0x5570485f4b30 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f28f009c000 tx=0x7f28f00d3820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7fecb9ab1da47cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:33.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.839+0000 7f28df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:20:33.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.839+0000 7f28df7fe640 1 -- 172.21.15.7:0/2068608511 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f009bc60 con 0x5570485ea9a0 2024-09-19T04:20:33.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.839+0000 7f28df7fe640 1 -- 172.21.15.7:0/2068608511 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f28f00d3ca0 con 0x5570485ea9a0 2024-09-19T04:20:33.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.839+0000 7f290905f740 1 -- 172.21.15.7:0/2068608511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28f4004c80 con 0x5570485ea9a0 2024-09-19T04:20:33.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.839+0000 7f28df7fe640 1 -- 172.21.15.7:0/2068608511 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f28f009ca00 con 0x5570485ea9a0 2024-09-19T04:20:33.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.839+0000 7f290905f740 10 client.15843 fetch_fsmap learned FSMap version 32 2024-09-19T04:20:33.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.839+0000 7f290905f740 1 -- 172.21.15.7:0/2068608511 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55704832d620 con 0x5570485ea9a0 2024-09-19T04:20:33.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.839+0000 7f28df7fe640 1 -- 172.21.15.7:0/2068608511 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28f4004c80 con 0x5570485ea9a0 2024-09-19T04:20:33.855 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.839+0000 7f28df7fe640 1 -- 172.21.15.7:0/2068608511 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f28f00d20d0 con 0x5570485ea9a0 2024-09-19T04:20:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.840+0000 7f290905f740 10 client.15843 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T04:20:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.840+0000 7f290905f740 10 client.15843 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:20:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.840+0000 7f290905f740 20 client.15843 populate_metadata read hostname 'smithi007' 2024-09-19T04:20:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.840+0000 7f290905f740 1 --2- 172.21.15.7:0/2068608511 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557048600770 0x557048602be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.840+0000 7f290905f740 4 client.15843 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:20:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.840+0000 7f290905f740 1 -- 172.21.15.7:0/2068608511 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55704855ba20 con 0x557048600770 2024-09-19T04:20:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.840+0000 7f28ff7fe640 1 --2- 172.21.15.7:0/2068608511 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557048600770 0x557048602be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.840+0000 7f28ff7fe640 1 --2- 172.21.15.7:0/2068608511 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557048600770 0x557048602be0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b48b455774d3509 server_cookie=9d1b6945f0cdacee in_seq=0 out_seq=0 2024-09-19T04:20:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.840+0000 7f28df7fe640 10 client.15843 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:20:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.843+0000 7f28df7fe640 1 -- 172.21.15.7:0/2068608511 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55704855ba20 con 0x557048600770 2024-09-19T04:20:33.856 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.843+0000 7f28df7fe640 10 client.15843 handle_command_reply: tid=0 2024-09-19T04:20:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.843+0000 7f290905f740 1 client.15843 shutdown 2024-09-19T04:20:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.843+0000 7f290905f740 1 -- 172.21.15.7:0/2068608511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570485ea9a0 msgr2=0x5570485f4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.843+0000 7f290905f740 1 --2- 172.21.15.7:0/2068608511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570485ea9a0 0x5570485f4b30 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f28f009c000 tx=0x7f28f00d3820 comp rx=0 tx=0).stop 2024-09-19T04:20:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.843+0000 7f290905f740 1 -- 172.21.15.7:0/2068608511 shutdown_connections 2024-09-19T04:20:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.843+0000 7f290905f740 1 --2- 172.21.15.7:0/2068608511 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557048600770 0x557048602be0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.843+0000 7f290905f740 1 --2- 172.21.15.7:0/2068608511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570485f0370 0x5570485fc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.843+0000 7f28df7fe640 0 client.15843 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:20:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.843+0000 7f290905f740 1 --2- 172.21.15.7:0/2068608511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5570485eb2e0 0x5570485f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.843+0000 7f290905f740 1 --2- 172.21.15.7:0/2068608511 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570485ea9a0 0x5570485f4b30 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.843+0000 7f290905f740 1 -- 172.21.15.7:0/2068608511 >> 172.21.15.7:0/2068608511 conn(0x5570485e6010 msgr2=0x5570485e7820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.843+0000 7f290905f740 1 -- 172.21.15.7:0/2068608511 shutdown_connections 2024-09-19T04:20:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.843+0000 7f290905f740 1 -- 172.21.15.7:0/2068608511 wait complete. 2024-09-19T04:20:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.843+0000 7f290905f740 20 client.15843 trim_cache size 0 max 16384 2024-09-19T04:20:33.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.859+0000 7f290905f740 1 Processor -- start 2024-09-19T04:20:33.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.859+0000 7f290905f740 1 -- start start 2024-09-19T04:20:33.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.859+0000 7f290905f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570485ea9a0 0x5570485f4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:33.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.859+0000 7f290905f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5570485eb2e0 0x5570485fbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:33.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.859+0000 7f290905f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570485f0370 0x5570485e6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:33.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.859+0000 7f290905f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f29001aa8a0 con 0x5570485f0370 2024-09-19T04:20:33.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.859+0000 7f290905f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f29001ac4a0 con 0x5570485ea9a0 2024-09-19T04:20:33.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.859+0000 7f290905f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f29001aaf70 con 0x5570485eb2e0 2024-09-19T04:20:33.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.859+0000 7f28fffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570485ea9a0 0x5570485f4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:33.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.859+0000 7f28ff7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5570485eb2e0 0x5570485fbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:33.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.859+0000 7f28fffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570485ea9a0 0x5570485f4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:57174/0 (socket says 172.21.15.7:57174) 2024-09-19T04:20:33.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.859+0000 7f28fffff640 1 -- 172.21.15.7:0/1870605208 learned_addr learned my addr 172.21.15.7:0/1870605208 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:33.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.859+0000 7f2904866640 1 --2- 172.21.15.7:0/1870605208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570485f0370 0x5570485e6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:33.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.860+0000 7f28ff7fe640 1 -- 172.21.15.7:0/1870605208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570485ea9a0 msgr2=0x5570485f4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:33.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.860+0000 7f28ff7fe640 1 --2- 172.21.15.7:0/1870605208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570485ea9a0 0x5570485f4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.860+0000 7f28ff7fe640 1 -- 172.21.15.7:0/1870605208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570485f0370 msgr2=0x5570485e6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:33.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.860+0000 7f28ff7fe640 1 --2- 172.21.15.7:0/1870605208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570485f0370 0x5570485e6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.860+0000 7f28ff7fe640 1 -- 172.21.15.7:0/1870605208 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570485eb7c0 con 0x5570485eb2e0 2024-09-19T04:20:33.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.860+0000 7f28fffff640 1 --2- 172.21.15.7:0/1870605208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570485ea9a0 0x5570485f4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:20:33.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.860+0000 7f28ff7fe640 1 --2- 172.21.15.7:0/1870605208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5570485eb2e0 0x5570485fbfd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f28f4005890 tx=0x7f28f4025040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96e856e083a064bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:33.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.860+0000 7f28e5ffb640 1 -- 172.21.15.7:0/1870605208 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f4011d10 con 0x5570485eb2e0 2024-09-19T04:20:33.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.860+0000 7f28e5ffb640 1 -- 172.21.15.7:0/1870605208 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28f4005000 con 0x5570485eb2e0 2024-09-19T04:20:33.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.860+0000 7f28e5ffb640 1 -- 172.21.15.7:0/1870605208 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f4003830 con 0x5570485eb2e0 2024-09-19T04:20:33.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.861+0000 7f290905f740 1 -- 172.21.15.7:0/1870605208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5570485eb2e0 msgr2=0x5570485fbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:33.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.861+0000 7f290905f740 1 --2- 172.21.15.7:0/1870605208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5570485eb2e0 0x5570485fbfd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f28f4005890 tx=0x7f28f4025040 comp rx=0 tx=0).stop 2024-09-19T04:20:33.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.861+0000 7f290905f740 1 -- 172.21.15.7:0/1870605208 shutdown_connections 2024-09-19T04:20:33.866 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.861+0000 7f290905f740 1 --2- 172.21.15.7:0/1870605208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570485f0370 0x5570485e6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.861+0000 7f290905f740 1 --2- 172.21.15.7:0/1870605208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5570485eb2e0 0x5570485fbfd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.861+0000 7f290905f740 1 --2- 172.21.15.7:0/1870605208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570485ea9a0 0x5570485f4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.861+0000 7f290905f740 1 -- 172.21.15.7:0/1870605208 >> 172.21.15.7:0/1870605208 conn(0x5570485e6010 msgr2=0x5570485f48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.861+0000 7f290905f740 1 -- 172.21.15.7:0/1870605208 shutdown_connections 2024-09-19T04:20:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.861+0000 7f290905f740 1 -- 172.21.15.7:0/1870605208 wait complete. 2024-09-19T04:20:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.861+0000 7f290905f740 1 -- start start 2024-09-19T04:20:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.862+0000 7f290905f740 1 Processor -- start 2024-09-19T04:20:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.862+0000 7f290905f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570485ea9a0 0x5570485f93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.862+0000 7f290905f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570485eb2e0 0x5570485f98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.862+0000 7f290905f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5570485f0370 0x5570485fa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.862+0000 7f290905f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f29001abd10 con 0x5570485eb2e0 2024-09-19T04:20:33.867 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.862+0000 7f290905f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f29001ab640 con 0x5570485ea9a0 2024-09-19T04:20:33.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.862+0000 7f290905f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f29001a8860 con 0x5570485f0370 2024-09-19T04:20:33.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.862+0000 7f290905f740 10 client.0 _ll_register_callbacks cb 0x7f28f00046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:20:33.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.862+0000 7f28ff7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570485eb2e0 0x5570485f98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:33.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.862+0000 7f28fffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570485ea9a0 0x5570485f93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:33.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.862+0000 7f28ff7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570485eb2e0 0x5570485f98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51136/0 (socket says 172.21.15.7:51136) 2024-09-19T04:20:33.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.862+0000 7f28fffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570485ea9a0 0x5570485f93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:57188/0 (socket says 172.21.15.7:57188) 2024-09-19T04:20:33.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.862+0000 7f28fffff640 1 -- 172.21.15.7:0/2865803882 learned_addr learned my addr 172.21.15.7:0/2865803882 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:33.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.862+0000 7f2904866640 1 --2- 172.21.15.7:0/2865803882 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5570485f0370 0x5570485fa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:33.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.862+0000 7f28fffff640 1 -- 172.21.15.7:0/2865803882 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5570485f0370 msgr2=0x5570485fa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:33.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.862+0000 7f28fffff640 1 --2- 172.21.15.7:0/2865803882 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5570485f0370 0x5570485fa8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.862+0000 7f28fffff640 1 -- 172.21.15.7:0/2865803882 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570485eb2e0 msgr2=0x5570485f98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:33.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.862+0000 7f28fffff640 1 --2- 172.21.15.7:0/2865803882 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570485eb2e0 0x5570485f98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:33.868 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.862+0000 7f28fffff640 1 -- 172.21.15.7:0/2865803882 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570485faec0 con 0x5570485ea9a0 2024-09-19T04:20:33.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.863+0000 7f28fffff640 1 --2- 172.21.15.7:0/2865803882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570485ea9a0 0x5570485f93b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f28f0098760 tx=0x7f28f0003d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33ca7ef497808899 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:33.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.863+0000 7f28df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T04:20:33.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.863+0000 7f28df7fe640 1 -- 172.21.15.7:0/2865803882 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f009bc60 con 0x5570485ea9a0 2024-09-19T04:20:33.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.863+0000 7f28df7fe640 1 -- 172.21.15.7:0/2865803882 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f28f00a0180 con 0x5570485ea9a0 2024-09-19T04:20:33.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.863+0000 7f290905f740 1 -- 172.21.15.7:0/2865803882 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28f4005000 con 0x5570485ea9a0 2024-09-19T04:20:33.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.863+0000 7f28df7fe640 1 -- 172.21.15.7:0/2865803882 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f28f009c0d0 con 0x5570485ea9a0 2024-09-19T04:20:33.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.863+0000 7f290905f740 10 client.25448 fetch_fsmap learned FSMap version 32 2024-09-19T04:20:33.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.863+0000 7f290905f740 1 -- 172.21.15.7:0/2865803882 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5570485fc240 con 0x5570485ea9a0 2024-09-19T04:20:33.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.863+0000 7f28df7fe640 1 -- 172.21.15.7:0/2865803882 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28f4005000 con 0x5570485ea9a0 2024-09-19T04:20:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.863+0000 7f28df7fe640 1 -- 172.21.15.7:0/2865803882 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f28f009b1c0 con 0x5570485ea9a0 2024-09-19T04:20:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.863+0000 7f290905f740 10 client.25448 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T04:20:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.863+0000 7f290905f740 10 client.25448 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:20:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.863+0000 7f290905f740 20 client.25448 populate_metadata read hostname 'smithi007' 2024-09-19T04:20:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.863+0000 7f290905f740 1 --2- 172.21.15.7:0/2865803882 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557048600770 0x55704866dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.863+0000 7f290905f740 4 client.25448 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:20:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.863+0000 7f290905f740 1 -- 172.21.15.7:0/2865803882 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557048555d70 con 0x557048600770 2024-09-19T04:20:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.864+0000 7f28ff7fe640 1 --2- 172.21.15.7:0/2865803882 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557048600770 0x55704866dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.864+0000 7f28df7fe640 10 client.25448 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:20:33.870 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:33.864+0000 7f28ff7fe640 1 --2- 172.21.15.7:0/2865803882 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557048600770 0x55704866dc90 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dfa5c0c47796184 server_cookie=213a219c5a013079 in_seq=0 out_seq=0 2024-09-19T04:20:34.606 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'eab6828c', quiesce took 22.5 seconds. Will release after: -5.899999999999999 2024-09-19T04:20:34.606 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:20:34.915 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:20:35.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:35 smithi007 ceph-mon[31360]: pgmap v464: 129 pgs: 129 active+clean; 220 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 2.4 MiB/s wr, 891 op/s 2024-09-19T04:20:35.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:35 smithi102 ceph-mon[35446]: pgmap v464: 129 pgs: 129 active+clean; 220 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 2.4 MiB/s wr, 891 op/s 2024-09-19T04:20:35.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:35 smithi092 ceph-mon[34940]: pgmap v464: 129 pgs: 129 active+clean; 220 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 2.4 MiB/s wr, 891 op/s 2024-09-19T04:20:36.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:36.390+0000 7f28df7fe640 1 -- 172.21.15.7:0/2865803882 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557048555d70 con 0x557048600770 2024-09-19T04:20:36.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:36.390+0000 7f28df7fe640 10 client.25448 handle_command_reply: tid=0 2024-09-19T04:20:36.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:36.390+0000 7f290905f740 1 client.25448 shutdown 2024-09-19T04:20:36.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:36.391+0000 7f290905f740 1 -- 172.21.15.7:0/2865803882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570485ea9a0 msgr2=0x5570485f93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:36.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:36.391+0000 7f290905f740 1 --2- 172.21.15.7:0/2865803882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570485ea9a0 0x5570485f93b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f28f0098760 tx=0x7f28f0003d60 comp rx=0 tx=0).stop 2024-09-19T04:20:36.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:36.391+0000 7f290905f740 1 -- 172.21.15.7:0/2865803882 shutdown_connections 2024-09-19T04:20:36.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:36.391+0000 7f290905f740 1 --2- 172.21.15.7:0/2865803882 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557048600770 0x55704866dc90 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:36.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:36.391+0000 7f290905f740 1 --2- 172.21.15.7:0/2865803882 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5570485f0370 0x5570485fa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:36.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:36.391+0000 7f290905f740 1 --2- 172.21.15.7:0/2865803882 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5570485eb2e0 0x5570485f98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:36.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:36.391+0000 7f290905f740 1 --2- 172.21.15.7:0/2865803882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5570485ea9a0 0x5570485f93b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:36.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:36.391+0000 7f290905f740 1 -- 172.21.15.7:0/2865803882 >> 172.21.15.7:0/2865803882 conn(0x5570485e6010 msgr2=0x5570485e49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:36.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:36.391+0000 7f28df7fe640 0 client.25448 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:20:36.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:36.391+0000 7f290905f740 1 -- 172.21.15.7:0/2865803882 shutdown_connections 2024-09-19T04:20:36.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:36.391+0000 7f290905f740 1 -- 172.21.15.7:0/2865803882 wait complete. 2024-09-19T04:20:36.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:36.392+0000 7f290905f740 20 client.25448 trim_cache size 0 max 16384 2024-09-19T04:20:36.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:20:36.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:20:36.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:20:36.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:20:36.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:36.392+0000 7f29062c9640 1 -- 172.21.15.7:0/3050141825 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f28e80a3240 msgr2=0x7f28e80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:36.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:36.392+0000 7f29062c9640 1 --2- 172.21.15.7:0/3050141825 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f28e80a3240 0x7f28e80a5700 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f28f8005e30 tx=0x7f28f80095c0 comp rx=0 tx=0).stop 2024-09-19T04:20:36.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:36.393+0000 7f29062c9640 1 -- 172.21.15.7:0/3050141825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2900101b40 msgr2=0x7f2900197e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:36.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:36.393+0000 7f29062c9640 1 --2- 172.21.15.7:0/3050141825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2900101b40 0x7f2900197e40 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f28f000e9c0 tx=0x7f28f000ee80 comp rx=0 tx=0).stop 2024-09-19T04:20:36.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:36.393+0000 7f29062c9640 1 -- 172.21.15.7:0/3050141825 shutdown_connections 2024-09-19T04:20:36.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:36.393+0000 7f29062c9640 1 --2- 172.21.15.7:0/3050141825 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f28e80a3240 0x7f28e80a5700 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:36.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:36.393+0000 7f29062c9640 1 --2- 172.21.15.7:0/3050141825 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29001036f0 0x7f290019f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:36.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:36.393+0000 7f29062c9640 1 --2- 172.21.15.7:0/3050141825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2900102d30 0x7f2900198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:36.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:36.393+0000 7f29062c9640 1 --2- 172.21.15.7:0/3050141825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2900101b40 0x7f2900197e40 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:36.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:36.393+0000 7f29062c9640 1 -- 172.21.15.7:0/3050141825 >> 172.21.15.7:0/3050141825 conn(0x7f29000fd2e0 msgr2=0x7f29001060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:36.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:36.393+0000 7f29062c9640 1 -- 172.21.15.7:0/3050141825 shutdown_connections 2024-09-19T04:20:36.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:36.393+0000 7f29062c9640 1 -- 172.21.15.7:0/3050141825 wait complete. 2024-09-19T04:20:36.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.395+0000 7f6f92f89640 1 -- 172.21.15.7:0/2131661683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f8c076720 msgr2=0x7f6f8c076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:36.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.395+0000 7f6f92f89640 1 --2- 172.21.15.7:0/2131661683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f8c076720 0x7f6f8c076b00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c009900 tx=0x7f6f7c02a410 comp rx=0 tx=0).stop 2024-09-19T04:20:36.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.395+0000 7f6f92f89640 1 -- 172.21.15.7:0/2131661683 shutdown_connections 2024-09-19T04:20:36.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.395+0000 7f6f92f89640 1 --2- 172.21.15.7:0/2131661683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f8c112a30 0x7f6f8c114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:36.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.395+0000 7f6f92f89640 1 --2- 172.21.15.7:0/2131661683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f8c077040 0x7f6f8c1124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:36.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.395+0000 7f6f92f89640 1 --2- 172.21.15.7:0/2131661683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f8c076720 0x7f6f8c076b00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:36.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.395+0000 7f6f92f89640 1 -- 172.21.15.7:0/2131661683 >> 172.21.15.7:0/2131661683 conn(0x7f6f8c0ffab0 msgr2=0x7f6f8c101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:36.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.395+0000 7f6f92f89640 1 -- 172.21.15.7:0/2131661683 shutdown_connections 2024-09-19T04:20:36.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.395+0000 7f6f92f89640 1 -- 172.21.15.7:0/2131661683 wait complete. 2024-09-19T04:20:36.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.396+0000 7f6f92f89640 1 Processor -- start 2024-09-19T04:20:36.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.396+0000 7f6f92f89640 1 -- start start 2024-09-19T04:20:36.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.397+0000 7f6f92f89640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f8c076720 0x7f6f8c1a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:36.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.397+0000 7f6f92f89640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f8c077040 0x7f6f8c1a4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:36.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.397+0000 7f6f92f89640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f8c112a30 0x7f6f8c19e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:36.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.397+0000 7f6f92f89640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8c1185a0 con 0x7f6f8c112a30 2024-09-19T04:20:36.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.397+0000 7f6f92f89640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8c118420 con 0x7f6f8c076720 2024-09-19T04:20:36.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.397+0000 7f6f92f89640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8c118720 con 0x7f6f8c077040 2024-09-19T04:20:36.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.397+0000 7f6f8bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f8c077040 0x7f6f8c1a4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:36.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.397+0000 7f6f90d25640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f8c076720 0x7f6f8c1a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:36.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.397+0000 7f6f8bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f8c077040 0x7f6f8c1a4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:48808/0 (socket says 172.21.15.7:48808) 2024-09-19T04:20:36.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.397+0000 7f6f90d25640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f8c076720 0x7f6f8c1a4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:57210/0 (socket says 172.21.15.7:57210) 2024-09-19T04:20:36.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.397+0000 7f6f8bfff640 1 -- 172.21.15.7:0/3763855466 learned_addr learned my addr 172.21.15.7:0/3763855466 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:36.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.397+0000 7f6f91526640 1 --2- 172.21.15.7:0/3763855466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f8c112a30 0x7f6f8c19e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:36.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.397+0000 7f6f8bfff640 1 -- 172.21.15.7:0/3763855466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f8c076720 msgr2=0x7f6f8c1a4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:36.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.397+0000 7f6f8bfff640 1 --2- 172.21.15.7:0/3763855466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f8c076720 0x7f6f8c1a4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:36.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.397+0000 7f6f8bfff640 1 -- 172.21.15.7:0/3763855466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f8c112a30 msgr2=0x7f6f8c19e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:36.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.397+0000 7f6f8bfff640 1 --2- 172.21.15.7:0/3763855466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f8c112a30 0x7f6f8c19e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:36.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.397+0000 7f6f8bfff640 1 -- 172.21.15.7:0/3763855466 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f8c19f040 con 0x7f6f8c077040 2024-09-19T04:20:36.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.397+0000 7f6f90d25640 1 --2- 172.21.15.7:0/3763855466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f8c076720 0x7f6f8c1a4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:20:36.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.398+0000 7f6f8bfff640 1 --2- 172.21.15.7:0/3763855466 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f8c077040 0x7f6f8c1a4c90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000e9f0 tx=0x7f6f8000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:36.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.398+0000 7f6f89ffb640 1 -- 172.21.15.7:0/3763855466 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f8000cd80 con 0x7f6f8c077040 2024-09-19T04:20:36.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.398+0000 7f6f92f89640 1 -- 172.21.15.7:0/3763855466 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f8c19f330 con 0x7f6f8c077040 2024-09-19T04:20:36.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.398+0000 7f6f89ffb640 1 -- 172.21.15.7:0/3763855466 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f80010910 con 0x7f6f8c077040 2024-09-19T04:20:36.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.398+0000 7f6f89ffb640 1 -- 172.21.15.7:0/3763855466 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f800188f0 con 0x7f6f8c077040 2024-09-19T04:20:36.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.398+0000 7f6f92f89640 1 -- 172.21.15.7:0/3763855466 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f8c1ab620 con 0x7f6f8c077040 2024-09-19T04:20:36.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.399+0000 7f6f92f89640 1 -- 172.21.15.7:0/3763855466 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f8c076b00 con 0x7f6f8c077040 2024-09-19T04:20:36.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.401+0000 7f6f89ffb640 1 -- 172.21.15.7:0/3763855466 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f6f80010ac0 con 0x7f6f8c077040 2024-09-19T04:20:36.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.401+0000 7f6f89ffb640 1 --2- 172.21.15.7:0/3763855466 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6f740a32c0 0x7f6f740a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:36.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.401+0000 7f6f89ffb640 1 -- 172.21.15.7:0/3763855466 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f6f800d0410 con 0x7f6f8c077040 2024-09-19T04:20:36.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.401+0000 7f6f90d25640 1 --2- 172.21.15.7:0/3763855466 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6f740a32c0 0x7f6f740a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:36.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.402+0000 7f6f90d25640 1 --2- 172.21.15.7:0/3763855466 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6f740a32c0 0x7f6f740a5780 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c19fa50 tx=0x7f6f7c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:36.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.405+0000 7f6f89ffb640 1 -- 172.21.15.7:0/3763855466 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6f8009c6d0 con 0x7f6f8c077040 2024-09-19T04:20:36.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.629+0000 7f6f92f89640 1 -- 172.21.15.7:0/3763855466 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f8c1ab940 con 0x7f6f8c077040 2024-09-19T04:20:36.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.630+0000 7f6f89ffb640 1 -- 172.21.15.7:0/3763855466 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11969 (secure 0 0 0) 0x7f6f800a09d0 con 0x7f6f8c077040 2024-09-19T04:20:36.631 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:20:36.631 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":32,"btime":"2024-09-19T04:19:33:910404+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:19:32.925740+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24496,"mds_2":24482,"mds_3":24478,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24472,24478,24482,24496,24506]},"id":1}]} 2024-09-19T04:20:36.632 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 32 2024-09-19T04:20:36.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.632+0000 7f6f92f89640 1 -- 172.21.15.7:0/3763855466 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6f740a32c0 msgr2=0x7f6f740a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:36.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.632+0000 7f6f92f89640 1 --2- 172.21.15.7:0/3763855466 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6f740a32c0 0x7f6f740a5780 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c19fa50 tx=0x7f6f7c0058d0 comp rx=0 tx=0).stop 2024-09-19T04:20:36.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.632+0000 7f6f92f89640 1 -- 172.21.15.7:0/3763855466 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f8c077040 msgr2=0x7f6f8c1a4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:36.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.632+0000 7f6f92f89640 1 --2- 172.21.15.7:0/3763855466 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f8c077040 0x7f6f8c1a4c90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000e9f0 tx=0x7f6f8000eeb0 comp rx=0 tx=0).stop 2024-09-19T04:20:36.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.632+0000 7f6f92f89640 1 -- 172.21.15.7:0/3763855466 shutdown_connections 2024-09-19T04:20:36.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.632+0000 7f6f92f89640 1 --2- 172.21.15.7:0/3763855466 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6f740a32c0 0x7f6f740a5780 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:36.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.632+0000 7f6f92f89640 1 --2- 172.21.15.7:0/3763855466 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f8c112a30 0x7f6f8c19e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:36.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.632+0000 7f6f92f89640 1 --2- 172.21.15.7:0/3763855466 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f8c077040 0x7f6f8c1a4c90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:36.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.632+0000 7f6f92f89640 1 --2- 172.21.15.7:0/3763855466 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f8c076720 0x7f6f8c1a4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:36.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.632+0000 7f6f92f89640 1 -- 172.21.15.7:0/3763855466 >> 172.21.15.7:0/3763855466 conn(0x7f6f8c0ffab0 msgr2=0x7f6f8c101ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:36.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.632+0000 7f6f92f89640 1 -- 172.21.15.7:0/3763855466 shutdown_connections 2024-09-19T04:20:36.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:36.632+0000 7f6f92f89640 1 -- 172.21.15.7:0/3763855466 wait complete. 2024-09-19T04:20:37.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:37 smithi007 ceph-mon[31360]: pgmap v465: 129 pgs: 129 active+clean; 233 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 601 op/s 2024-09-19T04:20:37.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:37 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3763855466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:20:37.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:37 smithi102 ceph-mon[35446]: pgmap v465: 129 pgs: 129 active+clean; 233 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 601 op/s 2024-09-19T04:20:37.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:37 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3763855466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:20:37.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:37 smithi092 ceph-mon[34940]: pgmap v465: 129 pgs: 129 active+clean; 233 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 601 op/s 2024-09-19T04:20:37.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:37 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3763855466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:20:37.595 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24506 quiesce db --set-id eab6828c --release --await' 2024-09-19T04:20:37.595 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24506 quiesce db --set-id eab6828c --release --await 2024-09-19T04:20:37.870 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:20:38.158 INFO:tasks.workunit.client.0.smithi007.stdout: 77 2278 0 1902 0 2349 0 2024-09-19T04:20:38.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.384+0000 7f876a38f640 1 -- 172.21.15.7:0/2690438393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8764100e20 msgr2=0x7f8764101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:38.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.384+0000 7f876a38f640 1 --2- 172.21.15.7:0/2690438393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8764100e20 0x7f8764101200 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8754009930 tx=0x7f875402a4d0 comp rx=0 tx=0).stop 2024-09-19T04:20:38.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.384+0000 7f876a38f640 1 -- 172.21.15.7:0/2690438393 shutdown_connections 2024-09-19T04:20:38.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.384+0000 7f876a38f640 1 --2- 172.21.15.7:0/2690438393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8764102ef0 0x7f876410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:38.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.384+0000 7f876a38f640 1 --2- 172.21.15.7:0/2690438393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8764102570 0x7f87641029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:38.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.384+0000 7f876a38f640 1 --2- 172.21.15.7:0/2690438393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8764100e20 0x7f8764101200 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:38.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.384+0000 7f876a38f640 1 -- 172.21.15.7:0/2690438393 >> 172.21.15.7:0/2690438393 conn(0x7f87640fc7d0 msgr2=0x7f87640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:38.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.384+0000 7f876a38f640 1 -- 172.21.15.7:0/2690438393 shutdown_connections 2024-09-19T04:20:38.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.384+0000 7f876a38f640 1 -- 172.21.15.7:0/2690438393 wait complete. 2024-09-19T04:20:38.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.385+0000 7f876a38f640 1 Processor -- start 2024-09-19T04:20:38.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.385+0000 7f876a38f640 1 -- start start 2024-09-19T04:20:38.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.385+0000 7f876a38f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8764100e20 0x7f8764198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:38.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.385+0000 7f876a38f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8764102570 0x7f8764198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:38.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.385+0000 7f876a38f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8764102ef0 0x7f876419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:38.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.385+0000 7f876a38f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8764110f50 con 0x7f8764102570 2024-09-19T04:20:38.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.385+0000 7f876a38f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8764110dd0 con 0x7f8764100e20 2024-09-19T04:20:38.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.385+0000 7f876a38f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f87641110d0 con 0x7f8764102ef0 2024-09-19T04:20:38.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.385+0000 7f875bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8764102570 0x7f8764198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:38.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.385+0000 7f875bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8764102570 0x7f8764198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49140/0 (socket says 172.21.15.7:49140) 2024-09-19T04:20:38.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.385+0000 7f875bfff640 1 -- 172.21.15.7:0/595801700 learned_addr learned my addr 172.21.15.7:0/595801700 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:38.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.385+0000 7f8763fff640 1 --2- 172.21.15.7:0/595801700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8764100e20 0x7f8764198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:38.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.385+0000 7f876892c640 1 --2- 172.21.15.7:0/595801700 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8764102ef0 0x7f876419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:38.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.386+0000 7f875bfff640 1 -- 172.21.15.7:0/595801700 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8764102ef0 msgr2=0x7f876419ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:38.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.386+0000 7f875bfff640 1 --2- 172.21.15.7:0/595801700 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8764102ef0 0x7f876419ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:38.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.386+0000 7f875bfff640 1 -- 172.21.15.7:0/595801700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8764100e20 msgr2=0x7f8764198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:38.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.386+0000 7f875bfff640 1 --2- 172.21.15.7:0/595801700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8764100e20 0x7f8764198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:38.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.386+0000 7f875bfff640 1 -- 172.21.15.7:0/595801700 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f876419d500 con 0x7f8764102570 2024-09-19T04:20:38.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.386+0000 7f876892c640 1 --2- 172.21.15.7:0/595801700 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8764102ef0 0x7f876419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:20:38.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.386+0000 7f875bfff640 1 --2- 172.21.15.7:0/595801700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8764102570 0x7f8764198a90 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f874c00ea60 tx=0x7f874c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:38.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.386+0000 7f8761ffb640 1 -- 172.21.15.7:0/595801700 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874c00cde0 con 0x7f8764102570 2024-09-19T04:20:38.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.386+0000 7f876a38f640 1 -- 172.21.15.7:0/595801700 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f876419d7f0 con 0x7f8764102570 2024-09-19T04:20:38.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.386+0000 7f876a38f640 1 -- 172.21.15.7:0/595801700 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87641a50d0 con 0x7f8764102570 2024-09-19T04:20:38.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.386+0000 7f8761ffb640 1 -- 172.21.15.7:0/595801700 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f874c0035f0 con 0x7f8764102570 2024-09-19T04:20:38.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.386+0000 7f8761ffb640 1 -- 172.21.15.7:0/595801700 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874c010670 con 0x7f8764102570 2024-09-19T04:20:38.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.389+0000 7f8761ffb640 1 -- 172.21.15.7:0/595801700 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f874c010810 con 0x7f8764102570 2024-09-19T04:20:38.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.389+0000 7f876c768740 1 Processor -- start 2024-09-19T04:20:38.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.389+0000 7f876c768740 1 -- start start 2024-09-19T04:20:38.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.389+0000 7f876c768740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d369364060 0x55d369364440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:38.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.389+0000 7f876c768740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d369364980 0x55d36936ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:38.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.389+0000 7f876c768740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d36936f240 0x55d369371630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:38.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.389+0000 7f876c768740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d3692c9620 con 0x55d36936f240 2024-09-19T04:20:38.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.389+0000 7f876c768740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d369270e50 con 0x55d369364980 2024-09-19T04:20:38.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.389+0000 7f876c768740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d3692c55e0 con 0x55d369364060 2024-09-19T04:20:38.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.390+0000 7f8763fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d369364980 0x55d36936ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:38.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.390+0000 7f876892c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d369364060 0x55d369364440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:38.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.390+0000 7f8763fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d369364980 0x55d36936ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:50508/0 (socket says 172.21.15.7:50508) 2024-09-19T04:20:38.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.390+0000 7f8763fff640 1 -- 172.21.15.7:0/2803506352 learned_addr learned my addr 172.21.15.7:0/2803506352 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:38.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.390+0000 7f875bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d36936f240 0x55d369371630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:38.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.390+0000 7f8763fff640 1 -- 172.21.15.7:0/2803506352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d369364060 msgr2=0x55d369364440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:38.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.390+0000 7f8763fff640 1 --2- 172.21.15.7:0/2803506352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d369364060 0x55d369364440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:38.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.390+0000 7f8763fff640 1 -- 172.21.15.7:0/2803506352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d36936f240 msgr2=0x55d369371630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:38.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.390+0000 7f8763fff640 1 --2- 172.21.15.7:0/2803506352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d36936f240 0x55d369371630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:38.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.390+0000 7f8763fff640 1 -- 172.21.15.7:0/2803506352 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d369261d40 con 0x55d369364980 2024-09-19T04:20:38.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.390+0000 7f8761ffb640 1 --2- 172.21.15.7:0/595801700 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f87500a3240 0x7f87500a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:38.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.390+0000 7f876892c640 1 --2- 172.21.15.7:0/595801700 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f87500a3240 0x7f87500a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:38.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.390+0000 7f8763fff640 1 --2- 172.21.15.7:0/2803506352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d369364980 0x55d36936ed00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f875402a9f0 tx=0x7f8754005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3d8a5afd96bba8b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:38.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.390+0000 7f8761ffb640 1 -- 172.21.15.7:0/595801700 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f874c0d0070 con 0x7f8764102570 2024-09-19T04:20:38.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.390+0000 7f875a7fc640 1 -- 172.21.15.7:0/2803506352 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8754040070 con 0x55d369364980 2024-09-19T04:20:38.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.390+0000 7f875a7fc640 1 -- 172.21.15.7:0/2803506352 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8754031870 con 0x55d369364980 2024-09-19T04:20:38.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.390+0000 7f875a7fc640 1 -- 172.21.15.7:0/2803506352 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8754035040 con 0x55d369364980 2024-09-19T04:20:38.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.391+0000 7f876c768740 1 -- 172.21.15.7:0/2803506352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d369364980 msgr2=0x55d36936ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:38.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.391+0000 7f876892c640 1 --2- 172.21.15.7:0/595801700 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f87500a3240 0x7f87500a5700 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f875c005fd0 tx=0x7f875c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:38.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.391+0000 7f876c768740 1 --2- 172.21.15.7:0/2803506352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d369364980 0x55d36936ed00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f875402a9f0 tx=0x7f8754005bd0 comp rx=0 tx=0).stop 2024-09-19T04:20:38.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.391+0000 7f876c768740 1 -- 172.21.15.7:0/2803506352 shutdown_connections 2024-09-19T04:20:38.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.391+0000 7f876c768740 1 --2- 172.21.15.7:0/2803506352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d36936f240 0x55d369371630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:38.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.391+0000 7f876c768740 1 --2- 172.21.15.7:0/2803506352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d369364980 0x55d36936ed00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:38.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.391+0000 7f876c768740 1 --2- 172.21.15.7:0/2803506352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d369364060 0x55d369364440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:38.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.391+0000 7f876c768740 1 -- 172.21.15.7:0/2803506352 >> 172.21.15.7:0/2803506352 conn(0x55d3693605f0 msgr2=0x55d3693609d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:38.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.391+0000 7f876c768740 1 -- 172.21.15.7:0/2803506352 shutdown_connections 2024-09-19T04:20:38.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.391+0000 7f876c768740 1 -- 172.21.15.7:0/2803506352 wait complete. 2024-09-19T04:20:38.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.391+0000 7f876c768740 1 -- start start 2024-09-19T04:20:38.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.392+0000 7f876c768740 1 Processor -- start 2024-09-19T04:20:38.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.392+0000 7f876c768740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d369364060 0x55d36936c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:38.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.392+0000 7f876c768740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d369364980 0x55d36936c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:38.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.392+0000 7f876c768740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d36936f240 0x55d36936cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:38.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.392+0000 7f876c768740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d369371e10 con 0x55d369364060 2024-09-19T04:20:38.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.392+0000 7f876c768740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d369251f10 con 0x55d369364980 2024-09-19T04:20:38.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.392+0000 7f876c768740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d369371f90 con 0x55d36936f240 2024-09-19T04:20:38.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.392+0000 7f876c768740 10 client.0 _ll_register_callbacks cb 0x55d369275db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:20:38.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.392+0000 7f8763fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d369364060 0x55d36936c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:38.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.392+0000 7f875bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d369364980 0x55d36936c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:38.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.392+0000 7f8763fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d369364060 0x55d36936c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49158/0 (socket says 172.21.15.7:49158) 2024-09-19T04:20:38.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.392+0000 7f875bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d369364980 0x55d36936c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:50518/0 (socket says 172.21.15.7:50518) 2024-09-19T04:20:38.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.392+0000 7f8763fff640 1 -- 172.21.15.7:0/777536928 learned_addr learned my addr 172.21.15.7:0/777536928 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:38.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.392+0000 7f876892c640 1 --2- 172.21.15.7:0/777536928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d36936f240 0x55d36936cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:38.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.393+0000 7f875bfff640 1 -- 172.21.15.7:0/777536928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d36936f240 msgr2=0x55d36936cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:38.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.393+0000 7f875bfff640 1 --2- 172.21.15.7:0/777536928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d36936f240 0x55d36936cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:38.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.393+0000 7f875bfff640 1 -- 172.21.15.7:0/777536928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d369364060 msgr2=0x55d36936c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:38.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.393+0000 7f875bfff640 1 --2- 172.21.15.7:0/777536928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d369364060 0x55d36936c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:38.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.393+0000 7f875bfff640 1 -- 172.21.15.7:0/777536928 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d368fd8580 con 0x55d369364980 2024-09-19T04:20:38.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.393+0000 7f876892c640 1 --2- 172.21.15.7:0/777536928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d36936f240 0x55d36936cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:20:38.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.393+0000 7f875bfff640 1 --2- 172.21.15.7:0/777536928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d369364980 0x55d36936c660 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x55d369361970 tx=0x7f874c098620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc8e5c9bda8d67b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:38.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.393+0000 7f87437fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T04:20:38.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.393+0000 7f87437fe640 1 -- 172.21.15.7:0/777536928 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874c09c9c0 con 0x55d369364980 2024-09-19T04:20:38.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.393+0000 7f87437fe640 1 -- 172.21.15.7:0/777536928 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f874c098930 con 0x55d369364980 2024-09-19T04:20:38.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.393+0000 7f876c768740 1 -- 172.21.15.7:0/777536928 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8754031870 con 0x55d369364980 2024-09-19T04:20:38.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.393+0000 7f87437fe640 1 -- 172.21.15.7:0/777536928 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f874c09c2c0 con 0x55d369364980 2024-09-19T04:20:38.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.393+0000 7f876c768740 10 client.25466 fetch_fsmap learned FSMap version 32 2024-09-19T04:20:38.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.393+0000 7f876c768740 1 -- 172.21.15.7:0/777536928 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d3690a2960 con 0x55d369364980 2024-09-19T04:20:38.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.393+0000 7f87437fe640 1 -- 172.21.15.7:0/777536928 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8754031870 con 0x55d369364980 2024-09-19T04:20:38.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.393+0000 7f87437fe640 1 -- 172.21.15.7:0/777536928 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f874c0d2110 con 0x55d369364980 2024-09-19T04:20:38.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.394+0000 7f876c768740 10 client.25466 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T04:20:38.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.394+0000 7f876c768740 10 client.25466 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:20:38.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.394+0000 7f876c768740 20 client.25466 populate_metadata read hostname 'smithi007' 2024-09-19T04:20:38.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.394+0000 7f876c768740 1 --2- 172.21.15.7:0/777536928 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d3693832b0 0x55d3693856a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:38.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.394+0000 7f876c768740 4 client.25466 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:20:38.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.394+0000 7f876c768740 1 -- 172.21.15.7:0/777536928 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3692d6b90 con 0x55d3693832b0 2024-09-19T04:20:38.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.394+0000 7f8763fff640 1 --2- 172.21.15.7:0/777536928 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d3693832b0 0x55d3693856a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:38.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.394+0000 7f8763fff640 1 --2- 172.21.15.7:0/777536928 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d3693832b0 0x55d3693856a0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7f5c267ef8833f3 server_cookie=b932413fbfed67a8 in_seq=0 out_seq=0 2024-09-19T04:20:38.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.394+0000 7f87437fe640 10 client.25466 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:20:38.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.396+0000 7f87437fe640 1 -- 172.21.15.7:0/777536928 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d3692d6b90 con 0x55d3693832b0 2024-09-19T04:20:38.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.396+0000 7f87437fe640 10 client.25466 handle_command_reply: tid=0 2024-09-19T04:20:38.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.396+0000 7f876c768740 1 client.25466 shutdown 2024-09-19T04:20:38.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.396+0000 7f876c768740 1 -- 172.21.15.7:0/777536928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d369364980 msgr2=0x55d36936c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:38.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.396+0000 7f876c768740 1 --2- 172.21.15.7:0/777536928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d369364980 0x55d36936c660 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x55d369361970 tx=0x7f874c098620 comp rx=0 tx=0).stop 2024-09-19T04:20:38.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.396+0000 7f876c768740 1 -- 172.21.15.7:0/777536928 shutdown_connections 2024-09-19T04:20:38.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.396+0000 7f876c768740 1 --2- 172.21.15.7:0/777536928 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d3693832b0 0x55d3693856a0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:38.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.396+0000 7f876c768740 1 --2- 172.21.15.7:0/777536928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d36936f240 0x55d36936cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:38.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.396+0000 7f876c768740 1 --2- 172.21.15.7:0/777536928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d369364980 0x55d36936c660 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:38.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.396+0000 7f87437fe640 0 client.25466 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:20:38.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.396+0000 7f876c768740 1 --2- 172.21.15.7:0/777536928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d369364060 0x55d36936c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:38.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.396+0000 7f876c768740 1 -- 172.21.15.7:0/777536928 >> 172.21.15.7:0/777536928 conn(0x55d3693605f0 msgr2=0x55d3693662d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:38.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.396+0000 7f876c768740 1 -- 172.21.15.7:0/777536928 shutdown_connections 2024-09-19T04:20:38.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.396+0000 7f876c768740 1 -- 172.21.15.7:0/777536928 wait complete. 2024-09-19T04:20:38.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.396+0000 7f876c768740 20 client.25466 trim_cache size 0 max 16384 2024-09-19T04:20:38.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.415+0000 7f876c768740 1 Processor -- start 2024-09-19T04:20:38.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.415+0000 7f876c768740 1 -- start start 2024-09-19T04:20:38.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.415+0000 7f876c768740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d369364060 0x55d3693661c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:38.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.415+0000 7f876c768740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d369364980 0x55d36938afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:38.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.415+0000 7f876c768740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d36936f240 0x55d36938b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:38.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.415+0000 7f876c768740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f87641acca0 con 0x55d369364980 2024-09-19T04:20:38.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.415+0000 7f876c768740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f87641ae8a0 con 0x55d369364060 2024-09-19T04:20:38.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.415+0000 7f876c768740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f87641ad370 con 0x55d36936f240 2024-09-19T04:20:38.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.416+0000 7f875bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d369364980 0x55d36938afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:38.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.416+0000 7f8763fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d369364060 0x55d3693661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:38.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.416+0000 7f875bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d369364980 0x55d36938afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49170/0 (socket says 172.21.15.7:49170) 2024-09-19T04:20:38.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.416+0000 7f875bfff640 1 -- 172.21.15.7:0/905168315 learned_addr learned my addr 172.21.15.7:0/905168315 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:38.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.416+0000 7f8763fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d369364060 0x55d3693661c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:50534/0 (socket says 172.21.15.7:50534) 2024-09-19T04:20:38.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.416+0000 7f876892c640 1 --2- 172.21.15.7:0/905168315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d36936f240 0x55d36938b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:38.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.416+0000 7f875bfff640 1 -- 172.21.15.7:0/905168315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d36936f240 msgr2=0x55d36938b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:38.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.416+0000 7f875bfff640 1 --2- 172.21.15.7:0/905168315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d36936f240 0x55d36938b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:38.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.416+0000 7f875bfff640 1 -- 172.21.15.7:0/905168315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d369364060 msgr2=0x55d3693661c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:38.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.416+0000 7f875bfff640 1 --2- 172.21.15.7:0/905168315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d369364060 0x55d3693661c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:38.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.416+0000 7f875bfff640 1 -- 172.21.15.7:0/905168315 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3693647b0 con 0x55d369364980 2024-09-19T04:20:38.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.416+0000 7f8763fff640 1 --2- 172.21.15.7:0/905168315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d369364060 0x55d3693661c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:20:38.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.416+0000 7f875bfff640 1 --2- 172.21.15.7:0/905168315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d369364980 0x55d36938afb0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f874c09c250 tx=0x7f874c0d3620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f21da33d2741dce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:38.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.416+0000 7f8759ffb640 1 -- 172.21.15.7:0/905168315 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874c09be00 con 0x55d369364980 2024-09-19T04:20:38.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.416+0000 7f8759ffb640 1 -- 172.21.15.7:0/905168315 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f874c09c9c0 con 0x55d369364980 2024-09-19T04:20:38.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.416+0000 7f8759ffb640 1 -- 172.21.15.7:0/905168315 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874c098930 con 0x55d369364980 2024-09-19T04:20:38.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.417+0000 7f876c768740 1 -- 172.21.15.7:0/905168315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d369364980 msgr2=0x55d36938afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:38.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.417+0000 7f876c768740 1 --2- 172.21.15.7:0/905168315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d369364980 0x55d36938afb0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f874c09c250 tx=0x7f874c0d3620 comp rx=0 tx=0).stop 2024-09-19T04:20:38.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.417+0000 7f876c768740 1 -- 172.21.15.7:0/905168315 shutdown_connections 2024-09-19T04:20:38.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.417+0000 7f876c768740 1 --2- 172.21.15.7:0/905168315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d36936f240 0x55d36938b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:38.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.417+0000 7f876c768740 1 --2- 172.21.15.7:0/905168315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d369364980 0x55d36938afb0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:38.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.417+0000 7f876c768740 1 --2- 172.21.15.7:0/905168315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d369364060 0x55d3693661c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:38.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.417+0000 7f876c768740 1 -- 172.21.15.7:0/905168315 >> 172.21.15.7:0/905168315 conn(0x55d3693605f0 msgr2=0x55d369365ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:38.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.417+0000 7f876c768740 1 -- 172.21.15.7:0/905168315 shutdown_connections 2024-09-19T04:20:38.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.417+0000 7f876c768740 1 -- 172.21.15.7:0/905168315 wait complete. 2024-09-19T04:20:38.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.418+0000 7f876c768740 1 -- start start 2024-09-19T04:20:38.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.418+0000 7f876c768740 1 Processor -- start 2024-09-19T04:20:38.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.418+0000 7f876c768740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d369364060 0x55d369372f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:38.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.418+0000 7f876c768740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d369364980 0x55d369373490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:38.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.418+0000 7f876c768740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d36936f240 0x55d3693739d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:38.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.418+0000 7f876c768740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f87641ae110 con 0x55d369364060 2024-09-19T04:20:38.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.418+0000 7f876c768740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f87641ada40 con 0x55d36936f240 2024-09-19T04:20:38.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.418+0000 7f876c768740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f87641aac60 con 0x55d369364980 2024-09-19T04:20:38.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.418+0000 7f876c768740 10 client.0 _ll_register_callbacks cb 0x7f874c009540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:20:38.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.418+0000 7f8763fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d369364060 0x55d369372f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:38.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.418+0000 7f875bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d369364980 0x55d369373490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:38.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.418+0000 7f876892c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d36936f240 0x55d3693739d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:38.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.418+0000 7f875bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d369364980 0x55d369373490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:54632/0 (socket says 172.21.15.7:54632) 2024-09-19T04:20:38.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.418+0000 7f875bfff640 1 -- 172.21.15.7:0/63338672 learned_addr learned my addr 172.21.15.7:0/63338672 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:38.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.418+0000 7f8763fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d369364060 0x55d369372f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49182/0 (socket says 172.21.15.7:49182) 2024-09-19T04:20:38.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.419+0000 7f876892c640 1 -- 172.21.15.7:0/63338672 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d369364980 msgr2=0x55d369373490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:38.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.419+0000 7f876892c640 1 --2- 172.21.15.7:0/63338672 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d369364980 0x55d369373490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:38.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.419+0000 7f876892c640 1 -- 172.21.15.7:0/63338672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d369364060 msgr2=0x55d369372f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.419+0000 7f876892c640 1 --2- 172.21.15.7:0/63338672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d369364060 0x55d369372f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.419+0000 7f876892c640 1 -- 172.21.15.7:0/63338672 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3693ecfb0 con 0x55d36936f240 2024-09-19T04:20:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.419+0000 7f875bfff640 1 --2- 172.21.15.7:0/63338672 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d369364980 0x55d369373490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:20:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.419+0000 7f8763fff640 1 --2- 172.21.15.7:0/63338672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d369364060 0x55d369372f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:20:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.419+0000 7f876892c640 1 --2- 172.21.15.7:0/63338672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d36936f240 0x55d3693739d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55d369364fa0 tx=0x7f875c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f11dc6f3ef738aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.419+0000 7f87437fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T04:20:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.419+0000 7f87437fe640 1 -- 172.21.15.7:0/63338672 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f875c01ea70 con 0x55d36936f240 2024-09-19T04:20:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.419+0000 7f876c768740 1 -- 172.21.15.7:0/63338672 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f874c09c9c0 con 0x55d36936f240 2024-09-19T04:20:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.419+0000 7f87437fe640 1 -- 172.21.15.7:0/63338672 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f875c01ec10 con 0x55d36936f240 2024-09-19T04:20:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.420+0000 7f87437fe640 1 -- 172.21.15.7:0/63338672 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f875c034050 con 0x55d36936f240 2024-09-19T04:20:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.420+0000 7f876c768740 10 client.25472 fetch_fsmap learned FSMap version 32 2024-09-19T04:20:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.420+0000 7f876c768740 1 -- 172.21.15.7:0/63338672 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d3693ee360 con 0x55d36936f240 2024-09-19T04:20:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.420+0000 7f87437fe640 1 -- 172.21.15.7:0/63338672 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f874c09c9c0 con 0x55d36936f240 2024-09-19T04:20:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.420+0000 7f87437fe640 1 -- 172.21.15.7:0/63338672 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f875c0283f0 con 0x55d36936f240 2024-09-19T04:20:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.420+0000 7f876c768740 10 client.25472 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T04:20:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.420+0000 7f876c768740 10 client.25472 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:20:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.420+0000 7f876c768740 20 client.25472 populate_metadata read hostname 'smithi007' 2024-09-19T04:20:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.420+0000 7f876c768740 1 --2- 172.21.15.7:0/63338672 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d3693eeb50 0x55d3693f0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.420+0000 7f876c768740 4 client.25472 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "eab6828c", "release": true, "await": true}] 2024-09-19T04:20:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.420+0000 7f876c768740 1 -- 172.21.15.7:0/63338672 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "quiesce db", "set_id": "eab6828c", "release": true, "await": true}) -- 0x55d3692d10a0 con 0x55d3693eeb50 2024-09-19T04:20:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.420+0000 7f8763fff640 1 --2- 172.21.15.7:0/63338672 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d3693eeb50 0x55d3693f0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.421+0000 7f87437fe640 10 client.25472 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:20:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:38.421+0000 7f8763fff640 1 --2- 172.21.15.7:0/63338672 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d3693eeb50 0x55d3693f0f70 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=542b3346efbb8475 server_cookie=b2fe738172ab6cba in_seq=0 out_seq=0 2024-09-19T04:20:39.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:39.057+0000 7f87437fe640 1 -- 172.21.15.7:0/63338672 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d3692d10a0 con 0x55d3693eeb50 2024-09-19T04:20:39.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:39.057+0000 7f87437fe640 10 client.25472 handle_command_reply: tid=0 2024-09-19T04:20:39.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:39.058+0000 7f876c768740 1 client.25472 shutdown 2024-09-19T04:20:39.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:39.058+0000 7f876c768740 1 -- 172.21.15.7:0/63338672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d36936f240 msgr2=0x55d3693739d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:39.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:39.058+0000 7f876c768740 1 --2- 172.21.15.7:0/63338672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d36936f240 0x55d3693739d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55d369364fa0 tx=0x7f875c004a40 comp rx=0 tx=0).stop 2024-09-19T04:20:39.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:39.058+0000 7f876c768740 1 -- 172.21.15.7:0/63338672 shutdown_connections 2024-09-19T04:20:39.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:39.058+0000 7f876c768740 1 --2- 172.21.15.7:0/63338672 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d3693eeb50 0x55d3693f0f70 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:39.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:39.058+0000 7f876c768740 1 --2- 172.21.15.7:0/63338672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d36936f240 0x55d3693739d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:39.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:39.058+0000 7f87437fe640 0 client.25472 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:20:39.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:39.058+0000 7f876c768740 1 --2- 172.21.15.7:0/63338672 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d369364980 0x55d369373490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:39.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:39.058+0000 7f876c768740 1 --2- 172.21.15.7:0/63338672 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d369364060 0x55d369372f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:39.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:39.058+0000 7f876c768740 1 -- 172.21.15.7:0/63338672 >> 172.21.15.7:0/63338672 conn(0x55d3693605f0 msgr2=0x55d36935f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:39.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:39.058+0000 7f876c768740 1 -- 172.21.15.7:0/63338672 shutdown_connections 2024-09-19T04:20:39.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:39.058+0000 7f876c768740 1 -- 172.21.15.7:0/63338672 wait complete. 2024-09-19T04:20:39.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:39.058+0000 7f876c768740 20 client.25472 trim_cache size 0 max 16384 2024-09-19T04:20:39.061 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:20:39.061 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 32, 2024-09-19T04:20:39.062 INFO:teuthology.orchestra.run.smithi007.stdout: "leader": 24506, 2024-09-19T04:20:39.062 INFO:teuthology.orchestra.run.smithi007.stdout: "set_version": 16, 2024-09-19T04:20:39.062 INFO:teuthology.orchestra.run.smithi007.stdout: "sets": { 2024-09-19T04:20:39.062 INFO:teuthology.orchestra.run.smithi007.stdout: "eab6828c": { 2024-09-19T04:20:39.062 INFO:teuthology.orchestra.run.smithi007.stdout: "version": 16, 2024-09-19T04:20:39.062 INFO:teuthology.orchestra.run.smithi007.stdout: "age_ref": 0.0, 2024-09-19T04:20:39.062 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:20:39.062 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RELEASED", 2024-09-19T04:20:39.062 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:20:39.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:20:39.062 INFO:teuthology.orchestra.run.smithi007.stdout: "timeout": 90.0, 2024-09-19T04:20:39.062 INFO:teuthology.orchestra.run.smithi007.stdout: "expiration": 136.6, 2024-09-19T04:20:39.062 INFO:teuthology.orchestra.run.smithi007.stdout: "members": { 2024-09-19T04:20:39.063 INFO:teuthology.orchestra.run.smithi007.stdout: "file:/": { 2024-09-19T04:20:39.063 INFO:teuthology.orchestra.run.smithi007.stdout: "excluded": false, 2024-09-19T04:20:39.063 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:20:39.063 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RELEASED", 2024-09-19T04:20:39.063 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:20:39.063 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:20:39.063 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:20:39.063 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:20:39.063 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:20:39.063 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:20:39.063 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:20:39.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:39.059+0000 7f876a38f640 1 -- 172.21.15.7:0/595801700 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f87500a3240 msgr2=0x7f87500a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:39.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:39.059+0000 7f876a38f640 1 --2- 172.21.15.7:0/595801700 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f87500a3240 0x7f87500a5700 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f875c005fd0 tx=0x7f875c009500 comp rx=0 tx=0).stop 2024-09-19T04:20:39.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:39.059+0000 7f876a38f640 1 -- 172.21.15.7:0/595801700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8764102570 msgr2=0x7f8764198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:39.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:39.059+0000 7f876a38f640 1 --2- 172.21.15.7:0/595801700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8764102570 0x7f8764198a90 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f874c00ea60 tx=0x7f874c00ef20 comp rx=0 tx=0).stop 2024-09-19T04:20:39.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:39.060+0000 7f876a38f640 1 -- 172.21.15.7:0/595801700 shutdown_connections 2024-09-19T04:20:39.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:39.060+0000 7f876a38f640 1 --2- 172.21.15.7:0/595801700 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f87500a3240 0x7f87500a5700 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:39.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:39.060+0000 7f876a38f640 1 --2- 172.21.15.7:0/595801700 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8764102ef0 0x7f876419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:39.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:39.060+0000 7f876a38f640 1 --2- 172.21.15.7:0/595801700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8764102570 0x7f8764198a90 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:39.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:39.060+0000 7f876a38f640 1 --2- 172.21.15.7:0/595801700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8764100e20 0x7f8764198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:39.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:39.060+0000 7f876a38f640 1 -- 172.21.15.7:0/595801700 >> 172.21.15.7:0/595801700 conn(0x7f87640fc7d0 msgr2=0x7f876406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:39.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:39.060+0000 7f876a38f640 1 -- 172.21.15.7:0/595801700 shutdown_connections 2024-09-19T04:20:39.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:20:39.060+0000 7f876a38f640 1 -- 172.21.15.7:0/595801700 wait complete. 2024-09-19T04:20:39.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:39 smithi007 ceph-mon[31360]: pgmap v466: 129 pgs: 129 active+clean; 233 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 337 op/s 2024-09-19T04:20:39.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:39 smithi102 ceph-mon[35446]: pgmap v466: 129 pgs: 129 active+clean; 233 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 337 op/s 2024-09-19T04:20:39.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:39 smithi092 ceph-mon[34940]: pgmap v466: 129 pgs: 129 active+clean; 233 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 337 op/s 2024-09-19T04:20:39.925 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'eab6828c', total seconds elapsed: 27.8 2024-09-19T04:20:41.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:41 smithi007 ceph-mon[31360]: pgmap v467: 129 pgs: 129 active+clean; 223 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.7 MiB/s wr, 548 op/s 2024-09-19T04:20:41.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:41 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:20:41.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:41 smithi102 ceph-mon[35446]: pgmap v467: 129 pgs: 129 active+clean; 223 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.7 MiB/s wr, 548 op/s 2024-09-19T04:20:41.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:41 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:20:41.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:41 smithi092 ceph-mon[34940]: pgmap v467: 129 pgs: 129 active+clean; 223 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.7 MiB/s wr, 548 op/s 2024-09-19T04:20:41.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:41 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:20:42.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:42 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:20:42.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:42 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:20:42.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:42 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:20:42.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:42 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:20:42.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:42 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:20:42.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:42 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:20:42.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:42 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:20:42.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:42 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:20:42.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:42 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:20:43.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:43 smithi007 ceph-mon[31360]: pgmap v468: 129 pgs: 129 active+clean; 216 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.4 MiB/s wr, 497 op/s 2024-09-19T04:20:43.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:43 smithi102 ceph-mon[35446]: pgmap v468: 129 pgs: 129 active+clean; 216 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.4 MiB/s wr, 497 op/s 2024-09-19T04:20:43.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:43 smithi092 ceph-mon[34940]: pgmap v468: 129 pgs: 129 active+clean; 216 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.4 MiB/s wr, 497 op/s 2024-09-19T04:20:45.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:45 smithi007 ceph-mon[31360]: pgmap v469: 129 pgs: 129 active+clean; 221 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.5 MiB/s wr, 566 op/s 2024-09-19T04:20:45.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:45 smithi102 ceph-mon[35446]: pgmap v469: 129 pgs: 129 active+clean; 221 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.5 MiB/s wr, 566 op/s 2024-09-19T04:20:45.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:45 smithi092 ceph-mon[34940]: pgmap v469: 129 pgs: 129 active+clean; 221 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.5 MiB/s wr, 566 op/s 2024-09-19T04:20:47.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:47 smithi007 ceph-mon[31360]: pgmap v470: 129 pgs: 129 active+clean; 231 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.1 MiB/s wr, 647 op/s 2024-09-19T04:20:47.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:47 smithi102 ceph-mon[35446]: pgmap v470: 129 pgs: 129 active+clean; 231 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.1 MiB/s wr, 647 op/s 2024-09-19T04:20:47.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:47 smithi092 ceph-mon[34940]: pgmap v470: 129 pgs: 129 active+clean; 231 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.1 MiB/s wr, 647 op/s 2024-09-19T04:20:48.158 INFO:tasks.workunit.client.0.smithi007.stdout: 80 25189 131 17328 140 15791 299 2024-09-19T04:20:49.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:49 smithi007 ceph-mon[31360]: pgmap v471: 129 pgs: 129 active+clean; 231 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.0 MiB/s wr, 488 op/s 2024-09-19T04:20:49.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:49 smithi102 ceph-mon[35446]: pgmap v471: 129 pgs: 129 active+clean; 231 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.0 MiB/s wr, 488 op/s 2024-09-19T04:20:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.493+0000 7f72c52af640 1 -- 172.21.15.7:0/1630977153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c0101b60 msgr2=0x7f72c0101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.493+0000 7f72c52af640 1 --2- 172.21.15.7:0/1630977153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c0101b60 0x7f72c0101f60 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009900 tx=0x7f72b002a410 comp rx=0 tx=0).stop 2024-09-19T04:20:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.493+0000 7f72c52af640 1 -- 172.21.15.7:0/1630977153 shutdown_connections 2024-09-19T04:20:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.493+0000 7f72c52af640 1 --2- 172.21.15.7:0/1630977153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72c0103710 0x7f72c0109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.493+0000 7f72c52af640 1 --2- 172.21.15.7:0/1630977153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72c0102d50 0x7f72c01031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.493+0000 7f72c52af640 1 --2- 172.21.15.7:0/1630977153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c0101b60 0x7f72c0101f60 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.493+0000 7f72c52af640 1 -- 172.21.15.7:0/1630977153 >> 172.21.15.7:0/1630977153 conn(0x7f72c00fd2e0 msgr2=0x7f72c00ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.493+0000 7f72c52af640 1 -- 172.21.15.7:0/1630977153 shutdown_connections 2024-09-19T04:20:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.493+0000 7f72c52af640 1 -- 172.21.15.7:0/1630977153 wait complete. 2024-09-19T04:20:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.493+0000 7f72c52af640 1 Processor -- start 2024-09-19T04:20:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.494+0000 7f72c52af640 1 -- start start 2024-09-19T04:20:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.494+0000 7f72c52af640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c0101b60 0x7f72c0197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.494+0000 7f72c52af640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72c0102d50 0x7f72c0198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.494+0000 7f72c52af640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72c0103710 0x7f72c019f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.494+0000 7f72c52af640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f72c010d7e0 con 0x7f72c0101b60 2024-09-19T04:20:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.494+0000 7f72c52af640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f72c010d660 con 0x7f72c0103710 2024-09-19T04:20:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.494+0000 7f72c52af640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f72c010d960 con 0x7f72c0102d50 2024-09-19T04:20:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.494+0000 7f72beffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c0101b60 0x7f72c0197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.494+0000 7f72beffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c0101b60 0x7f72c0197ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36652/0 (socket says 172.21.15.7:36652) 2024-09-19T04:20:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.494+0000 7f72beffd640 1 -- 172.21.15.7:0/3595085977 learned_addr learned my addr 172.21.15.7:0/3595085977 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.494+0000 7f72bf7fe640 1 --2- 172.21.15.7:0/3595085977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72c0103710 0x7f72c019f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.494+0000 7f72be7fc640 1 --2- 172.21.15.7:0/3595085977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72c0102d50 0x7f72c0198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.494+0000 7f72beffd640 1 -- 172.21.15.7:0/3595085977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72c0102d50 msgr2=0x7f72c0198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.494+0000 7f72beffd640 1 --2- 172.21.15.7:0/3595085977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72c0102d50 0x7f72c0198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.494+0000 7f72beffd640 1 -- 172.21.15.7:0/3595085977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72c0103710 msgr2=0x7f72c019f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.494+0000 7f72beffd640 1 --2- 172.21.15.7:0/3595085977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72c0103710 0x7f72c019f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.494+0000 7f72beffd640 1 -- 172.21.15.7:0/3595085977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c019fb10 con 0x7f72c0101b60 2024-09-19T04:20:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.495+0000 7f72beffd640 1 --2- 172.21.15.7:0/3595085977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c0101b60 0x7f72c0197ef0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f72b0031610 tx=0x7f72b0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.495+0000 7f72a7fff640 1 -- 172.21.15.7:0/3595085977 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b003f030 con 0x7f72c0101b60 2024-09-19T04:20:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.495+0000 7f72a7fff640 1 -- 172.21.15.7:0/3595085977 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72b0003ad0 con 0x7f72c0101b60 2024-09-19T04:20:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.495+0000 7f72c52af640 1 -- 172.21.15.7:0/3595085977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c019fda0 con 0x7f72c0101b60 2024-09-19T04:20:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.495+0000 7f72a7fff640 1 -- 172.21.15.7:0/3595085977 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0035070 con 0x7f72c0101b60 2024-09-19T04:20:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.495+0000 7f72c52af640 1 -- 172.21.15.7:0/3595085977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c01a0220 con 0x7f72c0101b60 2024-09-19T04:20:49.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.497+0000 7f72a7fff640 1 -- 172.21.15.7:0/3595085977 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f72b0042030 con 0x7f72c0101b60 2024-09-19T04:20:49.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.498+0000 7f72c803d740 1 Processor -- start 2024-09-19T04:20:49.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.498+0000 7f72c803d740 1 -- start start 2024-09-19T04:20:49.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.498+0000 7f72c803d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ac0af9a0 0x5593ac0afda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:49.506 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.498+0000 7f72c803d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593ac0b02e0 0x5593ac0b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.498+0000 7f72c803d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5593ac0b5370 0x5593ac0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.498+0000 7f72c803d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5593ac0132f0 con 0x5593ac0af9a0 2024-09-19T04:20:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.498+0000 7f72c803d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5593abfbb270 con 0x5593ac0b02e0 2024-09-19T04:20:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.498+0000 7f72c803d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5593ac00f2b0 con 0x5593ac0b5370 2024-09-19T04:20:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.498+0000 7f72bf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ac0af9a0 0x5593ac0afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.498+0000 7f72bf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ac0af9a0 0x5593ac0afda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36654/0 (socket says 172.21.15.7:36654) 2024-09-19T04:20:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.498+0000 7f72bf7fe640 1 -- 172.21.15.7:0/4212718611 learned_addr learned my addr 172.21.15.7:0/4212718611 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.498+0000 7f72beffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593ac0b02e0 0x5593ac0b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.498+0000 7f72a7fff640 1 --2- 172.21.15.7:0/3595085977 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f72a80a32c0 0x7f72a80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.498+0000 7f72be7fc640 1 --2- 172.21.15.7:0/4212718611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5593ac0b5370 0x5593ac0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.498+0000 7f72bf7fe640 1 -- 172.21.15.7:0/4212718611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5593ac0b5370 msgr2=0x5593ac0b7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.498+0000 7f72bf7fe640 1 --2- 172.21.15.7:0/4212718611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5593ac0b5370 0x5593ac0b7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.498+0000 7f72bf7fe640 1 -- 172.21.15.7:0/4212718611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593ac0b02e0 msgr2=0x5593ac0b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.498+0000 7f72bf7fe640 1 --2- 172.21.15.7:0/4212718611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593ac0b02e0 0x5593ac0b4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.498+0000 7f72bf7fe640 1 -- 172.21.15.7:0/4212718611 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593abfba340 con 0x5593ac0af9a0 2024-09-19T04:20:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.498+0000 7f72beffd640 1 --2- 172.21.15.7:0/4212718611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593ac0b02e0 0x5593ac0b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:20:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.498+0000 7f72bf7fe640 1 --2- 172.21.15.7:0/3595085977 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f72a80a32c0 0x7f72a80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.499+0000 7f72a7fff640 1 -- 172.21.15.7:0/3595085977 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f72b00efe80 con 0x7f72c0101b60 2024-09-19T04:20:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.499+0000 7f72bf7fe640 1 --2- 172.21.15.7:0/4212718611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ac0af9a0 0x5593ac0afda0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f72b8011590 tx=0x7f72b8011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ed9cd957f6627 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.499+0000 7f72a57fa640 1 -- 172.21.15.7:0/4212718611 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b8017050 con 0x5593ac0af9a0 2024-09-19T04:20:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.499+0000 7f72a57fa640 1 -- 172.21.15.7:0/4212718611 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72b800fd20 con 0x5593ac0af9a0 2024-09-19T04:20:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.499+0000 7f72a57fa640 1 -- 172.21.15.7:0/4212718611 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b801bb00 con 0x5593ac0af9a0 2024-09-19T04:20:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.500+0000 7f72c803d740 1 -- 172.21.15.7:0/4212718611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ac0af9a0 msgr2=0x5593ac0afda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.500+0000 7f72bf7fe640 1 --2- 172.21.15.7:0/3595085977 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f72a80a32c0 0x7f72a80a5780 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f72b8022000 tx=0x7f72b8023000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.500+0000 7f72c803d740 1 --2- 172.21.15.7:0/4212718611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ac0af9a0 0x5593ac0afda0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f72b8011590 tx=0x7f72b8011a50 comp rx=0 tx=0).stop 2024-09-19T04:20:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.500+0000 7f72c803d740 1 -- 172.21.15.7:0/4212718611 shutdown_connections 2024-09-19T04:20:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.500+0000 7f72c803d740 1 --2- 172.21.15.7:0/4212718611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5593ac0b5370 0x5593ac0b7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.500+0000 7f72c803d740 1 --2- 172.21.15.7:0/4212718611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593ac0b02e0 0x5593ac0b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.500+0000 7f72c803d740 1 --2- 172.21.15.7:0/4212718611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ac0af9a0 0x5593ac0afda0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.500+0000 7f72c803d740 1 -- 172.21.15.7:0/4212718611 >> 172.21.15.7:0/4212718611 conn(0x5593ac0ab010 msgr2=0x5593ac0ab410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.500+0000 7f72c803d740 1 -- 172.21.15.7:0/4212718611 shutdown_connections 2024-09-19T04:20:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.500+0000 7f72c803d740 1 -- 172.21.15.7:0/4212718611 wait complete. 2024-09-19T04:20:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.500+0000 7f72c803d740 1 -- start start 2024-09-19T04:20:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.500+0000 7f72c803d740 1 Processor -- start 2024-09-19T04:20:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.501+0000 7f72c803d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593ac0af9a0 0x5593ac0b9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.501+0000 7f72c803d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5593ac0b02e0 0x5593ac0ba0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.501+0000 7f72c803d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ac0b5370 0x5593ac0c1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.501+0000 7f72c803d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5593ac0b8340 con 0x5593ac0b5370 2024-09-19T04:20:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.501+0000 7f72c803d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5593abf9c290 con 0x5593ac0af9a0 2024-09-19T04:20:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.501+0000 7f72c803d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5593ac0b84c0 con 0x5593ac0b02e0 2024-09-19T04:20:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.501+0000 7f72c803d740 10 client.0 _ll_register_callbacks cb 0x5593abfcd140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:20:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.501+0000 7f72beffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593ac0af9a0 0x5593ac0b9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.501+0000 7f72beffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593ac0af9a0 0x5593ac0b9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:35906/0 (socket says 172.21.15.7:35906) 2024-09-19T04:20:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.501+0000 7f72beffd640 1 -- 172.21.15.7:0/2973325634 learned_addr learned my addr 172.21.15.7:0/2973325634 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.501+0000 7f72bf7fe640 1 --2- 172.21.15.7:0/2973325634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ac0b5370 0x5593ac0c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.501+0000 7f72be7fc640 1 --2- 172.21.15.7:0/2973325634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5593ac0b02e0 0x5593ac0ba0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.501+0000 7f72beffd640 1 -- 172.21.15.7:0/2973325634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5593ac0b02e0 msgr2=0x5593ac0ba0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.501+0000 7f72beffd640 1 --2- 172.21.15.7:0/2973325634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5593ac0b02e0 0x5593ac0ba0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.501+0000 7f72beffd640 1 -- 172.21.15.7:0/2973325634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ac0b5370 msgr2=0x5593ac0c1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.501+0000 7f72beffd640 1 --2- 172.21.15.7:0/2973325634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ac0b5370 0x5593ac0c1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.501+0000 7f72beffd640 1 -- 172.21.15.7:0/2973325634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593abd26210 con 0x5593ac0af9a0 2024-09-19T04:20:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.501+0000 7f72bf7fe640 1 --2- 172.21.15.7:0/2973325634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ac0b5370 0x5593ac0c1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:20:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.501+0000 7f72beffd640 1 --2- 172.21.15.7:0/2973325634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593ac0af9a0 0x5593ac0b9ba0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f72b00ed5b0 tx=0x7f72b00b8540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55d1e8cdb8d0142d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.501+0000 7f72a2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T04:20:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.501+0000 7f72a2ff5640 1 -- 172.21.15.7:0/2973325634 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0049050 con 0x5593ac0af9a0 2024-09-19T04:20:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.502+0000 7f72c803d740 1 -- 172.21.15.7:0/2973325634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72b800fd20 con 0x5593ac0af9a0 2024-09-19T04:20:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.502+0000 7f72a2ff5640 1 -- 172.21.15.7:0/2973325634 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f72b0003c80 con 0x5593ac0af9a0 2024-09-19T04:20:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.502+0000 7f72a2ff5640 1 -- 172.21.15.7:0/2973325634 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f72b00bbae0 con 0x5593ac0af9a0 2024-09-19T04:20:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.502+0000 7f72c803d740 10 client.25484 fetch_fsmap learned FSMap version 32 2024-09-19T04:20:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.502+0000 7f72c803d740 1 -- 172.21.15.7:0/2973325634 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5593abdf2620 con 0x5593ac0af9a0 2024-09-19T04:20:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.502+0000 7f72a2ff5640 1 -- 172.21.15.7:0/2973325634 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72b800fd20 con 0x5593ac0af9a0 2024-09-19T04:20:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.502+0000 7f72a2ff5640 1 -- 172.21.15.7:0/2973325634 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f72b00035f0 con 0x5593ac0af9a0 2024-09-19T04:20:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.502+0000 7f72c803d740 10 client.25484 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T04:20:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.502+0000 7f72c803d740 10 client.25484 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:20:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.502+0000 7f72c803d740 20 client.25484 populate_metadata read hostname 'smithi007' 2024-09-19T04:20:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.502+0000 7f72c803d740 1 --2- 172.21.15.7:0/2973325634 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5593ac0c5810 0x5593ac0c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.502+0000 7f72c803d740 4 client.25484 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:20:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.502+0000 7f72c803d740 1 -- 172.21.15.7:0/2973325634 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593ac020a20 con 0x5593ac0c5810 2024-09-19T04:20:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.502+0000 7f72be7fc640 1 --2- 172.21.15.7:0/2973325634 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5593ac0c5810 0x5593ac0c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.503+0000 7f72a2ff5640 10 client.25484 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:20:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.503+0000 7f72be7fc640 1 --2- 172.21.15.7:0/2973325634 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5593ac0c5810 0x5593ac0c7c90 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33428ca9df3aef9 server_cookie=dafbce46275b24fe in_seq=0 out_seq=0 2024-09-19T04:20:49.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.504+0000 7f72a2ff5640 1 -- 172.21.15.7:0/2973325634 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5593ac020a20 con 0x5593ac0c5810 2024-09-19T04:20:49.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.504+0000 7f72a2ff5640 10 client.25484 handle_command_reply: tid=0 2024-09-19T04:20:49.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.504+0000 7f72c803d740 1 client.25484 shutdown 2024-09-19T04:20:49.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.504+0000 7f72c803d740 1 -- 172.21.15.7:0/2973325634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593ac0af9a0 msgr2=0x5593ac0b9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:49.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.504+0000 7f72c803d740 1 --2- 172.21.15.7:0/2973325634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593ac0af9a0 0x5593ac0b9ba0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f72b00ed5b0 tx=0x7f72b00b8540 comp rx=0 tx=0).stop 2024-09-19T04:20:49.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.504+0000 7f72c803d740 1 -- 172.21.15.7:0/2973325634 shutdown_connections 2024-09-19T04:20:49.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.504+0000 7f72c803d740 1 --2- 172.21.15.7:0/2973325634 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5593ac0c5810 0x5593ac0c7c90 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:49.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.504+0000 7f72c803d740 1 --2- 172.21.15.7:0/2973325634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ac0b5370 0x5593ac0c1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:49.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.504+0000 7f72c803d740 1 --2- 172.21.15.7:0/2973325634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5593ac0b02e0 0x5593ac0ba0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:49.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.504+0000 7f72a2ff5640 0 client.25484 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:20:49.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.504+0000 7f72c803d740 1 --2- 172.21.15.7:0/2973325634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593ac0af9a0 0x5593ac0b9ba0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:49.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.504+0000 7f72c803d740 1 -- 172.21.15.7:0/2973325634 >> 172.21.15.7:0/2973325634 conn(0x5593ac0ab010 msgr2=0x5593ac0ac820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:49.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.504+0000 7f72c803d740 1 -- 172.21.15.7:0/2973325634 shutdown_connections 2024-09-19T04:20:49.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.504+0000 7f72c803d740 1 -- 172.21.15.7:0/2973325634 wait complete. 2024-09-19T04:20:49.514 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.504+0000 7f72c803d740 20 client.25484 trim_cache size 0 max 16384 2024-09-19T04:20:49.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.533+0000 7f72c803d740 1 Processor -- start 2024-09-19T04:20:49.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.533+0000 7f72c803d740 1 -- start start 2024-09-19T04:20:49.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.533+0000 7f72c803d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593ac0af9a0 0x5593ac0ba170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:49.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.533+0000 7f72c803d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5593ac0b02e0 0x5593ac0c10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:49.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.533+0000 7f72c803d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ac0b5370 0x5593ac0aa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:49.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.533+0000 7f72c803d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01aa880 con 0x5593ac0b5370 2024-09-19T04:20:49.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.533+0000 7f72c803d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01ac480 con 0x5593ac0af9a0 2024-09-19T04:20:49.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.533+0000 7f72c803d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01aaf50 con 0x5593ac0b02e0 2024-09-19T04:20:49.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.533+0000 7f72bf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ac0b5370 0x5593ac0aa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:49.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.533+0000 7f72bf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ac0b5370 0x5593ac0aa0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36676/0 (socket says 172.21.15.7:36676) 2024-09-19T04:20:49.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.533+0000 7f72bf7fe640 1 -- 172.21.15.7:0/2487024006 learned_addr learned my addr 172.21.15.7:0/2487024006 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:49.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.533+0000 7f72be7fc640 1 --2- 172.21.15.7:0/2487024006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5593ac0b02e0 0x5593ac0c10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:49.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.533+0000 7f72beffd640 1 --2- 172.21.15.7:0/2487024006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593ac0af9a0 0x5593ac0ba170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:49.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.533+0000 7f72bf7fe640 1 -- 172.21.15.7:0/2487024006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5593ac0b02e0 msgr2=0x5593ac0c10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.533+0000 7f72bf7fe640 1 --2- 172.21.15.7:0/2487024006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5593ac0b02e0 0x5593ac0c10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.533+0000 7f72bf7fe640 1 -- 172.21.15.7:0/2487024006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593ac0af9a0 msgr2=0x5593ac0ba170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.533+0000 7f72bf7fe640 1 --2- 172.21.15.7:0/2487024006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593ac0af9a0 0x5593ac0ba170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.533+0000 7f72bf7fe640 1 -- 172.21.15.7:0/2487024006 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593ac0aae30 con 0x5593ac0b5370 2024-09-19T04:20:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.534+0000 7f72bf7fe640 1 --2- 172.21.15.7:0/2487024006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ac0b5370 0x5593ac0aa0b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f72b801b800 tx=0x7f72b8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe8860e75d1f723 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.534+0000 7f72a4ff9640 1 -- 172.21.15.7:0/2487024006 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b8037070 con 0x5593ac0b5370 2024-09-19T04:20:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.534+0000 7f72a4ff9640 1 -- 172.21.15.7:0/2487024006 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72b8009cd0 con 0x5593ac0b5370 2024-09-19T04:20:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.534+0000 7f72a4ff9640 1 -- 172.21.15.7:0/2487024006 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b800f9a0 con 0x5593ac0b5370 2024-09-19T04:20:49.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.535+0000 7f72c803d740 1 -- 172.21.15.7:0/2487024006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ac0b5370 msgr2=0x5593ac0aa0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:49.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.535+0000 7f72c803d740 1 --2- 172.21.15.7:0/2487024006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ac0b5370 0x5593ac0aa0b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f72b801b800 tx=0x7f72b8003f10 comp rx=0 tx=0).stop 2024-09-19T04:20:49.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.535+0000 7f72c803d740 1 -- 172.21.15.7:0/2487024006 shutdown_connections 2024-09-19T04:20:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.535+0000 7f72c803d740 1 --2- 172.21.15.7:0/2487024006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ac0b5370 0x5593ac0aa0b0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.535+0000 7f72c803d740 1 --2- 172.21.15.7:0/2487024006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5593ac0b02e0 0x5593ac0c10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.535+0000 7f72c803d740 1 --2- 172.21.15.7:0/2487024006 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593ac0af9a0 0x5593ac0ba170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.535+0000 7f72c803d740 1 -- 172.21.15.7:0/2487024006 >> 172.21.15.7:0/2487024006 conn(0x5593ac0ab010 msgr2=0x5593ac0a99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.535+0000 7f72c803d740 1 -- 172.21.15.7:0/2487024006 shutdown_connections 2024-09-19T04:20:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.535+0000 7f72c803d740 1 -- 172.21.15.7:0/2487024006 wait complete. 2024-09-19T04:20:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.535+0000 7f72c803d740 1 -- start start 2024-09-19T04:20:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.535+0000 7f72c803d740 1 Processor -- start 2024-09-19T04:20:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.535+0000 7f72c803d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ac0af9a0 0x5593ac0be3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.535+0000 7f72c803d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5593ac0b02e0 0x5593ac0be900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.535+0000 7f72c803d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593ac0b5370 0x5593ac0bf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.535+0000 7f72c803d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01abcf0 con 0x5593ac0af9a0 2024-09-19T04:20:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.535+0000 7f72c803d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01ab620 con 0x5593ac0b5370 2024-09-19T04:20:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.535+0000 7f72c803d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01a8840 con 0x5593ac0b02e0 2024-09-19T04:20:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.535+0000 7f72c803d740 10 client.0 _ll_register_callbacks cb 0x7f72b0031ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:20:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.535+0000 7f72beffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ac0af9a0 0x5593ac0be3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.535+0000 7f72beffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ac0af9a0 0x5593ac0be3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36682/0 (socket says 172.21.15.7:36682) 2024-09-19T04:20:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.535+0000 7f72beffd640 1 -- 172.21.15.7:0/152847138 learned_addr learned my addr 172.21.15.7:0/152847138 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:20:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.535+0000 7f72bf7fe640 1 --2- 172.21.15.7:0/152847138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593ac0b5370 0x5593ac0bf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.536+0000 7f72be7fc640 1 --2- 172.21.15.7:0/152847138 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5593ac0b02e0 0x5593ac0be900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.536+0000 7f72beffd640 1 -- 172.21.15.7:0/152847138 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5593ac0b02e0 msgr2=0x5593ac0be900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.536+0000 7f72beffd640 1 --2- 172.21.15.7:0/152847138 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5593ac0b02e0 0x5593ac0be900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.536+0000 7f72beffd640 1 -- 172.21.15.7:0/152847138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593ac0b5370 msgr2=0x5593ac0bf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:20:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.536+0000 7f72beffd640 1 --2- 172.21.15.7:0/152847138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593ac0b5370 0x5593ac0bf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.536+0000 7f72beffd640 1 -- 172.21.15.7:0/152847138 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593ac0bff20 con 0x5593ac0af9a0 2024-09-19T04:20:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.536+0000 7f72be7fc640 1 --2- 172.21.15.7:0/152847138 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5593ac0b02e0 0x5593ac0be900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:20:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.536+0000 7f72beffd640 1 --2- 172.21.15.7:0/152847138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ac0af9a0 0x5593ac0be3c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f72b00c4810 tx=0x7f72b00f0190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=976a33079cd1fd86 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:20:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.536+0000 7f72a2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:20:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.536+0000 7f72a2ff5640 1 -- 172.21.15.7:0/152847138 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0049040 con 0x5593ac0af9a0 2024-09-19T04:20:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.536+0000 7f72a2ff5640 1 -- 172.21.15.7:0/152847138 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f72b00035f0 con 0x5593ac0af9a0 2024-09-19T04:20:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.536+0000 7f72c803d740 1 -- 172.21.15.7:0/152847138 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72b8009cd0 con 0x5593ac0af9a0 2024-09-19T04:20:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.536+0000 7f72a2ff5640 1 -- 172.21.15.7:0/152847138 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f72b00d50d0 con 0x5593ac0af9a0 2024-09-19T04:20:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.536+0000 7f72c803d740 10 client.15891 fetch_fsmap learned FSMap version 32 2024-09-19T04:20:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.536+0000 7f72c803d740 1 -- 172.21.15.7:0/152847138 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5593ac0c12a0 con 0x5593ac0af9a0 2024-09-19T04:20:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.536+0000 7f72a2ff5640 1 -- 172.21.15.7:0/152847138 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72b8009cd0 con 0x5593ac0af9a0 2024-09-19T04:20:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.536+0000 7f72a2ff5640 1 -- 172.21.15.7:0/152847138 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f72b00b87f0 con 0x5593ac0af9a0 2024-09-19T04:20:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.537+0000 7f72c803d740 10 client.15891 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T04:20:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.537+0000 7f72c803d740 10 client.15891 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:20:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.537+0000 7f72c803d740 20 client.15891 populate_metadata read hostname 'smithi007' 2024-09-19T04:20:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.537+0000 7f72c803d740 1 --2- 172.21.15.7:0/152847138 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5593ac130910 0x5593ac132d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:20:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.537+0000 7f72c803d740 4 client.15891 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:20:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.537+0000 7f72c803d740 1 -- 172.21.15.7:0/152847138 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5593ac01ad70 con 0x5593ac130910 2024-09-19T04:20:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.537+0000 7f72be7fc640 1 --2- 172.21.15.7:0/152847138 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5593ac130910 0x5593ac132d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:20:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.537+0000 7f72be7fc640 1 --2- 172.21.15.7:0/152847138 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5593ac130910 0x5593ac132d30 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94f2516b8db7efe6 server_cookie=73750ec3c6664f55 in_seq=0 out_seq=0 2024-09-19T04:20:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:49.537+0000 7f72a2ff5640 10 client.15891 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:20:49.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:49 smithi092 ceph-mon[34940]: pgmap v471: 129 pgs: 129 active+clean; 231 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.0 MiB/s wr, 488 op/s 2024-09-19T04:20:51.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:51 smithi007 ceph-mon[31360]: pgmap v472: 129 pgs: 129 active+clean; 245 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.2 MiB/s wr, 610 op/s 2024-09-19T04:20:51.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:51 smithi102 ceph-mon[35446]: pgmap v472: 129 pgs: 129 active+clean; 245 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.2 MiB/s wr, 610 op/s 2024-09-19T04:20:51.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:51 smithi092 ceph-mon[34940]: pgmap v472: 129 pgs: 129 active+clean; 245 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.2 MiB/s wr, 610 op/s 2024-09-19T04:20:52.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:52.818+0000 7f72a2ff5640 1 -- 172.21.15.7:0/152847138 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5593ac01ad70 con 0x5593ac130910 2024-09-19T04:20:52.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:52.818+0000 7f72a2ff5640 10 client.15891 handle_command_reply: tid=0 2024-09-19T04:20:52.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:52.818+0000 7f72c803d740 1 client.15891 shutdown 2024-09-19T04:20:52.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:52.818+0000 7f72c803d740 1 -- 172.21.15.7:0/152847138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ac0af9a0 msgr2=0x5593ac0be3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:52.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:52.818+0000 7f72c803d740 1 --2- 172.21.15.7:0/152847138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ac0af9a0 0x5593ac0be3c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f72b00c4810 tx=0x7f72b00f0190 comp rx=0 tx=0).stop 2024-09-19T04:20:52.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:52.819+0000 7f72c803d740 1 -- 172.21.15.7:0/152847138 shutdown_connections 2024-09-19T04:20:52.820 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:52.819+0000 7f72c803d740 1 --2- 172.21.15.7:0/152847138 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5593ac130910 0x5593ac132d30 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:52.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:52.819+0000 7f72c803d740 1 --2- 172.21.15.7:0/152847138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593ac0b5370 0x5593ac0bf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:52.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:52.819+0000 7f72c803d740 1 --2- 172.21.15.7:0/152847138 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5593ac0b02e0 0x5593ac0be900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:52.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:52.819+0000 7f72c803d740 1 --2- 172.21.15.7:0/152847138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ac0af9a0 0x5593ac0be3c0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:52.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:52.819+0000 7f72c803d740 1 -- 172.21.15.7:0/152847138 >> 172.21.15.7:0/152847138 conn(0x5593ac0ab010 msgr2=0x5593ac0aa1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:52.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:52.819+0000 7f72a2ff5640 0 client.15891 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:20:52.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:52.819+0000 7f72c803d740 1 -- 172.21.15.7:0/152847138 shutdown_connections 2024-09-19T04:20:52.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:52.820+0000 7f72c803d740 1 -- 172.21.15.7:0/152847138 wait complete. 2024-09-19T04:20:52.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:52.820+0000 7f72c803d740 20 client.15891 trim_cache size 0 max 16384 2024-09-19T04:20:52.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:20:52.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:20:52.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:20:52.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:20:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:52.821+0000 7f72c52af640 1 -- 172.21.15.7:0/3595085977 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f72a80a32c0 msgr2=0x7f72a80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:52.821+0000 7f72c52af640 1 --2- 172.21.15.7:0/3595085977 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f72a80a32c0 0x7f72a80a5780 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f72b8022000 tx=0x7f72b8023000 comp rx=0 tx=0).stop 2024-09-19T04:20:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:52.821+0000 7f72c52af640 1 -- 172.21.15.7:0/3595085977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c0101b60 msgr2=0x7f72c0197ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:20:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:52.821+0000 7f72c52af640 1 --2- 172.21.15.7:0/3595085977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c0101b60 0x7f72c0197ef0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f72b0031610 tx=0x7f72b0004270 comp rx=0 tx=0).stop 2024-09-19T04:20:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:52.821+0000 7f72c52af640 1 -- 172.21.15.7:0/3595085977 shutdown_connections 2024-09-19T04:20:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:52.821+0000 7f72c52af640 1 --2- 172.21.15.7:0/3595085977 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f72a80a32c0 0x7f72a80a5780 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:52.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:52.821+0000 7f72c52af640 1 --2- 172.21.15.7:0/3595085977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72c0103710 0x7f72c019f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:52.821+0000 7f72c52af640 1 --2- 172.21.15.7:0/3595085977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72c0102d50 0x7f72c0198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:52.821+0000 7f72c52af640 1 --2- 172.21.15.7:0/3595085977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c0101b60 0x7f72c0197ef0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:20:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:52.821+0000 7f72c52af640 1 -- 172.21.15.7:0/3595085977 >> 172.21.15.7:0/3595085977 conn(0x7f72c00fd2e0 msgr2=0x7f72c01061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:20:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:52.822+0000 7f72c52af640 1 -- 172.21.15.7:0/3595085977 shutdown_connections 2024-09-19T04:20:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:20:52.822+0000 7f72c52af640 1 -- 172.21.15.7:0/3595085977 wait complete. 2024-09-19T04:20:53.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:53 smithi007 ceph-mon[31360]: pgmap v473: 129 pgs: 129 active+clean; 249 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 448 op/s 2024-09-19T04:20:53.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:53 smithi102 ceph-mon[35446]: pgmap v473: 129 pgs: 129 active+clean; 249 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 448 op/s 2024-09-19T04:20:53.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:53 smithi092 ceph-mon[34940]: pgmap v473: 129 pgs: 129 active+clean; 249 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 448 op/s 2024-09-19T04:20:55.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:55 smithi007 ceph-mon[31360]: pgmap v474: 129 pgs: 129 active+clean; 250 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 518 op/s 2024-09-19T04:20:55.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:55 smithi102 ceph-mon[35446]: pgmap v474: 129 pgs: 129 active+clean; 250 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 518 op/s 2024-09-19T04:20:55.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:55 smithi092 ceph-mon[34940]: pgmap v474: 129 pgs: 129 active+clean; 250 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 518 op/s 2024-09-19T04:20:57.380 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:57 smithi007 ceph-mon[31360]: pgmap v475: 129 pgs: 129 active+clean; 249 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.6 MiB/s wr, 598 op/s 2024-09-19T04:20:57.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:57 smithi102 ceph-mon[35446]: pgmap v475: 129 pgs: 129 active+clean; 249 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.6 MiB/s wr, 598 op/s 2024-09-19T04:20:57.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:57 smithi092 ceph-mon[34940]: pgmap v475: 129 pgs: 129 active+clean; 249 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.6 MiB/s wr, 598 op/s 2024-09-19T04:20:58.158 INFO:tasks.workunit.client.0.smithi007.stdout: 88 1229303 511 898870 457 722024 1037 2024-09-19T04:20:59.348 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:20:59 smithi092 ceph-mon[34940]: pgmap v476: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 509 op/s 2024-09-19T04:20:59.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:20:59 smithi007 ceph-mon[31360]: pgmap v476: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 509 op/s 2024-09-19T04:20:59.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:20:59 smithi102 ceph-mon[35446]: pgmap v476: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 509 op/s 2024-09-19T04:21:01.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:01 smithi007 ceph-mon[31360]: pgmap v477: 129 pgs: 129 active+clean; 252 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.4 MiB/s wr, 558 op/s 2024-09-19T04:21:01.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:01 smithi102 ceph-mon[35446]: pgmap v477: 129 pgs: 129 active+clean; 252 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.4 MiB/s wr, 558 op/s 2024-09-19T04:21:01.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:01 smithi092 ceph-mon[34940]: pgmap v477: 129 pgs: 129 active+clean; 252 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.4 MiB/s wr, 558 op/s 2024-09-19T04:21:03.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:03 smithi007 ceph-mon[31360]: pgmap v478: 129 pgs: 129 active+clean; 251 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 449 op/s 2024-09-19T04:21:03.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:03 smithi102 ceph-mon[35446]: pgmap v478: 129 pgs: 129 active+clean; 251 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 449 op/s 2024-09-19T04:21:03.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:03 smithi092 ceph-mon[34940]: pgmap v478: 129 pgs: 129 active+clean; 251 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 449 op/s 2024-09-19T04:21:05.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:05 smithi007 ceph-mon[31360]: pgmap v479: 129 pgs: 129 active+clean; 256 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 436 op/s 2024-09-19T04:21:05.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:05 smithi102 ceph-mon[35446]: pgmap v479: 129 pgs: 129 active+clean; 256 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 436 op/s 2024-09-19T04:21:05.548 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:05 smithi092 ceph-mon[34940]: pgmap v479: 129 pgs: 129 active+clean; 256 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 436 op/s 2024-09-19T04:21:06.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.346+0000 7fb2bfad0640 1 -- 172.21.15.7:0/3194885549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2b80736b0 msgr2=0x7fb2b8119130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:06.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.346+0000 7fb2bfad0640 1 --2- 172.21.15.7:0/3194885549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2b80736b0 0x7fb2b8119130 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb2a801a910 tx=0x7fb2a803b450 comp rx=0 tx=0).stop 2024-09-19T04:21:06.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.348+0000 7fb2bfad0640 1 -- 172.21.15.7:0/3194885549 shutdown_connections 2024-09-19T04:21:06.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.348+0000 7fb2bfad0640 1 --2- 172.21.15.7:0/3194885549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2b80736b0 0x7fb2b8119130 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:06.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.348+0000 7fb2bfad0640 1 --2- 172.21.15.7:0/3194885549 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2b8072d10 0x7fb2b8073170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:06.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.348+0000 7fb2bfad0640 1 --2- 172.21.15.7:0/3194885549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2b8109700 0x7fb2b8109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:06.351 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.348+0000 7fb2bfad0640 1 -- 172.21.15.7:0/3194885549 >> 172.21.15.7:0/3194885549 conn(0x7fb2b806ecd0 msgr2=0x7fb2b8071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:06.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.355+0000 7fb2bfad0640 1 -- 172.21.15.7:0/3194885549 shutdown_connections 2024-09-19T04:21:06.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.358+0000 7fb2bfad0640 1 -- 172.21.15.7:0/3194885549 wait complete. 2024-09-19T04:21:06.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.358+0000 7fb2bfad0640 1 Processor -- start 2024-09-19T04:21:06.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.361+0000 7fb2bfad0640 1 -- start start 2024-09-19T04:21:06.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.361+0000 7fb2bfad0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2b8072d10 0x7fb2b81c0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:06.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.361+0000 7fb2bfad0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2b80736b0 0x7fb2b81c0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:06.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.361+0000 7fb2bfad0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2b8109700 0x7fb2b81c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:06.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.361+0000 7fb2bfad0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b8113640 con 0x7fb2b8109700 2024-09-19T04:21:06.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.361+0000 7fb2bfad0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b81134c0 con 0x7fb2b80736b0 2024-09-19T04:21:06.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.361+0000 7fb2bfad0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b81137c0 con 0x7fb2b8072d10 2024-09-19T04:21:06.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.363+0000 7fb2bd06b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2b80736b0 0x7fb2b81c0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:06.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.363+0000 7fb2bd06b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2b80736b0 0x7fb2b81c0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:47276/0 (socket says 172.21.15.7:47276) 2024-09-19T04:21:06.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.363+0000 7fb2bd06b640 1 -- 172.21.15.7:0/370656741 learned_addr learned my addr 172.21.15.7:0/370656741 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:06.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.366+0000 7fb2bd06b640 1 -- 172.21.15.7:0/370656741 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2b8072d10 msgr2=0x7fb2b81c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:06.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.366+0000 7fb2bd06b640 1 --2- 172.21.15.7:0/370656741 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2b8072d10 0x7fb2b81c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:06.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.366+0000 7fb2bd06b640 1 -- 172.21.15.7:0/370656741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2b8109700 msgr2=0x7fb2b81c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:06.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.366+0000 7fb2bd06b640 1 --2- 172.21.15.7:0/370656741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2b8109700 0x7fb2b81c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:06.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.366+0000 7fb2bd06b640 1 -- 172.21.15.7:0/370656741 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b81c80e0 con 0x7fb2b80736b0 2024-09-19T04:21:06.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.368+0000 7fb2bd06b640 1 --2- 172.21.15.7:0/370656741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2b80736b0 0x7fb2b81c0e40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb2b400b4a0 tx=0x7fb2b400b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:06.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.372+0000 7fb2aeffd640 1 -- 172.21.15.7:0/370656741 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4014070 con 0x7fb2b80736b0 2024-09-19T04:21:06.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.372+0000 7fb2aeffd640 1 -- 172.21.15.7:0/370656741 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2b4010af0 con 0x7fb2b80736b0 2024-09-19T04:21:06.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.372+0000 7fb2aeffd640 1 -- 172.21.15.7:0/370656741 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4017c40 con 0x7fb2b80736b0 2024-09-19T04:21:06.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.372+0000 7fb2bfad0640 1 -- 172.21.15.7:0/370656741 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2b81c83d0 con 0x7fb2b80736b0 2024-09-19T04:21:06.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.372+0000 7fb2bfad0640 1 -- 172.21.15.7:0/370656741 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2b81c8950 con 0x7fb2b80736b0 2024-09-19T04:21:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.378+0000 7fb2aeffd640 1 -- 172.21.15.7:0/370656741 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fb2b4017070 con 0x7fb2b80736b0 2024-09-19T04:21:06.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.379+0000 7fb2aeffd640 1 --2- 172.21.15.7:0/370656741 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb2a40a33d0 0x7fb2a40a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:06.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.380+0000 7fb2aeffd640 1 -- 172.21.15.7:0/370656741 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fb2b40cffb0 con 0x7fb2b80736b0 2024-09-19T04:21:06.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.382+0000 7fb2c286d740 1 Processor -- start 2024-09-19T04:21:06.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.382+0000 7fb2c286d740 1 -- start start 2024-09-19T04:21:06.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.382+0000 7fb2c286d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bd71929a0 0x558bd7192da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:06.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.382+0000 7fb2c286d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558bd71932e0 0x558bd7197da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:06.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.382+0000 7fb2c286d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558bd7198370 0x558bd719a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:06.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.382+0000 7fb2c286d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558bd70f62f0 con 0x558bd71932e0 2024-09-19T04:21:06.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.382+0000 7fb2c286d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558bd709e270 con 0x558bd71929a0 2024-09-19T04:21:06.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.382+0000 7fb2c286d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558bd70f22b0 con 0x558bd7198370 2024-09-19T04:21:06.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.385+0000 7fb2bd06b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558bd71932e0 0x558bd7197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:06.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.385+0000 7fb2bd06b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558bd71932e0 0x558bd7197da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39238/0 (socket says 172.21.15.7:39238) 2024-09-19T04:21:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.385+0000 7fb2bd06b640 1 -- 172.21.15.7:0/1129781326 learned_addr learned my addr 172.21.15.7:0/1129781326 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.386+0000 7fb2bd86c640 1 --2- 172.21.15.7:0/370656741 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb2a40a33d0 0x7fb2a40a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.390+0000 7fb2bd86c640 1 --2- 172.21.15.7:0/1129781326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bd71929a0 0x558bd7192da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:06.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.393+0000 7fb2bd06b640 1 -- 172.21.15.7:0/1129781326 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558bd7198370 msgr2=0x558bd719a830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T04:21:06.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.393+0000 7fb2bd06b640 1 --2- 172.21.15.7:0/1129781326 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558bd7198370 0x558bd719a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:06.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.393+0000 7fb2bd06b640 1 -- 172.21.15.7:0/1129781326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bd71929a0 msgr2=0x558bd7192da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:06.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.393+0000 7fb2bd06b640 1 --2- 172.21.15.7:0/1129781326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bd71929a0 0x558bd7192da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:06.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.393+0000 7fb2bd06b640 1 -- 172.21.15.7:0/1129781326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bd709d340 con 0x558bd71932e0 2024-09-19T04:21:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.403+0000 7fb2bd06b640 1 --2- 172.21.15.7:0/1129781326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558bd71932e0 0x558bd7197da0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4017770 tx=0x7fb2b40047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce959323c18b1727 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:06.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.404+0000 7fb2a3fff640 1 -- 172.21.15.7:0/1129781326 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b401e070 con 0x558bd71932e0 2024-09-19T04:21:06.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.404+0000 7fb2a3fff640 1 -- 172.21.15.7:0/1129781326 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2b409a500 con 0x558bd71932e0 2024-09-19T04:21:06.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.406+0000 7fb2c286d740 1 -- 172.21.15.7:0/1129781326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558bd71932e0 msgr2=0x558bd7197da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:06.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.406+0000 7fb2c286d740 1 --2- 172.21.15.7:0/1129781326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558bd71932e0 0x558bd7197da0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4017770 tx=0x7fb2b40047d0 comp rx=0 tx=0).stop 2024-09-19T04:21:06.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.407+0000 7fb2bd86c640 1 --2- 172.21.15.7:0/370656741 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb2a40a33d0 0x7fb2a40a5890 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000e560 tx=0x7fb2b000a7e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.413+0000 7fb2c286d740 1 -- 172.21.15.7:0/1129781326 shutdown_connections 2024-09-19T04:21:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.413+0000 7fb2c286d740 1 --2- 172.21.15.7:0/1129781326 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558bd7198370 0x558bd719a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.413+0000 7fb2c286d740 1 --2- 172.21.15.7:0/1129781326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558bd71932e0 0x558bd7197da0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.413+0000 7fb2c286d740 1 --2- 172.21.15.7:0/1129781326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bd71929a0 0x558bd7192da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:06.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.413+0000 7fb2c286d740 1 -- 172.21.15.7:0/1129781326 >> 172.21.15.7:0/1129781326 conn(0x558bd718e010 msgr2=0x558bd718e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:06.425 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.423+0000 7fb2c286d740 1 -- 172.21.15.7:0/1129781326 shutdown_connections 2024-09-19T04:21:06.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.424+0000 7fb2c286d740 1 -- 172.21.15.7:0/1129781326 wait complete. 2024-09-19T04:21:06.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.424+0000 7fb2c286d740 1 -- start start 2024-09-19T04:21:06.427 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.424+0000 7fb2c286d740 1 Processor -- start 2024-09-19T04:21:06.429 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.427+0000 7fb2c286d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558bd71929a0 0x558bd719cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:06.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.427+0000 7fb2c286d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558bd71932e0 0x558bd719d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:06.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.427+0000 7fb2c286d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bd7198370 0x558bd71a43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:06.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.427+0000 7fb2c286d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558bd719b330 con 0x558bd71929a0 2024-09-19T04:21:06.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.427+0000 7fb2c286d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558bd707f290 con 0x558bd7198370 2024-09-19T04:21:06.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.427+0000 7fb2c286d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558bd719b4b0 con 0x558bd71932e0 2024-09-19T04:21:06.430 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.427+0000 7fb2c286d740 10 client.0 _ll_register_callbacks cb 0x558bd70b0140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:21:06.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.430+0000 7fb2bd06b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558bd71932e0 0x558bd719d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:06.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.430+0000 7fb2bd86c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558bd71929a0 0x558bd719cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:06.432 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.430+0000 7fb2be06d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bd7198370 0x558bd71a43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.430+0000 7fb2bd86c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558bd71929a0 0x558bd719cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39242/0 (socket says 172.21.15.7:39242) 2024-09-19T04:21:06.433 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.430+0000 7fb2bd86c640 1 -- 172.21.15.7:0/41430731 learned_addr learned my addr 172.21.15.7:0/41430731 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:06.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.434+0000 7fb2bd06b640 1 -- 172.21.15.7:0/41430731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bd7198370 msgr2=0x558bd71a43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:06.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.434+0000 7fb2bd06b640 1 --2- 172.21.15.7:0/41430731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bd7198370 0x558bd71a43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:06.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.434+0000 7fb2bd06b640 1 -- 172.21.15.7:0/41430731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558bd71929a0 msgr2=0x558bd719cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:06.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.434+0000 7fb2bd06b640 1 --2- 172.21.15.7:0/41430731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558bd71929a0 0x558bd719cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:06.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.434+0000 7fb2bd06b640 1 -- 172.21.15.7:0/41430731 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bd6e09210 con 0x558bd71932e0 2024-09-19T04:21:06.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.434+0000 7fb2bd06b640 1 --2- 172.21.15.7:0/41430731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558bd71932e0 0x558bd719d440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4000c00 tx=0x7fb2b40a0730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d25a3ceafb454530 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:06.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.434+0000 7fb2a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-19T04:21:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.434+0000 7fb2a17fa640 1 -- 172.21.15.7:0/41430731 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b40ba060 con 0x558bd71932e0 2024-09-19T04:21:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.434+0000 7fb2c286d740 1 -- 172.21.15.7:0/41430731 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558bd7103a20 con 0x558bd71932e0 2024-09-19T04:21:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.434+0000 7fb2a17fa640 1 -- 172.21.15.7:0/41430731 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fb2b40cdba0 con 0x558bd71932e0 2024-09-19T04:21:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.435+0000 7fb2a17fa640 1 -- 172.21.15.7:0/41430731 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb2b401e070 con 0x558bd71932e0 2024-09-19T04:21:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.437+0000 7fb2c286d740 10 client.25579 fetch_fsmap learned FSMap version 32 2024-09-19T04:21:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.437+0000 7fb2c286d740 1 -- 172.21.15.7:0/41430731 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558bd6ed5620 con 0x558bd71932e0 2024-09-19T04:21:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.438+0000 7fb2a17fa640 1 -- 172.21.15.7:0/41430731 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x558bd7103a20 con 0x558bd71932e0 2024-09-19T04:21:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.438+0000 7fb2a17fa640 1 -- 172.21.15.7:0/41430731 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fb2b409b650 con 0x558bd71932e0 2024-09-19T04:21:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.438+0000 7fb2c286d740 10 client.25579 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T04:21:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.438+0000 7fb2c286d740 10 client.25579 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:21:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.438+0000 7fb2c286d740 20 client.25579 populate_metadata read hostname 'smithi007' 2024-09-19T04:21:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.438+0000 7fb2c286d740 1 --2- 172.21.15.7:0/41430731 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x558bd71a8db0 0x558bd71ab250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.438+0000 7fb2c286d740 4 client.25579 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:21:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.438+0000 7fb2c286d740 1 -- 172.21.15.7:0/41430731 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558bd70fdd70 con 0x558bd71a8db0 2024-09-19T04:21:06.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.455+0000 7fb2bd86c640 1 --2- 172.21.15.7:0/41430731 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x558bd71a8db0 0x558bd71ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:06.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.457+0000 7fb2bd86c640 1 --2- 172.21.15.7:0/41430731 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x558bd71a8db0 0x558bd71ab250 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc614dc63eefdd4d server_cookie=1b49dc9b2f3db518 in_seq=0 out_seq=0 2024-09-19T04:21:06.464 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.457+0000 7fb2a17fa640 10 client.25579 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:21:06.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.464+0000 7fb2a17fa640 1 -- 172.21.15.7:0/41430731 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558bd70fdd70 con 0x558bd71a8db0 2024-09-19T04:21:06.466 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.464+0000 7fb2a17fa640 10 client.25579 handle_command_reply: tid=0 2024-09-19T04:21:06.474 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.469+0000 7fb2c286d740 1 client.25579 shutdown 2024-09-19T04:21:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.472+0000 7fb2c286d740 1 -- 172.21.15.7:0/41430731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558bd71932e0 msgr2=0x558bd719d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.472+0000 7fb2c286d740 1 --2- 172.21.15.7:0/41430731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558bd71932e0 0x558bd719d440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4000c00 tx=0x7fb2b40a0730 comp rx=0 tx=0).stop 2024-09-19T04:21:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.472+0000 7fb2c286d740 1 -- 172.21.15.7:0/41430731 shutdown_connections 2024-09-19T04:21:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.472+0000 7fb2c286d740 1 --2- 172.21.15.7:0/41430731 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x558bd71a8db0 0x558bd71ab250 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.472+0000 7fb2c286d740 1 --2- 172.21.15.7:0/41430731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bd7198370 0x558bd71a43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.473+0000 7fb2c286d740 1 --2- 172.21.15.7:0/41430731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558bd71932e0 0x558bd719d440 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.473+0000 7fb2c286d740 1 --2- 172.21.15.7:0/41430731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558bd71929a0 0x558bd719cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:06.475 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.473+0000 7fb2c286d740 1 -- 172.21.15.7:0/41430731 >> 172.21.15.7:0/41430731 conn(0x558bd718e010 msgr2=0x558bd718f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:06.476 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.473+0000 7fb2a17fa640 0 client.25579 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:21:06.476 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.473+0000 7fb2c286d740 1 -- 172.21.15.7:0/41430731 shutdown_connections 2024-09-19T04:21:06.476 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.473+0000 7fb2c286d740 1 -- 172.21.15.7:0/41430731 wait complete. 2024-09-19T04:21:06.484 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.481+0000 7fb2c286d740 20 client.25579 trim_cache size 0 max 16384 2024-09-19T04:21:06.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.560+0000 7fb2c286d740 1 Processor -- start 2024-09-19T04:21:06.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.560+0000 7fb2c286d740 1 -- start start 2024-09-19T04:21:06.563 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.561+0000 7fb2c286d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558bd71929a0 0x558bd719d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:06.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.561+0000 7fb2c286d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bd71932e0 0x558bd71a4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:06.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.562+0000 7fb2bd86c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558bd71929a0 0x558bd719d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:06.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.562+0000 7fb2bd86c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558bd71929a0 0x558bd719d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39250/0 (socket says 172.21.15.7:39250) 2024-09-19T04:21:06.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.562+0000 7fb2bd86c640 1 -- 172.21.15.7:0/2197222731 learned_addr learned my addr 172.21.15.7:0/2197222731 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:06.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.562+0000 7fb2c286d740 1 --2- 172.21.15.7:0/2197222731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558bd7198370 0x558bd718eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:06.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.562+0000 7fb2bd06b640 1 --2- 172.21.15.7:0/2197222731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bd71932e0 0x558bd71a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:06.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.562+0000 7fb2c286d740 1 -- 172.21.15.7:0/2197222731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb29c00fcd0 con 0x558bd71929a0 2024-09-19T04:21:06.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.562+0000 7fb2c286d740 1 -- 172.21.15.7:0/2197222731 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb29c0118d0 con 0x558bd71932e0 2024-09-19T04:21:06.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.562+0000 7fb2be06d640 1 --2- 172.21.15.7:0/2197222731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558bd7198370 0x558bd718eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:06.565 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.563+0000 7fb2c286d740 1 -- 172.21.15.7:0/2197222731 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb29c0103a0 con 0x558bd7198370 2024-09-19T04:21:06.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.564+0000 7fb2bd06b640 1 -- 172.21.15.7:0/2197222731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558bd7198370 msgr2=0x558bd718eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:06.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.564+0000 7fb2bd06b640 1 --2- 172.21.15.7:0/2197222731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558bd7198370 0x558bd718eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:06.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.564+0000 7fb2bd06b640 1 -- 172.21.15.7:0/2197222731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558bd71929a0 msgr2=0x558bd719d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:06.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.564+0000 7fb2bd06b640 1 --2- 172.21.15.7:0/2197222731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558bd71929a0 0x558bd719d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:06.566 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.564+0000 7fb2bd06b640 1 -- 172.21.15.7:0/2197222731 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bd71892d0 con 0x558bd71932e0 2024-09-19T04:21:06.567 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.564+0000 7fb2bd06b640 1 --2- 172.21.15.7:0/2197222731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bd71932e0 0x558bd71a4360 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb2b409c190 tx=0x7fb2b40047d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca12fc93a0bfdce7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:06.575 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.572+0000 7fb2a37fe640 1 -- 172.21.15.7:0/2197222731 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b40ba050 con 0x558bd71932e0 2024-09-19T04:21:06.575 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.572+0000 7fb2a37fe640 1 -- 172.21.15.7:0/2197222731 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2b409c900 con 0x558bd71932e0 2024-09-19T04:21:06.575 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.572+0000 7fb2a37fe640 1 -- 172.21.15.7:0/2197222731 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b40a8070 con 0x558bd71932e0 2024-09-19T04:21:06.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.576+0000 7fb2c286d740 1 -- 172.21.15.7:0/2197222731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bd71932e0 msgr2=0x558bd71a4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:06.578 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.576+0000 7fb2c286d740 1 --2- 172.21.15.7:0/2197222731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bd71932e0 0x558bd71a4360 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb2b409c190 tx=0x7fb2b40047d0 comp rx=0 tx=0).stop 2024-09-19T04:21:06.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.579+0000 7fb2c286d740 1 -- 172.21.15.7:0/2197222731 shutdown_connections 2024-09-19T04:21:06.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.579+0000 7fb2c286d740 1 --2- 172.21.15.7:0/2197222731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558bd7198370 0x558bd718eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:06.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.579+0000 7fb2c286d740 1 --2- 172.21.15.7:0/2197222731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bd71932e0 0x558bd71a4360 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:06.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.579+0000 7fb2c286d740 1 --2- 172.21.15.7:0/2197222731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558bd71929a0 0x558bd719d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:06.581 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.579+0000 7fb2c286d740 1 -- 172.21.15.7:0/2197222731 >> 172.21.15.7:0/2197222731 conn(0x558bd718e010 msgr2=0x558bd719ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:06.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.581+0000 7fb2c286d740 1 -- 172.21.15.7:0/2197222731 shutdown_connections 2024-09-19T04:21:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.581+0000 7fb2c286d740 1 -- 172.21.15.7:0/2197222731 wait complete. 2024-09-19T04:21:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.582+0000 7fb2c286d740 1 -- start start 2024-09-19T04:21:06.584 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.582+0000 7fb2c286d740 1 Processor -- start 2024-09-19T04:21:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.583+0000 7fb2c286d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bd71929a0 0x558bd71a3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.583+0000 7fb2c286d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558bd71932e0 0x558bd71a4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.583+0000 7fb2c286d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558bd7198370 0x558bd71a09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:06.585 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.583+0000 7fb2c286d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb29c011140 con 0x558bd71932e0 2024-09-19T04:21:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.583+0000 7fb2c286d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb29c010a70 con 0x558bd71929a0 2024-09-19T04:21:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.583+0000 7fb2c286d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb29c00dc90 con 0x558bd7198370 2024-09-19T04:21:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.583+0000 7fb2c286d740 10 client.0 _ll_register_callbacks cb 0x7fb2b409c290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:21:06.586 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.584+0000 7fb2be06d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558bd7198370 0x558bd71a09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.584+0000 7fb2be06d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558bd7198370 0x558bd71a09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:40146/0 (socket says 172.21.15.7:40146) 2024-09-19T04:21:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.584+0000 7fb2be06d640 1 -- 172.21.15.7:0/2796600461 learned_addr learned my addr 172.21.15.7:0/2796600461 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:06.587 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.584+0000 7fb2bd86c640 1 --2- 172.21.15.7:0/2796600461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bd71929a0 0x558bd71a3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.587+0000 7fb2bd86c640 1 -- 172.21.15.7:0/2796600461 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558bd7198370 msgr2=0x558bd71a09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.587+0000 7fb2bd86c640 1 --2- 172.21.15.7:0/2796600461 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558bd7198370 0x558bd71a09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.587+0000 7fb2bd86c640 1 -- 172.21.15.7:0/2796600461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558bd71932e0 msgr2=0x558bd71a4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.587+0000 7fb2bd86c640 1 --2- 172.21.15.7:0/2796600461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558bd71932e0 0x558bd71a4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.587+0000 7fb2bd86c640 1 -- 172.21.15.7:0/2796600461 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bd71a1220 con 0x558bd71929a0 2024-09-19T04:21:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.588+0000 7fb2bd86c640 1 --2- 172.21.15.7:0/2796600461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bd71929a0 0x558bd71a3de0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x558bd71a5150 tx=0x7fb2b0016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8ee500607d99254 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.592+0000 7fb2a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T04:21:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.592+0000 7fb2a17fa640 1 -- 172.21.15.7:0/2796600461 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0008280 con 0x558bd71929a0 2024-09-19T04:21:06.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.592+0000 7fb2a17fa640 1 -- 172.21.15.7:0/2796600461 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fb2b0025660 con 0x558bd71929a0 2024-09-19T04:21:06.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.592+0000 7fb2c286d740 1 -- 172.21.15.7:0/2796600461 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2b409c900 con 0x558bd71929a0 2024-09-19T04:21:06.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.593+0000 7fb2a17fa640 1 -- 172.21.15.7:0/2796600461 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb2b0033050 con 0x558bd71929a0 2024-09-19T04:21:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.594+0000 7fb2c286d740 10 client.25508 fetch_fsmap learned FSMap version 32 2024-09-19T04:21:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.594+0000 7fb2c286d740 1 -- 172.21.15.7:0/2796600461 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x558bd7212a40 con 0x558bd71929a0 2024-09-19T04:21:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.595+0000 7fb2a17fa640 1 -- 172.21.15.7:0/2796600461 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2b409c900 con 0x558bd71929a0 2024-09-19T04:21:06.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.596+0000 7fb2a17fa640 1 -- 172.21.15.7:0/2796600461 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fb2b002e030 con 0x558bd71929a0 2024-09-19T04:21:06.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.598+0000 7fb2c286d740 10 client.25508 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T04:21:06.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.598+0000 7fb2c286d740 10 client.25508 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:21:06.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.598+0000 7fb2c286d740 20 client.25508 populate_metadata read hostname 'smithi007' 2024-09-19T04:21:06.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.598+0000 7fb2c286d740 1 --2- 172.21.15.7:0/2796600461 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x558bd7213410 0x558bd7215830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:06.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.598+0000 7fb2c286d740 4 client.25508 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:21:06.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.598+0000 7fb2c286d740 1 -- 172.21.15.7:0/2796600461 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558bd707a900 con 0x558bd7213410 2024-09-19T04:21:06.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.600+0000 7fb2bd06b640 1 --2- 172.21.15.7:0/2796600461 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x558bd7213410 0x558bd7215830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.604+0000 7fb2a17fa640 10 client.25508 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:21:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:06.604+0000 7fb2bd06b640 1 --2- 172.21.15.7:0/2796600461 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x558bd7213410 0x558bd7215830 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=658248ba02e1e422 server_cookie=89f75e1f76adacab in_seq=0 out_seq=0 2024-09-19T04:21:07.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:07 smithi007 ceph-mon[31360]: pgmap v480: 129 pgs: 129 active+clean; 257 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 333 op/s 2024-09-19T04:21:07.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:07 smithi102 ceph-mon[35446]: pgmap v480: 129 pgs: 129 active+clean; 257 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 333 op/s 2024-09-19T04:21:07.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:07 smithi092 ceph-mon[34940]: pgmap v480: 129 pgs: 129 active+clean; 257 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 333 op/s 2024-09-19T04:21:08.158 INFO:tasks.workunit.client.0.smithi007.stdout: 95 1616165 448 1194052 444 953561 1371 2024-09-19T04:21:09.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:09 smithi007 ceph-mon[31360]: pgmap v481: 129 pgs: 129 active+clean; 256 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 192 op/s 2024-09-19T04:21:09.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:09 smithi102 ceph-mon[35446]: pgmap v481: 129 pgs: 129 active+clean; 256 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 192 op/s 2024-09-19T04:21:09.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:09 smithi092 ceph-mon[34940]: pgmap v481: 129 pgs: 129 active+clean; 256 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 192 op/s 2024-09-19T04:21:10.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:10.493+0000 7fb2a17fa640 1 -- 172.21.15.7:0/2796600461 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558bd707a900 con 0x558bd7213410 2024-09-19T04:21:10.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:10.493+0000 7fb2a17fa640 10 client.25508 handle_command_reply: tid=0 2024-09-19T04:21:10.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:10.493+0000 7fb2c286d740 1 client.25508 shutdown 2024-09-19T04:21:10.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:10.493+0000 7fb2c286d740 1 -- 172.21.15.7:0/2796600461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bd71929a0 msgr2=0x558bd71a3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:10.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:10.493+0000 7fb2c286d740 1 --2- 172.21.15.7:0/2796600461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bd71929a0 0x558bd71a3de0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x558bd71a5150 tx=0x7fb2b0016000 comp rx=0 tx=0).stop 2024-09-19T04:21:10.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:10.493+0000 7fb2c286d740 1 -- 172.21.15.7:0/2796600461 shutdown_connections 2024-09-19T04:21:10.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:10.493+0000 7fb2c286d740 1 --2- 172.21.15.7:0/2796600461 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x558bd7213410 0x558bd7215830 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:10.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:10.493+0000 7fb2c286d740 1 --2- 172.21.15.7:0/2796600461 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558bd7198370 0x558bd71a09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:10.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:10.494+0000 7fb2c286d740 1 --2- 172.21.15.7:0/2796600461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558bd71932e0 0x558bd71a4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:10.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:10.494+0000 7fb2c286d740 1 --2- 172.21.15.7:0/2796600461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558bd71929a0 0x558bd71a3de0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:10.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:10.494+0000 7fb2c286d740 1 -- 172.21.15.7:0/2796600461 >> 172.21.15.7:0/2796600461 conn(0x558bd718e010 msgr2=0x558bd718c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:10.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:10.494+0000 7fb2a17fa640 0 client.25508 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:21:10.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:10.494+0000 7fb2c286d740 1 -- 172.21.15.7:0/2796600461 shutdown_connections 2024-09-19T04:21:10.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:10.494+0000 7fb2c286d740 1 -- 172.21.15.7:0/2796600461 wait complete. 2024-09-19T04:21:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:10.494+0000 7fb2c286d740 20 client.25508 trim_cache size 0 max 16384 2024-09-19T04:21:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:21:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:21:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:21:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:21:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:10.495+0000 7fb2bfad0640 1 -- 172.21.15.7:0/370656741 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb2a40a33d0 msgr2=0x7fb2a40a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:10.495+0000 7fb2bfad0640 1 --2- 172.21.15.7:0/370656741 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb2a40a33d0 0x7fb2a40a5890 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000e560 tx=0x7fb2b000a7e0 comp rx=0 tx=0).stop 2024-09-19T04:21:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:10.495+0000 7fb2bfad0640 1 -- 172.21.15.7:0/370656741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2b80736b0 msgr2=0x7fb2b81c0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:10.495+0000 7fb2bfad0640 1 --2- 172.21.15.7:0/370656741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2b80736b0 0x7fb2b81c0e40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb2b400b4a0 tx=0x7fb2b400b960 comp rx=0 tx=0).stop 2024-09-19T04:21:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:10.495+0000 7fb2bfad0640 1 -- 172.21.15.7:0/370656741 shutdown_connections 2024-09-19T04:21:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:10.495+0000 7fb2bfad0640 1 --2- 172.21.15.7:0/370656741 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb2a40a33d0 0x7fb2a40a5890 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:10.495+0000 7fb2bfad0640 1 --2- 172.21.15.7:0/370656741 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2b8109700 0x7fb2b81c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:10.495+0000 7fb2bfad0640 1 --2- 172.21.15.7:0/370656741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2b80736b0 0x7fb2b81c0e40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:10.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:10.495+0000 7fb2bfad0640 1 --2- 172.21.15.7:0/370656741 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2b8072d10 0x7fb2b81c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:10.495+0000 7fb2bfad0640 1 -- 172.21.15.7:0/370656741 >> 172.21.15.7:0/370656741 conn(0x7fb2b806ecd0 msgr2=0x7fb2b81160f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:10.495+0000 7fb2bfad0640 1 -- 172.21.15.7:0/370656741 shutdown_connections 2024-09-19T04:21:10.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:10.495+0000 7fb2bfad0640 1 -- 172.21.15.7:0/370656741 wait complete. 2024-09-19T04:21:10.755 INFO:tasks.quiescer.fs.[cephfs]:Total duration (59.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T04:21:10.755 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.8 2024-09-19T04:21:10.756 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:21:11.112 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:11 smithi007 ceph-mon[31360]: pgmap v482: 129 pgs: 129 active+clean; 302 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.6 MiB/s wr, 609 op/s 2024-09-19T04:21:11.381 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:21:11.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:11 smithi102 ceph-mon[35446]: pgmap v482: 129 pgs: 129 active+clean; 302 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.6 MiB/s wr, 609 op/s 2024-09-19T04:21:11.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:11 smithi092 ceph-mon[34940]: pgmap v482: 129 pgs: 129 active+clean; 302 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.6 MiB/s wr, 609 op/s 2024-09-19T04:21:11.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.981+0000 7fd975682640 1 -- 172.21.15.7:0/3135235964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd96809d7a0 msgr2=0x7fd96809db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:11.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.981+0000 7fd975682640 1 --2- 172.21.15.7:0/3135235964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd96809d7a0 0x7fd96809db80 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd964009930 tx=0x7fd96402a420 comp rx=0 tx=0).stop 2024-09-19T04:21:11.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.982+0000 7fd975682640 1 -- 172.21.15.7:0/3135235964 shutdown_connections 2024-09-19T04:21:11.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.982+0000 7fd975682640 1 --2- 172.21.15.7:0/3135235964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd968098140 0x7fd9680a4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:11.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.982+0000 7fd975682640 1 --2- 172.21.15.7:0/3135235964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9680977a0 0x7fd968097c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:11.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.982+0000 7fd975682640 1 --2- 172.21.15.7:0/3135235964 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd96809d7a0 0x7fd96809db80 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:11.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.982+0000 7fd975682640 1 -- 172.21.15.7:0/3135235964 >> 172.21.15.7:0/3135235964 conn(0x7fd968093440 msgr2=0x7fd968095860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:11.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.982+0000 7fd975682640 1 -- 172.21.15.7:0/3135235964 shutdown_connections 2024-09-19T04:21:11.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.982+0000 7fd975682640 1 -- 172.21.15.7:0/3135235964 wait complete. 2024-09-19T04:21:11.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.983+0000 7fd975682640 1 Processor -- start 2024-09-19T04:21:11.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.983+0000 7fd975682640 1 -- start start 2024-09-19T04:21:11.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.983+0000 7fd975682640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9680977a0 0x7fd9680a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:11.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.983+0000 7fd975682640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd968098140 0x7fd9680a1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:11.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.984+0000 7fd975682640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd96809d7a0 0x7fd9680a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:11.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.984+0000 7fd975682640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd9680a7bf0 con 0x7fd9680977a0 2024-09-19T04:21:11.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.984+0000 7fd975682640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd9680a7a70 con 0x7fd96809d7a0 2024-09-19T04:21:11.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.984+0000 7fd975682640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd9680a7d70 con 0x7fd968098140 2024-09-19T04:21:11.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.984+0000 7fd96ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9680977a0 0x7fd9680a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:11.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.984+0000 7fd96ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9680977a0 0x7fd9680a4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58776/0 (socket says 172.21.15.7:58776) 2024-09-19T04:21:11.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.984+0000 7fd96ffff640 1 -- 172.21.15.7:0/3106202685 learned_addr learned my addr 172.21.15.7:0/3106202685 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:11.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.984+0000 7fd96f7fe640 1 --2- 172.21.15.7:0/3106202685 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd968098140 0x7fd9680a1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:11.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.984+0000 7fd974e81640 1 --2- 172.21.15.7:0/3106202685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd96809d7a0 0x7fd9680a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:11.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.984+0000 7fd96ffff640 1 -- 172.21.15.7:0/3106202685 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd968098140 msgr2=0x7fd9680a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:11.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.984+0000 7fd96ffff640 1 --2- 172.21.15.7:0/3106202685 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd968098140 0x7fd9680a1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:11.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.984+0000 7fd96ffff640 1 -- 172.21.15.7:0/3106202685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd96809d7a0 msgr2=0x7fd9680a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:11.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.984+0000 7fd96ffff640 1 --2- 172.21.15.7:0/3106202685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd96809d7a0 0x7fd9680a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:11.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.985+0000 7fd96ffff640 1 -- 172.21.15.7:0/3106202685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9680a2070 con 0x7fd9680977a0 2024-09-19T04:21:11.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.985+0000 7fd96ffff640 1 --2- 172.21.15.7:0/3106202685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9680977a0 0x7fd9680a4350 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd96402a940 tx=0x7fd964030650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:11.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.985+0000 7fd96d7fa640 1 -- 172.21.15.7:0/3106202685 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96403f070 con 0x7fd9680977a0 2024-09-19T04:21:11.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.986+0000 7fd96d7fa640 1 -- 172.21.15.7:0/3106202685 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd964004460 con 0x7fd9680977a0 2024-09-19T04:21:11.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.986+0000 7fd96d7fa640 1 -- 172.21.15.7:0/3106202685 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd964035030 con 0x7fd9680977a0 2024-09-19T04:21:11.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.986+0000 7fd975682640 1 -- 172.21.15.7:0/3106202685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9681340b0 con 0x7fd9680977a0 2024-09-19T04:21:11.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.986+0000 7fd975682640 1 -- 172.21.15.7:0/3106202685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd968134540 con 0x7fd9680977a0 2024-09-19T04:21:11.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.987+0000 7fd975682640 1 -- 172.21.15.7:0/3106202685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9680a2240 con 0x7fd9680977a0 2024-09-19T04:21:11.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.990+0000 7fd96d7fa640 1 -- 172.21.15.7:0/3106202685 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fd964042070 con 0x7fd9680977a0 2024-09-19T04:21:11.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.991+0000 7fd96d7fa640 1 --2- 172.21.15.7:0/3106202685 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd9600a33a0 0x7fd9600a5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:11.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.991+0000 7fd96f7fe640 1 --2- 172.21.15.7:0/3106202685 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd9600a33a0 0x7fd9600a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:11.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.991+0000 7fd96d7fa640 1 -- 172.21.15.7:0/3106202685 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fd9640f0280 con 0x7fd9680977a0 2024-09-19T04:21:11.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.992+0000 7fd96f7fe640 1 --2- 172.21.15.7:0/3106202685 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd9600a33a0 0x7fd9600a5860 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd9680a2bc0 tx=0x7fd95c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:11.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:11.997+0000 7fd96d7fa640 1 -- 172.21.15.7:0/3106202685 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd964049070 con 0x7fd9680977a0 2024-09-19T04:21:12.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:12.273+0000 7fd975682640 1 -- 172.21.15.7:0/3106202685 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd968098ee0 con 0x7fd9680977a0 2024-09-19T04:21:12.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:12.274+0000 7fd96d7fa640 1 -- 172.21.15.7:0/3106202685 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11969 (secure 0 0 0) 0x7fd9640bcb90 con 0x7fd9680977a0 2024-09-19T04:21:12.276 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:21:12.276 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":32,"btime":"2024-09-19T04:19:33:910404+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:19:32.925740+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24496,"mds_2":24482,"mds_3":24478,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24472,24478,24482,24496,24506]},"id":1}]} 2024-09-19T04:21:12.276 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 32 2024-09-19T04:21:12.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:12.276+0000 7fd975682640 1 -- 172.21.15.7:0/3106202685 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd9600a33a0 msgr2=0x7fd9600a5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:12.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:12.276+0000 7fd975682640 1 --2- 172.21.15.7:0/3106202685 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd9600a33a0 0x7fd9600a5860 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd9680a2bc0 tx=0x7fd95c005f90 comp rx=0 tx=0).stop 2024-09-19T04:21:12.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:12.276+0000 7fd975682640 1 -- 172.21.15.7:0/3106202685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9680977a0 msgr2=0x7fd9680a4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:12.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:12.276+0000 7fd975682640 1 --2- 172.21.15.7:0/3106202685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9680977a0 0x7fd9680a4350 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd96402a940 tx=0x7fd964030650 comp rx=0 tx=0).stop 2024-09-19T04:21:12.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:12.276+0000 7fd975682640 1 -- 172.21.15.7:0/3106202685 shutdown_connections 2024-09-19T04:21:12.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:12.276+0000 7fd975682640 1 --2- 172.21.15.7:0/3106202685 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd9600a33a0 0x7fd9600a5860 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:12.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:12.276+0000 7fd975682640 1 --2- 172.21.15.7:0/3106202685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd96809d7a0 0x7fd9680a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:12.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:12.276+0000 7fd975682640 1 --2- 172.21.15.7:0/3106202685 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd968098140 0x7fd9680a1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:12.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:12.276+0000 7fd975682640 1 --2- 172.21.15.7:0/3106202685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9680977a0 0x7fd9680a4350 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:12.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:12.276+0000 7fd975682640 1 -- 172.21.15.7:0/3106202685 >> 172.21.15.7:0/3106202685 conn(0x7fd968093440 msgr2=0x7fd968094910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:12.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:12.276+0000 7fd975682640 1 -- 172.21.15.7:0/3106202685 shutdown_connections 2024-09-19T04:21:12.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:12.277+0000 7fd975682640 1 -- 172.21.15.7:0/3106202685 wait complete. 2024-09-19T04:21:13.053 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24506 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0' 2024-09-19T04:21:13.054 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24506 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0 2024-09-19T04:21:13.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:13 smithi007 ceph-mon[31360]: pgmap v483: 129 pgs: 129 active+clean; 317 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.2 MiB/s wr, 914 op/s 2024-09-19T04:21:13.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:13 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3106202685' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:21:13.390 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:21:13.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:13 smithi102 ceph-mon[35446]: pgmap v483: 129 pgs: 129 active+clean; 317 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.2 MiB/s wr, 914 op/s 2024-09-19T04:21:13.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:13 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3106202685' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:21:13.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:13 smithi092 ceph-mon[34940]: pgmap v483: 129 pgs: 129 active+clean; 317 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.2 MiB/s wr, 914 op/s 2024-09-19T04:21:13.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:13 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3106202685' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:21:15.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.569+0000 7f5ae27af640 1 -- 172.21.15.7:0/84465432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5adc10d9b0 msgr2=0x7f5adc115510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:15.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.571+0000 7f5ae27af640 1 --2- 172.21.15.7:0/84465432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5adc10d9b0 0x7f5adc115510 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4009cd0 tx=0x7f5ad402a930 comp rx=0 tx=0).stop 2024-09-19T04:21:15.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.575+0000 7f5ae27af640 1 -- 172.21.15.7:0/84465432 shutdown_connections 2024-09-19T04:21:15.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.575+0000 7f5ae27af640 1 --2- 172.21.15.7:0/84465432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5adc10d9b0 0x7f5adc115510 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:15.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.575+0000 7f5ae27af640 1 --2- 172.21.15.7:0/84465432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5adc10ef30 0x7f5adc10d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:15.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.575+0000 7f5ae27af640 1 --2- 172.21.15.7:0/84465432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5adc10e580 0x7f5adc10e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:15.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.575+0000 7f5ae27af640 1 -- 172.21.15.7:0/84465432 >> 172.21.15.7:0/84465432 conn(0x7f5adc06e140 msgr2=0x7f5adc06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:15.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.583+0000 7f5ae27af640 1 -- 172.21.15.7:0/84465432 shutdown_connections 2024-09-19T04:21:15.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.583+0000 7f5ae27af640 1 -- 172.21.15.7:0/84465432 wait complete. 2024-09-19T04:21:15.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.584+0000 7f5ae27af640 1 Processor -- start 2024-09-19T04:21:15.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.584+0000 7f5ae27af640 1 -- start start 2024-09-19T04:21:15.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.585+0000 7f5ae27af640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5adc10d9b0 0x7f5adc19ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:15.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.586+0000 7f5ae27af640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5adc10e580 0x7f5adc19f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:15.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.586+0000 7f5adbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5adc10d9b0 0x7f5adc19ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:15.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.586+0000 7f5adbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5adc10d9b0 0x7f5adc19ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:51186/0 (socket says 172.21.15.7:51186) 2024-09-19T04:21:15.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.586+0000 7f5adbfff640 1 -- 172.21.15.7:0/147232134 learned_addr learned my addr 172.21.15.7:0/147232134 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:15.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.586+0000 7f5ae27af640 1 --2- 172.21.15.7:0/147232134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5adc10ef30 0x7f5adc1a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:15.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.586+0000 7f5adb7fe640 1 --2- 172.21.15.7:0/147232134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5adc10e580 0x7f5adc19f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:15.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.587+0000 7f5ae0d4c640 1 --2- 172.21.15.7:0/147232134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5adc10ef30 0x7f5adc1a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:15.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.587+0000 7f5ae27af640 1 -- 172.21.15.7:0/147232134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5adc118b10 con 0x7f5adc10e580 2024-09-19T04:21:15.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.587+0000 7f5ae27af640 1 -- 172.21.15.7:0/147232134 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5adc118990 con 0x7f5adc10ef30 2024-09-19T04:21:15.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.587+0000 7f5ae27af640 1 -- 172.21.15.7:0/147232134 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5adc118c90 con 0x7f5adc10d9b0 2024-09-19T04:21:15.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.587+0000 7f5adbfff640 1 -- 172.21.15.7:0/147232134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5adc10ef30 msgr2=0x7f5adc1a3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:15.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.587+0000 7f5adbfff640 1 --2- 172.21.15.7:0/147232134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5adc10ef30 0x7f5adc1a3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:15.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.587+0000 7f5adbfff640 1 -- 172.21.15.7:0/147232134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5adc10e580 msgr2=0x7f5adc19f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:15.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.587+0000 7f5adbfff640 1 --2- 172.21.15.7:0/147232134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5adc10e580 0x7f5adc19f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:15.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.587+0000 7f5adbfff640 1 -- 172.21.15.7:0/147232134 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5adc06f200 con 0x7f5adc10d9b0 2024-09-19T04:21:15.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.588+0000 7f5adbfff640 1 --2- 172.21.15.7:0/147232134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5adc10d9b0 0x7f5adc19ef30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000b440 tx=0x7f5ad000b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:15.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.589+0000 7f5ad97fa640 1 -- 172.21.15.7:0/147232134 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0017070 con 0x7f5adc10d9b0 2024-09-19T04:21:15.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.589+0000 7f5ae27af640 1 -- 172.21.15.7:0/147232134 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5adc1a3da0 con 0x7f5adc10d9b0 2024-09-19T04:21:15.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.589+0000 7f5ae27af640 1 -- 172.21.15.7:0/147232134 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5adc1a4270 con 0x7f5adc10d9b0 2024-09-19T04:21:15.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.589+0000 7f5ad97fa640 1 -- 172.21.15.7:0/147232134 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ad0007ce0 con 0x7f5adc10d9b0 2024-09-19T04:21:15.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.590+0000 7f5ad97fa640 1 -- 172.21.15.7:0/147232134 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0012d80 con 0x7f5adc10d9b0 2024-09-19T04:21:15.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.602+0000 7f5ad97fa640 1 -- 172.21.15.7:0/147232134 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f5ad001a070 con 0x7f5adc10d9b0 2024-09-19T04:21:15.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.604+0000 7f5ae4b88740 1 Processor -- start 2024-09-19T04:21:15.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.605+0000 7f5ad97fa640 1 --2- 172.21.15.7:0/147232134 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f5ac40a3300 0x7f5ac40a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:15.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.606+0000 7f5ad97fa640 1 -- 172.21.15.7:0/147232134 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f5ad00d3e30 con 0x7f5adc10d9b0 2024-09-19T04:21:15.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.606+0000 7f5ae4b88740 1 -- start start 2024-09-19T04:21:15.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.606+0000 7f5ae4b88740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cddb35f70 0x555cddb36350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:15.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.606+0000 7f5ae4b88740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cddb36890 0x555cddb40c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:15.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.607+0000 7f5ae4b88740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cddb41150 0x555cddb43540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:15.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.607+0000 7f5ae4b88740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555cdda932a0 con 0x555cddb35f70 2024-09-19T04:21:15.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.607+0000 7f5ae4b88740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555cdda3ab10 con 0x555cddb41150 2024-09-19T04:21:15.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.607+0000 7f5ae4b88740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555cdda8f260 con 0x555cddb36890 2024-09-19T04:21:15.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.607+0000 7f5adb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cddb36890 0x555cddb40c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:15.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.607+0000 7f5adb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cddb36890 0x555cddb40c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:51196/0 (socket says 172.21.15.7:51196) 2024-09-19T04:21:15.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.607+0000 7f5adb7fe640 1 -- 172.21.15.7:0/2013542224 learned_addr learned my addr 172.21.15.7:0/2013542224 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:15.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.608+0000 7f5adbfff640 1 --2- 172.21.15.7:0/2013542224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cddb35f70 0x555cddb36350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:15.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.609+0000 7f5ae0d4c640 1 --2- 172.21.15.7:0/2013542224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cddb41150 0x555cddb43540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:15.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.609+0000 7f5ae0d4c640 1 --2- 172.21.15.7:0/147232134 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f5ac40a3300 0x7f5ac40a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:15.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.609+0000 7f5adb7fe640 1 -- 172.21.15.7:0/2013542224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cddb41150 msgr2=0x555cddb43540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:15.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.609+0000 7f5adb7fe640 1 --2- 172.21.15.7:0/2013542224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cddb41150 0x555cddb43540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:15.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.609+0000 7f5adb7fe640 1 -- 172.21.15.7:0/2013542224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cddb35f70 msgr2=0x555cddb36350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:15.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.609+0000 7f5adb7fe640 1 --2- 172.21.15.7:0/2013542224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cddb35f70 0x555cddb36350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:15.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.609+0000 7f5adb7fe640 1 -- 172.21.15.7:0/2013542224 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cdd804b90 con 0x555cddb36890 2024-09-19T04:21:15.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.613+0000 7f5adb7fe640 1 --2- 172.21.15.7:0/2013542224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cddb36890 0x555cddb40c10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5acc006a70 tx=0x7f5acc00d260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49e861704709ccc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:15.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.614+0000 7f5ae0d4c640 1 --2- 172.21.15.7:0/147232134 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f5ac40a3300 0x7f5ac40a57c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x555cddb33880 tx=0x7f5ad403f040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:15.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.620+0000 7f5ac27fc640 1 -- 172.21.15.7:0/2013542224 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc015070 con 0x555cddb36890 2024-09-19T04:21:15.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.620+0000 7f5ac27fc640 1 -- 172.21.15.7:0/2013542224 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5acc00dc30 con 0x555cddb36890 2024-09-19T04:21:15.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.621+0000 7f5ae4b88740 1 -- 172.21.15.7:0/2013542224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cddb36890 msgr2=0x555cddb40c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:15.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.621+0000 7f5ae4b88740 1 --2- 172.21.15.7:0/2013542224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cddb36890 0x555cddb40c10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5acc006a70 tx=0x7f5acc00d260 comp rx=0 tx=0).stop 2024-09-19T04:21:15.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.627+0000 7f5ae4b88740 1 -- 172.21.15.7:0/2013542224 shutdown_connections 2024-09-19T04:21:15.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.627+0000 7f5ae4b88740 1 --2- 172.21.15.7:0/2013542224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cddb41150 0x555cddb43540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:15.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.627+0000 7f5ae4b88740 1 --2- 172.21.15.7:0/2013542224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cddb36890 0x555cddb40c10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:15.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.627+0000 7f5ae4b88740 1 --2- 172.21.15.7:0/2013542224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cddb35f70 0x555cddb36350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:15.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.627+0000 7f5ae4b88740 1 -- 172.21.15.7:0/2013542224 >> 172.21.15.7:0/2013542224 conn(0x555cddb32500 msgr2=0x555cddb328e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:15.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.627+0000 7f5ae4b88740 1 -- 172.21.15.7:0/2013542224 shutdown_connections 2024-09-19T04:21:15.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.628+0000 7f5ae4b88740 1 -- 172.21.15.7:0/2013542224 wait complete. 2024-09-19T04:21:15.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.629+0000 7f5ae4b88740 1 -- start start 2024-09-19T04:21:15.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.629+0000 7f5ae4b88740 1 Processor -- start 2024-09-19T04:21:15.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.635+0000 7f5ae4b88740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cddb35f70 0x555cddb2f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:15.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.635+0000 7f5ae4b88740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cddb36890 0x555cddb2f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:15.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.635+0000 7f5ae4b88740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cddb41150 0x555cddb3fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:15.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.635+0000 7f5ae4b88740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555cddb299b0 con 0x555cddb36890 2024-09-19T04:21:15.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.635+0000 7f5ae4b88740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555cdda1b6e0 con 0x555cddb35f70 2024-09-19T04:21:15.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.635+0000 7f5ae4b88740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555cddb29b30 con 0x555cddb41150 2024-09-19T04:21:15.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.635+0000 7f5ae4b88740 10 client.0 _ll_register_callbacks cb 0x555cdda3fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:21:15.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.636+0000 7f5adbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cddb35f70 0x555cddb2f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:15.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.636+0000 7f5adbfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cddb35f70 0x555cddb2f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:60522/0 (socket says 172.21.15.7:60522) 2024-09-19T04:21:15.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.636+0000 7f5adbfff640 1 -- 172.21.15.7:0/827193165 learned_addr learned my addr 172.21.15.7:0/827193165 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:15.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.636+0000 7f5ae0d4c640 1 --2- 172.21.15.7:0/827193165 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cddb41150 0x555cddb3fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:15.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.636+0000 7f5adb7fe640 1 --2- 172.21.15.7:0/827193165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cddb36890 0x555cddb2f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:15.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.637+0000 7f5adb7fe640 1 -- 172.21.15.7:0/827193165 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cddb41150 msgr2=0x555cddb3fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:15.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.637+0000 7f5adb7fe640 1 --2- 172.21.15.7:0/827193165 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cddb41150 0x555cddb3fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:15.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.637+0000 7f5adb7fe640 1 -- 172.21.15.7:0/827193165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cddb35f70 msgr2=0x555cddb2f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:15.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.637+0000 7f5adb7fe640 1 --2- 172.21.15.7:0/827193165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cddb35f70 0x555cddb2f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:15.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.637+0000 7f5adb7fe640 1 -- 172.21.15.7:0/827193165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cddb40140 con 0x555cddb36890 2024-09-19T04:21:15.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.638+0000 7f5adb7fe640 1 --2- 172.21.15.7:0/827193165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cddb36890 0x555cddb2f750 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5acc006a70 tx=0x7f5acc012f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6924121559afad29 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:15.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.638+0000 7f5abb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:21:15.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.639+0000 7f5abb7fe640 1 -- 172.21.15.7:0/827193165 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc015040 con 0x555cddb36890 2024-09-19T04:21:15.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.639+0000 7f5ae4b88740 1 -- 172.21.15.7:0/827193165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5acc00dc30 con 0x555cddb36890 2024-09-19T04:21:15.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.639+0000 7f5abb7fe640 1 -- 172.21.15.7:0/827193165 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f5acc011460 con 0x555cddb36890 2024-09-19T04:21:15.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.641+0000 7f5abb7fe640 1 -- 172.21.15.7:0/827193165 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5acc02f050 con 0x555cddb36890 2024-09-19T04:21:15.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.642+0000 7f5ae4b88740 10 client.15918 fetch_fsmap learned FSMap version 32 2024-09-19T04:21:15.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.642+0000 7f5ae4b88740 1 -- 172.21.15.7:0/827193165 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x555cddb58300 con 0x555cddb36890 2024-09-19T04:21:15.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.643+0000 7f5abb7fe640 1 -- 172.21.15.7:0/827193165 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5acc00dc30 con 0x555cddb36890 2024-09-19T04:21:15.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.643+0000 7f5abb7fe640 1 -- 172.21.15.7:0/827193165 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f5acc026940 con 0x555cddb36890 2024-09-19T04:21:15.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.644+0000 7f5ae4b88740 10 client.15918 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T04:21:15.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.644+0000 7f5ae4b88740 10 client.15918 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:21:15.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.644+0000 7f5ae4b88740 20 client.15918 populate_metadata read hostname 'smithi007' 2024-09-19T04:21:15.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.644+0000 7f5ae4b88740 1 --2- 172.21.15.7:0/827193165 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x555cddb59710 0x555cddb5bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:15.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.644+0000 7f5ae4b88740 4 client.15918 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:21:15.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.644+0000 7f5ae4b88740 1 -- 172.21.15.7:0/827193165 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cddaa09d0 con 0x555cddb59710 2024-09-19T04:21:15.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.649+0000 7f5adbfff640 1 --2- 172.21.15.7:0/827193165 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x555cddb59710 0x555cddb5bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:15.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.652+0000 7f5adbfff640 1 --2- 172.21.15.7:0/827193165 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x555cddb59710 0x555cddb5bb00 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3341e34e885d9811 server_cookie=b932d037893f61b3 in_seq=0 out_seq=0 2024-09-19T04:21:15.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.654+0000 7f5abb7fe640 10 client.15918 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:21:15.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.658+0000 7f5abb7fe640 1 -- 172.21.15.7:0/827193165 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555cddaa09d0 con 0x555cddb59710 2024-09-19T04:21:15.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.658+0000 7f5abb7fe640 10 client.15918 handle_command_reply: tid=0 2024-09-19T04:21:15.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.658+0000 7f5ae4b88740 1 client.15918 shutdown 2024-09-19T04:21:15.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.663+0000 7f5ae4b88740 1 -- 172.21.15.7:0/827193165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cddb36890 msgr2=0x555cddb2f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:15.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.663+0000 7f5ae4b88740 1 --2- 172.21.15.7:0/827193165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cddb36890 0x555cddb2f750 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5acc006a70 tx=0x7f5acc012f60 comp rx=0 tx=0).stop 2024-09-19T04:21:15.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.666+0000 7f5ae4b88740 1 -- 172.21.15.7:0/827193165 shutdown_connections 2024-09-19T04:21:15.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.666+0000 7f5ae4b88740 1 --2- 172.21.15.7:0/827193165 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x555cddb59710 0x555cddb5bb00 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:15.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.666+0000 7f5ae4b88740 1 --2- 172.21.15.7:0/827193165 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cddb41150 0x555cddb3fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:15.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.666+0000 7f5ae4b88740 1 --2- 172.21.15.7:0/827193165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cddb36890 0x555cddb2f750 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:15.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.666+0000 7f5ae4b88740 1 --2- 172.21.15.7:0/827193165 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cddb35f70 0x555cddb2f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:15.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.666+0000 7f5ae4b88740 1 -- 172.21.15.7:0/827193165 >> 172.21.15.7:0/827193165 conn(0x555cddb32500 msgr2=0x555cddb28e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:15.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.668+0000 7f5abb7fe640 0 client.15918 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:21:15.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.674+0000 7f5ae4b88740 1 -- 172.21.15.7:0/827193165 shutdown_connections 2024-09-19T04:21:15.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.674+0000 7f5ae4b88740 1 -- 172.21.15.7:0/827193165 wait complete. 2024-09-19T04:21:15.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.674+0000 7f5ae4b88740 20 client.15918 trim_cache size 0 max 16384 2024-09-19T04:21:15.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.715+0000 7f5ae4b88740 1 Processor -- start 2024-09-19T04:21:15.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.715+0000 7f5ae4b88740 1 -- start start 2024-09-19T04:21:15.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.715+0000 7f5ae4b88740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cddb35f70 0x555cddb61310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:15.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.715+0000 7f5ae4b88740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cddb36890 0x555cddb3fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:15.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.715+0000 7f5ae4b88740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cddb41150 0x555cddb61850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:15.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.715+0000 7f5adb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cddb36890 0x555cddb3fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:15.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.715+0000 7f5adb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cddb36890 0x555cddb3fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:51212/0 (socket says 172.21.15.7:51212) 2024-09-19T04:21:15.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.715+0000 7f5adb7fe640 1 -- 172.21.15.7:0/1482919752 learned_addr learned my addr 172.21.15.7:0/1482919752 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:15.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.715+0000 7f5ae4b88740 1 -- 172.21.15.7:0/1482919752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac800fdd0 con 0x555cddb35f70 2024-09-19T04:21:15.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.715+0000 7f5ae4b88740 1 -- 172.21.15.7:0/1482919752 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac80119d0 con 0x555cddb41150 2024-09-19T04:21:15.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.715+0000 7f5ae4b88740 1 -- 172.21.15.7:0/1482919752 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac80104a0 con 0x555cddb36890 2024-09-19T04:21:15.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.716+0000 7f5ae0d4c640 1 --2- 172.21.15.7:0/1482919752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cddb41150 0x555cddb61850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:15.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.716+0000 7f5adb7fe640 1 -- 172.21.15.7:0/1482919752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cddb41150 msgr2=0x555cddb61850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:15.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.716+0000 7f5adb7fe640 1 --2- 172.21.15.7:0/1482919752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cddb41150 0x555cddb61850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:15.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.716+0000 7f5adb7fe640 1 -- 172.21.15.7:0/1482919752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cddb35f70 msgr2=0x555cddb61310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:15.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.716+0000 7f5adb7fe640 1 --2- 172.21.15.7:0/1482919752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cddb35f70 0x555cddb61310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:15.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.716+0000 7f5adb7fe640 1 -- 172.21.15.7:0/1482919752 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cddb366c0 con 0x555cddb36890 2024-09-19T04:21:15.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.717+0000 7f5adb7fe640 1 --2- 172.21.15.7:0/1482919752 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cddb36890 0x555cddb3fbf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00e010 tx=0x7f5acc010760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b128aab2851d7202 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:15.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.721+0000 7f5ac1ffb640 1 -- 172.21.15.7:0/1482919752 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc00b1e0 con 0x555cddb36890 2024-09-19T04:21:15.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.721+0000 7f5ac1ffb640 1 -- 172.21.15.7:0/1482919752 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5acc005e50 con 0x555cddb36890 2024-09-19T04:21:15.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.721+0000 7f5ac1ffb640 1 -- 172.21.15.7:0/1482919752 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc004310 con 0x555cddb36890 2024-09-19T04:21:15.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.722+0000 7f5ae4b88740 1 -- 172.21.15.7:0/1482919752 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cddb36890 msgr2=0x555cddb3fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:15.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.722+0000 7f5ae4b88740 1 --2- 172.21.15.7:0/1482919752 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cddb36890 0x555cddb3fbf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00e010 tx=0x7f5acc010760 comp rx=0 tx=0).stop 2024-09-19T04:21:15.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.725+0000 7f5ae4b88740 1 -- 172.21.15.7:0/1482919752 shutdown_connections 2024-09-19T04:21:15.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.725+0000 7f5ae4b88740 1 --2- 172.21.15.7:0/1482919752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cddb41150 0x555cddb61850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:15.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.725+0000 7f5ae4b88740 1 --2- 172.21.15.7:0/1482919752 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cddb36890 0x555cddb3fbf0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:15.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.725+0000 7f5ae4b88740 1 --2- 172.21.15.7:0/1482919752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cddb35f70 0x555cddb61310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:15.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.725+0000 7f5ae4b88740 1 -- 172.21.15.7:0/1482919752 >> 172.21.15.7:0/1482919752 conn(0x555cddb32500 msgr2=0x555cddb30a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:15.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.725+0000 7f5ae4b88740 1 -- 172.21.15.7:0/1482919752 shutdown_connections 2024-09-19T04:21:15.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.725+0000 7f5ae4b88740 1 -- 172.21.15.7:0/1482919752 wait complete. 2024-09-19T04:21:15.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.726+0000 7f5ae4b88740 1 -- start start 2024-09-19T04:21:15.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.726+0000 7f5ae4b88740 1 Processor -- start 2024-09-19T04:21:15.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.727+0000 7f5ae4b88740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cddb35f70 0x555cddb3a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:15.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.728+0000 7f5ae4b88740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cddb36890 0x555cddb3a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:15.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.728+0000 7f5ae4b88740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cddb41150 0x555cddb3abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:15.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.728+0000 7f5adb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cddb36890 0x555cddb3a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:15.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.728+0000 7f5adb7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cddb36890 0x555cddb3a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:60538/0 (socket says 172.21.15.7:60538) 2024-09-19T04:21:15.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.728+0000 7f5adb7fe640 1 -- 172.21.15.7:0/3624265696 learned_addr learned my addr 172.21.15.7:0/3624265696 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:15.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.728+0000 7f5ae0d4c640 1 --2- 172.21.15.7:0/3624265696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cddb41150 0x555cddb3abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:15.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.728+0000 7f5ae4b88740 1 -- 172.21.15.7:0/3624265696 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac8011240 con 0x555cddb35f70 2024-09-19T04:21:15.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.728+0000 7f5ae4b88740 1 -- 172.21.15.7:0/3624265696 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac8010b70 con 0x555cddb36890 2024-09-19T04:21:15.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.728+0000 7f5ae4b88740 1 -- 172.21.15.7:0/3624265696 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac800dd90 con 0x555cddb41150 2024-09-19T04:21:15.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.729+0000 7f5adb7fe640 1 -- 172.21.15.7:0/3624265696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cddb41150 msgr2=0x555cddb3abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:15.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.729+0000 7f5adb7fe640 1 --2- 172.21.15.7:0/3624265696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cddb41150 0x555cddb3abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:15.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.729+0000 7f5adb7fe640 1 -- 172.21.15.7:0/3624265696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cddb35f70 msgr2=0x555cddb3a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:15.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.729+0000 7f5adb7fe640 1 --2- 172.21.15.7:0/3624265696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cddb35f70 0x555cddb3a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:15.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.729+0000 7f5adb7fe640 1 -- 172.21.15.7:0/3624265696 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cddbc4390 con 0x555cddb36890 2024-09-19T04:21:15.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.730+0000 7f5adb7fe640 1 --2- 172.21.15.7:0/3624265696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cddb36890 0x555cddb3a680 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00ba60 tx=0x7f5acc00dcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6636299f42f6160c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:15.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.730+0000 7f5abb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T04:21:15.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.730+0000 7f5abb7fe640 1 -- 172.21.15.7:0/3624265696 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5acc02c040 con 0x555cddb36890 2024-09-19T04:21:15.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.730+0000 7f5ae4b88740 10 client.0 _ll_register_callbacks cb 0x7f5acc010c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:21:15.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.730+0000 7f5abb7fe640 1 -- 172.21.15.7:0/3624265696 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f5acc004450 con 0x555cddb36890 2024-09-19T04:21:15.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.730+0000 7f5ae4b88740 1 -- 172.21.15.7:0/3624265696 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5acc005e50 con 0x555cddb36890 2024-09-19T04:21:15.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.731+0000 7f5abb7fe640 1 -- 172.21.15.7:0/3624265696 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5acc045050 con 0x555cddb36890 2024-09-19T04:21:15.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.733+0000 7f5ae4b88740 10 client.25529 fetch_fsmap learned FSMap version 32 2024-09-19T04:21:15.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.733+0000 7f5ae4b88740 1 -- 172.21.15.7:0/3624265696 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({fsmap=32}) -- 0x555cddbc5420 con 0x555cddb36890 2024-09-19T04:21:15.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.735+0000 7f5abb7fe640 1 -- 172.21.15.7:0/3624265696 <== mon.2 v2:172.21.15.92:3300/0 4 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7f5acc026450 con 0x555cddb36890 2024-09-19T04:21:15.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.735+0000 7f5ae4b88740 10 client.25529 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T04:21:15.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.735+0000 7f5ae4b88740 10 client.25529 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:21:15.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.735+0000 7f5ae4b88740 20 client.25529 populate_metadata read hostname 'smithi007' 2024-09-19T04:21:15.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.735+0000 7f5ae4b88740 1 --2- 172.21.15.7:0/3624265696 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x555cddbc5ac0 0x555cddbc7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:15.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.735+0000 7f5ae4b88740 4 client.25529 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}] 2024-09-19T04:21:15.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.735+0000 7f5ae4b88740 1 -- 172.21.15.7:0/3624265696 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}) -- 0x555cdda9ad20 con 0x555cddbc5ac0 2024-09-19T04:21:15.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.735+0000 7f5adbfff640 1 --2- 172.21.15.7:0/3624265696 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x555cddbc5ac0 0x555cddbc7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:15.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.736+0000 7f5abb7fe640 10 client.25529 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:21:15.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:14.736+0000 7f5adbfff640 1 --2- 172.21.15.7:0/3624265696 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x555cddbc5ac0 0x555cddbc7ee0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec22904271d37f13 server_cookie=6ab6b44a5713f2be in_seq=0 out_seq=0 2024-09-19T04:21:15.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:15 smithi007 ceph-mon[31360]: pgmap v484: 129 pgs: 129 active+clean; 307 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.0 MiB/s wr, 1.50k op/s 2024-09-19T04:21:15.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:15 smithi102 ceph-mon[35446]: pgmap v484: 129 pgs: 129 active+clean; 307 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.0 MiB/s wr, 1.50k op/s 2024-09-19T04:21:15.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:15 smithi092 ceph-mon[34940]: pgmap v484: 129 pgs: 129 active+clean; 307 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.0 MiB/s wr, 1.50k op/s 2024-09-19T04:21:17.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:17 smithi007 ceph-mon[31360]: pgmap v485: 129 pgs: 129 active+clean; 313 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.0 MiB/s wr, 1.82k op/s 2024-09-19T04:21:17.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:17 smithi102 ceph-mon[35446]: pgmap v485: 129 pgs: 129 active+clean; 313 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.0 MiB/s wr, 1.82k op/s 2024-09-19T04:21:17.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:17 smithi092 ceph-mon[34940]: pgmap v485: 129 pgs: 129 active+clean; 313 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.0 MiB/s wr, 1.82k op/s 2024-09-19T04:21:18.158 INFO:tasks.workunit.client.0.smithi007.stdout: 100 399220 159 290799 265 239534 443 2024-09-19T04:21:19.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:19 smithi007 ceph-mon[31360]: pgmap v486: 129 pgs: 129 active+clean; 313 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.8 MiB/s wr, 1.79k op/s 2024-09-19T04:21:19.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:19 smithi102 ceph-mon[35446]: pgmap v486: 129 pgs: 129 active+clean; 313 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.8 MiB/s wr, 1.79k op/s 2024-09-19T04:21:19.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:19 smithi092 ceph-mon[34940]: pgmap v486: 129 pgs: 129 active+clean; 313 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.8 MiB/s wr, 1.79k op/s 2024-09-19T04:21:21.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:21 smithi007 ceph-mon[31360]: pgmap v487: 129 pgs: 129 active+clean; 316 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.2 MiB/s wr, 1.85k op/s 2024-09-19T04:21:21.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:21 smithi102 ceph-mon[35446]: pgmap v487: 129 pgs: 129 active+clean; 316 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.2 MiB/s wr, 1.85k op/s 2024-09-19T04:21:21.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:21 smithi092 ceph-mon[34940]: pgmap v487: 129 pgs: 129 active+clean; 316 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.2 MiB/s wr, 1.85k op/s 2024-09-19T04:21:23.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:23 smithi007 ceph-mon[31360]: pgmap v488: 129 pgs: 129 active+clean; 316 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 1.42k op/s 2024-09-19T04:21:23.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:23 smithi102 ceph-mon[35446]: pgmap v488: 129 pgs: 129 active+clean; 316 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 1.42k op/s 2024-09-19T04:21:23.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:23 smithi092 ceph-mon[34940]: pgmap v488: 129 pgs: 129 active+clean; 316 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 1.42k op/s 2024-09-19T04:21:23.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.589+0000 7fc4066a5640 1 -- 172.21.15.7:0/1657897876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc400101b70 msgr2=0x7fc400101f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:23.593 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.589+0000 7fc4066a5640 1 --2- 172.21.15.7:0/1657897876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc400101b70 0x7fc400101f70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0009900 tx=0x7fc3f002a410 comp rx=0 tx=0).stop 2024-09-19T04:21:23.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.590+0000 7fc4066a5640 1 -- 172.21.15.7:0/1657897876 shutdown_connections 2024-09-19T04:21:23.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.590+0000 7fc4066a5640 1 --2- 172.21.15.7:0/1657897876 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc400103720 0x7fc400109fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:23.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.590+0000 7fc4066a5640 1 --2- 172.21.15.7:0/1657897876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc400102d60 0x7fc4001031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:23.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.590+0000 7fc4066a5640 1 --2- 172.21.15.7:0/1657897876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc400101b70 0x7fc400101f70 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:23.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.590+0000 7fc4066a5640 1 -- 172.21.15.7:0/1657897876 >> 172.21.15.7:0/1657897876 conn(0x7fc4000fd2f0 msgr2=0x7fc4000ff710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:23.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.590+0000 7fc4066a5640 1 -- 172.21.15.7:0/1657897876 shutdown_connections 2024-09-19T04:21:23.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.590+0000 7fc4066a5640 1 -- 172.21.15.7:0/1657897876 wait complete. 2024-09-19T04:21:23.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.590+0000 7fc4066a5640 1 Processor -- start 2024-09-19T04:21:23.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.590+0000 7fc4066a5640 1 -- start start 2024-09-19T04:21:23.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.590+0000 7fc4066a5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc400101b70 0x7fc400197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.591+0000 7fc4066a5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc400102d60 0x7fc4001983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.591+0000 7fc4066a5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc400103720 0x7fc40019f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.591+0000 7fc4066a5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc40010d7d0 con 0x7fc400101b70 2024-09-19T04:21:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.591+0000 7fc4066a5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc40010d650 con 0x7fc400102d60 2024-09-19T04:21:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.591+0000 7fc4066a5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc40010d950 con 0x7fc400103720 2024-09-19T04:21:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.591+0000 7fc3fffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc400101b70 0x7fc400197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.591+0000 7fc3fffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc400101b70 0x7fc400197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58932/0 (socket says 172.21.15.7:58932) 2024-09-19T04:21:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.591+0000 7fc3ff7fe640 1 --2- 172.21.15.7:0/2540401720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc400102d60 0x7fc4001983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.591+0000 7fc3fffff640 1 -- 172.21.15.7:0/2540401720 learned_addr learned my addr 172.21.15.7:0/2540401720 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.591+0000 7fc404c42640 1 --2- 172.21.15.7:0/2540401720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc400103720 0x7fc40019f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.591+0000 7fc3fffff640 1 -- 172.21.15.7:0/2540401720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc400103720 msgr2=0x7fc40019f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.591+0000 7fc3fffff640 1 --2- 172.21.15.7:0/2540401720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc400103720 0x7fc40019f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.591+0000 7fc3fffff640 1 -- 172.21.15.7:0/2540401720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc400102d60 msgr2=0x7fc4001983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:23.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.591+0000 7fc3fffff640 1 --2- 172.21.15.7:0/2540401720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc400102d60 0x7fc4001983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:23.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.591+0000 7fc3fffff640 1 -- 172.21.15.7:0/2540401720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc40019fad0 con 0x7fc400101b70 2024-09-19T04:21:23.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.591+0000 7fc3ff7fe640 1 --2- 172.21.15.7:0/2540401720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc400102d60 0x7fc4001983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:21:23.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.591+0000 7fc3fffff640 1 --2- 172.21.15.7:0/2540401720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc400101b70 0x7fc400197eb0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0031610 tx=0x7fc3f0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:23.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.591+0000 7fc3fd7fa640 1 -- 172.21.15.7:0/2540401720 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f003f030 con 0x7fc400101b70 2024-09-19T04:21:23.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.591+0000 7fc4066a5640 1 -- 172.21.15.7:0/2540401720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc40019fd60 con 0x7fc400101b70 2024-09-19T04:21:23.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.591+0000 7fc3fd7fa640 1 -- 172.21.15.7:0/2540401720 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3f0003ad0 con 0x7fc400101b70 2024-09-19T04:21:23.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.591+0000 7fc3fd7fa640 1 -- 172.21.15.7:0/2540401720 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f0035070 con 0x7fc400101b70 2024-09-19T04:21:23.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.591+0000 7fc4066a5640 1 -- 172.21.15.7:0/2540401720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4001a01a0 con 0x7fc400101b70 2024-09-19T04:21:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.594+0000 7fc3fd7fa640 1 -- 172.21.15.7:0/2540401720 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fc3f0042030 con 0x7fc400101b70 2024-09-19T04:21:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.594+0000 7fc409443740 1 Processor -- start 2024-09-19T04:21:23.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.595+0000 7fc409443740 1 -- start start 2024-09-19T04:21:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.595+0000 7fc409443740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f31e29db0 0x555f31e2a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.595+0000 7fc409443740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f31e2a6f0 0x555f31e2f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.595+0000 7fc409443740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555f31e2f780 0x555f31e31c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.595+0000 7fc409443740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555f31d892f0 con 0x555f31e2a6f0 2024-09-19T04:21:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.595+0000 7fc409443740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555f31d31270 con 0x555f31e29db0 2024-09-19T04:21:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.595+0000 7fc409443740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555f31d852b0 con 0x555f31e2f780 2024-09-19T04:21:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.595+0000 7fc3fffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f31e2a6f0 0x555f31e2f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.595+0000 7fc404c42640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f31e29db0 0x555f31e2a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.595+0000 7fc404c42640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f31e29db0 0x555f31e2a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:42200/0 (socket says 172.21.15.7:42200) 2024-09-19T04:21:23.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.595+0000 7fc404c42640 1 -- 172.21.15.7:0/2668554529 learned_addr learned my addr 172.21.15.7:0/2668554529 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:23.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.595+0000 7fc3fffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f31e2a6f0 0x555f31e2f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58934/0 (socket says 172.21.15.7:58934) 2024-09-19T04:21:23.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.595+0000 7fc3ff7fe640 1 --2- 172.21.15.7:0/2668554529 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555f31e2f780 0x555f31e31c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:23.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.595+0000 7fc404c42640 1 -- 172.21.15.7:0/2668554529 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555f31e2f780 msgr2=0x555f31e31c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:23.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.595+0000 7fc404c42640 1 --2- 172.21.15.7:0/2668554529 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555f31e2f780 0x555f31e31c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:23.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.595+0000 7fc404c42640 1 -- 172.21.15.7:0/2668554529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f31e2a6f0 msgr2=0x555f31e2f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:23.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.595+0000 7fc404c42640 1 --2- 172.21.15.7:0/2668554529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f31e2a6f0 0x555f31e2f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:23.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.595+0000 7fc404c42640 1 -- 172.21.15.7:0/2668554529 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f31d30340 con 0x555f31e29db0 2024-09-19T04:21:23.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.595+0000 7fc3fffff640 1 --2- 172.21.15.7:0/2668554529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f31e2a6f0 0x555f31e2f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:21:23.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.595+0000 7fc3fd7fa640 1 --2- 172.21.15.7:0/2540401720 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc3e80a3240 0x7fc3e80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.595+0000 7fc404c42640 1 --2- 172.21.15.7:0/2668554529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f31e29db0 0x555f31e2a1b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc3f80039f0 tx=0x7fc3f8003eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=406c2302752d6d41 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.596+0000 7fc3fffff640 1 --2- 172.21.15.7:0/2540401720 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc3e80a3240 0x7fc3e80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.596+0000 7fc3e67fc640 1 -- 172.21.15.7:0/2668554529 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f801a470 con 0x555f31e29db0 2024-09-19T04:21:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.596+0000 7fc3fd7fa640 1 -- 172.21.15.7:0/2540401720 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fc3f00f03a0 con 0x7fc400101b70 2024-09-19T04:21:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.596+0000 7fc3e67fc640 1 -- 172.21.15.7:0/2668554529 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3f8015070 con 0x555f31e29db0 2024-09-19T04:21:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.596+0000 7fc3e67fc640 1 -- 172.21.15.7:0/2668554529 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8010900 con 0x555f31e29db0 2024-09-19T04:21:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.596+0000 7fc409443740 1 -- 172.21.15.7:0/2668554529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f31e29db0 msgr2=0x555f31e2a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.596+0000 7fc3fffff640 1 --2- 172.21.15.7:0/2540401720 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc3e80a3240 0x7fc3e80a5700 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc3f00bc360 tx=0x7fc3f00f3de0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.596+0000 7fc409443740 1 --2- 172.21.15.7:0/2668554529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f31e29db0 0x555f31e2a1b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc3f80039f0 tx=0x7fc3f8003eb0 comp rx=0 tx=0).stop 2024-09-19T04:21:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.596+0000 7fc409443740 1 -- 172.21.15.7:0/2668554529 shutdown_connections 2024-09-19T04:21:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.596+0000 7fc409443740 1 --2- 172.21.15.7:0/2668554529 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555f31e2f780 0x555f31e31c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.596+0000 7fc409443740 1 --2- 172.21.15.7:0/2668554529 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f31e2a6f0 0x555f31e2f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:23.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.596+0000 7fc409443740 1 --2- 172.21.15.7:0/2668554529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f31e29db0 0x555f31e2a1b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.596+0000 7fc409443740 1 -- 172.21.15.7:0/2668554529 >> 172.21.15.7:0/2668554529 conn(0x555f31e21010 msgr2=0x555f31e21410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.596+0000 7fc409443740 1 -- 172.21.15.7:0/2668554529 shutdown_connections 2024-09-19T04:21:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.596+0000 7fc409443740 1 -- 172.21.15.7:0/2668554529 wait complete. 2024-09-19T04:21:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.597+0000 7fc409443740 1 -- start start 2024-09-19T04:21:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.597+0000 7fc409443740 1 Processor -- start 2024-09-19T04:21:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.597+0000 7fc409443740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f31e29db0 0x555f31e34010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.597+0000 7fc409443740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f31e2a6f0 0x555f31e34550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.597+0000 7fc409443740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555f31e2f780 0x555f31e3b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.597+0000 7fc409443740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555f31e32750 con 0x555f31e29db0 2024-09-19T04:21:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.597+0000 7fc409443740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555f31d12290 con 0x555f31e2a6f0 2024-09-19T04:21:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.597+0000 7fc409443740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555f31e328d0 con 0x555f31e2f780 2024-09-19T04:21:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.597+0000 7fc409443740 10 client.0 _ll_register_callbacks cb 0x555f31d43140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:21:23.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.597+0000 7fc404c42640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f31e29db0 0x555f31e34010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.597+0000 7fc404c42640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f31e29db0 0x555f31e34010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58946/0 (socket says 172.21.15.7:58946) 2024-09-19T04:21:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.597+0000 7fc404c42640 1 -- 172.21.15.7:0/3463453625 learned_addr learned my addr 172.21.15.7:0/3463453625 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.597+0000 7fc3ff7fe640 1 --2- 172.21.15.7:0/3463453625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f31e2a6f0 0x555f31e34550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.598+0000 7fc404c42640 1 --2- 172.21.15.7:0/3463453625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555f31e2f780 0x555f31e3b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:23.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.598+0000 7fc404c42640 1 -- 172.21.15.7:0/3463453625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555f31e2f780 msgr2=0x555f31e3b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.598+0000 7fc404c42640 1 --2- 172.21.15.7:0/3463453625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555f31e2f780 0x555f31e3b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.598+0000 7fc404c42640 1 -- 172.21.15.7:0/3463453625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f31e2a6f0 msgr2=0x555f31e34550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.598+0000 7fc404c42640 1 --2- 172.21.15.7:0/3463453625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f31e2a6f0 0x555f31e34550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.598+0000 7fc404c42640 1 -- 172.21.15.7:0/3463453625 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f31a9c210 con 0x555f31e29db0 2024-09-19T04:21:23.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.598+0000 7fc404c42640 1 --2- 172.21.15.7:0/3463453625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f31e29db0 0x555f31e34010 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc3f800a010 tx=0x7fc3f8005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed5cff8b33ca563 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.598+0000 7fc3df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:21:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.598+0000 7fc3df7fe640 1 -- 172.21.15.7:0/3463453625 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f80116c0 con 0x555f31e29db0 2024-09-19T04:21:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.598+0000 7fc3df7fe640 1 -- 172.21.15.7:0/3463453625 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fc3f8011860 con 0x555f31e29db0 2024-09-19T04:21:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.598+0000 7fc409443740 1 -- 172.21.15.7:0/3463453625 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3f8015070 con 0x555f31e29db0 2024-09-19T04:21:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.598+0000 7fc3df7fe640 1 -- 172.21.15.7:0/3463453625 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc3f8033050 con 0x555f31e29db0 2024-09-19T04:21:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.598+0000 7fc409443740 10 client.15930 fetch_fsmap learned FSMap version 32 2024-09-19T04:21:23.609 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.598+0000 7fc409443740 1 -- 172.21.15.7:0/3463453625 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x555f31b68620 con 0x555f31e29db0 2024-09-19T04:21:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.598+0000 7fc3df7fe640 1 -- 172.21.15.7:0/3463453625 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3f8015070 con 0x555f31e29db0 2024-09-19T04:21:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.599+0000 7fc3df7fe640 1 -- 172.21.15.7:0/3463453625 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fc3f801a500 con 0x555f31e29db0 2024-09-19T04:21:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.599+0000 7fc409443740 10 client.15930 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T04:21:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.599+0000 7fc409443740 10 client.15930 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:21:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.599+0000 7fc409443740 20 client.15930 populate_metadata read hostname 'smithi007' 2024-09-19T04:21:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.599+0000 7fc409443740 1 --2- 172.21.15.7:0/3463453625 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x555f31e3f950 0x555f31e41d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.599+0000 7fc409443740 4 client.15930 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:21:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.599+0000 7fc409443740 1 -- 172.21.15.7:0/3463453625 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f31d96a20 con 0x555f31e3f950 2024-09-19T04:21:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.599+0000 7fc3ff7fe640 1 --2- 172.21.15.7:0/3463453625 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x555f31e3f950 0x555f31e41d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.599+0000 7fc3ff7fe640 1 --2- 172.21.15.7:0/3463453625 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x555f31e3f950 0x555f31e41d40 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f60fee85c7ad5345 server_cookie=887047ab6523d192 in_seq=0 out_seq=0 2024-09-19T04:21:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.599+0000 7fc3df7fe640 10 client.15930 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:21:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.601+0000 7fc3df7fe640 1 -- 172.21.15.7:0/3463453625 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555f31d96a20 con 0x555f31e3f950 2024-09-19T04:21:23.610 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.601+0000 7fc3df7fe640 10 client.15930 handle_command_reply: tid=0 2024-09-19T04:21:23.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.601+0000 7fc409443740 1 client.15930 shutdown 2024-09-19T04:21:23.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.601+0000 7fc409443740 1 -- 172.21.15.7:0/3463453625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f31e29db0 msgr2=0x555f31e34010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:23.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.601+0000 7fc409443740 1 --2- 172.21.15.7:0/3463453625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f31e29db0 0x555f31e34010 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc3f800a010 tx=0x7fc3f8005c50 comp rx=0 tx=0).stop 2024-09-19T04:21:23.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.601+0000 7fc409443740 1 -- 172.21.15.7:0/3463453625 shutdown_connections 2024-09-19T04:21:23.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.601+0000 7fc409443740 1 --2- 172.21.15.7:0/3463453625 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x555f31e3f950 0x555f31e41d40 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:23.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.601+0000 7fc409443740 1 --2- 172.21.15.7:0/3463453625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555f31e2f780 0x555f31e3b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:23.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.601+0000 7fc409443740 1 --2- 172.21.15.7:0/3463453625 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f31e2a6f0 0x555f31e34550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:23.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.601+0000 7fc3df7fe640 0 client.15930 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:21:23.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.601+0000 7fc409443740 1 --2- 172.21.15.7:0/3463453625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f31e29db0 0x555f31e34010 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:23.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.601+0000 7fc409443740 1 -- 172.21.15.7:0/3463453625 >> 172.21.15.7:0/3463453625 conn(0x555f31e21010 msgr2=0x555f31e22820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:23.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.601+0000 7fc409443740 1 -- 172.21.15.7:0/3463453625 shutdown_connections 2024-09-19T04:21:23.611 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.601+0000 7fc409443740 1 -- 172.21.15.7:0/3463453625 wait complete. 2024-09-19T04:21:23.612 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.601+0000 7fc409443740 20 client.15930 trim_cache size 0 max 16384 2024-09-19T04:21:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.615+0000 7fc409443740 1 Processor -- start 2024-09-19T04:21:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.615+0000 7fc409443740 1 -- start start 2024-09-19T04:21:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.615+0000 7fc409443740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f31e29db0 0x555f31e2a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.615+0000 7fc409443740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555f31e2a6f0 0x555f31e3b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.615+0000 7fc409443740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f31e2f780 0x555f31e21ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.615+0000 7fc409443740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc4001a8640 con 0x555f31e2f780 2024-09-19T04:21:23.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.615+0000 7fc409443740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc4001aa240 con 0x555f31e29db0 2024-09-19T04:21:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.615+0000 7fc409443740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc4001a8d10 con 0x555f31e2a6f0 2024-09-19T04:21:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.616+0000 7fc404c42640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f31e29db0 0x555f31e2a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.616+0000 7fc404c42640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f31e29db0 0x555f31e2a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:42214/0 (socket says 172.21.15.7:42214) 2024-09-19T04:21:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.616+0000 7fc404c42640 1 -- 172.21.15.7:0/3681796611 learned_addr learned my addr 172.21.15.7:0/3681796611 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.616+0000 7fc404c42640 1 --2- 172.21.15.7:0/3681796611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f31e2f780 0x555f31e21ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.616+0000 7fc3ff7fe640 1 --2- 172.21.15.7:0/3681796611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555f31e2a6f0 0x555f31e3b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.616+0000 7fc404c42640 1 -- 172.21.15.7:0/3681796611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555f31e2a6f0 msgr2=0x555f31e3b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.616+0000 7fc404c42640 1 --2- 172.21.15.7:0/3681796611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555f31e2a6f0 0x555f31e3b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.616+0000 7fc404c42640 1 -- 172.21.15.7:0/3681796611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f31e2f780 msgr2=0x555f31e21ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.616+0000 7fc404c42640 1 --2- 172.21.15.7:0/3681796611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f31e2f780 0x555f31e21ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.616+0000 7fc404c42640 1 -- 172.21.15.7:0/3681796611 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f31e20e30 con 0x555f31e29db0 2024-09-19T04:21:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.616+0000 7fc404c42640 1 --2- 172.21.15.7:0/3681796611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f31e29db0 0x555f31e2a190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8005a40 tx=0x7fc3f8013040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=585fb9558783b476 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:23.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.616+0000 7fc3e5ffb640 1 -- 172.21.15.7:0/3681796611 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8004410 con 0x555f31e29db0 2024-09-19T04:21:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.616+0000 7fc3e5ffb640 1 -- 172.21.15.7:0/3681796611 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3f8015070 con 0x555f31e29db0 2024-09-19T04:21:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.616+0000 7fc3e5ffb640 1 -- 172.21.15.7:0/3681796611 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f80107d0 con 0x555f31e29db0 2024-09-19T04:21:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.617+0000 7fc409443740 1 -- 172.21.15.7:0/3681796611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f31e29db0 msgr2=0x555f31e2a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.617+0000 7fc409443740 1 --2- 172.21.15.7:0/3681796611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f31e29db0 0x555f31e2a190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8005a40 tx=0x7fc3f8013040 comp rx=0 tx=0).stop 2024-09-19T04:21:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.617+0000 7fc409443740 1 -- 172.21.15.7:0/3681796611 shutdown_connections 2024-09-19T04:21:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.617+0000 7fc409443740 1 --2- 172.21.15.7:0/3681796611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f31e2f780 0x555f31e21ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.617+0000 7fc409443740 1 --2- 172.21.15.7:0/3681796611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555f31e2a6f0 0x555f31e3b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.617+0000 7fc409443740 1 --2- 172.21.15.7:0/3681796611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f31e29db0 0x555f31e2a190 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.617+0000 7fc409443740 1 -- 172.21.15.7:0/3681796611 >> 172.21.15.7:0/3681796611 conn(0x555f31e21010 msgr2=0x555f31e33dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.617+0000 7fc409443740 1 -- 172.21.15.7:0/3681796611 shutdown_connections 2024-09-19T04:21:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.617+0000 7fc409443740 1 -- 172.21.15.7:0/3681796611 wait complete. 2024-09-19T04:21:23.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.617+0000 7fc409443740 1 -- start start 2024-09-19T04:21:23.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.618+0000 7fc409443740 1 Processor -- start 2024-09-19T04:21:23.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.618+0000 7fc409443740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f31e29db0 0x555f31e38570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:23.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.618+0000 7fc409443740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f31e2a6f0 0x555f31e38ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:23.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.618+0000 7fc409443740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555f31e2f780 0x555f31ea85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:23.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.618+0000 7fc409443740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc4001a9ab0 con 0x555f31e29db0 2024-09-19T04:21:23.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.618+0000 7fc409443740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc4001a93e0 con 0x555f31e2a6f0 2024-09-19T04:21:23.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.618+0000 7fc409443740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc4001a6600 con 0x555f31e2f780 2024-09-19T04:21:23.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.618+0000 7fc409443740 10 client.0 _ll_register_callbacks cb 0x7fc3f00f3cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:21:23.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.618+0000 7fc404c42640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f31e29db0 0x555f31e38570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:23.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.618+0000 7fc404c42640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f31e29db0 0x555f31e38570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58952/0 (socket says 172.21.15.7:58952) 2024-09-19T04:21:23.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.618+0000 7fc404c42640 1 -- 172.21.15.7:0/2527924528 learned_addr learned my addr 172.21.15.7:0/2527924528 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:23.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.618+0000 7fc3ff7fe640 1 --2- 172.21.15.7:0/2527924528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f31e2a6f0 0x555f31e38ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.618+0000 7fc404c42640 1 --2- 172.21.15.7:0/2527924528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555f31e2f780 0x555f31ea85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.618+0000 7fc404c42640 1 -- 172.21.15.7:0/2527924528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555f31e2f780 msgr2=0x555f31ea85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.618+0000 7fc404c42640 1 --2- 172.21.15.7:0/2527924528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555f31e2f780 0x555f31ea85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.618+0000 7fc404c42640 1 -- 172.21.15.7:0/2527924528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f31e2a6f0 msgr2=0x555f31e38ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.618+0000 7fc404c42640 1 --2- 172.21.15.7:0/2527924528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f31e2a6f0 0x555f31e38ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.618+0000 7fc404c42640 1 -- 172.21.15.7:0/2527924528 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f31ea8b80 con 0x555f31e29db0 2024-09-19T04:21:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.618+0000 7fc3ff7fe640 1 --2- 172.21.15.7:0/2527924528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f31e2a6f0 0x555f31e38ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:21:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.618+0000 7fc404c42640 1 --2- 172.21.15.7:0/2527924528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f31e29db0 0x555f31e38570 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8011f20 tx=0x7fc3f8005960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c1eafc234ee69a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.618+0000 7fc3df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:21:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.619+0000 7fc3df7fe640 1 -- 172.21.15.7:0/2527924528 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f801e070 con 0x555f31e29db0 2024-09-19T04:21:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.619+0000 7fc409443740 1 -- 172.21.15.7:0/2527924528 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3f8015070 con 0x555f31e29db0 2024-09-19T04:21:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.619+0000 7fc3df7fe640 1 -- 172.21.15.7:0/2527924528 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fc3f8004410 con 0x555f31e29db0 2024-09-19T04:21:23.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.619+0000 7fc3df7fe640 1 -- 172.21.15.7:0/2527924528 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fc3f8030030 con 0x555f31e29db0 2024-09-19T04:21:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.619+0000 7fc409443740 10 client.15936 fetch_fsmap learned FSMap version 32 2024-09-19T04:21:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.619+0000 7fc409443740 1 -- 172.21.15.7:0/2527924528 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x555f31ea9e90 con 0x555f31e29db0 2024-09-19T04:21:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.619+0000 7fc3df7fe640 1 -- 172.21.15.7:0/2527924528 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3f8015070 con 0x555f31e29db0 2024-09-19T04:21:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.619+0000 7fc3df7fe640 1 -- 172.21.15.7:0/2527924528 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 32) ==== 8386+0+0 (secure 0 0 0) 0x7fc3f802b950 con 0x555f31e29db0 2024-09-19T04:21:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.619+0000 7fc409443740 10 client.15936 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T04:21:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.619+0000 7fc409443740 10 client.15936 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:21:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.619+0000 7fc409443740 20 client.15936 populate_metadata read hostname 'smithi007' 2024-09-19T04:21:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.619+0000 7fc409443740 1 --2- 172.21.15.7:0/2527924528 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x555f31eaa850 0x555f31eacc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.619+0000 7fc409443740 4 client.15936 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:21:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.619+0000 7fc409443740 1 -- 172.21.15.7:0/2527924528 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555f31d90d70 con 0x555f31eaa850 2024-09-19T04:21:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.619+0000 7fc3ff7fe640 1 --2- 172.21.15.7:0/2527924528 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x555f31eaa850 0x555f31eacc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:23.626 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.620+0000 7fc3df7fe640 10 client.15936 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:21:23.627 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:23.620+0000 7fc3ff7fe640 1 --2- 172.21.15.7:0/2527924528 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x555f31eaa850 0x555f31eacc70 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8587bc5e8ea32354 server_cookie=5c8755dd00104e64 in_seq=0 out_seq=0 2024-09-19T04:21:25.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:25 smithi102 ceph-mon[35446]: pgmap v489: 129 pgs: 129 active+clean; 324 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.5 MiB/s wr, 1.13k op/s 2024-09-19T04:21:25.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:25 smithi092 ceph-mon[34940]: pgmap v489: 129 pgs: 129 active+clean; 324 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.5 MiB/s wr, 1.13k op/s 2024-09-19T04:21:25.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:25 smithi007 ceph-mon[31360]: pgmap v489: 129 pgs: 129 active+clean; 324 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.5 MiB/s wr, 1.13k op/s 2024-09-19T04:21:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:26.260+0000 7fc3df7fe640 1 -- 172.21.15.7:0/2527924528 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555f31d90d70 con 0x555f31eaa850 2024-09-19T04:21:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:26.260+0000 7fc3df7fe640 10 client.15936 handle_command_reply: tid=0 2024-09-19T04:21:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:26.260+0000 7fc409443740 1 client.15936 shutdown 2024-09-19T04:21:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:26.261+0000 7fc409443740 1 -- 172.21.15.7:0/2527924528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f31e29db0 msgr2=0x555f31e38570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:26.261+0000 7fc409443740 1 --2- 172.21.15.7:0/2527924528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f31e29db0 0x555f31e38570 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8011f20 tx=0x7fc3f8005960 comp rx=0 tx=0).stop 2024-09-19T04:21:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:26.261+0000 7fc409443740 1 -- 172.21.15.7:0/2527924528 shutdown_connections 2024-09-19T04:21:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:26.261+0000 7fc409443740 1 --2- 172.21.15.7:0/2527924528 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x555f31eaa850 0x555f31eacc70 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:26.261+0000 7fc3df7fe640 0 client.15936 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:21:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:26.261+0000 7fc409443740 1 --2- 172.21.15.7:0/2527924528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555f31e2f780 0x555f31ea85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:26.261+0000 7fc409443740 1 --2- 172.21.15.7:0/2527924528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f31e2a6f0 0x555f31e38ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:26.261+0000 7fc409443740 1 --2- 172.21.15.7:0/2527924528 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555f31e29db0 0x555f31e38570 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:26.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:26.261+0000 7fc409443740 1 -- 172.21.15.7:0/2527924528 >> 172.21.15.7:0/2527924528 conn(0x555f31e21010 msgr2=0x555f31e1f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:26.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:26.261+0000 7fc409443740 1 -- 172.21.15.7:0/2527924528 shutdown_connections 2024-09-19T04:21:26.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:26.261+0000 7fc409443740 1 -- 172.21.15.7:0/2527924528 wait complete. 2024-09-19T04:21:26.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:26.261+0000 7fc409443740 20 client.15936 trim_cache size 0 max 16384 2024-09-19T04:21:26.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:21:26.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:21:26.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:21:26.264 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:21:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:26.262+0000 7fc4066a5640 1 -- 172.21.15.7:0/2540401720 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc3e80a3240 msgr2=0x7fc3e80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:26.262+0000 7fc4066a5640 1 --2- 172.21.15.7:0/2540401720 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc3e80a3240 0x7fc3e80a5700 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc3f00bc360 tx=0x7fc3f00f3de0 comp rx=0 tx=0).stop 2024-09-19T04:21:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:26.262+0000 7fc4066a5640 1 -- 172.21.15.7:0/2540401720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc400101b70 msgr2=0x7fc400197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:26.262+0000 7fc4066a5640 1 --2- 172.21.15.7:0/2540401720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc400101b70 0x7fc400197eb0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0031610 tx=0x7fc3f0004270 comp rx=0 tx=0).stop 2024-09-19T04:21:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:26.262+0000 7fc4066a5640 1 -- 172.21.15.7:0/2540401720 shutdown_connections 2024-09-19T04:21:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:26.262+0000 7fc4066a5640 1 --2- 172.21.15.7:0/2540401720 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc3e80a3240 0x7fc3e80a5700 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:26.263+0000 7fc4066a5640 1 --2- 172.21.15.7:0/2540401720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc400103720 0x7fc40019f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:26.263+0000 7fc4066a5640 1 --2- 172.21.15.7:0/2540401720 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc400102d60 0x7fc4001983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:26.263+0000 7fc4066a5640 1 --2- 172.21.15.7:0/2540401720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc400101b70 0x7fc400197eb0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:26.263+0000 7fc4066a5640 1 -- 172.21.15.7:0/2540401720 >> 172.21.15.7:0/2540401720 conn(0x7fc4000fd2f0 msgr2=0x7fc4001061f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:26.263+0000 7fc4066a5640 1 -- 172.21.15.7:0/2540401720 shutdown_connections 2024-09-19T04:21:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:26.263+0000 7fc4066a5640 1 -- 172.21.15.7:0/2540401720 wait complete. 2024-09-19T04:21:26.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:26.301+0000 7f5abb7fe640 1 -- 172.21.15.7:0/3624265696 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x555cdda9ad20 con 0x555cddbc5ac0 2024-09-19T04:21:26.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:26.301+0000 7f5abb7fe640 10 client.25529 handle_command_reply: tid=0 2024-09-19T04:21:26.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:26.301+0000 7f5ae4b88740 1 client.25529 shutdown 2024-09-19T04:21:26.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:26.302+0000 7f5ae4b88740 1 -- 172.21.15.7:0/3624265696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cddb36890 msgr2=0x555cddb3a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:26.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:26.302+0000 7f5ae4b88740 1 --2- 172.21.15.7:0/3624265696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cddb36890 0x555cddb3a680 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00ba60 tx=0x7f5acc00dcd0 comp rx=0 tx=0).stop 2024-09-19T04:21:26.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:26.302+0000 7f5ae4b88740 1 -- 172.21.15.7:0/3624265696 shutdown_connections 2024-09-19T04:21:26.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:26.302+0000 7f5ae4b88740 1 --2- 172.21.15.7:0/3624265696 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x555cddbc5ac0 0x555cddbc7ee0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:26.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:26.302+0000 7f5ae4b88740 1 --2- 172.21.15.7:0/3624265696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555cddb41150 0x555cddb3abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:26.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:26.302+0000 7f5ae4b88740 1 --2- 172.21.15.7:0/3624265696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555cddb36890 0x555cddb3a680 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:26.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:26.302+0000 7f5ae4b88740 1 --2- 172.21.15.7:0/3624265696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555cddb35f70 0x555cddb3a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:26.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:26.302+0000 7f5abb7fe640 0 client.25529 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:21:26.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:26.302+0000 7f5ae4b88740 1 -- 172.21.15.7:0/3624265696 >> 172.21.15.7:0/3624265696 conn(0x555cddb32500 msgr2=0x555cddb2ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:26.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:26.302+0000 7f5ae4b88740 1 -- 172.21.15.7:0/3624265696 shutdown_connections 2024-09-19T04:21:26.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:26.302+0000 7f5ae4b88740 1 -- 172.21.15.7:0/3624265696 wait complete. 2024-09-19T04:21:26.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:26.302+0000 7f5ae4b88740 20 client.25529 trim_cache size 0 max 16384 2024-09-19T04:21:26.305 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:21:26.305 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 32, 2024-09-19T04:21:26.305 INFO:teuthology.orchestra.run.smithi007.stdout: "leader": 24506, 2024-09-19T04:21:26.305 INFO:teuthology.orchestra.run.smithi007.stdout: "set_version": 18, 2024-09-19T04:21:26.306 INFO:teuthology.orchestra.run.smithi007.stdout: "sets": { 2024-09-19T04:21:26.306 INFO:teuthology.orchestra.run.smithi007.stdout: "3a24f514": { 2024-09-19T04:21:26.306 INFO:teuthology.orchestra.run.smithi007.stdout: "version": 18, 2024-09-19T04:21:26.306 INFO:teuthology.orchestra.run.smithi007.stdout: "age_ref": 0.0, 2024-09-19T04:21:26.306 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:21:26.306 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "QUIESCED", 2024-09-19T04:21:26.306 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:21:26.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:21:26.306 INFO:teuthology.orchestra.run.smithi007.stdout: "timeout": 90.0, 2024-09-19T04:21:26.306 INFO:teuthology.orchestra.run.smithi007.stdout: "expiration": 149.8, 2024-09-19T04:21:26.306 INFO:teuthology.orchestra.run.smithi007.stdout: "members": { 2024-09-19T04:21:26.306 INFO:teuthology.orchestra.run.smithi007.stdout: "file:/": { 2024-09-19T04:21:26.306 INFO:teuthology.orchestra.run.smithi007.stdout: "excluded": false, 2024-09-19T04:21:26.307 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:21:26.307 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "QUIESCED", 2024-09-19T04:21:26.307 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:21:26.307 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:21:26.307 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:21:26.307 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:21:26.307 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:21:26.307 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:21:26.307 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:21:26.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:26.303+0000 7f5ae27af640 1 -- 172.21.15.7:0/147232134 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f5ac40a3300 msgr2=0x7f5ac40a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:26.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:26.303+0000 7f5ae27af640 1 --2- 172.21.15.7:0/147232134 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f5ac40a3300 0x7f5ac40a57c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x555cddb33880 tx=0x7f5ad403f040 comp rx=0 tx=0).stop 2024-09-19T04:21:26.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:26.303+0000 7f5ae27af640 1 -- 172.21.15.7:0/147232134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5adc10d9b0 msgr2=0x7f5adc19ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:26.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:26.303+0000 7f5ae27af640 1 --2- 172.21.15.7:0/147232134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5adc10d9b0 0x7f5adc19ef30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000b440 tx=0x7f5ad000b900 comp rx=0 tx=0).stop 2024-09-19T04:21:26.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:26.303+0000 7f5ae27af640 1 -- 172.21.15.7:0/147232134 shutdown_connections 2024-09-19T04:21:26.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:26.303+0000 7f5ae27af640 1 --2- 172.21.15.7:0/147232134 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f5ac40a3300 0x7f5ac40a57c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:26.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:26.303+0000 7f5ae27af640 1 --2- 172.21.15.7:0/147232134 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5adc10ef30 0x7f5adc1a3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:26.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:26.303+0000 7f5ae27af640 1 --2- 172.21.15.7:0/147232134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5adc10e580 0x7f5adc19f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:26.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:26.303+0000 7f5ae27af640 1 --2- 172.21.15.7:0/147232134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5adc10d9b0 0x7f5adc19ef30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:26.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:26.303+0000 7f5ae27af640 1 -- 172.21.15.7:0/147232134 >> 172.21.15.7:0/147232134 conn(0x7f5adc06e140 msgr2=0x7f5adc0728c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:26.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:26.303+0000 7f5ae27af640 1 -- 172.21.15.7:0/147232134 shutdown_connections 2024-09-19T04:21:26.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:26.303+0000 7f5ae27af640 1 -- 172.21.15.7:0/147232134 wait complete. 2024-09-19T04:21:27.303 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:27 smithi007 ceph-mon[31360]: pgmap v490: 129 pgs: 129 active+clean; 324 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 MiB/s wr, 534 op/s 2024-09-19T04:21:27.335 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3a24f514', quiesce took 16.6 seconds. Will release after: 13.2 2024-09-19T04:21:27.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:27 smithi102 ceph-mon[35446]: pgmap v490: 129 pgs: 129 active+clean; 324 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 MiB/s wr, 534 op/s 2024-09-19T04:21:27.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:27 smithi092 ceph-mon[34940]: pgmap v490: 129 pgs: 129 active+clean; 324 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 MiB/s wr, 534 op/s 2024-09-19T04:21:28.158 INFO:tasks.workunit.client.0.smithi007.stdout: 100 2001 0 1900 0 1857 0 2024-09-19T04:21:29.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:29 smithi102 ceph-mon[35446]: pgmap v491: 129 pgs: 129 active+clean; 324 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 194 op/s 2024-09-19T04:21:29.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:29 smithi092 ceph-mon[34940]: pgmap v491: 129 pgs: 129 active+clean; 324 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 194 op/s 2024-09-19T04:21:29.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:29 smithi007 ceph-mon[31360]: pgmap v491: 129 pgs: 129 active+clean; 324 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 194 op/s 2024-09-19T04:21:31.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:31 smithi102 ceph-mon[35446]: pgmap v492: 129 pgs: 129 active+clean; 312 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 456 op/s 2024-09-19T04:21:31.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:31 smithi092 ceph-mon[34940]: pgmap v492: 129 pgs: 129 active+clean; 312 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 456 op/s 2024-09-19T04:21:31.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:31 smithi007 ceph-mon[31360]: pgmap v492: 129 pgs: 129 active+clean; 312 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 456 op/s 2024-09-19T04:21:33.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:33 smithi102 ceph-mon[35446]: pgmap v493: 129 pgs: 129 active+clean; 312 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 462 op/s 2024-09-19T04:21:33.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:33 smithi092 ceph-mon[34940]: pgmap v493: 129 pgs: 129 active+clean; 312 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 462 op/s 2024-09-19T04:21:33.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:33 smithi007 ceph-mon[31360]: pgmap v493: 129 pgs: 129 active+clean; 312 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 462 op/s 2024-09-19T04:21:34.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:34 smithi102 ceph-mon[35446]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:21:34.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:34 smithi092 ceph-mon[34940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:21:34.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:34 smithi007 ceph-mon[31360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:21:35.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:35 smithi102 ceph-mon[35446]: pgmap v494: 129 pgs: 129 active+clean; 313 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 457 op/s 2024-09-19T04:21:35.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:35 smithi092 ceph-mon[34940]: pgmap v494: 129 pgs: 129 active+clean; 313 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 457 op/s 2024-09-19T04:21:35.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:35 smithi007 ceph-mon[31360]: pgmap v494: 129 pgs: 129 active+clean; 313 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 457 op/s 2024-09-19T04:21:37.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:37 smithi102 ceph-mon[35446]: pgmap v495: 129 pgs: 129 active+clean; 313 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 396 op/s 2024-09-19T04:21:37.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:37 smithi092 ceph-mon[34940]: pgmap v495: 129 pgs: 129 active+clean; 313 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 396 op/s 2024-09-19T04:21:37.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:37 smithi007 ceph-mon[31360]: pgmap v495: 129 pgs: 129 active+clean; 313 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 396 op/s 2024-09-19T04:21:38.158 INFO:tasks.workunit.client.0.smithi007.stdout: 100 24956 0 17834 0 12718 0 2024-09-19T04:21:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.363+0000 7f5878b2a640 1 -- 172.21.15.7:0/973093349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5874104f30 msgr2=0x7f5874107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.363+0000 7f5878b2a640 1 --2- 172.21.15.7:0/973093349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5874104f30 0x7f5874107320 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5868009900 tx=0x7f586802a410 comp rx=0 tx=0).stop 2024-09-19T04:21:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.363+0000 7f5878b2a640 1 -- 172.21.15.7:0/973093349 shutdown_connections 2024-09-19T04:21:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.363+0000 7f5878b2a640 1 --2- 172.21.15.7:0/973093349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5874107860 0x7f5874109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.363+0000 7f5878b2a640 1 --2- 172.21.15.7:0/973093349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5874104f30 0x7f5874107320 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.363+0000 7f5878b2a640 1 --2- 172.21.15.7:0/973093349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5874102600 0x7f58741049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.363+0000 7f5878b2a640 1 -- 172.21.15.7:0/973093349 >> 172.21.15.7:0/973093349 conn(0x7f58740fc1e0 msgr2=0x7f58740fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.363+0000 7f5878b2a640 1 -- 172.21.15.7:0/973093349 shutdown_connections 2024-09-19T04:21:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.363+0000 7f5878b2a640 1 -- 172.21.15.7:0/973093349 wait complete. 2024-09-19T04:21:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.364+0000 7f5878b2a640 1 Processor -- start 2024-09-19T04:21:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.364+0000 7f5878b2a640 1 -- start start 2024-09-19T04:21:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.364+0000 7f5878b2a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5874102600 0x7f5874101f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.364+0000 7f5878b2a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5874104f30 0x7f58741005b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.364+0000 7f5878b2a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5874107860 0x7f5874100af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.364+0000 7f5878b2a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f587410d840 con 0x7f5874104f30 2024-09-19T04:21:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.364+0000 7f5878b2a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f587410d6c0 con 0x7f5874102600 2024-09-19T04:21:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.364+0000 7f5878b2a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f587410d9c0 con 0x7f5874107860 2024-09-19T04:21:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.364+0000 7f5871d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5874104f30 0x7f58741005b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.364+0000 7f5871d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5874104f30 0x7f58741005b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36292/0 (socket says 172.21.15.7:36292) 2024-09-19T04:21:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.364+0000 7f587259c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5874102600 0x7f5874101f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.364+0000 7f5871d9b640 1 -- 172.21.15.7:0/4168127666 learned_addr learned my addr 172.21.15.7:0/4168127666 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.364+0000 7f5872d9d640 1 --2- 172.21.15.7:0/4168127666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5874107860 0x7f5874100af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.364+0000 7f587259c640 1 -- 172.21.15.7:0/4168127666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5874107860 msgr2=0x7f5874100af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:39.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.364+0000 7f587259c640 1 --2- 172.21.15.7:0/4168127666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5874107860 0x7f5874100af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.364+0000 7f587259c640 1 -- 172.21.15.7:0/4168127666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5874104f30 msgr2=0x7f58741005b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.364+0000 7f587259c640 1 --2- 172.21.15.7:0/4168127666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5874104f30 0x7f58741005b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.364+0000 7f587259c640 1 -- 172.21.15.7:0/4168127666 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5874101380 con 0x7f5874102600 2024-09-19T04:21:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.364+0000 7f5871d9b640 1 --2- 172.21.15.7:0/4168127666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5874104f30 0x7f58741005b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:21:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.365+0000 7f587259c640 1 --2- 172.21.15.7:0/4168127666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5874102600 0x7f5874101f70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f586400e9f0 tx=0x7f586400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.365+0000 7f58637fe640 1 -- 172.21.15.7:0/4168127666 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586400cd80 con 0x7f5874102600 2024-09-19T04:21:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.365+0000 7f58637fe640 1 -- 172.21.15.7:0/4168127666 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58640035f0 con 0x7f5874102600 2024-09-19T04:21:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.365+0000 7f5878b2a640 1 -- 172.21.15.7:0/4168127666 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58741a1fb0 con 0x7f5874102600 2024-09-19T04:21:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.365+0000 7f58637fe640 1 -- 172.21.15.7:0/4168127666 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5864010690 con 0x7f5874102600 2024-09-19T04:21:39.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.365+0000 7f5878b2a640 1 -- 172.21.15.7:0/4168127666 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58741a2420 con 0x7f5874102600 2024-09-19T04:21:39.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.367+0000 7f58637fe640 1 -- 172.21.15.7:0/4168127666 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f5864003b30 con 0x7f5874102600 2024-09-19T04:21:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.367+0000 7f587b8c6740 1 Processor -- start 2024-09-19T04:21:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.368+0000 7f587b8c6740 1 -- start start 2024-09-19T04:21:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.368+0000 7f587b8c6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564386f699a0 0x564386f69da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.368+0000 7f587b8c6740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564386f6a2e0 0x564386f6eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.368+0000 7f587b8c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564386f6f370 0x564386f71830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.368+0000 7f587b8c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564386ecd2f0 con 0x564386f6f370 2024-09-19T04:21:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.368+0000 7f587b8c6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564386e75270 con 0x564386f699a0 2024-09-19T04:21:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.368+0000 7f587b8c6740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564386ec92b0 con 0x564386f6a2e0 2024-09-19T04:21:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.368+0000 7f5871d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564386f6f370 0x564386f71830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.368+0000 7f5871d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564386f6f370 0x564386f71830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36302/0 (socket says 172.21.15.7:36302) 2024-09-19T04:21:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.368+0000 7f5871d9b640 1 -- 172.21.15.7:0/3866905641 learned_addr learned my addr 172.21.15.7:0/3866905641 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:39.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.368+0000 7f5872d9d640 1 --2- 172.21.15.7:0/3866905641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564386f699a0 0x564386f69da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:39.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.368+0000 7f587259c640 1 --2- 172.21.15.7:0/3866905641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564386f6a2e0 0x564386f6eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:39.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.368+0000 7f5871d9b640 1 -- 172.21.15.7:0/3866905641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564386f6a2e0 msgr2=0x564386f6eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:39.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.368+0000 7f5871d9b640 1 --2- 172.21.15.7:0/3866905641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564386f6a2e0 0x564386f6eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.368+0000 7f58637fe640 1 --2- 172.21.15.7:0/4168127666 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f585c0a32c0 0x7f585c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:39.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.368+0000 7f5871d9b640 1 -- 172.21.15.7:0/3866905641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564386f699a0 msgr2=0x564386f69da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:39.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.368+0000 7f5871d9b640 1 --2- 172.21.15.7:0/3866905641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564386f699a0 0x564386f69da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.368+0000 7f5871d9b640 1 -- 172.21.15.7:0/3866905641 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564386e74340 con 0x564386f6f370 2024-09-19T04:21:39.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.368+0000 7f5872d9d640 1 --2- 172.21.15.7:0/3866905641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564386f699a0 0x564386f69da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:21:39.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.368+0000 7f5872d9d640 1 --2- 172.21.15.7:0/4168127666 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f585c0a32c0 0x7f585c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:39.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.369+0000 7f58637fe640 1 -- 172.21.15.7:0/4168127666 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f58640d0010 con 0x7f5874102600 2024-09-19T04:21:39.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.369+0000 7f5871d9b640 1 --2- 172.21.15.7:0/3866905641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564386f6f370 0x564386f71830 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f5868031440 tx=0x7f5868005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab15758d6f5e2015 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:39.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.369+0000 7f5860ff9640 1 -- 172.21.15.7:0/3866905641 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5868035040 con 0x564386f6f370 2024-09-19T04:21:39.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.369+0000 7f5860ff9640 1 -- 172.21.15.7:0/3866905641 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58680319b0 con 0x564386f6f370 2024-09-19T04:21:39.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.369+0000 7f5860ff9640 1 -- 172.21.15.7:0/3866905641 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58680049a0 con 0x564386f6f370 2024-09-19T04:21:39.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.370+0000 7f587b8c6740 1 -- 172.21.15.7:0/3866905641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564386f6f370 msgr2=0x564386f71830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:39.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.370+0000 7f5872d9d640 1 --2- 172.21.15.7:0/4168127666 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f585c0a32c0 0x7f585c0a5780 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f586c009fd0 tx=0x7f586c004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:39.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.370+0000 7f587b8c6740 1 --2- 172.21.15.7:0/3866905641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564386f6f370 0x564386f71830 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f5868031440 tx=0x7f5868005de0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.370+0000 7f587b8c6740 1 -- 172.21.15.7:0/3866905641 shutdown_connections 2024-09-19T04:21:39.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.370+0000 7f587b8c6740 1 --2- 172.21.15.7:0/3866905641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564386f6f370 0x564386f71830 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.370+0000 7f587b8c6740 1 --2- 172.21.15.7:0/3866905641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564386f6a2e0 0x564386f6eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.370+0000 7f587b8c6740 1 --2- 172.21.15.7:0/3866905641 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564386f699a0 0x564386f69da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.370+0000 7f587b8c6740 1 -- 172.21.15.7:0/3866905641 >> 172.21.15.7:0/3866905641 conn(0x564386f65010 msgr2=0x564386f65410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:39.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.370+0000 7f587b8c6740 1 -- 172.21.15.7:0/3866905641 shutdown_connections 2024-09-19T04:21:39.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.370+0000 7f587b8c6740 1 -- 172.21.15.7:0/3866905641 wait complete. 2024-09-19T04:21:39.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.370+0000 7f587b8c6740 1 -- start start 2024-09-19T04:21:39.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.370+0000 7f587b8c6740 1 Processor -- start 2024-09-19T04:21:39.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.370+0000 7f587b8c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564386f699a0 0x564386f73ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:39.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.370+0000 7f587b8c6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564386f6a2e0 0x564386f73ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:39.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.371+0000 7f587b8c6740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564386f6f370 0x564386f7b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:39.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.371+0000 7f587b8c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564386f722e0 con 0x564386f699a0 2024-09-19T04:21:39.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.371+0000 7f587b8c6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564386e56290 con 0x564386f6a2e0 2024-09-19T04:21:39.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.371+0000 7f587b8c6740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564386f72460 con 0x564386f6f370 2024-09-19T04:21:39.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.371+0000 7f587b8c6740 10 client.0 _ll_register_callbacks cb 0x564386e87140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:21:39.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.371+0000 7f587259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564386f699a0 0x564386f73ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:39.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.371+0000 7f587259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564386f699a0 0x564386f73ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36306/0 (socket says 172.21.15.7:36306) 2024-09-19T04:21:39.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.371+0000 7f587259c640 1 -- 172.21.15.7:0/3122307965 learned_addr learned my addr 172.21.15.7:0/3122307965 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:39.378 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.371+0000 7f5871d9b640 1 --2- 172.21.15.7:0/3122307965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564386f6a2e0 0x564386f73ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:39.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.371+0000 7f5872d9d640 1 --2- 172.21.15.7:0/3122307965 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564386f6f370 0x564386f7b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:39.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.371+0000 7f587259c640 1 -- 172.21.15.7:0/3122307965 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564386f6f370 msgr2=0x564386f7b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:39.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.371+0000 7f587259c640 1 --2- 172.21.15.7:0/3122307965 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564386f6f370 0x564386f7b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.371+0000 7f587259c640 1 -- 172.21.15.7:0/3122307965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564386f6a2e0 msgr2=0x564386f73ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:39.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.371+0000 7f587259c640 1 --2- 172.21.15.7:0/3122307965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564386f6a2e0 0x564386f73ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.371+0000 7f587259c640 1 -- 172.21.15.7:0/3122307965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564386be0210 con 0x564386f699a0 2024-09-19T04:21:39.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.371+0000 7f5872d9d640 1 --2- 172.21.15.7:0/3122307965 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564386f6f370 0x564386f7b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:21:39.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.371+0000 7f587259c640 1 --2- 172.21.15.7:0/3122307965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564386f699a0 0x564386f73ab0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5864098c30 tx=0x7f58640985f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97c3ef5b224e090 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:39.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.371+0000 7f5859ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:21:39.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.371+0000 7f5859ffb640 1 -- 172.21.15.7:0/3122307965 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5864009450 con 0x564386f699a0 2024-09-19T04:21:39.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.371+0000 7f5859ffb640 1 -- 172.21.15.7:0/3122307965 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f58640988d0 con 0x564386f699a0 2024-09-19T04:21:39.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.371+0000 7f587b8c6740 1 -- 172.21.15.7:0/3122307965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58680319b0 con 0x564386f699a0 2024-09-19T04:21:39.379 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.371+0000 7f5859ffb640 1 -- 172.21.15.7:0/3122307965 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f586409c960 con 0x564386f699a0 2024-09-19T04:21:39.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.371+0000 7f587b8c6740 10 client.15948 fetch_fsmap learned FSMap version 33 2024-09-19T04:21:39.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.371+0000 7f587b8c6740 1 -- 172.21.15.7:0/3122307965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564386cac620 con 0x564386f699a0 2024-09-19T04:21:39.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.372+0000 7f5859ffb640 1 -- 172.21.15.7:0/3122307965 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58680319b0 con 0x564386f699a0 2024-09-19T04:21:39.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.372+0000 7f5859ffb640 1 -- 172.21.15.7:0/3122307965 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f58640b50a0 con 0x564386f699a0 2024-09-19T04:21:39.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.372+0000 7f587b8c6740 10 client.15948 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T04:21:39.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.372+0000 7f587b8c6740 10 client.15948 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:21:39.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.372+0000 7f587b8c6740 20 client.15948 populate_metadata read hostname 'smithi007' 2024-09-19T04:21:39.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.372+0000 7f587b8c6740 1 --2- 172.21.15.7:0/3122307965 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564386f7f7b0 0x564386f81c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:39.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.372+0000 7f587b8c6740 4 client.15948 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:21:39.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.372+0000 7f587b8c6740 1 -- 172.21.15.7:0/3122307965 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564386edaa20 con 0x564386f7f7b0 2024-09-19T04:21:39.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.372+0000 7f5871d9b640 1 --2- 172.21.15.7:0/3122307965 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564386f7f7b0 0x564386f81c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:39.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.372+0000 7f5859ffb640 10 client.15948 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:21:39.380 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.372+0000 7f5871d9b640 1 --2- 172.21.15.7:0/3122307965 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564386f7f7b0 0x564386f81c00 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ee9cf4b14abfce0 server_cookie=c9afb9c938e0ee78 in_seq=0 out_seq=0 2024-09-19T04:21:39.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.374+0000 7f5859ffb640 1 -- 172.21.15.7:0/3122307965 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564386edaa20 con 0x564386f7f7b0 2024-09-19T04:21:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.374+0000 7f5859ffb640 10 client.15948 handle_command_reply: tid=0 2024-09-19T04:21:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.374+0000 7f587b8c6740 1 client.15948 shutdown 2024-09-19T04:21:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.374+0000 7f587b8c6740 1 -- 172.21.15.7:0/3122307965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564386f699a0 msgr2=0x564386f73ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.374+0000 7f587b8c6740 1 --2- 172.21.15.7:0/3122307965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564386f699a0 0x564386f73ab0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5864098c30 tx=0x7f58640985f0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.374+0000 7f587b8c6740 1 -- 172.21.15.7:0/3122307965 shutdown_connections 2024-09-19T04:21:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.374+0000 7f587b8c6740 1 --2- 172.21.15.7:0/3122307965 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564386f7f7b0 0x564386f81c00 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.374+0000 7f587b8c6740 1 --2- 172.21.15.7:0/3122307965 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564386f6f370 0x564386f7b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.374+0000 7f587b8c6740 1 --2- 172.21.15.7:0/3122307965 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564386f6a2e0 0x564386f73ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.374+0000 7f587b8c6740 1 --2- 172.21.15.7:0/3122307965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564386f699a0 0x564386f73ab0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.374+0000 7f5859ffb640 0 client.15948 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:21:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.374+0000 7f587b8c6740 1 -- 172.21.15.7:0/3122307965 >> 172.21.15.7:0/3122307965 conn(0x564386f65010 msgr2=0x564386f66820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.374+0000 7f587b8c6740 1 -- 172.21.15.7:0/3122307965 shutdown_connections 2024-09-19T04:21:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.374+0000 7f587b8c6740 1 -- 172.21.15.7:0/3122307965 wait complete. 2024-09-19T04:21:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.374+0000 7f587b8c6740 20 client.15948 trim_cache size 0 max 16384 2024-09-19T04:21:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.389+0000 7f587b8c6740 1 Processor -- start 2024-09-19T04:21:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.389+0000 7f587b8c6740 1 -- start start 2024-09-19T04:21:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.390+0000 7f587b8c6740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564386f699a0 0x564386f74080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.390+0000 7f587b8c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564386f6a2e0 0x564386f69d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.390+0000 7f587b8c6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564386f6f370 0x564386f7aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.390+0000 7f587b8c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f58741acaf0 con 0x564386f6a2e0 2024-09-19T04:21:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.390+0000 7f587b8c6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f58741ae6c0 con 0x564386f6f370 2024-09-19T04:21:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.390+0000 7f587b8c6740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f58741ad1c0 con 0x564386f699a0 2024-09-19T04:21:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.390+0000 7f5871d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564386f6a2e0 0x564386f69d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.390+0000 7f5871d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564386f6a2e0 0x564386f69d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36320/0 (socket says 172.21.15.7:36320) 2024-09-19T04:21:39.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.390+0000 7f5871d9b640 1 -- 172.21.15.7:0/756583393 learned_addr learned my addr 172.21.15.7:0/756583393 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:39.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.390+0000 7f5872d9d640 1 --2- 172.21.15.7:0/756583393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564386f6f370 0x564386f7aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:39.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.390+0000 7f587259c640 1 --2- 172.21.15.7:0/756583393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564386f699a0 0x564386f74080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:39.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.390+0000 7f5871d9b640 1 -- 172.21.15.7:0/756583393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564386f699a0 msgr2=0x564386f74080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:39.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.390+0000 7f5871d9b640 1 --2- 172.21.15.7:0/756583393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564386f699a0 0x564386f74080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.390+0000 7f5871d9b640 1 -- 172.21.15.7:0/756583393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564386f6f370 msgr2=0x564386f7aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:39.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.390+0000 7f5871d9b640 1 --2- 172.21.15.7:0/756583393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564386f6f370 0x564386f7aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.390+0000 7f5871d9b640 1 -- 172.21.15.7:0/756583393 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564386f64e30 con 0x564386f6a2e0 2024-09-19T04:21:39.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.390+0000 7f5871d9b640 1 --2- 172.21.15.7:0/756583393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564386f6a2e0 0x564386f69d80 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f5868006010 tx=0x7f586802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d8e3a2d92fa322 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:39.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.390+0000 7f585bfff640 1 -- 172.21.15.7:0/756583393 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5868035040 con 0x564386f6a2e0 2024-09-19T04:21:39.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.391+0000 7f585bfff640 1 -- 172.21.15.7:0/756583393 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5868031970 con 0x564386f6a2e0 2024-09-19T04:21:39.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.391+0000 7f585bfff640 1 -- 172.21.15.7:0/756583393 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5868003a60 con 0x564386f6a2e0 2024-09-19T04:21:39.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.391+0000 7f587b8c6740 1 -- 172.21.15.7:0/756583393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564386f6a2e0 msgr2=0x564386f69d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:39.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.391+0000 7f587b8c6740 1 --2- 172.21.15.7:0/756583393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564386f6a2e0 0x564386f69d80 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f5868006010 tx=0x7f586802a410 comp rx=0 tx=0).stop 2024-09-19T04:21:39.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.391+0000 7f587b8c6740 1 -- 172.21.15.7:0/756583393 shutdown_connections 2024-09-19T04:21:39.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.391+0000 7f587b8c6740 1 --2- 172.21.15.7:0/756583393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564386f6f370 0x564386f7aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.391+0000 7f587b8c6740 1 --2- 172.21.15.7:0/756583393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564386f6a2e0 0x564386f69d80 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.391+0000 7f587b8c6740 1 --2- 172.21.15.7:0/756583393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564386f699a0 0x564386f74080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.391+0000 7f587b8c6740 1 -- 172.21.15.7:0/756583393 >> 172.21.15.7:0/756583393 conn(0x564386f65010 msgr2=0x564386f639a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:39.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.391+0000 7f587b8c6740 1 -- 172.21.15.7:0/756583393 shutdown_connections 2024-09-19T04:21:39.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.391+0000 7f587b8c6740 1 -- 172.21.15.7:0/756583393 wait complete. 2024-09-19T04:21:39.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.392+0000 7f587b8c6740 1 -- start start 2024-09-19T04:21:39.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.392+0000 7f587b8c6740 1 Processor -- start 2024-09-19T04:21:39.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.392+0000 7f587b8c6740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564386f699a0 0x564386f781c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:39.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.392+0000 7f587b8c6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564386f6a2e0 0x564386f78700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:39.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.392+0000 7f587b8c6740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564386f6f370 0x564386f79710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:39.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.392+0000 7f587b8c6740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f58741adf60 con 0x564386f699a0 2024-09-19T04:21:39.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.392+0000 7f587b8c6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f58741ad890 con 0x564386f6a2e0 2024-09-19T04:21:39.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.392+0000 7f587b8c6740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f58741aaab0 con 0x564386f6f370 2024-09-19T04:21:39.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.392+0000 7f587b8c6740 10 client.0 _ll_register_callbacks cb 0x7f586400e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:21:39.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.392+0000 7f587259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564386f699a0 0x564386f781c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:39.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.392+0000 7f587259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564386f699a0 0x564386f781c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36336/0 (socket says 172.21.15.7:36336) 2024-09-19T04:21:39.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.392+0000 7f587259c640 1 -- 172.21.15.7:0/361551388 learned_addr learned my addr 172.21.15.7:0/361551388 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:39.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.392+0000 7f5871d9b640 1 --2- 172.21.15.7:0/361551388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564386f6a2e0 0x564386f78700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:39.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.392+0000 7f5872d9d640 1 --2- 172.21.15.7:0/361551388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564386f6f370 0x564386f79710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:39.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.392+0000 7f587259c640 1 -- 172.21.15.7:0/361551388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564386f6f370 msgr2=0x564386f79710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:39.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.392+0000 7f587259c640 1 --2- 172.21.15.7:0/361551388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564386f6f370 0x564386f79710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.392+0000 7f587259c640 1 -- 172.21.15.7:0/361551388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564386f6a2e0 msgr2=0x564386f78700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:39.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.392+0000 7f587259c640 1 --2- 172.21.15.7:0/361551388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564386f6a2e0 0x564386f78700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.392+0000 7f587259c640 1 -- 172.21.15.7:0/361551388 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564386f79d20 con 0x564386f699a0 2024-09-19T04:21:39.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.392+0000 7f5871d9b640 1 --2- 172.21.15.7:0/361551388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564386f6a2e0 0x564386f78700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:21:39.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.392+0000 7f587259c640 1 --2- 172.21.15.7:0/361551388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564386f699a0 0x564386f781c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f58640a49a0 tx=0x7f58640d21a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b12b33edd2128fb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:39.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.392+0000 7f5859ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:21:39.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.393+0000 7f5859ffb640 1 -- 172.21.15.7:0/361551388 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58640bc2c0 con 0x564386f699a0 2024-09-19T04:21:39.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.393+0000 7f5859ffb640 1 -- 172.21.15.7:0/361551388 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f58640a0150 con 0x564386f699a0 2024-09-19T04:21:39.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.393+0000 7f587b8c6740 1 -- 172.21.15.7:0/361551388 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5868031970 con 0x564386f699a0 2024-09-19T04:21:39.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.393+0000 7f5859ffb640 1 -- 172.21.15.7:0/361551388 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f58640b5220 con 0x564386f699a0 2024-09-19T04:21:39.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.393+0000 7f587b8c6740 10 client.15954 fetch_fsmap learned FSMap version 33 2024-09-19T04:21:39.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.393+0000 7f587b8c6740 1 -- 172.21.15.7:0/361551388 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564386f7b0a0 con 0x564386f699a0 2024-09-19T04:21:39.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.393+0000 7f5859ffb640 1 -- 172.21.15.7:0/361551388 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5868031970 con 0x564386f699a0 2024-09-19T04:21:39.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.393+0000 7f5859ffb640 1 -- 172.21.15.7:0/361551388 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f586409b6b0 con 0x564386f699a0 2024-09-19T04:21:39.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.393+0000 7f587b8c6740 10 client.15954 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T04:21:39.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.393+0000 7f587b8c6740 10 client.15954 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:21:39.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.393+0000 7f587b8c6740 20 client.15954 populate_metadata read hostname 'smithi007' 2024-09-19T04:21:39.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.393+0000 7f587b8c6740 1 --2- 172.21.15.7:0/361551388 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564386fea9f0 0x564386fece10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:39.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.393+0000 7f587b8c6740 4 client.15954 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:21:39.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.393+0000 7f587b8c6740 1 -- 172.21.15.7:0/361551388 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564386ed4d70 con 0x564386fea9f0 2024-09-19T04:21:39.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.393+0000 7f5871d9b640 1 --2- 172.21.15.7:0/361551388 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564386fea9f0 0x564386fece10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:39.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.394+0000 7f5871d9b640 1 --2- 172.21.15.7:0/361551388 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564386fea9f0 0x564386fece10 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab07258318459d7d server_cookie=23d8087568c6f8e2 in_seq=0 out_seq=0 2024-09-19T04:21:39.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.394+0000 7f5859ffb640 10 client.15954 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:21:39.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:39 smithi102 ceph-mon[35446]: pgmap v496: 129 pgs: 129 active+clean; 313 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 388 op/s 2024-09-19T04:21:39.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:39 smithi092 ceph-mon[34940]: pgmap v496: 129 pgs: 129 active+clean; 313 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 388 op/s 2024-09-19T04:21:39.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:39 smithi007 ceph-mon[31360]: pgmap v496: 129 pgs: 129 active+clean; 313 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 388 op/s 2024-09-19T04:21:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.875+0000 7f5859ffb640 1 -- 172.21.15.7:0/361551388 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564386ed4d70 con 0x564386fea9f0 2024-09-19T04:21:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.875+0000 7f5859ffb640 10 client.15954 handle_command_reply: tid=0 2024-09-19T04:21:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.875+0000 7f587b8c6740 1 client.15954 shutdown 2024-09-19T04:21:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.875+0000 7f587b8c6740 1 -- 172.21.15.7:0/361551388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564386f699a0 msgr2=0x564386f781c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.875+0000 7f587b8c6740 1 --2- 172.21.15.7:0/361551388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564386f699a0 0x564386f781c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f58640a49a0 tx=0x7f58640d21a0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.875+0000 7f587b8c6740 1 -- 172.21.15.7:0/361551388 shutdown_connections 2024-09-19T04:21:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.875+0000 7f587b8c6740 1 --2- 172.21.15.7:0/361551388 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564386fea9f0 0x564386fece10 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.875+0000 7f587b8c6740 1 --2- 172.21.15.7:0/361551388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564386f6f370 0x564386f79710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.875+0000 7f587b8c6740 1 --2- 172.21.15.7:0/361551388 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564386f6a2e0 0x564386f78700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.875+0000 7f5859ffb640 0 client.15954 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:21:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.876+0000 7f587b8c6740 1 --2- 172.21.15.7:0/361551388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564386f699a0 0x564386f781c0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.876+0000 7f587b8c6740 1 -- 172.21.15.7:0/361551388 >> 172.21.15.7:0/361551388 conn(0x564386f65010 msgr2=0x564386f666b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.876+0000 7f587b8c6740 1 -- 172.21.15.7:0/361551388 shutdown_connections 2024-09-19T04:21:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.876+0000 7f587b8c6740 1 -- 172.21.15.7:0/361551388 wait complete. 2024-09-19T04:21:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.876+0000 7f587b8c6740 20 client.15954 trim_cache size 0 max 16384 2024-09-19T04:21:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:21:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:21:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:21:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:21:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.877+0000 7f5878b2a640 1 -- 172.21.15.7:0/4168127666 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f585c0a32c0 msgr2=0x7f585c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.877+0000 7f5878b2a640 1 --2- 172.21.15.7:0/4168127666 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f585c0a32c0 0x7f585c0a5780 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f586c009fd0 tx=0x7f586c004a40 comp rx=0 tx=0).stop 2024-09-19T04:21:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.877+0000 7f5878b2a640 1 -- 172.21.15.7:0/4168127666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5874102600 msgr2=0x7f5874101f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.877+0000 7f5878b2a640 1 --2- 172.21.15.7:0/4168127666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5874102600 0x7f5874101f70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f586400e9f0 tx=0x7f586400eeb0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.877+0000 7f5878b2a640 1 -- 172.21.15.7:0/4168127666 shutdown_connections 2024-09-19T04:21:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.877+0000 7f5878b2a640 1 --2- 172.21.15.7:0/4168127666 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f585c0a32c0 0x7f585c0a5780 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.877+0000 7f5878b2a640 1 --2- 172.21.15.7:0/4168127666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5874107860 0x7f5874100af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.877+0000 7f5878b2a640 1 --2- 172.21.15.7:0/4168127666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5874104f30 0x7f58741005b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.877+0000 7f5878b2a640 1 --2- 172.21.15.7:0/4168127666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5874102600 0x7f5874101f70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.877+0000 7f5878b2a640 1 -- 172.21.15.7:0/4168127666 >> 172.21.15.7:0/4168127666 conn(0x7f58740fc1e0 msgr2=0x7f5874103040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:39.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.877+0000 7f5878b2a640 1 -- 172.21.15.7:0/4168127666 shutdown_connections 2024-09-19T04:21:39.881 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:39.877+0000 7f5878b2a640 1 -- 172.21.15.7:0/4168127666 wait complete. 2024-09-19T04:21:40.536 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:21:40.827 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:21:41.279 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:41 smithi007 ceph-mon[31360]: pgmap v497: 129 pgs: 129 active+clean; 323 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 440 op/s 2024-09-19T04:21:41.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:41 smithi102 ceph-mon[35446]: pgmap v497: 129 pgs: 129 active+clean; 323 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 440 op/s 2024-09-19T04:21:41.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:41 smithi092 ceph-mon[34940]: pgmap v497: 129 pgs: 129 active+clean; 323 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 440 op/s 2024-09-19T04:21:41.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.623+0000 7f77f9454640 1 -- 172.21.15.7:0/2414516299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77f41036a0 msgr2=0x7f77f410bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:41.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.623+0000 7f77f9454640 1 --2- 172.21.15.7:0/2414516299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77f41036a0 0x7f77f410bb90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f77dc009900 tx=0x7f77dc02a480 comp rx=0 tx=0).stop 2024-09-19T04:21:41.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.623+0000 7f77f9454640 1 -- 172.21.15.7:0/2414516299 shutdown_connections 2024-09-19T04:21:41.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.623+0000 7f77f9454640 1 --2- 172.21.15.7:0/2414516299 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77f410c160 0x7f77f410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:41.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.623+0000 7f77f9454640 1 --2- 172.21.15.7:0/2414516299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77f41036a0 0x7f77f410bb90 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:41.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.623+0000 7f77f9454640 1 --2- 172.21.15.7:0/2414516299 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f4102d80 0x7f77f4103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:41.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.623+0000 7f77f9454640 1 -- 172.21.15.7:0/2414516299 >> 172.21.15.7:0/2414516299 conn(0x7f77f40fc7a0 msgr2=0x7f77f40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:41.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.623+0000 7f77f9454640 1 -- 172.21.15.7:0/2414516299 shutdown_connections 2024-09-19T04:21:41.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.623+0000 7f77f9454640 1 -- 172.21.15.7:0/2414516299 wait complete. 2024-09-19T04:21:41.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.624+0000 7f77f9454640 1 Processor -- start 2024-09-19T04:21:41.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.624+0000 7f77f9454640 1 -- start start 2024-09-19T04:21:41.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.624+0000 7f77f9454640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f4102d80 0x7f77f41009e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:41.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.624+0000 7f77f9454640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77f41036a0 0x7f77f4100f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:41.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.624+0000 7f77f9454640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77f410c160 0x7f77f4101460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:41.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.624+0000 7f77f9454640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f77f4111f60 con 0x7f77f410c160 2024-09-19T04:21:41.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.624+0000 7f77f9454640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f77f4111de0 con 0x7f77f4102d80 2024-09-19T04:21:41.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.624+0000 7f77f9454640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f77f41120e0 con 0x7f77f41036a0 2024-09-19T04:21:41.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.625+0000 7f77f2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f4102d80 0x7f77f41009e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:41.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.625+0000 7f77f37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77f410c160 0x7f77f4101460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:41.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.625+0000 7f77f2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f4102d80 0x7f77f41009e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:55348/0 (socket says 172.21.15.7:55348) 2024-09-19T04:21:41.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.625+0000 7f77f2ffd640 1 -- 172.21.15.7:0/1539690708 learned_addr learned my addr 172.21.15.7:0/1539690708 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:41.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.625+0000 7f77ebfff640 1 --2- 172.21.15.7:0/1539690708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77f41036a0 0x7f77f4100f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:41.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.625+0000 7f77f37fe640 1 -- 172.21.15.7:0/1539690708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77f41036a0 msgr2=0x7f77f4100f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:41.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.625+0000 7f77f37fe640 1 --2- 172.21.15.7:0/1539690708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77f41036a0 0x7f77f4100f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:41.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.625+0000 7f77f37fe640 1 -- 172.21.15.7:0/1539690708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f4102d80 msgr2=0x7f77f41009e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:41.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.625+0000 7f77f37fe640 1 --2- 172.21.15.7:0/1539690708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f4102d80 0x7f77f41009e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:41.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.625+0000 7f77f37fe640 1 -- 172.21.15.7:0/1539690708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f41a6960 con 0x7f77f410c160 2024-09-19T04:21:41.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.625+0000 7f77f37fe640 1 --2- 172.21.15.7:0/1539690708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77f410c160 0x7f77f4101460 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f77ec00ec50 tx=0x7f77ec00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:41.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.625+0000 7f77f0ff9640 1 -- 172.21.15.7:0/1539690708 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec003b70 con 0x7f77f410c160 2024-09-19T04:21:41.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.625+0000 7f77f0ff9640 1 -- 172.21.15.7:0/1539690708 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77ec003d10 con 0x7f77f410c160 2024-09-19T04:21:41.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.625+0000 7f77f9454640 1 -- 172.21.15.7:0/1539690708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77f41a6c50 con 0x7f77f410c160 2024-09-19T04:21:41.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.625+0000 7f77f0ff9640 1 -- 172.21.15.7:0/1539690708 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ec010890 con 0x7f77f410c160 2024-09-19T04:21:41.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.625+0000 7f77f9454640 1 -- 172.21.15.7:0/1539690708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77f41a7160 con 0x7f77f410c160 2024-09-19T04:21:41.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.626+0000 7f77f9454640 1 -- 172.21.15.7:0/1539690708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77f4103160 con 0x7f77f410c160 2024-09-19T04:21:41.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.628+0000 7f77f0ff9640 1 -- 172.21.15.7:0/1539690708 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f77ec004b40 con 0x7f77f410c160 2024-09-19T04:21:41.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.628+0000 7f77f0ff9640 1 --2- 172.21.15.7:0/1539690708 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f77e00a32c0 0x7f77e00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:41.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.628+0000 7f77f0ff9640 1 -- 172.21.15.7:0/1539690708 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f77ec0d01f0 con 0x7f77f410c160 2024-09-19T04:21:41.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.629+0000 7f77f2ffd640 1 --2- 172.21.15.7:0/1539690708 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f77e00a32c0 0x7f77e00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:41.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.629+0000 7f77f2ffd640 1 --2- 172.21.15.7:0/1539690708 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f77e00a32c0 0x7f77e00a5780 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009c90 tx=0x7f77e4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:41.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.632+0000 7f77f0ff9640 1 -- 172.21.15.7:0/1539690708 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f77ec09cbd0 con 0x7f77f410c160 2024-09-19T04:21:41.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.859+0000 7f77f9454640 1 -- 172.21.15.7:0/1539690708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77f4101f10 con 0x7f77f410c160 2024-09-19T04:21:41.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.860+0000 7f77f0ff9640 1 -- 172.21.15.7:0/1539690708 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11967 (secure 0 0 0) 0x7f77f4101f10 con 0x7f77f410c160 2024-09-19T04:21:41.861 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:21:41.862 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":33,"btime":"2024-09-19T04:21:33:135435+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:21:33.031782+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24496,"mds_2":24482,"mds_3":24478,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24506,24496,24482,24478,24472]},"id":1}]} 2024-09-19T04:21:41.862 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 33 2024-09-19T04:21:41.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.862+0000 7f77f9454640 1 -- 172.21.15.7:0/1539690708 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f77e00a32c0 msgr2=0x7f77e00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:41.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.862+0000 7f77f9454640 1 --2- 172.21.15.7:0/1539690708 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f77e00a32c0 0x7f77e00a5780 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009c90 tx=0x7f77e4005f90 comp rx=0 tx=0).stop 2024-09-19T04:21:41.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.862+0000 7f77f9454640 1 -- 172.21.15.7:0/1539690708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77f410c160 msgr2=0x7f77f4101460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:41.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.862+0000 7f77f9454640 1 --2- 172.21.15.7:0/1539690708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77f410c160 0x7f77f4101460 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f77ec00ec50 tx=0x7f77ec00c6a0 comp rx=0 tx=0).stop 2024-09-19T04:21:41.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.862+0000 7f77f9454640 1 -- 172.21.15.7:0/1539690708 shutdown_connections 2024-09-19T04:21:41.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.862+0000 7f77f9454640 1 --2- 172.21.15.7:0/1539690708 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f77e00a32c0 0x7f77e00a5780 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:41.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.862+0000 7f77f9454640 1 --2- 172.21.15.7:0/1539690708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77f410c160 0x7f77f4101460 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:41.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.862+0000 7f77f9454640 1 --2- 172.21.15.7:0/1539690708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f77f41036a0 0x7f77f4100f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:41.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.862+0000 7f77f9454640 1 --2- 172.21.15.7:0/1539690708 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f4102d80 0x7f77f41009e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:41.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.862+0000 7f77f9454640 1 -- 172.21.15.7:0/1539690708 >> 172.21.15.7:0/1539690708 conn(0x7f77f40fc7a0 msgr2=0x7f77f40fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:41.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.862+0000 7f77f9454640 1 -- 172.21.15.7:0/1539690708 shutdown_connections 2024-09-19T04:21:41.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:41.862+0000 7f77f9454640 1 -- 172.21.15.7:0/1539690708 wait complete. 2024-09-19T04:21:42.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:42 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:21:42.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:42 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1539690708' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:21:42.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:42 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:21:42.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:42 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:21:42.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:42 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:21:42.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:42 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:21:42.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:42 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1539690708' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:21:42.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:42 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:21:42.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:42 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:21:42.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:42 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:21:42.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:42 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:21:42.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:42 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1539690708' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:21:42.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:42 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:21:42.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:42 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:21:42.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:42 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:21:42.753 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24506 quiesce db --set-id 3a24f514 --release --await' 2024-09-19T04:21:42.753 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24506 quiesce db --set-id 3a24f514 --release --await 2024-09-19T04:21:43.018 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:21:43.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:43 smithi007 ceph-mon[31360]: pgmap v498: 129 pgs: 129 active+clean; 326 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 1.3 MiB/s wr, 200 op/s 2024-09-19T04:21:43.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:43 smithi092 ceph-mon[34940]: pgmap v498: 129 pgs: 129 active+clean; 326 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 1.3 MiB/s wr, 200 op/s 2024-09-19T04:21:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.520+0000 7f1f19ae5640 1 -- 172.21.15.7:0/2537898582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f1410c170 msgr2=0x7f1f1410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.520+0000 7f1f19ae5640 1 --2- 172.21.15.7:0/2537898582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f1410c170 0x7f1f1410e610 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c009ca0 tx=0x7f1f0c02a950 comp rx=0 tx=0).stop 2024-09-19T04:21:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.520+0000 7f1f19ae5640 1 -- 172.21.15.7:0/2537898582 shutdown_connections 2024-09-19T04:21:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.520+0000 7f1f19ae5640 1 --2- 172.21.15.7:0/2537898582 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f1410c170 0x7f1f1410e610 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.520+0000 7f1f19ae5640 1 --2- 172.21.15.7:0/2537898582 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f14103660 0x7f1f1410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.520+0000 7f1f19ae5640 1 --2- 172.21.15.7:0/2537898582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f14102d40 0x7f1f14103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.520+0000 7f1f19ae5640 1 -- 172.21.15.7:0/2537898582 >> 172.21.15.7:0/2537898582 conn(0x7f1f140fc7a0 msgr2=0x7f1f140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.521+0000 7f1f19ae5640 1 -- 172.21.15.7:0/2537898582 shutdown_connections 2024-09-19T04:21:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.521+0000 7f1f19ae5640 1 -- 172.21.15.7:0/2537898582 wait complete. 2024-09-19T04:21:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.521+0000 7f1f19ae5640 1 Processor -- start 2024-09-19T04:21:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.521+0000 7f1f19ae5640 1 -- start start 2024-09-19T04:21:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.522+0000 7f1f19ae5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f14102d40 0x7f1f14198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.522+0000 7f1f19ae5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f14103660 0x7f1f14198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.522+0000 7f1f19ae5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f1410c170 0x7f1f1419cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.522+0000 7f1f19ae5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1f14111f70 con 0x7f1f1410c170 2024-09-19T04:21:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.522+0000 7f1f19ae5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1f14111df0 con 0x7f1f14103660 2024-09-19T04:21:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.522+0000 7f1f19ae5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1f141120f0 con 0x7f1f14102d40 2024-09-19T04:21:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.522+0000 7f1f13fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f1410c170 0x7f1f1419cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.522+0000 7f1f13fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f1410c170 0x7f1f1419cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36372/0 (socket says 172.21.15.7:36372) 2024-09-19T04:21:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.522+0000 7f1f13fff640 1 -- 172.21.15.7:0/2789295953 learned_addr learned my addr 172.21.15.7:0/2789295953 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.522+0000 7f1f137fe640 1 --2- 172.21.15.7:0/2789295953 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f14102d40 0x7f1f14198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.522+0000 7f1f0affd640 1 --2- 172.21.15.7:0/2789295953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f14103660 0x7f1f14198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.522+0000 7f1f13fff640 1 -- 172.21.15.7:0/2789295953 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f14102d40 msgr2=0x7f1f14198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.522+0000 7f1f13fff640 1 --2- 172.21.15.7:0/2789295953 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f14102d40 0x7f1f14198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.522+0000 7f1f13fff640 1 -- 172.21.15.7:0/2789295953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f14103660 msgr2=0x7f1f14198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.522+0000 7f1f13fff640 1 --2- 172.21.15.7:0/2789295953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f14103660 0x7f1f14198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.522+0000 7f1f13fff640 1 -- 172.21.15.7:0/2789295953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1419d2e0 con 0x7f1f1410c170 2024-09-19T04:21:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.522+0000 7f1f137fe640 1 --2- 172.21.15.7:0/2789295953 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f14102d40 0x7f1f14198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:21:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.522+0000 7f1f0affd640 1 --2- 172.21.15.7:0/2789295953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f14103660 0x7f1f14198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:21:43.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.522+0000 7f1f13fff640 1 --2- 172.21.15.7:0/2789295953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f1410c170 0x7f1f1419cc00 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c02ae70 tx=0x7f1f0c02f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.523+0000 7f1f117fa640 1 -- 172.21.15.7:0/2789295953 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c034040 con 0x7f1f1410c170 2024-09-19T04:21:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.523+0000 7f1f117fa640 1 -- 172.21.15.7:0/2789295953 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f0c030920 con 0x7f1f1410c170 2024-09-19T04:21:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.523+0000 7f1f19ae5640 1 -- 172.21.15.7:0/2789295953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f1419d570 con 0x7f1f1410c170 2024-09-19T04:21:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.523+0000 7f1f117fa640 1 -- 172.21.15.7:0/2789295953 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c045480 con 0x7f1f1410c170 2024-09-19T04:21:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.523+0000 7f1f19ae5640 1 -- 172.21.15.7:0/2789295953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f141a4eb0 con 0x7f1f1410c170 2024-09-19T04:21:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.525+0000 7f1f117fa640 1 -- 172.21.15.7:0/2789295953 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f1f0c037020 con 0x7f1f1410c170 2024-09-19T04:21:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.525+0000 7f1f1bebe740 1 Processor -- start 2024-09-19T04:21:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.525+0000 7f1f1bebe740 1 -- start start 2024-09-19T04:21:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.525+0000 7f1f1bebe740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928fa3b060 0x55928fa3b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.525+0000 7f1f1bebe740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55928fa3b980 0x55928fa45d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.526+0000 7f1f1bebe740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55928fa46240 0x55928fa48630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.526+0000 7f1f1bebe740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55928f9a0620 con 0x55928fa3b060 2024-09-19T04:21:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.526+0000 7f1f1bebe740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55928f947e50 con 0x55928fa3b980 2024-09-19T04:21:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.526+0000 7f1f1bebe740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55928f99c5e0 con 0x55928fa46240 2024-09-19T04:21:43.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.526+0000 7f1f0affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928fa3b060 0x55928fa3b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:43.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.526+0000 7f1f0affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928fa3b060 0x55928fa3b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36384/0 (socket says 172.21.15.7:36384) 2024-09-19T04:21:43.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.526+0000 7f1f0affd640 1 -- 172.21.15.7:0/2106833504 learned_addr learned my addr 172.21.15.7:0/2106833504 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:43.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.526+0000 7f1f137fe640 1 --2- 172.21.15.7:0/2106833504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55928fa3b980 0x55928fa45d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:43.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.526+0000 7f1f0affd640 1 --2- 172.21.15.7:0/2106833504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55928fa46240 0x55928fa48630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:43.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.526+0000 7f1f117fa640 1 --2- 172.21.15.7:0/2789295953 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1f000a3240 0x7f1f000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:43.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.526+0000 7f1f0affd640 1 -- 172.21.15.7:0/2106833504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55928fa46240 msgr2=0x55928fa48630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:43.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.526+0000 7f1f0affd640 1 --2- 172.21.15.7:0/2106833504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55928fa46240 0x55928fa48630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:43.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.526+0000 7f1f0affd640 1 -- 172.21.15.7:0/2106833504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55928fa3b980 msgr2=0x55928fa45d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:43.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.526+0000 7f1f0affd640 1 --2- 172.21.15.7:0/2106833504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55928fa3b980 0x55928fa45d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:43.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.526+0000 7f1f0affd640 1 -- 172.21.15.7:0/2106833504 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55928f938d40 con 0x55928fa3b060 2024-09-19T04:21:43.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.526+0000 7f1f13fff640 1 --2- 172.21.15.7:0/2789295953 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1f000a3240 0x7f1f000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:43.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.526+0000 7f1f117fa640 1 -- 172.21.15.7:0/2789295953 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f1f0c0f0d00 con 0x7f1f1410c170 2024-09-19T04:21:43.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.526+0000 7f1f0affd640 1 --2- 172.21.15.7:0/2106833504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928fa3b060 0x55928fa3b440 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1efc008fd0 tx=0x7f1efc0085b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6bf3061a909f191 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:43.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.526+0000 7f1f09ffb640 1 -- 172.21.15.7:0/2106833504 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc018030 con 0x55928fa3b060 2024-09-19T04:21:43.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.526+0000 7f1f09ffb640 1 -- 172.21.15.7:0/2106833504 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1efc005500 con 0x55928fa3b060 2024-09-19T04:21:43.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.527+0000 7f1f09ffb640 1 -- 172.21.15.7:0/2106833504 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc00c750 con 0x55928fa3b060 2024-09-19T04:21:43.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.527+0000 7f1f1bebe740 1 -- 172.21.15.7:0/2106833504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928fa3b060 msgr2=0x55928fa3b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:43.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.527+0000 7f1f1bebe740 1 --2- 172.21.15.7:0/2106833504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928fa3b060 0x55928fa3b440 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1efc008fd0 tx=0x7f1efc0085b0 comp rx=0 tx=0).stop 2024-09-19T04:21:43.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.527+0000 7f1f13fff640 1 --2- 172.21.15.7:0/2789295953 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1f000a3240 0x7f1f000a5700 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c0ee430 tx=0x7f1f0c03c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:43.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.527+0000 7f1f1bebe740 1 -- 172.21.15.7:0/2106833504 shutdown_connections 2024-09-19T04:21:43.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.527+0000 7f1f1bebe740 1 --2- 172.21.15.7:0/2106833504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55928fa46240 0x55928fa48630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:43.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.527+0000 7f1f1bebe740 1 --2- 172.21.15.7:0/2106833504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55928fa3b980 0x55928fa45d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:43.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.527+0000 7f1f1bebe740 1 --2- 172.21.15.7:0/2106833504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928fa3b060 0x55928fa3b440 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:43.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.527+0000 7f1f1bebe740 1 -- 172.21.15.7:0/2106833504 >> 172.21.15.7:0/2106833504 conn(0x55928fa375f0 msgr2=0x55928fa379d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:43.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.527+0000 7f1f1bebe740 1 -- 172.21.15.7:0/2106833504 shutdown_connections 2024-09-19T04:21:43.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.527+0000 7f1f1bebe740 1 -- 172.21.15.7:0/2106833504 wait complete. 2024-09-19T04:21:43.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.528+0000 7f1f1bebe740 1 -- start start 2024-09-19T04:21:43.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.528+0000 7f1f1bebe740 1 Processor -- start 2024-09-19T04:21:43.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.528+0000 7f1f1bebe740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55928fa3b060 0x55928fa430b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:43.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.528+0000 7f1f1bebe740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55928fa3b980 0x55928fa435f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:43.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.528+0000 7f1f1bebe740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928fa46240 0x55928fa43b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:43.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.528+0000 7f1f1bebe740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55928fa48e10 con 0x55928fa46240 2024-09-19T04:21:43.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.528+0000 7f1f1bebe740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55928f928f10 con 0x55928fa3b980 2024-09-19T04:21:43.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.528+0000 7f1f1bebe740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55928fa48f90 con 0x55928fa3b060 2024-09-19T04:21:43.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.528+0000 7f1f1bebe740 10 client.0 _ll_register_callbacks cb 0x55928f94cdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:21:43.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.528+0000 7f1f0affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928fa46240 0x55928fa43b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:43.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.528+0000 7f1f0affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928fa46240 0x55928fa43b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36386/0 (socket says 172.21.15.7:36386) 2024-09-19T04:21:43.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.528+0000 7f1f0affd640 1 -- 172.21.15.7:0/2865591141 learned_addr learned my addr 172.21.15.7:0/2865591141 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:43.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.528+0000 7f1f0affd640 1 --2- 172.21.15.7:0/2865591141 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55928fa3b060 0x55928fa430b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.528+0000 7f1f137fe640 1 --2- 172.21.15.7:0/2865591141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55928fa3b980 0x55928fa435f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.529+0000 7f1f0affd640 1 -- 172.21.15.7:0/2865591141 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55928fa3b060 msgr2=0x55928fa430b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.529+0000 7f1f0affd640 1 --2- 172.21.15.7:0/2865591141 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55928fa3b060 0x55928fa430b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.529+0000 7f1f0affd640 1 -- 172.21.15.7:0/2865591141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55928fa3b980 msgr2=0x55928fa435f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.529+0000 7f1f0affd640 1 --2- 172.21.15.7:0/2865591141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55928fa3b980 0x55928fa435f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.529+0000 7f1f0affd640 1 -- 172.21.15.7:0/2865591141 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55928f6af580 con 0x55928fa46240 2024-09-19T04:21:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.529+0000 7f1f0affd640 1 --2- 172.21.15.7:0/2865591141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928fa46240 0x55928fa43b30 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f1efc004b60 tx=0x7f1efc004d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f98fe566c6237c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.529+0000 7f1ef2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:21:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.529+0000 7f1ef2ffd640 1 -- 172.21.15.7:0/2865591141 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc004260 con 0x55928fa46240 2024-09-19T04:21:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.529+0000 7f1ef2ffd640 1 -- 172.21.15.7:0/2865591141 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f1efc004400 con 0x55928fa46240 2024-09-19T04:21:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.529+0000 7f1f1bebe740 1 -- 172.21.15.7:0/2865591141 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1efc005500 con 0x55928fa46240 2024-09-19T04:21:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.529+0000 7f1ef2ffd640 1 -- 172.21.15.7:0/2865591141 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f1efc0035f0 con 0x55928fa46240 2024-09-19T04:21:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.529+0000 7f1f1bebe740 10 client.15972 fetch_fsmap learned FSMap version 33 2024-09-19T04:21:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.529+0000 7f1f1bebe740 1 -- 172.21.15.7:0/2865591141 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55928f779960 con 0x55928fa46240 2024-09-19T04:21:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.529+0000 7f1ef2ffd640 1 -- 172.21.15.7:0/2865591141 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1efc005500 con 0x55928fa46240 2024-09-19T04:21:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.529+0000 7f1ef2ffd640 1 -- 172.21.15.7:0/2865591141 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f1efc00c550 con 0x55928fa46240 2024-09-19T04:21:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.530+0000 7f1f1bebe740 10 client.15972 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T04:21:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.530+0000 7f1f1bebe740 10 client.15972 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:21:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.530+0000 7f1f1bebe740 20 client.15972 populate_metadata read hostname 'smithi007' 2024-09-19T04:21:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.530+0000 7f1f1bebe740 1 --2- 172.21.15.7:0/2865591141 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55928fa55c10 0x55928fa58000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.530+0000 7f1f1bebe740 4 client.15972 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:21:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.530+0000 7f1f1bebe740 1 -- 172.21.15.7:0/2865591141 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55928f9adb90 con 0x55928fa55c10 2024-09-19T04:21:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.530+0000 7f1f137fe640 1 --2- 172.21.15.7:0/2865591141 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55928fa55c10 0x55928fa58000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.530+0000 7f1f137fe640 1 --2- 172.21.15.7:0/2865591141 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55928fa55c10 0x55928fa58000 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b8373a9582fdb6e server_cookie=ef3de99a56735db3 in_seq=0 out_seq=0 2024-09-19T04:21:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.530+0000 7f1ef2ffd640 10 client.15972 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:21:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.531+0000 7f1ef2ffd640 1 -- 172.21.15.7:0/2865591141 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55928f9adb90 con 0x55928fa55c10 2024-09-19T04:21:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.531+0000 7f1ef2ffd640 10 client.15972 handle_command_reply: tid=0 2024-09-19T04:21:43.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.531+0000 7f1f1bebe740 1 client.15972 shutdown 2024-09-19T04:21:43.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.531+0000 7f1f1bebe740 1 -- 172.21.15.7:0/2865591141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928fa46240 msgr2=0x55928fa43b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:43.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.531+0000 7f1f1bebe740 1 --2- 172.21.15.7:0/2865591141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928fa46240 0x55928fa43b30 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f1efc004b60 tx=0x7f1efc004d80 comp rx=0 tx=0).stop 2024-09-19T04:21:43.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.531+0000 7f1f1bebe740 1 -- 172.21.15.7:0/2865591141 shutdown_connections 2024-09-19T04:21:43.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.531+0000 7f1f1bebe740 1 --2- 172.21.15.7:0/2865591141 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55928fa55c10 0x55928fa58000 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:43.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.531+0000 7f1f1bebe740 1 --2- 172.21.15.7:0/2865591141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928fa46240 0x55928fa43b30 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:43.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.531+0000 7f1f1bebe740 1 --2- 172.21.15.7:0/2865591141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55928fa3b980 0x55928fa435f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:43.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.531+0000 7f1f1bebe740 1 --2- 172.21.15.7:0/2865591141 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55928fa3b060 0x55928fa430b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:43.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.531+0000 7f1ef2ffd640 0 client.15972 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:21:43.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.531+0000 7f1f1bebe740 1 -- 172.21.15.7:0/2865591141 >> 172.21.15.7:0/2865591141 conn(0x55928fa375f0 msgr2=0x55928fa3d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:43.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.531+0000 7f1f1bebe740 1 -- 172.21.15.7:0/2865591141 shutdown_connections 2024-09-19T04:21:43.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.531+0000 7f1f1bebe740 1 -- 172.21.15.7:0/2865591141 wait complete. 2024-09-19T04:21:43.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.532+0000 7f1f1bebe740 20 client.15972 trim_cache size 0 max 16384 2024-09-19T04:21:43.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.548+0000 7f1f1bebe740 1 Processor -- start 2024-09-19T04:21:43.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.548+0000 7f1f1bebe740 1 -- start start 2024-09-19T04:21:43.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.548+0000 7f1f1bebe740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928fa3b060 0x55928fa57e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:43.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.549+0000 7f1f1bebe740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55928fa3b980 0x55928fa3dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:43.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.549+0000 7f1f1bebe740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55928fa46240 0x55928fa36640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:43.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.549+0000 7f1f1bebe740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1f141aeca0 con 0x55928fa3b060 2024-09-19T04:21:43.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.549+0000 7f1f1bebe740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1f141b0870 con 0x55928fa46240 2024-09-19T04:21:43.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.549+0000 7f1f1bebe740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1f141af370 con 0x55928fa3b980 2024-09-19T04:21:43.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.549+0000 7f1f0affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928fa3b060 0x55928fa57e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:43.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.549+0000 7f1f0affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928fa3b060 0x55928fa57e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36396/0 (socket says 172.21.15.7:36396) 2024-09-19T04:21:43.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.549+0000 7f1f0affd640 1 -- 172.21.15.7:0/2378814731 learned_addr learned my addr 172.21.15.7:0/2378814731 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:43.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.549+0000 7f1f137fe640 1 --2- 172.21.15.7:0/2378814731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55928fa3b980 0x55928fa3dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:43.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.549+0000 7f1f0affd640 1 -- 172.21.15.7:0/2378814731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55928fa3b980 msgr2=0x55928fa3dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:43.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.549+0000 7f1f0affd640 1 --2- 172.21.15.7:0/2378814731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55928fa3b980 0x55928fa3dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:43.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.549+0000 7f1f0affd640 1 -- 172.21.15.7:0/2378814731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55928fa46240 msgr2=0x55928fa36640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:43.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.549+0000 7f1f0affd640 1 --2- 172.21.15.7:0/2378814731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55928fa46240 0x55928fa36640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:43.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.549+0000 7f1f0affd640 1 -- 172.21.15.7:0/2378814731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55928fa37420 con 0x55928fa3b060 2024-09-19T04:21:43.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.549+0000 7f1f0affd640 1 --2- 172.21.15.7:0/2378814731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928fa3b060 0x55928fa57e50 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f1efc009010 tx=0x7f1efc008530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a997e658c0ca9a3b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:43.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.549+0000 7f1f097fa640 1 -- 172.21.15.7:0/2378814731 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc018040 con 0x55928fa3b060 2024-09-19T04:21:43.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.549+0000 7f1f097fa640 1 -- 172.21.15.7:0/2378814731 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1efc012d60 con 0x55928fa3b060 2024-09-19T04:21:43.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.549+0000 7f1f097fa640 1 -- 172.21.15.7:0/2378814731 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc003c70 con 0x55928fa3b060 2024-09-19T04:21:43.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.550+0000 7f1f1bebe740 1 -- 172.21.15.7:0/2378814731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928fa3b060 msgr2=0x55928fa57e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:43.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.550+0000 7f1f1bebe740 1 --2- 172.21.15.7:0/2378814731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928fa3b060 0x55928fa57e50 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f1efc009010 tx=0x7f1efc008530 comp rx=0 tx=0).stop 2024-09-19T04:21:43.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.550+0000 7f1f1bebe740 1 -- 172.21.15.7:0/2378814731 shutdown_connections 2024-09-19T04:21:43.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.550+0000 7f1f1bebe740 1 --2- 172.21.15.7:0/2378814731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55928fa46240 0x55928fa36640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:43.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.550+0000 7f1f1bebe740 1 --2- 172.21.15.7:0/2378814731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55928fa3b980 0x55928fa3dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:43.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.550+0000 7f1f1bebe740 1 --2- 172.21.15.7:0/2378814731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928fa3b060 0x55928fa57e50 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.550+0000 7f1f1bebe740 1 -- 172.21.15.7:0/2378814731 >> 172.21.15.7:0/2378814731 conn(0x55928fa375f0 msgr2=0x55928fa35f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.550+0000 7f1f1bebe740 1 -- 172.21.15.7:0/2378814731 shutdown_connections 2024-09-19T04:21:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.550+0000 7f1f1bebe740 1 -- 172.21.15.7:0/2378814731 wait complete. 2024-09-19T04:21:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.550+0000 7f1f1bebe740 1 -- start start 2024-09-19T04:21:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.551+0000 7f1f1bebe740 1 Processor -- start 2024-09-19T04:21:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.551+0000 7f1f1bebe740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55928fa3b060 0x55928fa4a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.551+0000 7f1f1bebe740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928fa3b980 0x55928fa4ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.551+0000 7f1f1bebe740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55928fa46240 0x55928fabf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.551+0000 7f1f1bebe740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1f141b0110 con 0x55928fa3b980 2024-09-19T04:21:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.551+0000 7f1f1bebe740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1f141afa40 con 0x55928fa46240 2024-09-19T04:21:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.551+0000 7f1f1bebe740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1f141acc60 con 0x55928fa3b060 2024-09-19T04:21:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.551+0000 7f1f1bebe740 10 client.0 _ll_register_callbacks cb 0x7f1efc004770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:21:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.551+0000 7f1f137fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928fa3b980 0x55928fa4ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:43.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.551+0000 7f1f137fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928fa3b980 0x55928fa4ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36406/0 (socket says 172.21.15.7:36406) 2024-09-19T04:21:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.551+0000 7f1f137fe640 1 -- 172.21.15.7:0/1987424110 learned_addr learned my addr 172.21.15.7:0/1987424110 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.551+0000 7f1f0affd640 1 --2- 172.21.15.7:0/1987424110 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55928fa3b060 0x55928fa4a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.551+0000 7f1f0affd640 1 --2- 172.21.15.7:0/1987424110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55928fa46240 0x55928fabf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.551+0000 7f1f137fe640 1 -- 172.21.15.7:0/1987424110 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55928fa3b060 msgr2=0x55928fa4a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.551+0000 7f1f137fe640 1 --2- 172.21.15.7:0/1987424110 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55928fa3b060 0x55928fa4a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.551+0000 7f1f137fe640 1 -- 172.21.15.7:0/1987424110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55928fa46240 msgr2=0x55928fabf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.551+0000 7f1f137fe640 1 --2- 172.21.15.7:0/1987424110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55928fa46240 0x55928fabf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.551+0000 7f1f137fe640 1 -- 172.21.15.7:0/1987424110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55928fa38280 con 0x55928fa3b980 2024-09-19T04:21:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.552+0000 7f1f137fe640 1 --2- 172.21.15.7:0/1987424110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928fa3b980 0x55928fa4ac90 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f1f04004700 tx=0x7f1f0400bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b7a407f606dfcf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.552+0000 7f1ef2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:21:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.552+0000 7f1ef2ffd640 1 -- 172.21.15.7:0/1987424110 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f04005030 con 0x55928fa3b980 2024-09-19T04:21:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.552+0000 7f1ef2ffd640 1 -- 172.21.15.7:0/1987424110 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f1f040051d0 con 0x55928fa3b980 2024-09-19T04:21:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.552+0000 7f1f1bebe740 1 -- 172.21.15.7:0/1987424110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1efc012d60 con 0x55928fa3b980 2024-09-19T04:21:43.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.552+0000 7f1ef2ffd640 1 -- 172.21.15.7:0/1987424110 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f1f0402c050 con 0x55928fa3b980 2024-09-19T04:21:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.552+0000 7f1f1bebe740 10 client.15978 fetch_fsmap learned FSMap version 33 2024-09-19T04:21:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.552+0000 7f1f1bebe740 1 -- 172.21.15.7:0/1987424110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55928fac0fd0 con 0x55928fa3b980 2024-09-19T04:21:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.552+0000 7f1ef2ffd640 1 -- 172.21.15.7:0/1987424110 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1efc012d60 con 0x55928fa3b980 2024-09-19T04:21:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.553+0000 7f1ef2ffd640 1 -- 172.21.15.7:0/1987424110 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f1f0401d420 con 0x55928fa3b980 2024-09-19T04:21:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.553+0000 7f1f1bebe740 10 client.15978 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T04:21:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.553+0000 7f1f1bebe740 10 client.15978 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:21:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.553+0000 7f1f1bebe740 20 client.15978 populate_metadata read hostname 'smithi007' 2024-09-19T04:21:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.553+0000 7f1f1bebe740 1 --2- 172.21.15.7:0/1987424110 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55928fac1810 0x55928fac3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.553+0000 7f1f1bebe740 4 client.15978 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3a24f514", "release": true, "await": true}] 2024-09-19T04:21:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.553+0000 7f1f1bebe740 1 -- 172.21.15.7:0/1987424110 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3a24f514", "release": true, "await": true}) -- 0x55928f9a80a0 con 0x55928fac1810 2024-09-19T04:21:43.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.553+0000 7f1f0affd640 1 --2- 172.21.15.7:0/1987424110 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55928fac1810 0x55928fac3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:43.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.553+0000 7f1ef2ffd640 10 client.15978 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:21:43.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:43.553+0000 7f1f0affd640 1 --2- 172.21.15.7:0/1987424110 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55928fac1810 0x55928fac3c30 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6474c9624cd10b9d server_cookie=da9845671b8b7722 in_seq=0 out_seq=0 2024-09-19T04:21:43.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:43 smithi102 ceph-mon[35446]: pgmap v498: 129 pgs: 129 active+clean; 326 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 1.3 MiB/s wr, 200 op/s 2024-09-19T04:21:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:44.333+0000 7f1ef2ffd640 1 -- 172.21.15.7:0/1987424110 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55928f9a80a0 con 0x55928fac1810 2024-09-19T04:21:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:44.333+0000 7f1ef2ffd640 10 client.15978 handle_command_reply: tid=0 2024-09-19T04:21:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:44.333+0000 7f1f1bebe740 1 client.15978 shutdown 2024-09-19T04:21:44.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:44.333+0000 7f1f1bebe740 1 -- 172.21.15.7:0/1987424110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928fa3b980 msgr2=0x55928fa4ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:44.333+0000 7f1f1bebe740 1 --2- 172.21.15.7:0/1987424110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928fa3b980 0x55928fa4ac90 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f1f04004700 tx=0x7f1f0400bdf0 comp rx=0 tx=0).stop 2024-09-19T04:21:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:44.333+0000 7f1f1bebe740 1 -- 172.21.15.7:0/1987424110 shutdown_connections 2024-09-19T04:21:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:44.333+0000 7f1f1bebe740 1 --2- 172.21.15.7:0/1987424110 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55928fac1810 0x55928fac3c30 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:44.334+0000 7f1f1bebe740 1 --2- 172.21.15.7:0/1987424110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55928fa46240 0x55928fabf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:44.334+0000 7f1f1bebe740 1 --2- 172.21.15.7:0/1987424110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55928fa3b980 0x55928fa4ac90 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:44.334+0000 7f1f1bebe740 1 --2- 172.21.15.7:0/1987424110 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55928fa3b060 0x55928fa4a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:44.334+0000 7f1f1bebe740 1 -- 172.21.15.7:0/1987424110 >> 172.21.15.7:0/1987424110 conn(0x55928fa375f0 msgr2=0x55928fa43890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:44.334+0000 7f1ef2ffd640 0 client.15978 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:21:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:44.334+0000 7f1f1bebe740 1 -- 172.21.15.7:0/1987424110 shutdown_connections 2024-09-19T04:21:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:44.334+0000 7f1f1bebe740 1 -- 172.21.15.7:0/1987424110 wait complete. 2024-09-19T04:21:44.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:44.334+0000 7f1f1bebe740 20 client.15978 trim_cache size 0 max 16384 2024-09-19T04:21:44.337 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:21:44.337 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 33, 2024-09-19T04:21:44.337 INFO:teuthology.orchestra.run.smithi007.stdout: "leader": 24506, 2024-09-19T04:21:44.337 INFO:teuthology.orchestra.run.smithi007.stdout: "set_version": 20, 2024-09-19T04:21:44.337 INFO:teuthology.orchestra.run.smithi007.stdout: "sets": { 2024-09-19T04:21:44.337 INFO:teuthology.orchestra.run.smithi007.stdout: "3a24f514": { 2024-09-19T04:21:44.337 INFO:teuthology.orchestra.run.smithi007.stdout: "version": 20, 2024-09-19T04:21:44.337 INFO:teuthology.orchestra.run.smithi007.stdout: "age_ref": 0.0, 2024-09-19T04:21:44.337 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:21:44.337 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RELEASED", 2024-09-19T04:21:44.337 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:21:44.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:21:44.338 INFO:teuthology.orchestra.run.smithi007.stdout: "timeout": 90.0, 2024-09-19T04:21:44.338 INFO:teuthology.orchestra.run.smithi007.stdout: "expiration": 149.8, 2024-09-19T04:21:44.338 INFO:teuthology.orchestra.run.smithi007.stdout: "members": { 2024-09-19T04:21:44.338 INFO:teuthology.orchestra.run.smithi007.stdout: "file:/": { 2024-09-19T04:21:44.338 INFO:teuthology.orchestra.run.smithi007.stdout: "excluded": false, 2024-09-19T04:21:44.338 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:21:44.338 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RELEASED", 2024-09-19T04:21:44.338 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:21:44.338 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:21:44.338 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:21:44.338 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:21:44.338 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:21:44.338 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:21:44.338 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:21:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:44.335+0000 7f1f19ae5640 1 -- 172.21.15.7:0/2789295953 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1f000a3240 msgr2=0x7f1f000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:44.335+0000 7f1f19ae5640 1 --2- 172.21.15.7:0/2789295953 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1f000a3240 0x7f1f000a5700 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c0ee430 tx=0x7f1f0c03c040 comp rx=0 tx=0).stop 2024-09-19T04:21:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:44.335+0000 7f1f19ae5640 1 -- 172.21.15.7:0/2789295953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f1410c170 msgr2=0x7f1f1419cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:44.335+0000 7f1f19ae5640 1 --2- 172.21.15.7:0/2789295953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f1410c170 0x7f1f1419cc00 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c02ae70 tx=0x7f1f0c02f5b0 comp rx=0 tx=0).stop 2024-09-19T04:21:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:44.335+0000 7f1f19ae5640 1 -- 172.21.15.7:0/2789295953 shutdown_connections 2024-09-19T04:21:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:44.335+0000 7f1f19ae5640 1 --2- 172.21.15.7:0/2789295953 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1f000a3240 0x7f1f000a5700 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:44.335+0000 7f1f19ae5640 1 --2- 172.21.15.7:0/2789295953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f1410c170 0x7f1f1419cc00 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:44.335+0000 7f1f19ae5640 1 --2- 172.21.15.7:0/2789295953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f14103660 0x7f1f14198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:44.335+0000 7f1f19ae5640 1 --2- 172.21.15.7:0/2789295953 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f14102d40 0x7f1f14198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:44.335+0000 7f1f19ae5640 1 -- 172.21.15.7:0/2789295953 >> 172.21.15.7:0/2789295953 conn(0x7f1f140fc7a0 msgr2=0x7f1f140fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:44.335+0000 7f1f19ae5640 1 -- 172.21.15.7:0/2789295953 shutdown_connections 2024-09-19T04:21:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:44.335+0000 7f1f19ae5640 1 -- 172.21.15.7:0/2789295953 wait complete. 2024-09-19T04:21:44.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:44 smithi092 ceph-mon[34940]: pgmap v499: 129 pgs: 129 active+clean; 315 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 1.4 MiB/s wr, 202 op/s 2024-09-19T04:21:44.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:44 smithi007 ceph-mon[31360]: pgmap v499: 129 pgs: 129 active+clean; 315 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 1.4 MiB/s wr, 202 op/s 2024-09-19T04:21:44.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:44 smithi102 ceph-mon[35446]: pgmap v499: 129 pgs: 129 active+clean; 315 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 1.4 MiB/s wr, 202 op/s 2024-09-19T04:21:45.188 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3a24f514', total seconds elapsed: 34.4 2024-09-19T04:21:45.188 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.8 2024-09-19T04:21:45.189 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:21:45.466 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:21:45.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.983+0000 7f440ea80640 1 -- 172.21.15.7:0/2008738079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4408100a80 msgr2=0x7f4408100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:45.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.983+0000 7f440ea80640 1 --2- 172.21.15.7:0/2008738079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4408100a80 0x7f4408100ee0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f43f4009930 tx=0x7f43f402a420 comp rx=0 tx=0).stop 2024-09-19T04:21:45.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.983+0000 7f440ea80640 1 -- 172.21.15.7:0/2008738079 shutdown_connections 2024-09-19T04:21:45.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.983+0000 7f440ea80640 1 --2- 172.21.15.7:0/2008738079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4408101420 0x7f440810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:45.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.983+0000 7f440ea80640 1 --2- 172.21.15.7:0/2008738079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4408100a80 0x7f4408100ee0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:45.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.983+0000 7f440ea80640 1 --2- 172.21.15.7:0/2008738079 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4408106a80 0x7f4408106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:45.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.983+0000 7f440ea80640 1 -- 172.21.15.7:0/2008738079 >> 172.21.15.7:0/2008738079 conn(0x7f44080fc7a0 msgr2=0x7f44080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:45.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.983+0000 7f440ea80640 1 -- 172.21.15.7:0/2008738079 shutdown_connections 2024-09-19T04:21:45.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.983+0000 7f440ea80640 1 -- 172.21.15.7:0/2008738079 wait complete. 2024-09-19T04:21:45.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.984+0000 7f440ea80640 1 Processor -- start 2024-09-19T04:21:45.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.984+0000 7f440ea80640 1 -- start start 2024-09-19T04:21:45.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.984+0000 7f440ea80640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4408100a80 0x7f440810e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:45.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.984+0000 7f440ea80640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4408101420 0x7f440810e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:45.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.984+0000 7f440ea80640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4408106a80 0x7f440810ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:45.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.984+0000 7f440ea80640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4408111fd0 con 0x7f4408100a80 2024-09-19T04:21:45.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.984+0000 7f440ea80640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4408111e50 con 0x7f4408106a80 2024-09-19T04:21:45.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.984+0000 7f440ea80640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4408112150 con 0x7f4408101420 2024-09-19T04:21:45.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.984+0000 7f440c81c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4408100a80 0x7f440810e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:45.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.984+0000 7f440c81c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4408100a80 0x7f440810e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36412/0 (socket says 172.21.15.7:36412) 2024-09-19T04:21:45.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.984+0000 7f440c81c640 1 -- 172.21.15.7:0/1949678678 learned_addr learned my addr 172.21.15.7:0/1949678678 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:45.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.985+0000 7f440d01d640 1 --2- 172.21.15.7:0/1949678678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4408106a80 0x7f440810ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:45.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.985+0000 7f4407fff640 1 --2- 172.21.15.7:0/1949678678 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4408101420 0x7f440810e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:45.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.985+0000 7f440c81c640 1 -- 172.21.15.7:0/1949678678 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4408101420 msgr2=0x7f440810e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:45.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.985+0000 7f440c81c640 1 --2- 172.21.15.7:0/1949678678 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4408101420 0x7f440810e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:45.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.985+0000 7f440c81c640 1 -- 172.21.15.7:0/1949678678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4408106a80 msgr2=0x7f440810ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:45.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.985+0000 7f440c81c640 1 --2- 172.21.15.7:0/1949678678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4408106a80 0x7f440810ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:45.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.985+0000 7f440c81c640 1 -- 172.21.15.7:0/1949678678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44081aae20 con 0x7f4408100a80 2024-09-19T04:21:45.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.985+0000 7f440c81c640 1 --2- 172.21.15.7:0/1949678678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4408100a80 0x7f440810e260 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f43fc00e9f0 tx=0x7f43fc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:45.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.985+0000 7f4405ffb640 1 -- 172.21.15.7:0/1949678678 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43fc00cd80 con 0x7f4408100a80 2024-09-19T04:21:45.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.985+0000 7f4405ffb640 1 -- 172.21.15.7:0/1949678678 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43fc010910 con 0x7f4408100a80 2024-09-19T04:21:45.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.985+0000 7f4405ffb640 1 -- 172.21.15.7:0/1949678678 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43fc018990 con 0x7f4408100a80 2024-09-19T04:21:45.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.985+0000 7f440ea80640 1 -- 172.21.15.7:0/1949678678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44081aaff0 con 0x7f4408100a80 2024-09-19T04:21:45.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.985+0000 7f440ea80640 1 -- 172.21.15.7:0/1949678678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44081ab480 con 0x7f4408100a80 2024-09-19T04:21:45.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.986+0000 7f440ea80640 1 -- 172.21.15.7:0/1949678678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44081021c0 con 0x7f4408100a80 2024-09-19T04:21:45.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.988+0000 7f4405ffb640 1 -- 172.21.15.7:0/1949678678 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f43fc010ac0 con 0x7f4408100a80 2024-09-19T04:21:45.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.989+0000 7f4405ffb640 1 --2- 172.21.15.7:0/1949678678 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f43f80a32c0 0x7f43f80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:45.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.989+0000 7f4407fff640 1 --2- 172.21.15.7:0/1949678678 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f43f80a32c0 0x7f43f80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:45.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.989+0000 7f4405ffb640 1 -- 172.21.15.7:0/1949678678 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f43fc0cffb0 con 0x7f4408100a80 2024-09-19T04:21:45.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.989+0000 7f4407fff640 1 --2- 172.21.15.7:0/1949678678 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f43f80a32c0 0x7f43f80a5780 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f440819c5b0 tx=0x7f43f4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:45.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:45.993+0000 7f4405ffb640 1 -- 172.21.15.7:0/1949678678 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f43fc09c900 con 0x7f4408100a80 2024-09-19T04:21:46.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:46.265+0000 7f440ea80640 1 -- 172.21.15.7:0/1949678678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4408108ff0 con 0x7f4408100a80 2024-09-19T04:21:46.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:46.265+0000 7f4405ffb640 1 -- 172.21.15.7:0/1949678678 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11967 (secure 0 0 0) 0x7f43fc09c200 con 0x7f4408100a80 2024-09-19T04:21:46.267 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:21:46.267 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":33,"btime":"2024-09-19T04:21:33:135435+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:21:33.031782+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24496,"mds_2":24482,"mds_3":24478,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24506,24496,24482,24478,24472]},"id":1}]} 2024-09-19T04:21:46.268 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 33 2024-09-19T04:21:46.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:46.268+0000 7f440ea80640 1 -- 172.21.15.7:0/1949678678 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f43f80a32c0 msgr2=0x7f43f80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:46.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:46.268+0000 7f440ea80640 1 --2- 172.21.15.7:0/1949678678 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f43f80a32c0 0x7f43f80a5780 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f440819c5b0 tx=0x7f43f4005a20 comp rx=0 tx=0).stop 2024-09-19T04:21:46.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:46.268+0000 7f440ea80640 1 -- 172.21.15.7:0/1949678678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4408100a80 msgr2=0x7f440810e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:46.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:46.268+0000 7f440ea80640 1 --2- 172.21.15.7:0/1949678678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4408100a80 0x7f440810e260 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f43fc00e9f0 tx=0x7f43fc00eeb0 comp rx=0 tx=0).stop 2024-09-19T04:21:46.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:46.268+0000 7f440ea80640 1 -- 172.21.15.7:0/1949678678 shutdown_connections 2024-09-19T04:21:46.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:46.268+0000 7f440ea80640 1 --2- 172.21.15.7:0/1949678678 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f43f80a32c0 0x7f43f80a5780 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:46.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:46.268+0000 7f440ea80640 1 --2- 172.21.15.7:0/1949678678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4408106a80 0x7f440810ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:46.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:46.268+0000 7f440ea80640 1 --2- 172.21.15.7:0/1949678678 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4408101420 0x7f440810e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:46.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:46.268+0000 7f440ea80640 1 --2- 172.21.15.7:0/1949678678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4408100a80 0x7f440810e260 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:46.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:46.268+0000 7f440ea80640 1 -- 172.21.15.7:0/1949678678 >> 172.21.15.7:0/1949678678 conn(0x7f44080fc7a0 msgr2=0x7f44080fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:46.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:46.268+0000 7f440ea80640 1 -- 172.21.15.7:0/1949678678 shutdown_connections 2024-09-19T04:21:46.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:46.268+0000 7f440ea80640 1 -- 172.21.15.7:0/1949678678 wait complete. 2024-09-19T04:21:46.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:46 smithi007 ceph-mon[31360]: pgmap v500: 129 pgs: 129 active+clean; 314 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 1.4 MiB/s wr, 230 op/s 2024-09-19T04:21:46.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:46 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1949678678' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:21:46.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:46 smithi102 ceph-mon[35446]: pgmap v500: 129 pgs: 129 active+clean; 314 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 1.4 MiB/s wr, 230 op/s 2024-09-19T04:21:46.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:46 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1949678678' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:21:46.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:46 smithi092 ceph-mon[34940]: pgmap v500: 129 pgs: 129 active+clean; 314 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 1.4 MiB/s wr, 230 op/s 2024-09-19T04:21:46.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:46 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1949678678' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:21:47.076 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24506 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0' 2024-09-19T04:21:47.076 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24506 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0 2024-09-19T04:21:47.353 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:21:47.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.865+0000 7fb9af724640 1 -- 172.21.15.7:0/1234036728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9a8077040 msgr2=0x7fb9a81124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:47.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.865+0000 7fb9af724640 1 --2- 172.21.15.7:0/1234036728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9a8077040 0x7fb9a81124f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fb998009900 tx=0x7fb99802a410 comp rx=0 tx=0).stop 2024-09-19T04:21:47.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.865+0000 7fb9af724640 1 -- 172.21.15.7:0/1234036728 shutdown_connections 2024-09-19T04:21:47.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.865+0000 7fb9af724640 1 --2- 172.21.15.7:0/1234036728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9a8112a30 0x7fb9a8114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:47.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.865+0000 7fb9af724640 1 --2- 172.21.15.7:0/1234036728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9a8077040 0x7fb9a81124f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:47.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.865+0000 7fb9af724640 1 --2- 172.21.15.7:0/1234036728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9a8076720 0x7fb9a8076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:47.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.865+0000 7fb9af724640 1 -- 172.21.15.7:0/1234036728 >> 172.21.15.7:0/1234036728 conn(0x7fb9a80ffab0 msgr2=0x7fb9a8101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:47.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.865+0000 7fb9af724640 1 -- 172.21.15.7:0/1234036728 shutdown_connections 2024-09-19T04:21:47.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.865+0000 7fb9af724640 1 -- 172.21.15.7:0/1234036728 wait complete. 2024-09-19T04:21:47.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.866+0000 7fb9af724640 1 Processor -- start 2024-09-19T04:21:47.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.866+0000 7fb9af724640 1 -- start start 2024-09-19T04:21:47.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.866+0000 7fb9af724640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9a8076720 0x7fb9a81a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:47.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.866+0000 7fb9af724640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9a8077040 0x7fb9a81a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:47.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.866+0000 7fb9af724640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9a8112a30 0x7fb9a819e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:47.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.866+0000 7fb9af724640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a81185a0 con 0x7fb9a8112a30 2024-09-19T04:21:47.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.866+0000 7fb9af724640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a8118420 con 0x7fb9a8077040 2024-09-19T04:21:47.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.866+0000 7fb9af724640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a8118720 con 0x7fb9a8076720 2024-09-19T04:21:47.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.866+0000 7fb9accbf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9a8077040 0x7fb9a81a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:47.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.866+0000 7fb9adcc1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9a8112a30 0x7fb9a819e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:47.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.866+0000 7fb9accbf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9a8077040 0x7fb9a81a4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:56904/0 (socket says 172.21.15.7:56904) 2024-09-19T04:21:47.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.866+0000 7fb9accbf640 1 -- 172.21.15.7:0/3662188183 learned_addr learned my addr 172.21.15.7:0/3662188183 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:47.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.866+0000 7fb9ad4c0640 1 --2- 172.21.15.7:0/3662188183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9a8076720 0x7fb9a81a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:47.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.866+0000 7fb9adcc1640 1 -- 172.21.15.7:0/3662188183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9a8076720 msgr2=0x7fb9a81a46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:47.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.866+0000 7fb9adcc1640 1 --2- 172.21.15.7:0/3662188183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9a8076720 0x7fb9a81a46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:47.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.866+0000 7fb9adcc1640 1 -- 172.21.15.7:0/3662188183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9a8077040 msgr2=0x7fb9a81a4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:47.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.866+0000 7fb9adcc1640 1 --2- 172.21.15.7:0/3662188183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9a8077040 0x7fb9a81a4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:47.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.866+0000 7fb9adcc1640 1 -- 172.21.15.7:0/3662188183 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a819efe0 con 0x7fb9a8112a30 2024-09-19T04:21:47.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.866+0000 7fb9accbf640 1 --2- 172.21.15.7:0/3662188183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9a8077040 0x7fb9a81a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:21:47.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.867+0000 7fb9adcc1640 1 --2- 172.21.15.7:0/3662188183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9a8112a30 0x7fb9a819e8b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fb9a807aa10 tx=0x7fb9a000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:47.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.867+0000 7fb99e7fc640 1 -- 172.21.15.7:0/3662188183 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a000cdf0 con 0x7fb9a8112a30 2024-09-19T04:21:47.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.867+0000 7fb99e7fc640 1 -- 172.21.15.7:0/3662188183 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9a0005020 con 0x7fb9a8112a30 2024-09-19T04:21:47.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.867+0000 7fb99e7fc640 1 -- 172.21.15.7:0/3662188183 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0010670 con 0x7fb9a8112a30 2024-09-19T04:21:47.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.867+0000 7fb9af724640 1 -- 172.21.15.7:0/3662188183 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9a819f2d0 con 0x7fb9a8112a30 2024-09-19T04:21:47.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.867+0000 7fb9af724640 1 -- 172.21.15.7:0/3662188183 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9a81ab5c0 con 0x7fb9a8112a30 2024-09-19T04:21:47.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.869+0000 7fb99e7fc640 1 -- 172.21.15.7:0/3662188183 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fb9a00054d0 con 0x7fb9a8112a30 2024-09-19T04:21:47.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.870+0000 7fb9b1afd740 1 Processor -- start 2024-09-19T04:21:47.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.870+0000 7fb9b1afd740 1 -- start start 2024-09-19T04:21:47.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.870+0000 7fb9b1afd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5611a6d7a760 0x5611a6d7ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:47.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.870+0000 7fb9b1afd740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611a6d7b080 0x5611a6d85400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:47.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.870+0000 7fb9b1afd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a6d85940 0x5611a6d87d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:47.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.870+0000 7fb9b1afd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5611a6ce02a0 con 0x5611a6d85940 2024-09-19T04:21:47.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.870+0000 7fb9b1afd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5611a6c87b10 con 0x5611a6d7a760 2024-09-19T04:21:47.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.870+0000 7fb9b1afd740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5611a6cdc260 con 0x5611a6d7b080 2024-09-19T04:21:47.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.870+0000 7fb99e7fc640 1 --2- 172.21.15.7:0/3662188183 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb9940a32c0 0x7fb9940a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:47.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.870+0000 7fb9ad4c0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611a6d7b080 0x5611a6d85400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:47.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.870+0000 7fb9accbf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a6d85940 0x5611a6d87d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:47.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.870+0000 7fb9ad4c0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611a6d7b080 0x5611a6d85400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:38756/0 (socket says 172.21.15.7:38756) 2024-09-19T04:21:47.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.870+0000 7fb9ad4c0640 1 -- 172.21.15.7:0/1484944088 learned_addr learned my addr 172.21.15.7:0/1484944088 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:47.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.870+0000 7fb9accbf640 1 --2- 172.21.15.7:0/1484944088 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5611a6d7a760 0x5611a6d7ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:47.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.870+0000 7fb99e7fc640 1 -- 172.21.15.7:0/3662188183 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fb9a00d02a0 con 0x7fb9a8112a30 2024-09-19T04:21:47.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.870+0000 7fb9adcc1640 1 --2- 172.21.15.7:0/3662188183 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb9940a32c0 0x7fb9940a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:47.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.870+0000 7fb9ad4c0640 1 -- 172.21.15.7:0/1484944088 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5611a6d7a760 msgr2=0x5611a6d7ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:47.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.870+0000 7fb9ad4c0640 1 --2- 172.21.15.7:0/1484944088 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5611a6d7a760 0x5611a6d7ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:47.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.870+0000 7fb9ad4c0640 1 -- 172.21.15.7:0/1484944088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a6d85940 msgr2=0x5611a6d87d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:47.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.870+0000 7fb9ad4c0640 1 --2- 172.21.15.7:0/1484944088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a6d85940 0x5611a6d87d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:47.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.870+0000 7fb9ad4c0640 1 -- 172.21.15.7:0/1484944088 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611a6a51b90 con 0x5611a6d7b080 2024-09-19T04:21:47.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.871+0000 7fb9ad4c0640 1 --2- 172.21.15.7:0/1484944088 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611a6d7b080 0x5611a6d85400 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb9a400bcb0 tx=0x7fb9a40107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e413b531036e2f40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:47.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.871+0000 7fb9adcc1640 1 --2- 172.21.15.7:0/3662188183 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb9940a32c0 0x7fb9940a5780 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb9a009c480 tx=0x7fb9a0005440 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:47.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.871+0000 7fb9937fe640 1 -- 172.21.15.7:0/1484944088 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a401c480 con 0x5611a6d7b080 2024-09-19T04:21:47.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.871+0000 7fb9937fe640 1 -- 172.21.15.7:0/1484944088 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9a401cb00 con 0x5611a6d7b080 2024-09-19T04:21:47.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.871+0000 7fb9937fe640 1 -- 172.21.15.7:0/1484944088 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a4011c70 con 0x5611a6d7b080 2024-09-19T04:21:47.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.872+0000 7fb9b1afd740 1 -- 172.21.15.7:0/1484944088 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611a6d7b080 msgr2=0x5611a6d85400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:47.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.872+0000 7fb9b1afd740 1 --2- 172.21.15.7:0/1484944088 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611a6d7b080 0x5611a6d85400 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb9a400bcb0 tx=0x7fb9a40107a0 comp rx=0 tx=0).stop 2024-09-19T04:21:47.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.872+0000 7fb9b1afd740 1 -- 172.21.15.7:0/1484944088 shutdown_connections 2024-09-19T04:21:47.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.872+0000 7fb9b1afd740 1 --2- 172.21.15.7:0/1484944088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a6d85940 0x5611a6d87d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:47.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.872+0000 7fb9b1afd740 1 --2- 172.21.15.7:0/1484944088 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611a6d7b080 0x5611a6d85400 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:47.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.872+0000 7fb9b1afd740 1 --2- 172.21.15.7:0/1484944088 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5611a6d7a760 0x5611a6d7ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:47.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.872+0000 7fb9b1afd740 1 -- 172.21.15.7:0/1484944088 >> 172.21.15.7:0/1484944088 conn(0x5611a6d76cf0 msgr2=0x5611a6d770d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:47.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.872+0000 7fb9b1afd740 1 -- 172.21.15.7:0/1484944088 shutdown_connections 2024-09-19T04:21:47.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.872+0000 7fb9b1afd740 1 -- 172.21.15.7:0/1484944088 wait complete. 2024-09-19T04:21:47.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.872+0000 7fb9b1afd740 1 -- start start 2024-09-19T04:21:47.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.872+0000 7fb9b1afd740 1 Processor -- start 2024-09-19T04:21:47.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.873+0000 7fb9b1afd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a6d7a760 0x5611a6d82850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:47.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.873+0000 7fb9b1afd740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611a6d7b080 0x5611a6d82d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:47.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.873+0000 7fb9b1afd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5611a6d85940 0x5611a6d832d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:47.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.873+0000 7fb9b1afd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5611a6d88510 con 0x5611a6d7a760 2024-09-19T04:21:47.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.873+0000 7fb9b1afd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5611a6c686e0 con 0x5611a6d85940 2024-09-19T04:21:47.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.873+0000 7fb9b1afd740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5611a6d88690 con 0x5611a6d7b080 2024-09-19T04:21:47.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.873+0000 7fb9b1afd740 10 client.0 _ll_register_callbacks cb 0x5611a6c8ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:21:47.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.873+0000 7fb9accbf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a6d7a760 0x5611a6d82850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:47.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.873+0000 7fb9accbf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a6d7a760 0x5611a6d82850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43444/0 (socket says 172.21.15.7:43444) 2024-09-19T04:21:47.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.873+0000 7fb9accbf640 1 -- 172.21.15.7:0/1119306791 learned_addr learned my addr 172.21.15.7:0/1119306791 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:47.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.873+0000 7fb9accbf640 1 --2- 172.21.15.7:0/1119306791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5611a6d85940 0x5611a6d832d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:47.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.873+0000 7fb9ad4c0640 1 --2- 172.21.15.7:0/1119306791 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611a6d7b080 0x5611a6d82d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:47.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.873+0000 7fb9accbf640 1 -- 172.21.15.7:0/1119306791 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611a6d7b080 msgr2=0x5611a6d82d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:47.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.873+0000 7fb9accbf640 1 --2- 172.21.15.7:0/1119306791 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611a6d7b080 0x5611a6d82d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:47.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.873+0000 7fb9accbf640 1 -- 172.21.15.7:0/1119306791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5611a6d85940 msgr2=0x5611a6d832d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:47.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.873+0000 7fb9accbf640 1 --2- 172.21.15.7:0/1119306791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5611a6d85940 0x5611a6d832d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:47.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.873+0000 7fb9accbf640 1 -- 172.21.15.7:0/1119306791 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611a6d91a30 con 0x5611a6d7a760 2024-09-19T04:21:47.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.873+0000 7fb9ad4c0640 1 --2- 172.21.15.7:0/1119306791 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611a6d7b080 0x5611a6d82d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:21:47.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.873+0000 7fb9accbf640 1 --2- 172.21.15.7:0/1119306791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a6d7a760 0x5611a6d82850 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fb998006010 tx=0x7fb998005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71750b82b0bad7d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:47.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.873+0000 7fb990ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:21:47.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.874+0000 7fb990ff9640 1 -- 172.21.15.7:0/1119306791 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb998035030 con 0x5611a6d7a760 2024-09-19T04:21:47.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.874+0000 7fb990ff9640 1 -- 172.21.15.7:0/1119306791 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fb998005260 con 0x5611a6d7a760 2024-09-19T04:21:47.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.874+0000 7fb9b1afd740 1 -- 172.21.15.7:0/1119306791 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9a401cb00 con 0x5611a6d7a760 2024-09-19T04:21:47.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.874+0000 7fb990ff9640 1 -- 172.21.15.7:0/1119306791 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb998054050 con 0x5611a6d7a760 2024-09-19T04:21:47.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.874+0000 7fb9b1afd740 10 client.15996 fetch_fsmap learned FSMap version 33 2024-09-19T04:21:47.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.874+0000 7fb9b1afd740 1 -- 172.21.15.7:0/1119306791 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5611a6d943c0 con 0x5611a6d7a760 2024-09-19T04:21:47.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.874+0000 7fb990ff9640 1 -- 172.21.15.7:0/1119306791 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9a401cb00 con 0x5611a6d7a760 2024-09-19T04:21:47.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.874+0000 7fb990ff9640 1 -- 172.21.15.7:0/1119306791 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7fb99804b070 con 0x5611a6d7a760 2024-09-19T04:21:47.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.874+0000 7fb9b1afd740 10 client.15996 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T04:21:47.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.874+0000 7fb9b1afd740 10 client.15996 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:21:47.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.874+0000 7fb9b1afd740 20 client.15996 populate_metadata read hostname 'smithi007' 2024-09-19T04:21:47.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.874+0000 7fb9b1afd740 1 --2- 172.21.15.7:0/1119306791 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5611a6d957d0 0x5611a6d97c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:47.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.874+0000 7fb9b1afd740 4 client.15996 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:21:47.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.874+0000 7fb9b1afd740 1 -- 172.21.15.7:0/1119306791 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5611a6ced9d0 con 0x5611a6d957d0 2024-09-19T04:21:47.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.875+0000 7fb9ad4c0640 1 --2- 172.21.15.7:0/1119306791 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5611a6d957d0 0x5611a6d97c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:47.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.875+0000 7fb990ff9640 10 client.15996 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:21:47.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.875+0000 7fb9ad4c0640 1 --2- 172.21.15.7:0/1119306791 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5611a6d957d0 0x5611a6d97c30 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8c0c93f8eb97c26 server_cookie=6b2e1d269440d6d0 in_seq=0 out_seq=0 2024-09-19T04:21:47.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.876+0000 7fb990ff9640 1 -- 172.21.15.7:0/1119306791 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5611a6ced9d0 con 0x5611a6d957d0 2024-09-19T04:21:47.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.876+0000 7fb990ff9640 10 client.15996 handle_command_reply: tid=0 2024-09-19T04:21:47.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.876+0000 7fb9b1afd740 1 client.15996 shutdown 2024-09-19T04:21:47.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.876+0000 7fb9b1afd740 1 -- 172.21.15.7:0/1119306791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a6d7a760 msgr2=0x5611a6d82850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:47.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.876+0000 7fb9b1afd740 1 --2- 172.21.15.7:0/1119306791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a6d7a760 0x5611a6d82850 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fb998006010 tx=0x7fb998005dd0 comp rx=0 tx=0).stop 2024-09-19T04:21:47.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.876+0000 7fb9b1afd740 1 -- 172.21.15.7:0/1119306791 shutdown_connections 2024-09-19T04:21:47.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.876+0000 7fb9b1afd740 1 --2- 172.21.15.7:0/1119306791 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5611a6d957d0 0x5611a6d97c30 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:47.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.876+0000 7fb9b1afd740 1 --2- 172.21.15.7:0/1119306791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5611a6d85940 0x5611a6d832d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:47.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.876+0000 7fb9b1afd740 1 --2- 172.21.15.7:0/1119306791 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611a6d7b080 0x5611a6d82d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:47.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.876+0000 7fb9b1afd740 1 --2- 172.21.15.7:0/1119306791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a6d7a760 0x5611a6d82850 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:47.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.876+0000 7fb9b1afd740 1 -- 172.21.15.7:0/1119306791 >> 172.21.15.7:0/1119306791 conn(0x5611a6d76cf0 msgr2=0x5611a6d75e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:47.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.876+0000 7fb990ff9640 0 client.15996 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:21:47.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.876+0000 7fb9b1afd740 1 -- 172.21.15.7:0/1119306791 shutdown_connections 2024-09-19T04:21:47.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.876+0000 7fb9b1afd740 1 -- 172.21.15.7:0/1119306791 wait complete. 2024-09-19T04:21:47.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.877+0000 7fb9b1afd740 20 client.15996 trim_cache size 0 max 16384 2024-09-19T04:21:47.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.896+0000 7fb9b1afd740 1 Processor -- start 2024-09-19T04:21:47.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.896+0000 7fb9b1afd740 1 -- start start 2024-09-19T04:21:47.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.896+0000 7fb9b1afd740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611a6d7a760 0x5611a6d7d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:47.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.896+0000 7fb9b1afd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5611a6d7b080 0x5611a6d75d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:47.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.896+0000 7fb9b1afd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a6d85940 0x5611a6d9d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:47.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.896+0000 7fb9b1afd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a81b5490 con 0x5611a6d85940 2024-09-19T04:21:47.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.896+0000 7fb9b1afd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a81b7060 con 0x5611a6d7b080 2024-09-19T04:21:47.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.896+0000 7fb9b1afd740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a81b5b60 con 0x5611a6d7a760 2024-09-19T04:21:47.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.896+0000 7fb9accbf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a6d85940 0x5611a6d9d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:47.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.896+0000 7fb9accbf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a6d85940 0x5611a6d9d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43446/0 (socket says 172.21.15.7:43446) 2024-09-19T04:21:47.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.896+0000 7fb9ad4c0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5611a6d7b080 0x5611a6d75d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:47.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.896+0000 7fb9accbf640 1 -- 172.21.15.7:0/4160605846 learned_addr learned my addr 172.21.15.7:0/4160605846 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:47.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.896+0000 7fb9accbf640 1 --2- 172.21.15.7:0/4160605846 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611a6d7a760 0x5611a6d7d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:47.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.897+0000 7fb9ad4c0640 1 -- 172.21.15.7:0/4160605846 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611a6d7a760 msgr2=0x5611a6d7d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:47.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.897+0000 7fb9ad4c0640 1 --2- 172.21.15.7:0/4160605846 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611a6d7a760 0x5611a6d7d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:47.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.897+0000 7fb9ad4c0640 1 -- 172.21.15.7:0/4160605846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a6d85940 msgr2=0x5611a6d9d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:47.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.897+0000 7fb9ad4c0640 1 --2- 172.21.15.7:0/4160605846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a6d85940 0x5611a6d9d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:47.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.897+0000 7fb9ad4c0640 1 -- 172.21.15.7:0/4160605846 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611a6d72260 con 0x5611a6d7b080 2024-09-19T04:21:47.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.897+0000 7fb9accbf640 1 --2- 172.21.15.7:0/4160605846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a6d85940 0x5611a6d9d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:21:47.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.897+0000 7fb9ad4c0640 1 --2- 172.21.15.7:0/4160605846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5611a6d7b080 0x5611a6d75d60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb9a400bc80 tx=0x7fb9a400b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c177e246457e4fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:47.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.897+0000 7fb992ffd640 1 -- 172.21.15.7:0/4160605846 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a402c030 con 0x5611a6d7b080 2024-09-19T04:21:47.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.897+0000 7fb992ffd640 1 -- 172.21.15.7:0/4160605846 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9a4005520 con 0x5611a6d7b080 2024-09-19T04:21:47.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.897+0000 7fb992ffd640 1 -- 172.21.15.7:0/4160605846 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a401cab0 con 0x5611a6d7b080 2024-09-19T04:21:47.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.898+0000 7fb9b1afd740 1 -- 172.21.15.7:0/4160605846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5611a6d7b080 msgr2=0x5611a6d75d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:47.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.898+0000 7fb9b1afd740 1 --2- 172.21.15.7:0/4160605846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5611a6d7b080 0x5611a6d75d60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb9a400bc80 tx=0x7fb9a400b390 comp rx=0 tx=0).stop 2024-09-19T04:21:47.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.898+0000 7fb9b1afd740 1 -- 172.21.15.7:0/4160605846 shutdown_connections 2024-09-19T04:21:47.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.898+0000 7fb9b1afd740 1 --2- 172.21.15.7:0/4160605846 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a6d85940 0x5611a6d9d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:47.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.898+0000 7fb9b1afd740 1 --2- 172.21.15.7:0/4160605846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5611a6d7b080 0x5611a6d75d60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:47.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.898+0000 7fb9b1afd740 1 --2- 172.21.15.7:0/4160605846 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611a6d7a760 0x5611a6d7d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:47.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.898+0000 7fb9b1afd740 1 -- 172.21.15.7:0/4160605846 >> 172.21.15.7:0/4160605846 conn(0x5611a6d76cf0 msgr2=0x5611a6d75650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:47.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.898+0000 7fb9b1afd740 1 -- 172.21.15.7:0/4160605846 shutdown_connections 2024-09-19T04:21:47.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.898+0000 7fb9b1afd740 1 -- 172.21.15.7:0/4160605846 wait complete. 2024-09-19T04:21:47.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.898+0000 7fb9b1afd740 1 -- start start 2024-09-19T04:21:47.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.898+0000 7fb9b1afd740 1 Processor -- start 2024-09-19T04:21:47.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.899+0000 7fb9b1afd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a6d7a760 0x5611a6d8de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:47.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.899+0000 7fb9b1afd740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611a6d7b080 0x5611a6d8a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:47.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.899+0000 7fb9b1afd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5611a6d85940 0x5611a6d8a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:47.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.899+0000 7fb9b1afd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a81b6900 con 0x5611a6d7a760 2024-09-19T04:21:47.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.899+0000 7fb9b1afd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a81b6230 con 0x5611a6d85940 2024-09-19T04:21:47.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.899+0000 7fb9b1afd740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a81b3450 con 0x5611a6d7b080 2024-09-19T04:21:47.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.899+0000 7fb9b1afd740 10 client.0 _ll_register_callbacks cb 0x7fb998004270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:21:47.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.899+0000 7fb9accbf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a6d7a760 0x5611a6d8de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:47.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.899+0000 7fb9ad4c0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611a6d7b080 0x5611a6d8a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:47.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.899+0000 7fb9accbf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a6d7a760 0x5611a6d8de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43452/0 (socket says 172.21.15.7:43452) 2024-09-19T04:21:47.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.899+0000 7fb9accbf640 1 -- 172.21.15.7:0/3803080829 learned_addr learned my addr 172.21.15.7:0/3803080829 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:47.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.899+0000 7fb9accbf640 1 --2- 172.21.15.7:0/3803080829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5611a6d85940 0x5611a6d8a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:47.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.899+0000 7fb9accbf640 1 -- 172.21.15.7:0/3803080829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611a6d7b080 msgr2=0x5611a6d8a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:47.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.899+0000 7fb9accbf640 1 --2- 172.21.15.7:0/3803080829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611a6d7b080 0x5611a6d8a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:47.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.899+0000 7fb9accbf640 1 -- 172.21.15.7:0/3803080829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5611a6d85940 msgr2=0x5611a6d8a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:47.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.899+0000 7fb9accbf640 1 --2- 172.21.15.7:0/3803080829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5611a6d85940 0x5611a6d8a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:47.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.899+0000 7fb9accbf640 1 -- 172.21.15.7:0/3803080829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611a6d8ad10 con 0x5611a6d7a760 2024-09-19T04:21:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.899+0000 7fb9ad4c0640 1 --2- 172.21.15.7:0/3803080829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611a6d7b080 0x5611a6d8a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:21:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.899+0000 7fb9accbf640 1 --2- 172.21.15.7:0/3803080829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a6d7a760 0x5611a6d8de50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb998003730 tx=0x7fb998005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a46a4bd7eba5cf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.899+0000 7fb990ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:21:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.900+0000 7fb990ff9640 1 -- 172.21.15.7:0/3803080829 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb998035040 con 0x5611a6d7a760 2024-09-19T04:21:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.900+0000 7fb990ff9640 1 -- 172.21.15.7:0/3803080829 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fb998005260 con 0x5611a6d7a760 2024-09-19T04:21:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.900+0000 7fb9b1afd740 1 -- 172.21.15.7:0/3803080829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9a4005520 con 0x5611a6d7a760 2024-09-19T04:21:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.900+0000 7fb990ff9640 1 -- 172.21.15.7:0/3803080829 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb998065050 con 0x5611a6d7a760 2024-09-19T04:21:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.900+0000 7fb9b1afd740 10 client.16002 fetch_fsmap learned FSMap version 33 2024-09-19T04:21:47.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.900+0000 7fb9b1afd740 1 -- 172.21.15.7:0/3803080829 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5611a6e012d0 con 0x5611a6d7a760 2024-09-19T04:21:47.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.900+0000 7fb990ff9640 1 -- 172.21.15.7:0/3803080829 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9a4005520 con 0x5611a6d7a760 2024-09-19T04:21:47.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.900+0000 7fb990ff9640 1 -- 172.21.15.7:0/3803080829 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7fb99804b040 con 0x5611a6d7a760 2024-09-19T04:21:47.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.900+0000 7fb9b1afd740 10 client.16002 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T04:21:47.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.900+0000 7fb9b1afd740 10 client.16002 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:21:47.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.900+0000 7fb9b1afd740 20 client.16002 populate_metadata read hostname 'smithi007' 2024-09-19T04:21:47.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.900+0000 7fb9b1afd740 1 --2- 172.21.15.7:0/3803080829 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5611a6e01a00 0x5611a6e03e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:47.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.900+0000 7fb9b1afd740 4 client.16002 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}] 2024-09-19T04:21:47.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.900+0000 7fb9b1afd740 1 -- 172.21.15.7:0/3803080829 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}) -- 0x5611a6ce7d20 con 0x5611a6e01a00 2024-09-19T04:21:47.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.901+0000 7fb9ad4c0640 1 --2- 172.21.15.7:0/3803080829 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5611a6e01a00 0x5611a6e03e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:47.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.901+0000 7fb9ad4c0640 1 --2- 172.21.15.7:0/3803080829 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5611a6e01a00 0x5611a6e03e20 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c154a2c631d8b01 server_cookie=5ef9a646b441cd8b in_seq=0 out_seq=0 2024-09-19T04:21:47.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:47.901+0000 7fb990ff9640 10 client.16002 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:21:48.159 INFO:tasks.workunit.client.0.smithi007.stdout: 103 243935 77 178553 86 141880 143 2024-09-19T04:21:48.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:48 smithi007 ceph-mon[31360]: pgmap v501: 129 pgs: 129 active+clean; 314 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 1.4 MiB/s wr, 218 op/s 2024-09-19T04:21:48.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:48 smithi102 ceph-mon[35446]: pgmap v501: 129 pgs: 129 active+clean; 314 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 1.4 MiB/s wr, 218 op/s 2024-09-19T04:21:48.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:48 smithi092 ceph-mon[34940]: pgmap v501: 129 pgs: 129 active+clean; 314 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 1.4 MiB/s wr, 218 op/s 2024-09-19T04:21:50.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:50 smithi007 ceph-mon[31360]: pgmap v502: 129 pgs: 129 active+clean; 316 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 1.6 MiB/s wr, 239 op/s 2024-09-19T04:21:50.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:50 smithi102 ceph-mon[35446]: pgmap v502: 129 pgs: 129 active+clean; 316 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 1.6 MiB/s wr, 239 op/s 2024-09-19T04:21:50.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:50 smithi092 ceph-mon[34940]: pgmap v502: 129 pgs: 129 active+clean; 316 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 1.6 MiB/s wr, 239 op/s 2024-09-19T04:21:52.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:52 smithi007 ceph-mon[31360]: pgmap v503: 129 pgs: 129 active+clean; 316 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 758 KiB/s wr, 184 op/s 2024-09-19T04:21:52.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:52 smithi102 ceph-mon[35446]: pgmap v503: 129 pgs: 129 active+clean; 316 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 758 KiB/s wr, 184 op/s 2024-09-19T04:21:52.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:52 smithi092 ceph-mon[34940]: pgmap v503: 129 pgs: 129 active+clean; 316 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 758 KiB/s wr, 184 op/s 2024-09-19T04:21:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.975+0000 7f1f14f42640 1 -- 172.21.15.7:0/3679069055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f101025f0 msgr2=0x7f1f10108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.975+0000 7f1f14f42640 1 --2- 172.21.15.7:0/3679069055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f101025f0 0x7f1f10108e80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1f08009be0 tx=0x7f1f0802a6c0 comp rx=0 tx=0).stop 2024-09-19T04:21:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.975+0000 7f1f14f42640 1 -- 172.21.15.7:0/3679069055 shutdown_connections 2024-09-19T04:21:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.975+0000 7f1f14f42640 1 --2- 172.21.15.7:0/3679069055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f101025f0 0x7f1f10108e80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.975+0000 7f1f14f42640 1 --2- 172.21.15.7:0/3679069055 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f10101c30 0x7f1f101020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.975+0000 7f1f14f42640 1 --2- 172.21.15.7:0/3679069055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f10100a40 0x7f1f10100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.976+0000 7f1f14f42640 1 -- 172.21.15.7:0/3679069055 >> 172.21.15.7:0/3679069055 conn(0x7f1f100fc1c0 msgr2=0x7f1f100fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.976+0000 7f1f14f42640 1 -- 172.21.15.7:0/3679069055 shutdown_connections 2024-09-19T04:21:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.976+0000 7f1f14f42640 1 -- 172.21.15.7:0/3679069055 wait complete. 2024-09-19T04:21:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.976+0000 7f1f14f42640 1 Processor -- start 2024-09-19T04:21:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.976+0000 7f1f14f42640 1 -- start start 2024-09-19T04:21:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.977+0000 7f1f14f42640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f10100a40 0x7f1f10197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.977+0000 7f1f14f42640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f10101c30 0x7f1f101983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.977+0000 7f1f14f42640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f101025f0 0x7f1f1019f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.977+0000 7f1f14f42640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1010c670 con 0x7f1f10101c30 2024-09-19T04:21:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.977+0000 7f1f14f42640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1010c4f0 con 0x7f1f10100a40 2024-09-19T04:21:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.977+0000 7f1f14f42640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1010c7f0 con 0x7f1f101025f0 2024-09-19T04:21:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.977+0000 7f1f0dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f10101c30 0x7f1f101983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.977+0000 7f1f0dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f10101c30 0x7f1f101983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43470/0 (socket says 172.21.15.7:43470) 2024-09-19T04:21:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.977+0000 7f1f0dd9b640 1 -- 172.21.15.7:0/889563874 learned_addr learned my addr 172.21.15.7:0/889563874 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.977+0000 7f1f0e59c640 1 --2- 172.21.15.7:0/889563874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f10100a40 0x7f1f10197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.977+0000 7f1f0ed9d640 1 --2- 172.21.15.7:0/889563874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f101025f0 0x7f1f1019f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.977+0000 7f1f0dd9b640 1 -- 172.21.15.7:0/889563874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f101025f0 msgr2=0x7f1f1019f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.977+0000 7f1f0dd9b640 1 --2- 172.21.15.7:0/889563874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f101025f0 0x7f1f1019f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.977+0000 7f1f0dd9b640 1 -- 172.21.15.7:0/889563874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f10100a40 msgr2=0x7f1f10197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.977+0000 7f1f0dd9b640 1 --2- 172.21.15.7:0/889563874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f10100a40 0x7f1f10197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.977+0000 7f1f0dd9b640 1 -- 172.21.15.7:0/889563874 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1019fa90 con 0x7f1f10101c30 2024-09-19T04:21:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.977+0000 7f1f0e59c640 1 --2- 172.21.15.7:0/889563874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f10100a40 0x7f1f10197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:21:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.977+0000 7f1f0dd9b640 1 --2- 172.21.15.7:0/889563874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f10101c30 0x7f1f101983b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1f0400e9f0 tx=0x7f1f0400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.977+0000 7f1eff7fe640 1 -- 172.21.15.7:0/889563874 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0400cd80 con 0x7f1f10101c30 2024-09-19T04:21:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.978+0000 7f1eff7fe640 1 -- 172.21.15.7:0/889563874 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f04005500 con 0x7f1f10101c30 2024-09-19T04:21:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.978+0000 7f1f14f42640 1 -- 172.21.15.7:0/889563874 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f1019fd80 con 0x7f1f10101c30 2024-09-19T04:21:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.978+0000 7f1eff7fe640 1 -- 172.21.15.7:0/889563874 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f04010690 con 0x7f1f10101c30 2024-09-19T04:21:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.978+0000 7f1f14f42640 1 -- 172.21.15.7:0/889563874 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f101a0220 con 0x7f1f10101c30 2024-09-19T04:21:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.980+0000 7f1f17cdc740 1 Processor -- start 2024-09-19T04:21:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.980+0000 7f1f17cdc740 1 -- start start 2024-09-19T04:21:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.980+0000 7f1eff7fe640 1 -- 172.21.15.7:0/889563874 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f1f040046c0 con 0x7f1f10101c30 2024-09-19T04:21:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.981+0000 7f1f17cdc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6a279a0 0x55acf6a27da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.981+0000 7f1f17cdc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf6a282e0 0x55acf6a2cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.981+0000 7f1f17cdc740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55acf6a2d370 0x55acf6a2f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.981+0000 7f1f17cdc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55acf698b2f0 con 0x55acf6a279a0 2024-09-19T04:21:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.981+0000 7f1f17cdc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55acf6933270 con 0x55acf6a282e0 2024-09-19T04:21:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.981+0000 7f1f17cdc740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55acf69872b0 con 0x55acf6a2d370 2024-09-19T04:21:52.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.981+0000 7f1f0e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf6a282e0 0x55acf6a2cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.981+0000 7f1f0ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6a279a0 0x55acf6a27da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.981+0000 7f1f0e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf6a282e0 0x55acf6a2cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:56962/0 (socket says 172.21.15.7:56962) 2024-09-19T04:21:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.981+0000 7f1f0e59c640 1 -- 172.21.15.7:0/1007483513 learned_addr learned my addr 172.21.15.7:0/1007483513 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.981+0000 7f1f0dd9b640 1 --2- 172.21.15.7:0/1007483513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55acf6a2d370 0x55acf6a2f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.981+0000 7f1f0e59c640 1 -- 172.21.15.7:0/1007483513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55acf6a2d370 msgr2=0x55acf6a2f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.981+0000 7f1f0e59c640 1 --2- 172.21.15.7:0/1007483513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55acf6a2d370 0x55acf6a2f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.981+0000 7f1f0e59c640 1 -- 172.21.15.7:0/1007483513 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6a279a0 msgr2=0x55acf6a27da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.981+0000 7f1f0e59c640 1 --2- 172.21.15.7:0/1007483513 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6a279a0 0x55acf6a27da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.981+0000 7f1f0e59c640 1 -- 172.21.15.7:0/1007483513 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acf6932340 con 0x55acf6a282e0 2024-09-19T04:21:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.981+0000 7f1f0dd9b640 1 --2- 172.21.15.7:0/1007483513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55acf6a2d370 0x55acf6a2f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:21:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.981+0000 7f1f0e59c640 1 --2- 172.21.15.7:0/1007483513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf6a282e0 0x55acf6a2cda0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1f000114f0 tx=0x7f1f000119b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69b565a4e174855f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.981+0000 7f1efcff9640 1 -- 172.21.15.7:0/1007483513 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f00005020 con 0x55acf6a282e0 2024-09-19T04:21:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.981+0000 7f1efcff9640 1 -- 172.21.15.7:0/1007483513 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f000047a0 con 0x55acf6a282e0 2024-09-19T04:21:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.982+0000 7f1efcff9640 1 -- 172.21.15.7:0/1007483513 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0000f9e0 con 0x55acf6a282e0 2024-09-19T04:21:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.982+0000 7f1eff7fe640 1 --2- 172.21.15.7:0/889563874 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1ef80a3240 0x7f1ef80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.982+0000 7f1f0ed9d640 1 --2- 172.21.15.7:0/889563874 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1ef80a3240 0x7f1ef80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.982+0000 7f1eff7fe640 1 -- 172.21.15.7:0/889563874 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f1f040d01b0 con 0x7f1f10101c30 2024-09-19T04:21:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.982+0000 7f1f17cdc740 1 -- 172.21.15.7:0/1007483513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf6a282e0 msgr2=0x55acf6a2cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.982+0000 7f1f17cdc740 1 --2- 172.21.15.7:0/1007483513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf6a282e0 0x55acf6a2cda0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1f000114f0 tx=0x7f1f000119b0 comp rx=0 tx=0).stop 2024-09-19T04:21:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.982+0000 7f1f0ed9d640 1 --2- 172.21.15.7:0/889563874 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1ef80a3240 0x7f1ef80a5700 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1f08004af0 tx=0x7f1f08030a30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.982+0000 7f1f17cdc740 1 -- 172.21.15.7:0/1007483513 shutdown_connections 2024-09-19T04:21:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.982+0000 7f1f17cdc740 1 --2- 172.21.15.7:0/1007483513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55acf6a2d370 0x55acf6a2f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.982+0000 7f1f17cdc740 1 --2- 172.21.15.7:0/1007483513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf6a282e0 0x55acf6a2cda0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.982+0000 7f1f17cdc740 1 --2- 172.21.15.7:0/1007483513 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6a279a0 0x55acf6a27da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.982+0000 7f1f17cdc740 1 -- 172.21.15.7:0/1007483513 >> 172.21.15.7:0/1007483513 conn(0x55acf6a23010 msgr2=0x55acf6a23410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.982+0000 7f1f17cdc740 1 -- 172.21.15.7:0/1007483513 shutdown_connections 2024-09-19T04:21:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.982+0000 7f1f17cdc740 1 -- 172.21.15.7:0/1007483513 wait complete. 2024-09-19T04:21:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.983+0000 7f1f17cdc740 1 -- start start 2024-09-19T04:21:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.983+0000 7f1f17cdc740 1 Processor -- start 2024-09-19T04:21:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.983+0000 7f1f17cdc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf6a279a0 0x55acf6a31b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.983+0000 7f1f17cdc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6a282e0 0x55acf6a32080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.983+0000 7f1f17cdc740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55acf6a2d370 0x55acf6a390c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.983+0000 7f1f17cdc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55acf6a30340 con 0x55acf6a282e0 2024-09-19T04:21:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.983+0000 7f1f17cdc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55acf6914290 con 0x55acf6a279a0 2024-09-19T04:21:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.983+0000 7f1f17cdc740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55acf6a304c0 con 0x55acf6a2d370 2024-09-19T04:21:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.983+0000 7f1f17cdc740 10 client.0 _ll_register_callbacks cb 0x55acf6945140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:21:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.983+0000 7f1f0dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6a282e0 0x55acf6a32080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.983+0000 7f1f0e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf6a279a0 0x55acf6a31b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.983+0000 7f1f0e59c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf6a279a0 0x55acf6a31b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:56974/0 (socket says 172.21.15.7:56974) 2024-09-19T04:21:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.983+0000 7f1f0e59c640 1 -- 172.21.15.7:0/1864175662 learned_addr learned my addr 172.21.15.7:0/1864175662 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.983+0000 7f1f0ed9d640 1 --2- 172.21.15.7:0/1864175662 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55acf6a2d370 0x55acf6a390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.983+0000 7f1f0dd9b640 1 -- 172.21.15.7:0/1864175662 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55acf6a2d370 msgr2=0x55acf6a390c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.983+0000 7f1f0dd9b640 1 --2- 172.21.15.7:0/1864175662 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55acf6a2d370 0x55acf6a390c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:52.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.983+0000 7f1f0dd9b640 1 -- 172.21.15.7:0/1864175662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf6a279a0 msgr2=0x55acf6a31b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:52.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.983+0000 7f1f0dd9b640 1 --2- 172.21.15.7:0/1864175662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf6a279a0 0x55acf6a31b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:52.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.984+0000 7f1f0dd9b640 1 -- 172.21.15.7:0/1864175662 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acf669e210 con 0x55acf6a282e0 2024-09-19T04:21:52.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.984+0000 7f1f0e59c640 1 --2- 172.21.15.7:0/1864175662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf6a279a0 0x55acf6a31b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:21:52.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.984+0000 7f1f0dd9b640 1 --2- 172.21.15.7:0/1864175662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6a282e0 0x55acf6a32080 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1f0409c390 tx=0x7f1f0409c290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcff052e21622097 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:52.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.984+0000 7f1ef5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:21:52.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.984+0000 7f1ef5ffb640 1 -- 172.21.15.7:0/1864175662 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f040a4de0 con 0x55acf6a282e0 2024-09-19T04:21:52.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.984+0000 7f1ef5ffb640 1 -- 172.21.15.7:0/1864175662 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f1f0409b850 con 0x55acf6a282e0 2024-09-19T04:21:52.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.984+0000 7f1f17cdc740 1 -- 172.21.15.7:0/1864175662 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f000047a0 con 0x55acf6a282e0 2024-09-19T04:21:52.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.984+0000 7f1ef5ffb640 1 -- 172.21.15.7:0/1864175662 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f1f0409c400 con 0x55acf6a282e0 2024-09-19T04:21:52.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.984+0000 7f1f17cdc740 10 client.16014 fetch_fsmap learned FSMap version 33 2024-09-19T04:21:52.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.984+0000 7f1f17cdc740 1 -- 172.21.15.7:0/1864175662 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55acf676a620 con 0x55acf6a282e0 2024-09-19T04:21:53.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.984+0000 7f1ef5ffb640 1 -- 172.21.15.7:0/1864175662 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f000047a0 con 0x55acf6a282e0 2024-09-19T04:21:53.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.984+0000 7f1ef5ffb640 1 -- 172.21.15.7:0/1864175662 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f1f040b5260 con 0x55acf6a282e0 2024-09-19T04:21:53.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.984+0000 7f1f17cdc740 10 client.16014 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T04:21:53.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.984+0000 7f1f17cdc740 10 client.16014 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:21:53.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.984+0000 7f1f17cdc740 20 client.16014 populate_metadata read hostname 'smithi007' 2024-09-19T04:21:53.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.985+0000 7f1f17cdc740 1 --2- 172.21.15.7:0/1864175662 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55acf6a3d6f0 0x55acf6a3fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:53.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.985+0000 7f1f17cdc740 4 client.16014 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:21:53.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.985+0000 7f1f17cdc740 1 -- 172.21.15.7:0/1864175662 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55acf6998a20 con 0x55acf6a3d6f0 2024-09-19T04:21:53.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.985+0000 7f1f0e59c640 1 --2- 172.21.15.7:0/1864175662 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55acf6a3d6f0 0x55acf6a3fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:53.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.985+0000 7f1ef5ffb640 10 client.16014 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:21:53.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.985+0000 7f1f0e59c640 1 --2- 172.21.15.7:0/1864175662 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55acf6a3d6f0 0x55acf6a3fb60 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=195a654715f4f72e server_cookie=24bce4dd47b7e7dd in_seq=0 out_seq=0 2024-09-19T04:21:53.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.986+0000 7f1ef5ffb640 1 -- 172.21.15.7:0/1864175662 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55acf6998a20 con 0x55acf6a3d6f0 2024-09-19T04:21:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.986+0000 7f1ef5ffb640 10 client.16014 handle_command_reply: tid=0 2024-09-19T04:21:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.986+0000 7f1f17cdc740 1 client.16014 shutdown 2024-09-19T04:21:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.986+0000 7f1f17cdc740 1 -- 172.21.15.7:0/1864175662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6a282e0 msgr2=0x55acf6a32080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.986+0000 7f1f17cdc740 1 --2- 172.21.15.7:0/1864175662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6a282e0 0x55acf6a32080 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1f0409c390 tx=0x7f1f0409c290 comp rx=0 tx=0).stop 2024-09-19T04:21:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.986+0000 7f1f17cdc740 1 -- 172.21.15.7:0/1864175662 shutdown_connections 2024-09-19T04:21:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.986+0000 7f1f17cdc740 1 --2- 172.21.15.7:0/1864175662 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55acf6a3d6f0 0x55acf6a3fb60 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.986+0000 7f1f17cdc740 1 --2- 172.21.15.7:0/1864175662 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55acf6a2d370 0x55acf6a390c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.986+0000 7f1f17cdc740 1 --2- 172.21.15.7:0/1864175662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6a282e0 0x55acf6a32080 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.986+0000 7f1ef5ffb640 0 client.16014 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:21:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.986+0000 7f1f17cdc740 1 --2- 172.21.15.7:0/1864175662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf6a279a0 0x55acf6a31b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.986+0000 7f1f17cdc740 1 -- 172.21.15.7:0/1864175662 >> 172.21.15.7:0/1864175662 conn(0x55acf6a23010 msgr2=0x55acf6a24820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.986+0000 7f1f17cdc740 1 -- 172.21.15.7:0/1864175662 shutdown_connections 2024-09-19T04:21:53.002 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.986+0000 7f1f17cdc740 1 -- 172.21.15.7:0/1864175662 wait complete. 2024-09-19T04:21:53.002 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:52.987+0000 7f1f17cdc740 20 client.16014 trim_cache size 0 max 16384 2024-09-19T04:21:53.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.002+0000 7f1f17cdc740 1 Processor -- start 2024-09-19T04:21:53.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.002+0000 7f1f17cdc740 1 -- start start 2024-09-19T04:21:53.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.002+0000 7f1f17cdc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6a279a0 0x55acf6a2cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:53.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.002+0000 7f1f17cdc740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55acf6a282e0 0x55acf6a39080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:53.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.002+0000 7f1f17cdc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf6a2d370 0x55acf6a219a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:53.009 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.002+0000 7f1f17cdc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1f101aa8d0 con 0x55acf6a279a0 2024-09-19T04:21:53.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.002+0000 7f1f17cdc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1f101ac4a0 con 0x55acf6a2d370 2024-09-19T04:21:53.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.002+0000 7f1f17cdc740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1f101aafa0 con 0x55acf6a282e0 2024-09-19T04:21:53.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.002+0000 7f1f0e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6a279a0 0x55acf6a2cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:53.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.003+0000 7f1f0e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6a279a0 0x55acf6a2cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43490/0 (socket says 172.21.15.7:43490) 2024-09-19T04:21:53.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.003+0000 7f1f0e59c640 1 -- 172.21.15.7:0/386584484 learned_addr learned my addr 172.21.15.7:0/386584484 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:53.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.003+0000 7f1f0ed9d640 1 --2- 172.21.15.7:0/386584484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf6a2d370 0x55acf6a219a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:53.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.003+0000 7f1f0dd9b640 1 --2- 172.21.15.7:0/386584484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55acf6a282e0 0x55acf6a39080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:53.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.003+0000 7f1f0e59c640 1 -- 172.21.15.7:0/386584484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55acf6a282e0 msgr2=0x55acf6a39080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:53.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.003+0000 7f1f0e59c640 1 --2- 172.21.15.7:0/386584484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55acf6a282e0 0x55acf6a39080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:53.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.003+0000 7f1f0e59c640 1 -- 172.21.15.7:0/386584484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf6a2d370 msgr2=0x55acf6a219a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:53.010 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.003+0000 7f1f0e59c640 1 --2- 172.21.15.7:0/386584484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf6a2d370 0x55acf6a219a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:53.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.003+0000 7f1f0e59c640 1 -- 172.21.15.7:0/386584484 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acf6a31680 con 0x55acf6a279a0 2024-09-19T04:21:53.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.003+0000 7f1f0ed9d640 1 --2- 172.21.15.7:0/386584484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf6a2d370 0x55acf6a219a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:21:53.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.003+0000 7f1f0e59c640 1 --2- 172.21.15.7:0/386584484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6a279a0 0x55acf6a2cc80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1f000114c0 tx=0x7f1f000119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e58d9a74d0fc00c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:53.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.003+0000 7f1ef7fff640 1 -- 172.21.15.7:0/386584484 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0002d020 con 0x55acf6a279a0 2024-09-19T04:21:53.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.003+0000 7f1ef7fff640 1 -- 172.21.15.7:0/386584484 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f000055e0 con 0x55acf6a279a0 2024-09-19T04:21:53.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.003+0000 7f1ef7fff640 1 -- 172.21.15.7:0/386584484 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0000fb70 con 0x55acf6a279a0 2024-09-19T04:21:53.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.004+0000 7f1f17cdc740 1 -- 172.21.15.7:0/386584484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6a279a0 msgr2=0x55acf6a2cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:53.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.004+0000 7f1f17cdc740 1 --2- 172.21.15.7:0/386584484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6a279a0 0x55acf6a2cc80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1f000114c0 tx=0x7f1f000119b0 comp rx=0 tx=0).stop 2024-09-19T04:21:53.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.004+0000 7f1f17cdc740 1 -- 172.21.15.7:0/386584484 shutdown_connections 2024-09-19T04:21:53.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.004+0000 7f1f17cdc740 1 --2- 172.21.15.7:0/386584484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf6a2d370 0x55acf6a219a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:53.011 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.004+0000 7f1f17cdc740 1 --2- 172.21.15.7:0/386584484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55acf6a282e0 0x55acf6a39080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:53.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.004+0000 7f1f17cdc740 1 --2- 172.21.15.7:0/386584484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6a279a0 0x55acf6a2cc80 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:53.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.004+0000 7f1f17cdc740 1 -- 172.21.15.7:0/386584484 >> 172.21.15.7:0/386584484 conn(0x55acf6a23010 msgr2=0x55acf6a293c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:53.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.004+0000 7f1f17cdc740 1 -- 172.21.15.7:0/386584484 shutdown_connections 2024-09-19T04:21:53.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.004+0000 7f1f17cdc740 1 -- 172.21.15.7:0/386584484 wait complete. 2024-09-19T04:21:53.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.004+0000 7f1f17cdc740 1 -- start start 2024-09-19T04:21:53.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.004+0000 7f1f17cdc740 1 Processor -- start 2024-09-19T04:21:53.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.005+0000 7f1f17cdc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6a279a0 0x55acf6a36350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:53.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.005+0000 7f1f17cdc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf6a282e0 0x55acf6a36890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:53.012 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.005+0000 7f1f17cdc740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55acf6a2d370 0x55acf6a378a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.005+0000 7f1f17cdc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1f101abd40 con 0x55acf6a279a0 2024-09-19T04:21:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.005+0000 7f1f17cdc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1f101ab670 con 0x55acf6a282e0 2024-09-19T04:21:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.005+0000 7f1f17cdc740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1f101a8890 con 0x55acf6a2d370 2024-09-19T04:21:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.005+0000 7f1f17cdc740 10 client.0 _ll_register_callbacks cb 0x7f1f0400e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:21:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.005+0000 7f1f0e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6a279a0 0x55acf6a36350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.005+0000 7f1f0e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6a279a0 0x55acf6a36350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43502/0 (socket says 172.21.15.7:43502) 2024-09-19T04:21:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.005+0000 7f1f0e59c640 1 -- 172.21.15.7:0/1740307999 learned_addr learned my addr 172.21.15.7:0/1740307999 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:21:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.005+0000 7f1f0dd9b640 1 --2- 172.21.15.7:0/1740307999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf6a282e0 0x55acf6a36890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.005+0000 7f1f0ed9d640 1 --2- 172.21.15.7:0/1740307999 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55acf6a2d370 0x55acf6a378a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.005+0000 7f1f0e59c640 1 -- 172.21.15.7:0/1740307999 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55acf6a2d370 msgr2=0x55acf6a378a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.005+0000 7f1f0e59c640 1 --2- 172.21.15.7:0/1740307999 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55acf6a2d370 0x55acf6a378a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:53.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.005+0000 7f1f0e59c640 1 -- 172.21.15.7:0/1740307999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf6a282e0 msgr2=0x55acf6a36890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:21:53.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.005+0000 7f1f0e59c640 1 --2- 172.21.15.7:0/1740307999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf6a282e0 0x55acf6a36890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:53.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.005+0000 7f1f0e59c640 1 -- 172.21.15.7:0/1740307999 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acf6a37eb0 con 0x55acf6a279a0 2024-09-19T04:21:53.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.005+0000 7f1f0e59c640 1 --2- 172.21.15.7:0/1740307999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6a279a0 0x55acf6a36350 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f1f00009e00 tx=0x7f1f00005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e574148abc5e43 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:53.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.005+0000 7f1ef5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:21:53.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.005+0000 7f1ef5ffb640 1 -- 172.21.15.7:0/1740307999 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f00036070 con 0x55acf6a279a0 2024-09-19T04:21:53.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.005+0000 7f1ef5ffb640 1 -- 172.21.15.7:0/1740307999 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f1f00011040 con 0x55acf6a279a0 2024-09-19T04:21:53.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.005+0000 7f1f17cdc740 1 -- 172.21.15.7:0/1740307999 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f000055e0 con 0x55acf6a279a0 2024-09-19T04:21:53.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.006+0000 7f1ef5ffb640 1 -- 172.21.15.7:0/1740307999 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f1f0002d030 con 0x55acf6a279a0 2024-09-19T04:21:53.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.006+0000 7f1f17cdc740 10 client.16020 fetch_fsmap learned FSMap version 33 2024-09-19T04:21:53.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.006+0000 7f1f17cdc740 1 -- 172.21.15.7:0/1740307999 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55acf6a391c0 con 0x55acf6a279a0 2024-09-19T04:21:53.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.006+0000 7f1ef5ffb640 1 -- 172.21.15.7:0/1740307999 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f000055e0 con 0x55acf6a279a0 2024-09-19T04:21:53.014 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.006+0000 7f1ef5ffb640 1 -- 172.21.15.7:0/1740307999 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f1f00032450 con 0x55acf6a279a0 2024-09-19T04:21:53.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.006+0000 7f1f17cdc740 10 client.16020 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T04:21:53.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.006+0000 7f1f17cdc740 10 client.16020 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:21:53.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.006+0000 7f1f17cdc740 20 client.16020 populate_metadata read hostname 'smithi007' 2024-09-19T04:21:53.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.006+0000 7f1f17cdc740 1 --2- 172.21.15.7:0/1740307999 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55acf6ab1130 0x55acf6ab3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:53.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.006+0000 7f1f17cdc740 4 client.16020 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:21:53.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.006+0000 7f1f17cdc740 1 -- 172.21.15.7:0/1740307999 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55acf6992d70 con 0x55acf6ab1130 2024-09-19T04:21:53.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.006+0000 7f1f0dd9b640 1 --2- 172.21.15.7:0/1740307999 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55acf6ab1130 0x55acf6ab3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:53.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.007+0000 7f1f0dd9b640 1 --2- 172.21.15.7:0/1740307999 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55acf6ab1130 0x55acf6ab3550 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ceae9a91179a6d0 server_cookie=44578b7d8db0d77a in_seq=0 out_seq=0 2024-09-19T04:21:53.015 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.007+0000 7f1ef5ffb640 10 client.16020 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:21:53.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.248+0000 7f1ef5ffb640 1 -- 172.21.15.7:0/1740307999 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55acf6992d70 con 0x55acf6ab1130 2024-09-19T04:21:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.248+0000 7f1ef5ffb640 10 client.16020 handle_command_reply: tid=0 2024-09-19T04:21:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.248+0000 7f1f17cdc740 1 client.16020 shutdown 2024-09-19T04:21:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.249+0000 7f1f17cdc740 1 -- 172.21.15.7:0/1740307999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6a279a0 msgr2=0x55acf6a36350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.249+0000 7f1f17cdc740 1 --2- 172.21.15.7:0/1740307999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6a279a0 0x55acf6a36350 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f1f00009e00 tx=0x7f1f00005e60 comp rx=0 tx=0).stop 2024-09-19T04:21:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.249+0000 7f1f17cdc740 1 -- 172.21.15.7:0/1740307999 shutdown_connections 2024-09-19T04:21:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.249+0000 7f1f17cdc740 1 --2- 172.21.15.7:0/1740307999 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55acf6ab1130 0x55acf6ab3550 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.249+0000 7f1f17cdc740 1 --2- 172.21.15.7:0/1740307999 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55acf6a2d370 0x55acf6a378a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:53.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.249+0000 7f1ef5ffb640 0 client.16020 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:21:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.249+0000 7f1f17cdc740 1 --2- 172.21.15.7:0/1740307999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf6a282e0 0x55acf6a36890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.249+0000 7f1f17cdc740 1 --2- 172.21.15.7:0/1740307999 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55acf6a279a0 0x55acf6a36350 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.249+0000 7f1f17cdc740 1 -- 172.21.15.7:0/1740307999 >> 172.21.15.7:0/1740307999 conn(0x55acf6a23010 msgr2=0x55acf6a219a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.249+0000 7f1f17cdc740 1 -- 172.21.15.7:0/1740307999 shutdown_connections 2024-09-19T04:21:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.249+0000 7f1f17cdc740 1 -- 172.21.15.7:0/1740307999 wait complete. 2024-09-19T04:21:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.249+0000 7f1f17cdc740 20 client.16020 trim_cache size 0 max 16384 2024-09-19T04:21:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:21:53.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:21:53.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:21:53.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:21:53.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.249+0000 7f1f14f42640 1 -- 172.21.15.7:0/889563874 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1ef80a3240 msgr2=0x7f1ef80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.250+0000 7f1f14f42640 1 --2- 172.21.15.7:0/889563874 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1ef80a3240 0x7f1ef80a5700 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1f08004af0 tx=0x7f1f08030a30 comp rx=0 tx=0).stop 2024-09-19T04:21:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.250+0000 7f1f14f42640 1 -- 172.21.15.7:0/889563874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f10101c30 msgr2=0x7f1f101983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.250+0000 7f1f14f42640 1 --2- 172.21.15.7:0/889563874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f10101c30 0x7f1f101983b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1f0400e9f0 tx=0x7f1f0400edf0 comp rx=0 tx=0).stop 2024-09-19T04:21:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.250+0000 7f1f14f42640 1 -- 172.21.15.7:0/889563874 shutdown_connections 2024-09-19T04:21:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.250+0000 7f1f14f42640 1 --2- 172.21.15.7:0/889563874 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1ef80a3240 0x7f1ef80a5700 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.250+0000 7f1f14f42640 1 --2- 172.21.15.7:0/889563874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f101025f0 0x7f1f1019f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.250+0000 7f1f14f42640 1 --2- 172.21.15.7:0/889563874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f10101c30 0x7f1f101983b0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.250+0000 7f1f14f42640 1 --2- 172.21.15.7:0/889563874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f10100a40 0x7f1f10197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:53.254 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.250+0000 7f1f14f42640 1 -- 172.21.15.7:0/889563874 >> 172.21.15.7:0/889563874 conn(0x7f1f100fc1c0 msgr2=0x7f1f10069ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.250+0000 7f1f14f42640 1 -- 172.21.15.7:0/889563874 shutdown_connections 2024-09-19T04:21:53.255 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:21:53.250+0000 7f1f14f42640 1 -- 172.21.15.7:0/889563874 wait complete. 2024-09-19T04:21:54.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:54 smithi007 ceph-mon[31360]: pgmap v504: 129 pgs: 129 active+clean; 319 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 649 KiB/s wr, 172 op/s 2024-09-19T04:21:54.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:54 smithi102 ceph-mon[35446]: pgmap v504: 129 pgs: 129 active+clean; 319 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 649 KiB/s wr, 172 op/s 2024-09-19T04:21:54.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:54 smithi092 ceph-mon[34940]: pgmap v504: 129 pgs: 129 active+clean; 319 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 649 KiB/s wr, 172 op/s 2024-09-19T04:21:55.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:55.331+0000 7fb990ff9640 1 -- 172.21.15.7:0/3803080829 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5611a6ce7d20 con 0x5611a6e01a00 2024-09-19T04:21:55.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:55.331+0000 7fb990ff9640 10 client.16002 handle_command_reply: tid=0 2024-09-19T04:21:55.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:55.331+0000 7fb9b1afd740 1 client.16002 shutdown 2024-09-19T04:21:55.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:55.331+0000 7fb9b1afd740 1 -- 172.21.15.7:0/3803080829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a6d7a760 msgr2=0x5611a6d8de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:55.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:55.331+0000 7fb9b1afd740 1 --2- 172.21.15.7:0/3803080829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a6d7a760 0x5611a6d8de50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb998003730 tx=0x7fb998005a20 comp rx=0 tx=0).stop 2024-09-19T04:21:55.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:55.331+0000 7fb9b1afd740 1 -- 172.21.15.7:0/3803080829 shutdown_connections 2024-09-19T04:21:55.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:55.331+0000 7fb9b1afd740 1 --2- 172.21.15.7:0/3803080829 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5611a6e01a00 0x5611a6e03e20 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:55.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:55.331+0000 7fb9b1afd740 1 --2- 172.21.15.7:0/3803080829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5611a6d85940 0x5611a6d8a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:55.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:55.331+0000 7fb9b1afd740 1 --2- 172.21.15.7:0/3803080829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5611a6d7b080 0x5611a6d8a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:55.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:55.331+0000 7fb990ff9640 0 client.16002 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:21:55.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:55.331+0000 7fb9b1afd740 1 --2- 172.21.15.7:0/3803080829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5611a6d7a760 0x5611a6d8de50 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:55.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:55.331+0000 7fb9b1afd740 1 -- 172.21.15.7:0/3803080829 >> 172.21.15.7:0/3803080829 conn(0x5611a6d76cf0 msgr2=0x5611a6d83030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:55.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:55.331+0000 7fb9b1afd740 1 -- 172.21.15.7:0/3803080829 shutdown_connections 2024-09-19T04:21:55.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:55.331+0000 7fb9b1afd740 1 -- 172.21.15.7:0/3803080829 wait complete. 2024-09-19T04:21:55.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:55.332+0000 7fb9b1afd740 20 client.16002 trim_cache size 0 max 16384 2024-09-19T04:21:55.334 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:21:55.335 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 33, 2024-09-19T04:21:55.335 INFO:teuthology.orchestra.run.smithi007.stdout: "leader": 24506, 2024-09-19T04:21:55.335 INFO:teuthology.orchestra.run.smithi007.stdout: "set_version": 22, 2024-09-19T04:21:55.335 INFO:teuthology.orchestra.run.smithi007.stdout: "sets": { 2024-09-19T04:21:55.335 INFO:teuthology.orchestra.run.smithi007.stdout: "3281ba4b": { 2024-09-19T04:21:55.335 INFO:teuthology.orchestra.run.smithi007.stdout: "version": 22, 2024-09-19T04:21:55.335 INFO:teuthology.orchestra.run.smithi007.stdout: "age_ref": 0.0, 2024-09-19T04:21:55.335 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:21:55.335 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "QUIESCED", 2024-09-19T04:21:55.335 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:21:55.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:21:55.335 INFO:teuthology.orchestra.run.smithi007.stdout: "timeout": 90.0, 2024-09-19T04:21:55.335 INFO:teuthology.orchestra.run.smithi007.stdout: "expiration": 149.8, 2024-09-19T04:21:55.335 INFO:teuthology.orchestra.run.smithi007.stdout: "members": { 2024-09-19T04:21:55.336 INFO:teuthology.orchestra.run.smithi007.stdout: "file:/": { 2024-09-19T04:21:55.336 INFO:teuthology.orchestra.run.smithi007.stdout: "excluded": false, 2024-09-19T04:21:55.336 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:21:55.336 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "QUIESCED", 2024-09-19T04:21:55.336 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:21:55.336 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:21:55.336 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:21:55.336 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:21:55.336 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:21:55.336 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:21:55.336 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:21:55.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:55.332+0000 7fb9af724640 1 -- 172.21.15.7:0/3662188183 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb9940a32c0 msgr2=0x7fb9940a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:55.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:55.332+0000 7fb9af724640 1 --2- 172.21.15.7:0/3662188183 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb9940a32c0 0x7fb9940a5780 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb9a009c480 tx=0x7fb9a0005440 comp rx=0 tx=0).stop 2024-09-19T04:21:55.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:55.332+0000 7fb9af724640 1 -- 172.21.15.7:0/3662188183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9a8112a30 msgr2=0x7fb9a819e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:55.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:55.332+0000 7fb9af724640 1 --2- 172.21.15.7:0/3662188183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9a8112a30 0x7fb9a819e8b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fb9a807aa10 tx=0x7fb9a000ef10 comp rx=0 tx=0).stop 2024-09-19T04:21:55.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:55.332+0000 7fb9af724640 1 -- 172.21.15.7:0/3662188183 shutdown_connections 2024-09-19T04:21:55.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:55.332+0000 7fb9af724640 1 --2- 172.21.15.7:0/3662188183 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb9940a32c0 0x7fb9940a5780 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:55.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:55.332+0000 7fb9af724640 1 --2- 172.21.15.7:0/3662188183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9a8112a30 0x7fb9a819e8b0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:55.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:55.332+0000 7fb9af724640 1 --2- 172.21.15.7:0/3662188183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9a8077040 0x7fb9a81a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:55.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:55.332+0000 7fb9af724640 1 --2- 172.21.15.7:0/3662188183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9a8076720 0x7fb9a81a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:55.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:55.332+0000 7fb9af724640 1 -- 172.21.15.7:0/3662188183 >> 172.21.15.7:0/3662188183 conn(0x7fb9a80ffab0 msgr2=0x7fb9a8101ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:55.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:55.332+0000 7fb9af724640 1 -- 172.21.15.7:0/3662188183 shutdown_connections 2024-09-19T04:21:55.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:21:55.332+0000 7fb9af724640 1 -- 172.21.15.7:0/3662188183 wait complete. 2024-09-19T04:21:56.138 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3281ba4b', quiesce took 10.9 seconds. Will release after: 18.9 2024-09-19T04:21:56.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:56 smithi007 ceph-mon[31360]: pgmap v505: 129 pgs: 129 active+clean; 319 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 572 KiB/s wr, 160 op/s 2024-09-19T04:21:56.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:56 smithi102 ceph-mon[35446]: pgmap v505: 129 pgs: 129 active+clean; 319 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 572 KiB/s wr, 160 op/s 2024-09-19T04:21:56.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:56 smithi092 ceph-mon[34940]: pgmap v505: 129 pgs: 129 active+clean; 319 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 572 KiB/s wr, 160 op/s 2024-09-19T04:21:58.158 INFO:tasks.workunit.client.0.smithi007.stdout: 103 2227 1 2188 3 1756 4 2024-09-19T04:21:58.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:21:58 smithi007 ceph-mon[31360]: pgmap v506: 129 pgs: 129 active+clean; 319 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 550 KiB/s wr, 136 op/s 2024-09-19T04:21:58.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:21:58 smithi102 ceph-mon[35446]: pgmap v506: 129 pgs: 129 active+clean; 319 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 550 KiB/s wr, 136 op/s 2024-09-19T04:21:58.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:21:58 smithi092 ceph-mon[34940]: pgmap v506: 129 pgs: 129 active+clean; 319 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 550 KiB/s wr, 136 op/s 2024-09-19T04:22:00.598 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:00 smithi092 ceph-mon[34940]: pgmap v507: 129 pgs: 129 active+clean; 323 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 1.2 MiB/s wr, 228 op/s 2024-09-19T04:22:00.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:00 smithi007 ceph-mon[31360]: pgmap v507: 129 pgs: 129 active+clean; 323 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 1.2 MiB/s wr, 228 op/s 2024-09-19T04:22:00.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:00 smithi102 ceph-mon[35446]: pgmap v507: 129 pgs: 129 active+clean; 323 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 1.2 MiB/s wr, 228 op/s 2024-09-19T04:22:02.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:02 smithi007 ceph-mon[31360]: pgmap v508: 129 pgs: 129 active+clean; 323 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 1.1 MiB/s wr, 232 op/s 2024-09-19T04:22:02.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:02 smithi102 ceph-mon[35446]: pgmap v508: 129 pgs: 129 active+clean; 323 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 1.1 MiB/s wr, 232 op/s 2024-09-19T04:22:02.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:02 smithi092 ceph-mon[34940]: pgmap v508: 129 pgs: 129 active+clean; 323 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 1.1 MiB/s wr, 232 op/s 2024-09-19T04:22:04.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:04 smithi007 ceph-mon[31360]: pgmap v509: 129 pgs: 129 active+clean; 325 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.2 MiB/s wr, 279 op/s 2024-09-19T04:22:04.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:04 smithi007 ceph-mon[31360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:22:04.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:04 smithi102 ceph-mon[35446]: pgmap v509: 129 pgs: 129 active+clean; 325 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.2 MiB/s wr, 279 op/s 2024-09-19T04:22:04.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:04 smithi102 ceph-mon[35446]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:22:04.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:04 smithi092 ceph-mon[34940]: pgmap v509: 129 pgs: 129 active+clean; 325 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.2 MiB/s wr, 279 op/s 2024-09-19T04:22:04.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:04 smithi092 ceph-mon[34940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:22:06.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.351+0000 7fe40a8f1640 1 -- 172.21.15.7:0/3716228855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe404101b60 msgr2=0x7fe404101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:06.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.351+0000 7fe40a8f1640 1 --2- 172.21.15.7:0/3716228855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe404101b60 0x7fe404101f60 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4009900 tx=0x7fe3f402a410 comp rx=0 tx=0).stop 2024-09-19T04:22:06.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.351+0000 7fe40a8f1640 1 -- 172.21.15.7:0/3716228855 shutdown_connections 2024-09-19T04:22:06.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.351+0000 7fe40a8f1640 1 --2- 172.21.15.7:0/3716228855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe404103710 0x7fe404109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:06.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.351+0000 7fe40a8f1640 1 --2- 172.21.15.7:0/3716228855 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe404102d50 0x7fe4041031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:06.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.351+0000 7fe40a8f1640 1 --2- 172.21.15.7:0/3716228855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe404101b60 0x7fe404101f60 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:06.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.351+0000 7fe40a8f1640 1 -- 172.21.15.7:0/3716228855 >> 172.21.15.7:0/3716228855 conn(0x7fe4040fd2e0 msgr2=0x7fe4040ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:06.353 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.351+0000 7fe40a8f1640 1 -- 172.21.15.7:0/3716228855 shutdown_connections 2024-09-19T04:22:06.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.351+0000 7fe40a8f1640 1 -- 172.21.15.7:0/3716228855 wait complete. 2024-09-19T04:22:06.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.352+0000 7fe40a8f1640 1 Processor -- start 2024-09-19T04:22:06.354 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.352+0000 7fe40a8f1640 1 -- start start 2024-09-19T04:22:06.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.352+0000 7fe40a8f1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe404101b60 0x7fe404197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:06.355 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.352+0000 7fe40a8f1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe404102d50 0x7fe404198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:06.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.352+0000 7fe40a8f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe404103710 0x7fe40419f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:06.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.352+0000 7fe40a8f1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe40410d7c0 con 0x7fe404101b60 2024-09-19T04:22:06.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.352+0000 7fe40a8f1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe40410d640 con 0x7fe404102d50 2024-09-19T04:22:06.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.352+0000 7fe40a8f1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe40410d940 con 0x7fe404103710 2024-09-19T04:22:06.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.352+0000 7fe403fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe404101b60 0x7fe404197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:06.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.352+0000 7fe403fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe404101b60 0x7fe404197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42356/0 (socket says 172.21.15.7:42356) 2024-09-19T04:22:06.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.352+0000 7fe403fff640 1 -- 172.21.15.7:0/666435319 learned_addr learned my addr 172.21.15.7:0/666435319 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:22:06.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.352+0000 7fe4037fe640 1 --2- 172.21.15.7:0/666435319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe404102d50 0x7fe404198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:06.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.352+0000 7fe408e8e640 1 --2- 172.21.15.7:0/666435319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe404103710 0x7fe40419f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:06.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.352+0000 7fe403fff640 1 -- 172.21.15.7:0/666435319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe404103710 msgr2=0x7fe40419f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:06.356 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.352+0000 7fe403fff640 1 --2- 172.21.15.7:0/666435319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe404103710 0x7fe40419f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:06.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.352+0000 7fe403fff640 1 -- 172.21.15.7:0/666435319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe404102d50 msgr2=0x7fe404198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:06.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.352+0000 7fe403fff640 1 --2- 172.21.15.7:0/666435319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe404102d50 0x7fe404198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:06.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.353+0000 7fe403fff640 1 -- 172.21.15.7:0/666435319 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe40419faf0 con 0x7fe404101b60 2024-09-19T04:22:06.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.353+0000 7fe408e8e640 1 --2- 172.21.15.7:0/666435319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe404103710 0x7fe40419f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:22:06.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.353+0000 7fe403fff640 1 --2- 172.21.15.7:0/666435319 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe404101b60 0x7fe404197ed0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4031610 tx=0x7fe3f4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:06.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.353+0000 7fe4017fa640 1 -- 172.21.15.7:0/666435319 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f403f030 con 0x7fe404101b60 2024-09-19T04:22:06.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.353+0000 7fe4017fa640 1 -- 172.21.15.7:0/666435319 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3f4003ad0 con 0x7fe404101b60 2024-09-19T04:22:06.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.353+0000 7fe40a8f1640 1 -- 172.21.15.7:0/666435319 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe40419fd80 con 0x7fe404101b60 2024-09-19T04:22:06.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.353+0000 7fe4017fa640 1 -- 172.21.15.7:0/666435319 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f4035070 con 0x7fe404101b60 2024-09-19T04:22:06.357 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.353+0000 7fe40a8f1640 1 -- 172.21.15.7:0/666435319 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4041a0200 con 0x7fe404101b60 2024-09-19T04:22:06.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.356+0000 7fe4017fa640 1 -- 172.21.15.7:0/666435319 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fe3f4042030 con 0x7fe404101b60 2024-09-19T04:22:06.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.356+0000 7fe40d68b740 1 Processor -- start 2024-09-19T04:22:06.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.356+0000 7fe40d68b740 1 -- start start 2024-09-19T04:22:06.359 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.356+0000 7fe40d68b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674a2d79a0 0x55674a2d7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:06.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.356+0000 7fe40d68b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674a2d82e0 0x55674a2dcda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:06.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.357+0000 7fe40d68b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55674a2dd370 0x55674a2df830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:06.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.357+0000 7fe40d68b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55674a23b2f0 con 0x55674a2d79a0 2024-09-19T04:22:06.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.357+0000 7fe40d68b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55674a1e3270 con 0x55674a2d82e0 2024-09-19T04:22:06.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.357+0000 7fe40d68b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55674a2372b0 con 0x55674a2dd370 2024-09-19T04:22:06.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.357+0000 7fe408e8e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674a2d79a0 0x55674a2d7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:06.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.357+0000 7fe403fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674a2d82e0 0x55674a2dcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:06.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.357+0000 7fe4037fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55674a2dd370 0x55674a2df830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:06.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.357+0000 7fe408e8e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674a2d79a0 0x55674a2d7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42372/0 (socket says 172.21.15.7:42372) 2024-09-19T04:22:06.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.357+0000 7fe408e8e640 1 -- 172.21.15.7:0/4112032555 learned_addr learned my addr 172.21.15.7:0/4112032555 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:22:06.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.357+0000 7fe408e8e640 1 -- 172.21.15.7:0/4112032555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55674a2dd370 msgr2=0x55674a2df830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:06.360 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.357+0000 7fe408e8e640 1 --2- 172.21.15.7:0/4112032555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55674a2dd370 0x55674a2df830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:06.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.357+0000 7fe408e8e640 1 -- 172.21.15.7:0/4112032555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674a2d82e0 msgr2=0x55674a2dcda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:06.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.357+0000 7fe408e8e640 1 --2- 172.21.15.7:0/4112032555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674a2d82e0 0x55674a2dcda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:06.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.357+0000 7fe408e8e640 1 -- 172.21.15.7:0/4112032555 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55674a1e2340 con 0x55674a2d79a0 2024-09-19T04:22:06.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.357+0000 7fe4017fa640 1 --2- 172.21.15.7:0/666435319 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe3ec0a32c0 0x7fe3ec0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:06.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.357+0000 7fe403fff640 1 --2- 172.21.15.7:0/4112032555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674a2d82e0 0x55674a2dcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:22:06.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.357+0000 7fe403fff640 1 --2- 172.21.15.7:0/666435319 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe3ec0a32c0 0x7fe3ec0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:06.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.357+0000 7fe4017fa640 1 -- 172.21.15.7:0/666435319 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fe3f40f02c0 con 0x7fe404101b60 2024-09-19T04:22:06.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.357+0000 7fe408e8e640 1 --2- 172.21.15.7:0/4112032555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674a2d79a0 0x55674a2d7da0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc010450 tx=0x7fe3fc010910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5906dd2a3f5e1e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:06.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.358+0000 7fe3ea7fc640 1 -- 172.21.15.7:0/4112032555 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc017070 con 0x55674a2d79a0 2024-09-19T04:22:06.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.358+0000 7fe3ea7fc640 1 -- 172.21.15.7:0/4112032555 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3fc011c40 con 0x55674a2d79a0 2024-09-19T04:22:06.361 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.358+0000 7fe3ea7fc640 1 -- 172.21.15.7:0/4112032555 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc01ad30 con 0x55674a2d79a0 2024-09-19T04:22:06.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.359+0000 7fe403fff640 1 --2- 172.21.15.7:0/666435319 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe3ec0a32c0 0x7fe3ec0a5780 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe3f40b8970 tx=0x7fe3f40f3d40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:06.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.359+0000 7fe40d68b740 1 -- 172.21.15.7:0/4112032555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674a2d79a0 msgr2=0x55674a2d7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:06.364 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.359+0000 7fe40d68b740 1 --2- 172.21.15.7:0/4112032555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674a2d79a0 0x55674a2d7da0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc010450 tx=0x7fe3fc010910 comp rx=0 tx=0).stop 2024-09-19T04:22:06.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.359+0000 7fe40d68b740 1 -- 172.21.15.7:0/4112032555 shutdown_connections 2024-09-19T04:22:06.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.359+0000 7fe40d68b740 1 --2- 172.21.15.7:0/4112032555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55674a2dd370 0x55674a2df830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:06.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.359+0000 7fe40d68b740 1 --2- 172.21.15.7:0/4112032555 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674a2d82e0 0x55674a2dcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:06.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.359+0000 7fe40d68b740 1 --2- 172.21.15.7:0/4112032555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674a2d79a0 0x55674a2d7da0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:06.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.359+0000 7fe40d68b740 1 -- 172.21.15.7:0/4112032555 >> 172.21.15.7:0/4112032555 conn(0x55674a2d3010 msgr2=0x55674a2d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:06.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.359+0000 7fe40d68b740 1 -- 172.21.15.7:0/4112032555 shutdown_connections 2024-09-19T04:22:06.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.359+0000 7fe40d68b740 1 -- 172.21.15.7:0/4112032555 wait complete. 2024-09-19T04:22:06.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.359+0000 7fe40d68b740 1 -- start start 2024-09-19T04:22:06.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.360+0000 7fe40d68b740 1 Processor -- start 2024-09-19T04:22:06.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.360+0000 7fe40d68b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674a2d79a0 0x55674a2e1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:06.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.360+0000 7fe40d68b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674a2d82e0 0x55674a2e20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:06.365 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.360+0000 7fe40d68b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55674a2dd370 0x55674a2e9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.360+0000 7fe40d68b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55674a2e0340 con 0x55674a2d79a0 2024-09-19T04:22:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.360+0000 7fe40d68b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55674a1c4290 con 0x55674a2d82e0 2024-09-19T04:22:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.360+0000 7fe40d68b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55674a2e04c0 con 0x55674a2dd370 2024-09-19T04:22:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.360+0000 7fe40d68b740 10 client.0 _ll_register_callbacks cb 0x55674a1f5140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:22:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.360+0000 7fe408e8e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674a2d79a0 0x55674a2e1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.360+0000 7fe4037fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674a2d82e0 0x55674a2e20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.360+0000 7fe408e8e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674a2d79a0 0x55674a2e1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42382/0 (socket says 172.21.15.7:42382) 2024-09-19T04:22:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.360+0000 7fe408e8e640 1 -- 172.21.15.7:0/613282997 learned_addr learned my addr 172.21.15.7:0/613282997 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:22:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.360+0000 7fe408e8e640 1 --2- 172.21.15.7:0/613282997 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55674a2dd370 0x55674a2e9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.360+0000 7fe4037fe640 1 -- 172.21.15.7:0/613282997 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55674a2dd370 msgr2=0x55674a2e9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.360+0000 7fe4037fe640 1 --2- 172.21.15.7:0/613282997 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55674a2dd370 0x55674a2e9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.361+0000 7fe4037fe640 1 -- 172.21.15.7:0/613282997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674a2d79a0 msgr2=0x55674a2e1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:06.366 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.361+0000 7fe4037fe640 1 --2- 172.21.15.7:0/613282997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674a2d79a0 0x55674a2e1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:06.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.361+0000 7fe4037fe640 1 -- 172.21.15.7:0/613282997 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556749f4e210 con 0x55674a2d82e0 2024-09-19T04:22:06.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.361+0000 7fe408e8e640 1 --2- 172.21.15.7:0/613282997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674a2d79a0 0x55674a2e1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:22:06.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.361+0000 7fe4037fe640 1 --2- 172.21.15.7:0/613282997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674a2d82e0 0x55674a2e20e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe4041993e0 tx=0x7fe3f8012b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85dc5cc3752d2fdd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:06.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.361+0000 7fe3e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T04:22:06.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.361+0000 7fe3e37fe640 1 -- 172.21.15.7:0/613282997 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f800f920 con 0x55674a2d82e0 2024-09-19T04:22:06.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.361+0000 7fe3e37fe640 1 -- 172.21.15.7:0/613282997 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fe3f800fac0 con 0x55674a2d82e0 2024-09-19T04:22:06.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.361+0000 7fe40d68b740 1 -- 172.21.15.7:0/613282997 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3fc011c40 con 0x55674a2d82e0 2024-09-19T04:22:06.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.361+0000 7fe3e37fe640 1 -- 172.21.15.7:0/613282997 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe3f800fcc0 con 0x55674a2d82e0 2024-09-19T04:22:06.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.361+0000 7fe40d68b740 10 client.25640 fetch_fsmap learned FSMap version 34 2024-09-19T04:22:06.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.361+0000 7fe40d68b740 1 -- 172.21.15.7:0/613282997 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55674a01a620 con 0x55674a2d82e0 2024-09-19T04:22:06.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.361+0000 7fe3e37fe640 1 -- 172.21.15.7:0/613282997 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3fc011c40 con 0x55674a2d82e0 2024-09-19T04:22:06.367 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.361+0000 7fe3e37fe640 1 -- 172.21.15.7:0/613282997 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 34) ==== 8378+0+0 (secure 0 0 0) 0x7fe3f801c420 con 0x55674a2d82e0 2024-09-19T04:22:06.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.361+0000 7fe40d68b740 10 client.25640 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:22:06.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.362+0000 7fe40d68b740 10 client.25640 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:22:06.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.362+0000 7fe40d68b740 20 client.25640 populate_metadata read hostname 'smithi007' 2024-09-19T04:22:06.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.362+0000 7fe40d68b740 1 --2- 172.21.15.7:0/613282997 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55674a2eaf00 0x55674a2ed380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:06.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.362+0000 7fe40d68b740 4 client.25640 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:22:06.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.362+0000 7fe40d68b740 1 -- 172.21.15.7:0/613282997 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55674a248a20 con 0x55674a2eaf00 2024-09-19T04:22:06.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.362+0000 7fe408e8e640 1 --2- 172.21.15.7:0/613282997 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55674a2eaf00 0x55674a2ed380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:06.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.362+0000 7fe3e37fe640 10 client.25640 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:22:06.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.362+0000 7fe408e8e640 1 --2- 172.21.15.7:0/613282997 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55674a2eaf00 0x55674a2ed380 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea2f5b28ed5a1734 server_cookie=434985c212b43bb2 in_seq=0 out_seq=0 2024-09-19T04:22:06.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.365+0000 7fe3e37fe640 1 -- 172.21.15.7:0/613282997 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55674a248a20 con 0x55674a2eaf00 2024-09-19T04:22:06.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.365+0000 7fe3e37fe640 10 client.25640 handle_command_reply: tid=0 2024-09-19T04:22:06.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.365+0000 7fe40d68b740 1 client.25640 shutdown 2024-09-19T04:22:06.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.365+0000 7fe40d68b740 1 -- 172.21.15.7:0/613282997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674a2d82e0 msgr2=0x55674a2e20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:06.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.365+0000 7fe40d68b740 1 --2- 172.21.15.7:0/613282997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674a2d82e0 0x55674a2e20e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe4041993e0 tx=0x7fe3f8012b60 comp rx=0 tx=0).stop 2024-09-19T04:22:06.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.365+0000 7fe40d68b740 1 -- 172.21.15.7:0/613282997 shutdown_connections 2024-09-19T04:22:06.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.365+0000 7fe40d68b740 1 --2- 172.21.15.7:0/613282997 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55674a2eaf00 0x55674a2ed380 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:06.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.365+0000 7fe40d68b740 1 --2- 172.21.15.7:0/613282997 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55674a2dd370 0x55674a2e9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:06.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.365+0000 7fe40d68b740 1 --2- 172.21.15.7:0/613282997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674a2d82e0 0x55674a2e20e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:06.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.365+0000 7fe3e37fe640 0 client.25640 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:22:06.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.365+0000 7fe40d68b740 1 --2- 172.21.15.7:0/613282997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674a2d79a0 0x55674a2e1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:06.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.365+0000 7fe40d68b740 1 -- 172.21.15.7:0/613282997 >> 172.21.15.7:0/613282997 conn(0x55674a2d3010 msgr2=0x55674a2d4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:06.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.365+0000 7fe40d68b740 1 -- 172.21.15.7:0/613282997 shutdown_connections 2024-09-19T04:22:06.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.366+0000 7fe40d68b740 1 -- 172.21.15.7:0/613282997 wait complete. 2024-09-19T04:22:06.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.366+0000 7fe40d68b740 20 client.25640 trim_cache size 0 max 16384 2024-09-19T04:22:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.381+0000 7fe40d68b740 1 Processor -- start 2024-09-19T04:22:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.381+0000 7fe40d68b740 1 -- start start 2024-09-19T04:22:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.382+0000 7fe40d68b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674a2d79a0 0x55674a2d20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.382+0000 7fe40d68b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55674a2d82e0 0x55674a2e90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.382+0000 7fe40d68b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674a2dd370 0x55674a2d4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.382+0000 7fe40d68b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe4041a8720 con 0x55674a2d79a0 2024-09-19T04:22:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.382+0000 7fe40d68b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe4041aa2c0 con 0x55674a2dd370 2024-09-19T04:22:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.382+0000 7fe40d68b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe4041a8df0 con 0x55674a2d82e0 2024-09-19T04:22:06.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.382+0000 7fe408e8e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674a2d79a0 0x55674a2d20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.382+0000 7fe408e8e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674a2d79a0 0x55674a2d20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42384/0 (socket says 172.21.15.7:42384) 2024-09-19T04:22:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.382+0000 7fe408e8e640 1 -- 172.21.15.7:0/2123576526 learned_addr learned my addr 172.21.15.7:0/2123576526 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:22:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.382+0000 7fe4037fe640 1 --2- 172.21.15.7:0/2123576526 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55674a2d82e0 0x55674a2e90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.382+0000 7fe408e8e640 1 --2- 172.21.15.7:0/2123576526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674a2dd370 0x55674a2d4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.382+0000 7fe4037fe640 1 -- 172.21.15.7:0/2123576526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674a2dd370 msgr2=0x55674a2d4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.382+0000 7fe4037fe640 1 --2- 172.21.15.7:0/2123576526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674a2dd370 0x55674a2d4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.382+0000 7fe4037fe640 1 -- 172.21.15.7:0/2123576526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674a2d79a0 msgr2=0x55674a2d20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.382+0000 7fe4037fe640 1 --2- 172.21.15.7:0/2123576526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674a2d79a0 0x55674a2d20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.382+0000 7fe4037fe640 1 -- 172.21.15.7:0/2123576526 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55674a2e16e0 con 0x55674a2d82e0 2024-09-19T04:22:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.382+0000 7fe408e8e640 1 --2- 172.21.15.7:0/2123576526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674a2d79a0 0x55674a2d20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:22:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.383+0000 7fe4037fe640 1 --2- 172.21.15.7:0/2123576526 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55674a2d82e0 0x55674a2e90e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe3f80097e0 tx=0x7fe3f8009370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=892350e0369a58f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:06.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.383+0000 7fe3e9ffb640 1 -- 172.21.15.7:0/2123576526 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f800f920 con 0x55674a2d82e0 2024-09-19T04:22:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.383+0000 7fe3e9ffb640 1 -- 172.21.15.7:0/2123576526 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3f800fac0 con 0x55674a2d82e0 2024-09-19T04:22:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.383+0000 7fe3e9ffb640 1 -- 172.21.15.7:0/2123576526 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f80035f0 con 0x55674a2d82e0 2024-09-19T04:22:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.384+0000 7fe40d68b740 1 -- 172.21.15.7:0/2123576526 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55674a2d82e0 msgr2=0x55674a2e90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.384+0000 7fe40d68b740 1 --2- 172.21.15.7:0/2123576526 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55674a2d82e0 0x55674a2e90e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe3f80097e0 tx=0x7fe3f8009370 comp rx=0 tx=0).stop 2024-09-19T04:22:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.384+0000 7fe40d68b740 1 -- 172.21.15.7:0/2123576526 shutdown_connections 2024-09-19T04:22:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.384+0000 7fe40d68b740 1 --2- 172.21.15.7:0/2123576526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674a2dd370 0x55674a2d4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.384+0000 7fe40d68b740 1 --2- 172.21.15.7:0/2123576526 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55674a2d82e0 0x55674a2e90e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.384+0000 7fe40d68b740 1 --2- 172.21.15.7:0/2123576526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674a2d79a0 0x55674a2d20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.384+0000 7fe40d68b740 1 -- 172.21.15.7:0/2123576526 >> 172.21.15.7:0/2123576526 conn(0x55674a2d3010 msgr2=0x55674a2d19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.384+0000 7fe40d68b740 1 -- 172.21.15.7:0/2123576526 shutdown_connections 2024-09-19T04:22:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.384+0000 7fe40d68b740 1 -- 172.21.15.7:0/2123576526 wait complete. 2024-09-19T04:22:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.384+0000 7fe40d68b740 1 -- start start 2024-09-19T04:22:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.384+0000 7fe40d68b740 1 Processor -- start 2024-09-19T04:22:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.384+0000 7fe40d68b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674a2d79a0 0x55674a2e6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.384+0000 7fe40d68b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55674a2d82e0 0x55674a2e6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.385+0000 7fe40d68b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674a2dd370 0x55674a2e7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.385+0000 7fe40d68b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe4041a9b90 con 0x55674a2d79a0 2024-09-19T04:22:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.385+0000 7fe40d68b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe4041a94c0 con 0x55674a2dd370 2024-09-19T04:22:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.385+0000 7fe40d68b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe4041a66e0 con 0x55674a2d82e0 2024-09-19T04:22:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.385+0000 7fe40d68b740 10 client.0 _ll_register_callbacks cb 0x7fe3f8009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:22:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.385+0000 7fe4037fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55674a2d82e0 0x55674a2e6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.385+0000 7fe408e8e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674a2d79a0 0x55674a2e6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.385+0000 7fe4037fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55674a2d82e0 0x55674a2e6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:42678/0 (socket says 172.21.15.7:42678) 2024-09-19T04:22:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.385+0000 7fe4037fe640 1 -- 172.21.15.7:0/3913533001 learned_addr learned my addr 172.21.15.7:0/3913533001 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:22:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.385+0000 7fe408e8e640 1 --2- 172.21.15.7:0/3913533001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674a2dd370 0x55674a2e7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.385+0000 7fe4037fe640 1 -- 172.21.15.7:0/3913533001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674a2dd370 msgr2=0x55674a2e7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.385+0000 7fe4037fe640 1 --2- 172.21.15.7:0/3913533001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674a2dd370 0x55674a2e7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.385+0000 7fe4037fe640 1 -- 172.21.15.7:0/3913533001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674a2d79a0 msgr2=0x55674a2e6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.385+0000 7fe4037fe640 1 --2- 172.21.15.7:0/3913533001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674a2d79a0 0x55674a2e6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.385+0000 7fe4037fe640 1 -- 172.21.15.7:0/3913533001 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55674a2d8f70 con 0x55674a2d82e0 2024-09-19T04:22:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.385+0000 7fe408e8e640 1 --2- 172.21.15.7:0/3913533001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674a2d79a0 0x55674a2e6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:22:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.385+0000 7fe4037fe640 1 --2- 172.21.15.7:0/3913533001 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55674a2d82e0 0x55674a2e6d60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8000c00 tx=0x7fe3f8005720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bd4fe7989cb206a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.385+0000 7fe3e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-19T04:22:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.385+0000 7fe3e37fe640 1 -- 172.21.15.7:0/3913533001 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f800f920 con 0x55674a2d82e0 2024-09-19T04:22:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.386+0000 7fe3e37fe640 1 -- 172.21.15.7:0/3913533001 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fe3f802f040 con 0x55674a2d82e0 2024-09-19T04:22:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.386+0000 7fe40d68b740 1 -- 172.21.15.7:0/3913533001 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3f800fac0 con 0x55674a2d82e0 2024-09-19T04:22:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.386+0000 7fe3e37fe640 1 -- 172.21.15.7:0/3913533001 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe3f803c050 con 0x55674a2d82e0 2024-09-19T04:22:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.386+0000 7fe40d68b740 10 client.25717 fetch_fsmap learned FSMap version 34 2024-09-19T04:22:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.386+0000 7fe40d68b740 1 -- 172.21.15.7:0/3913533001 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55674a2e94c0 con 0x55674a2d82e0 2024-09-19T04:22:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.386+0000 7fe3e37fe640 1 -- 172.21.15.7:0/3913533001 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3f800fac0 con 0x55674a2d82e0 2024-09-19T04:22:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.386+0000 7fe3e37fe640 1 -- 172.21.15.7:0/3913533001 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 34) ==== 8378+0+0 (secure 0 0 0) 0x7fe3f8010430 con 0x55674a2d82e0 2024-09-19T04:22:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.386+0000 7fe40d68b740 10 client.25717 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:22:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.386+0000 7fe40d68b740 10 client.25717 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:22:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.386+0000 7fe40d68b740 20 client.25717 populate_metadata read hostname 'smithi007' 2024-09-19T04:22:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.386+0000 7fe40d68b740 1 --2- 172.21.15.7:0/3913533001 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55674a3614a0 0x55674a3638c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.386+0000 7fe40d68b740 4 client.25717 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:22:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.386+0000 7fe40d68b740 1 -- 172.21.15.7:0/3913533001 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55674a242d70 con 0x55674a3614a0 2024-09-19T04:22:06.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.386+0000 7fe408e8e640 1 --2- 172.21.15.7:0/3913533001 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55674a3614a0 0x55674a3638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:06.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.387+0000 7fe3e37fe640 10 client.25717 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:22:06.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:06.387+0000 7fe408e8e640 1 --2- 172.21.15.7:0/3913533001 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55674a3614a0 0x55674a3638c0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55edc8398434fac server_cookie=8125c56d28f42886 in_seq=0 out_seq=0 2024-09-19T04:22:06.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:06 smithi007 ceph-mon[31360]: pgmap v510: 129 pgs: 129 active+clean; 325 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 965 KiB/s wr, 333 op/s 2024-09-19T04:22:06.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:06 smithi102 ceph-mon[35446]: pgmap v510: 129 pgs: 129 active+clean; 325 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 965 KiB/s wr, 333 op/s 2024-09-19T04:22:06.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:06 smithi092 ceph-mon[34940]: pgmap v510: 129 pgs: 129 active+clean; 325 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 965 KiB/s wr, 333 op/s 2024-09-19T04:22:08.158 INFO:tasks.workunit.client.0.smithi007.stdout: 103 50654 0 36826 0 29023 0 2024-09-19T04:22:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:08.268+0000 7fe3e37fe640 1 -- 172.21.15.7:0/3913533001 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55674a242d70 con 0x55674a3614a0 2024-09-19T04:22:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:08.268+0000 7fe3e37fe640 10 client.25717 handle_command_reply: tid=0 2024-09-19T04:22:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:08.268+0000 7fe40d68b740 1 client.25717 shutdown 2024-09-19T04:22:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:08.268+0000 7fe40d68b740 1 -- 172.21.15.7:0/3913533001 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55674a2d82e0 msgr2=0x55674a2e6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:08.268+0000 7fe40d68b740 1 --2- 172.21.15.7:0/3913533001 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55674a2d82e0 0x55674a2e6d60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe3f8000c00 tx=0x7fe3f8005720 comp rx=0 tx=0).stop 2024-09-19T04:22:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:08.268+0000 7fe40d68b740 1 -- 172.21.15.7:0/3913533001 shutdown_connections 2024-09-19T04:22:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:08.268+0000 7fe40d68b740 1 --2- 172.21.15.7:0/3913533001 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55674a3614a0 0x55674a3638c0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:08.271 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:08.268+0000 7fe40d68b740 1 --2- 172.21.15.7:0/3913533001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55674a2dd370 0x55674a2e7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:08.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:08.268+0000 7fe40d68b740 1 --2- 172.21.15.7:0/3913533001 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55674a2d82e0 0x55674a2e6d60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:08.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:08.268+0000 7fe3e37fe640 0 client.25717 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:22:08.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:08.268+0000 7fe40d68b740 1 --2- 172.21.15.7:0/3913533001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55674a2d79a0 0x55674a2e6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:08.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:08.268+0000 7fe40d68b740 1 -- 172.21.15.7:0/3913533001 >> 172.21.15.7:0/3913533001 conn(0x55674a2d3010 msgr2=0x55674a2d21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:08.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:08.268+0000 7fe40d68b740 1 -- 172.21.15.7:0/3913533001 shutdown_connections 2024-09-19T04:22:08.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:08.268+0000 7fe40d68b740 1 -- 172.21.15.7:0/3913533001 wait complete. 2024-09-19T04:22:08.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:08.268+0000 7fe40d68b740 20 client.25717 trim_cache size 0 max 16384 2024-09-19T04:22:08.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:22:08.272 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:22:08.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:22:08.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:22:08.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:08.269+0000 7fe40a8f1640 1 -- 172.21.15.7:0/666435319 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe3ec0a32c0 msgr2=0x7fe3ec0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:08.273 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:08.269+0000 7fe40a8f1640 1 --2- 172.21.15.7:0/666435319 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe3ec0a32c0 0x7fe3ec0a5780 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe3f40b8970 tx=0x7fe3f40f3d40 comp rx=0 tx=0).stop 2024-09-19T04:22:08.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:08.269+0000 7fe40a8f1640 1 -- 172.21.15.7:0/666435319 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe404101b60 msgr2=0x7fe404197ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:08.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:08.269+0000 7fe40a8f1640 1 --2- 172.21.15.7:0/666435319 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe404101b60 0x7fe404197ed0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4031610 tx=0x7fe3f4004270 comp rx=0 tx=0).stop 2024-09-19T04:22:08.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:08.269+0000 7fe40a8f1640 1 -- 172.21.15.7:0/666435319 shutdown_connections 2024-09-19T04:22:08.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:08.269+0000 7fe40a8f1640 1 --2- 172.21.15.7:0/666435319 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe3ec0a32c0 0x7fe3ec0a5780 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:08.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:08.269+0000 7fe40a8f1640 1 --2- 172.21.15.7:0/666435319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe404103710 0x7fe40419f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:08.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:08.269+0000 7fe40a8f1640 1 --2- 172.21.15.7:0/666435319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe404102d50 0x7fe404198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:08.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:08.269+0000 7fe40a8f1640 1 --2- 172.21.15.7:0/666435319 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe404101b60 0x7fe404197ed0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:08.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:08.269+0000 7fe40a8f1640 1 -- 172.21.15.7:0/666435319 >> 172.21.15.7:0/666435319 conn(0x7fe4040fd2e0 msgr2=0x7fe404106210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:08.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:08.269+0000 7fe40a8f1640 1 -- 172.21.15.7:0/666435319 shutdown_connections 2024-09-19T04:22:08.274 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:08.269+0000 7fe40a8f1640 1 -- 172.21.15.7:0/666435319 wait complete. 2024-09-19T04:22:08.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:08 smithi007 ceph-mon[31360]: pgmap v511: 129 pgs: 129 active+clean; 325 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 898 KiB/s wr, 280 op/s 2024-09-19T04:22:08.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:08 smithi102 ceph-mon[35446]: pgmap v511: 129 pgs: 129 active+clean; 325 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 898 KiB/s wr, 280 op/s 2024-09-19T04:22:08.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:08 smithi092 ceph-mon[34940]: pgmap v511: 129 pgs: 129 active+clean; 325 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 898 KiB/s wr, 280 op/s 2024-09-19T04:22:10.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:10 smithi007 ceph-mon[31360]: pgmap v512: 129 pgs: 129 active+clean; 326 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 1.0 MiB/s wr, 419 op/s 2024-09-19T04:22:10.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:10 smithi102 ceph-mon[35446]: pgmap v512: 129 pgs: 129 active+clean; 326 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 1.0 MiB/s wr, 419 op/s 2024-09-19T04:22:10.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:10 smithi092 ceph-mon[34940]: pgmap v512: 129 pgs: 129 active+clean; 326 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 1.0 MiB/s wr, 419 op/s 2024-09-19T04:22:12.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:12 smithi007 ceph-mon[31360]: pgmap v513: 129 pgs: 129 active+clean; 326 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 380 KiB/s wr, 378 op/s 2024-09-19T04:22:12.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:12 smithi102 ceph-mon[35446]: pgmap v513: 129 pgs: 129 active+clean; 326 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 380 KiB/s wr, 378 op/s 2024-09-19T04:22:12.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:12 smithi092 ceph-mon[34940]: pgmap v513: 129 pgs: 129 active+clean; 326 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 380 KiB/s wr, 378 op/s 2024-09-19T04:22:14.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:14 smithi007 ceph-mon[31360]: pgmap v514: 129 pgs: 129 active+clean; 319 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 393 KiB/s wr, 377 op/s 2024-09-19T04:22:14.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:14 smithi102 ceph-mon[35446]: pgmap v514: 129 pgs: 129 active+clean; 319 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 393 KiB/s wr, 377 op/s 2024-09-19T04:22:14.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:14 smithi092 ceph-mon[34940]: pgmap v514: 129 pgs: 129 active+clean; 319 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 393 KiB/s wr, 377 op/s 2024-09-19T04:22:15.039 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:22:15.313 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:22:15.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.796+0000 7f3353320640 1 -- 172.21.15.7:0/635167880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f334c100e20 msgr2=0x7f334c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:15.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.796+0000 7f3353320640 1 --2- 172.21.15.7:0/635167880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f334c100e20 0x7f334c101200 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f3348009900 tx=0x7f334802a480 comp rx=0 tx=0).stop 2024-09-19T04:22:15.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.796+0000 7f3353320640 1 -- 172.21.15.7:0/635167880 shutdown_connections 2024-09-19T04:22:15.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.796+0000 7f3353320640 1 --2- 172.21.15.7:0/635167880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f334c102ef0 0x7f334c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:15.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.796+0000 7f3353320640 1 --2- 172.21.15.7:0/635167880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f334c102570 0x7f334c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:15.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.796+0000 7f3353320640 1 --2- 172.21.15.7:0/635167880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f334c100e20 0x7f334c101200 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:15.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.796+0000 7f3353320640 1 -- 172.21.15.7:0/635167880 >> 172.21.15.7:0/635167880 conn(0x7f334c0fc7d0 msgr2=0x7f334c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:15.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.796+0000 7f3353320640 1 -- 172.21.15.7:0/635167880 shutdown_connections 2024-09-19T04:22:15.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.796+0000 7f3353320640 1 -- 172.21.15.7:0/635167880 wait complete. 2024-09-19T04:22:15.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.797+0000 7f3353320640 1 Processor -- start 2024-09-19T04:22:15.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.797+0000 7f3353320640 1 -- start start 2024-09-19T04:22:15.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.797+0000 7f3353320640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f334c100e20 0x7f334c1993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:15.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.797+0000 7f3353320640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f334c102570 0x7f334c199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:15.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.797+0000 7f3353320640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f334c102ef0 0x7f334c1a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:15.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.797+0000 7f3353320640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f334c110f80 con 0x7f334c102570 2024-09-19T04:22:15.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.797+0000 7f3353320640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f334c110e00 con 0x7f334c102ef0 2024-09-19T04:22:15.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.797+0000 7f3353320640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f334c111100 con 0x7f334c100e20 2024-09-19T04:22:15.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.797+0000 7f33508bb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f334c102570 0x7f334c199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:15.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.797+0000 7f33508bb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f334c102570 0x7f334c199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52346/0 (socket says 172.21.15.7:52346) 2024-09-19T04:22:15.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.798+0000 7f33508bb640 1 -- 172.21.15.7:0/2550731631 learned_addr learned my addr 172.21.15.7:0/2550731631 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:22:15.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.798+0000 7f33518bd640 1 --2- 172.21.15.7:0/2550731631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f334c102ef0 0x7f334c1a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:15.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.798+0000 7f33510bc640 1 --2- 172.21.15.7:0/2550731631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f334c100e20 0x7f334c1993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:15.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.798+0000 7f33508bb640 1 -- 172.21.15.7:0/2550731631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f334c100e20 msgr2=0x7f334c1993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:15.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.798+0000 7f33508bb640 1 --2- 172.21.15.7:0/2550731631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f334c100e20 0x7f334c1993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:15.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.798+0000 7f33508bb640 1 -- 172.21.15.7:0/2550731631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f334c102ef0 msgr2=0x7f334c1a4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:15.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.798+0000 7f33508bb640 1 --2- 172.21.15.7:0/2550731631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f334c102ef0 0x7f334c1a4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:15.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.798+0000 7f33508bb640 1 -- 172.21.15.7:0/2550731631 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f334c1a4990 con 0x7f334c102570 2024-09-19T04:22:15.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.798+0000 7f33508bb640 1 --2- 172.21.15.7:0/2550731631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f334c102570 0x7f334c199910 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f333c00d770 tx=0x7f333c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:15.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.798+0000 7f33427fc640 1 -- 172.21.15.7:0/2550731631 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c017070 con 0x7f334c102570 2024-09-19T04:22:15.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.798+0000 7f3353320640 1 -- 172.21.15.7:0/2550731631 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f334c1a4b60 con 0x7f334c102570 2024-09-19T04:22:15.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.798+0000 7f33427fc640 1 -- 172.21.15.7:0/2550731631 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f333c005500 con 0x7f334c102570 2024-09-19T04:22:15.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.798+0000 7f33427fc640 1 -- 172.21.15.7:0/2550731631 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c004e00 con 0x7f334c102570 2024-09-19T04:22:15.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.798+0000 7f3353320640 1 -- 172.21.15.7:0/2550731631 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f334c1a5020 con 0x7f334c102570 2024-09-19T04:22:15.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.800+0000 7f3353320640 1 -- 172.21.15.7:0/2550731631 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f334c101200 con 0x7f334c102570 2024-09-19T04:22:15.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.800+0000 7f33427fc640 1 -- 172.21.15.7:0/2550731631 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f333c004fa0 con 0x7f334c102570 2024-09-19T04:22:15.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.801+0000 7f33427fc640 1 --2- 172.21.15.7:0/2550731631 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f33380a3240 0x7f33380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:15.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.802+0000 7f33510bc640 1 --2- 172.21.15.7:0/2550731631 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f33380a3240 0x7f33380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:15.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.802+0000 7f33427fc640 1 -- 172.21.15.7:0/2550731631 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f333c0cf760 con 0x7f334c102570 2024-09-19T04:22:15.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.802+0000 7f33510bc640 1 --2- 172.21.15.7:0/2550731631 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f33380a3240 0x7f33380a5700 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3348005ab0 tx=0x7f3348005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:15.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:15.806+0000 7f33427fc640 1 -- 172.21.15.7:0/2550731631 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f333c09c0b0 con 0x7f334c102570 2024-09-19T04:22:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:16.029+0000 7f3353320640 1 -- 172.21.15.7:0/2550731631 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f334c109090 con 0x7f334c102570 2024-09-19T04:22:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:16.029+0000 7f33427fc640 1 -- 172.21.15.7:0/2550731631 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11965 (secure 0 0 0) 0x7f333c09b9b0 con 0x7f334c102570 2024-09-19T04:22:16.032 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:22:16.032 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":34,"btime":"2024-09-19T04:22:03:317947+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:22:03.057091+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24496,"mds_2":24482,"mds_3":24478,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24472,24478,24482,24496,24506]},"id":1}]} 2024-09-19T04:22:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 34 2024-09-19T04:22:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:16.032+0000 7f3353320640 1 -- 172.21.15.7:0/2550731631 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f33380a3240 msgr2=0x7f33380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:16.032+0000 7f3353320640 1 --2- 172.21.15.7:0/2550731631 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f33380a3240 0x7f33380a5700 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3348005ab0 tx=0x7f3348005a20 comp rx=0 tx=0).stop 2024-09-19T04:22:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:16.032+0000 7f3353320640 1 -- 172.21.15.7:0/2550731631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f334c102570 msgr2=0x7f334c199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:16.032+0000 7f3353320640 1 --2- 172.21.15.7:0/2550731631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f334c102570 0x7f334c199910 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f333c00d770 tx=0x7f333c00dc30 comp rx=0 tx=0).stop 2024-09-19T04:22:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:16.032+0000 7f3353320640 1 -- 172.21.15.7:0/2550731631 shutdown_connections 2024-09-19T04:22:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:16.032+0000 7f3353320640 1 --2- 172.21.15.7:0/2550731631 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f33380a3240 0x7f33380a5700 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:16.032+0000 7f3353320640 1 --2- 172.21.15.7:0/2550731631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f334c102ef0 0x7f334c1a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:16.032+0000 7f3353320640 1 --2- 172.21.15.7:0/2550731631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f334c102570 0x7f334c199910 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:16.032+0000 7f3353320640 1 --2- 172.21.15.7:0/2550731631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f334c100e20 0x7f334c1993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:16.032+0000 7f3353320640 1 -- 172.21.15.7:0/2550731631 >> 172.21.15.7:0/2550731631 conn(0x7f334c0fc7d0 msgr2=0x7f334c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:16.032+0000 7f3353320640 1 -- 172.21.15.7:0/2550731631 shutdown_connections 2024-09-19T04:22:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:16.032+0000 7f3353320640 1 -- 172.21.15.7:0/2550731631 wait complete. 2024-09-19T04:22:16.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:16 smithi007 ceph-mon[31360]: pgmap v515: 129 pgs: 129 active+clean; 319 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 287 KiB/s wr, 322 op/s 2024-09-19T04:22:16.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:16 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2550731631' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:22:16.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:16 smithi102 ceph-mon[35446]: pgmap v515: 129 pgs: 129 active+clean; 319 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 287 KiB/s wr, 322 op/s 2024-09-19T04:22:16.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:16 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2550731631' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:22:16.773 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24506 quiesce db --set-id 3281ba4b --release --await' 2024-09-19T04:22:16.773 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24506 quiesce db --set-id 3281ba4b --release --await 2024-09-19T04:22:16.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:16 smithi092 ceph-mon[34940]: pgmap v515: 129 pgs: 129 active+clean; 319 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 287 KiB/s wr, 322 op/s 2024-09-19T04:22:16.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:16 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2550731631' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:22:17.037 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:22:17.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.554+0000 7f5972b8b640 1 -- 172.21.15.7:0/2113826657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f596c102da0 msgr2=0x7f596c103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:17.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.554+0000 7f5972b8b640 1 --2- 172.21.15.7:0/2113826657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f596c102da0 0x7f596c103180 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f5968009900 tx=0x7f596802a480 comp rx=0 tx=0).stop 2024-09-19T04:22:17.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.554+0000 7f5972b8b640 1 -- 172.21.15.7:0/2113826657 shutdown_connections 2024-09-19T04:22:17.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.554+0000 7f5972b8b640 1 --2- 172.21.15.7:0/2113826657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f596c10c180 0x7f596c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:17.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.554+0000 7f5972b8b640 1 --2- 172.21.15.7:0/2113826657 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f596c1036c0 0x7f596c10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:17.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.554+0000 7f5972b8b640 1 --2- 172.21.15.7:0/2113826657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f596c102da0 0x7f596c103180 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:17.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.554+0000 7f5972b8b640 1 -- 172.21.15.7:0/2113826657 >> 172.21.15.7:0/2113826657 conn(0x7f596c0fc7a0 msgr2=0x7f596c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:17.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.554+0000 7f5972b8b640 1 -- 172.21.15.7:0/2113826657 shutdown_connections 2024-09-19T04:22:17.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.554+0000 7f5972b8b640 1 -- 172.21.15.7:0/2113826657 wait complete. 2024-09-19T04:22:17.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.555+0000 7f5972b8b640 1 Processor -- start 2024-09-19T04:22:17.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.555+0000 7f5972b8b640 1 -- start start 2024-09-19T04:22:17.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.555+0000 7f5972b8b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f596c102da0 0x7f596c1983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:17.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.555+0000 7f5972b8b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f596c1036c0 0x7f596c1988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:17.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.555+0000 7f5972b8b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f596c10c180 0x7f596c19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:17.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.555+0000 7f5972b8b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f596c111f60 con 0x7f596c10c180 2024-09-19T04:22:17.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.555+0000 7f5972b8b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f596c111de0 con 0x7f596c102da0 2024-09-19T04:22:17.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.555+0000 7f5972b8b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f596c1120e0 con 0x7f596c1036c0 2024-09-19T04:22:17.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.555+0000 7f5971128640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f596c10c180 0x7f596c19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:17.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.555+0000 7f5971128640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f596c10c180 0x7f596c19cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34454/0 (socket says 172.21.15.7:34454) 2024-09-19T04:22:17.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.555+0000 7f5971128640 1 -- 172.21.15.7:0/3540041927 learned_addr learned my addr 172.21.15.7:0/3540041927 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:22:17.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.555+0000 7f5970927640 1 --2- 172.21.15.7:0/3540041927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f596c102da0 0x7f596c1983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:17.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.555+0000 7f5963fff640 1 --2- 172.21.15.7:0/3540041927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f596c1036c0 0x7f596c1988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:17.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.556+0000 7f5971128640 1 -- 172.21.15.7:0/3540041927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f596c1036c0 msgr2=0x7f596c1988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:17.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.556+0000 7f5971128640 1 --2- 172.21.15.7:0/3540041927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f596c1036c0 0x7f596c1988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:17.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.556+0000 7f5971128640 1 -- 172.21.15.7:0/3540041927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f596c102da0 msgr2=0x7f596c1983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:17.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.556+0000 7f5971128640 1 --2- 172.21.15.7:0/3540041927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f596c102da0 0x7f596c1983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:17.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.556+0000 7f5971128640 1 -- 172.21.15.7:0/3540041927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596c19d350 con 0x7f596c10c180 2024-09-19T04:22:17.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.556+0000 7f5971128640 1 --2- 172.21.15.7:0/3540041927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f596c10c180 0x7f596c19cc70 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f596400eaa0 tx=0x7f596400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:17.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.556+0000 7f5961ffb640 1 -- 172.21.15.7:0/3540041927 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5964004d20 con 0x7f596c10c180 2024-09-19T04:22:17.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.556+0000 7f5961ffb640 1 -- 172.21.15.7:0/3540041927 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5964005020 con 0x7f596c10c180 2024-09-19T04:22:17.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.556+0000 7f5972b8b640 1 -- 172.21.15.7:0/3540041927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f596c19d640 con 0x7f596c10c180 2024-09-19T04:22:17.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.556+0000 7f5961ffb640 1 -- 172.21.15.7:0/3540041927 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59640116d0 con 0x7f596c10c180 2024-09-19T04:22:17.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.556+0000 7f5972b8b640 1 -- 172.21.15.7:0/3540041927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f596c1a4f20 con 0x7f596c10c180 2024-09-19T04:22:17.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.558+0000 7f5961ffb640 1 -- 172.21.15.7:0/3540041927 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f59640051d0 con 0x7f596c10c180 2024-09-19T04:22:17.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.559+0000 7f5974f64740 1 Processor -- start 2024-09-19T04:22:17.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.559+0000 7f5974f64740 1 -- start start 2024-09-19T04:22:17.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.559+0000 7f5974f64740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561852607060 0x561852607440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:17.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.559+0000 7f5974f64740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561852607980 0x561852611d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:17.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.559+0000 7f5974f64740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561852612240 0x561852614630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:17.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.559+0000 7f5974f64740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56185256c620 con 0x561852612240 2024-09-19T04:22:17.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.559+0000 7f5974f64740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561852513e50 con 0x561852607980 2024-09-19T04:22:17.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.559+0000 7f5974f64740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5618525685e0 con 0x561852607060 2024-09-19T04:22:17.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.559+0000 7f5961ffb640 1 --2- 172.21.15.7:0/3540041927 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f59540a32c0 0x7f59540a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:17.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.559+0000 7f5963fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561852612240 0x561852614630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:17.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.559+0000 7f5963fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561852612240 0x561852614630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34466/0 (socket says 172.21.15.7:34466) 2024-09-19T04:22:17.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.559+0000 7f5963fff640 1 -- 172.21.15.7:0/2113473675 learned_addr learned my addr 172.21.15.7:0/2113473675 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:22:17.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.559+0000 7f5963fff640 1 --2- 172.21.15.7:0/2113473675 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561852607060 0x561852607440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:17.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.559+0000 7f5971128640 1 --2- 172.21.15.7:0/3540041927 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f59540a32c0 0x7f59540a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:17.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.560+0000 7f5970927640 1 --2- 172.21.15.7:0/2113473675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561852607980 0x561852611d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:17.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.560+0000 7f5961ffb640 1 -- 172.21.15.7:0/3540041927 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f59640cfdd0 con 0x7f596c10c180 2024-09-19T04:22:17.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.560+0000 7f5963fff640 1 -- 172.21.15.7:0/2113473675 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561852607060 msgr2=0x561852607440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:17.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.560+0000 7f5963fff640 1 --2- 172.21.15.7:0/2113473675 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561852607060 0x561852607440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:17.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.560+0000 7f5963fff640 1 -- 172.21.15.7:0/2113473675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561852607980 msgr2=0x561852611d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:17.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.560+0000 7f5963fff640 1 --2- 172.21.15.7:0/2113473675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561852607980 0x561852611d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:17.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.560+0000 7f5963fff640 1 -- 172.21.15.7:0/2113473675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561852504d40 con 0x561852612240 2024-09-19T04:22:17.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.560+0000 7f5963fff640 1 --2- 172.21.15.7:0/2113473675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561852612240 0x561852614630 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f595c0117e0 tx=0x7f595c00a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d98470e9a77b59 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:17.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.560+0000 7f5971128640 1 --2- 172.21.15.7:0/3540041927 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f59540a32c0 0x7f59540a5780 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5964098440 tx=0x7f5964093040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:17.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.560+0000 7f5952ffd640 1 -- 172.21.15.7:0/2113473675 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c011e20 con 0x561852612240 2024-09-19T04:22:17.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.560+0000 7f5952ffd640 1 -- 172.21.15.7:0/2113473675 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f595c005020 con 0x561852612240 2024-09-19T04:22:17.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.560+0000 7f5952ffd640 1 -- 172.21.15.7:0/2113473675 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c004b20 con 0x561852612240 2024-09-19T04:22:17.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.561+0000 7f5974f64740 1 -- 172.21.15.7:0/2113473675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561852612240 msgr2=0x561852614630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:17.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.561+0000 7f5974f64740 1 --2- 172.21.15.7:0/2113473675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561852612240 0x561852614630 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f595c0117e0 tx=0x7f595c00a760 comp rx=0 tx=0).stop 2024-09-19T04:22:17.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.561+0000 7f5974f64740 1 -- 172.21.15.7:0/2113473675 shutdown_connections 2024-09-19T04:22:17.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.561+0000 7f5974f64740 1 --2- 172.21.15.7:0/2113473675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561852612240 0x561852614630 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:17.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.561+0000 7f5974f64740 1 --2- 172.21.15.7:0/2113473675 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561852607980 0x561852611d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:17.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.561+0000 7f5974f64740 1 --2- 172.21.15.7:0/2113473675 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561852607060 0x561852607440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:17.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.561+0000 7f5974f64740 1 -- 172.21.15.7:0/2113473675 >> 172.21.15.7:0/2113473675 conn(0x5618526035f0 msgr2=0x5618526039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:17.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.561+0000 7f5974f64740 1 -- 172.21.15.7:0/2113473675 shutdown_connections 2024-09-19T04:22:17.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.561+0000 7f5974f64740 1 -- 172.21.15.7:0/2113473675 wait complete. 2024-09-19T04:22:17.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.561+0000 7f5974f64740 1 -- start start 2024-09-19T04:22:17.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.562+0000 7f5974f64740 1 Processor -- start 2024-09-19T04:22:17.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.562+0000 7f5974f64740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561852607060 0x56185260f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:17.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.562+0000 7f5974f64740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561852607980 0x56185260f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:17.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.562+0000 7f5974f64740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561852612240 0x56185260fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:17.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.562+0000 7f5974f64740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561852614e10 con 0x561852612240 2024-09-19T04:22:17.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.562+0000 7f5974f64740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5618524f4f10 con 0x561852607980 2024-09-19T04:22:17.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.562+0000 7f5974f64740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561852614f90 con 0x561852607060 2024-09-19T04:22:17.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.562+0000 7f5974f64740 10 client.0 _ll_register_callbacks cb 0x561852518db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:22:17.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.562+0000 7f5963fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561852612240 0x56185260fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:17.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.562+0000 7f5963fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561852612240 0x56185260fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34468/0 (socket says 172.21.15.7:34468) 2024-09-19T04:22:17.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.562+0000 7f5963fff640 1 -- 172.21.15.7:0/1273549557 learned_addr learned my addr 172.21.15.7:0/1273549557 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:22:17.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.562+0000 7f5963fff640 1 --2- 172.21.15.7:0/1273549557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561852607060 0x56185260f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:17.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.562+0000 7f5970927640 1 --2- 172.21.15.7:0/1273549557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561852607980 0x56185260f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:17.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.562+0000 7f5963fff640 1 -- 172.21.15.7:0/1273549557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561852607060 msgr2=0x56185260f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:17.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.562+0000 7f5963fff640 1 --2- 172.21.15.7:0/1273549557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561852607060 0x56185260f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:17.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.562+0000 7f5963fff640 1 -- 172.21.15.7:0/1273549557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561852607980 msgr2=0x56185260f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:17.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.562+0000 7f5963fff640 1 --2- 172.21.15.7:0/1273549557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561852607980 0x56185260f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:17.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.563+0000 7f5963fff640 1 -- 172.21.15.7:0/1273549557 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56185227b580 con 0x561852612240 2024-09-19T04:22:17.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.563+0000 7f5970927640 1 --2- 172.21.15.7:0/1273549557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561852607980 0x56185260f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:22:17.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.563+0000 7f5963fff640 1 --2- 172.21.15.7:0/1273549557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561852612240 0x56185260fc00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f595c00a3f0 tx=0x7f595c00a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2558255666967676 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:17.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.563+0000 7f594bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:22:17.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.563+0000 7f594bfff640 1 -- 172.21.15.7:0/1273549557 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c022020 con 0x561852612240 2024-09-19T04:22:17.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.563+0000 7f594bfff640 1 -- 172.21.15.7:0/1273549557 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f595c004aa0 con 0x561852612240 2024-09-19T04:22:17.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.563+0000 7f5974f64740 1 -- 172.21.15.7:0/1273549557 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f595c005020 con 0x561852612240 2024-09-19T04:22:17.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.563+0000 7f594bfff640 1 -- 172.21.15.7:0/1273549557 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f595c032050 con 0x561852612240 2024-09-19T04:22:17.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.563+0000 7f5974f64740 10 client.16056 fetch_fsmap learned FSMap version 34 2024-09-19T04:22:17.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.563+0000 7f5974f64740 1 -- 172.21.15.7:0/1273549557 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561852345960 con 0x561852612240 2024-09-19T04:22:17.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.563+0000 7f594bfff640 1 -- 172.21.15.7:0/1273549557 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f595c005020 con 0x561852612240 2024-09-19T04:22:17.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.563+0000 7f594bfff640 1 -- 172.21.15.7:0/1273549557 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 34) ==== 8378+0+0 (secure 0 0 0) 0x7f595c01e9e0 con 0x561852612240 2024-09-19T04:22:17.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.563+0000 7f5974f64740 10 client.16056 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:22:17.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.563+0000 7f5974f64740 10 client.16056 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:22:17.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.564+0000 7f5974f64740 20 client.16056 populate_metadata read hostname 'smithi007' 2024-09-19T04:22:17.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.564+0000 7f5974f64740 1 --2- 172.21.15.7:0/1273549557 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x561852621c90 0x561852624080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:17.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.564+0000 7f5974f64740 4 client.16056 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:22:17.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.564+0000 7f5974f64740 1 -- 172.21.15.7:0/1273549557 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561852579b90 con 0x561852621c90 2024-09-19T04:22:17.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.564+0000 7f5970927640 1 --2- 172.21.15.7:0/1273549557 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x561852621c90 0x561852624080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:17.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.564+0000 7f5970927640 1 --2- 172.21.15.7:0/1273549557 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x561852621c90 0x561852624080 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3899afbb015a3a69 server_cookie=ead18d6d1bf83db in_seq=0 out_seq=0 2024-09-19T04:22:17.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.564+0000 7f594bfff640 10 client.16056 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:22:17.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.565+0000 7f594bfff640 1 -- 172.21.15.7:0/1273549557 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561852579b90 con 0x561852621c90 2024-09-19T04:22:17.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.565+0000 7f594bfff640 10 client.16056 handle_command_reply: tid=0 2024-09-19T04:22:17.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.565+0000 7f5974f64740 1 client.16056 shutdown 2024-09-19T04:22:17.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.565+0000 7f5974f64740 1 -- 172.21.15.7:0/1273549557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561852612240 msgr2=0x56185260fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:17.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.565+0000 7f5974f64740 1 --2- 172.21.15.7:0/1273549557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561852612240 0x56185260fc00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f595c00a3f0 tx=0x7f595c00a2d0 comp rx=0 tx=0).stop 2024-09-19T04:22:17.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.565+0000 7f5974f64740 1 -- 172.21.15.7:0/1273549557 shutdown_connections 2024-09-19T04:22:17.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.565+0000 7f5974f64740 1 --2- 172.21.15.7:0/1273549557 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x561852621c90 0x561852624080 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:17.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.566+0000 7f594bfff640 0 client.16056 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:22:17.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.566+0000 7f5974f64740 1 --2- 172.21.15.7:0/1273549557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561852612240 0x56185260fc00 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:17.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.566+0000 7f5974f64740 1 --2- 172.21.15.7:0/1273549557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561852607980 0x56185260f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:17.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.566+0000 7f5974f64740 1 --2- 172.21.15.7:0/1273549557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561852607060 0x56185260f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:17.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.566+0000 7f5974f64740 1 -- 172.21.15.7:0/1273549557 >> 172.21.15.7:0/1273549557 conn(0x5618526035f0 msgr2=0x5618526092d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:17.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.566+0000 7f5974f64740 1 -- 172.21.15.7:0/1273549557 shutdown_connections 2024-09-19T04:22:17.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.566+0000 7f5974f64740 1 -- 172.21.15.7:0/1273549557 wait complete. 2024-09-19T04:22:17.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.566+0000 7f5974f64740 20 client.16056 trim_cache size 0 max 16384 2024-09-19T04:22:17.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.583+0000 7f5974f64740 1 Processor -- start 2024-09-19T04:22:17.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.583+0000 7f5974f64740 1 -- start start 2024-09-19T04:22:17.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.583+0000 7f5974f64740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561852607060 0x5618526297f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:17.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.583+0000 7f5974f64740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561852607980 0x561852629d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:17.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.583+0000 7f5974f64740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561852612240 0x56185260c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:17.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.583+0000 7f5974f64740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f596c1aee20 con 0x561852612240 2024-09-19T04:22:17.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.583+0000 7f5974f64740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f596c1b09c0 con 0x561852607060 2024-09-19T04:22:17.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.583+0000 7f5974f64740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f596c1af4f0 con 0x561852607980 2024-09-19T04:22:17.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.583+0000 7f5963fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561852612240 0x56185260c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:17.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.583+0000 7f5963fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561852612240 0x56185260c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34470/0 (socket says 172.21.15.7:34470) 2024-09-19T04:22:17.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.583+0000 7f5963fff640 1 -- 172.21.15.7:0/30595212 learned_addr learned my addr 172.21.15.7:0/30595212 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:22:17.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.584+0000 7f5970927640 1 --2- 172.21.15.7:0/30595212 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561852607980 0x561852629d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:17.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.584+0000 7f5963fff640 1 --2- 172.21.15.7:0/30595212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561852607060 0x5618526297f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:17.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.584+0000 7f5963fff640 1 -- 172.21.15.7:0/30595212 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561852607980 msgr2=0x561852629d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:17.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.584+0000 7f5963fff640 1 --2- 172.21.15.7:0/30595212 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561852607980 0x561852629d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:17.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.584+0000 7f5963fff640 1 -- 172.21.15.7:0/30595212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561852607060 msgr2=0x5618526297f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:17.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.584+0000 7f5963fff640 1 --2- 172.21.15.7:0/30595212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561852607060 0x5618526297f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:17.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.584+0000 7f5963fff640 1 -- 172.21.15.7:0/30595212 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561852611af0 con 0x561852612240 2024-09-19T04:22:17.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.584+0000 7f5963fff640 1 --2- 172.21.15.7:0/30595212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561852612240 0x56185260c3e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f595c011620 tx=0x7f595c013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e08a163792e02e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:17.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.584+0000 7f59527fc640 1 -- 172.21.15.7:0/30595212 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c03b070 con 0x561852612240 2024-09-19T04:22:17.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.584+0000 7f59527fc640 1 -- 172.21.15.7:0/30595212 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f595c023040 con 0x561852612240 2024-09-19T04:22:17.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.584+0000 7f59527fc640 1 -- 172.21.15.7:0/30595212 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c022070 con 0x561852612240 2024-09-19T04:22:17.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.585+0000 7f5974f64740 1 -- 172.21.15.7:0/30595212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561852612240 msgr2=0x56185260c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:17.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.585+0000 7f5974f64740 1 --2- 172.21.15.7:0/30595212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561852612240 0x56185260c3e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f595c011620 tx=0x7f595c013040 comp rx=0 tx=0).stop 2024-09-19T04:22:17.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.585+0000 7f5974f64740 1 -- 172.21.15.7:0/30595212 shutdown_connections 2024-09-19T04:22:17.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.585+0000 7f5974f64740 1 --2- 172.21.15.7:0/30595212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561852612240 0x56185260c3e0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:17.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.585+0000 7f5974f64740 1 --2- 172.21.15.7:0/30595212 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561852607980 0x561852629d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:17.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.585+0000 7f5974f64740 1 --2- 172.21.15.7:0/30595212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561852607060 0x5618526297f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:17.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.585+0000 7f5974f64740 1 -- 172.21.15.7:0/30595212 >> 172.21.15.7:0/30595212 conn(0x5618526035f0 msgr2=0x5618526109e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:17.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.585+0000 7f5974f64740 1 -- 172.21.15.7:0/30595212 shutdown_connections 2024-09-19T04:22:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.585+0000 7f5974f64740 1 -- 172.21.15.7:0/30595212 wait complete. 2024-09-19T04:22:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.585+0000 7f5974f64740 1 -- start start 2024-09-19T04:22:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.585+0000 7f5974f64740 1 Processor -- start 2024-09-19T04:22:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.586+0000 7f5974f64740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561852607060 0x561852684960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.586+0000 7f5974f64740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561852607980 0x561852684ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.586+0000 7f5974f64740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561852612240 0x56185268f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.586+0000 7f5974f64740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f596c1b0290 con 0x561852607980 2024-09-19T04:22:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.586+0000 7f5974f64740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f596c1afbc0 con 0x561852612240 2024-09-19T04:22:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.586+0000 7f5974f64740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f596c1acde0 con 0x561852607060 2024-09-19T04:22:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.586+0000 7f5974f64740 10 client.0 _ll_register_callbacks cb 0x7f595c0116e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:22:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.586+0000 7f5970927640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561852607980 0x561852684ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.586+0000 7f5970927640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561852607980 0x561852684ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34482/0 (socket says 172.21.15.7:34482) 2024-09-19T04:22:17.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.586+0000 7f5970927640 1 -- 172.21.15.7:0/531732583 learned_addr learned my addr 172.21.15.7:0/531732583 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:22:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.586+0000 7f5963fff640 1 --2- 172.21.15.7:0/531732583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561852612240 0x56185268f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.586+0000 7f5963fff640 1 --2- 172.21.15.7:0/531732583 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561852607060 0x561852684960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.586+0000 7f5970927640 1 -- 172.21.15.7:0/531732583 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561852607060 msgr2=0x561852684960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.586+0000 7f5970927640 1 --2- 172.21.15.7:0/531732583 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561852607060 0x561852684960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.586+0000 7f5970927640 1 -- 172.21.15.7:0/531732583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561852612240 msgr2=0x56185268f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.586+0000 7f5970927640 1 --2- 172.21.15.7:0/531732583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561852612240 0x56185268f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.587+0000 7f5970927640 1 -- 172.21.15.7:0/531732583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56185268fe10 con 0x561852607980 2024-09-19T04:22:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.587+0000 7f5970927640 1 --2- 172.21.15.7:0/531732583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561852607980 0x561852684ea0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f596802a9a0 tx=0x7f59680319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12840942eae84b03 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.587+0000 7f594bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:22:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.587+0000 7f594bfff640 1 -- 172.21.15.7:0/531732583 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596804a070 con 0x561852607980 2024-09-19T04:22:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.587+0000 7f594bfff640 1 -- 172.21.15.7:0/531732583 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f5968004450 con 0x561852607980 2024-09-19T04:22:17.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.587+0000 7f5974f64740 1 -- 172.21.15.7:0/531732583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f595c023040 con 0x561852607980 2024-09-19T04:22:17.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.587+0000 7f594bfff640 1 -- 172.21.15.7:0/531732583 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5968057050 con 0x561852607980 2024-09-19T04:22:17.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.587+0000 7f5974f64740 10 client.16062 fetch_fsmap learned FSMap version 34 2024-09-19T04:22:17.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.587+0000 7f5974f64740 1 -- 172.21.15.7:0/531732583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5618526911e0 con 0x561852607980 2024-09-19T04:22:17.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.587+0000 7f594bfff640 1 -- 172.21.15.7:0/531732583 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f595c023040 con 0x561852607980 2024-09-19T04:22:17.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.588+0000 7f594bfff640 1 -- 172.21.15.7:0/531732583 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 34) ==== 8378+0+0 (secure 0 0 0) 0x7f59680035f0 con 0x561852607980 2024-09-19T04:22:17.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.588+0000 7f5974f64740 10 client.16062 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:22:17.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.588+0000 7f5974f64740 10 client.16062 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:22:17.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.588+0000 7f5974f64740 20 client.16062 populate_metadata read hostname 'smithi007' 2024-09-19T04:22:17.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.588+0000 7f5974f64740 1 --2- 172.21.15.7:0/531732583 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5618526919a0 0x561852693dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:17.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.588+0000 7f5974f64740 4 client.16062 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3281ba4b", "release": true, "await": true}] 2024-09-19T04:22:17.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.588+0000 7f5974f64740 1 -- 172.21.15.7:0/531732583 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3281ba4b", "release": true, "await": true}) -- 0x5618525740a0 con 0x5618526919a0 2024-09-19T04:22:17.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.588+0000 7f5963fff640 1 --2- 172.21.15.7:0/531732583 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5618526919a0 0x561852693dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:17.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.588+0000 7f594bfff640 10 client.16062 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:22:17.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:17.588+0000 7f5963fff640 1 --2- 172.21.15.7:0/531732583 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5618526919a0 0x561852693dc0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e24030803f64878 server_cookie=1a8e3a977518d32f in_seq=0 out_seq=0 2024-09-19T04:22:18.159 INFO:tasks.workunit.client.0.smithi007.stdout: 103 12310 0 8893 0 6630 0 2024-09-19T04:22:18.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:18.358+0000 7f594bfff640 1 -- 172.21.15.7:0/531732583 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5618525740a0 con 0x5618526919a0 2024-09-19T04:22:18.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:18.358+0000 7f594bfff640 10 client.16062 handle_command_reply: tid=0 2024-09-19T04:22:18.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:18.358+0000 7f5974f64740 1 client.16062 shutdown 2024-09-19T04:22:18.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:18.359+0000 7f5974f64740 1 -- 172.21.15.7:0/531732583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561852607980 msgr2=0x561852684ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:18.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:18.359+0000 7f5974f64740 1 --2- 172.21.15.7:0/531732583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561852607980 0x561852684ea0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f596802a9a0 tx=0x7f59680319a0 comp rx=0 tx=0).stop 2024-09-19T04:22:18.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:18.359+0000 7f5974f64740 1 -- 172.21.15.7:0/531732583 shutdown_connections 2024-09-19T04:22:18.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:18.359+0000 7f5974f64740 1 --2- 172.21.15.7:0/531732583 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5618526919a0 0x561852693dc0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:18.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:18.359+0000 7f5974f64740 1 --2- 172.21.15.7:0/531732583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561852612240 0x56185268f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:18.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:18.359+0000 7f5974f64740 1 --2- 172.21.15.7:0/531732583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561852607980 0x561852684ea0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:18.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:18.359+0000 7f5974f64740 1 --2- 172.21.15.7:0/531732583 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561852607060 0x561852684960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:18.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:18.359+0000 7f594bfff640 0 client.16062 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:22:18.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:18.359+0000 7f5974f64740 1 -- 172.21.15.7:0/531732583 >> 172.21.15.7:0/531732583 conn(0x5618526035f0 msgr2=0x56185260f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:18.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:18.359+0000 7f5974f64740 1 -- 172.21.15.7:0/531732583 shutdown_connections 2024-09-19T04:22:18.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:18.359+0000 7f5974f64740 1 -- 172.21.15.7:0/531732583 wait complete. 2024-09-19T04:22:18.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:18.359+0000 7f5974f64740 20 client.16062 trim_cache size 0 max 16384 2024-09-19T04:22:18.363 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:22:18.363 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 34, 2024-09-19T04:22:18.363 INFO:teuthology.orchestra.run.smithi007.stdout: "leader": 24506, 2024-09-19T04:22:18.363 INFO:teuthology.orchestra.run.smithi007.stdout: "set_version": 24, 2024-09-19T04:22:18.363 INFO:teuthology.orchestra.run.smithi007.stdout: "sets": { 2024-09-19T04:22:18.363 INFO:teuthology.orchestra.run.smithi007.stdout: "3281ba4b": { 2024-09-19T04:22:18.363 INFO:teuthology.orchestra.run.smithi007.stdout: "version": 24, 2024-09-19T04:22:18.363 INFO:teuthology.orchestra.run.smithi007.stdout: "age_ref": 0.0, 2024-09-19T04:22:18.363 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:22:18.363 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RELEASED", 2024-09-19T04:22:18.363 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:22:18.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:22:18.364 INFO:teuthology.orchestra.run.smithi007.stdout: "timeout": 90.0, 2024-09-19T04:22:18.364 INFO:teuthology.orchestra.run.smithi007.stdout: "expiration": 149.8, 2024-09-19T04:22:18.364 INFO:teuthology.orchestra.run.smithi007.stdout: "members": { 2024-09-19T04:22:18.364 INFO:teuthology.orchestra.run.smithi007.stdout: "file:/": { 2024-09-19T04:22:18.364 INFO:teuthology.orchestra.run.smithi007.stdout: "excluded": false, 2024-09-19T04:22:18.364 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:22:18.364 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RELEASED", 2024-09-19T04:22:18.364 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:22:18.364 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:22:18.364 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:22:18.364 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:22:18.364 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:22:18.365 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:22:18.365 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:22:18.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:18.360+0000 7f5972b8b640 1 -- 172.21.15.7:0/3540041927 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f59540a32c0 msgr2=0x7f59540a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:18.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:18.360+0000 7f5972b8b640 1 --2- 172.21.15.7:0/3540041927 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f59540a32c0 0x7f59540a5780 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5964098440 tx=0x7f5964093040 comp rx=0 tx=0).stop 2024-09-19T04:22:18.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:18.360+0000 7f5972b8b640 1 -- 172.21.15.7:0/3540041927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f596c10c180 msgr2=0x7f596c19cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:18.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:18.360+0000 7f5972b8b640 1 --2- 172.21.15.7:0/3540041927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f596c10c180 0x7f596c19cc70 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f596400eaa0 tx=0x7f596400eea0 comp rx=0 tx=0).stop 2024-09-19T04:22:18.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:18.360+0000 7f5972b8b640 1 -- 172.21.15.7:0/3540041927 shutdown_connections 2024-09-19T04:22:18.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:18.360+0000 7f5972b8b640 1 --2- 172.21.15.7:0/3540041927 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f59540a32c0 0x7f59540a5780 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:18.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:18.360+0000 7f5972b8b640 1 --2- 172.21.15.7:0/3540041927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f596c10c180 0x7f596c19cc70 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:18.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:18.360+0000 7f5972b8b640 1 --2- 172.21.15.7:0/3540041927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f596c1036c0 0x7f596c1988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:18.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:18.360+0000 7f5972b8b640 1 --2- 172.21.15.7:0/3540041927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f596c102da0 0x7f596c1983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:18.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:18.360+0000 7f5972b8b640 1 -- 172.21.15.7:0/3540041927 >> 172.21.15.7:0/3540041927 conn(0x7f596c0fc7a0 msgr2=0x7f596c0fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:18.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:18.360+0000 7f5972b8b640 1 -- 172.21.15.7:0/3540041927 shutdown_connections 2024-09-19T04:22:18.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:22:18.360+0000 7f5972b8b640 1 -- 172.21.15.7:0/3540041927 wait complete. 2024-09-19T04:22:18.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:18 smithi007 ceph-mon[31360]: pgmap v516: 129 pgs: 129 active+clean; 319 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 277 KiB/s wr, 237 op/s 2024-09-19T04:22:18.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:18 smithi102 ceph-mon[35446]: pgmap v516: 129 pgs: 129 active+clean; 319 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 277 KiB/s wr, 237 op/s 2024-09-19T04:22:18.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:18 smithi092 ceph-mon[34940]: pgmap v516: 129 pgs: 129 active+clean; 319 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 277 KiB/s wr, 237 op/s 2024-09-19T04:22:19.178 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3281ba4b', total seconds elapsed: 34.0 2024-09-19T04:22:20.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:20 smithi007 ceph-mon[31360]: pgmap v517: 129 pgs: 129 active+clean; 319 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 277 KiB/s wr, 235 op/s 2024-09-19T04:22:20.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:20 smithi102 ceph-mon[35446]: pgmap v517: 129 pgs: 129 active+clean; 319 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 277 KiB/s wr, 235 op/s 2024-09-19T04:22:20.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:20 smithi092 ceph-mon[34940]: pgmap v517: 129 pgs: 129 active+clean; 319 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 277 KiB/s wr, 235 op/s 2024-09-19T04:22:21.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.366+0000 7fc62d08d640 1 -- 172.21.15.7:0/3013244231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6281025f0 msgr2=0x7fc628108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:21.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.366+0000 7fc62d08d640 1 --2- 172.21.15.7:0/3013244231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6281025f0 0x7fc628108e80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc620009900 tx=0x7fc62002a410 comp rx=0 tx=0).stop 2024-09-19T04:22:21.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.366+0000 7fc62d08d640 1 -- 172.21.15.7:0/3013244231 shutdown_connections 2024-09-19T04:22:21.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.366+0000 7fc62d08d640 1 --2- 172.21.15.7:0/3013244231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc6281025f0 0x7fc628108e80 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:21.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.366+0000 7fc62d08d640 1 --2- 172.21.15.7:0/3013244231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc628101c30 0x7fc6281020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:21.368 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.366+0000 7fc62d08d640 1 --2- 172.21.15.7:0/3013244231 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc628100a40 0x7fc628100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:21.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.366+0000 7fc62d08d640 1 -- 172.21.15.7:0/3013244231 >> 172.21.15.7:0/3013244231 conn(0x7fc6280fc1c0 msgr2=0x7fc6280fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:21.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.366+0000 7fc62d08d640 1 -- 172.21.15.7:0/3013244231 shutdown_connections 2024-09-19T04:22:21.369 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.366+0000 7fc62d08d640 1 -- 172.21.15.7:0/3013244231 wait complete. 2024-09-19T04:22:21.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.367+0000 7fc62d08d640 1 Processor -- start 2024-09-19T04:22:21.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.367+0000 7fc62d08d640 1 -- start start 2024-09-19T04:22:21.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.367+0000 7fc62d08d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc628100a40 0x7fc62810b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:21.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.367+0000 7fc62d08d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc628101c30 0x7fc628109a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:21.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.367+0000 7fc62d08d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6281025f0 0x7fc628109f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:21.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.367+0000 7fc62d08d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc62810d870 con 0x7fc628101c30 2024-09-19T04:22:21.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.367+0000 7fc62d08d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc62810d6f0 con 0x7fc6281025f0 2024-09-19T04:22:21.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.367+0000 7fc62d08d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc62810d9f0 con 0x7fc628100a40 2024-09-19T04:22:21.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.368+0000 7fc62659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc628101c30 0x7fc628109a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:21.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.368+0000 7fc62659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc628101c30 0x7fc628109a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34498/0 (socket says 172.21.15.7:34498) 2024-09-19T04:22:21.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.368+0000 7fc62659c640 1 -- 172.21.15.7:0/3291001083 learned_addr learned my addr 172.21.15.7:0/3291001083 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:22:21.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.368+0000 7fc62759e640 1 --2- 172.21.15.7:0/3291001083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6281025f0 0x7fc628109f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:21.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.368+0000 7fc626d9d640 1 --2- 172.21.15.7:0/3291001083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc628100a40 0x7fc62810b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:21.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.368+0000 7fc62659c640 1 -- 172.21.15.7:0/3291001083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc628100a40 msgr2=0x7fc62810b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:21.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.368+0000 7fc62659c640 1 --2- 172.21.15.7:0/3291001083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc628100a40 0x7fc62810b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:21.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.368+0000 7fc62659c640 1 -- 172.21.15.7:0/3291001083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6281025f0 msgr2=0x7fc628109f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:21.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.368+0000 7fc62659c640 1 --2- 172.21.15.7:0/3291001083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6281025f0 0x7fc628109f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:21.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.368+0000 7fc62659c640 1 -- 172.21.15.7:0/3291001083 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc62810a7d0 con 0x7fc628101c30 2024-09-19T04:22:21.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.368+0000 7fc62659c640 1 --2- 172.21.15.7:0/3291001083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc628101c30 0x7fc628109a00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc61c00e9f0 tx=0x7fc61c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:21.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.368+0000 7fc60ffff640 1 -- 172.21.15.7:0/3291001083 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61c00cd80 con 0x7fc628101c30 2024-09-19T04:22:21.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.368+0000 7fc62d08d640 1 -- 172.21.15.7:0/3291001083 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6281a1f50 con 0x7fc628101c30 2024-09-19T04:22:21.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.368+0000 7fc60ffff640 1 -- 172.21.15.7:0/3291001083 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc61c010910 con 0x7fc628101c30 2024-09-19T04:22:21.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.368+0000 7fc60ffff640 1 -- 172.21.15.7:0/3291001083 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61c018950 con 0x7fc628101c30 2024-09-19T04:22:21.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.368+0000 7fc62d08d640 1 -- 172.21.15.7:0/3291001083 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6281a23c0 con 0x7fc628101c30 2024-09-19T04:22:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.371+0000 7fc60ffff640 1 -- 172.21.15.7:0/3291001083 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fc61c010ac0 con 0x7fc628101c30 2024-09-19T04:22:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.371+0000 7fc62fe2d740 1 Processor -- start 2024-09-19T04:22:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.371+0000 7fc62fe2d740 1 -- start start 2024-09-19T04:22:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.372+0000 7fc62fe2d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba996ed9a0 0x55ba996edda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.372+0000 7fc62fe2d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba996ee2e0 0x55ba996f2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.372+0000 7fc62fe2d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba996f3370 0x55ba996f5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.372+0000 7fc62fe2d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ba996512f0 con 0x55ba996f3370 2024-09-19T04:22:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.372+0000 7fc62fe2d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ba995f9270 con 0x55ba996ee2e0 2024-09-19T04:22:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.372+0000 7fc62fe2d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ba9964d2b0 con 0x55ba996ed9a0 2024-09-19T04:22:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.372+0000 7fc62759e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba996ed9a0 0x55ba996edda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.372+0000 7fc62759e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba996ed9a0 0x55ba996edda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:57510/0 (socket says 172.21.15.7:57510) 2024-09-19T04:22:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.372+0000 7fc62759e640 1 -- 172.21.15.7:0/4053552506 learned_addr learned my addr 172.21.15.7:0/4053552506 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:22:21.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.372+0000 7fc62659c640 1 --2- 172.21.15.7:0/4053552506 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba996f3370 0x55ba996f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:21.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.372+0000 7fc626d9d640 1 --2- 172.21.15.7:0/4053552506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba996ee2e0 0x55ba996f2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:21.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.372+0000 7fc62759e640 1 -- 172.21.15.7:0/4053552506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba996ee2e0 msgr2=0x55ba996f2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:21.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.372+0000 7fc62759e640 1 --2- 172.21.15.7:0/4053552506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba996ee2e0 0x55ba996f2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:21.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.372+0000 7fc62759e640 1 -- 172.21.15.7:0/4053552506 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba996f3370 msgr2=0x55ba996f5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:21.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.372+0000 7fc62759e640 1 --2- 172.21.15.7:0/4053552506 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba996f3370 0x55ba996f5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:21.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.372+0000 7fc62759e640 1 -- 172.21.15.7:0/4053552506 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba995f8340 con 0x55ba996ed9a0 2024-09-19T04:22:21.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.373+0000 7fc60ffff640 1 --2- 172.21.15.7:0/3291001083 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc6100a3240 0x7fc6100a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:21.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.373+0000 7fc62759e640 1 --2- 172.21.15.7:0/4053552506 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba996ed9a0 0x55ba996edda0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc62002aa00 tx=0x7fc620005e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae16e19d08134e25 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:21.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.373+0000 7fc626d9d640 1 --2- 172.21.15.7:0/3291001083 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc6100a3240 0x7fc6100a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:21.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.373+0000 7fc60ffff640 1 -- 172.21.15.7:0/3291001083 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fc61c0d0020 con 0x7fc628101c30 2024-09-19T04:22:21.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.373+0000 7fc60d7fa640 1 -- 172.21.15.7:0/4053552506 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc620040070 con 0x55ba996ed9a0 2024-09-19T04:22:21.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.373+0000 7fc60d7fa640 1 -- 172.21.15.7:0/4053552506 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc620005500 con 0x55ba996ed9a0 2024-09-19T04:22:21.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.373+0000 7fc60d7fa640 1 -- 172.21.15.7:0/4053552506 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc620035040 con 0x55ba996ed9a0 2024-09-19T04:22:21.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.374+0000 7fc62fe2d740 1 -- 172.21.15.7:0/4053552506 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba996ed9a0 msgr2=0x55ba996edda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:21.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.374+0000 7fc62fe2d740 1 --2- 172.21.15.7:0/4053552506 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba996ed9a0 0x55ba996edda0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc62002aa00 tx=0x7fc620005e60 comp rx=0 tx=0).stop 2024-09-19T04:22:21.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.374+0000 7fc626d9d640 1 --2- 172.21.15.7:0/3291001083 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc6100a3240 0x7fc6100a5700 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x55ba996eed10 tx=0x7fc618009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:21.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.374+0000 7fc62fe2d740 1 -- 172.21.15.7:0/4053552506 shutdown_connections 2024-09-19T04:22:21.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.374+0000 7fc62fe2d740 1 --2- 172.21.15.7:0/4053552506 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba996f3370 0x55ba996f5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:21.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.374+0000 7fc62fe2d740 1 --2- 172.21.15.7:0/4053552506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba996ee2e0 0x55ba996f2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:21.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.374+0000 7fc62fe2d740 1 --2- 172.21.15.7:0/4053552506 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba996ed9a0 0x55ba996edda0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:21.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.374+0000 7fc62fe2d740 1 -- 172.21.15.7:0/4053552506 >> 172.21.15.7:0/4053552506 conn(0x55ba996e9010 msgr2=0x55ba996e9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:21.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.374+0000 7fc62fe2d740 1 -- 172.21.15.7:0/4053552506 shutdown_connections 2024-09-19T04:22:21.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.374+0000 7fc62fe2d740 1 -- 172.21.15.7:0/4053552506 wait complete. 2024-09-19T04:22:21.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.374+0000 7fc62fe2d740 1 -- start start 2024-09-19T04:22:21.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.374+0000 7fc62fe2d740 1 Processor -- start 2024-09-19T04:22:21.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.374+0000 7fc62fe2d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba996ed9a0 0x55ba996f7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:21.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.374+0000 7fc62fe2d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba996ee2e0 0x55ba996f8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:21.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.374+0000 7fc62fe2d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba996f3370 0x55ba996ff150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:21.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.374+0000 7fc62fe2d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ba996f62e0 con 0x55ba996ed9a0 2024-09-19T04:22:21.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.374+0000 7fc62fe2d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ba995da290 con 0x55ba996f3370 2024-09-19T04:22:21.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.374+0000 7fc62fe2d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ba996f6460 con 0x55ba996ee2e0 2024-09-19T04:22:21.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.375+0000 7fc62fe2d740 10 client.0 _ll_register_callbacks cb 0x55ba9960b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:22:21.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.375+0000 7fc626d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba996ed9a0 0x55ba996f7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:21.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.375+0000 7fc62759e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba996f3370 0x55ba996ff150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:21.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.375+0000 7fc626d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba996ed9a0 0x55ba996f7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34524/0 (socket says 172.21.15.7:34524) 2024-09-19T04:22:21.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.375+0000 7fc626d9d640 1 -- 172.21.15.7:0/2284489658 learned_addr learned my addr 172.21.15.7:0/2284489658 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:22:21.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.375+0000 7fc62659c640 1 --2- 172.21.15.7:0/2284489658 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba996ee2e0 0x55ba996f8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:21.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.375+0000 7fc626d9d640 1 -- 172.21.15.7:0/2284489658 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba996ee2e0 msgr2=0x55ba996f8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:21.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.375+0000 7fc626d9d640 1 --2- 172.21.15.7:0/2284489658 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba996ee2e0 0x55ba996f8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:21.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.375+0000 7fc626d9d640 1 -- 172.21.15.7:0/2284489658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba996f3370 msgr2=0x55ba996ff150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:21.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.375+0000 7fc626d9d640 1 --2- 172.21.15.7:0/2284489658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba996f3370 0x55ba996ff150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:21.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.375+0000 7fc626d9d640 1 -- 172.21.15.7:0/2284489658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba99364210 con 0x55ba996ed9a0 2024-09-19T04:22:21.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.375+0000 7fc62759e640 1 --2- 172.21.15.7:0/2284489658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba996f3370 0x55ba996ff150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:22:21.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.375+0000 7fc626d9d640 1 --2- 172.21.15.7:0/2284489658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba996ed9a0 0x55ba996f7bd0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc618003f90 tx=0x7fc618004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb0c9d9a664f6166 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:21.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.375+0000 7fc60aff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:22:21.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.375+0000 7fc60aff5640 1 -- 172.21.15.7:0/2284489658 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61800f8f0 con 0x55ba996ed9a0 2024-09-19T04:22:21.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.375+0000 7fc60aff5640 1 -- 172.21.15.7:0/2284489658 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fc61800fa90 con 0x55ba996ed9a0 2024-09-19T04:22:21.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.375+0000 7fc62fe2d740 1 -- 172.21.15.7:0/2284489658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc620005500 con 0x55ba996ed9a0 2024-09-19T04:22:21.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.376+0000 7fc60aff5640 1 -- 172.21.15.7:0/2284489658 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc61800fc90 con 0x55ba996ed9a0 2024-09-19T04:22:21.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.376+0000 7fc62fe2d740 10 client.16074 fetch_fsmap learned FSMap version 34 2024-09-19T04:22:21.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.376+0000 7fc62fe2d740 1 -- 172.21.15.7:0/2284489658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ba99430620 con 0x55ba996ed9a0 2024-09-19T04:22:21.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.376+0000 7fc60aff5640 1 -- 172.21.15.7:0/2284489658 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc620005500 con 0x55ba996ed9a0 2024-09-19T04:22:21.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.376+0000 7fc60aff5640 1 -- 172.21.15.7:0/2284489658 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 34) ==== 8378+0+0 (secure 0 0 0) 0x7fc618026070 con 0x55ba996ed9a0 2024-09-19T04:22:21.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.376+0000 7fc62fe2d740 10 client.16074 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:22:21.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.376+0000 7fc62fe2d740 10 client.16074 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:22:21.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.376+0000 7fc62fe2d740 20 client.16074 populate_metadata read hostname 'smithi007' 2024-09-19T04:22:21.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.376+0000 7fc62fe2d740 1 --2- 172.21.15.7:0/2284489658 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55ba99703920 0x55ba99705dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:21.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.376+0000 7fc62fe2d740 4 client.16074 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:22:21.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.376+0000 7fc62fe2d740 1 -- 172.21.15.7:0/2284489658 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba9965ea20 con 0x55ba99703920 2024-09-19T04:22:21.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.376+0000 7fc62659c640 1 --2- 172.21.15.7:0/2284489658 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55ba99703920 0x55ba99705dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:21.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.377+0000 7fc60aff5640 10 client.16074 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:22:21.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.377+0000 7fc62659c640 1 --2- 172.21.15.7:0/2284489658 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55ba99703920 0x55ba99705dc0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36bfe860876348da server_cookie=cd5a48cf0f5e5bf7 in_seq=0 out_seq=0 2024-09-19T04:22:21.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.378+0000 7fc60aff5640 1 -- 172.21.15.7:0/2284489658 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ba9965ea20 con 0x55ba99703920 2024-09-19T04:22:21.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.378+0000 7fc60aff5640 10 client.16074 handle_command_reply: tid=0 2024-09-19T04:22:21.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.378+0000 7fc62fe2d740 1 client.16074 shutdown 2024-09-19T04:22:21.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.378+0000 7fc62fe2d740 1 -- 172.21.15.7:0/2284489658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba996ed9a0 msgr2=0x55ba996f7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:21.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.378+0000 7fc62fe2d740 1 --2- 172.21.15.7:0/2284489658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba996ed9a0 0x55ba996f7bd0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc618003f90 tx=0x7fc618004ab0 comp rx=0 tx=0).stop 2024-09-19T04:22:21.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.378+0000 7fc62fe2d740 1 -- 172.21.15.7:0/2284489658 shutdown_connections 2024-09-19T04:22:21.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.378+0000 7fc62fe2d740 1 --2- 172.21.15.7:0/2284489658 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55ba99703920 0x55ba99705dc0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:21.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.378+0000 7fc62fe2d740 1 --2- 172.21.15.7:0/2284489658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba996f3370 0x55ba996ff150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:21.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.378+0000 7fc62fe2d740 1 --2- 172.21.15.7:0/2284489658 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba996ee2e0 0x55ba996f8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:21.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.378+0000 7fc60aff5640 0 client.16074 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:22:21.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.378+0000 7fc62fe2d740 1 --2- 172.21.15.7:0/2284489658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba996ed9a0 0x55ba996f7bd0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:21.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.378+0000 7fc62fe2d740 1 -- 172.21.15.7:0/2284489658 >> 172.21.15.7:0/2284489658 conn(0x55ba996e9010 msgr2=0x55ba996ea820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:21.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.378+0000 7fc62fe2d740 1 -- 172.21.15.7:0/2284489658 shutdown_connections 2024-09-19T04:22:21.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.378+0000 7fc62fe2d740 1 -- 172.21.15.7:0/2284489658 wait complete. 2024-09-19T04:22:21.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.379+0000 7fc62fe2d740 20 client.16074 trim_cache size 0 max 16384 2024-09-19T04:22:21.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.394+0000 7fc62fe2d740 1 Processor -- start 2024-09-19T04:22:21.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.394+0000 7fc62fe2d740 1 -- start start 2024-09-19T04:22:21.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.394+0000 7fc62fe2d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba996ed9a0 0x55ba996f7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.394+0000 7fc62fe2d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba996ee2e0 0x55ba996ff070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.394+0000 7fc62fe2d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba996f3370 0x55ba996ea400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.395+0000 7fc62fe2d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc6281acad0 con 0x55ba996ed9a0 2024-09-19T04:22:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.395+0000 7fc62fe2d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc6281ae670 con 0x55ba996ee2e0 2024-09-19T04:22:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.395+0000 7fc62fe2d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc6281ad1a0 con 0x55ba996f3370 2024-09-19T04:22:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.395+0000 7fc62659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba996ee2e0 0x55ba996ff070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.395+0000 7fc62659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba996ee2e0 0x55ba996ff070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:55036/0 (socket says 172.21.15.7:55036) 2024-09-19T04:22:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.395+0000 7fc62659c640 1 -- 172.21.15.7:0/558261163 learned_addr learned my addr 172.21.15.7:0/558261163 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:22:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.395+0000 7fc62759e640 1 --2- 172.21.15.7:0/558261163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba996f3370 0x55ba996ea400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.395+0000 7fc626d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba996ed9a0 0x55ba996f7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.395+0000 7fc62759e640 1 -- 172.21.15.7:0/558261163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba996ee2e0 msgr2=0x55ba996ff070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.395+0000 7fc62759e640 1 --2- 172.21.15.7:0/558261163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba996ee2e0 0x55ba996ff070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.395+0000 7fc62759e640 1 -- 172.21.15.7:0/558261163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba996ed9a0 msgr2=0x55ba996f7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.395+0000 7fc62759e640 1 --2- 172.21.15.7:0/558261163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba996ed9a0 0x55ba996f7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.395+0000 7fc62759e640 1 -- 172.21.15.7:0/558261163 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba996e8e30 con 0x55ba996f3370 2024-09-19T04:22:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.395+0000 7fc626d9d640 1 --2- 172.21.15.7:0/558261163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba996ed9a0 0x55ba996f7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:22:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.396+0000 7fc62759e640 1 --2- 172.21.15.7:0/558261163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba996f3370 0x55ba996ea400 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc62002a930 tx=0x7fc620031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb7ebb6c8c8e86f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.396+0000 7fc60cff9640 1 -- 172.21.15.7:0/558261163 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc620040070 con 0x55ba996f3370 2024-09-19T04:22:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.396+0000 7fc60cff9640 1 -- 172.21.15.7:0/558261163 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6200048c0 con 0x55ba996f3370 2024-09-19T04:22:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.396+0000 7fc60cff9640 1 -- 172.21.15.7:0/558261163 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc620035040 con 0x55ba996f3370 2024-09-19T04:22:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.397+0000 7fc62fe2d740 1 -- 172.21.15.7:0/558261163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba996f3370 msgr2=0x55ba996ea400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.397+0000 7fc62fe2d740 1 --2- 172.21.15.7:0/558261163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba996f3370 0x55ba996ea400 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc62002a930 tx=0x7fc620031400 comp rx=0 tx=0).stop 2024-09-19T04:22:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.397+0000 7fc62fe2d740 1 -- 172.21.15.7:0/558261163 shutdown_connections 2024-09-19T04:22:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.397+0000 7fc62fe2d740 1 --2- 172.21.15.7:0/558261163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba996f3370 0x55ba996ea400 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.397+0000 7fc62fe2d740 1 --2- 172.21.15.7:0/558261163 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba996ee2e0 0x55ba996ff070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.397+0000 7fc62fe2d740 1 --2- 172.21.15.7:0/558261163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba996ed9a0 0x55ba996f7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.397+0000 7fc62fe2d740 1 -- 172.21.15.7:0/558261163 >> 172.21.15.7:0/558261163 conn(0x55ba996e9010 msgr2=0x55ba996e81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.397+0000 7fc62fe2d740 1 -- 172.21.15.7:0/558261163 shutdown_connections 2024-09-19T04:22:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.397+0000 7fc62fe2d740 1 -- 172.21.15.7:0/558261163 wait complete. 2024-09-19T04:22:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.397+0000 7fc62fe2d740 1 -- start start 2024-09-19T04:22:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.398+0000 7fc62fe2d740 1 Processor -- start 2024-09-19T04:22:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.398+0000 7fc62fe2d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba996ed9a0 0x55ba996fc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.398+0000 7fc62fe2d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba996ee2e0 0x55ba996fce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.398+0000 7fc62fe2d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba996f3370 0x55ba996fde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.398+0000 7fc62fe2d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc6281adf40 con 0x55ba996ed9a0 2024-09-19T04:22:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.398+0000 7fc62fe2d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc6281ad870 con 0x55ba996ee2e0 2024-09-19T04:22:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.398+0000 7fc62fe2d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc6281aaa90 con 0x55ba996f3370 2024-09-19T04:22:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.398+0000 7fc62fe2d740 10 client.0 _ll_register_callbacks cb 0x7fc618003e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:22:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.398+0000 7fc626d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba996ed9a0 0x55ba996fc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.398+0000 7fc626d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba996ed9a0 0x55ba996fc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34548/0 (socket says 172.21.15.7:34548) 2024-09-19T04:22:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.398+0000 7fc626d9d640 1 -- 172.21.15.7:0/246358840 learned_addr learned my addr 172.21.15.7:0/246358840 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:22:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.398+0000 7fc62659c640 1 --2- 172.21.15.7:0/246358840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba996ee2e0 0x55ba996fce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.398+0000 7fc62759e640 1 --2- 172.21.15.7:0/246358840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba996f3370 0x55ba996fde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.398+0000 7fc626d9d640 1 -- 172.21.15.7:0/246358840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba996f3370 msgr2=0x55ba996fde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.398+0000 7fc626d9d640 1 --2- 172.21.15.7:0/246358840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba996f3370 0x55ba996fde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.398+0000 7fc626d9d640 1 -- 172.21.15.7:0/246358840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba996ee2e0 msgr2=0x55ba996fce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.398+0000 7fc626d9d640 1 --2- 172.21.15.7:0/246358840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba996ee2e0 0x55ba996fce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.398+0000 7fc626d9d640 1 -- 172.21.15.7:0/246358840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba996fe470 con 0x55ba996ed9a0 2024-09-19T04:22:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.398+0000 7fc62659c640 1 --2- 172.21.15.7:0/246358840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba996ee2e0 0x55ba996fce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:22:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.399+0000 7fc626d9d640 1 --2- 172.21.15.7:0/246358840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba996ed9a0 0x55ba996fc910 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc61801e5f0 tx=0x7fc61801ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c8ab84e7c6f964 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.399+0000 7fc60aff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:22:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.399+0000 7fc60aff5640 1 -- 172.21.15.7:0/246358840 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61803b060 con 0x55ba996ed9a0 2024-09-19T04:22:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.399+0000 7fc60aff5640 1 -- 172.21.15.7:0/246358840 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fc618011040 con 0x55ba996ed9a0 2024-09-19T04:22:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.399+0000 7fc62fe2d740 1 -- 172.21.15.7:0/246358840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6200048c0 con 0x55ba996ed9a0 2024-09-19T04:22:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.399+0000 7fc60aff5640 1 -- 172.21.15.7:0/246358840 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc618042050 con 0x55ba996ed9a0 2024-09-19T04:22:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.399+0000 7fc62fe2d740 10 client.16080 fetch_fsmap learned FSMap version 34 2024-09-19T04:22:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.399+0000 7fc62fe2d740 1 -- 172.21.15.7:0/246358840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ba9976e8a0 con 0x55ba996ed9a0 2024-09-19T04:22:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.399+0000 7fc60aff5640 1 -- 172.21.15.7:0/246358840 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6200048c0 con 0x55ba996ed9a0 2024-09-19T04:22:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.399+0000 7fc60aff5640 1 -- 172.21.15.7:0/246358840 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 34) ==== 8378+0+0 (secure 0 0 0) 0x7fc618026070 con 0x55ba996ed9a0 2024-09-19T04:22:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.400+0000 7fc62fe2d740 10 client.16080 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:22:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.400+0000 7fc62fe2d740 10 client.16080 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:22:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.400+0000 7fc62fe2d740 20 client.16080 populate_metadata read hostname 'smithi007' 2024-09-19T04:22:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.400+0000 7fc62fe2d740 1 --2- 172.21.15.7:0/246358840 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55ba99703920 0x55ba99771320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.400+0000 7fc62fe2d740 4 client.16080 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:22:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.400+0000 7fc62fe2d740 1 -- 172.21.15.7:0/246358840 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ba99658d70 con 0x55ba99703920 2024-09-19T04:22:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.400+0000 7fc62659c640 1 --2- 172.21.15.7:0/246358840 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55ba99703920 0x55ba99771320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.400+0000 7fc60aff5640 10 client.16080 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:22:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:21.400+0000 7fc62659c640 1 --2- 172.21.15.7:0/246358840 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55ba99703920 0x55ba99771320 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a700a6099b416d1 server_cookie=252c8eb48be8471b in_seq=0 out_seq=0 2024-09-19T04:22:22.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:22 smithi007 ceph-mon[31360]: pgmap v518: 129 pgs: 129 active+clean; 319 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 105 KiB/s wr, 93 op/s 2024-09-19T04:22:22.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:22 smithi102 ceph-mon[35446]: pgmap v518: 129 pgs: 129 active+clean; 319 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 105 KiB/s wr, 93 op/s 2024-09-19T04:22:22.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:22 smithi092 ceph-mon[34940]: pgmap v518: 129 pgs: 129 active+clean; 319 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 105 KiB/s wr, 93 op/s 2024-09-19T04:22:24.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:24 smithi007 ceph-mon[31360]: pgmap v519: 129 pgs: 129 active+clean; 322 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 335 KiB/s wr, 80 op/s 2024-09-19T04:22:24.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:24 smithi102 ceph-mon[35446]: pgmap v519: 129 pgs: 129 active+clean; 322 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 335 KiB/s wr, 80 op/s 2024-09-19T04:22:24.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:24 smithi092 ceph-mon[34940]: pgmap v519: 129 pgs: 129 active+clean; 322 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 335 KiB/s wr, 80 op/s 2024-09-19T04:22:26.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:26 smithi007 ceph-mon[31360]: pgmap v520: 129 pgs: 129 active+clean; 321 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 266 KiB/s wr, 123 op/s 2024-09-19T04:22:26.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:26 smithi102 ceph-mon[35446]: pgmap v520: 129 pgs: 129 active+clean; 321 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 266 KiB/s wr, 123 op/s 2024-09-19T04:22:26.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:26 smithi092 ceph-mon[34940]: pgmap v520: 129 pgs: 129 active+clean; 321 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 266 KiB/s wr, 123 op/s 2024-09-19T04:22:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:27.859+0000 7fc60aff5640 1 -- 172.21.15.7:0/246358840 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ba99658d70 con 0x55ba99703920 2024-09-19T04:22:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:27.859+0000 7fc60aff5640 10 client.16080 handle_command_reply: tid=0 2024-09-19T04:22:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:27.859+0000 7fc62fe2d740 1 client.16080 shutdown 2024-09-19T04:22:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:27.859+0000 7fc62fe2d740 1 -- 172.21.15.7:0/246358840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba996ed9a0 msgr2=0x55ba996fc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:27.859+0000 7fc62fe2d740 1 --2- 172.21.15.7:0/246358840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba996ed9a0 0x55ba996fc910 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc61801e5f0 tx=0x7fc61801ea10 comp rx=0 tx=0).stop 2024-09-19T04:22:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:27.859+0000 7fc62fe2d740 1 -- 172.21.15.7:0/246358840 shutdown_connections 2024-09-19T04:22:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:27.859+0000 7fc62fe2d740 1 --2- 172.21.15.7:0/246358840 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55ba99703920 0x55ba99771320 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:27.859+0000 7fc62fe2d740 1 --2- 172.21.15.7:0/246358840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba996f3370 0x55ba996fde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:27.859+0000 7fc62fe2d740 1 --2- 172.21.15.7:0/246358840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ba996ee2e0 0x55ba996fce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:27.859+0000 7fc62fe2d740 1 --2- 172.21.15.7:0/246358840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba996ed9a0 0x55ba996fc910 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:27.859+0000 7fc62fe2d740 1 -- 172.21.15.7:0/246358840 >> 172.21.15.7:0/246358840 conn(0x55ba996e9010 msgr2=0x55ba996e81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:27.859+0000 7fc60aff5640 0 client.16080 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:22:27.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:27.862+0000 7fc62fe2d740 1 -- 172.21.15.7:0/246358840 shutdown_connections 2024-09-19T04:22:27.869 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:27.868+0000 7fc62fe2d740 1 -- 172.21.15.7:0/246358840 wait complete. 2024-09-19T04:22:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:27.871+0000 7fc62fe2d740 20 client.16080 trim_cache size 0 max 16384 2024-09-19T04:22:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:22:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:22:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:22:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:22:27.889 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:27.888+0000 7fc62d08d640 1 -- 172.21.15.7:0/3291001083 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc6100a3240 msgr2=0x7fc6100a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:27.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:27.888+0000 7fc62d08d640 1 --2- 172.21.15.7:0/3291001083 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc6100a3240 0x7fc6100a5700 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x55ba996eed10 tx=0x7fc618009500 comp rx=0 tx=0).stop 2024-09-19T04:22:27.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:27.888+0000 7fc62d08d640 1 -- 172.21.15.7:0/3291001083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc628101c30 msgr2=0x7fc628109a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:27.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:27.888+0000 7fc62d08d640 1 --2- 172.21.15.7:0/3291001083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc628101c30 0x7fc628109a00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc61c00e9f0 tx=0x7fc61c00eeb0 comp rx=0 tx=0).stop 2024-09-19T04:22:27.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:27.888+0000 7fc62d08d640 1 -- 172.21.15.7:0/3291001083 shutdown_connections 2024-09-19T04:22:27.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:27.888+0000 7fc62d08d640 1 --2- 172.21.15.7:0/3291001083 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fc6100a3240 0x7fc6100a5700 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:27.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:27.888+0000 7fc62d08d640 1 --2- 172.21.15.7:0/3291001083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6281025f0 0x7fc628109f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:27.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:27.888+0000 7fc62d08d640 1 --2- 172.21.15.7:0/3291001083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc628101c30 0x7fc628109a00 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:27.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:27.888+0000 7fc62d08d640 1 --2- 172.21.15.7:0/3291001083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc628100a40 0x7fc62810b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:27.890 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:27.888+0000 7fc62d08d640 1 -- 172.21.15.7:0/3291001083 >> 172.21.15.7:0/3291001083 conn(0x7fc6280fc1c0 msgr2=0x7fc628104f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:27.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:27.889+0000 7fc62d08d640 1 -- 172.21.15.7:0/3291001083 shutdown_connections 2024-09-19T04:22:27.891 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:27.889+0000 7fc62d08d640 1 -- 172.21.15.7:0/3291001083 wait complete. 2024-09-19T04:22:28.159 INFO:tasks.workunit.client.0.smithi007.stdout: 109 915870 368 679461 413 541299 1144 2024-09-19T04:22:28.631 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:28 smithi007 ceph-mon[31360]: pgmap v521: 129 pgs: 129 active+clean; 321 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 266 KiB/s wr, 138 op/s 2024-09-19T04:22:28.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:28 smithi102 ceph-mon[35446]: pgmap v521: 129 pgs: 129 active+clean; 321 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 266 KiB/s wr, 138 op/s 2024-09-19T04:22:28.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:28 smithi092 ceph-mon[34940]: pgmap v521: 129 pgs: 129 active+clean; 321 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 266 KiB/s wr, 138 op/s 2024-09-19T04:22:30.629 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:30 smithi007 ceph-mon[31360]: pgmap v522: 129 pgs: 129 active+clean; 329 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 362 op/s 2024-09-19T04:22:30.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:30 smithi102 ceph-mon[35446]: pgmap v522: 129 pgs: 129 active+clean; 329 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 362 op/s 2024-09-19T04:22:30.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:30 smithi092 ceph-mon[34940]: pgmap v522: 129 pgs: 129 active+clean; 329 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 362 op/s 2024-09-19T04:22:32.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:32 smithi102 ceph-mon[35446]: pgmap v523: 129 pgs: 129 active+clean; 337 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.4 MiB/s wr, 441 op/s 2024-09-19T04:22:32.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:32 smithi092 ceph-mon[34940]: pgmap v523: 129 pgs: 129 active+clean; 337 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.4 MiB/s wr, 441 op/s 2024-09-19T04:22:32.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:32 smithi007 ceph-mon[31360]: pgmap v523: 129 pgs: 129 active+clean; 337 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.4 MiB/s wr, 441 op/s 2024-09-19T04:22:34.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:34 smithi102 ceph-mon[35446]: pgmap v524: 129 pgs: 129 active+clean; 357 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 526 op/s 2024-09-19T04:22:34.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:34 smithi092 ceph-mon[34940]: pgmap v524: 129 pgs: 129 active+clean; 357 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 526 op/s 2024-09-19T04:22:34.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:34 smithi007 ceph-mon[31360]: pgmap v524: 129 pgs: 129 active+clean; 357 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 526 op/s 2024-09-19T04:22:36.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:36 smithi102 ceph-mon[35446]: pgmap v525: 129 pgs: 129 active+clean; 358 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.2 MiB/s wr, 538 op/s 2024-09-19T04:22:36.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:36 smithi092 ceph-mon[34940]: pgmap v525: 129 pgs: 129 active+clean; 358 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.2 MiB/s wr, 538 op/s 2024-09-19T04:22:36.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:36 smithi007 ceph-mon[31360]: pgmap v525: 129 pgs: 129 active+clean; 358 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.2 MiB/s wr, 538 op/s 2024-09-19T04:22:38.162 INFO:tasks.workunit.client.0.smithi007.stdout: 119 1643886 614 1206773 601 983039 1270 2024-09-19T04:22:38.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:38 smithi102 ceph-mon[35446]: pgmap v526: 129 pgs: 129 active+clean; 358 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.2 MiB/s wr, 476 op/s 2024-09-19T04:22:38.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:38 smithi092 ceph-mon[34940]: pgmap v526: 129 pgs: 129 active+clean; 358 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.2 MiB/s wr, 476 op/s 2024-09-19T04:22:38.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:38 smithi007 ceph-mon[31360]: pgmap v526: 129 pgs: 129 active+clean; 358 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.2 MiB/s wr, 476 op/s 2024-09-19T04:22:40.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:40 smithi102 ceph-mon[35446]: pgmap v527: 129 pgs: 129 active+clean; 366 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.1 MiB/s wr, 522 op/s 2024-09-19T04:22:40.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:40 smithi092 ceph-mon[34940]: pgmap v527: 129 pgs: 129 active+clean; 366 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.1 MiB/s wr, 522 op/s 2024-09-19T04:22:40.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:40 smithi007 ceph-mon[31360]: pgmap v527: 129 pgs: 129 active+clean; 366 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.1 MiB/s wr, 522 op/s 2024-09-19T04:22:41.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.690+0000 7fba6759e640 1 -- 172.21.15.7:0/2107587728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba6810b4e0 msgr2=0x7fba6810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:41.692 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.690+0000 7fba6759e640 1 --2- 172.21.15.7:0/2107587728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba6810b4e0 0x7fba6810d950 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fba6001ace0 tx=0x7fba6003b970 comp rx=0 tx=0).stop 2024-09-19T04:22:41.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.695+0000 7fba6759e640 1 -- 172.21.15.7:0/2107587728 shutdown_connections 2024-09-19T04:22:41.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.695+0000 7fba6759e640 1 --2- 172.21.15.7:0/2107587728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba6810de90 0x7fba68110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:41.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.695+0000 7fba6759e640 1 --2- 172.21.15.7:0/2107587728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba6810b4e0 0x7fba6810d950 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:41.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.695+0000 7fba6759e640 1 --2- 172.21.15.7:0/2107587728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba68072d80 0x7fba68073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:41.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.695+0000 7fba6759e640 1 -- 172.21.15.7:0/2107587728 >> 172.21.15.7:0/2107587728 conn(0x7fba6806eb10 msgr2=0x7fba68070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:41.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.695+0000 7fba6759e640 1 -- 172.21.15.7:0/2107587728 shutdown_connections 2024-09-19T04:22:41.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.696+0000 7fba6759e640 1 -- 172.21.15.7:0/2107587728 wait complete. 2024-09-19T04:22:41.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.697+0000 7fba6759e640 1 Processor -- start 2024-09-19T04:22:41.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.697+0000 7fba6759e640 1 -- start start 2024-09-19T04:22:41.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.697+0000 7fba6759e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba68072d80 0x7fba6819e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:41.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.697+0000 7fba6759e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba6810b4e0 0x7fba6819ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:41.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.697+0000 7fba6759e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba6810de90 0x7fba681a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:41.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.697+0000 7fba6759e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fba681135e0 con 0x7fba68072d80 2024-09-19T04:22:41.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.697+0000 7fba6759e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fba68113460 con 0x7fba6810de90 2024-09-19T04:22:41.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.697+0000 7fba6759e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fba68113760 con 0x7fba6810b4e0 2024-09-19T04:22:41.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.698+0000 7fba66d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba6810de90 0x7fba681a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:41.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.698+0000 7fba65d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba6810b4e0 0x7fba6819ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:41.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.698+0000 7fba65d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba6810b4e0 0x7fba6819ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:57166/0 (socket says 172.21.15.7:57166) 2024-09-19T04:22:41.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.698+0000 7fba66d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba6810de90 0x7fba681a5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:57962/0 (socket says 172.21.15.7:57962) 2024-09-19T04:22:41.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.698+0000 7fba65d9b640 1 -- 172.21.15.7:0/3680110156 learned_addr learned my addr 172.21.15.7:0/3680110156 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:22:41.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.698+0000 7fba6659c640 1 --2- 172.21.15.7:0/3680110156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba68072d80 0x7fba6819e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:41.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.698+0000 7fba65d9b640 1 -- 172.21.15.7:0/3680110156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba6810de90 msgr2=0x7fba681a5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:41.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.698+0000 7fba65d9b640 1 --2- 172.21.15.7:0/3680110156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba6810de90 0x7fba681a5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:41.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.698+0000 7fba65d9b640 1 -- 172.21.15.7:0/3680110156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba68072d80 msgr2=0x7fba6819e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:41.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.698+0000 7fba65d9b640 1 --2- 172.21.15.7:0/3680110156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba68072d80 0x7fba6819e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:41.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.698+0000 7fba65d9b640 1 -- 172.21.15.7:0/3680110156 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba681a5fb0 con 0x7fba6810b4e0 2024-09-19T04:22:41.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.698+0000 7fba6659c640 1 --2- 172.21.15.7:0/3680110156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba68072d80 0x7fba6819e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:22:41.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.698+0000 7fba65d9b640 1 --2- 172.21.15.7:0/3680110156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba6810b4e0 0x7fba6819ec80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fba6001acb0 tx=0x7fba60041860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:41.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.713+0000 7fba577fe640 1 -- 172.21.15.7:0/3680110156 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba60045070 con 0x7fba6810b4e0 2024-09-19T04:22:41.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.716+0000 7fba6759e640 1 -- 172.21.15.7:0/3680110156 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba681a6240 con 0x7fba6810b4e0 2024-09-19T04:22:41.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.716+0000 7fba577fe640 1 -- 172.21.15.7:0/3680110156 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba60003e50 con 0x7fba6810b4e0 2024-09-19T04:22:41.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.716+0000 7fba577fe640 1 -- 172.21.15.7:0/3680110156 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba600042a0 con 0x7fba6810b4e0 2024-09-19T04:22:41.720 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.716+0000 7fba6759e640 1 -- 172.21.15.7:0/3680110156 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba681a67b0 con 0x7fba6810b4e0 2024-09-19T04:22:41.723 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.722+0000 7fba577fe640 1 -- 172.21.15.7:0/3680110156 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fba60048020 con 0x7fba6810b4e0 2024-09-19T04:22:41.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.722+0000 7fba6f9ff740 1 Processor -- start 2024-09-19T04:22:41.724 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.723+0000 7fba6f9ff740 1 -- start start 2024-09-19T04:22:41.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.723+0000 7fba6f9ff740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cec0182b70 0x55cec0182f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:41.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.723+0000 7fba6f9ff740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cec01834b0 0x55cec0187f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:41.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.723+0000 7fba6f9ff740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec0188540 0x55cec018aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:41.725 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.723+0000 7fba6f9ff740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cec00e62f0 con 0x55cec0182b70 2024-09-19T04:22:41.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.724+0000 7fba6f9ff740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cec008e270 con 0x55cec0188540 2024-09-19T04:22:41.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.724+0000 7fba6f9ff740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55cec00e22b0 con 0x55cec01834b0 2024-09-19T04:22:41.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.724+0000 7fba6659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cec01834b0 0x55cec0187f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:41.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.724+0000 7fba6659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cec01834b0 0x55cec0187f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:57182/0 (socket says 172.21.15.7:57182) 2024-09-19T04:22:41.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.724+0000 7fba6659c640 1 -- 172.21.15.7:0/4028164731 learned_addr learned my addr 172.21.15.7:0/4028164731 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:22:41.726 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.724+0000 7fba66d9d640 1 --2- 172.21.15.7:0/4028164731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cec0182b70 0x55cec0182f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.724+0000 7fba66d9d640 1 -- 172.21.15.7:0/4028164731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cec01834b0 msgr2=0x55cec0187f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.724+0000 7fba66d9d640 1 --2- 172.21.15.7:0/4028164731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cec01834b0 0x55cec0187f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.724+0000 7fba66d9d640 1 -- 172.21.15.7:0/4028164731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec0188540 msgr2=0x55cec018aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.724+0000 7fba66d9d640 1 --2- 172.21.15.7:0/4028164731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec0188540 0x55cec018aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.724+0000 7fba66d9d640 1 -- 172.21.15.7:0/4028164731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cec008d340 con 0x55cec0182b70 2024-09-19T04:22:41.727 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.725+0000 7fba66d9d640 1 --2- 172.21.15.7:0/4028164731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cec0182b70 0x55cec0182f70 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fba58009b90 tx=0x7fba58011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34bbaeefc8c61ac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:41.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.726+0000 7fba577fe640 1 --2- 172.21.15.7:0/3680110156 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fba500a3460 0x7fba500a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:41.728 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.726+0000 7fba6659c640 1 --2- 172.21.15.7:0/3680110156 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fba500a3460 0x7fba500a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:41.729 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.728+0000 7fba6659c640 1 --2- 172.21.15.7:0/3680110156 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fba500a3460 0x7fba500a5920 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x55cec0183ee0 tx=0x7fba5c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:41.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.730+0000 7fba577fe640 1 -- 172.21.15.7:0/3680110156 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fba60102570 con 0x7fba6810b4e0 2024-09-19T04:22:41.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.751+0000 7fba54ff9640 1 -- 172.21.15.7:0/4028164731 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba58004030 con 0x55cec0182b70 2024-09-19T04:22:41.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.751+0000 7fba54ff9640 1 -- 172.21.15.7:0/4028164731 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba580041d0 con 0x55cec0182b70 2024-09-19T04:22:41.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.751+0000 7fba54ff9640 1 -- 172.21.15.7:0/4028164731 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba58019740 con 0x55cec0182b70 2024-09-19T04:22:41.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.752+0000 7fba6f9ff740 1 -- 172.21.15.7:0/4028164731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cec0182b70 msgr2=0x55cec0182f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:41.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.752+0000 7fba6f9ff740 1 --2- 172.21.15.7:0/4028164731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cec0182b70 0x55cec0182f70 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fba58009b90 tx=0x7fba58011810 comp rx=0 tx=0).stop 2024-09-19T04:22:41.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.753+0000 7fba6f9ff740 1 -- 172.21.15.7:0/4028164731 shutdown_connections 2024-09-19T04:22:41.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.753+0000 7fba6f9ff740 1 --2- 172.21.15.7:0/4028164731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec0188540 0x55cec018aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:41.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.753+0000 7fba6f9ff740 1 --2- 172.21.15.7:0/4028164731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cec01834b0 0x55cec0187f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:41.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.753+0000 7fba6f9ff740 1 --2- 172.21.15.7:0/4028164731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cec0182b70 0x55cec0182f70 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:41.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.753+0000 7fba6f9ff740 1 -- 172.21.15.7:0/4028164731 >> 172.21.15.7:0/4028164731 conn(0x55cec017e1e0 msgr2=0x55cec017e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.757+0000 7fba6f9ff740 1 -- 172.21.15.7:0/4028164731 shutdown_connections 2024-09-19T04:22:41.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.757+0000 7fba6f9ff740 1 -- 172.21.15.7:0/4028164731 wait complete. 2024-09-19T04:22:41.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.757+0000 7fba6f9ff740 1 -- start start 2024-09-19T04:22:41.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.758+0000 7fba6f9ff740 1 Processor -- start 2024-09-19T04:22:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.758+0000 7fba6f9ff740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec0182b70 0x55cec018ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.758+0000 7fba6f9ff740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cec01834b0 0x55cec018d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.758+0000 7fba6f9ff740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cec0188540 0x55cec01943e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.758+0000 7fba6f9ff740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cec018b510 con 0x55cec01834b0 2024-09-19T04:22:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.758+0000 7fba6f9ff740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cec006f290 con 0x55cec0182b70 2024-09-19T04:22:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.758+0000 7fba6f9ff740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55cec018b690 con 0x55cec0188540 2024-09-19T04:22:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.758+0000 7fba6f9ff740 10 client.0 _ll_register_callbacks cb 0x55cec00a0140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:22:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.759+0000 7fba6659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec0182b70 0x55cec018ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.759+0000 7fba6659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec0182b70 0x55cec018ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:57986/0 (socket says 172.21.15.7:57986) 2024-09-19T04:22:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.759+0000 7fba6659c640 1 -- 172.21.15.7:0/1907593451 learned_addr learned my addr 172.21.15.7:0/1907593451 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:22:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.759+0000 7fba65d9b640 1 --2- 172.21.15.7:0/1907593451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cec01834b0 0x55cec018d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.759+0000 7fba66d9d640 1 --2- 172.21.15.7:0/1907593451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cec0188540 0x55cec01943e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.759+0000 7fba6659c640 1 -- 172.21.15.7:0/1907593451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cec0188540 msgr2=0x55cec01943e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.759+0000 7fba6659c640 1 --2- 172.21.15.7:0/1907593451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cec0188540 0x55cec01943e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.759+0000 7fba6659c640 1 -- 172.21.15.7:0/1907593451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cec01834b0 msgr2=0x55cec018d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.759+0000 7fba6659c640 1 --2- 172.21.15.7:0/1907593451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cec01834b0 0x55cec018d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.759+0000 7fba6659c640 1 -- 172.21.15.7:0/1907593451 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cebfdf9210 con 0x55cec0182b70 2024-09-19T04:22:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.759+0000 7fba65d9b640 1 --2- 172.21.15.7:0/1907593451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cec01834b0 0x55cec018d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:22:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.759+0000 7fba6659c640 1 --2- 172.21.15.7:0/1907593451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec0182b70 0x55cec018ce60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fba5c015980 tx=0x7fba5c0046e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fa03daf23e51283 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:41.785 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.784+0000 7fba4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T04:22:41.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.784+0000 7fba4dffb640 1 -- 172.21.15.7:0/1907593451 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5c023070 con 0x55cec0182b70 2024-09-19T04:22:41.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.785+0000 7fba6f9ff740 1 -- 172.21.15.7:0/1907593451 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba580041d0 con 0x55cec0182b70 2024-09-19T04:22:41.786 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.785+0000 7fba4dffb640 1 -- 172.21.15.7:0/1907593451 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fba5c013d30 con 0x55cec0182b70 2024-09-19T04:22:41.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.785+0000 7fba4dffb640 1 -- 172.21.15.7:0/1907593451 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fba5c02f050 con 0x55cec0182b70 2024-09-19T04:22:41.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.786+0000 7fba6f9ff740 10 client.25694 fetch_fsmap learned FSMap version 34 2024-09-19T04:22:41.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.786+0000 7fba6f9ff740 1 -- 172.21.15.7:0/1907593451 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55cebfec5620 con 0x55cec0182b70 2024-09-19T04:22:41.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.790+0000 7fba4dffb640 1 -- 172.21.15.7:0/1907593451 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba580041d0 con 0x55cec0182b70 2024-09-19T04:22:41.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.790+0000 7fba4dffb640 1 -- 172.21.15.7:0/1907593451 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 34) ==== 8378+0+0 (secure 0 0 0) 0x7fba5c01e070 con 0x55cec0182b70 2024-09-19T04:22:41.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.790+0000 7fba6f9ff740 10 client.25694 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:22:41.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.790+0000 7fba6f9ff740 10 client.25694 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:22:41.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.790+0000 7fba6f9ff740 20 client.25694 populate_metadata read hostname 'smithi007' 2024-09-19T04:22:41.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.790+0000 7fba6f9ff740 1 --2- 172.21.15.7:0/1907593451 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55cec0199020 0x55cec019b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:41.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.790+0000 7fba6f9ff740 4 client.25694 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:22:41.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.790+0000 7fba6f9ff740 1 -- 172.21.15.7:0/1907593451 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cec00f3a20 con 0x55cec0199020 2024-09-19T04:22:41.792 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.791+0000 7fba65d9b640 1 --2- 172.21.15.7:0/1907593451 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55cec0199020 0x55cec019b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:41.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.792+0000 7fba65d9b640 1 --2- 172.21.15.7:0/1907593451 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55cec0199020 0x55cec019b460 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3bae9b0999fa411 server_cookie=152fd2d518b647f4 in_seq=0 out_seq=0 2024-09-19T04:22:41.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.794+0000 7fba4dffb640 10 client.25694 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:22:41.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.798+0000 7fba4dffb640 1 -- 172.21.15.7:0/1907593451 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cec00f3a20 con 0x55cec0199020 2024-09-19T04:22:41.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.798+0000 7fba4dffb640 10 client.25694 handle_command_reply: tid=0 2024-09-19T04:22:41.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.798+0000 7fba6f9ff740 1 client.25694 shutdown 2024-09-19T04:22:41.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.798+0000 7fba6f9ff740 1 -- 172.21.15.7:0/1907593451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec0182b70 msgr2=0x55cec018ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:41.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.798+0000 7fba6f9ff740 1 --2- 172.21.15.7:0/1907593451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec0182b70 0x55cec018ce60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fba5c015980 tx=0x7fba5c0046e0 comp rx=0 tx=0).stop 2024-09-19T04:22:41.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.798+0000 7fba6f9ff740 1 -- 172.21.15.7:0/1907593451 shutdown_connections 2024-09-19T04:22:41.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.798+0000 7fba6f9ff740 1 --2- 172.21.15.7:0/1907593451 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55cec0199020 0x55cec019b460 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:41.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.798+0000 7fba6f9ff740 1 --2- 172.21.15.7:0/1907593451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cec0188540 0x55cec01943e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:41.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.798+0000 7fba6f9ff740 1 --2- 172.21.15.7:0/1907593451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cec01834b0 0x55cec018d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:41.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.798+0000 7fba6f9ff740 1 --2- 172.21.15.7:0/1907593451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec0182b70 0x55cec018ce60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:41.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.798+0000 7fba6f9ff740 1 -- 172.21.15.7:0/1907593451 >> 172.21.15.7:0/1907593451 conn(0x55cec017e1e0 msgr2=0x55cec017f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:41.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.799+0000 7fba4dffb640 0 client.25694 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:22:41.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.799+0000 7fba6f9ff740 1 -- 172.21.15.7:0/1907593451 shutdown_connections 2024-09-19T04:22:41.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.799+0000 7fba6f9ff740 1 -- 172.21.15.7:0/1907593451 wait complete. 2024-09-19T04:22:41.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.799+0000 7fba6f9ff740 20 client.25694 trim_cache size 0 max 16384 2024-09-19T04:22:41.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.858+0000 7fba6f9ff740 1 Processor -- start 2024-09-19T04:22:41.860 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.859+0000 7fba6f9ff740 1 -- start start 2024-09-19T04:22:41.861 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.859+0000 7fba6f9ff740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cec0182b70 0x55cec018bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.859+0000 7fba6f9ff740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec01834b0 0x55cec0194370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.859+0000 7fba6f9ff740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cec0188540 0x55cec017e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.859+0000 7fba6f9ff740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fba4800fde0 con 0x55cec0182b70 2024-09-19T04:22:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.860+0000 7fba6659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cec0182b70 0x55cec018bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.860+0000 7fba65d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec01834b0 0x55cec0194370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.860+0000 7fba65d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec01834b0 0x55cec0194370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:57988/0 (socket says 172.21.15.7:57988) 2024-09-19T04:22:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.860+0000 7fba6f9ff740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fba48011980 con 0x55cec01834b0 2024-09-19T04:22:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.860+0000 7fba65d9b640 1 -- 172.21.15.7:0/1248795715 learned_addr learned my addr 172.21.15.7:0/1248795715 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:22:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.860+0000 7fba6f9ff740 1 -- 172.21.15.7:0/1248795715 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fba480104b0 con 0x55cec0188540 2024-09-19T04:22:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.860+0000 7fba66d9d640 1 --2- 172.21.15.7:0/1248795715 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cec0188540 0x55cec017e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.860+0000 7fba66d9d640 1 -- 172.21.15.7:0/1248795715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec01834b0 msgr2=0x55cec0194370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.860+0000 7fba66d9d640 1 --2- 172.21.15.7:0/1248795715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec01834b0 0x55cec0194370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.860+0000 7fba66d9d640 1 -- 172.21.15.7:0/1248795715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cec0182b70 msgr2=0x55cec018bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:22:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.860+0000 7fba66d9d640 1 --2- 172.21.15.7:0/1248795715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cec0182b70 0x55cec018bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.860+0000 7fba66d9d640 1 -- 172.21.15.7:0/1248795715 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cec018c9a0 con 0x55cec0188540 2024-09-19T04:22:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.860+0000 7fba6659c640 1 --2- 172.21.15.7:0/1248795715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cec0182b70 0x55cec018bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:22:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.861+0000 7fba66d9d640 1 --2- 172.21.15.7:0/1248795715 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cec0188540 0x55cec017e5c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fba580093a0 tx=0x7fba58009e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2bf8186caa69ca1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.861+0000 7fba4ffff640 1 -- 172.21.15.7:0/1248795715 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5801f040 con 0x55cec0188540 2024-09-19T04:22:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.861+0000 7fba4ffff640 1 -- 172.21.15.7:0/1248795715 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba580035f0 con 0x55cec0188540 2024-09-19T04:22:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.863+0000 7fba6f9ff740 1 -- 172.21.15.7:0/1248795715 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cec0188540 msgr2=0x55cec017e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.863+0000 7fba6f9ff740 1 --2- 172.21.15.7:0/1248795715 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cec0188540 0x55cec017e5c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fba580093a0 tx=0x7fba58009e00 comp rx=0 tx=0).stop 2024-09-19T04:22:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.863+0000 7fba6f9ff740 1 -- 172.21.15.7:0/1248795715 shutdown_connections 2024-09-19T04:22:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.863+0000 7fba6f9ff740 1 --2- 172.21.15.7:0/1248795715 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cec0188540 0x55cec017e5c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.863+0000 7fba6f9ff740 1 --2- 172.21.15.7:0/1248795715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec01834b0 0x55cec0194370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.863+0000 7fba6f9ff740 1 --2- 172.21.15.7:0/1248795715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cec0182b70 0x55cec018bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.863+0000 7fba6f9ff740 1 -- 172.21.15.7:0/1248795715 >> 172.21.15.7:0/1248795715 conn(0x55cec017e1e0 msgr2=0x55cec01846f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:41.873 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.872+0000 7fba6f9ff740 1 -- 172.21.15.7:0/1248795715 shutdown_connections 2024-09-19T04:22:41.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.872+0000 7fba6f9ff740 1 -- 172.21.15.7:0/1248795715 wait complete. 2024-09-19T04:22:41.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.873+0000 7fba6f9ff740 1 -- start start 2024-09-19T04:22:41.874 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.873+0000 7fba6f9ff740 1 Processor -- start 2024-09-19T04:22:41.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.873+0000 7fba6f9ff740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec0182b70 0x55cec0194220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:41.875 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.873+0000 7fba6f9ff740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cec01834b0 0x55cec0190d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:41.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.873+0000 7fba6f9ff740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cec0191250 0x55cec0201d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:41.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.873+0000 7fba6f9ff740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fba48011250 con 0x55cec0191250 2024-09-19T04:22:41.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.873+0000 7fba6f9ff740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fba48010b80 con 0x55cec0182b70 2024-09-19T04:22:41.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.873+0000 7fba6f9ff740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fba4800dda0 con 0x55cec01834b0 2024-09-19T04:22:41.876 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.874+0000 7fba66d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cec0191250 0x55cec0201d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.874+0000 7fba66d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cec0191250 0x55cec0201d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42364/0 (socket says 172.21.15.7:42364) 2024-09-19T04:22:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.874+0000 7fba66d9d640 1 -- 172.21.15.7:0/1740160292 learned_addr learned my addr 172.21.15.7:0/1740160292 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:22:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.875+0000 7fba66d9d640 1 -- 172.21.15.7:0/1740160292 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cec01834b0 msgr2=0x55cec0190d10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T04:22:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.875+0000 7fba66d9d640 1 --2- 172.21.15.7:0/1740160292 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cec01834b0 0x55cec0190d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.875+0000 7fba66d9d640 1 -- 172.21.15.7:0/1740160292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec0182b70 msgr2=0x55cec0194220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T04:22:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.875+0000 7fba66d9d640 1 --2- 172.21.15.7:0/1740160292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec0182b70 0x55cec0194220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.875+0000 7fba6f9ff740 10 client.0 _ll_register_callbacks cb 0x7fba5c006c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:22:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.875+0000 7fba66d9d640 1 -- 172.21.15.7:0/1740160292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cec01918b0 con 0x55cec0191250 2024-09-19T04:22:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.876+0000 7fba66d9d640 1 --2- 172.21.15.7:0/1740160292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cec0191250 0x55cec0201d30 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fba58000c00 tx=0x7fba58005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd7522a0349f283 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.876+0000 7fba6f9ff740 1 -- 172.21.15.7:0/1740160292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cec00edd70 con 0x55cec0191250 2024-09-19T04:22:41.893 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.892+0000 7fba4dffb640 10 client.16095 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:22:41.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.892+0000 7fba4dffb640 1 -- 172.21.15.7:0/1740160292 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba5802f070 con 0x55cec0191250 2024-09-19T04:22:41.896 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.895+0000 7fba4dffb640 1 -- 172.21.15.7:0/1740160292 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fba5801aac0 con 0x55cec0191250 2024-09-19T04:22:41.904 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.895+0000 7fba4dffb640 1 -- 172.21.15.7:0/1740160292 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fba5803b050 con 0x55cec0191250 2024-09-19T04:22:41.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.903+0000 7fba6f9ff740 10 client.16095 fetch_fsmap learned FSMap version 34 2024-09-19T04:22:41.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.903+0000 7fba6f9ff740 1 -- 172.21.15.7:0/1740160292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({fsmap=34}) -- 0x55cec02032e0 con 0x55cec0191250 2024-09-19T04:22:41.905 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.904+0000 7fba4dffb640 1 -- 172.21.15.7:0/1740160292 <== mon.0 v2:172.21.15.7:3300/0 4 ==== fsmap(e 34) ==== 8378+0+0 (secure 0 0 0) 0x7fba58018070 con 0x55cec0191250 2024-09-19T04:22:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.904+0000 7fba6f9ff740 10 client.16095 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:22:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.904+0000 7fba6f9ff740 10 client.16095 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:22:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.904+0000 7fba6f9ff740 20 client.16095 populate_metadata read hostname 'smithi007' 2024-09-19T04:22:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.905+0000 7fba6f9ff740 1 --2- 172.21.15.7:0/1740160292 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55cec0203c90 0x55cec02060f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.905+0000 7fba6f9ff740 4 client.16095 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:22:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.905+0000 7fba6f9ff740 1 -- 172.21.15.7:0/1740160292 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cec006a900 con 0x55cec0203c90 2024-09-19T04:22:41.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.905+0000 7fba6659c640 1 --2- 172.21.15.7:0/1740160292 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55cec0203c90 0x55cec02060f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:41.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.905+0000 7fba4dffb640 10 client.16095 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:22:41.907 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:41.905+0000 7fba6659c640 1 --2- 172.21.15.7:0/1740160292 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55cec0203c90 0x55cec02060f0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12e03bb0335ca5e3 server_cookie=add1ee102b83c01c in_seq=0 out_seq=0 2024-09-19T04:22:42.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:42 smithi102 ceph-mon[35446]: pgmap v528: 129 pgs: 129 active+clean; 365 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 318 op/s 2024-09-19T04:22:42.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:42 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:22:42.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:42 smithi092 ceph-mon[34940]: pgmap v528: 129 pgs: 129 active+clean; 365 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 318 op/s 2024-09-19T04:22:42.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:42 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:22:42.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:42 smithi007 ceph-mon[31360]: pgmap v528: 129 pgs: 129 active+clean; 365 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 318 op/s 2024-09-19T04:22:42.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:42 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:22:44.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:44 smithi102 ceph-mon[35446]: pgmap v529: 129 pgs: 129 active+clean; 368 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 283 op/s 2024-09-19T04:22:44.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:44 smithi092 ceph-mon[34940]: pgmap v529: 129 pgs: 129 active+clean; 368 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 283 op/s 2024-09-19T04:22:44.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:44 smithi007 ceph-mon[31360]: pgmap v529: 129 pgs: 129 active+clean; 368 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 283 op/s 2024-09-19T04:22:46.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:46 smithi102 ceph-mon[35446]: pgmap v530: 129 pgs: 129 active+clean; 371 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 232 op/s 2024-09-19T04:22:46.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:22:46.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:22:46.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:46 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:22:46.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:46 smithi092 ceph-mon[34940]: pgmap v530: 129 pgs: 129 active+clean; 371 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 232 op/s 2024-09-19T04:22:46.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:46 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:22:46.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:46 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:22:46.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:46 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:22:46.879 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:46 smithi007 ceph-mon[31360]: pgmap v530: 129 pgs: 129 active+clean; 371 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 232 op/s 2024-09-19T04:22:46.879 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:22:46.880 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:22:46.880 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:46 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:22:48.163 INFO:tasks.workunit.client.0.smithi007.stdout: 122 1740452 363 1275022 281 1068379 1650 2024-09-19T04:22:48.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:48 smithi102 ceph-mon[35446]: pgmap v531: 129 pgs: 129 active+clean; 370 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 188 op/s 2024-09-19T04:22:48.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:48 smithi092 ceph-mon[34940]: pgmap v531: 129 pgs: 129 active+clean; 370 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 188 op/s 2024-09-19T04:22:48.890 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:48 smithi007 ceph-mon[31360]: pgmap v531: 129 pgs: 129 active+clean; 370 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 188 op/s 2024-09-19T04:22:50.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:50 smithi092 ceph-mon[34940]: pgmap v532: 129 pgs: 129 active+clean; 373 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 825 op/s 2024-09-19T04:22:50.881 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:50 smithi007 ceph-mon[31360]: pgmap v532: 129 pgs: 129 active+clean; 373 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 825 op/s 2024-09-19T04:22:50.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:50 smithi102 ceph-mon[35446]: pgmap v532: 129 pgs: 129 active+clean; 373 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 825 op/s 2024-09-19T04:22:52.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:52 smithi092 ceph-mon[34940]: pgmap v533: 129 pgs: 129 active+clean; 376 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 1.15k op/s 2024-09-19T04:22:52.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:52 smithi007 ceph-mon[31360]: pgmap v533: 129 pgs: 129 active+clean; 376 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 1.15k op/s 2024-09-19T04:22:52.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:52 smithi102 ceph-mon[35446]: pgmap v533: 129 pgs: 129 active+clean; 376 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 1.15k op/s 2024-09-19T04:22:54.483 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:54 smithi007 ceph-mon[31360]: pgmap v534: 129 pgs: 129 active+clean; 396 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.3 MiB/s wr, 1.29k op/s 2024-09-19T04:22:54.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:54 smithi092 ceph-mon[34940]: pgmap v534: 129 pgs: 129 active+clean; 396 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.3 MiB/s wr, 1.29k op/s 2024-09-19T04:22:54.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:54 smithi102 ceph-mon[35446]: pgmap v534: 129 pgs: 129 active+clean; 396 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.3 MiB/s wr, 1.29k op/s 2024-09-19T04:22:56.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:56 smithi092 ceph-mon[34940]: pgmap v535: 129 pgs: 129 active+clean; 422 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 5.2 MiB/s wr, 1.49k op/s 2024-09-19T04:22:56.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:56 smithi007 ceph-mon[31360]: pgmap v535: 129 pgs: 129 active+clean; 422 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 5.2 MiB/s wr, 1.49k op/s 2024-09-19T04:22:56.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:56 smithi102 ceph-mon[35446]: pgmap v535: 129 pgs: 129 active+clean; 422 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 5.2 MiB/s wr, 1.49k op/s 2024-09-19T04:22:58.163 INFO:tasks.workunit.client.0.smithi007.stdout: 126 1000972 233 744243 205 640798 290 2024-09-19T04:22:58.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:58 smithi092 ceph-mon[34940]: pgmap v536: 129 pgs: 129 active+clean; 430 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 5.5 MiB/s wr, 1.56k op/s 2024-09-19T04:22:58.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:58 smithi007 ceph-mon[31360]: pgmap v536: 129 pgs: 129 active+clean; 430 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 5.5 MiB/s wr, 1.56k op/s 2024-09-19T04:22:58.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:58 smithi102 ceph-mon[35446]: pgmap v536: 129 pgs: 129 active+clean; 430 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 5.5 MiB/s wr, 1.56k op/s 2024-09-19T04:22:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:59.123+0000 7fba4dffb640 1 -- 172.21.15.7:0/1740160292 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cec006a900 con 0x55cec0203c90 2024-09-19T04:22:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:59.123+0000 7fba4dffb640 10 client.16095 handle_command_reply: tid=0 2024-09-19T04:22:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:59.124+0000 7fba6f9ff740 1 client.16095 shutdown 2024-09-19T04:22:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:59.124+0000 7fba6f9ff740 1 -- 172.21.15.7:0/1740160292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cec0191250 msgr2=0x55cec0201d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:59.124+0000 7fba6f9ff740 1 --2- 172.21.15.7:0/1740160292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cec0191250 0x55cec0201d30 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fba58000c00 tx=0x7fba58005710 comp rx=0 tx=0).stop 2024-09-19T04:22:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:59.124+0000 7fba6f9ff740 1 -- 172.21.15.7:0/1740160292 shutdown_connections 2024-09-19T04:22:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:59.124+0000 7fba6f9ff740 1 --2- 172.21.15.7:0/1740160292 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55cec0203c90 0x55cec02060f0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:59.124+0000 7fba6f9ff740 1 --2- 172.21.15.7:0/1740160292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cec0191250 0x55cec0201d30 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:59.124+0000 7fba6f9ff740 1 --2- 172.21.15.7:0/1740160292 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cec01834b0 0x55cec0190d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:59.124+0000 7fba4dffb640 0 client.16095 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:22:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:59.124+0000 7fba6f9ff740 1 --2- 172.21.15.7:0/1740160292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cec0182b70 0x55cec0194220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:59.124+0000 7fba6f9ff740 1 -- 172.21.15.7:0/1740160292 >> 172.21.15.7:0/1740160292 conn(0x55cec017e1e0 msgr2=0x55cec018ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:59.124+0000 7fba6f9ff740 1 -- 172.21.15.7:0/1740160292 shutdown_connections 2024-09-19T04:22:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:59.124+0000 7fba6f9ff740 1 -- 172.21.15.7:0/1740160292 wait complete. 2024-09-19T04:22:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:59.124+0000 7fba6f9ff740 20 client.16095 trim_cache size 0 max 16384 2024-09-19T04:22:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:22:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:22:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:22:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:22:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:59.125+0000 7fba6759e640 1 -- 172.21.15.7:0/3680110156 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fba500a3460 msgr2=0x7fba500a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:59.125+0000 7fba6759e640 1 --2- 172.21.15.7:0/3680110156 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fba500a3460 0x7fba500a5920 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x55cec0183ee0 tx=0x7fba5c008040 comp rx=0 tx=0).stop 2024-09-19T04:22:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:59.125+0000 7fba6759e640 1 -- 172.21.15.7:0/3680110156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba6810b4e0 msgr2=0x7fba6819ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:59.125+0000 7fba6759e640 1 --2- 172.21.15.7:0/3680110156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba6810b4e0 0x7fba6819ec80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fba6001acb0 tx=0x7fba60041860 comp rx=0 tx=0).stop 2024-09-19T04:22:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:59.125+0000 7fba6759e640 1 -- 172.21.15.7:0/3680110156 shutdown_connections 2024-09-19T04:22:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:59.125+0000 7fba6759e640 1 --2- 172.21.15.7:0/3680110156 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fba500a3460 0x7fba500a5920 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:59.125+0000 7fba6759e640 1 --2- 172.21.15.7:0/3680110156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba6810de90 0x7fba681a5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:59.125+0000 7fba6759e640 1 --2- 172.21.15.7:0/3680110156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba6810b4e0 0x7fba6819ec80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:59.125+0000 7fba6759e640 1 --2- 172.21.15.7:0/3680110156 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba68072d80 0x7fba6819e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:59.125+0000 7fba6759e640 1 -- 172.21.15.7:0/3680110156 >> 172.21.15.7:0/3680110156 conn(0x7fba6806eb10 msgr2=0x7fba6810e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:59.125+0000 7fba6759e640 1 -- 172.21.15.7:0/3680110156 shutdown_connections 2024-09-19T04:22:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:22:59.125+0000 7fba6759e640 1 -- 172.21.15.7:0/3680110156 wait complete. 2024-09-19T04:22:59.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:22:59 smithi092 ceph-mon[34940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:22:59.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:22:59 smithi007 ceph-mon[31360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:22:59.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:22:59 smithi102 ceph-mon[35446]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:23:01.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:00 smithi092 ceph-mon[34940]: pgmap v537: 129 pgs: 129 active+clean; 435 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 6.1 MiB/s wr, 1.74k op/s 2024-09-19T04:23:01.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:00 smithi007 ceph-mon[31360]: pgmap v537: 129 pgs: 129 active+clean; 435 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 6.1 MiB/s wr, 1.74k op/s 2024-09-19T04:23:01.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:00 smithi102 ceph-mon[35446]: pgmap v537: 129 pgs: 129 active+clean; 435 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 844 KiB/s rd, 6.1 MiB/s wr, 1.74k op/s 2024-09-19T04:23:03.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:02 smithi092 ceph-mon[34940]: pgmap v538: 129 pgs: 129 active+clean; 444 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 7.0 MiB/s wr, 1.40k op/s 2024-09-19T04:23:03.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:02 smithi007 ceph-mon[31360]: pgmap v538: 129 pgs: 129 active+clean; 444 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 7.0 MiB/s wr, 1.40k op/s 2024-09-19T04:23:03.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:02 smithi102 ceph-mon[35446]: pgmap v538: 129 pgs: 129 active+clean; 444 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 7.0 MiB/s wr, 1.40k op/s 2024-09-19T04:23:05.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:04 smithi092 ceph-mon[34940]: pgmap v539: 129 pgs: 129 active+clean; 418 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 6.7 MiB/s wr, 1.11k op/s 2024-09-19T04:23:05.379 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:04 smithi007 ceph-mon[31360]: pgmap v539: 129 pgs: 129 active+clean; 418 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 6.7 MiB/s wr, 1.11k op/s 2024-09-19T04:23:05.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:04 smithi102 ceph-mon[35446]: pgmap v539: 129 pgs: 129 active+clean; 418 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 6.7 MiB/s wr, 1.11k op/s 2024-09-19T04:23:07.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:06 smithi092 ceph-mon[34940]: pgmap v540: 129 pgs: 129 active+clean; 424 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.7 MiB/s wr, 1.00k op/s 2024-09-19T04:23:07.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:06 smithi007 ceph-mon[31360]: pgmap v540: 129 pgs: 129 active+clean; 424 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.7 MiB/s wr, 1.00k op/s 2024-09-19T04:23:07.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:06 smithi102 ceph-mon[35446]: pgmap v540: 129 pgs: 129 active+clean; 424 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.7 MiB/s wr, 1.00k op/s 2024-09-19T04:23:08.165 INFO:tasks.workunit.client.0.smithi007.stdout: 137 1471843 600 1101624 527 900218 1459 2024-09-19T04:23:09.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:08 smithi092 ceph-mon[34940]: pgmap v541: 129 pgs: 129 active+clean; 424 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 767 op/s 2024-09-19T04:23:09.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:08 smithi007 ceph-mon[31360]: pgmap v541: 129 pgs: 129 active+clean; 424 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 767 op/s 2024-09-19T04:23:09.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:08 smithi102 ceph-mon[35446]: pgmap v541: 129 pgs: 129 active+clean; 424 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 767 op/s 2024-09-19T04:23:11.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:10 smithi092 ceph-mon[34940]: pgmap v542: 129 pgs: 129 active+clean; 430 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.5 MiB/s wr, 693 op/s 2024-09-19T04:23:11.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:10 smithi007 ceph-mon[31360]: pgmap v542: 129 pgs: 129 active+clean; 430 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.5 MiB/s wr, 693 op/s 2024-09-19T04:23:11.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:10 smithi102 ceph-mon[35446]: pgmap v542: 129 pgs: 129 active+clean; 430 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.5 MiB/s wr, 693 op/s 2024-09-19T04:23:13.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:12 smithi092 ceph-mon[34940]: pgmap v543: 129 pgs: 129 active+clean; 429 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 549 op/s 2024-09-19T04:23:13.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:12 smithi007 ceph-mon[31360]: pgmap v543: 129 pgs: 129 active+clean; 429 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 549 op/s 2024-09-19T04:23:13.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:12 smithi102 ceph-mon[35446]: pgmap v543: 129 pgs: 129 active+clean; 429 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 549 op/s 2024-09-19T04:23:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.529+0000 7fcb3a1fc640 1 -- 172.21.15.7:0/1837922826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb3410b4e0 msgr2=0x7fcb3410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:13.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.529+0000 7fcb3a1fc640 1 --2- 172.21.15.7:0/1837922826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb3410b4e0 0x7fcb3410d950 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c009f00 tx=0x7fcb2c02ab40 comp rx=0 tx=0).stop 2024-09-19T04:23:13.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.533+0000 7fcb3a1fc640 1 -- 172.21.15.7:0/1837922826 shutdown_connections 2024-09-19T04:23:13.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.533+0000 7fcb3a1fc640 1 --2- 172.21.15.7:0/1837922826 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb3410de90 0x7fcb34110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:13.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.533+0000 7fcb3a1fc640 1 --2- 172.21.15.7:0/1837922826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb3410b4e0 0x7fcb3410d950 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:13.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.533+0000 7fcb3a1fc640 1 --2- 172.21.15.7:0/1837922826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb34072d80 0x7fcb34073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:13.535 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.533+0000 7fcb3a1fc640 1 -- 172.21.15.7:0/1837922826 >> 172.21.15.7:0/1837922826 conn(0x7fcb3406eb10 msgr2=0x7fcb34070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:23:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.536+0000 7fcb3a1fc640 1 -- 172.21.15.7:0/1837922826 shutdown_connections 2024-09-19T04:23:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.536+0000 7fcb3a1fc640 1 -- 172.21.15.7:0/1837922826 wait complete. 2024-09-19T04:23:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.537+0000 7fcb3a1fc640 1 Processor -- start 2024-09-19T04:23:13.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.537+0000 7fcb3a1fc640 1 -- start start 2024-09-19T04:23:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.538+0000 7fcb3a1fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb34072d80 0x7fcb341a6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.538+0000 7fcb3a1fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb3410b4e0 0x7fcb341a70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.538+0000 7fcb3a1fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb3410de90 0x7fcb341ae160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.538+0000 7fcb3a1fc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3411c4d0 con 0x7fcb34072d80 2024-09-19T04:23:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.538+0000 7fcb3a1fc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3411c350 con 0x7fcb3410b4e0 2024-09-19T04:23:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.538+0000 7fcb3a1fc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3411c650 con 0x7fcb3410de90 2024-09-19T04:23:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.538+0000 7fcb391fa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb34072d80 0x7fcb341a6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.538+0000 7fcb391fa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb34072d80 0x7fcb341a6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49534/0 (socket says 172.21.15.7:49534) 2024-09-19T04:23:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.538+0000 7fcb391fa640 1 -- 172.21.15.7:0/1140016360 learned_addr learned my addr 172.21.15.7:0/1140016360 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:23:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.538+0000 7fcb399fb640 1 --2- 172.21.15.7:0/1140016360 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb3410de90 0x7fcb341ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.538+0000 7fcb389f9640 1 --2- 172.21.15.7:0/1140016360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb3410b4e0 0x7fcb341a70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.538+0000 7fcb391fa640 1 -- 172.21.15.7:0/1140016360 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb3410de90 msgr2=0x7fcb341ae160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.538+0000 7fcb391fa640 1 --2- 172.21.15.7:0/1140016360 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb3410de90 0x7fcb341ae160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.538+0000 7fcb391fa640 1 -- 172.21.15.7:0/1140016360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb3410b4e0 msgr2=0x7fcb341a70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.539+0000 7fcb391fa640 1 --2- 172.21.15.7:0/1140016360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb3410b4e0 0x7fcb341a70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.539+0000 7fcb391fa640 1 -- 172.21.15.7:0/1140016360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb34110a50 con 0x7fcb34072d80 2024-09-19T04:23:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.539+0000 7fcb399fb640 1 --2- 172.21.15.7:0/1140016360 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb3410de90 0x7fcb341ae160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:23:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.539+0000 7fcb391fa640 1 --2- 172.21.15.7:0/1140016360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb34072d80 0x7fcb341a6bb0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fcb2400da90 tx=0x7fcb2400df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:23:13.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.543+0000 7fcb2a7fc640 1 -- 172.21.15.7:0/1140016360 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb24017070 con 0x7fcb34072d80 2024-09-19T04:23:13.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.543+0000 7fcb2a7fc640 1 -- 172.21.15.7:0/1140016360 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb24009c00 con 0x7fcb34072d80 2024-09-19T04:23:13.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.543+0000 7fcb2a7fc640 1 -- 172.21.15.7:0/1140016360 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2400f700 con 0x7fcb34072d80 2024-09-19T04:23:13.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.543+0000 7fcb3a1fc640 1 -- 172.21.15.7:0/1140016360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb34110d40 con 0x7fcb34072d80 2024-09-19T04:23:13.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.543+0000 7fcb3a1fc640 1 -- 172.21.15.7:0/1140016360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb34111290 con 0x7fcb34072d80 2024-09-19T04:23:13.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.554+0000 7fcb3e1fc740 1 Processor -- start 2024-09-19T04:23:13.555 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.554+0000 7fcb3e1fc740 1 -- start start 2024-09-19T04:23:13.556 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.555+0000 7fcb3e1fc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d26be2b70 0x564d26be2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:13.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.555+0000 7fcb3e1fc740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d26be34b0 0x564d26be7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:13.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.555+0000 7fcb399fb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d26be2b70 0x564d26be2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:13.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.555+0000 7fcb399fb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d26be2b70 0x564d26be2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49542/0 (socket says 172.21.15.7:49542) 2024-09-19T04:23:13.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.555+0000 7fcb399fb640 1 -- 172.21.15.7:0/637174145 learned_addr learned my addr 172.21.15.7:0/637174145 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:23:13.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.556+0000 7fcb2a7fc640 1 -- 172.21.15.7:0/1140016360 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fcb24010a60 con 0x7fcb34072d80 2024-09-19T04:23:13.557 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.556+0000 7fcb3e1fc740 1 --2- 172.21.15.7:0/637174145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d26be8540 0x564d26beaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:13.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.556+0000 7fcb391fa640 1 --2- 172.21.15.7:0/637174145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d26be34b0 0x564d26be7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:13.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.556+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/637174145 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564d26b462f0 con 0x564d26be2b70 2024-09-19T04:23:13.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.556+0000 7fcb389f9640 1 --2- 172.21.15.7:0/637174145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d26be8540 0x564d26beaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:13.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.556+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/637174145 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564d26aee270 con 0x564d26be8540 2024-09-19T04:23:13.558 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.556+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/637174145 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564d26b422b0 con 0x564d26be34b0 2024-09-19T04:23:13.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.557+0000 7fcb389f9640 1 -- 172.21.15.7:0/637174145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d26be34b0 msgr2=0x564d26be7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:23:13.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.557+0000 7fcb389f9640 1 --2- 172.21.15.7:0/637174145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d26be34b0 0x564d26be7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:13.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.557+0000 7fcb389f9640 1 -- 172.21.15.7:0/637174145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d26be2b70 msgr2=0x564d26be2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:23:13.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.557+0000 7fcb389f9640 1 --2- 172.21.15.7:0/637174145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d26be2b70 0x564d26be2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:13.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.557+0000 7fcb389f9640 1 -- 172.21.15.7:0/637174145 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d26aed340 con 0x564d26be8540 2024-09-19T04:23:13.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.557+0000 7fcb399fb640 1 --2- 172.21.15.7:0/637174145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d26be2b70 0x564d26be2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:23:13.559 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.557+0000 7fcb389f9640 1 --2- 172.21.15.7:0/637174145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d26be8540 0x564d26beaa00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c02db20 tx=0x7fcb2c009970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f74c76a19cd2befc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:23:13.560 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.559+0000 7fcb2a7fc640 1 --2- 172.21.15.7:0/1140016360 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fcb200a3460 0x7fcb200a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.560+0000 7fcb399fb640 1 --2- 172.21.15.7:0/1140016360 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fcb200a3460 0x7fcb200a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:13.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.561+0000 7fcb399fb640 1 --2- 172.21.15.7:0/1140016360 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fcb200a3460 0x7fcb200a5920 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000bc30 tx=0x7fcb30008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:23:13.564 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.561+0000 7fcb2a7fc640 1 -- 172.21.15.7:0/1140016360 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fcb240cf760 con 0x7fcb34072d80 2024-09-19T04:23:13.571 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.570+0000 7fcb1f7fe640 1 -- 172.21.15.7:0/637174145 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c044020 con 0x564d26be8540 2024-09-19T04:23:13.571 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.570+0000 7fcb1f7fe640 1 -- 172.21.15.7:0/637174145 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb2c03c040 con 0x564d26be8540 2024-09-19T04:23:13.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.571+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/637174145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d26be8540 msgr2=0x564d26beaa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:13.582 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.571+0000 7fcb3e1fc740 1 --2- 172.21.15.7:0/637174145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d26be8540 0x564d26beaa00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c02db20 tx=0x7fcb2c009970 comp rx=0 tx=0).stop 2024-09-19T04:23:13.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.582+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/637174145 shutdown_connections 2024-09-19T04:23:13.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.582+0000 7fcb3e1fc740 1 --2- 172.21.15.7:0/637174145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d26be8540 0x564d26beaa00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:13.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.582+0000 7fcb3e1fc740 1 --2- 172.21.15.7:0/637174145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d26be34b0 0x564d26be7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:13.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.582+0000 7fcb3e1fc740 1 --2- 172.21.15.7:0/637174145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d26be2b70 0x564d26be2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:13.583 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.582+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/637174145 >> 172.21.15.7:0/637174145 conn(0x564d26bde1e0 msgr2=0x564d26bde5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:23:13.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.602+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/637174145 shutdown_connections 2024-09-19T04:23:13.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.602+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/637174145 wait complete. 2024-09-19T04:23:13.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.602+0000 7fcb3e1fc740 1 -- start start 2024-09-19T04:23:13.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.603+0000 7fcb3e1fc740 1 Processor -- start 2024-09-19T04:23:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.603+0000 7fcb3e1fc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d26be2b70 0x564d26becd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.603+0000 7fcb3e1fc740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d26be34b0 0x564d26bed2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.603+0000 7fcb3e1fc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d26bf21f0 0x564d26bf45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.603+0000 7fcb3e1fc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564d26beb4b0 con 0x564d26be2b70 2024-09-19T04:23:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.603+0000 7fcb3e1fc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564d26acf290 con 0x564d26bf21f0 2024-09-19T04:23:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.603+0000 7fcb3e1fc740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564d26beb630 con 0x564d26be34b0 2024-09-19T04:23:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.603+0000 7fcb3e1fc740 10 client.0 _ll_register_callbacks cb 0x564d26b00140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:23:13.606 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.604+0000 7fcb399fb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d26bf21f0 0x564d26bf45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:13.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.604+0000 7fcb399fb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d26bf21f0 0x564d26bf45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:56232/0 (socket says 172.21.15.7:56232) 2024-09-19T04:23:13.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.604+0000 7fcb399fb640 1 -- 172.21.15.7:0/2848898890 learned_addr learned my addr 172.21.15.7:0/2848898890 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:23:13.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.604+0000 7fcb389f9640 1 --2- 172.21.15.7:0/2848898890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d26be34b0 0x564d26bed2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:13.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.605+0000 7fcb391fa640 1 --2- 172.21.15.7:0/2848898890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d26be2b70 0x564d26becd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:13.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.605+0000 7fcb389f9640 1 -- 172.21.15.7:0/2848898890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d26bf21f0 msgr2=0x564d26bf45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:23:13.607 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.605+0000 7fcb389f9640 1 --2- 172.21.15.7:0/2848898890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d26bf21f0 0x564d26bf45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:13.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.605+0000 7fcb389f9640 1 -- 172.21.15.7:0/2848898890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d26be2b70 msgr2=0x564d26becd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:23:13.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.605+0000 7fcb389f9640 1 --2- 172.21.15.7:0/2848898890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d26be2b70 0x564d26becd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:13.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.605+0000 7fcb389f9640 1 -- 172.21.15.7:0/2848898890 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d26859210 con 0x564d26be34b0 2024-09-19T04:23:13.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.606+0000 7fcb391fa640 1 --2- 172.21.15.7:0/2848898890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d26be2b70 0x564d26becd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:23:13.608 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.606+0000 7fcb389f9640 1 --2- 172.21.15.7:0/2848898890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d26be34b0 0x564d26bed2a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c009f00 tx=0x7fcb2c02dbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52d6e0b06718a017 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:23:13.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.646+0000 7fcb1cff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-19T04:23:13.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.646+0000 7fcb1cff9640 1 -- 172.21.15.7:0/2848898890 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c04f070 con 0x564d26be34b0 2024-09-19T04:23:13.647 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.646+0000 7fcb1cff9640 1 -- 172.21.15.7:0/2848898890 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fcb2c003d80 con 0x564d26be34b0 2024-09-19T04:23:13.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.646+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/2848898890 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564d26b53a20 con 0x564d26be34b0 2024-09-19T04:23:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.656+0000 7fcb1cff9640 1 -- 172.21.15.7:0/2848898890 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fcb2c05b050 con 0x564d26be34b0 2024-09-19T04:23:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.656+0000 7fcb3e1fc740 10 client.25780 fetch_fsmap learned FSMap version 35 2024-09-19T04:23:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.656+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/2848898890 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x564d26925620 con 0x564d26be34b0 2024-09-19T04:23:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.657+0000 7fcb1cff9640 1 -- 172.21.15.7:0/2848898890 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x564d26b53a20 con 0x564d26be34b0 2024-09-19T04:23:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.658+0000 7fcb1cff9640 1 -- 172.21.15.7:0/2848898890 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8374+0+0 (secure 0 0 0) 0x7fcb2c049b50 con 0x564d26be34b0 2024-09-19T04:23:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.658+0000 7fcb3e1fc740 10 client.25780 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T04:23:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.658+0000 7fcb3e1fc740 10 client.25780 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:23:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.659+0000 7fcb3e1fc740 20 client.25780 populate_metadata read hostname 'smithi007' 2024-09-19T04:23:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.659+0000 7fcb3e1fc740 1 --2- 172.21.15.7:0/2848898890 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564d26bf8db0 0x564d26bfb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.659+0000 7fcb3e1fc740 4 client.25780 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:23:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.659+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/2848898890 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d26b4dd70 con 0x564d26bf8db0 2024-09-19T04:23:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.659+0000 7fcb391fa640 1 --2- 172.21.15.7:0/2848898890 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564d26bf8db0 0x564d26bfb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.659+0000 7fcb391fa640 1 --2- 172.21.15.7:0/2848898890 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564d26bf8db0 0x564d26bfb230 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1810cdf78e72c6f server_cookie=568b1e5c34c17b9c in_seq=0 out_seq=0 2024-09-19T04:23:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.660+0000 7fcb1cff9640 10 client.25780 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:23:13.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.663+0000 7fcb1cff9640 1 -- 172.21.15.7:0/2848898890 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564d26b4dd70 con 0x564d26bf8db0 2024-09-19T04:23:13.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.663+0000 7fcb1cff9640 10 client.25780 handle_command_reply: tid=0 2024-09-19T04:23:13.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.663+0000 7fcb3e1fc740 1 client.25780 shutdown 2024-09-19T04:23:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.669+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/2848898890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d26be34b0 msgr2=0x564d26bed2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.669+0000 7fcb3e1fc740 1 --2- 172.21.15.7:0/2848898890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d26be34b0 0x564d26bed2a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c009f00 tx=0x7fcb2c02dbf0 comp rx=0 tx=0).stop 2024-09-19T04:23:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.669+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/2848898890 shutdown_connections 2024-09-19T04:23:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.669+0000 7fcb3e1fc740 1 --2- 172.21.15.7:0/2848898890 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564d26bf8db0 0x564d26bfb230 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.669+0000 7fcb3e1fc740 1 --2- 172.21.15.7:0/2848898890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d26bf21f0 0x564d26bf45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.669+0000 7fcb3e1fc740 1 --2- 172.21.15.7:0/2848898890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d26be34b0 0x564d26bed2a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.669+0000 7fcb3e1fc740 1 --2- 172.21.15.7:0/2848898890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d26be2b70 0x564d26becd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.669+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/2848898890 >> 172.21.15.7:0/2848898890 conn(0x564d26bde1e0 msgr2=0x564d26bdfa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:23:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.669+0000 7fcb1cff9640 0 client.25780 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:23:13.672 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.670+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/2848898890 shutdown_connections 2024-09-19T04:23:13.672 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.670+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/2848898890 wait complete. 2024-09-19T04:23:13.672 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.670+0000 7fcb3e1fc740 20 client.25780 trim_cache size 0 max 16384 2024-09-19T04:23:13.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.807+0000 7fcb3e1fc740 1 Processor -- start 2024-09-19T04:23:13.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.807+0000 7fcb3e1fc740 1 -- start start 2024-09-19T04:23:13.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.808+0000 7fcb3e1fc740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d26be2b70 0x564d26bdd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:13.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.809+0000 7fcb3e1fc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d26be34b0 0x564d26bdd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:13.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.809+0000 7fcb391fa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d26be2b70 0x564d26bdd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:13.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.809+0000 7fcb391fa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d26be2b70 0x564d26bdd210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:59742/0 (socket says 172.21.15.7:59742) 2024-09-19T04:23:13.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.809+0000 7fcb391fa640 1 -- 172.21.15.7:0/2937465544 learned_addr learned my addr 172.21.15.7:0/2937465544 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:23:13.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.809+0000 7fcb389f9640 1 --2- 172.21.15.7:0/2937465544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d26be34b0 0x564d26bdd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:13.811 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.809+0000 7fcb3e1fc740 1 --2- 172.21.15.7:0/2937465544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d26bf21f0 0x564d26bdf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.810+0000 7fcb399fb640 1 --2- 172.21.15.7:0/2937465544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d26bf21f0 0x564d26bdf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.810+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/2937465544 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1800fc50 con 0x564d26bf21f0 2024-09-19T04:23:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.810+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/2937465544 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcb180117c0 con 0x564d26be34b0 2024-09-19T04:23:13.812 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.810+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/2937465544 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcb18010320 con 0x564d26be2b70 2024-09-19T04:23:13.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.811+0000 7fcb399fb640 1 -- 172.21.15.7:0/2937465544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d26be2b70 msgr2=0x564d26bdd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:23:13.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.811+0000 7fcb399fb640 1 --2- 172.21.15.7:0/2937465544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d26be2b70 0x564d26bdd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:13.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.811+0000 7fcb399fb640 1 -- 172.21.15.7:0/2937465544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d26be34b0 msgr2=0x564d26bdd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:23:13.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.811+0000 7fcb399fb640 1 --2- 172.21.15.7:0/2937465544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d26be34b0 0x564d26bdd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:13.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.811+0000 7fcb399fb640 1 -- 172.21.15.7:0/2937465544 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d26bde000 con 0x564d26bf21f0 2024-09-19T04:23:13.813 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.812+0000 7fcb399fb640 1 --2- 172.21.15.7:0/2937465544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d26bf21f0 0x564d26bdf5d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000b5f0 tx=0x7fcb30013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfdb1e2695cb156 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:23:13.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.823+0000 7fcb1effd640 1 -- 172.21.15.7:0/2937465544 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb30016da0 con 0x564d26bf21f0 2024-09-19T04:23:13.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.823+0000 7fcb1effd640 1 -- 172.21.15.7:0/2937465544 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb30027070 con 0x564d26bf21f0 2024-09-19T04:23:13.824 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.823+0000 7fcb1effd640 1 -- 172.21.15.7:0/2937465544 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb30022680 con 0x564d26bf21f0 2024-09-19T04:23:13.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.824+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/2937465544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d26bf21f0 msgr2=0x564d26bdf5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:13.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.824+0000 7fcb3e1fc740 1 --2- 172.21.15.7:0/2937465544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d26bf21f0 0x564d26bdf5d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000b5f0 tx=0x7fcb30013000 comp rx=0 tx=0).stop 2024-09-19T04:23:13.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.825+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/2937465544 shutdown_connections 2024-09-19T04:23:13.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.825+0000 7fcb3e1fc740 1 --2- 172.21.15.7:0/2937465544 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d26bf21f0 0x564d26bdf5d0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:13.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.825+0000 7fcb3e1fc740 1 --2- 172.21.15.7:0/2937465544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d26be34b0 0x564d26bdd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:13.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.825+0000 7fcb3e1fc740 1 --2- 172.21.15.7:0/2937465544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d26be2b70 0x564d26bdd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:13.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.825+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/2937465544 >> 172.21.15.7:0/2937465544 conn(0x564d26bde1e0 msgr2=0x564d26bdcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:23:13.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.829+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/2937465544 shutdown_connections 2024-09-19T04:23:13.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.829+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/2937465544 wait complete. 2024-09-19T04:23:13.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.830+0000 7fcb3e1fc740 1 -- start start 2024-09-19T04:23:13.831 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.830+0000 7fcb3e1fc740 1 Processor -- start 2024-09-19T04:23:13.832 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.831+0000 7fcb3e1fc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d26be2b70 0x564d26c0cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:13.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.831+0000 7fcb391fa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d26be2b70 0x564d26c0cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:13.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.831+0000 7fcb391fa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d26be2b70 0x564d26c0cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49562/0 (socket says 172.21.15.7:49562) 2024-09-19T04:23:13.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.832+0000 7fcb391fa640 1 -- 172.21.15.7:0/1024024838 learned_addr learned my addr 172.21.15.7:0/1024024838 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:23:13.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.832+0000 7fcb3e1fc740 1 --2- 172.21.15.7:0/1024024838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d26be34b0 0x564d26c097a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:13.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.832+0000 7fcb3e1fc740 1 --2- 172.21.15.7:0/1024024838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d26c0d2e0 0x564d26c09d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:13.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.832+0000 7fcb389f9640 1 --2- 172.21.15.7:0/1024024838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d26be34b0 0x564d26c097a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:13.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.832+0000 7fcb399fb640 1 --2- 172.21.15.7:0/1024024838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d26c0d2e0 0x564d26c09d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:13.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.832+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/1024024838 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcb180110c0 con 0x564d26be2b70 2024-09-19T04:23:13.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.833+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/1024024838 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcb180109f0 con 0x564d26c0d2e0 2024-09-19T04:23:13.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.833+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/1024024838 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1800dce0 con 0x564d26be34b0 2024-09-19T04:23:13.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.834+0000 7fcb391fa640 1 -- 172.21.15.7:0/1024024838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d26be34b0 msgr2=0x564d26c097a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:23:13.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.834+0000 7fcb391fa640 1 --2- 172.21.15.7:0/1024024838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d26be34b0 0x564d26c097a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:13.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.834+0000 7fcb391fa640 1 -- 172.21.15.7:0/1024024838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d26c0d2e0 msgr2=0x564d26c09d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:23:13.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.834+0000 7fcb391fa640 1 --2- 172.21.15.7:0/1024024838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d26c0d2e0 0x564d26c09d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:13.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.834+0000 7fcb391fa640 1 -- 172.21.15.7:0/1024024838 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d26c619b0 con 0x564d26be2b70 2024-09-19T04:23:13.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.834+0000 7fcb391fa640 1 --2- 172.21.15.7:0/1024024838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d26be2b70 0x564d26c0cd00 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fcb2409b6f0 tx=0x7fcb240d5400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee0292c01dda71c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:23:13.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.835+0000 7fcb3e1fc740 10 client.0 _ll_register_callbacks cb 0x7fcb3000b240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:23:13.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.835+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/1024024838 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb30027070 con 0x564d26be2b70 2024-09-19T04:23:13.850 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.849+0000 7fcb1cff9640 10 client.16113 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:23:13.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.849+0000 7fcb1cff9640 1 -- 172.21.15.7:0/1024024838 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb240b4060 con 0x564d26be2b70 2024-09-19T04:23:13.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.849+0000 7fcb1cff9640 1 -- 172.21.15.7:0/1024024838 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fcb24099cf0 con 0x564d26be2b70 2024-09-19T04:23:13.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.849+0000 7fcb1cff9640 1 -- 172.21.15.7:0/1024024838 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fcb2409b9f0 con 0x564d26be2b70 2024-09-19T04:23:13.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.849+0000 7fcb3e1fc740 10 client.16113 fetch_fsmap learned FSMap version 35 2024-09-19T04:23:13.851 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.850+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/1024024838 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({fsmap=35}) -- 0x564d26c62b40 con 0x564d26be2b70 2024-09-19T04:23:13.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.856+0000 7fcb1cff9640 1 -- 172.21.15.7:0/1024024838 <== mon.0 v2:172.21.15.7:3300/0 4 ==== fsmap(e 35) ==== 8374+0+0 (secure 0 0 0) 0x7fcb24098060 con 0x564d26be2b70 2024-09-19T04:23:13.857 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.856+0000 7fcb3e1fc740 10 client.16113 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T04:23:13.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.856+0000 7fcb3e1fc740 10 client.16113 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:23:13.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.856+0000 7fcb3e1fc740 20 client.16113 populate_metadata read hostname 'smithi007' 2024-09-19T04:23:13.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.856+0000 7fcb3e1fc740 1 --2- 172.21.15.7:0/1024024838 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564d26c63330 0x564d26c657f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:13.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.856+0000 7fcb3e1fc740 4 client.16113 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:23:13.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.856+0000 7fcb389f9640 1 --2- 172.21.15.7:0/1024024838 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564d26c63330 0x564d26c657f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:13.858 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.857+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/1024024838 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fcb30027070 con 0x564d26c63330 2024-09-19T04:23:13.859 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.857+0000 7fcb389f9640 1 --2- 172.21.15.7:0/1024024838 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564d26c63330 0x564d26c657f0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7fe1cccb834042e server_cookie=7b4642a11669ade1 in_seq=0 out_seq=0 2024-09-19T04:23:13.863 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:13.862+0000 7fcb1cff9640 10 client.16113 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:23:15.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:14 smithi092 ceph-mon[34940]: pgmap v544: 129 pgs: 129 active+clean; 432 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 290 op/s 2024-09-19T04:23:15.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:14 smithi092 ceph-mon[34940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:23:15.385 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:14 smithi007 ceph-mon[31360]: pgmap v544: 129 pgs: 129 active+clean; 432 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 290 op/s 2024-09-19T04:23:15.385 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:14 smithi007 ceph-mon[31360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:23:15.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:14 smithi102 ceph-mon[35446]: pgmap v544: 129 pgs: 129 active+clean; 432 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 290 op/s 2024-09-19T04:23:15.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:14 smithi102 ceph-mon[35446]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:23:17.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:16 smithi092 ceph-mon[34940]: pgmap v545: 129 pgs: 129 active+clean; 429 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 237 op/s 2024-09-19T04:23:17.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:16 smithi007 ceph-mon[31360]: pgmap v545: 129 pgs: 129 active+clean; 429 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 237 op/s 2024-09-19T04:23:17.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:16 smithi102 ceph-mon[35446]: pgmap v545: 129 pgs: 129 active+clean; 429 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 237 op/s 2024-09-19T04:23:18.166 INFO:tasks.workunit.client.0.smithi007.stdout: 143 1454561 352 1087399 387 894147 1094 2024-09-19T04:23:19.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:19 smithi092 ceph-mon[34940]: pgmap v546: 129 pgs: 129 active+clean; 433 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 221 op/s 2024-09-19T04:23:19.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:19 smithi007 ceph-mon[31360]: pgmap v546: 129 pgs: 129 active+clean; 433 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 221 op/s 2024-09-19T04:23:19.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:19 smithi102 ceph-mon[35446]: pgmap v546: 129 pgs: 129 active+clean; 433 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 221 op/s 2024-09-19T04:23:21.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:21 smithi092 ceph-mon[34940]: pgmap v547: 129 pgs: 129 active+clean; 458 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.5 MiB/s wr, 1.13k op/s 2024-09-19T04:23:21.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:21 smithi007 ceph-mon[31360]: pgmap v547: 129 pgs: 129 active+clean; 458 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.5 MiB/s wr, 1.13k op/s 2024-09-19T04:23:21.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:21 smithi102 ceph-mon[35446]: pgmap v547: 129 pgs: 129 active+clean; 458 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.5 MiB/s wr, 1.13k op/s 2024-09-19T04:23:23.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:23 smithi092 ceph-mon[34940]: pgmap v548: 129 pgs: 129 active+clean; 474 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 5.3 MiB/s wr, 1.61k op/s 2024-09-19T04:23:23.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:23 smithi007 ceph-mon[31360]: pgmap v548: 129 pgs: 129 active+clean; 474 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 5.3 MiB/s wr, 1.61k op/s 2024-09-19T04:23:23.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:23 smithi102 ceph-mon[35446]: pgmap v548: 129 pgs: 129 active+clean; 474 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 5.3 MiB/s wr, 1.61k op/s 2024-09-19T04:23:23.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:23.629+0000 7fcb1cff9640 1 -- 172.21.15.7:0/1024024838 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fcb30027070 con 0x564d26c63330 2024-09-19T04:23:23.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:23.629+0000 7fcb1cff9640 10 client.16113 handle_command_reply: tid=0 2024-09-19T04:23:23.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:23.629+0000 7fcb3e1fc740 1 client.16113 shutdown 2024-09-19T04:23:23.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:23.631+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/1024024838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d26be2b70 msgr2=0x564d26c0cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:23.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:23.631+0000 7fcb3e1fc740 1 --2- 172.21.15.7:0/1024024838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d26be2b70 0x564d26c0cd00 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fcb2409b6f0 tx=0x7fcb240d5400 comp rx=0 tx=0).stop 2024-09-19T04:23:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:23.631+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/1024024838 shutdown_connections 2024-09-19T04:23:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:23.631+0000 7fcb3e1fc740 1 --2- 172.21.15.7:0/1024024838 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564d26c63330 0x564d26c657f0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:23.631+0000 7fcb3e1fc740 1 --2- 172.21.15.7:0/1024024838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564d26c0d2e0 0x564d26c09d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:23.631+0000 7fcb3e1fc740 1 --2- 172.21.15.7:0/1024024838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564d26be34b0 0x564d26c097a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:23.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:23.631+0000 7fcb3e1fc740 1 --2- 172.21.15.7:0/1024024838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564d26be2b70 0x564d26c0cd00 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:23.631+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/1024024838 >> 172.21.15.7:0/1024024838 conn(0x564d26bde1e0 msgr2=0x564d26bdd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:23:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:23.631+0000 7fcb1cff9640 0 client.16113 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:23:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:23.633+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/1024024838 shutdown_connections 2024-09-19T04:23:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:23.633+0000 7fcb3e1fc740 1 -- 172.21.15.7:0/1024024838 wait complete. 2024-09-19T04:23:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:23.633+0000 7fcb3e1fc740 20 client.16113 trim_cache size 0 max 16384 2024-09-19T04:23:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:23:23.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:23:23.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:23:23.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:23:23.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:23.660+0000 7fcb3a1fc640 1 -- 172.21.15.7:0/1140016360 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fcb200a3460 msgr2=0x7fcb200a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:23.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:23.660+0000 7fcb3a1fc640 1 --2- 172.21.15.7:0/1140016360 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fcb200a3460 0x7fcb200a5920 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000bc30 tx=0x7fcb30008040 comp rx=0 tx=0).stop 2024-09-19T04:23:23.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:23.660+0000 7fcb3a1fc640 1 -- 172.21.15.7:0/1140016360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb34072d80 msgr2=0x7fcb341a6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:23.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:23.660+0000 7fcb3a1fc640 1 --2- 172.21.15.7:0/1140016360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb34072d80 0x7fcb341a6bb0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fcb2400da90 tx=0x7fcb2400df50 comp rx=0 tx=0).stop 2024-09-19T04:23:23.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:23.661+0000 7fcb3a1fc640 1 -- 172.21.15.7:0/1140016360 shutdown_connections 2024-09-19T04:23:23.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:23.661+0000 7fcb3a1fc640 1 --2- 172.21.15.7:0/1140016360 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fcb200a3460 0x7fcb200a5920 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:23.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:23.661+0000 7fcb3a1fc640 1 --2- 172.21.15.7:0/1140016360 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb3410de90 0x7fcb341ae160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:23.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:23.661+0000 7fcb3a1fc640 1 --2- 172.21.15.7:0/1140016360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcb3410b4e0 0x7fcb341a70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:23.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:23.661+0000 7fcb3a1fc640 1 --2- 172.21.15.7:0/1140016360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb34072d80 0x7fcb341a6bb0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:23.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:23.661+0000 7fcb3a1fc640 1 -- 172.21.15.7:0/1140016360 >> 172.21.15.7:0/1140016360 conn(0x7fcb3406eb10 msgr2=0x7fcb3410f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:23:23.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:23.661+0000 7fcb3a1fc640 1 -- 172.21.15.7:0/1140016360 shutdown_connections 2024-09-19T04:23:23.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:23.661+0000 7fcb3a1fc640 1 -- 172.21.15.7:0/1140016360 wait complete. 2024-09-19T04:23:25.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:25 smithi007 ceph-mon[31360]: pgmap v549: 129 pgs: 129 active+clean; 488 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 6.5 MiB/s wr, 1.83k op/s 2024-09-19T04:23:25.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:25 smithi007 ceph-mon[31360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:23:25.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:25 smithi102 ceph-mon[35446]: pgmap v549: 129 pgs: 129 active+clean; 488 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 6.5 MiB/s wr, 1.83k op/s 2024-09-19T04:23:25.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:25 smithi102 ceph-mon[35446]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:23:25.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:25 smithi092 ceph-mon[34940]: pgmap v549: 129 pgs: 129 active+clean; 488 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 6.5 MiB/s wr, 1.83k op/s 2024-09-19T04:23:25.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:25 smithi092 ceph-mon[34940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:23:27.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:27 smithi007 ceph-mon[31360]: pgmap v550: 129 pgs: 129 active+clean; 486 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 7.8 MiB/s wr, 1.94k op/s 2024-09-19T04:23:27.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:27 smithi102 ceph-mon[35446]: pgmap v550: 129 pgs: 129 active+clean; 486 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 7.8 MiB/s wr, 1.94k op/s 2024-09-19T04:23:27.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:27 smithi092 ceph-mon[34940]: pgmap v550: 129 pgs: 129 active+clean; 486 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 7.8 MiB/s wr, 1.94k op/s 2024-09-19T04:23:28.166 INFO:tasks.workunit.client.0.smithi007.stdout: 150 1288020 425 956450 330 793922 997 2024-09-19T04:23:29.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:29 smithi007 ceph-mon[31360]: pgmap v551: 129 pgs: 129 active+clean; 482 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 7.7 MiB/s wr, 2.02k op/s 2024-09-19T04:23:29.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:29 smithi102 ceph-mon[35446]: pgmap v551: 129 pgs: 129 active+clean; 482 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 7.7 MiB/s wr, 2.02k op/s 2024-09-19T04:23:29.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:29 smithi092 ceph-mon[34940]: pgmap v551: 129 pgs: 129 active+clean; 482 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 7.7 MiB/s wr, 2.02k op/s 2024-09-19T04:23:31.349 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:31 smithi092 ceph-mon[34940]: pgmap v552: 129 pgs: 129 active+clean; 470 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8.0 MiB/s wr, 2.08k op/s 2024-09-19T04:23:31.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:31 smithi007 ceph-mon[31360]: pgmap v552: 129 pgs: 129 active+clean; 470 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8.0 MiB/s wr, 2.08k op/s 2024-09-19T04:23:31.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:31 smithi102 ceph-mon[35446]: pgmap v552: 129 pgs: 129 active+clean; 470 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8.0 MiB/s wr, 2.08k op/s 2024-09-19T04:23:33.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:33 smithi007 ceph-mon[31360]: pgmap v553: 129 pgs: 129 active+clean; 469 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.6 MiB/s wr, 1.20k op/s 2024-09-19T04:23:33.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:33 smithi102 ceph-mon[35446]: pgmap v553: 129 pgs: 129 active+clean; 469 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.6 MiB/s wr, 1.20k op/s 2024-09-19T04:23:33.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:33 smithi092 ceph-mon[34940]: pgmap v553: 129 pgs: 129 active+clean; 469 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.6 MiB/s wr, 1.20k op/s 2024-09-19T04:23:35.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:35 smithi007 ceph-mon[31360]: pgmap v554: 129 pgs: 129 active+clean; 475 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.8 MiB/s wr, 734 op/s 2024-09-19T04:23:35.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:35 smithi102 ceph-mon[35446]: pgmap v554: 129 pgs: 129 active+clean; 475 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.8 MiB/s wr, 734 op/s 2024-09-19T04:23:35.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:35 smithi092 ceph-mon[34940]: pgmap v554: 129 pgs: 129 active+clean; 475 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.8 MiB/s wr, 734 op/s 2024-09-19T04:23:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.935+0000 7f11a5844640 1 -- 172.21.15.7:0/1158945139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1198096120 msgr2=0x7f119809c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.935+0000 7f11a5844640 1 --2- 172.21.15.7:0/1158945139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1198096120 0x7f119809c9b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f11a0050280 tx=0x7f11a0096b60 comp rx=0 tx=0).stop 2024-09-19T04:23:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.936+0000 7f11a5844640 1 -- 172.21.15.7:0/1158945139 shutdown_connections 2024-09-19T04:23:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.936+0000 7f11a5844640 1 --2- 172.21.15.7:0/1158945139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1198096120 0x7f119809c9b0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.936+0000 7f11a5844640 1 --2- 172.21.15.7:0/1158945139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1198095760 0x7f1198095be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.936+0000 7f11a5844640 1 --2- 172.21.15.7:0/1158945139 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1198094570 0x7f1198094970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.936+0000 7f11a5844640 1 -- 172.21.15.7:0/1158945139 >> 172.21.15.7:0/1158945139 conn(0x7f119808fcb0 msgr2=0x7f1198092110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:23:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.939+0000 7f11a5844640 1 -- 172.21.15.7:0/1158945139 shutdown_connections 2024-09-19T04:23:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.940+0000 7f11a5844640 1 -- 172.21.15.7:0/1158945139 wait complete. 2024-09-19T04:23:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.941+0000 7f11a5844640 1 Processor -- start 2024-09-19T04:23:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.941+0000 7f11a5844640 1 -- start start 2024-09-19T04:23:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.942+0000 7f11a5844640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1198094570 0x7f119809ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.942+0000 7f11a5844640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1198095760 0x7f119809bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.942+0000 7f11a5844640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1198096120 0x7f11981394f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.942+0000 7f11a5844640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1198005000 con 0x7f1198096120 2024-09-19T04:23:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.942+0000 7f11a5844640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1198004e80 con 0x7f1198095760 2024-09-19T04:23:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.942+0000 7f11a5844640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1198005180 con 0x7f1198094570 2024-09-19T04:23:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.942+0000 7f11a4842640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1198094570 0x7f119809ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.942+0000 7f11a4842640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1198094570 0x7f119809ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:53610/0 (socket says 172.21.15.7:53610) 2024-09-19T04:23:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.942+0000 7f11a4842640 1 -- 172.21.15.7:0/3016907975 learned_addr learned my addr 172.21.15.7:0/3016907975 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:23:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.943+0000 7f11a4842640 1 -- 172.21.15.7:0/3016907975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1198095760 msgr2=0x7f119809bf90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T04:23:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.943+0000 7f11a4842640 1 --2- 172.21.15.7:0/3016907975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1198095760 0x7f119809bf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.943+0000 7f11a4842640 1 -- 172.21.15.7:0/3016907975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1198096120 msgr2=0x7f11981394f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.943+0000 7f11a4842640 1 --2- 172.21.15.7:0/3016907975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1198096120 0x7f11981394f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.943+0000 7f11a4842640 1 -- 172.21.15.7:0/3016907975 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119812ad00 con 0x7f1198094570 2024-09-19T04:23:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.943+0000 7f11a4842640 1 --2- 172.21.15.7:0/3016907975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1198094570 0x7f119809ba50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f119400c970 tx=0x7f119400ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:23:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.944+0000 7f119dffb640 1 -- 172.21.15.7:0/3016907975 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1194004220 con 0x7f1198094570 2024-09-19T04:23:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.944+0000 7f11a5844640 1 -- 172.21.15.7:0/3016907975 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f119812aff0 con 0x7f1198094570 2024-09-19T04:23:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.944+0000 7f11a5844640 1 -- 172.21.15.7:0/3016907975 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f119812b540 con 0x7f1198094570 2024-09-19T04:23:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.944+0000 7f119dffb640 1 -- 172.21.15.7:0/3016907975 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11940043c0 con 0x7f1198094570 2024-09-19T04:23:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.944+0000 7f119dffb640 1 -- 172.21.15.7:0/3016907975 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1194004a20 con 0x7f1198094570 2024-09-19T04:23:36.950 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.948+0000 7f119dffb640 1 -- 172.21.15.7:0/3016907975 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f1194004bc0 con 0x7f1198094570 2024-09-19T04:23:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.950+0000 7f119dffb640 1 --2- 172.21.15.7:0/3016907975 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f11900a3450 0x7f11900a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:36.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.950+0000 7f119dffb640 1 -- 172.21.15.7:0/3016907975 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f11940d09e0 con 0x7f1198094570 2024-09-19T04:23:36.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.951+0000 7f119ffff640 1 --2- 172.21.15.7:0/3016907975 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f11900a3450 0x7f11900a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:36.955 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.954+0000 7f11a9839740 1 Processor -- start 2024-09-19T04:23:36.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.954+0000 7f11a9839740 1 -- start start 2024-09-19T04:23:36.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.955+0000 7f11a9839740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8b1a4fb70 0x55b8b1a4ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:36.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.955+0000 7f11a9839740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1a504b0 0x55b8b1a54f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:36.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.955+0000 7f11a9839740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b8b1a55540 0x55b8b1a57a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:36.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.955+0000 7f11a9839740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b8b19b32f0 con 0x55b8b1a55540 2024-09-19T04:23:36.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.955+0000 7f11a9839740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b8b195b270 con 0x55b8b1a4fb70 2024-09-19T04:23:36.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.958+0000 7f11a9839740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b8b19af2b0 con 0x55b8b1a504b0 2024-09-19T04:23:36.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.955+0000 7f11a4842640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8b1a4fb70 0x55b8b1a4ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:36.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.958+0000 7f11a4842640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8b1a4fb70 0x55b8b1a4ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:56286/0 (socket says 172.21.15.7:56286) 2024-09-19T04:23:36.960 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.958+0000 7f11a4842640 1 -- 172.21.15.7:0/2981708155 learned_addr learned my addr 172.21.15.7:0/2981708155 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:23:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.955+0000 7f11a5043640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b8b1a55540 0x55b8b1a57a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.959+0000 7f119ffff640 1 --2- 172.21.15.7:0/2981708155 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1a504b0 0x55b8b1a54f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.959+0000 7f11a4842640 1 -- 172.21.15.7:0/2981708155 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1a504b0 msgr2=0x55b8b1a54f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:23:36.961 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.959+0000 7f11a4842640 1 --2- 172.21.15.7:0/2981708155 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1a504b0 0x55b8b1a54f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.959+0000 7f11a4842640 1 -- 172.21.15.7:0/2981708155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b8b1a55540 msgr2=0x55b8b1a57a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:23:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.959+0000 7f11a4842640 1 --2- 172.21.15.7:0/2981708155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b8b1a55540 0x55b8b1a57a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.959+0000 7f11a4842640 1 -- 172.21.15.7:0/2981708155 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8b195a340 con 0x55b8b1a4fb70 2024-09-19T04:23:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.959+0000 7f119ffff640 1 --2- 172.21.15.7:0/3016907975 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f11900a3450 0x7f11900a5910 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1198133450 tx=0x7f118c009f80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:23:36.962 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.960+0000 7f11a4842640 1 --2- 172.21.15.7:0/2981708155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8b1a4fb70 0x55b8b1a4ff70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f11940995c0 tx=0x7f119409d2f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c68c21d919e37f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:23:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.960+0000 7f118affd640 1 -- 172.21.15.7:0/2981708155 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119401d030 con 0x55b8b1a4fb70 2024-09-19T04:23:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.960+0000 7f118affd640 1 -- 172.21.15.7:0/2981708155 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11940a0fa0 con 0x55b8b1a4fb70 2024-09-19T04:23:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.961+0000 7f118affd640 1 -- 172.21.15.7:0/2981708155 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1194004eb0 con 0x55b8b1a4fb70 2024-09-19T04:23:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.961+0000 7f11a9839740 1 -- 172.21.15.7:0/2981708155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8b1a4fb70 msgr2=0x55b8b1a4ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.961+0000 7f11a9839740 1 --2- 172.21.15.7:0/2981708155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8b1a4fb70 0x55b8b1a4ff70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f11940995c0 tx=0x7f119409d2f0 comp rx=0 tx=0).stop 2024-09-19T04:23:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.962+0000 7f11a9839740 1 -- 172.21.15.7:0/2981708155 shutdown_connections 2024-09-19T04:23:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.962+0000 7f11a9839740 1 --2- 172.21.15.7:0/2981708155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b8b1a55540 0x55b8b1a57a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.962+0000 7f11a9839740 1 --2- 172.21.15.7:0/2981708155 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1a504b0 0x55b8b1a54f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.962+0000 7f11a9839740 1 --2- 172.21.15.7:0/2981708155 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8b1a4fb70 0x55b8b1a4ff70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:36.963 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.962+0000 7f11a9839740 1 -- 172.21.15.7:0/2981708155 >> 172.21.15.7:0/2981708155 conn(0x55b8b1a4b1e0 msgr2=0x55b8b1a4b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:23:36.965 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.964+0000 7f11a9839740 1 -- 172.21.15.7:0/2981708155 shutdown_connections 2024-09-19T04:23:36.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.965+0000 7f11a9839740 1 -- 172.21.15.7:0/2981708155 wait complete. 2024-09-19T04:23:36.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.966+0000 7f11a9839740 1 -- start start 2024-09-19T04:23:36.968 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.966+0000 7f11a9839740 1 Processor -- start 2024-09-19T04:23:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.967+0000 7f11a9839740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b8b1a4fb70 0x55b8b1a6ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.967+0000 7f11a9839740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1a504b0 0x55b8b1a6b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.967+0000 7f11a9839740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8b1a55540 0x55b8b1a723c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.967+0000 7f11a9839740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b8b1a69570 con 0x55b8b1a4fb70 2024-09-19T04:23:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.967+0000 7f11a9839740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b8b193c290 con 0x55b8b1a55540 2024-09-19T04:23:36.970 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.967+0000 7f11a9839740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b8b1a696f0 con 0x55b8b1a504b0 2024-09-19T04:23:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.967+0000 7f11a9839740 10 client.0 _ll_register_callbacks cb 0x55b8b196d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:23:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.968+0000 7f11a5043640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8b1a55540 0x55b8b1a723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.968+0000 7f11a4842640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b8b1a4fb70 0x55b8b1a6ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.968+0000 7f11a4842640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b8b1a4fb70 0x55b8b1a6ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35186/0 (socket says 172.21.15.7:35186) 2024-09-19T04:23:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.968+0000 7f11a4842640 1 -- 172.21.15.7:0/2484539554 learned_addr learned my addr 172.21.15.7:0/2484539554 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:23:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.968+0000 7f11a5043640 1 -- 172.21.15.7:0/2484539554 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1a504b0 msgr2=0x55b8b1a6b380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T04:23:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.968+0000 7f11a5043640 1 --2- 172.21.15.7:0/2484539554 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1a504b0 0x55b8b1a6b380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.968+0000 7f11a5043640 1 -- 172.21.15.7:0/2484539554 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b8b1a4fb70 msgr2=0x55b8b1a6ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:23:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.969+0000 7f11a5043640 1 --2- 172.21.15.7:0/2484539554 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b8b1a4fb70 0x55b8b1a6ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:36.971 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.969+0000 7f11a5043640 1 -- 172.21.15.7:0/2484539554 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8b16c6210 con 0x55b8b1a55540 2024-09-19T04:23:36.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.969+0000 7f11a5043640 1 --2- 172.21.15.7:0/2484539554 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8b1a55540 0x55b8b1a723c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f11a002dd80 tx=0x7f11a0099d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fcef7315a555fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:23:36.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.969+0000 7f117ffff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T04:23:36.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.970+0000 7f117ffff640 1 -- 172.21.15.7:0/2484539554 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a00c8070 con 0x55b8b1a55540 2024-09-19T04:23:36.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.970+0000 7f117ffff640 1 -- 172.21.15.7:0/2484539554 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f11a00c4670 con 0x55b8b1a55540 2024-09-19T04:23:36.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.970+0000 7f11a9839740 1 -- 172.21.15.7:0/2484539554 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11940a0fa0 con 0x55b8b1a55540 2024-09-19T04:23:36.972 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.971+0000 7f117ffff640 1 -- 172.21.15.7:0/2484539554 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f11a00d2050 con 0x55b8b1a55540 2024-09-19T04:23:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.974+0000 7f11a9839740 10 client.25724 fetch_fsmap learned FSMap version 37 2024-09-19T04:23:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.974+0000 7f11a9839740 1 -- 172.21.15.7:0/2484539554 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55b8b1792620 con 0x55b8b1a55540 2024-09-19T04:23:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.976+0000 7f117ffff640 1 -- 172.21.15.7:0/2484539554 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11940a0fa0 con 0x55b8b1a55540 2024-09-19T04:23:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.976+0000 7f117ffff640 1 -- 172.21.15.7:0/2484539554 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 37) ==== 8374+0+0 (secure 0 0 0) 0x7f11a00cd8a0 con 0x55b8b1a55540 2024-09-19T04:23:36.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.976+0000 7f11a9839740 10 client.25724 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T04:23:36.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.976+0000 7f11a9839740 10 client.25724 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:23:36.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.976+0000 7f11a9839740 20 client.25724 populate_metadata read hostname 'smithi007' 2024-09-19T04:23:36.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.976+0000 7f11a9839740 1 --2- 172.21.15.7:0/2484539554 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55b8b1a76b20 0x55b8b1a78f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:36.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.976+0000 7f11a9839740 4 client.25724 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:23:36.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.976+0000 7f11a9839740 1 -- 172.21.15.7:0/2484539554 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8b19c0a20 con 0x55b8b1a76b20 2024-09-19T04:23:36.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.977+0000 7f11a4842640 1 --2- 172.21.15.7:0/2484539554 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55b8b1a76b20 0x55b8b1a78f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:36.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.979+0000 7f11a4842640 1 --2- 172.21.15.7:0/2484539554 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55b8b1a76b20 0x55b8b1a78f40 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=651a34d5a29e362a server_cookie=2662484fe36a4026 in_seq=0 out_seq=0 2024-09-19T04:23:36.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.979+0000 7f117ffff640 10 client.25724 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:23:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.982+0000 7f117ffff640 1 -- 172.21.15.7:0/2484539554 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b8b19c0a20 con 0x55b8b1a76b20 2024-09-19T04:23:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.982+0000 7f117ffff640 10 client.25724 handle_command_reply: tid=0 2024-09-19T04:23:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.982+0000 7f11a9839740 1 client.25724 shutdown 2024-09-19T04:23:36.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.988+0000 7f11a9839740 1 -- 172.21.15.7:0/2484539554 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8b1a55540 msgr2=0x55b8b1a723c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:36.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.989+0000 7f11a9839740 1 --2- 172.21.15.7:0/2484539554 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8b1a55540 0x55b8b1a723c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f11a002dd80 tx=0x7f11a0099d40 comp rx=0 tx=0).stop 2024-09-19T04:23:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.992+0000 7f11a9839740 1 -- 172.21.15.7:0/2484539554 shutdown_connections 2024-09-19T04:23:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.992+0000 7f11a9839740 1 --2- 172.21.15.7:0/2484539554 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55b8b1a76b20 0x55b8b1a78f40 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.992+0000 7f11a9839740 1 --2- 172.21.15.7:0/2484539554 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8b1a55540 0x55b8b1a723c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.992+0000 7f11a9839740 1 --2- 172.21.15.7:0/2484539554 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1a504b0 0x55b8b1a6b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.992+0000 7f11a9839740 1 --2- 172.21.15.7:0/2484539554 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b8b1a4fb70 0x55b8b1a6ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.992+0000 7f11a9839740 1 -- 172.21.15.7:0/2484539554 >> 172.21.15.7:0/2484539554 conn(0x55b8b1a4b1e0 msgr2=0x55b8b1a4c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:23:36.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.992+0000 7f117ffff640 0 client.25724 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:23:36.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.997+0000 7f11a9839740 1 -- 172.21.15.7:0/2484539554 shutdown_connections 2024-09-19T04:23:37.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:36.999+0000 7f11a9839740 1 -- 172.21.15.7:0/2484539554 wait complete. 2024-09-19T04:23:37.001 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.000+0000 7f11a9839740 20 client.25724 trim_cache size 0 max 16384 2024-09-19T04:23:37.038 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.036+0000 7f11a9839740 1 Processor -- start 2024-09-19T04:23:37.039 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.036+0000 7f11a9839740 1 -- start start 2024-09-19T04:23:37.039 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.036+0000 7f11a9839740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b8b1a4fb70 0x55b8b1a4b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:37.039 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.036+0000 7f11a9839740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1a504b0 0x55b8b1a72380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:37.039 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.037+0000 7f11a9839740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8b1a55540 0x55b8b1a4bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:37.039 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.037+0000 7f11a9839740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f118400fdc0 con 0x55b8b1a4fb70 2024-09-19T04:23:37.039 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.037+0000 7f11a9839740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1184011930 con 0x55b8b1a55540 2024-09-19T04:23:37.039 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.037+0000 7f11a9839740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1184010490 con 0x55b8b1a504b0 2024-09-19T04:23:37.039 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.037+0000 7f11a5043640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8b1a55540 0x55b8b1a4bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:37.039 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.037+0000 7f11a5043640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8b1a55540 0x55b8b1a4bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:56298/0 (socket says 172.21.15.7:56298) 2024-09-19T04:23:37.039 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.037+0000 7f11a5043640 1 -- 172.21.15.7:0/2499037751 learned_addr learned my addr 172.21.15.7:0/2499037751 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:23:37.039 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.037+0000 7f11a4842640 1 --2- 172.21.15.7:0/2499037751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b8b1a4fb70 0x55b8b1a4b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:37.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.037+0000 7f11a5043640 1 -- 172.21.15.7:0/2499037751 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1a504b0 msgr2=0x55b8b1a72380 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T04:23:37.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.037+0000 7f11a5043640 1 --2- 172.21.15.7:0/2499037751 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1a504b0 0x55b8b1a72380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:37.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.037+0000 7f11a5043640 1 -- 172.21.15.7:0/2499037751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b8b1a4fb70 msgr2=0x55b8b1a4b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:23:37.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.037+0000 7f11a5043640 1 --2- 172.21.15.7:0/2499037751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b8b1a4fb70 0x55b8b1a4b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:37.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.037+0000 7f11a5043640 1 -- 172.21.15.7:0/2499037751 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8b1a51140 con 0x55b8b1a55540 2024-09-19T04:23:37.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.038+0000 7f11a5043640 1 --2- 172.21.15.7:0/2499037751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8b1a55540 0x55b8b1a4bb00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f11a0068d00 tx=0x7f11a0099a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8117f84514fb62e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:23:37.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.038+0000 7f118a7fc640 1 -- 172.21.15.7:0/2499037751 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a00c8070 con 0x55b8b1a55540 2024-09-19T04:23:37.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.038+0000 7f118a7fc640 1 -- 172.21.15.7:0/2499037751 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11a0074240 con 0x55b8b1a55540 2024-09-19T04:23:37.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.038+0000 7f118a7fc640 1 -- 172.21.15.7:0/2499037751 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a009d070 con 0x55b8b1a55540 2024-09-19T04:23:37.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.039+0000 7f11a9839740 1 -- 172.21.15.7:0/2499037751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8b1a55540 msgr2=0x55b8b1a4bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:37.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.039+0000 7f11a9839740 1 --2- 172.21.15.7:0/2499037751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8b1a55540 0x55b8b1a4bb00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f11a0068d00 tx=0x7f11a0099a30 comp rx=0 tx=0).stop 2024-09-19T04:23:37.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.041+0000 7f11a9839740 1 -- 172.21.15.7:0/2499037751 shutdown_connections 2024-09-19T04:23:37.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.041+0000 7f11a9839740 1 --2- 172.21.15.7:0/2499037751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8b1a55540 0x55b8b1a4bb00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:37.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.041+0000 7f11a9839740 1 --2- 172.21.15.7:0/2499037751 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1a504b0 0x55b8b1a72380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:37.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.041+0000 7f11a9839740 1 --2- 172.21.15.7:0/2499037751 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b8b1a4fb70 0x55b8b1a4b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:37.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.041+0000 7f11a9839740 1 -- 172.21.15.7:0/2499037751 >> 172.21.15.7:0/2499037751 conn(0x55b8b1a4b1e0 msgr2=0x55b8b1a6ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:23:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.042+0000 7f11a9839740 1 -- 172.21.15.7:0/2499037751 shutdown_connections 2024-09-19T04:23:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.042+0000 7f11a9839740 1 -- 172.21.15.7:0/2499037751 wait complete. 2024-09-19T04:23:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.042+0000 7f11a9839740 1 -- start start 2024-09-19T04:23:37.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.043+0000 7f11a9839740 1 Processor -- start 2024-09-19T04:23:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.043+0000 7f11a9839740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1a4fb70 0x55b8b1a6f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.043+0000 7f11a9839740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8b1a504b0 0x55b8b1a6f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.044+0000 7f11a9839740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b8b1a55540 0x55b8b1a70900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.044+0000 7f11a9839740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1184011230 con 0x55b8b1a55540 2024-09-19T04:23:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.044+0000 7f11a9839740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1184010b60 con 0x55b8b1a504b0 2024-09-19T04:23:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.044+0000 7f11a4842640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1a4fb70 0x55b8b1a6f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.044+0000 7f11a5043640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b8b1a55540 0x55b8b1a70900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:37.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.044+0000 7f11a9839740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f118400dd80 con 0x55b8b1a4fb70 2024-09-19T04:23:37.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.044+0000 7f11a4842640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1a4fb70 0x55b8b1a6f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:53644/0 (socket says 172.21.15.7:53644) 2024-09-19T04:23:37.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.044+0000 7f11a4842640 1 -- 172.21.15.7:0/952262350 learned_addr learned my addr 172.21.15.7:0/952262350 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:23:37.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.044+0000 7f11a9839740 10 client.0 _ll_register_callbacks cb 0x7f11a0050f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:23:37.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.044+0000 7f119ffff640 1 --2- 172.21.15.7:0/952262350 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8b1a504b0 0x55b8b1a6f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:37.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.046+0000 7f119ffff640 1 -- 172.21.15.7:0/952262350 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1a4fb70 msgr2=0x55b8b1a6f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:23:37.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.046+0000 7f119ffff640 1 --2- 172.21.15.7:0/952262350 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1a4fb70 0x55b8b1a6f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:37.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.046+0000 7f119ffff640 1 -- 172.21.15.7:0/952262350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b8b1a55540 msgr2=0x55b8b1a70900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:23:37.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.046+0000 7f119ffff640 1 --2- 172.21.15.7:0/952262350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b8b1a55540 0x55b8b1a70900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:37.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.046+0000 7f119ffff640 1 -- 172.21.15.7:0/952262350 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8b1a70f10 con 0x55b8b1a504b0 2024-09-19T04:23:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.047+0000 7f119ffff640 1 --2- 172.21.15.7:0/952262350 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8b1a504b0 0x55b8b1a6f8f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x55b8b1a50ee0 tx=0x7f118c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7aee55adfebe94a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:23:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.048+0000 7f117ffff640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T04:23:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.048+0000 7f117ffff640 1 -- 172.21.15.7:0/952262350 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118c022070 con 0x55b8b1a504b0 2024-09-19T04:23:37.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.048+0000 7f117ffff640 1 -- 172.21.15.7:0/952262350 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f118c005020 con 0x55b8b1a504b0 2024-09-19T04:23:37.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.049+0000 7f11a9839740 1 -- 172.21.15.7:0/952262350 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11a0074240 con 0x55b8b1a504b0 2024-09-19T04:23:37.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.053+0000 7f117ffff640 1 -- 172.21.15.7:0/952262350 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f118c005220 con 0x55b8b1a504b0 2024-09-19T04:23:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.053+0000 7f11a9839740 10 client.25730 fetch_fsmap learned FSMap version 37 2024-09-19T04:23:37.058 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.053+0000 7f11a9839740 1 -- 172.21.15.7:0/952262350 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55b8b1a722f0 con 0x55b8b1a504b0 2024-09-19T04:23:37.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.059+0000 7f117ffff640 1 -- 172.21.15.7:0/952262350 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11a0074240 con 0x55b8b1a504b0 2024-09-19T04:23:37.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.060+0000 7f117ffff640 1 -- 172.21.15.7:0/952262350 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 37) ==== 8374+0+0 (secure 0 0 0) 0x7f118c02e020 con 0x55b8b1a504b0 2024-09-19T04:23:37.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.061+0000 7f11a9839740 10 client.25730 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T04:23:37.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.061+0000 7f11a9839740 10 client.25730 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:23:37.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.061+0000 7f11a9839740 20 client.25730 populate_metadata read hostname 'smithi007' 2024-09-19T04:23:37.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.061+0000 7f11a9839740 1 --2- 172.21.15.7:0/952262350 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55b8b1ae1cb0 0x55b8b1ae40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:37.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.061+0000 7f11a9839740 4 client.25730 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:23:37.062 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.061+0000 7f11a9839740 1 -- 172.21.15.7:0/952262350 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b8b19bad70 con 0x55b8b1ae1cb0 2024-09-19T04:23:37.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.062+0000 7f11a4842640 1 --2- 172.21.15.7:0/952262350 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55b8b1ae1cb0 0x55b8b1ae40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:37.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.066+0000 7f11a4842640 1 --2- 172.21.15.7:0/952262350 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55b8b1ae1cb0 0x55b8b1ae40d0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43452d1c5815a9b1 server_cookie=d071accaec4b39fb in_seq=0 out_seq=0 2024-09-19T04:23:37.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:37.066+0000 7f117ffff640 10 client.25730 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:23:37.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:37 smithi007 ceph-mon[31360]: pgmap v555: 129 pgs: 129 active+clean; 477 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.9 MiB/s wr, 518 op/s 2024-09-19T04:23:37.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:37 smithi102 ceph-mon[35446]: pgmap v555: 129 pgs: 129 active+clean; 477 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.9 MiB/s wr, 518 op/s 2024-09-19T04:23:37.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:37 smithi092 ceph-mon[34940]: pgmap v555: 129 pgs: 129 active+clean; 477 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.9 MiB/s wr, 518 op/s 2024-09-19T04:23:38.166 INFO:tasks.workunit.client.0.smithi007.stdout: 156 1473586 434 1106780 393 919620 1122 2024-09-19T04:23:39.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:39 smithi102 ceph-mon[35446]: pgmap v556: 129 pgs: 129 active+clean; 481 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 441 op/s 2024-09-19T04:23:39.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:39 smithi092 ceph-mon[34940]: pgmap v556: 129 pgs: 129 active+clean; 481 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 441 op/s 2024-09-19T04:23:39.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:39 smithi007 ceph-mon[31360]: pgmap v556: 129 pgs: 129 active+clean; 481 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 441 op/s 2024-09-19T04:23:41.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:41 smithi102 ceph-mon[35446]: pgmap v557: 129 pgs: 129 active+clean; 511 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.0 MiB/s wr, 512 op/s 2024-09-19T04:23:41.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:41 smithi092 ceph-mon[34940]: pgmap v557: 129 pgs: 129 active+clean; 511 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.0 MiB/s wr, 512 op/s 2024-09-19T04:23:41.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:41 smithi007 ceph-mon[31360]: pgmap v557: 129 pgs: 129 active+clean; 511 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.0 MiB/s wr, 512 op/s 2024-09-19T04:23:43.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:43 smithi092 ceph-mon[34940]: pgmap v558: 129 pgs: 129 active+clean; 527 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.7 MiB/s wr, 508 op/s 2024-09-19T04:23:43.629 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:43 smithi007 ceph-mon[31360]: pgmap v558: 129 pgs: 129 active+clean; 527 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.7 MiB/s wr, 508 op/s 2024-09-19T04:23:43.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:43 smithi102 ceph-mon[35446]: pgmap v558: 129 pgs: 129 active+clean; 527 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.7 MiB/s wr, 508 op/s 2024-09-19T04:23:45.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:45 smithi092 ceph-mon[34940]: pgmap v559: 129 pgs: 129 active+clean; 538 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.8 MiB/s wr, 1.04k op/s 2024-09-19T04:23:45.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:45 smithi007 ceph-mon[31360]: pgmap v559: 129 pgs: 129 active+clean; 538 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.8 MiB/s wr, 1.04k op/s 2024-09-19T04:23:45.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:45 smithi102 ceph-mon[35446]: pgmap v559: 129 pgs: 129 active+clean; 538 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.8 MiB/s wr, 1.04k op/s 2024-09-19T04:23:47.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:47 smithi092 ceph-mon[34940]: pgmap v560: 129 pgs: 129 active+clean; 538 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.3 MiB/s wr, 1.36k op/s 2024-09-19T04:23:47.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:47 smithi007 ceph-mon[31360]: pgmap v560: 129 pgs: 129 active+clean; 538 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.3 MiB/s wr, 1.36k op/s 2024-09-19T04:23:47.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:47 smithi102 ceph-mon[35446]: pgmap v560: 129 pgs: 129 active+clean; 538 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.3 MiB/s wr, 1.36k op/s 2024-09-19T04:23:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:47.756+0000 7f117ffff640 1 -- 172.21.15.7:0/952262350 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b8b19bad70 con 0x55b8b1ae1cb0 2024-09-19T04:23:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:47.756+0000 7f117ffff640 10 client.25730 handle_command_reply: tid=0 2024-09-19T04:23:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:47.768+0000 7f11a9839740 1 client.25730 shutdown 2024-09-19T04:23:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:47.768+0000 7f11a9839740 1 -- 172.21.15.7:0/952262350 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8b1a504b0 msgr2=0x55b8b1a6f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:47.768+0000 7f11a9839740 1 --2- 172.21.15.7:0/952262350 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8b1a504b0 0x55b8b1a6f8f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x55b8b1a50ee0 tx=0x7f118c0046c0 comp rx=0 tx=0).stop 2024-09-19T04:23:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:47.768+0000 7f11a9839740 1 -- 172.21.15.7:0/952262350 shutdown_connections 2024-09-19T04:23:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:47.768+0000 7f11a9839740 1 --2- 172.21.15.7:0/952262350 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55b8b1ae1cb0 0x55b8b1ae40d0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:47.768+0000 7f11a9839740 1 --2- 172.21.15.7:0/952262350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b8b1a55540 0x55b8b1a70900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:47.768+0000 7f11a9839740 1 --2- 172.21.15.7:0/952262350 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b8b1a504b0 0x55b8b1a6f8f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:47.768+0000 7f11a9839740 1 --2- 172.21.15.7:0/952262350 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1a4fb70 0x55b8b1a6f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:47.768+0000 7f11a9839740 1 -- 172.21.15.7:0/952262350 >> 172.21.15.7:0/952262350 conn(0x55b8b1a4b1e0 msgr2=0x55b8b1a49a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:23:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:47.768+0000 7f117ffff640 0 client.25730 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:23:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:47.768+0000 7f11a9839740 1 -- 172.21.15.7:0/952262350 shutdown_connections 2024-09-19T04:23:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:47.769+0000 7f11a9839740 1 -- 172.21.15.7:0/952262350 wait complete. 2024-09-19T04:23:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:47.769+0000 7f11a9839740 20 client.25730 trim_cache size 0 max 16384 2024-09-19T04:23:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:23:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:23:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:23:47.772 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:23:47.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:47.851+0000 7f11a5844640 1 -- 172.21.15.7:0/3016907975 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f11900a3450 msgr2=0x7f11900a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:47.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:47.851+0000 7f11a5844640 1 --2- 172.21.15.7:0/3016907975 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f11900a3450 0x7f11900a5910 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1198133450 tx=0x7f118c009f80 comp rx=0 tx=0).stop 2024-09-19T04:23:47.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:47.851+0000 7f11a5844640 1 -- 172.21.15.7:0/3016907975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1198094570 msgr2=0x7f119809ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:47.853 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:47.851+0000 7f11a5844640 1 --2- 172.21.15.7:0/3016907975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1198094570 0x7f119809ba50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f119400c970 tx=0x7f119400ce30 comp rx=0 tx=0).stop 2024-09-19T04:23:47.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:47.851+0000 7f11a5844640 1 -- 172.21.15.7:0/3016907975 shutdown_connections 2024-09-19T04:23:47.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:47.851+0000 7f11a5844640 1 --2- 172.21.15.7:0/3016907975 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f11900a3450 0x7f11900a5910 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:47.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:47.851+0000 7f11a5844640 1 --2- 172.21.15.7:0/3016907975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1198096120 0x7f11981394f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:47.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:47.851+0000 7f11a5844640 1 --2- 172.21.15.7:0/3016907975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1198095760 0x7f119809bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:47.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:47.851+0000 7f11a5844640 1 --2- 172.21.15.7:0/3016907975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1198094570 0x7f119809ba50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:47.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:47.851+0000 7f11a5844640 1 -- 172.21.15.7:0/3016907975 >> 172.21.15.7:0/3016907975 conn(0x7f119808fcb0 msgr2=0x7f1198090830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:23:47.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:47.852+0000 7f11a5844640 1 -- 172.21.15.7:0/3016907975 shutdown_connections 2024-09-19T04:23:47.854 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:23:47.852+0000 7f11a5844640 1 -- 172.21.15.7:0/3016907975 wait complete. 2024-09-19T04:23:48.166 INFO:tasks.workunit.client.0.smithi007.stdout: 163 1504761 438 1128942 458 954079 1356 2024-09-19T04:23:48.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:48 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:23:48.628 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:48 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:23:48.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:48 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:23:49.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:49 smithi092 ceph-mon[34940]: pgmap v561: 129 pgs: 129 active+clean; 538 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.9 MiB/s wr, 1.37k op/s 2024-09-19T04:23:49.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:49 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:49.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:49 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:49.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:49 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:49.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:49 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:49.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:49 smithi092 ceph-mon[34940]: Adjusting osd_memory_target on smithi102 to 176.0M 2024-09-19T04:23:49.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:49 smithi092 ceph-mon[34940]: Unable to set osd_memory_target on smithi102 to 184589619: error parsing value: Value '184589619' is below minimum 939524096 2024-09-19T04:23:49.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:49 smithi007 ceph-mon[31360]: pgmap v561: 129 pgs: 129 active+clean; 538 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.9 MiB/s wr, 1.37k op/s 2024-09-19T04:23:49.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:49 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:49.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:49 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:49.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:49 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:49.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:49 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:49.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:49 smithi007 ceph-mon[31360]: Adjusting osd_memory_target on smithi102 to 176.0M 2024-09-19T04:23:49.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:49 smithi007 ceph-mon[31360]: Unable to set osd_memory_target on smithi102 to 184589619: error parsing value: Value '184589619' is below minimum 939524096 2024-09-19T04:23:49.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:49 smithi102 ceph-mon[35446]: pgmap v561: 129 pgs: 129 active+clean; 538 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.9 MiB/s wr, 1.37k op/s 2024-09-19T04:23:49.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:49 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:49.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:49 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:49.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:49 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:49.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:49 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:49.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:49 smithi102 ceph-mon[35446]: Adjusting osd_memory_target on smithi102 to 176.0M 2024-09-19T04:23:49.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:49 smithi102 ceph-mon[35446]: Unable to set osd_memory_target on smithi102 to 184589619: error parsing value: Value '184589619' is below minimum 939524096 2024-09-19T04:23:50.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:50 smithi092 ceph-mon[34940]: pgmap v562: 129 pgs: 129 active+clean; 521 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.2 MiB/s wr, 1.49k op/s 2024-09-19T04:23:50.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:50 smithi007 ceph-mon[31360]: pgmap v562: 129 pgs: 129 active+clean; 521 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.2 MiB/s wr, 1.49k op/s 2024-09-19T04:23:50.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:50 smithi102 ceph-mon[35446]: pgmap v562: 129 pgs: 129 active+clean; 521 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.2 MiB/s wr, 1.49k op/s 2024-09-19T04:23:52.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:52 smithi102 ceph-mon[35446]: pgmap v563: 129 pgs: 129 active+clean; 507 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.5 MiB/s wr, 1.37k op/s 2024-09-19T04:23:52.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:52 smithi092 ceph-mon[34940]: pgmap v563: 129 pgs: 129 active+clean; 507 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.5 MiB/s wr, 1.37k op/s 2024-09-19T04:23:52.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:52 smithi007 ceph-mon[31360]: pgmap v563: 129 pgs: 129 active+clean; 507 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.5 MiB/s wr, 1.37k op/s 2024-09-19T04:23:54.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:54 smithi102 ceph-mon[35446]: pgmap v564: 129 pgs: 129 active+clean; 507 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 1.39k op/s 2024-09-19T04:23:54.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:54 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:54.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:54 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:54.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:54 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:54.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:54 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:54.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:54 smithi102 ceph-mon[35446]: Adjusting osd_memory_target on smithi007 to 177.0M 2024-09-19T04:23:54.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:54 smithi102 ceph-mon[35446]: Unable to set osd_memory_target on smithi007 to 185687040: error parsing value: Value '185687040' is below minimum 939524096 2024-09-19T04:23:54.679 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:54 smithi007 ceph-mon[31360]: pgmap v564: 129 pgs: 129 active+clean; 507 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 1.39k op/s 2024-09-19T04:23:54.679 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:54 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:54.679 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:54 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:54.679 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:54 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:54.679 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:54 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:54.679 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:54 smithi007 ceph-mon[31360]: Adjusting osd_memory_target on smithi007 to 177.0M 2024-09-19T04:23:54.679 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:54 smithi007 ceph-mon[31360]: Unable to set osd_memory_target on smithi007 to 185687040: error parsing value: Value '185687040' is below minimum 939524096 2024-09-19T04:23:54.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:54 smithi092 ceph-mon[34940]: pgmap v564: 129 pgs: 129 active+clean; 507 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 1.39k op/s 2024-09-19T04:23:54.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:54 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:54.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:54 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:54.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:54 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:54.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:54 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:54.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:54 smithi092 ceph-mon[34940]: Adjusting osd_memory_target on smithi007 to 177.0M 2024-09-19T04:23:54.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:54 smithi092 ceph-mon[34940]: Unable to set osd_memory_target on smithi007 to 185687040: error parsing value: Value '185687040' is below minimum 939524096 2024-09-19T04:23:56.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:56 smithi092 ceph-mon[34940]: pgmap v565: 129 pgs: 129 active+clean; 508 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 873 op/s 2024-09-19T04:23:56.905 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:56 smithi007 ceph-mon[31360]: pgmap v565: 129 pgs: 129 active+clean; 508 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 873 op/s 2024-09-19T04:23:56.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:56 smithi102 ceph-mon[35446]: pgmap v565: 129 pgs: 129 active+clean; 508 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 873 op/s 2024-09-19T04:23:57.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:57 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:57.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:57 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:57.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:57 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:57.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:57 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:57.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:57 smithi092 ceph-mon[34940]: Adjusting osd_memory_target on smithi092 to 176.0M 2024-09-19T04:23:57.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:57 smithi092 ceph-mon[34940]: Unable to set osd_memory_target on smithi092 to 184588902: error parsing value: Value '184588902' is below minimum 939524096 2024-09-19T04:23:57.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:57 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:57.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:57 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:23:57.798 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:57 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:23:57.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:57 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:57.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:57 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:57.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:57 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:57.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:57 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:57.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:57 smithi007 ceph-mon[31360]: Adjusting osd_memory_target on smithi092 to 176.0M 2024-09-19T04:23:57.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:57 smithi007 ceph-mon[31360]: Unable to set osd_memory_target on smithi092 to 184588902: error parsing value: Value '184588902' is below minimum 939524096 2024-09-19T04:23:57.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:57 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:57.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:57 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:23:57.879 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:57 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:23:57.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:57 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:57.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:57 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:57.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:57 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:57.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:57 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:57.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:57 smithi102 ceph-mon[35446]: Adjusting osd_memory_target on smithi092 to 176.0M 2024-09-19T04:23:57.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:57 smithi102 ceph-mon[35446]: Unable to set osd_memory_target on smithi092 to 184588902: error parsing value: Value '184588902' is below minimum 939524096 2024-09-19T04:23:57.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:57 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:57.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:57 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:23:57.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:57 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:23:58.166 INFO:tasks.workunit.client.0.smithi007.stdout: 172 1561998 367 1178109 415 988354 1073 2024-09-19T04:23:59.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:23:59 smithi092 ceph-mon[34940]: pgmap v566: 129 pgs: 129 active+clean; 509 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 503 op/s 2024-09-19T04:23:59.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:23:59 smithi007 ceph-mon[31360]: pgmap v566: 129 pgs: 129 active+clean; 509 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 503 op/s 2024-09-19T04:23:59.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:23:59 smithi102 ceph-mon[35446]: pgmap v566: 129 pgs: 129 active+clean; 509 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 503 op/s 2024-09-19T04:23:59.677 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-19T04:23:59.677 INFO:tasks.workunit.client.0.smithi007.stdout:Final score for writes: 172 2024-09-19T04:23:59.677 INFO:tasks.workunit.client.0.smithi007.stdout:Final score for reads : 569740 2024-09-19T04:23:59.677 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-19T04:23:59.678 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T04:23:59.678 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T04:24:01.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.177+0000 7f8882766640 1 -- 172.21.15.7:0/2653196742 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f887c109380 msgr2=0x7f887c109800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:01.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.177+0000 7f8882766640 1 --2- 172.21.15.7:0/2653196742 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f887c109380 0x7f887c109800 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f8864009930 tx=0x7f886402a440 comp rx=0 tx=0).stop 2024-09-19T04:24:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.178+0000 7f8882766640 1 -- 172.21.15.7:0/2653196742 shutdown_connections 2024-09-19T04:24:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.178+0000 7f8882766640 1 --2- 172.21.15.7:0/2653196742 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f887c109d40 0x7f887c1105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.178+0000 7f8882766640 1 --2- 172.21.15.7:0/2653196742 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f887c109380 0x7f887c109800 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.178+0000 7f8882766640 1 --2- 172.21.15.7:0/2653196742 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f887c1084c0 0x7f887c1088c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.178+0000 7f8882766640 1 -- 172.21.15.7:0/2653196742 >> 172.21.15.7:0/2653196742 conn(0x7f887c077490 msgr2=0x7f887c0798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.178+0000 7f8882766640 1 -- 172.21.15.7:0/2653196742 shutdown_connections 2024-09-19T04:24:01.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.178+0000 7f8882766640 1 -- 172.21.15.7:0/2653196742 wait complete. 2024-09-19T04:24:01.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.178+0000 7f8882766640 1 Processor -- start 2024-09-19T04:24:01.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.179+0000 7f8882766640 1 -- start start 2024-09-19T04:24:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.179+0000 7f8882766640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f887c1084c0 0x7f887c19e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.179+0000 7f8882766640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f887c109380 0x7f887c19ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.179+0000 7f8882766640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f887c109d40 0x7f887c1a5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.179+0000 7f8882766640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f887c113fa0 con 0x7f887c109d40 2024-09-19T04:24:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.179+0000 7f8882766640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f887c113e20 con 0x7f887c109380 2024-09-19T04:24:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.179+0000 7f8882766640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f887c114120 con 0x7f887c1084c0 2024-09-19T04:24:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.179+0000 7f887bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f887c1084c0 0x7f887c19e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.179+0000 7f887bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f887c1084c0 0x7f887c19e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:38468/0 (socket says 172.21.15.7:38468) 2024-09-19T04:24:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.179+0000 7f887bfff640 1 -- 172.21.15.7:0/1089306649 learned_addr learned my addr 172.21.15.7:0/1089306649 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.179+0000 7f88737fe640 1 --2- 172.21.15.7:0/1089306649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f887c109380 0x7f887c19ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.179+0000 7f887bfff640 1 -- 172.21.15.7:0/1089306649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f887c109380 msgr2=0x7f887c19ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.179+0000 7f887bfff640 1 --2- 172.21.15.7:0/1089306649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f887c109380 0x7f887c19ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.179+0000 7f887bfff640 1 -- 172.21.15.7:0/1089306649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f887c109d40 msgr2=0x7f887c1a5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.179+0000 7f887bfff640 1 --2- 172.21.15.7:0/1089306649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f887c109d40 0x7f887c1a5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.180+0000 7f887bfff640 1 -- 172.21.15.7:0/1089306649 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f887c1a6300 con 0x7f887c1084c0 2024-09-19T04:24:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.180+0000 7f887bfff640 1 --2- 172.21.15.7:0/1089306649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f887c1084c0 0x7f887c19e6e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f886c00b450 tx=0x7f886c00b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.180+0000 7f8879ffb640 1 -- 172.21.15.7:0/1089306649 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886c015020 con 0x7f887c1084c0 2024-09-19T04:24:01.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.180+0000 7f8879ffb640 1 -- 172.21.15.7:0/1089306649 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f886c011d70 con 0x7f887c1084c0 2024-09-19T04:24:01.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.181+0000 7f8879ffb640 1 -- 172.21.15.7:0/1089306649 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886c00f340 con 0x7f887c1084c0 2024-09-19T04:24:01.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.181+0000 7f8882766640 1 -- 172.21.15.7:0/1089306649 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f887c1a65f0 con 0x7f887c1084c0 2024-09-19T04:24:01.184 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.181+0000 7f8882766640 1 -- 172.21.15.7:0/1089306649 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f887c1a6ae0 con 0x7f887c1084c0 2024-09-19T04:24:01.186 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.184+0000 7f8879ffb640 1 -- 172.21.15.7:0/1089306649 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f886c018020 con 0x7f887c1084c0 2024-09-19T04:24:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.185+0000 7f8879ffb640 1 --2- 172.21.15.7:0/1089306649 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f88680a3300 0x7f88680a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.185+0000 7f88855df740 1 Processor -- start 2024-09-19T04:24:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.185+0000 7f8879ffb640 1 -- 172.21.15.7:0/1089306649 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f886c0cf7d0 con 0x7f887c1084c0 2024-09-19T04:24:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.186+0000 7f88855df740 1 -- start start 2024-09-19T04:24:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.186+0000 7f88737fe640 1 --2- 172.21.15.7:0/1089306649 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f88680a3300 0x7f88680a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.186+0000 7f88855df740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d1981ac9a0 0x55d1981acda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.186+0000 7f88855df740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1981ad2e0 0x55d1981b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.186+0000 7f88855df740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1981b2370 0x55d1981b4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.186+0000 7f88855df740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d1981102f0 con 0x55d1981b2370 2024-09-19T04:24:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.186+0000 7f88855df740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d1980b8270 con 0x55d1981ac9a0 2024-09-19T04:24:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.186+0000 7f88855df740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d19810c2b0 con 0x55d1981ad2e0 2024-09-19T04:24:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.186+0000 7f8880d03640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1981b2370 0x55d1981b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.186+0000 7f8880d03640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1981b2370 0x55d1981b4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38804/0 (socket says 172.21.15.7:38804) 2024-09-19T04:24:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.186+0000 7f8880d03640 1 -- 172.21.15.7:0/2638047872 learned_addr learned my addr 172.21.15.7:0/2638047872 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.186+0000 7f887bfff640 1 --2- 172.21.15.7:0/2638047872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d1981ac9a0 0x55d1981acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.186+0000 7f88737fe640 1 --2- 172.21.15.7:0/2638047872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1981ad2e0 0x55d1981b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.187+0000 7f887bfff640 1 -- 172.21.15.7:0/2638047872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1981ad2e0 msgr2=0x55d1981b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.187+0000 7f887bfff640 1 --2- 172.21.15.7:0/2638047872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1981ad2e0 0x55d1981b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.187+0000 7f887bfff640 1 -- 172.21.15.7:0/2638047872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1981b2370 msgr2=0x55d1981b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:01.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.187+0000 7f887bfff640 1 --2- 172.21.15.7:0/2638047872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1981b2370 0x55d1981b4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:01.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.187+0000 7f887bfff640 1 -- 172.21.15.7:0/2638047872 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1980b7340 con 0x55d1981ac9a0 2024-09-19T04:24:01.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.187+0000 7f88737fe640 1 --2- 172.21.15.7:0/2638047872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1981ad2e0 0x55d1981b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:24:01.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.187+0000 7f887bfff640 1 --2- 172.21.15.7:0/2638047872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d1981ac9a0 0x55d1981acda0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f886c00be10 tx=0x7f886c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dec99d9491ee4116 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:01.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.187+0000 7f88737fe640 1 --2- 172.21.15.7:0/1089306649 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f88680a3300 0x7f88680a57c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8864009900 tx=0x7f8864000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:01.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.187+0000 7f88727fc640 1 -- 172.21.15.7:0/2638047872 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886c0b4070 con 0x55d1981ac9a0 2024-09-19T04:24:01.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.187+0000 7f88727fc640 1 -- 172.21.15.7:0/2638047872 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f886c09fdd0 con 0x55d1981ac9a0 2024-09-19T04:24:01.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.188+0000 7f88727fc640 1 -- 172.21.15.7:0/2638047872 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886c086200 con 0x55d1981ac9a0 2024-09-19T04:24:01.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.188+0000 7f88855df740 1 -- 172.21.15.7:0/2638047872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d1981ac9a0 msgr2=0x55d1981acda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:01.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.188+0000 7f88855df740 1 --2- 172.21.15.7:0/2638047872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d1981ac9a0 0x55d1981acda0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f886c00be10 tx=0x7f886c0046c0 comp rx=0 tx=0).stop 2024-09-19T04:24:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.191+0000 7f88855df740 1 -- 172.21.15.7:0/2638047872 shutdown_connections 2024-09-19T04:24:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.191+0000 7f88855df740 1 --2- 172.21.15.7:0/2638047872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1981b2370 0x55d1981b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.191+0000 7f88855df740 1 --2- 172.21.15.7:0/2638047872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1981ad2e0 0x55d1981b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.191+0000 7f88855df740 1 --2- 172.21.15.7:0/2638047872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d1981ac9a0 0x55d1981acda0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:01.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.191+0000 7f88855df740 1 -- 172.21.15.7:0/2638047872 >> 172.21.15.7:0/2638047872 conn(0x55d1981a8010 msgr2=0x55d1981a8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.191+0000 7f88855df740 1 -- 172.21.15.7:0/2638047872 shutdown_connections 2024-09-19T04:24:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.191+0000 7f88855df740 1 -- 172.21.15.7:0/2638047872 wait complete. 2024-09-19T04:24:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.192+0000 7f88855df740 1 -- start start 2024-09-19T04:24:01.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.192+0000 7f88855df740 1 Processor -- start 2024-09-19T04:24:01.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.193+0000 7f88855df740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d1981ac9a0 0x55d1981b6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.193+0000 7f88855df740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1981ad2e0 0x55d1981b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.193+0000 7f887bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d1981ac9a0 0x55d1981b6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.193+0000 7f887bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d1981ac9a0 0x55d1981b6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:45454/0 (socket says 172.21.15.7:45454) 2024-09-19T04:24:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.193+0000 7f887bfff640 1 -- 172.21.15.7:0/1669177053 learned_addr learned my addr 172.21.15.7:0/1669177053 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.193+0000 7f88855df740 1 --2- 172.21.15.7:0/1669177053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1981b2370 0x55d1981be170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.193+0000 7f88737fe640 1 --2- 172.21.15.7:0/1669177053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1981ad2e0 0x55d1981b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.194+0000 7f88855df740 1 -- 172.21.15.7:0/1669177053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d1981b5390 con 0x55d1981ad2e0 2024-09-19T04:24:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.194+0000 7f88855df740 1 -- 172.21.15.7:0/1669177053 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d198099290 con 0x55d1981ac9a0 2024-09-19T04:24:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.194+0000 7f88855df740 1 -- 172.21.15.7:0/1669177053 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d1981b5510 con 0x55d1981b2370 2024-09-19T04:24:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.194+0000 7f8880d03640 1 --2- 172.21.15.7:0/1669177053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1981b2370 0x55d1981be170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.194+0000 7f88855df740 10 client.0 _ll_register_callbacks cb 0x55d1980ca140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:24:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.194+0000 7f8880d03640 1 -- 172.21.15.7:0/1669177053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d1981ac9a0 msgr2=0x55d1981b6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.194+0000 7f8880d03640 1 --2- 172.21.15.7:0/1669177053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d1981ac9a0 0x55d1981b6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:01.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.194+0000 7f8880d03640 1 -- 172.21.15.7:0/1669177053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1981ad2e0 msgr2=0x55d1981b71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:01.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.194+0000 7f8880d03640 1 --2- 172.21.15.7:0/1669177053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1981ad2e0 0x55d1981b71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:01.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.194+0000 7f8880d03640 1 -- 172.21.15.7:0/1669177053 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d197e23210 con 0x55d1981b2370 2024-09-19T04:24:01.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.196+0000 7f887bfff640 1 --2- 172.21.15.7:0/1669177053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d1981ac9a0 0x55d1981b6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:24:01.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.196+0000 7f88737fe640 1 --2- 172.21.15.7:0/1669177053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1981ad2e0 0x55d1981b71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:24:01.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.197+0000 7f8880d03640 1 --2- 172.21.15.7:0/1669177053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1981b2370 0x55d1981be170 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f887400e640 tx=0x7f887400eb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bd31975910f297e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:01.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.197+0000 7f885b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-19T04:24:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.197+0000 7f885b7fe640 1 -- 172.21.15.7:0/1669177053 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8874018020 con 0x55d1981b2370 2024-09-19T04:24:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.197+0000 7f885b7fe640 1 -- 172.21.15.7:0/1669177053 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f8874014810 con 0x55d1981b2370 2024-09-19T04:24:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.197+0000 7f88855df740 1 -- 172.21.15.7:0/1669177053 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f886c09fdd0 con 0x55d1981b2370 2024-09-19T04:24:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.197+0000 7f885b7fe640 1 -- 172.21.15.7:0/1669177053 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f8874023050 con 0x55d1981b2370 2024-09-19T04:24:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.197+0000 7f88855df740 10 client.25798 fetch_fsmap learned FSMap version 37 2024-09-19T04:24:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.197+0000 7f88855df740 1 -- 172.21.15.7:0/1669177053 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55d197eef620 con 0x55d1981b2370 2024-09-19T04:24:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.198+0000 7f885b7fe640 1 -- 172.21.15.7:0/1669177053 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f887401c3a0 con 0x55d1981b2370 2024-09-19T04:24:01.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.198+0000 7f885b7fe640 1 -- 172.21.15.7:0/1669177053 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 37) ==== 8374+0+0 (secure 0 0 0) 0x7f887401f4c0 con 0x55d1981b2370 2024-09-19T04:24:01.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.198+0000 7f88855df740 10 client.25798 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T04:24:01.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.198+0000 7f88855df740 10 client.25798 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:24:01.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.198+0000 7f88855df740 20 client.25798 populate_metadata read hostname 'smithi007' 2024-09-19T04:24:01.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.198+0000 7f88855df740 1 --2- 172.21.15.7:0/1669177053 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d1981c2880 0x55d1981c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:01.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.198+0000 7f88855df740 4 client.25798 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:24:01.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.198+0000 7f88855df740 1 -- 172.21.15.7:0/1669177053 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f886c09fdd0 con 0x55d1981c2880 2024-09-19T04:24:01.201 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.199+0000 7f887bfff640 1 --2- 172.21.15.7:0/1669177053 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d1981c2880 0x55d1981c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:01.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.199+0000 7f887bfff640 1 --2- 172.21.15.7:0/1669177053 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d1981c2880 0x55d1981c4ca0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a036f6d1f0333e96 server_cookie=76a799e910367a4e in_seq=0 out_seq=0 2024-09-19T04:24:01.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.199+0000 7f885b7fe640 10 client.25798 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:24:01.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.200+0000 7f885b7fe640 1 -- 172.21.15.7:0/1669177053 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f886c09fdd0 con 0x55d1981c2880 2024-09-19T04:24:01.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.200+0000 7f885b7fe640 10 client.25798 handle_command_reply: tid=0 2024-09-19T04:24:01.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.200+0000 7f88855df740 1 client.25798 shutdown 2024-09-19T04:24:01.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.200+0000 7f88855df740 1 -- 172.21.15.7:0/1669177053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1981b2370 msgr2=0x55d1981be170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:01.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.200+0000 7f88855df740 1 --2- 172.21.15.7:0/1669177053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1981b2370 0x55d1981be170 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f887400e640 tx=0x7f887400eb00 comp rx=0 tx=0).stop 2024-09-19T04:24:01.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.201+0000 7f88855df740 1 -- 172.21.15.7:0/1669177053 shutdown_connections 2024-09-19T04:24:01.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.201+0000 7f88855df740 1 --2- 172.21.15.7:0/1669177053 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d1981c2880 0x55d1981c4ca0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:01.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.201+0000 7f885b7fe640 0 client.25798 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:24:01.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.201+0000 7f88855df740 1 --2- 172.21.15.7:0/1669177053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1981b2370 0x55d1981be170 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:01.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.201+0000 7f88855df740 1 --2- 172.21.15.7:0/1669177053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1981ad2e0 0x55d1981b71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:01.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.201+0000 7f88855df740 1 --2- 172.21.15.7:0/1669177053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d1981ac9a0 0x55d1981b6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:01.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.201+0000 7f88855df740 1 -- 172.21.15.7:0/1669177053 >> 172.21.15.7:0/1669177053 conn(0x55d1981a8010 msgr2=0x55d1981a9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:01.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.201+0000 7f88855df740 1 -- 172.21.15.7:0/1669177053 shutdown_connections 2024-09-19T04:24:01.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.201+0000 7f88855df740 1 -- 172.21.15.7:0/1669177053 wait complete. 2024-09-19T04:24:01.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.201+0000 7f88855df740 20 client.25798 trim_cache size 0 max 16384 2024-09-19T04:24:01.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.228+0000 7f88855df740 1 Processor -- start 2024-09-19T04:24:01.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.228+0000 7f88855df740 1 -- start start 2024-09-19T04:24:01.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.228+0000 7f88855df740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1981ac9a0 0x55d1981aad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:01.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.228+0000 7f88855df740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1981ad2e0 0x55d1981be130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:01.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.228+0000 7f88855df740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d1981b2370 0x55d1981ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:01.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.228+0000 7f88855df740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f887c1b1260 con 0x55d1981ad2e0 2024-09-19T04:24:01.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.228+0000 7f88855df740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f887c1b2dd0 con 0x55d1981b2370 2024-09-19T04:24:01.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.228+0000 7f88855df740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f887c1b1930 con 0x55d1981ac9a0 2024-09-19T04:24:01.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.228+0000 7f887bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1981ac9a0 0x55d1981aad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:01.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.228+0000 7f887bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1981ac9a0 0x55d1981aad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:38492/0 (socket says 172.21.15.7:38492) 2024-09-19T04:24:01.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.228+0000 7f887bfff640 1 -- 172.21.15.7:0/235690345 learned_addr learned my addr 172.21.15.7:0/235690345 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:01.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.229+0000 7f88737fe640 1 --2- 172.21.15.7:0/235690345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1981ad2e0 0x55d1981be130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:01.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.229+0000 7f887bfff640 1 -- 172.21.15.7:0/235690345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d1981b2370 msgr2=0x55d1981ab2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:01.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.229+0000 7f887bfff640 1 --2- 172.21.15.7:0/235690345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d1981b2370 0x55d1981ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:01.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.229+0000 7f887bfff640 1 -- 172.21.15.7:0/235690345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1981ad2e0 msgr2=0x55d1981be130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:01.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.229+0000 7f887bfff640 1 --2- 172.21.15.7:0/235690345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1981ad2e0 0x55d1981be130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:01.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.229+0000 7f887bfff640 1 -- 172.21.15.7:0/235690345 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1981a7e30 con 0x55d1981ac9a0 2024-09-19T04:24:01.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.229+0000 7f887bfff640 1 --2- 172.21.15.7:0/235690345 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1981ac9a0 0x55d1981aad60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f886c086010 tx=0x7f886c086040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff38402e8f1e7284 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:01.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.230+0000 7f8871ffb640 1 -- 172.21.15.7:0/235690345 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886c0b4040 con 0x55d1981ac9a0 2024-09-19T04:24:01.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.230+0000 7f8871ffb640 1 -- 172.21.15.7:0/235690345 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f886c09fdd0 con 0x55d1981ac9a0 2024-09-19T04:24:01.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.230+0000 7f8871ffb640 1 -- 172.21.15.7:0/235690345 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886c017db0 con 0x55d1981ac9a0 2024-09-19T04:24:01.233 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.231+0000 7f88855df740 1 -- 172.21.15.7:0/235690345 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1981ac9a0 msgr2=0x55d1981aad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:01.233 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.231+0000 7f88855df740 1 --2- 172.21.15.7:0/235690345 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1981ac9a0 0x55d1981aad60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f886c086010 tx=0x7f886c086040 comp rx=0 tx=0).stop 2024-09-19T04:24:01.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.232+0000 7f88855df740 1 -- 172.21.15.7:0/235690345 shutdown_connections 2024-09-19T04:24:01.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.232+0000 7f88855df740 1 --2- 172.21.15.7:0/235690345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d1981b2370 0x55d1981ab2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:01.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.232+0000 7f88855df740 1 --2- 172.21.15.7:0/235690345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1981ad2e0 0x55d1981be130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:01.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.232+0000 7f88855df740 1 --2- 172.21.15.7:0/235690345 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1981ac9a0 0x55d1981aad60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:01.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.232+0000 7f88855df740 1 -- 172.21.15.7:0/235690345 >> 172.21.15.7:0/235690345 conn(0x55d1981a8010 msgr2=0x55d1981b6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:01.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.233+0000 7f88855df740 1 -- 172.21.15.7:0/235690345 shutdown_connections 2024-09-19T04:24:01.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.233+0000 7f88855df740 1 -- 172.21.15.7:0/235690345 wait complete. 2024-09-19T04:24:01.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.234+0000 7f88855df740 1 -- start start 2024-09-19T04:24:01.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.234+0000 7f88855df740 1 Processor -- start 2024-09-19T04:24:01.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.234+0000 7f88855df740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d1981ac9a0 0x55d1981bbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:01.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.234+0000 7f88855df740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1981ad2e0 0x55d1981bc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:01.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.234+0000 7f88855df740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1981b2370 0x55d1981bcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:01.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.234+0000 7f88855df740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f887c1b26d0 con 0x55d1981b2370 2024-09-19T04:24:01.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.234+0000 7f88855df740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f887c1b2000 con 0x55d1981ac9a0 2024-09-19T04:24:01.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.234+0000 7f88855df740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f887c1af220 con 0x55d1981ad2e0 2024-09-19T04:24:01.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.235+0000 7f88855df740 10 client.0 _ll_register_callbacks cb 0x7f887400e2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:24:01.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.235+0000 7f88737fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1981ad2e0 0x55d1981bc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:01.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.235+0000 7f887bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d1981ac9a0 0x55d1981bbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:01.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.235+0000 7f887bfff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d1981ac9a0 0x55d1981bbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:45470/0 (socket says 172.21.15.7:45470) 2024-09-19T04:24:01.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.235+0000 7f887bfff640 1 -- 172.21.15.7:0/1107951920 learned_addr learned my addr 172.21.15.7:0/1107951920 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:01.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.235+0000 7f8880d03640 1 --2- 172.21.15.7:0/1107951920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1981b2370 0x55d1981bcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:01.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.235+0000 7f88737fe640 1 -- 172.21.15.7:0/1107951920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d1981ac9a0 msgr2=0x55d1981bbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:01.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.235+0000 7f88737fe640 1 --2- 172.21.15.7:0/1107951920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d1981ac9a0 0x55d1981bbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:01.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.235+0000 7f88737fe640 1 -- 172.21.15.7:0/1107951920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1981b2370 msgr2=0x55d1981bcfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:01.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.235+0000 7f88737fe640 1 --2- 172.21.15.7:0/1107951920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1981b2370 0x55d1981bcfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:01.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.235+0000 7f88737fe640 1 -- 172.21.15.7:0/1107951920 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1981bd5c0 con 0x55d1981ad2e0 2024-09-19T04:24:01.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.236+0000 7f88737fe640 1 --2- 172.21.15.7:0/1107951920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1981ad2e0 0x55d1981bc060 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8864009850 tx=0x7f886402a440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b30f8dacb8218fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:01.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.236+0000 7f885b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-19T04:24:01.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.237+0000 7f885b7fe640 1 -- 172.21.15.7:0/1107951920 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886404e070 con 0x55d1981ad2e0 2024-09-19T04:24:01.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.237+0000 7f885b7fe640 1 -- 172.21.15.7:0/1107951920 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f8864003c40 con 0x55d1981ad2e0 2024-09-19T04:24:01.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.238+0000 7f88855df740 1 -- 172.21.15.7:0/1107951920 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f886c09fdd0 con 0x55d1981ad2e0 2024-09-19T04:24:01.241 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.240+0000 7f885b7fe640 1 -- 172.21.15.7:0/1107951920 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f8864058050 con 0x55d1981ad2e0 2024-09-19T04:24:01.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.240+0000 7f88855df740 10 client.25804 fetch_fsmap learned FSMap version 37 2024-09-19T04:24:01.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.240+0000 7f88855df740 1 -- 172.21.15.7:0/1107951920 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55d19822d740 con 0x55d1981ad2e0 2024-09-19T04:24:01.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.240+0000 7f885b7fe640 1 -- 172.21.15.7:0/1107951920 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f886c09fdd0 con 0x55d1981ad2e0 2024-09-19T04:24:01.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.240+0000 7f885b7fe640 1 -- 172.21.15.7:0/1107951920 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 37) ==== 8374+0+0 (secure 0 0 0) 0x7f886403d570 con 0x55d1981ad2e0 2024-09-19T04:24:01.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.240+0000 7f88855df740 10 client.25804 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T04:24:01.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.240+0000 7f88855df740 10 client.25804 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:24:01.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.240+0000 7f88855df740 20 client.25804 populate_metadata read hostname 'smithi007' 2024-09-19T04:24:01.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.240+0000 7f88855df740 1 --2- 172.21.15.7:0/1107951920 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d19822e120 0x55d198230540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:01.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.240+0000 7f88855df740 4 client.25804 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:24:01.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.240+0000 7f88855df740 1 -- 172.21.15.7:0/1107951920 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d19811da20 con 0x55d19822e120 2024-09-19T04:24:01.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.241+0000 7f887bfff640 1 --2- 172.21.15.7:0/1107951920 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d19822e120 0x55d198230540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:01.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.242+0000 7f887bfff640 1 --2- 172.21.15.7:0/1107951920 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d19822e120 0x55d198230540 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78319db5a20d7c25 server_cookie=a07c29e46d5679b6 in_seq=0 out_seq=0 2024-09-19T04:24:01.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:01.242+0000 7f885b7fe640 10 client.25804 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:24:01.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:01 smithi092 ceph-mon[34940]: pgmap v567: 129 pgs: 129 active+clean; 549 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.2 MiB/s wr, 680 op/s 2024-09-19T04:24:01.298 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:01 smithi007 ceph-mon[31360]: pgmap v567: 129 pgs: 129 active+clean; 549 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.2 MiB/s wr, 680 op/s 2024-09-19T04:24:01.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:01 smithi102 ceph-mon[35446]: pgmap v567: 129 pgs: 129 active+clean; 549 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.2 MiB/s wr, 680 op/s 2024-09-19T04:24:03.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:03 smithi007 ceph-mon[31360]: pgmap v568: 129 pgs: 129 active+clean; 563 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.6 MiB/s wr, 563 op/s 2024-09-19T04:24:03.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:03 smithi102 ceph-mon[35446]: pgmap v568: 129 pgs: 129 active+clean; 563 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.6 MiB/s wr, 563 op/s 2024-09-19T04:24:03.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:03 smithi092 ceph-mon[34940]: pgmap v568: 129 pgs: 129 active+clean; 563 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.6 MiB/s wr, 563 op/s 2024-09-19T04:24:04.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:04.436+0000 7f885b7fe640 1 -- 172.21.15.7:0/1107951920 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d19811da20 con 0x55d19822e120 2024-09-19T04:24:04.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:04.436+0000 7f885b7fe640 10 client.25804 handle_command_reply: tid=0 2024-09-19T04:24:04.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:04.436+0000 7f88855df740 1 client.25804 shutdown 2024-09-19T04:24:04.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:04.436+0000 7f88855df740 1 -- 172.21.15.7:0/1107951920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1981ad2e0 msgr2=0x55d1981bc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:04.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:04.436+0000 7f88855df740 1 --2- 172.21.15.7:0/1107951920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1981ad2e0 0x55d1981bc060 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8864009850 tx=0x7f886402a440 comp rx=0 tx=0).stop 2024-09-19T04:24:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:04.436+0000 7f88855df740 1 -- 172.21.15.7:0/1107951920 shutdown_connections 2024-09-19T04:24:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:04.436+0000 7f88855df740 1 --2- 172.21.15.7:0/1107951920 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d19822e120 0x55d198230540 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:04.436+0000 7f88855df740 1 --2- 172.21.15.7:0/1107951920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1981b2370 0x55d1981bcfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:04.436+0000 7f88855df740 1 --2- 172.21.15.7:0/1107951920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d1981ad2e0 0x55d1981bc060 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:04.436+0000 7f885b7fe640 0 client.25804 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:24:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:04.436+0000 7f88855df740 1 --2- 172.21.15.7:0/1107951920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d1981ac9a0 0x55d1981bbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:04.436+0000 7f88855df740 1 -- 172.21.15.7:0/1107951920 >> 172.21.15.7:0/1107951920 conn(0x55d1981a8010 msgr2=0x55d1981a69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:04.436+0000 7f88855df740 1 -- 172.21.15.7:0/1107951920 shutdown_connections 2024-09-19T04:24:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:04.436+0000 7f88855df740 1 -- 172.21.15.7:0/1107951920 wait complete. 2024-09-19T04:24:04.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:04.436+0000 7f88855df740 20 client.25804 trim_cache size 0 max 16384 2024-09-19T04:24:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:24:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:24:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:24:04.440 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:24:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:04.437+0000 7f8882766640 1 -- 172.21.15.7:0/1089306649 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f88680a3300 msgr2=0x7f88680a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:04.437+0000 7f8882766640 1 --2- 172.21.15.7:0/1089306649 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f88680a3300 0x7f88680a57c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8864009900 tx=0x7f8864000bc0 comp rx=0 tx=0).stop 2024-09-19T04:24:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:04.437+0000 7f8882766640 1 -- 172.21.15.7:0/1089306649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f887c1084c0 msgr2=0x7f887c19e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:04.437+0000 7f8882766640 1 --2- 172.21.15.7:0/1089306649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f887c1084c0 0x7f887c19e6e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f886c00b450 tx=0x7f886c00b910 comp rx=0 tx=0).stop 2024-09-19T04:24:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:04.437+0000 7f8882766640 1 -- 172.21.15.7:0/1089306649 shutdown_connections 2024-09-19T04:24:04.441 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:04.437+0000 7f8882766640 1 --2- 172.21.15.7:0/1089306649 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f88680a3300 0x7f88680a57c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:04.437+0000 7f8882766640 1 --2- 172.21.15.7:0/1089306649 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f887c109d40 0x7f887c1a5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:04.437+0000 7f8882766640 1 --2- 172.21.15.7:0/1089306649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f887c109380 0x7f887c19ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:04.437+0000 7f8882766640 1 --2- 172.21.15.7:0/1089306649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f887c1084c0 0x7f887c19e6e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:04.437+0000 7f8882766640 1 -- 172.21.15.7:0/1089306649 >> 172.21.15.7:0/1089306649 conn(0x7f887c077490 msgr2=0x7f887c10c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:04.438+0000 7f8882766640 1 -- 172.21.15.7:0/1089306649 shutdown_connections 2024-09-19T04:24:04.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:04.438+0000 7f8882766640 1 -- 172.21.15.7:0/1089306649 wait complete. 2024-09-19T04:24:05.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:05 smithi007 ceph-mon[31360]: pgmap v569: 129 pgs: 129 active+clean; 569 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 6.4 MiB/s wr, 981 op/s 2024-09-19T04:24:05.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:05 smithi102 ceph-mon[35446]: pgmap v569: 129 pgs: 129 active+clean; 569 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 6.4 MiB/s wr, 981 op/s 2024-09-19T04:24:05.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:05 smithi092 ceph-mon[34940]: pgmap v569: 129 pgs: 129 active+clean; 569 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 6.4 MiB/s wr, 981 op/s 2024-09-19T04:24:07.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:07 smithi007 ceph-mon[31360]: pgmap v570: 129 pgs: 129 active+clean; 570 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.0 MiB/s wr, 1.48k op/s 2024-09-19T04:24:07.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:07 smithi102 ceph-mon[35446]: pgmap v570: 129 pgs: 129 active+clean; 570 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.0 MiB/s wr, 1.48k op/s 2024-09-19T04:24:07.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:07 smithi092 ceph-mon[34940]: pgmap v570: 129 pgs: 129 active+clean; 570 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.0 MiB/s wr, 1.48k op/s 2024-09-19T04:24:09.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:09 smithi007 ceph-mon[31360]: pgmap v571: 129 pgs: 129 active+clean; 569 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 6.6 MiB/s wr, 1.51k op/s 2024-09-19T04:24:09.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:09 smithi102 ceph-mon[35446]: pgmap v571: 129 pgs: 129 active+clean; 569 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 6.6 MiB/s wr, 1.51k op/s 2024-09-19T04:24:09.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:09 smithi092 ceph-mon[34940]: pgmap v571: 129 pgs: 129 active+clean; 569 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 6.6 MiB/s wr, 1.51k op/s 2024-09-19T04:24:09.865 INFO:tasks.quiescer.fs.[cephfs]:Total duration (51.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T04:24:09.865 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.75 2024-09-19T04:24:09.865 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:24:10.130 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:24:10.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.893+0000 7efd50a6e640 1 -- 172.21.15.7:0/1338836024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd4c102ef0 msgr2=0x7efd4c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:10.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.893+0000 7efd50a6e640 1 --2- 172.21.15.7:0/1338836024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd4c102ef0 0x7efd4c10da40 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7efd44009ca0 tx=0x7efd4402a950 comp rx=0 tx=0).stop 2024-09-19T04:24:10.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.893+0000 7efd50a6e640 1 -- 172.21.15.7:0/1338836024 shutdown_connections 2024-09-19T04:24:10.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.893+0000 7efd50a6e640 1 --2- 172.21.15.7:0/1338836024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd4c102ef0 0x7efd4c10da40 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:10.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.893+0000 7efd50a6e640 1 --2- 172.21.15.7:0/1338836024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd4c102570 0x7efd4c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:10.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.893+0000 7efd50a6e640 1 --2- 172.21.15.7:0/1338836024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd4c100e20 0x7efd4c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:10.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.893+0000 7efd50a6e640 1 -- 172.21.15.7:0/1338836024 >> 172.21.15.7:0/1338836024 conn(0x7efd4c0fc7d0 msgr2=0x7efd4c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:10.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.893+0000 7efd50a6e640 1 -- 172.21.15.7:0/1338836024 shutdown_connections 2024-09-19T04:24:10.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.893+0000 7efd50a6e640 1 -- 172.21.15.7:0/1338836024 wait complete. 2024-09-19T04:24:10.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.894+0000 7efd50a6e640 1 Processor -- start 2024-09-19T04:24:10.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.894+0000 7efd50a6e640 1 -- start start 2024-09-19T04:24:10.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.894+0000 7efd50a6e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd4c100e20 0x7efd4c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:10.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.894+0000 7efd50a6e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd4c102570 0x7efd4c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:10.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.894+0000 7efd50a6e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd4c102ef0 0x7efd4c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:10.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.894+0000 7efd50a6e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efd4c110f80 con 0x7efd4c100e20 2024-09-19T04:24:10.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.894+0000 7efd50a6e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efd4c110e00 con 0x7efd4c102570 2024-09-19T04:24:10.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.894+0000 7efd50a6e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efd4c111100 con 0x7efd4c102ef0 2024-09-19T04:24:10.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.894+0000 7efd4a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd4c100e20 0x7efd4c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.894+0000 7efd4a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd4c100e20 0x7efd4c198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57972/0 (socket says 172.21.15.7:57972) 2024-09-19T04:24:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.894+0000 7efd4a59c640 1 -- 172.21.15.7:0/2415923457 learned_addr learned my addr 172.21.15.7:0/2415923457 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.894+0000 7efd43fff640 1 --2- 172.21.15.7:0/2415923457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd4c102570 0x7efd4c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.894+0000 7efd4ad9d640 1 --2- 172.21.15.7:0/2415923457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd4c102ef0 0x7efd4c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.895+0000 7efd4a59c640 1 -- 172.21.15.7:0/2415923457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd4c102ef0 msgr2=0x7efd4c19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.895+0000 7efd4a59c640 1 --2- 172.21.15.7:0/2415923457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd4c102ef0 0x7efd4c19cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.895+0000 7efd4a59c640 1 -- 172.21.15.7:0/2415923457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd4c102570 msgr2=0x7efd4c1989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.895+0000 7efd4a59c640 1 --2- 172.21.15.7:0/2415923457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd4c102570 0x7efd4c1989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.895+0000 7efd4a59c640 1 -- 172.21.15.7:0/2415923457 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd4c19d440 con 0x7efd4c100e20 2024-09-19T04:24:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.895+0000 7efd43fff640 1 --2- 172.21.15.7:0/2415923457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd4c102570 0x7efd4c1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:24:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.895+0000 7efd4ad9d640 1 --2- 172.21.15.7:0/2415923457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd4c102ef0 0x7efd4c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:24:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.895+0000 7efd4a59c640 1 --2- 172.21.15.7:0/2415923457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd4c100e20 0x7efd4c198490 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7efd3c00e9f0 tx=0x7efd3c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:10.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.895+0000 7efd437fe640 1 -- 172.21.15.7:0/2415923457 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3c00cd80 con 0x7efd4c100e20 2024-09-19T04:24:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.895+0000 7efd437fe640 1 -- 172.21.15.7:0/2415923457 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd3c005500 con 0x7efd4c100e20 2024-09-19T04:24:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.895+0000 7efd50a6e640 1 -- 172.21.15.7:0/2415923457 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd4c19d730 con 0x7efd4c100e20 2024-09-19T04:24:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.895+0000 7efd437fe640 1 -- 172.21.15.7:0/2415923457 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3c010690 con 0x7efd4c100e20 2024-09-19T04:24:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.895+0000 7efd50a6e640 1 -- 172.21.15.7:0/2415923457 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd4c1a5010 con 0x7efd4c100e20 2024-09-19T04:24:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.896+0000 7efd50a6e640 1 -- 172.21.15.7:0/2415923457 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd4c101200 con 0x7efd4c100e20 2024-09-19T04:24:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.897+0000 7efd437fe640 1 -- 172.21.15.7:0/2415923457 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7efd3c0046c0 con 0x7efd4c100e20 2024-09-19T04:24:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.898+0000 7efd437fe640 1 --2- 172.21.15.7:0/2415923457 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7efd380a32c0 0x7efd380a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.899+0000 7efd43fff640 1 --2- 172.21.15.7:0/2415923457 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7efd380a32c0 0x7efd380a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:10.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.899+0000 7efd437fe640 1 -- 172.21.15.7:0/2415923457 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7efd3c0d0060 con 0x7efd4c100e20 2024-09-19T04:24:10.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.899+0000 7efd43fff640 1 --2- 172.21.15.7:0/2415923457 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7efd380a32c0 0x7efd380a5780 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7efd4c1051c0 tx=0x7efd34005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:10.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:10.903+0000 7efd437fe640 1 -- 172.21.15.7:0/2415923457 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efd3c09c9b0 con 0x7efd4c100e20 2024-09-19T04:24:11.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:11.252+0000 7efd50a6e640 1 -- 172.21.15.7:0/2415923457 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd4c1997f0 con 0x7efd4c100e20 2024-09-19T04:24:11.254 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:11 smithi007 ceph-mon[31360]: pgmap v572: 129 pgs: 129 active+clean; 527 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.1 MiB/s wr, 1.86k op/s 2024-09-19T04:24:11.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:11.257+0000 7efd437fe640 1 -- 172.21.15.7:0/2415923457 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11963 (secure 0 0 0) 0x7efd3c096e20 con 0x7efd4c100e20 2024-09-19T04:24:11.259 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:24:11.259 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":37,"btime":"2024-09-19T04:23:24:032083+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:23:23.365366+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24496,"mds_2":24482,"mds_3":24478,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24506,24496,24482,24478,24472]},"id":1}]} 2024-09-19T04:24:11.259 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 37 2024-09-19T04:24:11.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:11.261+0000 7efd50a6e640 1 -- 172.21.15.7:0/2415923457 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7efd380a32c0 msgr2=0x7efd380a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:11.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:11.261+0000 7efd50a6e640 1 --2- 172.21.15.7:0/2415923457 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7efd380a32c0 0x7efd380a5780 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7efd4c1051c0 tx=0x7efd34005f90 comp rx=0 tx=0).stop 2024-09-19T04:24:11.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:11.262+0000 7efd50a6e640 1 -- 172.21.15.7:0/2415923457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd4c100e20 msgr2=0x7efd4c198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:11.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:11.262+0000 7efd50a6e640 1 --2- 172.21.15.7:0/2415923457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd4c100e20 0x7efd4c198490 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7efd3c00e9f0 tx=0x7efd3c00edf0 comp rx=0 tx=0).stop 2024-09-19T04:24:11.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:11.263+0000 7efd50a6e640 1 -- 172.21.15.7:0/2415923457 shutdown_connections 2024-09-19T04:24:11.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:11.263+0000 7efd50a6e640 1 --2- 172.21.15.7:0/2415923457 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7efd380a32c0 0x7efd380a5780 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:11.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:11.263+0000 7efd50a6e640 1 --2- 172.21.15.7:0/2415923457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd4c102ef0 0x7efd4c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:11.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:11.263+0000 7efd50a6e640 1 --2- 172.21.15.7:0/2415923457 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd4c102570 0x7efd4c1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:11.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:11.263+0000 7efd50a6e640 1 --2- 172.21.15.7:0/2415923457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd4c100e20 0x7efd4c198490 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:11.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:11.263+0000 7efd50a6e640 1 -- 172.21.15.7:0/2415923457 >> 172.21.15.7:0/2415923457 conn(0x7efd4c0fc7d0 msgr2=0x7efd4c06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:11.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:11.264+0000 7efd50a6e640 1 -- 172.21.15.7:0/2415923457 shutdown_connections 2024-09-19T04:24:11.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:11.264+0000 7efd50a6e640 1 -- 172.21.15.7:0/2415923457 wait complete. 2024-09-19T04:24:11.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:11 smithi102 ceph-mon[35446]: pgmap v572: 129 pgs: 129 active+clean; 527 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.1 MiB/s wr, 1.86k op/s 2024-09-19T04:24:11.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:11 smithi092 ceph-mon[34940]: pgmap v572: 129 pgs: 129 active+clean; 527 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.1 MiB/s wr, 1.86k op/s 2024-09-19T04:24:12.054 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24506 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0' 2024-09-19T04:24:12.055 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24506 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0 2024-09-19T04:24:12.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:12 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2415923457' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:24:12.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:12 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2415923457' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:24:12.518 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:24:12.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:12 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2415923457' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:24:13.347 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:13 smithi007 ceph-mon[31360]: pgmap v573: 129 pgs: 129 active+clean; 522 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.5 MiB/s wr, 1.68k op/s 2024-09-19T04:24:13.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:13 smithi102 ceph-mon[35446]: pgmap v573: 129 pgs: 129 active+clean; 522 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.5 MiB/s wr, 1.68k op/s 2024-09-19T04:24:13.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.497+0000 7f6e26733640 1 -- 172.21.15.7:0/3734713254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e201083f0 msgr2=0x7f6e201087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:13.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.497+0000 7f6e26733640 1 --2- 172.21.15.7:0/3734713254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e201083f0 0x7f6e201087d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6e18009860 tx=0x7f6e1802a340 comp rx=0 tx=0).stop 2024-09-19T04:24:13.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.497+0000 7f6e26733640 1 -- 172.21.15.7:0/3734713254 shutdown_connections 2024-09-19T04:24:13.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.497+0000 7f6e26733640 1 --2- 172.21.15.7:0/3734713254 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e2010d520 0x7f6e201150a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:13.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.497+0000 7f6e26733640 1 --2- 172.21.15.7:0/3734713254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e20108da0 0x7f6e2010cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:13.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.497+0000 7f6e26733640 1 --2- 172.21.15.7:0/3734713254 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e201083f0 0x7f6e201087d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:13.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.497+0000 7f6e26733640 1 -- 172.21.15.7:0/3734713254 >> 172.21.15.7:0/3734713254 conn(0x7f6e20077af0 msgr2=0x7f6e20079f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:13.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.498+0000 7f6e26733640 1 -- 172.21.15.7:0/3734713254 shutdown_connections 2024-09-19T04:24:13.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.498+0000 7f6e26733640 1 -- 172.21.15.7:0/3734713254 wait complete. 2024-09-19T04:24:13.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.499+0000 7f6e26733640 1 Processor -- start 2024-09-19T04:24:13.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.499+0000 7f6e26733640 1 -- start start 2024-09-19T04:24:13.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.499+0000 7f6e26733640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e201083f0 0x7f6e201a4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:13.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.499+0000 7f6e26733640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e20108da0 0x7f6e201a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:13.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.499+0000 7f6e26733640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e2010d520 0x7f6e2019e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:13.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.499+0000 7f6e26733640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6e20118590 con 0x7f6e201083f0 2024-09-19T04:24:13.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.499+0000 7f6e26733640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6e20118410 con 0x7f6e2010d520 2024-09-19T04:24:13.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.499+0000 7f6e26733640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6e20118710 con 0x7f6e20108da0 2024-09-19T04:24:13.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.499+0000 7f6e1f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e20108da0 0x7f6e201a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.499+0000 7f6e1f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e20108da0 0x7f6e201a4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:54290/0 (socket says 172.21.15.7:54290) 2024-09-19T04:24:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.500+0000 7f6e1ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e201083f0 0x7f6e201a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.500+0000 7f6e1f7fe640 1 -- 172.21.15.7:0/2755377056 learned_addr learned my addr 172.21.15.7:0/2755377056 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.500+0000 7f6e24cd0640 1 --2- 172.21.15.7:0/2755377056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e2010d520 0x7f6e2019e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.500+0000 7f6e1f7fe640 1 -- 172.21.15.7:0/2755377056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e2010d520 msgr2=0x7f6e2019e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.500+0000 7f6e1f7fe640 1 --2- 172.21.15.7:0/2755377056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e2010d520 0x7f6e2019e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.500+0000 7f6e1f7fe640 1 -- 172.21.15.7:0/2755377056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e201083f0 msgr2=0x7f6e201a4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.500+0000 7f6e1f7fe640 1 --2- 172.21.15.7:0/2755377056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e201083f0 0x7f6e201a4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.500+0000 7f6e1f7fe640 1 -- 172.21.15.7:0/2755377056 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e2019efa0 con 0x7f6e20108da0 2024-09-19T04:24:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.500+0000 7f6e1f7fe640 1 --2- 172.21.15.7:0/2755377056 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e20108da0 0x7f6e201a4bc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000c370 tx=0x7f6e1000c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.501+0000 7f6e1d7fa640 1 -- 172.21.15.7:0/2755377056 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1002c070 con 0x7f6e20108da0 2024-09-19T04:24:13.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.501+0000 7f6e26733640 1 -- 172.21.15.7:0/2755377056 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e2019f290 con 0x7f6e20108da0 2024-09-19T04:24:13.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.501+0000 7f6e1d7fa640 1 -- 172.21.15.7:0/2755377056 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e1000bb10 con 0x7f6e20108da0 2024-09-19T04:24:13.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.501+0000 7f6e1d7fa640 1 -- 172.21.15.7:0/2755377056 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e10027d40 con 0x7f6e20108da0 2024-09-19T04:24:13.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.501+0000 7f6e26733640 1 -- 172.21.15.7:0/2755377056 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e2007aa40 con 0x7f6e20108da0 2024-09-19T04:24:13.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.505+0000 7f6e28b0c740 1 Processor -- start 2024-09-19T04:24:13.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.505+0000 7f6e1d7fa640 1 -- 172.21.15.7:0/2755377056 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f6e1002f070 con 0x7f6e20108da0 2024-09-19T04:24:13.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.505+0000 7f6e28b0c740 1 -- start start 2024-09-19T04:24:13.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.505+0000 7f6e28b0c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d096211850 0x55d096211c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:13.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.505+0000 7f6e28b0c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d096212170 0x55d09621c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:13.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.505+0000 7f6e28b0c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d09621ca30 0x55d09621ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:13.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.505+0000 7f6e28b0c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d096176160 con 0x55d09621ca30 2024-09-19T04:24:13.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.505+0000 7f6e28b0c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d09611d720 con 0x55d096211850 2024-09-19T04:24:13.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.505+0000 7f6e28b0c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d096172120 con 0x55d096212170 2024-09-19T04:24:13.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.506+0000 7f6e1ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d096212170 0x55d09621c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:13.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.506+0000 7f6e1ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d096212170 0x55d09621c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:54306/0 (socket says 172.21.15.7:54306) 2024-09-19T04:24:13.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.506+0000 7f6e1ffff640 1 -- 172.21.15.7:0/2758811808 learned_addr learned my addr 172.21.15.7:0/2758811808 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:13.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.506+0000 7f6e24cd0640 1 --2- 172.21.15.7:0/2758811808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d096211850 0x55d096211c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:13.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.506+0000 7f6e1f7fe640 1 --2- 172.21.15.7:0/2758811808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d09621ca30 0x55d09621ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:13.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.507+0000 7f6e1ffff640 1 -- 172.21.15.7:0/2758811808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d096211850 msgr2=0x55d096211c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:13.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.507+0000 7f6e1ffff640 1 --2- 172.21.15.7:0/2758811808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d096211850 0x55d096211c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:13.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.507+0000 7f6e1ffff640 1 -- 172.21.15.7:0/2758811808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d09621ca30 msgr2=0x55d09621ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:13.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.507+0000 7f6e1ffff640 1 --2- 172.21.15.7:0/2758811808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d09621ca30 0x55d09621ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:13.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.507+0000 7f6e1ffff640 1 -- 172.21.15.7:0/2758811808 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d095ee7ba0 con 0x55d096212170 2024-09-19T04:24:13.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.507+0000 7f6e1d7fa640 1 --2- 172.21.15.7:0/2755377056 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6e0c0a3380 0x7f6e0c0a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:13.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.507+0000 7f6e1d7fa640 1 -- 172.21.15.7:0/2755377056 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f6e100e0c70 con 0x7f6e20108da0 2024-09-19T04:24:13.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.508+0000 7f6e1ffff640 1 --2- 172.21.15.7:0/2758811808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d096212170 0x55d09621c4f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6e18009860 tx=0x7f6e18009510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65c553a0e4d6fe87 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:13.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.509+0000 7f6e167fc640 1 -- 172.21.15.7:0/2758811808 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1803f020 con 0x55d096212170 2024-09-19T04:24:13.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.509+0000 7f6e167fc640 1 -- 172.21.15.7:0/2758811808 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e18030e50 con 0x55d096212170 2024-09-19T04:24:13.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.509+0000 7f6e167fc640 1 -- 172.21.15.7:0/2758811808 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e18037040 con 0x55d096212170 2024-09-19T04:24:13.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.509+0000 7f6e24cd0640 1 --2- 172.21.15.7:0/2755377056 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6e0c0a3380 0x7f6e0c0a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.510+0000 7f6e28b0c740 1 -- 172.21.15.7:0/2758811808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d096212170 msgr2=0x55d09621c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.510+0000 7f6e28b0c740 1 --2- 172.21.15.7:0/2758811808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d096212170 0x55d09621c4f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6e18009860 tx=0x7f6e18009510 comp rx=0 tx=0).stop 2024-09-19T04:24:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.510+0000 7f6e24cd0640 1 --2- 172.21.15.7:0/2755377056 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6e0c0a3380 0x7f6e0c0a5840 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6e080045d0 tx=0x7f6e0800b2e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.510+0000 7f6e28b0c740 1 -- 172.21.15.7:0/2758811808 shutdown_connections 2024-09-19T04:24:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.510+0000 7f6e28b0c740 1 --2- 172.21.15.7:0/2758811808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d09621ca30 0x55d09621ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.510+0000 7f6e28b0c740 1 --2- 172.21.15.7:0/2758811808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d096212170 0x55d09621c4f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.510+0000 7f6e28b0c740 1 --2- 172.21.15.7:0/2758811808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d096211850 0x55d096211c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.510+0000 7f6e28b0c740 1 -- 172.21.15.7:0/2758811808 >> 172.21.15.7:0/2758811808 conn(0x55d09620dde0 msgr2=0x55d09620e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:13.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.512+0000 7f6e28b0c740 1 -- 172.21.15.7:0/2758811808 shutdown_connections 2024-09-19T04:24:13.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.512+0000 7f6e28b0c740 1 -- 172.21.15.7:0/2758811808 wait complete. 2024-09-19T04:24:13.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.513+0000 7f6e28b0c740 1 -- start start 2024-09-19T04:24:13.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.513+0000 7f6e28b0c740 1 Processor -- start 2024-09-19T04:24:13.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.514+0000 7f6e28b0c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d096211850 0x55d096219930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:13.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.514+0000 7f6e28b0c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d096212170 0x55d096219e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:13.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.514+0000 7f6e28b0c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d09621ca30 0x55d09621a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:13.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.514+0000 7f6e28b0c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d09621f600 con 0x55d09621ca30 2024-09-19T04:24:13.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.514+0000 7f6e28b0c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d0960fe900 con 0x55d096211850 2024-09-19T04:24:13.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.514+0000 7f6e28b0c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d09621f780 con 0x55d096212170 2024-09-19T04:24:13.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.514+0000 7f6e1f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d096212170 0x55d096219e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:13.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.514+0000 7f6e24cd0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d09621ca30 0x55d09621a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:13.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.514+0000 7f6e1f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d096212170 0x55d096219e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:54320/0 (socket says 172.21.15.7:54320) 2024-09-19T04:24:13.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.514+0000 7f6e1f7fe640 1 -- 172.21.15.7:0/1653701770 learned_addr learned my addr 172.21.15.7:0/1653701770 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:13.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.514+0000 7f6e28b0c740 10 client.0 _ll_register_callbacks cb 0x55d0960fc780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:24:13.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.515+0000 7f6e1ffff640 1 --2- 172.21.15.7:0/1653701770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d096211850 0x55d096219930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.515+0000 7f6e1f7fe640 1 -- 172.21.15.7:0/1653701770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d096211850 msgr2=0x55d096219930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.515+0000 7f6e1f7fe640 1 --2- 172.21.15.7:0/1653701770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d096211850 0x55d096219930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.515+0000 7f6e1f7fe640 1 -- 172.21.15.7:0/1653701770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d09621ca30 msgr2=0x55d09621a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.515+0000 7f6e1f7fe640 1 --2- 172.21.15.7:0/1653701770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d09621ca30 0x55d09621a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.515+0000 7f6e1f7fe640 1 -- 172.21.15.7:0/1653701770 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d09613ec50 con 0x55d096212170 2024-09-19T04:24:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.515+0000 7f6e1f7fe640 1 --2- 172.21.15.7:0/1653701770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d096212170 0x55d096219e70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6e100a9900 tx=0x7f6e100acdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38401f6d129e9981 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.515+0000 7f6dff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-19T04:24:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.515+0000 7f6dff7fe640 1 -- 172.21.15.7:0/1653701770 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e100b1230 con 0x55d096212170 2024-09-19T04:24:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.516+0000 7f6e28b0c740 1 -- 172.21.15.7:0/1653701770 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e18030e50 con 0x55d096212170 2024-09-19T04:24:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.516+0000 7f6dff7fe640 1 -- 172.21.15.7:0/1653701770 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f6e100ab230 con 0x55d096212170 2024-09-19T04:24:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.516+0000 7f6dff7fe640 1 -- 172.21.15.7:0/1653701770 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f6e100b5af0 con 0x55d096212170 2024-09-19T04:24:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.516+0000 7f6e28b0c740 10 client.25822 fetch_fsmap learned FSMap version 37 2024-09-19T04:24:13.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.516+0000 7f6e28b0c740 1 -- 172.21.15.7:0/1653701770 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55d09622b2c0 con 0x55d096212170 2024-09-19T04:24:13.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.517+0000 7f6dff7fe640 1 -- 172.21.15.7:0/1653701770 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e18030e50 con 0x55d096212170 2024-09-19T04:24:13.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.518+0000 7f6dff7fe640 1 -- 172.21.15.7:0/1653701770 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 37) ==== 8374+0+0 (secure 0 0 0) 0x7f6e1000b040 con 0x55d096212170 2024-09-19T04:24:13.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.518+0000 7f6e28b0c740 10 client.25822 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T04:24:13.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.518+0000 7f6e28b0c740 10 client.25822 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:24:13.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.518+0000 7f6e28b0c740 20 client.25822 populate_metadata read hostname 'smithi007' 2024-09-19T04:24:13.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.518+0000 7f6e28b0c740 1 --2- 172.21.15.7:0/1653701770 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d09622cbf0 0x55d09622f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:13.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.518+0000 7f6e28b0c740 4 client.25822 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:24:13.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.518+0000 7f6e28b0c740 1 -- 172.21.15.7:0/1653701770 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d096183890 con 0x55d09622cbf0 2024-09-19T04:24:13.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.520+0000 7f6e1ffff640 1 --2- 172.21.15.7:0/1653701770 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d09622cbf0 0x55d09622f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:13.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.521+0000 7f6e1ffff640 1 --2- 172.21.15.7:0/1653701770 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d09622cbf0 0x55d09622f030 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b7cc2d569c4421f server_cookie=6382cf4eb3e6c682 in_seq=0 out_seq=0 2024-09-19T04:24:13.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.521+0000 7f6dff7fe640 10 client.25822 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:24:13.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.523+0000 7f6dff7fe640 1 -- 172.21.15.7:0/1653701770 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d096183890 con 0x55d09622cbf0 2024-09-19T04:24:13.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.523+0000 7f6dff7fe640 10 client.25822 handle_command_reply: tid=0 2024-09-19T04:24:13.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.523+0000 7f6e28b0c740 1 client.25822 shutdown 2024-09-19T04:24:13.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.526+0000 7f6e28b0c740 1 -- 172.21.15.7:0/1653701770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d096212170 msgr2=0x55d096219e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:13.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.526+0000 7f6e28b0c740 1 --2- 172.21.15.7:0/1653701770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d096212170 0x55d096219e70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6e100a9900 tx=0x7f6e100acdc0 comp rx=0 tx=0).stop 2024-09-19T04:24:13.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.527+0000 7f6e28b0c740 1 -- 172.21.15.7:0/1653701770 shutdown_connections 2024-09-19T04:24:13.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.527+0000 7f6e28b0c740 1 --2- 172.21.15.7:0/1653701770 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d09622cbf0 0x55d09622f030 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:13.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.527+0000 7f6e28b0c740 1 --2- 172.21.15.7:0/1653701770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d09621ca30 0x55d09621a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:13.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.527+0000 7f6e28b0c740 1 --2- 172.21.15.7:0/1653701770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d096212170 0x55d096219e70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:13.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.527+0000 7f6e28b0c740 1 --2- 172.21.15.7:0/1653701770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d096211850 0x55d096219930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:13.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.527+0000 7f6e28b0c740 1 -- 172.21.15.7:0/1653701770 >> 172.21.15.7:0/1653701770 conn(0x55d09620dde0 msgr2=0x55d09620cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:13.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.527+0000 7f6dff7fe640 0 client.25822 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:24:13.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.528+0000 7f6e28b0c740 1 -- 172.21.15.7:0/1653701770 shutdown_connections 2024-09-19T04:24:13.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.528+0000 7f6e28b0c740 1 -- 172.21.15.7:0/1653701770 wait complete. 2024-09-19T04:24:13.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.528+0000 7f6e28b0c740 20 client.25822 trim_cache size 0 max 16384 2024-09-19T04:24:13.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:13 smithi092 ceph-mon[34940]: pgmap v573: 129 pgs: 129 active+clean; 522 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.5 MiB/s wr, 1.68k op/s 2024-09-19T04:24:13.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.562+0000 7f6e28b0c740 1 Processor -- start 2024-09-19T04:24:13.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.562+0000 7f6e28b0c740 1 -- start start 2024-09-19T04:24:13.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.563+0000 7f6e28b0c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d096211850 0x55d09620cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:13.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.563+0000 7f6e28b0c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d096212170 0x55d09621a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:13.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.563+0000 7f6e28b0c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d09621ca30 0x55d096234940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:13.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.563+0000 7f6e28b0c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6e201aca50 con 0x55d096211850 2024-09-19T04:24:13.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.563+0000 7f6e28b0c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6e201ae5c0 con 0x55d09621ca30 2024-09-19T04:24:13.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.563+0000 7f6e28b0c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6e201ad120 con 0x55d096212170 2024-09-19T04:24:13.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.563+0000 7f6e1ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d096211850 0x55d09620cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:13.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.563+0000 7f6e1ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d096211850 0x55d09620cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58004/0 (socket says 172.21.15.7:58004) 2024-09-19T04:24:13.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.563+0000 7f6e1ffff640 1 -- 172.21.15.7:0/385029893 learned_addr learned my addr 172.21.15.7:0/385029893 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:13.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.563+0000 7f6e1f7fe640 1 --2- 172.21.15.7:0/385029893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d096212170 0x55d09621a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:13.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.563+0000 7f6e1ffff640 1 -- 172.21.15.7:0/385029893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d096212170 msgr2=0x55d09621a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:13.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.563+0000 7f6e1ffff640 1 --2- 172.21.15.7:0/385029893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d096212170 0x55d09621a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:13.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.563+0000 7f6e1ffff640 1 -- 172.21.15.7:0/385029893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d09621ca30 msgr2=0x55d096234940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:13.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.564+0000 7f6e1ffff640 1 --2- 172.21.15.7:0/385029893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d09621ca30 0x55d096234940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:13.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.564+0000 7f6e1ffff640 1 -- 172.21.15.7:0/385029893 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d096211680 con 0x55d096211850 2024-09-19T04:24:13.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.564+0000 7f6e1ffff640 1 --2- 172.21.15.7:0/385029893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d096211850 0x55d09620cdb0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f6e18030ac0 tx=0x7f6e1802a840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ef7f5c59693b92 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:13.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.565+0000 7f6e15ffb640 1 -- 172.21.15.7:0/385029893 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e18037040 con 0x55d096211850 2024-09-19T04:24:13.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.565+0000 7f6e15ffb640 1 -- 172.21.15.7:0/385029893 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e18030c50 con 0x55d096211850 2024-09-19T04:24:13.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.565+0000 7f6e15ffb640 1 -- 172.21.15.7:0/385029893 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1803f040 con 0x55d096211850 2024-09-19T04:24:13.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.566+0000 7f6e28b0c740 1 -- 172.21.15.7:0/385029893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d096211850 msgr2=0x55d09620cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:13.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.566+0000 7f6e28b0c740 1 --2- 172.21.15.7:0/385029893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d096211850 0x55d09620cdb0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f6e18030ac0 tx=0x7f6e1802a840 comp rx=0 tx=0).stop 2024-09-19T04:24:13.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.566+0000 7f6e28b0c740 1 -- 172.21.15.7:0/385029893 shutdown_connections 2024-09-19T04:24:13.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.566+0000 7f6e28b0c740 1 --2- 172.21.15.7:0/385029893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d09621ca30 0x55d096234940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:13.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.566+0000 7f6e28b0c740 1 --2- 172.21.15.7:0/385029893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d096212170 0x55d09621a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:13.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.566+0000 7f6e28b0c740 1 --2- 172.21.15.7:0/385029893 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d096211850 0x55d09620cdb0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:13.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.566+0000 7f6e28b0c740 1 -- 172.21.15.7:0/385029893 >> 172.21.15.7:0/385029893 conn(0x55d09620dde0 msgr2=0x55d09620c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:13.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.567+0000 7f6e28b0c740 1 -- 172.21.15.7:0/385029893 shutdown_connections 2024-09-19T04:24:13.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.567+0000 7f6e28b0c740 1 -- 172.21.15.7:0/385029893 wait complete. 2024-09-19T04:24:13.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.567+0000 7f6e28b0c740 1 -- start start 2024-09-19T04:24:13.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.568+0000 7f6e28b0c740 1 Processor -- start 2024-09-19T04:24:13.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.568+0000 7f6e28b0c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d096211850 0x55d096224dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:13.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.568+0000 7f6e28b0c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d096212170 0x55d096225300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:13.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.568+0000 7f6e28b0c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d09621ca30 0x55d096220340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:13.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.568+0000 7f6e28b0c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6e201adec0 con 0x55d09621ca30 2024-09-19T04:24:13.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.568+0000 7f6e28b0c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6e201ad7f0 con 0x55d096212170 2024-09-19T04:24:13.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.568+0000 7f6e28b0c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6e20082850 con 0x55d096211850 2024-09-19T04:24:13.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.568+0000 7f6e28b0c740 10 client.0 _ll_register_callbacks cb 0x7f6e08005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:24:13.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.569+0000 7f6e24cd0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d09621ca30 0x55d096220340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:13.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.569+0000 7f6e24cd0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d09621ca30 0x55d096220340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58008/0 (socket says 172.21.15.7:58008) 2024-09-19T04:24:13.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.569+0000 7f6e24cd0640 1 -- 172.21.15.7:0/1715691145 learned_addr learned my addr 172.21.15.7:0/1715691145 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:13.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.569+0000 7f6e24cd0640 1 -- 172.21.15.7:0/1715691145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d096211850 msgr2=0x55d096224dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:13.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.569+0000 7f6e24cd0640 1 --2- 172.21.15.7:0/1715691145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d096211850 0x55d096224dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:13.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.569+0000 7f6e24cd0640 1 -- 172.21.15.7:0/1715691145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d096212170 msgr2=0x55d096225300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:13.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.569+0000 7f6e24cd0640 1 --2- 172.21.15.7:0/1715691145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d096212170 0x55d096225300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:13.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.569+0000 7f6e24cd0640 1 -- 172.21.15.7:0/1715691145 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d096220b70 con 0x55d09621ca30 2024-09-19T04:24:13.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.570+0000 7f6e24cd0640 1 --2- 172.21.15.7:0/1715691145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d09621ca30 0x55d096220340 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6e08003e30 tx=0x7f6e08004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c9a5d8dc2b1573 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:13.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.570+0000 7f6dff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:24:13.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.570+0000 7f6dff7fe640 1 -- 172.21.15.7:0/1715691145 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e08005220 con 0x55d09621ca30 2024-09-19T04:24:13.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.571+0000 7f6dff7fe640 1 -- 172.21.15.7:0/1715691145 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f6e080053c0 con 0x55d09621ca30 2024-09-19T04:24:13.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.571+0000 7f6e28b0c740 1 -- 172.21.15.7:0/1715691145 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e18030c50 con 0x55d09621ca30 2024-09-19T04:24:13.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.571+0000 7f6dff7fe640 1 -- 172.21.15.7:0/1715691145 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f6e080055c0 con 0x55d09621ca30 2024-09-19T04:24:13.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.571+0000 7f6e28b0c740 10 client.16164 fetch_fsmap learned FSMap version 37 2024-09-19T04:24:13.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.571+0000 7f6e28b0c740 1 -- 172.21.15.7:0/1715691145 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55d096297600 con 0x55d09621ca30 2024-09-19T04:24:13.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.571+0000 7f6dff7fe640 1 -- 172.21.15.7:0/1715691145 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e08032420 con 0x55d09621ca30 2024-09-19T04:24:13.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.572+0000 7f6dff7fe640 1 -- 172.21.15.7:0/1715691145 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 37) ==== 8374+0+0 (secure 0 0 0) 0x7f6e08027030 con 0x55d09621ca30 2024-09-19T04:24:13.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.572+0000 7f6e28b0c740 10 client.16164 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T04:24:13.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.572+0000 7f6e28b0c740 10 client.16164 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:24:13.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.572+0000 7f6e28b0c740 20 client.16164 populate_metadata read hostname 'smithi007' 2024-09-19T04:24:13.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.572+0000 7f6e28b0c740 1 --2- 172.21.15.7:0/1715691145 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d096297d80 0x55d09629a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:13.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.572+0000 7f6e28b0c740 4 client.16164 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}] 2024-09-19T04:24:13.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.572+0000 7f6e28b0c740 1 -- 172.21.15.7:0/1715691145 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}) -- 0x7f6e18030c50 con 0x55d096297d80 2024-09-19T04:24:13.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.574+0000 7f6e1ffff640 1 --2- 172.21.15.7:0/1715691145 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d096297d80 0x55d09629a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:13.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.575+0000 7f6e1ffff640 1 --2- 172.21.15.7:0/1715691145 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d096297d80 0x55d09629a1e0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cafd12942dac7b7c server_cookie=722552ff984479af in_seq=0 out_seq=0 2024-09-19T04:24:13.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:13.575+0000 7f6dff7fe640 10 client.16164 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:24:15.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:15 smithi007 ceph-mon[31360]: pgmap v574: 129 pgs: 129 active+clean; 514 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.8 MiB/s wr, 1.78k op/s 2024-09-19T04:24:15.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:15 smithi102 ceph-mon[35446]: pgmap v574: 129 pgs: 129 active+clean; 514 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.8 MiB/s wr, 1.78k op/s 2024-09-19T04:24:15.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:15 smithi092 ceph-mon[34940]: pgmap v574: 129 pgs: 129 active+clean; 514 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.8 MiB/s wr, 1.78k op/s 2024-09-19T04:24:16.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:16 smithi007 ceph-mon[31360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:24:16.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:16 smithi102 ceph-mon[35446]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:24:16.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:16 smithi092 ceph-mon[34940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:24:17.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:17 smithi007 ceph-mon[31360]: pgmap v575: 129 pgs: 129 active+clean; 499 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 1.44k op/s 2024-09-19T04:24:17.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:17 smithi102 ceph-mon[35446]: pgmap v575: 129 pgs: 129 active+clean; 499 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 1.44k op/s 2024-09-19T04:24:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.535+0000 7f090f368640 1 -- 172.21.15.7:0/606784233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0908103720 msgr2=0x7f0908109fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.535+0000 7f090f368640 1 --2- 172.21.15.7:0/606784233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0908103720 0x7f0908109fb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0900009ca0 tx=0x7f090002a8c0 comp rx=0 tx=0).stop 2024-09-19T04:24:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.535+0000 7f090f368640 1 -- 172.21.15.7:0/606784233 shutdown_connections 2024-09-19T04:24:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.535+0000 7f090f368640 1 --2- 172.21.15.7:0/606784233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0908103720 0x7f0908109fb0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.535+0000 7f090f368640 1 --2- 172.21.15.7:0/606784233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0908102d60 0x7f09081031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.535+0000 7f090f368640 1 --2- 172.21.15.7:0/606784233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0908101b70 0x7f0908101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:17.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.535+0000 7f090f368640 1 -- 172.21.15.7:0/606784233 >> 172.21.15.7:0/606784233 conn(0x7f09080fd2f0 msgr2=0x7f09080ff710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:17.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.535+0000 7f090f368640 1 -- 172.21.15.7:0/606784233 shutdown_connections 2024-09-19T04:24:17.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.535+0000 7f090f368640 1 -- 172.21.15.7:0/606784233 wait complete. 2024-09-19T04:24:17.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.536+0000 7f090f368640 1 Processor -- start 2024-09-19T04:24:17.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.536+0000 7f090f368640 1 -- start start 2024-09-19T04:24:17.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.536+0000 7f090f368640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0908101b70 0x7f0908197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:17.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.536+0000 7f090f368640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0908102d60 0x7f0908198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:17.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.536+0000 7f090f368640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0908103720 0x7f090819f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:17.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.536+0000 7f090f368640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f090810d840 con 0x7f0908101b70 2024-09-19T04:24:17.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.536+0000 7f090f368640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f090810d6c0 con 0x7f0908102d60 2024-09-19T04:24:17.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.536+0000 7f090f368640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f090810d9c0 con 0x7f0908103720 2024-09-19T04:24:17.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.536+0000 7f090d104640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0908101b70 0x7f0908197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:17.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.536+0000 7f090d104640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0908101b70 0x7f0908197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52978/0 (socket says 172.21.15.7:52978) 2024-09-19T04:24:17.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.536+0000 7f090d104640 1 -- 172.21.15.7:0/2888793243 learned_addr learned my addr 172.21.15.7:0/2888793243 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:17.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.536+0000 7f090c903640 1 --2- 172.21.15.7:0/2888793243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0908102d60 0x7f0908198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:17.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.537+0000 7f090d905640 1 --2- 172.21.15.7:0/2888793243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0908103720 0x7f090819f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:17.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.537+0000 7f090d104640 1 -- 172.21.15.7:0/2888793243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0908103720 msgr2=0x7f090819f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:17.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.537+0000 7f090d104640 1 --2- 172.21.15.7:0/2888793243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0908103720 0x7f090819f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:17.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.537+0000 7f090d104640 1 -- 172.21.15.7:0/2888793243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0908102d60 msgr2=0x7f0908198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:17.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.537+0000 7f090d104640 1 --2- 172.21.15.7:0/2888793243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0908102d60 0x7f0908198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:17.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.537+0000 7f090d104640 1 -- 172.21.15.7:0/2888793243 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f090819fa50 con 0x7f0908101b70 2024-09-19T04:24:17.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.537+0000 7f090c903640 1 --2- 172.21.15.7:0/2888793243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0908102d60 0x7f0908198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:24:17.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.537+0000 7f090d104640 1 --2- 172.21.15.7:0/2888793243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0908101b70 0x7f0908197e30 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f090400e9c0 tx=0x7f090400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:17.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.537+0000 7f08fe7fc640 1 -- 172.21.15.7:0/2888793243 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f090400cd80 con 0x7f0908101b70 2024-09-19T04:24:17.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.537+0000 7f090f368640 1 -- 172.21.15.7:0/2888793243 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f090819fd40 con 0x7f0908101b70 2024-09-19T04:24:17.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.537+0000 7f090f368640 1 -- 172.21.15.7:0/2888793243 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09081a0220 con 0x7f0908101b70 2024-09-19T04:24:17.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.537+0000 7f08fe7fc640 1 -- 172.21.15.7:0/2888793243 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09040035f0 con 0x7f0908101b70 2024-09-19T04:24:17.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.537+0000 7f08fe7fc640 1 -- 172.21.15.7:0/2888793243 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0904010690 con 0x7f0908101b70 2024-09-19T04:24:17.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.539+0000 7f08fe7fc640 1 -- 172.21.15.7:0/2888793243 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f09040037a0 con 0x7f0908101b70 2024-09-19T04:24:17.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.540+0000 7f09121d9740 1 Processor -- start 2024-09-19T04:24:17.544 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.540+0000 7f09121d9740 1 -- start start 2024-09-19T04:24:17.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.540+0000 7f08fe7fc640 1 --2- 172.21.15.7:0/2888793243 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f08f40a3240 0x7f08f40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:17.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.541+0000 7f090d905640 1 --2- 172.21.15.7:0/2888793243 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f08f40a3240 0x7f08f40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:17.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.541+0000 7f08fe7fc640 1 -- 172.21.15.7:0/2888793243 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f09040d0180 con 0x7f0908101b70 2024-09-19T04:24:17.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.541+0000 7f09121d9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563637f089a0 0x563637f08da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:17.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.541+0000 7f09121d9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563637f092e0 0x563637f0dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:17.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.541+0000 7f09121d9740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563637f0e370 0x563637f10830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:17.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.541+0000 7f09121d9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563637e6c2f0 con 0x563637f089a0 2024-09-19T04:24:17.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.541+0000 7f09121d9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563637e14270 con 0x563637f092e0 2024-09-19T04:24:17.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.541+0000 7f09121d9740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563637e682b0 con 0x563637f0e370 2024-09-19T04:24:17.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.541+0000 7f090d104640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563637f089a0 0x563637f08da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:17.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.541+0000 7f090d104640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563637f089a0 0x563637f08da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52994/0 (socket says 172.21.15.7:52994) 2024-09-19T04:24:17.545 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.541+0000 7f090d104640 1 -- 172.21.15.7:0/4197513277 learned_addr learned my addr 172.21.15.7:0/4197513277 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:17.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.541+0000 7f090c903640 1 --2- 172.21.15.7:0/4197513277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563637f092e0 0x563637f0dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:17.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.541+0000 7f090d104640 1 -- 172.21.15.7:0/4197513277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563637f0e370 msgr2=0x563637f10830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:17.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.541+0000 7f090d104640 1 --2- 172.21.15.7:0/4197513277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563637f0e370 0x563637f10830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:17.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.541+0000 7f090d104640 1 -- 172.21.15.7:0/4197513277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563637f092e0 msgr2=0x563637f0dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:17.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.541+0000 7f090d104640 1 --2- 172.21.15.7:0/4197513277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563637f092e0 0x563637f0dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:17.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.541+0000 7f090d104640 1 -- 172.21.15.7:0/4197513277 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563637e13340 con 0x563637f089a0 2024-09-19T04:24:17.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.541+0000 7f090d905640 1 --2- 172.21.15.7:0/2888793243 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f08f40a3240 0x7f08f40a5700 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0900031c10 tx=0x7f0900009890 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:17.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.541+0000 7f090d104640 1 --2- 172.21.15.7:0/4197513277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563637f089a0 0x563637f08da0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f09040a4ad0 tx=0x7f090409bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f780e3a2ffc20621 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:17.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.541+0000 7f08f37fe640 1 -- 172.21.15.7:0/4197513277 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09040b5070 con 0x563637f089a0 2024-09-19T04:24:17.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.541+0000 7f08f37fe640 1 -- 172.21.15.7:0/4197513277 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09040a5000 con 0x563637f089a0 2024-09-19T04:24:17.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.541+0000 7f08f37fe640 1 -- 172.21.15.7:0/4197513277 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0904098a00 con 0x563637f089a0 2024-09-19T04:24:17.546 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.542+0000 7f09121d9740 1 -- 172.21.15.7:0/4197513277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563637f089a0 msgr2=0x563637f08da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:17.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.542+0000 7f09121d9740 1 --2- 172.21.15.7:0/4197513277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563637f089a0 0x563637f08da0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f09040a4ad0 tx=0x7f090409bdb0 comp rx=0 tx=0).stop 2024-09-19T04:24:17.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.542+0000 7f09121d9740 1 -- 172.21.15.7:0/4197513277 shutdown_connections 2024-09-19T04:24:17.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.542+0000 7f09121d9740 1 --2- 172.21.15.7:0/4197513277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563637f0e370 0x563637f10830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:17.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.542+0000 7f09121d9740 1 --2- 172.21.15.7:0/4197513277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563637f092e0 0x563637f0dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:17.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.542+0000 7f09121d9740 1 --2- 172.21.15.7:0/4197513277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563637f089a0 0x563637f08da0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:17.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.542+0000 7f09121d9740 1 -- 172.21.15.7:0/4197513277 >> 172.21.15.7:0/4197513277 conn(0x563637f04010 msgr2=0x563637f04410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:17.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.543+0000 7f09121d9740 1 -- 172.21.15.7:0/4197513277 shutdown_connections 2024-09-19T04:24:17.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.543+0000 7f09121d9740 1 -- 172.21.15.7:0/4197513277 wait complete. 2024-09-19T04:24:17.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.543+0000 7f09121d9740 1 -- start start 2024-09-19T04:24:17.547 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.543+0000 7f09121d9740 1 Processor -- start 2024-09-19T04:24:17.548 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:17 smithi092 ceph-mon[34940]: pgmap v575: 129 pgs: 129 active+clean; 499 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 1.44k op/s 2024-09-19T04:24:17.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.543+0000 7f09121d9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563637f089a0 0x563637f12c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:17.550 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.543+0000 7f09121d9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563637f092e0 0x563637f13190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:17.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.543+0000 7f09121d9740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563637f0e370 0x563637f1a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:17.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.543+0000 7f09121d9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563637f11340 con 0x563637f089a0 2024-09-19T04:24:17.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.543+0000 7f09121d9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563637df5290 con 0x563637f092e0 2024-09-19T04:24:17.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.543+0000 7f09121d9740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563637f114c0 con 0x563637f0e370 2024-09-19T04:24:17.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.543+0000 7f09121d9740 10 client.0 _ll_register_callbacks cb 0x563637e26140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:24:17.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.543+0000 7f090d104640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563637f089a0 0x563637f12c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:17.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.543+0000 7f090d104640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563637f089a0 0x563637f12c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53008/0 (socket says 172.21.15.7:53008) 2024-09-19T04:24:17.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.544+0000 7f090d104640 1 -- 172.21.15.7:0/3905625908 learned_addr learned my addr 172.21.15.7:0/3905625908 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:17.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.544+0000 7f090c903640 1 --2- 172.21.15.7:0/3905625908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563637f092e0 0x563637f13190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:17.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.544+0000 7f090d905640 1 --2- 172.21.15.7:0/3905625908 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563637f0e370 0x563637f1a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:17.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.544+0000 7f090d104640 1 -- 172.21.15.7:0/3905625908 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563637f0e370 msgr2=0x563637f1a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:17.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.544+0000 7f090d104640 1 --2- 172.21.15.7:0/3905625908 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563637f0e370 0x563637f1a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:17.551 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.544+0000 7f090d104640 1 -- 172.21.15.7:0/3905625908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563637f092e0 msgr2=0x563637f13190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:17.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.544+0000 7f090d104640 1 --2- 172.21.15.7:0/3905625908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563637f092e0 0x563637f13190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:17.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.544+0000 7f090d104640 1 -- 172.21.15.7:0/3905625908 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563637b7f210 con 0x563637f089a0 2024-09-19T04:24:17.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.544+0000 7f090c903640 1 --2- 172.21.15.7:0/3905625908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563637f092e0 0x563637f13190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:24:17.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.544+0000 7f090d104640 1 --2- 172.21.15.7:0/3905625908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563637f089a0 0x563637f12c50 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0904009830 tx=0x7f0904003e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b3cb7f251e8021 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:17.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.544+0000 7f08f0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:24:17.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.544+0000 7f08f0ff9640 1 -- 172.21.15.7:0/3905625908 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f090409b7e0 con 0x563637f089a0 2024-09-19T04:24:17.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.544+0000 7f08f0ff9640 1 -- 172.21.15.7:0/3905625908 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f090409b980 con 0x563637f089a0 2024-09-19T04:24:17.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.544+0000 7f09121d9740 1 -- 172.21.15.7:0/3905625908 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09040a5000 con 0x563637f089a0 2024-09-19T04:24:17.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.544+0000 7f08f0ff9640 1 -- 172.21.15.7:0/3905625908 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f0904067120 con 0x563637f089a0 2024-09-19T04:24:17.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.544+0000 7f09121d9740 10 client.16176 fetch_fsmap learned FSMap version 38 2024-09-19T04:24:17.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.544+0000 7f09121d9740 1 -- 172.21.15.7:0/3905625908 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x563637c4b620 con 0x563637f089a0 2024-09-19T04:24:17.552 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.545+0000 7f08f0ff9640 1 -- 172.21.15.7:0/3905625908 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09040a5000 con 0x563637f089a0 2024-09-19T04:24:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.545+0000 7f08f0ff9640 1 -- 172.21.15.7:0/3905625908 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 38) ==== 8378+0+0 (secure 0 0 0) 0x7f09040a0170 con 0x563637f089a0 2024-09-19T04:24:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.545+0000 7f09121d9740 10 client.16176 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T04:24:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.545+0000 7f09121d9740 10 client.16176 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:24:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.545+0000 7f09121d9740 20 client.16176 populate_metadata read hostname 'smithi007' 2024-09-19T04:24:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.545+0000 7f09121d9740 1 --2- 172.21.15.7:0/3905625908 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x563637f1e4d0 0x563637f208c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.545+0000 7f09121d9740 4 client.16176 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:24:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.545+0000 7f09121d9740 1 -- 172.21.15.7:0/3905625908 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563637e79a20 con 0x563637f1e4d0 2024-09-19T04:24:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.545+0000 7f090c903640 1 --2- 172.21.15.7:0/3905625908 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x563637f1e4d0 0x563637f208c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.546+0000 7f08f0ff9640 10 client.16176 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:24:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.546+0000 7f090c903640 1 --2- 172.21.15.7:0/3905625908 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x563637f1e4d0 0x563637f208c0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec40e53580106670 server_cookie=3bb72324f9ecd83f in_seq=0 out_seq=0 2024-09-19T04:24:17.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.596+0000 7f08f0ff9640 1 -- 172.21.15.7:0/3905625908 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563637e79a20 con 0x563637f1e4d0 2024-09-19T04:24:17.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.596+0000 7f08f0ff9640 10 client.16176 handle_command_reply: tid=0 2024-09-19T04:24:17.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.596+0000 7f09121d9740 1 client.16176 shutdown 2024-09-19T04:24:17.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.596+0000 7f09121d9740 1 -- 172.21.15.7:0/3905625908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563637f089a0 msgr2=0x563637f12c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:17.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.596+0000 7f09121d9740 1 --2- 172.21.15.7:0/3905625908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563637f089a0 0x563637f12c50 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0904009830 tx=0x7f0904003e30 comp rx=0 tx=0).stop 2024-09-19T04:24:17.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.596+0000 7f09121d9740 1 -- 172.21.15.7:0/3905625908 shutdown_connections 2024-09-19T04:24:17.598 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.596+0000 7f09121d9740 1 --2- 172.21.15.7:0/3905625908 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x563637f1e4d0 0x563637f208c0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:17.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.596+0000 7f09121d9740 1 --2- 172.21.15.7:0/3905625908 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563637f0e370 0x563637f1a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:17.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.596+0000 7f09121d9740 1 --2- 172.21.15.7:0/3905625908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563637f092e0 0x563637f13190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:17.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.596+0000 7f08f0ff9640 0 client.16176 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:24:17.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.596+0000 7f09121d9740 1 --2- 172.21.15.7:0/3905625908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563637f089a0 0x563637f12c50 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:17.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.596+0000 7f09121d9740 1 -- 172.21.15.7:0/3905625908 >> 172.21.15.7:0/3905625908 conn(0x563637f04010 msgr2=0x563637f05820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:17.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.596+0000 7f09121d9740 1 -- 172.21.15.7:0/3905625908 shutdown_connections 2024-09-19T04:24:17.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.596+0000 7f09121d9740 1 -- 172.21.15.7:0/3905625908 wait complete. 2024-09-19T04:24:17.599 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.596+0000 7f09121d9740 20 client.16176 trim_cache size 0 max 16384 2024-09-19T04:24:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.614+0000 7f09121d9740 1 Processor -- start 2024-09-19T04:24:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.614+0000 7f09121d9740 1 -- start start 2024-09-19T04:24:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.614+0000 7f09121d9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563637f04010 0x563637f13220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:17.616 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.614+0000 7f09121d9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563637f089a0 0x563637f1a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:17.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.614+0000 7f09121d9740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563637f092e0 0x563637f030b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:17.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.614+0000 7f09121d9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f09081aa980 con 0x563637f04010 2024-09-19T04:24:17.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.614+0000 7f09121d9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f09081ac4f0 con 0x563637f089a0 2024-09-19T04:24:17.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.614+0000 7f09121d9740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f09081ab050 con 0x563637f092e0 2024-09-19T04:24:17.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.614+0000 7f090d104640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563637f04010 0x563637f13220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:17.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.614+0000 7f090d104640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563637f04010 0x563637f13220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53018/0 (socket says 172.21.15.7:53018) 2024-09-19T04:24:17.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.614+0000 7f090d104640 1 -- 172.21.15.7:0/655026563 learned_addr learned my addr 172.21.15.7:0/655026563 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:17.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.614+0000 7f090c903640 1 --2- 172.21.15.7:0/655026563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563637f089a0 0x563637f1a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:17.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.614+0000 7f090d905640 1 --2- 172.21.15.7:0/655026563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563637f092e0 0x563637f030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:17.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.614+0000 7f090d104640 1 -- 172.21.15.7:0/655026563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563637f092e0 msgr2=0x563637f030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:17.617 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.614+0000 7f090d104640 1 --2- 172.21.15.7:0/655026563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563637f092e0 0x563637f030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:17.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.614+0000 7f090d104640 1 -- 172.21.15.7:0/655026563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563637f089a0 msgr2=0x563637f1a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:17.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.614+0000 7f090d104640 1 --2- 172.21.15.7:0/655026563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563637f089a0 0x563637f1a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:17.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.614+0000 7f090d104640 1 -- 172.21.15.7:0/655026563 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563637f085e0 con 0x563637f04010 2024-09-19T04:24:17.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.614+0000 7f090d905640 1 --2- 172.21.15.7:0/655026563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563637f092e0 0x563637f030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:24:17.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.615+0000 7f090d104640 1 --2- 172.21.15.7:0/655026563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563637f04010 0x563637f13220 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0904098d60 tx=0x7f090409a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da53c3d4f9700b02 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:17.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.615+0000 7f08f2ffd640 1 -- 172.21.15.7:0/655026563 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09040b5050 con 0x563637f04010 2024-09-19T04:24:17.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.615+0000 7f08f2ffd640 1 -- 172.21.15.7:0/655026563 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0904003b30 con 0x563637f04010 2024-09-19T04:24:17.618 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.615+0000 7f08f2ffd640 1 -- 172.21.15.7:0/655026563 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f090409ba40 con 0x563637f04010 2024-09-19T04:24:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.615+0000 7f09121d9740 1 -- 172.21.15.7:0/655026563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563637f04010 msgr2=0x563637f13220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.615+0000 7f09121d9740 1 --2- 172.21.15.7:0/655026563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563637f04010 0x563637f13220 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0904098d60 tx=0x7f090409a8a0 comp rx=0 tx=0).stop 2024-09-19T04:24:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.615+0000 7f09121d9740 1 -- 172.21.15.7:0/655026563 shutdown_connections 2024-09-19T04:24:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.615+0000 7f09121d9740 1 --2- 172.21.15.7:0/655026563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563637f092e0 0x563637f030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.615+0000 7f09121d9740 1 --2- 172.21.15.7:0/655026563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563637f089a0 0x563637f1a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.615+0000 7f09121d9740 1 --2- 172.21.15.7:0/655026563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563637f04010 0x563637f13220 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:17.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.615+0000 7f09121d9740 1 -- 172.21.15.7:0/655026563 >> 172.21.15.7:0/655026563 conn(0x563637f0dec0 msgr2=0x563637f029a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.615+0000 7f09121d9740 1 -- 172.21.15.7:0/655026563 shutdown_connections 2024-09-19T04:24:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.615+0000 7f09121d9740 1 -- 172.21.15.7:0/655026563 wait complete. 2024-09-19T04:24:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.616+0000 7f09121d9740 1 -- start start 2024-09-19T04:24:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.616+0000 7f09121d9740 1 Processor -- start 2024-09-19T04:24:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.616+0000 7f09121d9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563637f04010 0x563637f17720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.616+0000 7f09121d9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563637f089a0 0x563637f17c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.616+0000 7f09121d9740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563637f092e0 0x563637f18c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.616+0000 7f09121d9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f09081abdf0 con 0x563637f089a0 2024-09-19T04:24:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.616+0000 7f09121d9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f09081ab720 con 0x563637f04010 2024-09-19T04:24:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.616+0000 7f09121d9740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f09081a8940 con 0x563637f092e0 2024-09-19T04:24:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.616+0000 7f09121d9740 10 client.0 _ll_register_callbacks cb 0x7f09040b3070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:24:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.616+0000 7f090c903640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563637f089a0 0x563637f17c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:17.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.616+0000 7f090c903640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563637f089a0 0x563637f17c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53022/0 (socket says 172.21.15.7:53022) 2024-09-19T04:24:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.616+0000 7f090c903640 1 -- 172.21.15.7:0/3223692396 learned_addr learned my addr 172.21.15.7:0/3223692396 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.616+0000 7f090d104640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563637f04010 0x563637f17720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.616+0000 7f090d905640 1 --2- 172.21.15.7:0/3223692396 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563637f092e0 0x563637f18c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.617+0000 7f090c903640 1 -- 172.21.15.7:0/3223692396 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563637f092e0 msgr2=0x563637f18c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.617+0000 7f090c903640 1 --2- 172.21.15.7:0/3223692396 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563637f092e0 0x563637f18c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.617+0000 7f090c903640 1 -- 172.21.15.7:0/3223692396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563637f04010 msgr2=0x563637f17720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.617+0000 7f090c903640 1 --2- 172.21.15.7:0/3223692396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563637f04010 0x563637f17720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.617+0000 7f090c903640 1 -- 172.21.15.7:0/3223692396 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563637f19280 con 0x563637f089a0 2024-09-19T04:24:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.617+0000 7f090d104640 1 --2- 172.21.15.7:0/3223692396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563637f04010 0x563637f17720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:24:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.617+0000 7f090c903640 1 --2- 172.21.15.7:0/3223692396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563637f089a0 0x563637f17c60 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f08f80129f0 tx=0x7f08f8012f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88f47de4b34be62 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.617+0000 7f08f0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:24:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.617+0000 7f08f0ff9640 1 -- 172.21.15.7:0/3223692396 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f8020d10 con 0x563637f089a0 2024-09-19T04:24:17.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.617+0000 7f08f0ff9640 1 -- 172.21.15.7:0/3223692396 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f08f8004030 con 0x563637f089a0 2024-09-19T04:24:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.617+0000 7f09121d9740 1 -- 172.21.15.7:0/3223692396 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0904003b30 con 0x563637f089a0 2024-09-19T04:24:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.617+0000 7f08f0ff9640 1 -- 172.21.15.7:0/3223692396 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f08f8004230 con 0x563637f089a0 2024-09-19T04:24:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.617+0000 7f09121d9740 10 client.16182 fetch_fsmap learned FSMap version 38 2024-09-19T04:24:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.617+0000 7f09121d9740 1 -- 172.21.15.7:0/3223692396 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x563637f89060 con 0x563637f089a0 2024-09-19T04:24:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.617+0000 7f08f0ff9640 1 -- 172.21.15.7:0/3223692396 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0904003b30 con 0x563637f089a0 2024-09-19T04:24:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.618+0000 7f08f0ff9640 1 -- 172.21.15.7:0/3223692396 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 38) ==== 8378+0+0 (secure 0 0 0) 0x7f08f8004a40 con 0x563637f089a0 2024-09-19T04:24:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.618+0000 7f09121d9740 10 client.16182 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T04:24:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.618+0000 7f09121d9740 10 client.16182 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:24:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.618+0000 7f09121d9740 20 client.16182 populate_metadata read hostname 'smithi007' 2024-09-19T04:24:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.618+0000 7f09121d9740 1 --2- 172.21.15.7:0/3223692396 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x563637f0e370 0x563637f8b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.618+0000 7f09121d9740 4 client.16182 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:24:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.618+0000 7f09121d9740 1 -- 172.21.15.7:0/3223692396 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563637e73d70 con 0x563637f0e370 2024-09-19T04:24:17.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.618+0000 7f090d104640 1 --2- 172.21.15.7:0/3223692396 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x563637f0e370 0x563637f8b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.618+0000 7f090d104640 1 --2- 172.21.15.7:0/3223692396 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x563637f0e370 0x563637f8b990 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d337eec4ad5cfb72 server_cookie=ef367fa90918295c in_seq=0 out_seq=0 2024-09-19T04:24:17.625 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:17.618+0000 7f08f0ff9640 10 client.16182 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:24:18.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:18.941+0000 7f08f0ff9640 1 -- 172.21.15.7:0/3223692396 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563637e73d70 con 0x563637f0e370 2024-09-19T04:24:18.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:18.941+0000 7f08f0ff9640 10 client.16182 handle_command_reply: tid=0 2024-09-19T04:24:18.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:18.941+0000 7f09121d9740 1 client.16182 shutdown 2024-09-19T04:24:18.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:18.941+0000 7f09121d9740 1 -- 172.21.15.7:0/3223692396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563637f089a0 msgr2=0x563637f17c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:18.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:18.941+0000 7f09121d9740 1 --2- 172.21.15.7:0/3223692396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563637f089a0 0x563637f17c60 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f08f80129f0 tx=0x7f08f8012f90 comp rx=0 tx=0).stop 2024-09-19T04:24:18.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:18.941+0000 7f09121d9740 1 -- 172.21.15.7:0/3223692396 shutdown_connections 2024-09-19T04:24:18.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:18.941+0000 7f09121d9740 1 --2- 172.21.15.7:0/3223692396 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x563637f0e370 0x563637f8b990 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:18.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:18.941+0000 7f09121d9740 1 --2- 172.21.15.7:0/3223692396 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563637f092e0 0x563637f18c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:18.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:18.941+0000 7f08f0ff9640 0 client.16182 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:24:18.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:18.941+0000 7f09121d9740 1 --2- 172.21.15.7:0/3223692396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563637f089a0 0x563637f17c60 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:18.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:18.941+0000 7f09121d9740 1 --2- 172.21.15.7:0/3223692396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563637f04010 0x563637f17720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:18.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:18.941+0000 7f09121d9740 1 -- 172.21.15.7:0/3223692396 >> 172.21.15.7:0/3223692396 conn(0x563637f0dec0 msgr2=0x563637f031c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:18.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:18.942+0000 7f09121d9740 1 -- 172.21.15.7:0/3223692396 shutdown_connections 2024-09-19T04:24:18.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:18.942+0000 7f09121d9740 1 -- 172.21.15.7:0/3223692396 wait complete. 2024-09-19T04:24:18.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:18.942+0000 7f09121d9740 20 client.16182 trim_cache size 0 max 16384 2024-09-19T04:24:18.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:24:18.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:24:18.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:24:18.945 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:24:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:18.942+0000 7f090f368640 1 -- 172.21.15.7:0/2888793243 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f08f40a3240 msgr2=0x7f08f40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:18.942+0000 7f090f368640 1 --2- 172.21.15.7:0/2888793243 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f08f40a3240 0x7f08f40a5700 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0900031c10 tx=0x7f0900009890 comp rx=0 tx=0).stop 2024-09-19T04:24:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:18.942+0000 7f090f368640 1 -- 172.21.15.7:0/2888793243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0908101b70 msgr2=0x7f0908197e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:18.942+0000 7f090f368640 1 --2- 172.21.15.7:0/2888793243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0908101b70 0x7f0908197e30 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f090400e9c0 tx=0x7f090400ee80 comp rx=0 tx=0).stop 2024-09-19T04:24:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:18.942+0000 7f090f368640 1 -- 172.21.15.7:0/2888793243 shutdown_connections 2024-09-19T04:24:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:18.942+0000 7f090f368640 1 --2- 172.21.15.7:0/2888793243 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f08f40a3240 0x7f08f40a5700 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:18.942+0000 7f090f368640 1 --2- 172.21.15.7:0/2888793243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0908103720 0x7f090819f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:18.942+0000 7f090f368640 1 --2- 172.21.15.7:0/2888793243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0908102d60 0x7f0908198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:18.942+0000 7f090f368640 1 --2- 172.21.15.7:0/2888793243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0908101b70 0x7f0908197e30 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:18.942+0000 7f090f368640 1 -- 172.21.15.7:0/2888793243 >> 172.21.15.7:0/2888793243 conn(0x7f09080fd2f0 msgr2=0x7f09081060e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:18.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:18.943+0000 7f090f368640 1 -- 172.21.15.7:0/2888793243 shutdown_connections 2024-09-19T04:24:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:18.943+0000 7f090f368640 1 -- 172.21.15.7:0/2888793243 wait complete. 2024-09-19T04:24:19.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:19 smithi007 ceph-mon[31360]: pgmap v576: 129 pgs: 129 active+clean; 498 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 1.2 MiB/s wr, 847 op/s 2024-09-19T04:24:19.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:19 smithi102 ceph-mon[35446]: pgmap v576: 129 pgs: 129 active+clean; 498 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 1.2 MiB/s wr, 847 op/s 2024-09-19T04:24:19.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:19 smithi092 ceph-mon[34940]: pgmap v576: 129 pgs: 129 active+clean; 498 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 1.2 MiB/s wr, 847 op/s 2024-09-19T04:24:21.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:21 smithi007 ceph-mon[31360]: pgmap v577: 129 pgs: 129 active+clean; 493 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 833 op/s 2024-09-19T04:24:21.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:21 smithi102 ceph-mon[35446]: pgmap v577: 129 pgs: 129 active+clean; 493 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 833 op/s 2024-09-19T04:24:21.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:21 smithi092 ceph-mon[34940]: pgmap v577: 129 pgs: 129 active+clean; 493 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 833 op/s 2024-09-19T04:24:23.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:23 smithi007 ceph-mon[31360]: pgmap v578: 129 pgs: 129 active+clean; 493 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 824 KiB/s wr, 482 op/s 2024-09-19T04:24:23.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:23 smithi102 ceph-mon[35446]: pgmap v578: 129 pgs: 129 active+clean; 493 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 824 KiB/s wr, 482 op/s 2024-09-19T04:24:23.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:23 smithi092 ceph-mon[34940]: pgmap v578: 129 pgs: 129 active+clean; 493 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 824 KiB/s wr, 482 op/s 2024-09-19T04:24:25.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:25 smithi007 ceph-mon[31360]: pgmap v579: 129 pgs: 129 active+clean; 490 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 576 op/s 2024-09-19T04:24:25.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:25 smithi102 ceph-mon[35446]: pgmap v579: 129 pgs: 129 active+clean; 490 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 576 op/s 2024-09-19T04:24:25.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:25 smithi092 ceph-mon[34940]: pgmap v579: 129 pgs: 129 active+clean; 490 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 576 op/s 2024-09-19T04:24:27.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:27 smithi007 ceph-mon[31360]: pgmap v580: 129 pgs: 129 active+clean; 495 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 1.6 MiB/s wr, 611 op/s 2024-09-19T04:24:27.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:27 smithi102 ceph-mon[35446]: pgmap v580: 129 pgs: 129 active+clean; 495 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 1.6 MiB/s wr, 611 op/s 2024-09-19T04:24:27.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:27 smithi092 ceph-mon[34940]: pgmap v580: 129 pgs: 129 active+clean; 495 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 1.6 MiB/s wr, 611 op/s 2024-09-19T04:24:29.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:29 smithi007 ceph-mon[31360]: pgmap v581: 129 pgs: 129 active+clean; 495 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 866 KiB/s rd, 1.6 MiB/s wr, 453 op/s 2024-09-19T04:24:29.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:29 smithi102 ceph-mon[35446]: pgmap v581: 129 pgs: 129 active+clean; 495 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 866 KiB/s rd, 1.6 MiB/s wr, 453 op/s 2024-09-19T04:24:29.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:29 smithi092 ceph-mon[34940]: pgmap v581: 129 pgs: 129 active+clean; 495 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 866 KiB/s rd, 1.6 MiB/s wr, 453 op/s 2024-09-19T04:24:31.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:31 smithi007 ceph-mon[31360]: pgmap v582: 129 pgs: 129 active+clean; 497 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 608 op/s 2024-09-19T04:24:31.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:31 smithi102 ceph-mon[35446]: pgmap v582: 129 pgs: 129 active+clean; 497 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 608 op/s 2024-09-19T04:24:31.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:31 smithi092 ceph-mon[34940]: pgmap v582: 129 pgs: 129 active+clean; 497 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.1 MiB/s wr, 608 op/s 2024-09-19T04:24:32.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.037+0000 7f337e277640 1 -- 172.21.15.7:0/2294353339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33781025f0 msgr2=0x7f3378108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:32.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.037+0000 7f337e277640 1 --2- 172.21.15.7:0/2294353339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33781025f0 0x7f3378108e80 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f3370009ca0 tx=0x7f337002a8c0 comp rx=0 tx=0).stop 2024-09-19T04:24:32.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.037+0000 7f337e277640 1 -- 172.21.15.7:0/2294353339 shutdown_connections 2024-09-19T04:24:32.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.037+0000 7f337e277640 1 --2- 172.21.15.7:0/2294353339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33781025f0 0x7f3378108e80 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:32.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.037+0000 7f337e277640 1 --2- 172.21.15.7:0/2294353339 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3378101c30 0x7f33781020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:32.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.037+0000 7f337e277640 1 --2- 172.21.15.7:0/2294353339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3378100a40 0x7f3378100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:32.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.037+0000 7f337e277640 1 -- 172.21.15.7:0/2294353339 >> 172.21.15.7:0/2294353339 conn(0x7f33780fc1c0 msgr2=0x7f33780fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:32.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.037+0000 7f337e277640 1 -- 172.21.15.7:0/2294353339 shutdown_connections 2024-09-19T04:24:32.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.037+0000 7f337e277640 1 -- 172.21.15.7:0/2294353339 wait complete. 2024-09-19T04:24:32.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.037+0000 7f337e277640 1 Processor -- start 2024-09-19T04:24:32.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.038+0000 7f337e277640 1 -- start start 2024-09-19T04:24:32.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.038+0000 7f337e277640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3378100a40 0x7f33781049d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:32.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.038+0000 7f337e277640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3378101c30 0x7f3378103010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:32.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.038+0000 7f337e277640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33781025f0 0x7f3378103550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:32.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.038+0000 7f337e277640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f337810c6a0 con 0x7f3378101c30 2024-09-19T04:24:32.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.038+0000 7f337e277640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f337810c520 con 0x7f33781025f0 2024-09-19T04:24:32.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.038+0000 7f337e277640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f337810c820 con 0x7f3378100a40 2024-09-19T04:24:32.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.038+0000 7f336ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3378101c30 0x7f3378103010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:32.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.038+0000 7f3377fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3378100a40 0x7f33781049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:32.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.038+0000 7f336ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3378101c30 0x7f3378103010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60218/0 (socket says 172.21.15.7:60218) 2024-09-19T04:24:32.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.038+0000 7f336ffff640 1 -- 172.21.15.7:0/922708803 learned_addr learned my addr 172.21.15.7:0/922708803 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:32.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.038+0000 7f337c814640 1 --2- 172.21.15.7:0/922708803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33781025f0 0x7f3378103550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:32.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.038+0000 7f336ffff640 1 -- 172.21.15.7:0/922708803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3378100a40 msgr2=0x7f33781049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:32.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.038+0000 7f336ffff640 1 --2- 172.21.15.7:0/922708803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3378100a40 0x7f33781049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:32.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.038+0000 7f336ffff640 1 -- 172.21.15.7:0/922708803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33781025f0 msgr2=0x7f3378103550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:32.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.038+0000 7f336ffff640 1 --2- 172.21.15.7:0/922708803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33781025f0 0x7f3378103550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:32.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.038+0000 7f336ffff640 1 -- 172.21.15.7:0/922708803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3378103de0 con 0x7f3378101c30 2024-09-19T04:24:32.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.038+0000 7f336ffff640 1 --2- 172.21.15.7:0/922708803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3378101c30 0x7f3378103010 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f336000e9f0 tx=0x7f336000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:32.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.039+0000 7f3375ffb640 1 -- 172.21.15.7:0/922708803 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336000cd80 con 0x7f3378101c30 2024-09-19T04:24:32.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.039+0000 7f3375ffb640 1 -- 172.21.15.7:0/922708803 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3360010910 con 0x7f3378101c30 2024-09-19T04:24:32.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.039+0000 7f3375ffb640 1 -- 172.21.15.7:0/922708803 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3360018990 con 0x7f3378101c30 2024-09-19T04:24:32.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.039+0000 7f337e277640 1 -- 172.21.15.7:0/922708803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33781a1fa0 con 0x7f3378101c30 2024-09-19T04:24:32.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.039+0000 7f337e277640 1 -- 172.21.15.7:0/922708803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33781a2400 con 0x7f3378101c30 2024-09-19T04:24:32.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.041+0000 7f3375ffb640 1 -- 172.21.15.7:0/922708803 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f3360010ac0 con 0x7f3378101c30 2024-09-19T04:24:32.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.041+0000 7f3381012740 1 Processor -- start 2024-09-19T04:24:32.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.042+0000 7f3381012740 1 -- start start 2024-09-19T04:24:32.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.042+0000 7f3381012740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6633a19a0 0x55a6633a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:32.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.042+0000 7f3381012740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6633a22e0 0x55a6633a6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:32.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.042+0000 7f3381012740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6633a7370 0x55a6633a9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:32.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.042+0000 7f3381012740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a6633052f0 con 0x55a6633a19a0 2024-09-19T04:24:32.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.042+0000 7f3381012740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a6632ad270 con 0x55a6633a22e0 2024-09-19T04:24:32.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.042+0000 7f3381012740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a6633012b0 con 0x55a6633a7370 2024-09-19T04:24:32.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.042+0000 7f337c814640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6633a19a0 0x55a6633a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:32.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.042+0000 7f336ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6633a7370 0x55a6633a9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:32.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.042+0000 7f337c814640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6633a19a0 0x55a6633a1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60226/0 (socket says 172.21.15.7:60226) 2024-09-19T04:24:32.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.042+0000 7f337c814640 1 -- 172.21.15.7:0/9105648 learned_addr learned my addr 172.21.15.7:0/9105648 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:32.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.042+0000 7f3377fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6633a22e0 0x55a6633a6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.042+0000 7f3375ffb640 1 --2- 172.21.15.7:0/922708803 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f33640a3240 0x7f33640a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.042+0000 7f337c814640 1 -- 172.21.15.7:0/9105648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6633a7370 msgr2=0x55a6633a9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.042+0000 7f337c814640 1 --2- 172.21.15.7:0/9105648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6633a7370 0x55a6633a9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.042+0000 7f337c814640 1 -- 172.21.15.7:0/9105648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6633a22e0 msgr2=0x55a6633a6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.042+0000 7f337c814640 1 --2- 172.21.15.7:0/9105648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6633a22e0 0x55a6633a6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.042+0000 7f337c814640 1 -- 172.21.15.7:0/9105648 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6632ac340 con 0x55a6633a19a0 2024-09-19T04:24:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.042+0000 7f336ffff640 1 --2- 172.21.15.7:0/9105648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6633a7370 0x55a6633a9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:24:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.042+0000 7f3377fff640 1 --2- 172.21.15.7:0/9105648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6633a22e0 0x55a6633a6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:24:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.042+0000 7f3375ffb640 1 -- 172.21.15.7:0/922708803 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f33600cffb0 con 0x7f3378101c30 2024-09-19T04:24:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.042+0000 7f337c814640 1 --2- 172.21.15.7:0/922708803 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f33640a3240 0x7f33640a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.043+0000 7f337c814640 1 --2- 172.21.15.7:0/9105648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6633a19a0 0x55a6633a1da0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f3370035000 tx=0x7f3370004a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b0a9672bc24cea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.043+0000 7f336e7fc640 1 -- 172.21.15.7:0/9105648 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3370042040 con 0x55a6633a19a0 2024-09-19T04:24:32.050 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.043+0000 7f336e7fc640 1 -- 172.21.15.7:0/9105648 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3370044070 con 0x55a6633a19a0 2024-09-19T04:24:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.043+0000 7f336e7fc640 1 -- 172.21.15.7:0/9105648 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3370048430 con 0x55a6633a19a0 2024-09-19T04:24:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.044+0000 7f3381012740 1 -- 172.21.15.7:0/9105648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6633a19a0 msgr2=0x55a6633a1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.044+0000 7f3381012740 1 --2- 172.21.15.7:0/9105648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6633a19a0 0x55a6633a1da0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f3370035000 tx=0x7f3370004a90 comp rx=0 tx=0).stop 2024-09-19T04:24:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.044+0000 7f337c814640 1 --2- 172.21.15.7:0/922708803 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f33640a3240 0x7f33640a5700 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f337004d000 tx=0x7f337004e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.044+0000 7f3381012740 1 -- 172.21.15.7:0/9105648 shutdown_connections 2024-09-19T04:24:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.044+0000 7f3381012740 1 --2- 172.21.15.7:0/9105648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6633a7370 0x55a6633a9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.044+0000 7f3381012740 1 --2- 172.21.15.7:0/9105648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6633a22e0 0x55a6633a6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.044+0000 7f3381012740 1 --2- 172.21.15.7:0/9105648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6633a19a0 0x55a6633a1da0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.044+0000 7f3381012740 1 -- 172.21.15.7:0/9105648 >> 172.21.15.7:0/9105648 conn(0x55a66339d010 msgr2=0x55a66339d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.044+0000 7f3381012740 1 -- 172.21.15.7:0/9105648 shutdown_connections 2024-09-19T04:24:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.044+0000 7f3381012740 1 -- 172.21.15.7:0/9105648 wait complete. 2024-09-19T04:24:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.044+0000 7f3381012740 1 -- start start 2024-09-19T04:24:32.051 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.044+0000 7f3381012740 1 Processor -- start 2024-09-19T04:24:32.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.044+0000 7f3381012740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6633a19a0 0x55a6633abc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:32.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.044+0000 7f3381012740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6633a22e0 0x55a6633ac170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:32.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.045+0000 7f3381012740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6633a7370 0x55a6633b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:32.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.045+0000 7f3381012740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a6633aa340 con 0x55a6633a19a0 2024-09-19T04:24:32.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.045+0000 7f3381012740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a66328e290 con 0x55a6633a7370 2024-09-19T04:24:32.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.045+0000 7f3381012740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a6633aa4c0 con 0x55a6633a22e0 2024-09-19T04:24:32.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.045+0000 7f3381012740 10 client.0 _ll_register_callbacks cb 0x55a6632bf140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:24:32.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.045+0000 7f3377fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6633a19a0 0x55a6633abc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:32.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.045+0000 7f3377fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6633a19a0 0x55a6633abc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60232/0 (socket says 172.21.15.7:60232) 2024-09-19T04:24:32.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.045+0000 7f3377fff640 1 -- 172.21.15.7:0/8232507 learned_addr learned my addr 172.21.15.7:0/8232507 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:32.052 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.045+0000 7f337c814640 1 --2- 172.21.15.7:0/8232507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6633a7370 0x55a6633b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:32.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.045+0000 7f336ffff640 1 --2- 172.21.15.7:0/8232507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6633a22e0 0x55a6633ac170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:32.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.045+0000 7f3377fff640 1 -- 172.21.15.7:0/8232507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6633a22e0 msgr2=0x55a6633ac170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:32.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.045+0000 7f3377fff640 1 --2- 172.21.15.7:0/8232507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6633a22e0 0x55a6633ac170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:32.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.045+0000 7f3377fff640 1 -- 172.21.15.7:0/8232507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6633a7370 msgr2=0x55a6633b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:32.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.045+0000 7f3377fff640 1 --2- 172.21.15.7:0/8232507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6633a7370 0x55a6633b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:32.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.045+0000 7f3377fff640 1 -- 172.21.15.7:0/8232507 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a663018210 con 0x55a6633a19a0 2024-09-19T04:24:32.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.045+0000 7f3377fff640 1 --2- 172.21.15.7:0/8232507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6633a19a0 0x55a6633abc30 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3368012700 tx=0x7f3368012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe4f7ddf3067981a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:32.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.045+0000 7f33577fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:24:32.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.045+0000 7f33577fe640 1 -- 172.21.15.7:0/8232507 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336800f920 con 0x55a6633a19a0 2024-09-19T04:24:32.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.045+0000 7f33577fe640 1 -- 172.21.15.7:0/8232507 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f336800fac0 con 0x55a6633a19a0 2024-09-19T04:24:32.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.045+0000 7f3381012740 1 -- 172.21.15.7:0/8232507 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3370044070 con 0x55a6633a19a0 2024-09-19T04:24:32.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.046+0000 7f33577fe640 1 -- 172.21.15.7:0/8232507 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f336800fcc0 con 0x55a6633a19a0 2024-09-19T04:24:32.053 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.046+0000 7f3381012740 10 client.16194 fetch_fsmap learned FSMap version 38 2024-09-19T04:24:32.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.046+0000 7f3381012740 1 -- 172.21.15.7:0/8232507 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55a6630e4620 con 0x55a6633a19a0 2024-09-19T04:24:32.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.046+0000 7f33577fe640 1 -- 172.21.15.7:0/8232507 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3370044070 con 0x55a6633a19a0 2024-09-19T04:24:32.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.046+0000 7f33577fe640 1 -- 172.21.15.7:0/8232507 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 38) ==== 8378+0+0 (secure 0 0 0) 0x7f336801c420 con 0x55a6633a19a0 2024-09-19T04:24:32.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.046+0000 7f3381012740 10 client.16194 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T04:24:32.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.046+0000 7f3381012740 10 client.16194 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:24:32.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.046+0000 7f3381012740 20 client.16194 populate_metadata read hostname 'smithi007' 2024-09-19T04:24:32.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.046+0000 7f3381012740 1 --2- 172.21.15.7:0/8232507 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55a6633b79c0 0x55a6633b9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:32.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.046+0000 7f3381012740 4 client.16194 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:24:32.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.046+0000 7f3381012740 1 -- 172.21.15.7:0/8232507 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a663312a20 con 0x55a6633b79c0 2024-09-19T04:24:32.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.046+0000 7f336ffff640 1 --2- 172.21.15.7:0/8232507 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55a6633b79c0 0x55a6633b9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:32.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.047+0000 7f33577fe640 10 client.16194 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:24:32.054 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.047+0000 7f336ffff640 1 --2- 172.21.15.7:0/8232507 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55a6633b79c0 0x55a6633b9e00 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56800bee871fddc4 server_cookie=4d791b9d5e24ea18 in_seq=0 out_seq=0 2024-09-19T04:24:32.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.050+0000 7f33577fe640 1 -- 172.21.15.7:0/8232507 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a663312a20 con 0x55a6633b79c0 2024-09-19T04:24:32.055 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.050+0000 7f33577fe640 10 client.16194 handle_command_reply: tid=0 2024-09-19T04:24:32.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.050+0000 7f3381012740 1 client.16194 shutdown 2024-09-19T04:24:32.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.050+0000 7f3381012740 1 -- 172.21.15.7:0/8232507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6633a19a0 msgr2=0x55a6633abc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:32.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.050+0000 7f3381012740 1 --2- 172.21.15.7:0/8232507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6633a19a0 0x55a6633abc30 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3368012700 tx=0x7f3368012bc0 comp rx=0 tx=0).stop 2024-09-19T04:24:32.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.050+0000 7f3381012740 1 -- 172.21.15.7:0/8232507 shutdown_connections 2024-09-19T04:24:32.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.050+0000 7f3381012740 1 --2- 172.21.15.7:0/8232507 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55a6633b79c0 0x55a6633b9e00 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:32.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.050+0000 7f3381012740 1 --2- 172.21.15.7:0/8232507 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6633a7370 0x55a6633b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:32.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.050+0000 7f3381012740 1 --2- 172.21.15.7:0/8232507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6633a22e0 0x55a6633ac170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:32.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.050+0000 7f33577fe640 0 client.16194 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:24:32.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.050+0000 7f3381012740 1 --2- 172.21.15.7:0/8232507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6633a19a0 0x55a6633abc30 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:32.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.050+0000 7f3381012740 1 -- 172.21.15.7:0/8232507 >> 172.21.15.7:0/8232507 conn(0x55a66339d010 msgr2=0x55a66339e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:32.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.050+0000 7f3381012740 1 -- 172.21.15.7:0/8232507 shutdown_connections 2024-09-19T04:24:32.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.050+0000 7f3381012740 1 -- 172.21.15.7:0/8232507 wait complete. 2024-09-19T04:24:32.056 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.051+0000 7f3381012740 20 client.16194 trim_cache size 0 max 16384 2024-09-19T04:24:32.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.065+0000 7f3381012740 1 Processor -- start 2024-09-19T04:24:32.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.065+0000 7f3381012740 1 -- start start 2024-09-19T04:24:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.065+0000 7f3381012740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6633a19a0 0x55a66339d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.065+0000 7f3381012740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6633a22e0 0x55a6633b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.065+0000 7f3381012740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6633a7370 0x55a66339d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.065+0000 7f3381012740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f33781acab0 con 0x55a6633a19a0 2024-09-19T04:24:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.065+0000 7f3381012740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f33781ae620 con 0x55a6633a7370 2024-09-19T04:24:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.065+0000 7f3381012740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f33781ad180 con 0x55a6633a22e0 2024-09-19T04:24:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.065+0000 7f3377fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6633a19a0 0x55a66339d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.065+0000 7f3377fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6633a19a0 0x55a66339d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60236/0 (socket says 172.21.15.7:60236) 2024-09-19T04:24:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.065+0000 7f3377fff640 1 -- 172.21.15.7:0/700468923 learned_addr learned my addr 172.21.15.7:0/700468923 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.065+0000 7f336ffff640 1 --2- 172.21.15.7:0/700468923 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6633a22e0 0x55a6633b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.065+0000 7f337c814640 1 --2- 172.21.15.7:0/700468923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6633a7370 0x55a66339d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.066+0000 7f3377fff640 1 -- 172.21.15.7:0/700468923 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6633a22e0 msgr2=0x55a6633b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.066+0000 7f3377fff640 1 --2- 172.21.15.7:0/700468923 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6633a22e0 0x55a6633b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.066+0000 7f3377fff640 1 -- 172.21.15.7:0/700468923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6633a7370 msgr2=0x55a66339d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.066+0000 7f3377fff640 1 --2- 172.21.15.7:0/700468923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6633a7370 0x55a66339d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.066+0000 7f3377fff640 1 -- 172.21.15.7:0/700468923 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6633ab770 con 0x55a6633a19a0 2024-09-19T04:24:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.066+0000 7f3377fff640 1 --2- 172.21.15.7:0/700468923 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6633a19a0 0x55a66339d3f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f336801ca80 tx=0x7f3368009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d65c5ed23b3c8cb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.066+0000 7f336dffb640 1 -- 172.21.15.7:0/700468923 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336800f920 con 0x55a6633a19a0 2024-09-19T04:24:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.066+0000 7f336dffb640 1 -- 172.21.15.7:0/700468923 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f336800fac0 con 0x55a6633a19a0 2024-09-19T04:24:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.066+0000 7f336dffb640 1 -- 172.21.15.7:0/700468923 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3368004660 con 0x55a6633a19a0 2024-09-19T04:24:32.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.067+0000 7f3381012740 1 -- 172.21.15.7:0/700468923 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6633a19a0 msgr2=0x55a66339d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:32.072 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.067+0000 7f3381012740 1 --2- 172.21.15.7:0/700468923 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6633a19a0 0x55a66339d3f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f336801ca80 tx=0x7f3368009f20 comp rx=0 tx=0).stop 2024-09-19T04:24:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.067+0000 7f3381012740 1 -- 172.21.15.7:0/700468923 shutdown_connections 2024-09-19T04:24:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.067+0000 7f3381012740 1 --2- 172.21.15.7:0/700468923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6633a7370 0x55a66339d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.067+0000 7f3381012740 1 --2- 172.21.15.7:0/700468923 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6633a22e0 0x55a6633b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.067+0000 7f3381012740 1 --2- 172.21.15.7:0/700468923 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6633a19a0 0x55a66339d3f0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.067+0000 7f3381012740 1 -- 172.21.15.7:0/700468923 >> 172.21.15.7:0/700468923 conn(0x55a66339d010 msgr2=0x55a6633a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.067+0000 7f3381012740 1 -- 172.21.15.7:0/700468923 shutdown_connections 2024-09-19T04:24:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.067+0000 7f3381012740 1 -- 172.21.15.7:0/700468923 wait complete. 2024-09-19T04:24:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.067+0000 7f3381012740 1 -- start start 2024-09-19T04:24:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.067+0000 7f3381012740 1 Processor -- start 2024-09-19T04:24:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.068+0000 7f3381012740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6633a19a0 0x55a6633b0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.068+0000 7f3381012740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6633a22e0 0x55a6633b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:32.074 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.068+0000 7f3381012740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6633a7370 0x55a6633b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:32.074 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.068+0000 7f3381012740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f33781adf20 con 0x55a6633a19a0 2024-09-19T04:24:32.074 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.068+0000 7f3381012740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f33781ad850 con 0x55a6633a7370 2024-09-19T04:24:32.074 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.068+0000 7f3381012740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f33781aaa70 con 0x55a6633a22e0 2024-09-19T04:24:32.074 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.068+0000 7f3381012740 10 client.0 _ll_register_callbacks cb 0x7f3368009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:24:32.074 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.068+0000 7f3377fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6633a19a0 0x55a6633b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:32.074 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.068+0000 7f3377fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6633a19a0 0x55a6633b0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60248/0 (socket says 172.21.15.7:60248) 2024-09-19T04:24:32.074 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.068+0000 7f3377fff640 1 -- 172.21.15.7:0/2017269647 learned_addr learned my addr 172.21.15.7:0/2017269647 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:32.074 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.068+0000 7f336ffff640 1 --2- 172.21.15.7:0/2017269647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6633a22e0 0x55a6633b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:32.074 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.068+0000 7f337c814640 1 --2- 172.21.15.7:0/2017269647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6633a7370 0x55a6633b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:32.074 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.068+0000 7f3377fff640 1 -- 172.21.15.7:0/2017269647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6633a22e0 msgr2=0x55a6633b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:32.074 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.068+0000 7f3377fff640 1 --2- 172.21.15.7:0/2017269647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6633a22e0 0x55a6633b0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:32.074 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.068+0000 7f3377fff640 1 -- 172.21.15.7:0/2017269647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6633a7370 msgr2=0x55a6633b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:32.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.068+0000 7f3377fff640 1 --2- 172.21.15.7:0/2017269647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6633a7370 0x55a6633b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:32.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.068+0000 7f3377fff640 1 -- 172.21.15.7:0/2017269647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6633b21e0 con 0x55a6633a19a0 2024-09-19T04:24:32.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.068+0000 7f3377fff640 1 --2- 172.21.15.7:0/2017269647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6633a19a0 0x55a6633b0680 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f336800a010 tx=0x7f336801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c46cf06a8692e27 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:32.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.068+0000 7f33577fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:24:32.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.068+0000 7f33577fe640 1 -- 172.21.15.7:0/2017269647 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336800f920 con 0x55a6633a19a0 2024-09-19T04:24:32.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.068+0000 7f33577fe640 1 -- 172.21.15.7:0/2017269647 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f3368005320 con 0x55a6633a19a0 2024-09-19T04:24:32.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.069+0000 7f3381012740 1 -- 172.21.15.7:0/2017269647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f336800fac0 con 0x55a6633a19a0 2024-09-19T04:24:32.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.069+0000 7f33577fe640 1 -- 172.21.15.7:0/2017269647 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f3368005520 con 0x55a6633a19a0 2024-09-19T04:24:32.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.069+0000 7f3381012740 10 client.16200 fetch_fsmap learned FSMap version 38 2024-09-19T04:24:32.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.069+0000 7f3381012740 1 -- 172.21.15.7:0/2017269647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55a6634226e0 con 0x55a6633a19a0 2024-09-19T04:24:32.075 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.069+0000 7f33577fe640 1 -- 172.21.15.7:0/2017269647 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f336800fac0 con 0x55a6633a19a0 2024-09-19T04:24:32.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.069+0000 7f33577fe640 1 -- 172.21.15.7:0/2017269647 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 38) ==== 8378+0+0 (secure 0 0 0) 0x7f33680106d0 con 0x55a6633a19a0 2024-09-19T04:24:32.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.069+0000 7f3381012740 10 client.16200 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T04:24:32.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.069+0000 7f3381012740 10 client.16200 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:24:32.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.069+0000 7f3381012740 20 client.16200 populate_metadata read hostname 'smithi007' 2024-09-19T04:24:32.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.069+0000 7f3381012740 1 --2- 172.21.15.7:0/2017269647 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55a663422f20 0x55a663425340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:32.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.069+0000 7f3381012740 4 client.16200 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:24:32.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.069+0000 7f3381012740 1 -- 172.21.15.7:0/2017269647 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a66330cd70 con 0x55a663422f20 2024-09-19T04:24:32.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.069+0000 7f336ffff640 1 --2- 172.21.15.7:0/2017269647 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55a663422f20 0x55a663425340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:32.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.070+0000 7f33577fe640 10 client.16200 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:24:32.076 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:32.070+0000 7f336ffff640 1 --2- 172.21.15.7:0/2017269647 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55a663422f20 0x55a663425340 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13752c7e95a3edad server_cookie=fb0cf992b57a3125 in_seq=0 out_seq=0 2024-09-19T04:24:33.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:33 smithi007 ceph-mon[31360]: pgmap v583: 129 pgs: 129 active+clean; 500 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 638 op/s 2024-09-19T04:24:33.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:33 smithi102 ceph-mon[35446]: pgmap v583: 129 pgs: 129 active+clean; 500 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 638 op/s 2024-09-19T04:24:33.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:33 smithi092 ceph-mon[34940]: pgmap v583: 129 pgs: 129 active+clean; 500 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.3 MiB/s wr, 638 op/s 2024-09-19T04:24:33.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:33.629+0000 7f33577fe640 1 -- 172.21.15.7:0/2017269647 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a66330cd70 con 0x55a663422f20 2024-09-19T04:24:33.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:33.629+0000 7f33577fe640 10 client.16200 handle_command_reply: tid=0 2024-09-19T04:24:33.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:33.629+0000 7f3381012740 1 client.16200 shutdown 2024-09-19T04:24:33.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:33.629+0000 7f3381012740 1 -- 172.21.15.7:0/2017269647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6633a19a0 msgr2=0x55a6633b0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:33.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:33.629+0000 7f3381012740 1 --2- 172.21.15.7:0/2017269647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6633a19a0 0x55a6633b0680 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f336800a010 tx=0x7f336801cd60 comp rx=0 tx=0).stop 2024-09-19T04:24:33.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:33.629+0000 7f3381012740 1 -- 172.21.15.7:0/2017269647 shutdown_connections 2024-09-19T04:24:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:33.629+0000 7f3381012740 1 --2- 172.21.15.7:0/2017269647 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55a663422f20 0x55a663425340 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:33.629+0000 7f3381012740 1 --2- 172.21.15.7:0/2017269647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6633a7370 0x55a6633b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:33.629+0000 7f3381012740 1 --2- 172.21.15.7:0/2017269647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6633a22e0 0x55a6633b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:33.629+0000 7f33577fe640 0 client.16200 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:24:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:33.629+0000 7f3381012740 1 --2- 172.21.15.7:0/2017269647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6633a19a0 0x55a6633b0680 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:33.629+0000 7f3381012740 1 -- 172.21.15.7:0/2017269647 >> 172.21.15.7:0/2017269647 conn(0x55a66339d010 msgr2=0x55a66339b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:33.629+0000 7f3381012740 1 -- 172.21.15.7:0/2017269647 shutdown_connections 2024-09-19T04:24:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:33.629+0000 7f3381012740 1 -- 172.21.15.7:0/2017269647 wait complete. 2024-09-19T04:24:33.632 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:33.629+0000 7f3381012740 20 client.16200 trim_cache size 0 max 16384 2024-09-19T04:24:33.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:24:33.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:24:33.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:24:33.633 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:24:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:33.630+0000 7f337e277640 1 -- 172.21.15.7:0/922708803 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f33640a3240 msgr2=0x7f33640a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:33.630+0000 7f337e277640 1 --2- 172.21.15.7:0/922708803 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f33640a3240 0x7f33640a5700 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f337004d000 tx=0x7f337004e000 comp rx=0 tx=0).stop 2024-09-19T04:24:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:33.630+0000 7f337e277640 1 -- 172.21.15.7:0/922708803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3378101c30 msgr2=0x7f3378103010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:33.630+0000 7f337e277640 1 --2- 172.21.15.7:0/922708803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3378101c30 0x7f3378103010 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f336000e9f0 tx=0x7f336000eeb0 comp rx=0 tx=0).stop 2024-09-19T04:24:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:33.630+0000 7f337e277640 1 -- 172.21.15.7:0/922708803 shutdown_connections 2024-09-19T04:24:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:33.630+0000 7f337e277640 1 --2- 172.21.15.7:0/922708803 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f33640a3240 0x7f33640a5700 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:33.630+0000 7f337e277640 1 --2- 172.21.15.7:0/922708803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33781025f0 0x7f3378103550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:33.630+0000 7f337e277640 1 --2- 172.21.15.7:0/922708803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3378101c30 0x7f3378103010 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:33.634 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:33.630+0000 7f337e277640 1 --2- 172.21.15.7:0/922708803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3378100a40 0x7f33781049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:33.630+0000 7f337e277640 1 -- 172.21.15.7:0/922708803 >> 172.21.15.7:0/922708803 conn(0x7f33780fc1c0 msgr2=0x7f33780fdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:33.630+0000 7f337e277640 1 -- 172.21.15.7:0/922708803 shutdown_connections 2024-09-19T04:24:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:33.630+0000 7f337e277640 1 -- 172.21.15.7:0/922708803 wait complete. 2024-09-19T04:24:35.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:35 smithi007 ceph-mon[31360]: pgmap v584: 129 pgs: 129 active+clean; 504 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 926 op/s 2024-09-19T04:24:35.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:35 smithi102 ceph-mon[35446]: pgmap v584: 129 pgs: 129 active+clean; 504 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 926 op/s 2024-09-19T04:24:35.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:35 smithi092 ceph-mon[34940]: pgmap v584: 129 pgs: 129 active+clean; 504 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 926 op/s 2024-09-19T04:24:35.577 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:24:35.577 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 38, 2024-09-19T04:24:35.577 INFO:teuthology.orchestra.run.smithi007.stdout: "leader": 24506, 2024-09-19T04:24:35.577 INFO:teuthology.orchestra.run.smithi007.stdout: "set_version": 26, 2024-09-19T04:24:35.577 INFO:teuthology.orchestra.run.smithi007.stdout: "sets": { 2024-09-19T04:24:35.577 INFO:teuthology.orchestra.run.smithi007.stdout: "f93b4a75": { 2024-09-19T04:24:35.577 INFO:teuthology.orchestra.run.smithi007.stdout: "version": 26, 2024-09-19T04:24:35.578 INFO:teuthology.orchestra.run.smithi007.stdout: "age_ref": 0.0, 2024-09-19T04:24:35.578 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:24:35.578 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "QUIESCED", 2024-09-19T04:24:35.578 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:24:35.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:24:35.578 INFO:teuthology.orchestra.run.smithi007.stdout: "timeout": 90.0, 2024-09-19T04:24:35.578 INFO:teuthology.orchestra.run.smithi007.stdout: "expiration": 145.8, 2024-09-19T04:24:35.578 INFO:teuthology.orchestra.run.smithi007.stdout: "members": { 2024-09-19T04:24:35.578 INFO:teuthology.orchestra.run.smithi007.stdout: "file:/": { 2024-09-19T04:24:35.578 INFO:teuthology.orchestra.run.smithi007.stdout: "excluded": false, 2024-09-19T04:24:35.578 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:24:35.578 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "QUIESCED", 2024-09-19T04:24:35.579 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:24:35.579 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:24:35.579 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:24:35.579 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:24:35.579 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:24:35.579 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:24:35.579 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:24:35.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:35.574+0000 7f6dff7fe640 1 -- 172.21.15.7:0/1715691145 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f6e18030c50 con 0x55d096297d80 2024-09-19T04:24:35.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:35.574+0000 7f6dff7fe640 10 client.16164 handle_command_reply: tid=0 2024-09-19T04:24:35.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:35.574+0000 7f6e28b0c740 1 client.16164 shutdown 2024-09-19T04:24:35.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:35.575+0000 7f6e28b0c740 1 -- 172.21.15.7:0/1715691145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d09621ca30 msgr2=0x55d096220340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:35.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:35.575+0000 7f6e28b0c740 1 --2- 172.21.15.7:0/1715691145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d09621ca30 0x55d096220340 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6e08003e30 tx=0x7f6e08004730 comp rx=0 tx=0).stop 2024-09-19T04:24:35.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:35.575+0000 7f6e28b0c740 1 -- 172.21.15.7:0/1715691145 shutdown_connections 2024-09-19T04:24:35.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:35.575+0000 7f6e28b0c740 1 --2- 172.21.15.7:0/1715691145 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55d096297d80 0x55d09629a1e0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:35.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:35.575+0000 7f6e28b0c740 1 --2- 172.21.15.7:0/1715691145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d09621ca30 0x55d096220340 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:35.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:35.575+0000 7f6e28b0c740 1 --2- 172.21.15.7:0/1715691145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d096212170 0x55d096225300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:35.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:35.575+0000 7f6e28b0c740 1 --2- 172.21.15.7:0/1715691145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d096211850 0x55d096224dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:35.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:35.575+0000 7f6e28b0c740 1 -- 172.21.15.7:0/1715691145 >> 172.21.15.7:0/1715691145 conn(0x55d09620dde0 msgr2=0x55d09620c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:35.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:35.575+0000 7f6dff7fe640 0 client.16164 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:24:35.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:35.575+0000 7f6e28b0c740 1 -- 172.21.15.7:0/1715691145 shutdown_connections 2024-09-19T04:24:35.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:35.575+0000 7f6e28b0c740 1 -- 172.21.15.7:0/1715691145 wait complete. 2024-09-19T04:24:35.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:35.575+0000 7f6e28b0c740 20 client.16164 trim_cache size 0 max 16384 2024-09-19T04:24:35.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:35.576+0000 7f6e26733640 1 -- 172.21.15.7:0/2755377056 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6e0c0a3380 msgr2=0x7f6e0c0a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:35.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:35.576+0000 7f6e26733640 1 --2- 172.21.15.7:0/2755377056 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6e0c0a3380 0x7f6e0c0a5840 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6e080045d0 tx=0x7f6e0800b2e0 comp rx=0 tx=0).stop 2024-09-19T04:24:35.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:35.576+0000 7f6e26733640 1 -- 172.21.15.7:0/2755377056 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e20108da0 msgr2=0x7f6e201a4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:35.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:35.576+0000 7f6e26733640 1 --2- 172.21.15.7:0/2755377056 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e20108da0 0x7f6e201a4bc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000c370 tx=0x7f6e1000c830 comp rx=0 tx=0).stop 2024-09-19T04:24:35.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:35.576+0000 7f6e26733640 1 -- 172.21.15.7:0/2755377056 shutdown_connections 2024-09-19T04:24:35.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:35.576+0000 7f6e26733640 1 --2- 172.21.15.7:0/2755377056 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f6e0c0a3380 0x7f6e0c0a5840 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:35.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:35.576+0000 7f6e26733640 1 --2- 172.21.15.7:0/2755377056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6e2010d520 0x7f6e2019e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:35.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:35.576+0000 7f6e26733640 1 --2- 172.21.15.7:0/2755377056 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e20108da0 0x7f6e201a4bc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:35.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:35.576+0000 7f6e26733640 1 --2- 172.21.15.7:0/2755377056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e201083f0 0x7f6e201a4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:35.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:35.576+0000 7f6e26733640 1 -- 172.21.15.7:0/2755377056 >> 172.21.15.7:0/2755377056 conn(0x7f6e20077af0 msgr2=0x7f6e20078dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:35.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:35.576+0000 7f6e26733640 1 -- 172.21.15.7:0/2755377056 shutdown_connections 2024-09-19T04:24:35.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:35.576+0000 7f6e26733640 1 -- 172.21.15.7:0/2755377056 wait complete. 2024-09-19T04:24:36.234 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f93b4a75', quiesce took 26.4 seconds. Will release after: -0.6499999999999986 2024-09-19T04:24:36.234 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:24:36.528 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:24:37.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.013+0000 7f17033be640 1 -- 172.21.15.7:0/2970055557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16fc106f10 msgr2=0x7f16fc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:37.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.013+0000 7f17033be640 1 --2- 172.21.15.7:0/2970055557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16fc106f10 0x7f16fc10ea90 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f16ec009ca0 tx=0x7f16ec02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:24:37.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.013+0000 7f17033be640 1 -- 172.21.15.7:0/2970055557 shutdown_connections 2024-09-19T04:24:37.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.013+0000 7f17033be640 1 --2- 172.21.15.7:0/2970055557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16fc106f10 0x7f16fc10ea90 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:37.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.013+0000 7f17033be640 1 --2- 172.21.15.7:0/2970055557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16fc102790 0x7f16fc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:37.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.013+0000 7f17033be640 1 --2- 172.21.15.7:0/2970055557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16fc101de0 0x7f16fc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:37.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.013+0000 7f17033be640 1 -- 172.21.15.7:0/2970055557 >> 172.21.15.7:0/2970055557 conn(0x7f16fc0fd8c0 msgr2=0x7f16fc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:37.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.013+0000 7f17033be640 1 -- 172.21.15.7:0/2970055557 shutdown_connections 2024-09-19T04:24:37.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.013+0000 7f17033be640 1 -- 172.21.15.7:0/2970055557 wait complete. 2024-09-19T04:24:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.014+0000 7f17033be640 1 Processor -- start 2024-09-19T04:24:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.014+0000 7f17033be640 1 -- start start 2024-09-19T04:24:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.014+0000 7f17033be640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16fc101de0 0x7f16fc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.014+0000 7f17033be640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16fc102790 0x7f16fc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.014+0000 7f17033be640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16fc106f10 0x7f16fc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.014+0000 7f17033be640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f16fc111f70 con 0x7f16fc102790 2024-09-19T04:24:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.014+0000 7f17033be640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f16fc111df0 con 0x7f16fc106f10 2024-09-19T04:24:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.014+0000 7f17033be640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f16fc1120f0 con 0x7f16fc101de0 2024-09-19T04:24:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.014+0000 7f1700959640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16fc102790 0x7f16fc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.014+0000 7f1700959640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16fc102790 0x7f16fc074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60264/0 (socket says 172.21.15.7:60264) 2024-09-19T04:24:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.014+0000 7f1700959640 1 -- 172.21.15.7:0/1658878153 learned_addr learned my addr 172.21.15.7:0/1658878153 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.014+0000 7f170115a640 1 --2- 172.21.15.7:0/1658878153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16fc101de0 0x7f16fc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:37.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.014+0000 7f170195b640 1 --2- 172.21.15.7:0/1658878153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16fc106f10 0x7f16fc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.014+0000 7f1700959640 1 -- 172.21.15.7:0/1658878153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16fc101de0 msgr2=0x7f16fc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.014+0000 7f1700959640 1 --2- 172.21.15.7:0/1658878153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16fc101de0 0x7f16fc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.014+0000 7f1700959640 1 -- 172.21.15.7:0/1658878153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16fc106f10 msgr2=0x7f16fc074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.014+0000 7f1700959640 1 --2- 172.21.15.7:0/1658878153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16fc106f10 0x7f16fc074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.015+0000 7f1700959640 1 -- 172.21.15.7:0/1658878153 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16fc1a6780 con 0x7f16fc102790 2024-09-19T04:24:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.015+0000 7f1700959640 1 --2- 172.21.15.7:0/1658878153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16fc102790 0x7f16fc074a30 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f16f000c920 tx=0x7f16f000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.015+0000 7f16fa7fc640 1 -- 172.21.15.7:0/1658878153 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f0007c70 con 0x7f16fc102790 2024-09-19T04:24:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.015+0000 7f16fa7fc640 1 -- 172.21.15.7:0/1658878153 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16f0007e10 con 0x7f16fc102790 2024-09-19T04:24:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.015+0000 7f17033be640 1 -- 172.21.15.7:0/1658878153 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16fc1a6a70 con 0x7f16fc102790 2024-09-19T04:24:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.015+0000 7f16fa7fc640 1 -- 172.21.15.7:0/1658878153 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f0018890 con 0x7f16fc102790 2024-09-19T04:24:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.015+0000 7f17033be640 1 -- 172.21.15.7:0/1658878153 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16fc1a6fb0 con 0x7f16fc102790 2024-09-19T04:24:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.016+0000 7f17033be640 1 -- 172.21.15.7:0/1658878153 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16fc1021c0 con 0x7f16fc102790 2024-09-19T04:24:37.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.018+0000 7f16fa7fc640 1 -- 172.21.15.7:0/1658878153 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f16f0018a70 con 0x7f16fc102790 2024-09-19T04:24:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.018+0000 7f16fa7fc640 1 --2- 172.21.15.7:0/1658878153 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f16e40a3240 0x7f16e40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.019+0000 7f16fa7fc640 1 -- 172.21.15.7:0/1658878153 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f16f00cfe60 con 0x7f16fc102790 2024-09-19T04:24:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.019+0000 7f170115a640 1 --2- 172.21.15.7:0/1658878153 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f16e40a3240 0x7f16e40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.019+0000 7f170115a640 1 --2- 172.21.15.7:0/1658878153 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f16e40a3240 0x7f16e40a5700 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f16f4005e10 tx=0x7f16f4005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:37.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.023+0000 7f16fa7fc640 1 -- 172.21.15.7:0/1658878153 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f16f0014030 con 0x7f16fc102790 2024-09-19T04:24:37.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.250+0000 7f17033be640 1 -- 172.21.15.7:0/1658878153 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16fc075a20 con 0x7f16fc102790 2024-09-19T04:24:37.252 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:37 smithi007 ceph-mon[31360]: pgmap v585: 129 pgs: 129 active+clean; 500 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 1.03k op/s 2024-09-19T04:24:37.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.251+0000 7f16fa7fc640 1 -- 172.21.15.7:0/1658878153 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11964 (secure 0 0 0) 0x7f16f009c7b0 con 0x7f16fc102790 2024-09-19T04:24:37.253 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:24:37.253 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":38,"btime":"2024-09-19T04:24:15:074970+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:24:14.309726+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24496,"mds_2":24482,"mds_3":24478,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24472,24478,24482,24496,24506]},"id":1}]} 2024-09-19T04:24:37.254 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 38 2024-09-19T04:24:37.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.254+0000 7f17033be640 1 -- 172.21.15.7:0/1658878153 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f16e40a3240 msgr2=0x7f16e40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:37.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.254+0000 7f17033be640 1 --2- 172.21.15.7:0/1658878153 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f16e40a3240 0x7f16e40a5700 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f16f4005e10 tx=0x7f16f4005da0 comp rx=0 tx=0).stop 2024-09-19T04:24:37.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.254+0000 7f17033be640 1 -- 172.21.15.7:0/1658878153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16fc102790 msgr2=0x7f16fc074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:37.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.254+0000 7f17033be640 1 --2- 172.21.15.7:0/1658878153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16fc102790 0x7f16fc074a30 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f16f000c920 tx=0x7f16f000cde0 comp rx=0 tx=0).stop 2024-09-19T04:24:37.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.254+0000 7f17033be640 1 -- 172.21.15.7:0/1658878153 shutdown_connections 2024-09-19T04:24:37.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.254+0000 7f17033be640 1 --2- 172.21.15.7:0/1658878153 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f16e40a3240 0x7f16e40a5700 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:37.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.254+0000 7f17033be640 1 --2- 172.21.15.7:0/1658878153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16fc106f10 0x7f16fc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:37.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.254+0000 7f17033be640 1 --2- 172.21.15.7:0/1658878153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f16fc102790 0x7f16fc074a30 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:37.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.254+0000 7f17033be640 1 --2- 172.21.15.7:0/1658878153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16fc101de0 0x7f16fc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:37.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.254+0000 7f17033be640 1 -- 172.21.15.7:0/1658878153 >> 172.21.15.7:0/1658878153 conn(0x7f16fc0fd8c0 msgr2=0x7f16fc0fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:37.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.254+0000 7f17033be640 1 -- 172.21.15.7:0/1658878153 shutdown_connections 2024-09-19T04:24:37.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:37.254+0000 7f17033be640 1 -- 172.21.15.7:0/1658878153 wait complete. 2024-09-19T04:24:37.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:37 smithi102 ceph-mon[35446]: pgmap v585: 129 pgs: 129 active+clean; 500 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 1.03k op/s 2024-09-19T04:24:37.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:37 smithi092 ceph-mon[34940]: pgmap v585: 129 pgs: 129 active+clean; 500 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 1.03k op/s 2024-09-19T04:24:37.874 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24506 quiesce db --set-id f93b4a75 --release --await' 2024-09-19T04:24:37.874 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24506 quiesce db --set-id f93b4a75 --release --await 2024-09-19T04:24:38.131 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:24:38.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:38 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1658878153' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:24:38.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:38 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1658878153' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:24:38.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:38 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1658878153' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:24:38.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.613+0000 7f1e6cb20640 1 -- 172.21.15.7:0/1056586100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e68103740 msgr2=0x7f1e68107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:38.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.613+0000 7f1e6cb20640 1 --2- 172.21.15.7:0/1056586100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e68103740 0x7f1e68107b80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1e50009930 tx=0x7f1e5002a420 comp rx=0 tx=0).stop 2024-09-19T04:24:38.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.613+0000 7f1e6cb20640 1 -- 172.21.15.7:0/1056586100 shutdown_connections 2024-09-19T04:24:38.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.613+0000 7f1e6cb20640 1 --2- 172.21.15.7:0/1056586100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e68108290 0x7f1e6810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:38.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.613+0000 7f1e6cb20640 1 --2- 172.21.15.7:0/1056586100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e68103740 0x7f1e68107b80 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:38.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.613+0000 7f1e6cb20640 1 --2- 172.21.15.7:0/1056586100 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e68102d90 0x7f1e68103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:38.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.613+0000 7f1e6cb20640 1 -- 172.21.15.7:0/1056586100 >> 172.21.15.7:0/1056586100 conn(0x7f1e680fc7d0 msgr2=0x7f1e680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:38.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.613+0000 7f1e6cb20640 1 -- 172.21.15.7:0/1056586100 shutdown_connections 2024-09-19T04:24:38.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.613+0000 7f1e6cb20640 1 -- 172.21.15.7:0/1056586100 wait complete. 2024-09-19T04:24:38.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.614+0000 7f1e6cb20640 1 Processor -- start 2024-09-19T04:24:38.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.614+0000 7f1e6cb20640 1 -- start start 2024-09-19T04:24:38.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.614+0000 7f1e6cb20640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e68102d90 0x7f1e681009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:38.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.614+0000 7f1e6cb20640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e68103740 0x7f1e68100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:38.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.614+0000 7f1e6cb20640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e68108290 0x7f1e68101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:38.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.614+0000 7f1e6cb20640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1e68112090 con 0x7f1e68103740 2024-09-19T04:24:38.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.614+0000 7f1e6cb20640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1e68111f10 con 0x7f1e68108290 2024-09-19T04:24:38.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.614+0000 7f1e6cb20640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1e68112210 con 0x7f1e68102d90 2024-09-19T04:24:38.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.615+0000 7f1e5ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e68103740 0x7f1e68100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:38.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.615+0000 7f1e5ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e68103740 0x7f1e68100f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49496/0 (socket says 172.21.15.7:49496) 2024-09-19T04:24:38.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.615+0000 7f1e5ffff640 1 -- 172.21.15.7:0/112379401 learned_addr learned my addr 172.21.15.7:0/112379401 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:38.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.615+0000 7f1e66d9d640 1 --2- 172.21.15.7:0/112379401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e68108290 0x7f1e68101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:38.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.615+0000 7f1e6659c640 1 --2- 172.21.15.7:0/112379401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e68102d90 0x7f1e681009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:38.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.615+0000 7f1e5ffff640 1 -- 172.21.15.7:0/112379401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e68102d90 msgr2=0x7f1e681009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:38.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.615+0000 7f1e5ffff640 1 --2- 172.21.15.7:0/112379401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e68102d90 0x7f1e681009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:38.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.615+0000 7f1e5ffff640 1 -- 172.21.15.7:0/112379401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e68108290 msgr2=0x7f1e68101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:38.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.615+0000 7f1e5ffff640 1 --2- 172.21.15.7:0/112379401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e68108290 0x7f1e68101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:38.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.615+0000 7f1e5ffff640 1 -- 172.21.15.7:0/112379401 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e681a6af0 con 0x7f1e68103740 2024-09-19T04:24:38.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.615+0000 7f1e5ffff640 1 --2- 172.21.15.7:0/112379401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e68103740 0x7f1e68100f30 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f1e50005940 tx=0x7f1e500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:38.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.615+0000 7f1e5f7fe640 1 -- 172.21.15.7:0/112379401 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5003f030 con 0x7f1e68103740 2024-09-19T04:24:38.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.615+0000 7f1e5f7fe640 1 -- 172.21.15.7:0/112379401 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e50003ce0 con 0x7f1e68103740 2024-09-19T04:24:38.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.615+0000 7f1e5f7fe640 1 -- 172.21.15.7:0/112379401 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e50035070 con 0x7f1e68103740 2024-09-19T04:24:38.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.615+0000 7f1e6cb20640 1 -- 172.21.15.7:0/112379401 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e681a6d80 con 0x7f1e68103740 2024-09-19T04:24:38.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.615+0000 7f1e6cb20640 1 -- 172.21.15.7:0/112379401 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e681a7200 con 0x7f1e68103740 2024-09-19T04:24:38.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.618+0000 7f1e5f7fe640 1 -- 172.21.15.7:0/112379401 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f1e50042030 con 0x7f1e68103740 2024-09-19T04:24:38.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.618+0000 7f1e6eef9740 1 Processor -- start 2024-09-19T04:24:38.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.619+0000 7f1e6eef9740 1 -- start start 2024-09-19T04:24:38.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.619+0000 7f1e6eef9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6b954a060 0x55a6b954a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:38.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.619+0000 7f1e6eef9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6b954a980 0x55a6b9554d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:38.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.619+0000 7f1e6eef9740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6b9555240 0x55a6b9557630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:38.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.619+0000 7f1e6eef9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a6b94af620 con 0x55a6b954a060 2024-09-19T04:24:38.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.619+0000 7f1e6eef9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a6b9456e50 con 0x55a6b954a980 2024-09-19T04:24:38.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.619+0000 7f1e6eef9740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a6b94ab5e0 con 0x55a6b9555240 2024-09-19T04:24:38.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.619+0000 7f1e66d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6b954a060 0x55a6b954a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:38.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.619+0000 7f1e66d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6b954a060 0x55a6b954a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49498/0 (socket says 172.21.15.7:49498) 2024-09-19T04:24:38.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.619+0000 7f1e66d9d640 1 -- 172.21.15.7:0/3478761082 learned_addr learned my addr 172.21.15.7:0/3478761082 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:38.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.619+0000 7f1e5ffff640 1 --2- 172.21.15.7:0/3478761082 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6b9555240 0x55a6b9557630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:38.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.619+0000 7f1e6659c640 1 --2- 172.21.15.7:0/3478761082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6b954a980 0x55a6b9554d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:38.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.619+0000 7f1e5f7fe640 1 --2- 172.21.15.7:0/112379401 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1e540a3240 0x7f1e540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:38.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.620+0000 7f1e66d9d640 1 -- 172.21.15.7:0/3478761082 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6b9555240 msgr2=0x55a6b9557630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:38.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.620+0000 7f1e66d9d640 1 --2- 172.21.15.7:0/3478761082 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6b9555240 0x55a6b9557630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:38.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.620+0000 7f1e66d9d640 1 -- 172.21.15.7:0/3478761082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6b954a980 msgr2=0x55a6b9554d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:38.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.620+0000 7f1e66d9d640 1 --2- 172.21.15.7:0/3478761082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6b954a980 0x55a6b9554d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:38.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.620+0000 7f1e66d9d640 1 -- 172.21.15.7:0/3478761082 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6b9447d40 con 0x55a6b954a060 2024-09-19T04:24:38.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.620+0000 7f1e5f7fe640 1 -- 172.21.15.7:0/112379401 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f1e500f0190 con 0x7f1e68103740 2024-09-19T04:24:38.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.620+0000 7f1e66d9d640 1 --2- 172.21.15.7:0/112379401 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1e540a3240 0x7f1e540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:38.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.620+0000 7f1e66d9d640 1 --2- 172.21.15.7:0/3478761082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6b954a060 0x55a6b954a440 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1e60010440 tx=0x7f1e60010900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76da69689f14b3dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:38.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.620+0000 7f1e5cff9640 1 -- 172.21.15.7:0/3478761082 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6001d400 con 0x55a6b954a060 2024-09-19T04:24:38.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.620+0000 7f1e5cff9640 1 -- 172.21.15.7:0/3478761082 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e6001da80 con 0x55a6b954a060 2024-09-19T04:24:38.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.620+0000 7f1e5cff9640 1 -- 172.21.15.7:0/3478761082 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6001c940 con 0x55a6b954a060 2024-09-19T04:24:38.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.621+0000 7f1e6eef9740 1 -- 172.21.15.7:0/3478761082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6b954a060 msgr2=0x55a6b954a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:38.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.621+0000 7f1e6eef9740 1 --2- 172.21.15.7:0/3478761082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6b954a060 0x55a6b954a440 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1e60010440 tx=0x7f1e60010900 comp rx=0 tx=0).stop 2024-09-19T04:24:38.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.621+0000 7f1e66d9d640 1 --2- 172.21.15.7:0/112379401 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1e540a3240 0x7f1e540a5700 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1e60021000 tx=0x7f1e6001e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:38.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.621+0000 7f1e6eef9740 1 -- 172.21.15.7:0/3478761082 shutdown_connections 2024-09-19T04:24:38.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.621+0000 7f1e6eef9740 1 --2- 172.21.15.7:0/3478761082 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6b9555240 0x55a6b9557630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:38.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.621+0000 7f1e6eef9740 1 --2- 172.21.15.7:0/3478761082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6b954a980 0x55a6b9554d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:38.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.621+0000 7f1e6eef9740 1 --2- 172.21.15.7:0/3478761082 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6b954a060 0x55a6b954a440 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:38.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.621+0000 7f1e6eef9740 1 -- 172.21.15.7:0/3478761082 >> 172.21.15.7:0/3478761082 conn(0x55a6b95465f0 msgr2=0x55a6b95469d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:38.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.621+0000 7f1e6eef9740 1 -- 172.21.15.7:0/3478761082 shutdown_connections 2024-09-19T04:24:38.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.621+0000 7f1e6eef9740 1 -- 172.21.15.7:0/3478761082 wait complete. 2024-09-19T04:24:38.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.621+0000 7f1e6eef9740 1 -- start start 2024-09-19T04:24:38.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.621+0000 7f1e6eef9740 1 Processor -- start 2024-09-19T04:24:38.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.622+0000 7f1e6eef9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6b954a060 0x55a6b95520f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:38.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.622+0000 7f1e6eef9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6b954a980 0x55a6b9552630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:38.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.622+0000 7f1e6eef9740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6b9555240 0x55a6b9552b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:38.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.622+0000 7f1e6eef9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a6b9557e10 con 0x55a6b954a060 2024-09-19T04:24:38.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.622+0000 7f1e6eef9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a6b9437f10 con 0x55a6b954a980 2024-09-19T04:24:38.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.622+0000 7f1e6eef9740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a6b9557f90 con 0x55a6b9555240 2024-09-19T04:24:38.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.622+0000 7f1e6eef9740 10 client.0 _ll_register_callbacks cb 0x55a6b945bdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:24:38.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.622+0000 7f1e6659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6b954a060 0x55a6b95520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:38.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.622+0000 7f1e6659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6b954a060 0x55a6b95520f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49504/0 (socket says 172.21.15.7:49504) 2024-09-19T04:24:38.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.622+0000 7f1e6659c640 1 -- 172.21.15.7:0/4064099629 learned_addr learned my addr 172.21.15.7:0/4064099629 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:38.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.622+0000 7f1e5ffff640 1 --2- 172.21.15.7:0/4064099629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6b954a980 0x55a6b9552630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:38.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.622+0000 7f1e66d9d640 1 --2- 172.21.15.7:0/4064099629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6b9555240 0x55a6b9552b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:38.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.622+0000 7f1e6659c640 1 -- 172.21.15.7:0/4064099629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6b9555240 msgr2=0x55a6b9552b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:38.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.622+0000 7f1e6659c640 1 --2- 172.21.15.7:0/4064099629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6b9555240 0x55a6b9552b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:38.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.622+0000 7f1e6659c640 1 -- 172.21.15.7:0/4064099629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6b954a980 msgr2=0x55a6b9552630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:38.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.622+0000 7f1e6659c640 1 --2- 172.21.15.7:0/4064099629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6b954a980 0x55a6b9552630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:38.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.622+0000 7f1e6659c640 1 -- 172.21.15.7:0/4064099629 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6b91be580 con 0x55a6b954a060 2024-09-19T04:24:38.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.622+0000 7f1e5ffff640 1 --2- 172.21.15.7:0/4064099629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6b954a980 0x55a6b9552630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:24:38.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.622+0000 7f1e6659c640 1 --2- 172.21.15.7:0/4064099629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6b954a060 0x55a6b95520f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f1e580127a0 tx=0x7f1e58012c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef8af44f596d09e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:38.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.622+0000 7f1e4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:24:38.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.622+0000 7f1e4dffb640 1 -- 172.21.15.7:0/4064099629 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5801f060 con 0x55a6b954a060 2024-09-19T04:24:38.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.622+0000 7f1e4dffb640 1 -- 172.21.15.7:0/4064099629 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f1e58010d60 con 0x55a6b954a060 2024-09-19T04:24:38.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.622+0000 7f1e6eef9740 1 -- 172.21.15.7:0/4064099629 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e6001da80 con 0x55a6b954a060 2024-09-19T04:24:38.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.623+0000 7f1e4dffb640 1 -- 172.21.15.7:0/4064099629 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f1e58026050 con 0x55a6b954a060 2024-09-19T04:24:38.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.623+0000 7f1e6eef9740 10 client.16218 fetch_fsmap learned FSMap version 38 2024-09-19T04:24:38.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.623+0000 7f1e6eef9740 1 -- 172.21.15.7:0/4064099629 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55a6b9288960 con 0x55a6b954a060 2024-09-19T04:24:38.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.623+0000 7f1e4dffb640 1 -- 172.21.15.7:0/4064099629 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e6001da80 con 0x55a6b954a060 2024-09-19T04:24:38.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.623+0000 7f1e4dffb640 1 -- 172.21.15.7:0/4064099629 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 38) ==== 8378+0+0 (secure 0 0 0) 0x7f1e5800e590 con 0x55a6b954a060 2024-09-19T04:24:38.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.623+0000 7f1e6eef9740 10 client.16218 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T04:24:38.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.623+0000 7f1e6eef9740 10 client.16218 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:24:38.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.623+0000 7f1e6eef9740 20 client.16218 populate_metadata read hostname 'smithi007' 2024-09-19T04:24:38.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.623+0000 7f1e6eef9740 1 --2- 172.21.15.7:0/4064099629 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55a6b9564e10 0x55a6b95672a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:38.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.623+0000 7f1e6eef9740 4 client.16218 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:24:38.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.623+0000 7f1e6eef9740 1 -- 172.21.15.7:0/4064099629 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a6b94bcb90 con 0x55a6b9564e10 2024-09-19T04:24:38.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.623+0000 7f1e5ffff640 1 --2- 172.21.15.7:0/4064099629 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55a6b9564e10 0x55a6b95672a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:38.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.624+0000 7f1e4dffb640 10 client.16218 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:24:38.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.624+0000 7f1e5ffff640 1 --2- 172.21.15.7:0/4064099629 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55a6b9564e10 0x55a6b95672a0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55e9cf2efa9c4f4f server_cookie=4d7cbf0a3bd2acf8 in_seq=0 out_seq=0 2024-09-19T04:24:38.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.625+0000 7f1e4dffb640 1 -- 172.21.15.7:0/4064099629 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a6b94bcb90 con 0x55a6b9564e10 2024-09-19T04:24:38.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.625+0000 7f1e4dffb640 10 client.16218 handle_command_reply: tid=0 2024-09-19T04:24:38.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.625+0000 7f1e6eef9740 1 client.16218 shutdown 2024-09-19T04:24:38.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.625+0000 7f1e6eef9740 1 -- 172.21.15.7:0/4064099629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6b954a060 msgr2=0x55a6b95520f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:38.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.625+0000 7f1e6eef9740 1 --2- 172.21.15.7:0/4064099629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6b954a060 0x55a6b95520f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f1e580127a0 tx=0x7f1e58012c60 comp rx=0 tx=0).stop 2024-09-19T04:24:38.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.625+0000 7f1e6eef9740 1 -- 172.21.15.7:0/4064099629 shutdown_connections 2024-09-19T04:24:38.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.625+0000 7f1e6eef9740 1 --2- 172.21.15.7:0/4064099629 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55a6b9564e10 0x55a6b95672a0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:38.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.625+0000 7f1e6eef9740 1 --2- 172.21.15.7:0/4064099629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6b9555240 0x55a6b9552b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:38.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.625+0000 7f1e6eef9740 1 --2- 172.21.15.7:0/4064099629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6b954a980 0x55a6b9552630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:38.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.625+0000 7f1e4dffb640 0 client.16218 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:24:38.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.625+0000 7f1e6eef9740 1 --2- 172.21.15.7:0/4064099629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6b954a060 0x55a6b95520f0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:38.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.625+0000 7f1e6eef9740 1 -- 172.21.15.7:0/4064099629 >> 172.21.15.7:0/4064099629 conn(0x55a6b95465f0 msgr2=0x55a6b9545750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:38.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.625+0000 7f1e6eef9740 1 -- 172.21.15.7:0/4064099629 shutdown_connections 2024-09-19T04:24:38.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.625+0000 7f1e6eef9740 1 -- 172.21.15.7:0/4064099629 wait complete. 2024-09-19T04:24:38.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.625+0000 7f1e6eef9740 20 client.16218 trim_cache size 0 max 16384 2024-09-19T04:24:38.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.642+0000 7f1e6eef9740 1 Processor -- start 2024-09-19T04:24:38.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.642+0000 7f1e6eef9740 1 -- start start 2024-09-19T04:24:38.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.642+0000 7f1e6eef9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6b954a060 0x55a6b9553fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:38.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.642+0000 7f1e6eef9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6b954a980 0x55a6b956cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:38.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.642+0000 7f1e6eef9740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6b9555240 0x55a6b956d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:38.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.642+0000 7f1e6eef9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1e681b0fe0 con 0x55a6b954a980 2024-09-19T04:24:38.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.642+0000 7f1e6eef9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1e681b2b50 con 0x55a6b954a060 2024-09-19T04:24:38.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.642+0000 7f1e6eef9740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1e681b16b0 con 0x55a6b9555240 2024-09-19T04:24:38.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.642+0000 7f1e5ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6b954a980 0x55a6b956cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:38.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.642+0000 7f1e5ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6b954a980 0x55a6b956cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49512/0 (socket says 172.21.15.7:49512) 2024-09-19T04:24:38.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.642+0000 7f1e5ffff640 1 -- 172.21.15.7:0/3298526604 learned_addr learned my addr 172.21.15.7:0/3298526604 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:38.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.642+0000 7f1e66d9d640 1 --2- 172.21.15.7:0/3298526604 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6b9555240 0x55a6b956d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:38.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.642+0000 7f1e6659c640 1 --2- 172.21.15.7:0/3298526604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6b954a060 0x55a6b9553fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:38.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.643+0000 7f1e5ffff640 1 -- 172.21.15.7:0/3298526604 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6b9555240 msgr2=0x55a6b956d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:38.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.643+0000 7f1e5ffff640 1 --2- 172.21.15.7:0/3298526604 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6b9555240 0x55a6b956d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:38.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.643+0000 7f1e5ffff640 1 -- 172.21.15.7:0/3298526604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6b954a060 msgr2=0x55a6b9553fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:38.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.643+0000 7f1e5ffff640 1 --2- 172.21.15.7:0/3298526604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6b954a060 0x55a6b9553fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:38.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.643+0000 7f1e5ffff640 1 -- 172.21.15.7:0/3298526604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6b9549e90 con 0x55a6b954a980 2024-09-19T04:24:38.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.643+0000 7f1e66d9d640 1 --2- 172.21.15.7:0/3298526604 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6b9555240 0x55a6b956d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:24:38.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.643+0000 7f1e6659c640 1 --2- 172.21.15.7:0/3298526604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6b954a060 0x55a6b9553fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:24:38.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.643+0000 7f1e5ffff640 1 --2- 172.21.15.7:0/3298526604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6b954a980 0x55a6b956cb70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1e50009900 tx=0x7f1e500dc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830f5764bc2a0287 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:38.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.643+0000 7f1e4ffff640 1 -- 172.21.15.7:0/3298526604 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e50049040 con 0x55a6b954a980 2024-09-19T04:24:38.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.643+0000 7f1e4ffff640 1 -- 172.21.15.7:0/3298526604 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e500c5010 con 0x55a6b954a980 2024-09-19T04:24:38.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.643+0000 7f1e4ffff640 1 -- 172.21.15.7:0/3298526604 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e500ed990 con 0x55a6b954a980 2024-09-19T04:24:38.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.643+0000 7f1e6eef9740 1 -- 172.21.15.7:0/3298526604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6b954a980 msgr2=0x55a6b956cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:38.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.643+0000 7f1e6eef9740 1 --2- 172.21.15.7:0/3298526604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6b954a980 0x55a6b956cb70 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1e50009900 tx=0x7f1e500dc040 comp rx=0 tx=0).stop 2024-09-19T04:24:38.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.644+0000 7f1e6eef9740 1 -- 172.21.15.7:0/3298526604 shutdown_connections 2024-09-19T04:24:38.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.644+0000 7f1e6eef9740 1 --2- 172.21.15.7:0/3298526604 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6b9555240 0x55a6b956d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:38.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.644+0000 7f1e6eef9740 1 --2- 172.21.15.7:0/3298526604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6b954a980 0x55a6b956cb70 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:38.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.644+0000 7f1e6eef9740 1 --2- 172.21.15.7:0/3298526604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6b954a060 0x55a6b9553fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:38.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.644+0000 7f1e6eef9740 1 -- 172.21.15.7:0/3298526604 >> 172.21.15.7:0/3298526604 conn(0x55a6b95465f0 msgr2=0x55a6b9545750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:38.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.644+0000 7f1e6eef9740 1 -- 172.21.15.7:0/3298526604 shutdown_connections 2024-09-19T04:24:38.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.644+0000 7f1e6eef9740 1 -- 172.21.15.7:0/3298526604 wait complete. 2024-09-19T04:24:38.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.644+0000 7f1e6eef9740 1 -- start start 2024-09-19T04:24:38.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.644+0000 7f1e6eef9740 1 Processor -- start 2024-09-19T04:24:38.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.644+0000 7f1e6eef9740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6b954a060 0x55a6b955d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:38.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.644+0000 7f1e6eef9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6b954a980 0x55a6b9559b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:38.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.644+0000 7f1e6eef9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6b9555240 0x55a6b955a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:38.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.644+0000 7f1e6eef9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1e681b2450 con 0x55a6b954a980 2024-09-19T04:24:38.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.644+0000 7f1e6eef9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1e681b1d80 con 0x55a6b9555240 2024-09-19T04:24:38.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.644+0000 7f1e6eef9740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1e681aefa0 con 0x55a6b954a060 2024-09-19T04:24:38.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.644+0000 7f1e6eef9740 10 client.0 _ll_register_callbacks cb 0x7f1e5800aed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:24:38.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.644+0000 7f1e5ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6b954a980 0x55a6b9559b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:38.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.644+0000 7f1e5ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6b954a980 0x55a6b9559b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49522/0 (socket says 172.21.15.7:49522) 2024-09-19T04:24:38.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.644+0000 7f1e5ffff640 1 -- 172.21.15.7:0/632699419 learned_addr learned my addr 172.21.15.7:0/632699419 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:38.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.644+0000 7f1e66d9d640 1 --2- 172.21.15.7:0/632699419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6b9555240 0x55a6b955a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:38.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.644+0000 7f1e6659c640 1 --2- 172.21.15.7:0/632699419 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6b954a060 0x55a6b955d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:38.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.645+0000 7f1e5ffff640 1 -- 172.21.15.7:0/632699419 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6b954a060 msgr2=0x55a6b955d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:38.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.645+0000 7f1e5ffff640 1 --2- 172.21.15.7:0/632699419 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6b954a060 0x55a6b955d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:38.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.645+0000 7f1e5ffff640 1 -- 172.21.15.7:0/632699419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6b9555240 msgr2=0x55a6b955a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:38.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.645+0000 7f1e5ffff640 1 --2- 172.21.15.7:0/632699419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6b9555240 0x55a6b955a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:38.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.645+0000 7f1e5ffff640 1 -- 172.21.15.7:0/632699419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6b955a7c0 con 0x55a6b954a980 2024-09-19T04:24:38.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.645+0000 7f1e5ffff640 1 --2- 172.21.15.7:0/632699419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6b954a980 0x55a6b9559b90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f1e500c4ae0 tx=0x7f1e500ed820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c33978c6dbe8f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:38.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.645+0000 7f1e4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:24:38.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.645+0000 7f1e4dffb640 1 -- 172.21.15.7:0/632699419 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e50049040 con 0x55a6b954a980 2024-09-19T04:24:38.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.645+0000 7f1e4dffb640 1 -- 172.21.15.7:0/632699419 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f1e500ed990 con 0x55a6b954a980 2024-09-19T04:24:38.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.645+0000 7f1e6eef9740 1 -- 172.21.15.7:0/632699419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e500c5010 con 0x55a6b954a980 2024-09-19T04:24:38.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.645+0000 7f1e4dffb640 1 -- 172.21.15.7:0/632699419 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f1e500bbdb0 con 0x55a6b954a980 2024-09-19T04:24:38.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.645+0000 7f1e6eef9740 10 client.16224 fetch_fsmap learned FSMap version 38 2024-09-19T04:24:38.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.645+0000 7f1e6eef9740 1 -- 172.21.15.7:0/632699419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55a6b95d91f0 con 0x55a6b954a980 2024-09-19T04:24:38.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.645+0000 7f1e4dffb640 1 -- 172.21.15.7:0/632699419 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e500c5010 con 0x55a6b954a980 2024-09-19T04:24:38.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.645+0000 7f1e4dffb640 1 -- 172.21.15.7:0/632699419 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 38) ==== 8378+0+0 (secure 0 0 0) 0x7f1e500c4b80 con 0x55a6b954a980 2024-09-19T04:24:38.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.645+0000 7f1e6eef9740 10 client.16224 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T04:24:38.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.645+0000 7f1e6eef9740 10 client.16224 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:24:38.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.645+0000 7f1e6eef9740 20 client.16224 populate_metadata read hostname 'smithi007' 2024-09-19T04:24:38.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.645+0000 7f1e6eef9740 1 --2- 172.21.15.7:0/632699419 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55a6b95d9860 0x55a6b95dbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:38.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.645+0000 7f1e6eef9740 4 client.16224 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f93b4a75", "release": true, "await": true}] 2024-09-19T04:24:38.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.645+0000 7f1e6eef9740 1 -- 172.21.15.7:0/632699419 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f93b4a75", "release": true, "await": true}) -- 0x55a6b94b70a0 con 0x55a6b95d9860 2024-09-19T04:24:38.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.646+0000 7f1e6659c640 1 --2- 172.21.15.7:0/632699419 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55a6b95d9860 0x55a6b95dbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:38.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.646+0000 7f1e6659c640 1 --2- 172.21.15.7:0/632699419 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55a6b95d9860 0x55a6b95dbc80 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f57c87712f520941 server_cookie=9a1b1068653aa153 in_seq=0 out_seq=0 2024-09-19T04:24:38.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:38.646+0000 7f1e4dffb640 10 client.16224 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:24:39.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:39 smithi007 ceph-mon[31360]: pgmap v586: 129 pgs: 129 active+clean; 500 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 835 op/s 2024-09-19T04:24:39.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:39 smithi102 ceph-mon[35446]: pgmap v586: 129 pgs: 129 active+clean; 500 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 835 op/s 2024-09-19T04:24:39.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:39 smithi092 ceph-mon[34940]: pgmap v586: 129 pgs: 129 active+clean; 500 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 835 op/s 2024-09-19T04:24:39.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:39.650+0000 7f1e4dffb640 1 -- 172.21.15.7:0/632699419 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55a6b94b70a0 con 0x55a6b95d9860 2024-09-19T04:24:39.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:39.651+0000 7f1e4dffb640 10 client.16224 handle_command_reply: tid=0 2024-09-19T04:24:39.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:39.651+0000 7f1e6eef9740 1 client.16224 shutdown 2024-09-19T04:24:39.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:39.651+0000 7f1e6eef9740 1 -- 172.21.15.7:0/632699419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6b954a980 msgr2=0x55a6b9559b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:39.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:39.651+0000 7f1e6eef9740 1 --2- 172.21.15.7:0/632699419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6b954a980 0x55a6b9559b90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f1e500c4ae0 tx=0x7f1e500ed820 comp rx=0 tx=0).stop 2024-09-19T04:24:39.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:39.651+0000 7f1e6eef9740 1 -- 172.21.15.7:0/632699419 shutdown_connections 2024-09-19T04:24:39.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:39.652+0000 7f1e6eef9740 1 --2- 172.21.15.7:0/632699419 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55a6b95d9860 0x55a6b95dbc80 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:39.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:39.652+0000 7f1e6eef9740 1 --2- 172.21.15.7:0/632699419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a6b9555240 0x55a6b955a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:39.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:39.652+0000 7f1e4dffb640 0 client.16224 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:24:39.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:39.652+0000 7f1e6eef9740 1 --2- 172.21.15.7:0/632699419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a6b954a980 0x55a6b9559b90 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:39.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:39.652+0000 7f1e6eef9740 1 --2- 172.21.15.7:0/632699419 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a6b954a060 0x55a6b955d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:39.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:39.652+0000 7f1e6eef9740 1 -- 172.21.15.7:0/632699419 >> 172.21.15.7:0/632699419 conn(0x55a6b95465f0 msgr2=0x55a6b9544f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:39.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:39.652+0000 7f1e6eef9740 1 -- 172.21.15.7:0/632699419 shutdown_connections 2024-09-19T04:24:39.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:39.652+0000 7f1e6eef9740 1 -- 172.21.15.7:0/632699419 wait complete. 2024-09-19T04:24:39.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:39.652+0000 7f1e6eef9740 20 client.16224 trim_cache size 0 max 16384 2024-09-19T04:24:39.655 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:24:39.655 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 38, 2024-09-19T04:24:39.656 INFO:teuthology.orchestra.run.smithi007.stdout: "leader": 24506, 2024-09-19T04:24:39.656 INFO:teuthology.orchestra.run.smithi007.stdout: "set_version": 28, 2024-09-19T04:24:39.656 INFO:teuthology.orchestra.run.smithi007.stdout: "sets": { 2024-09-19T04:24:39.656 INFO:teuthology.orchestra.run.smithi007.stdout: "f93b4a75": { 2024-09-19T04:24:39.656 INFO:teuthology.orchestra.run.smithi007.stdout: "version": 28, 2024-09-19T04:24:39.656 INFO:teuthology.orchestra.run.smithi007.stdout: "age_ref": 0.0, 2024-09-19T04:24:39.656 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:24:39.656 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RELEASED", 2024-09-19T04:24:39.656 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:24:39.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:24:39.657 INFO:teuthology.orchestra.run.smithi007.stdout: "timeout": 90.0, 2024-09-19T04:24:39.657 INFO:teuthology.orchestra.run.smithi007.stdout: "expiration": 145.8, 2024-09-19T04:24:39.657 INFO:teuthology.orchestra.run.smithi007.stdout: "members": { 2024-09-19T04:24:39.657 INFO:teuthology.orchestra.run.smithi007.stdout: "file:/": { 2024-09-19T04:24:39.657 INFO:teuthology.orchestra.run.smithi007.stdout: "excluded": false, 2024-09-19T04:24:39.657 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:24:39.657 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RELEASED", 2024-09-19T04:24:39.657 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:24:39.657 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:24:39.657 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:24:39.657 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:24:39.657 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:24:39.658 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:24:39.658 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:24:39.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:39.655+0000 7f1e6cb20640 1 -- 172.21.15.7:0/112379401 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1e540a3240 msgr2=0x7f1e540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:39.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:39.655+0000 7f1e6cb20640 1 --2- 172.21.15.7:0/112379401 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1e540a3240 0x7f1e540a5700 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1e60021000 tx=0x7f1e6001e000 comp rx=0 tx=0).stop 2024-09-19T04:24:39.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:39.655+0000 7f1e6cb20640 1 -- 172.21.15.7:0/112379401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e68103740 msgr2=0x7f1e68100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:39.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:39.655+0000 7f1e6cb20640 1 --2- 172.21.15.7:0/112379401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e68103740 0x7f1e68100f30 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f1e50005940 tx=0x7f1e500042f0 comp rx=0 tx=0).stop 2024-09-19T04:24:39.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:39.655+0000 7f1e6cb20640 1 -- 172.21.15.7:0/112379401 shutdown_connections 2024-09-19T04:24:39.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:39.655+0000 7f1e6cb20640 1 --2- 172.21.15.7:0/112379401 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1e540a3240 0x7f1e540a5700 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:39.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:39.655+0000 7f1e6cb20640 1 --2- 172.21.15.7:0/112379401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1e68108290 0x7f1e68101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:39.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:39.655+0000 7f1e6cb20640 1 --2- 172.21.15.7:0/112379401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1e68103740 0x7f1e68100f30 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:39.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:39.655+0000 7f1e6cb20640 1 --2- 172.21.15.7:0/112379401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e68102d90 0x7f1e681009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:39.655+0000 7f1e6cb20640 1 -- 172.21.15.7:0/112379401 >> 172.21.15.7:0/112379401 conn(0x7f1e680fc7d0 msgr2=0x7f1e68105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:39.656+0000 7f1e6cb20640 1 -- 172.21.15.7:0/112379401 shutdown_connections 2024-09-19T04:24:39.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:39.658+0000 7f1e6cb20640 1 -- 172.21.15.7:0/112379401 wait complete. 2024-09-19T04:24:40.344 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f93b4a75', total seconds elapsed: 30.5 2024-09-19T04:24:40.345 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.75 2024-09-19T04:24:40.345 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:24:40.609 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:24:41.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.198+0000 7fb4a7fff640 1 -- 172.21.15.7:0/3041431489 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac040880 con 0x7fb4b01008c0 2024-09-19T04:24:41.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.199+0000 7fb4b768a640 1 -- 172.21.15.7:0/3041431489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4b01008c0 msgr2=0x7fb4b0100ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:41.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.199+0000 7fb4b768a640 1 --2- 172.21.15.7:0/3041431489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4b01008c0 0x7fb4b0100ca0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac01a910 tx=0x7fb4ac03b430 comp rx=0 tx=0).stop 2024-09-19T04:24:41.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.199+0000 7fb4b768a640 1 -- 172.21.15.7:0/3041431489 shutdown_connections 2024-09-19T04:24:41.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.199+0000 7fb4b768a640 1 --2- 172.21.15.7:0/3041431489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b0105ec0 0x7fb4b0106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:41.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.199+0000 7fb4b768a640 1 --2- 172.21.15.7:0/3041431489 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4b01011e0 0x7fb4b0105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:41.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.199+0000 7fb4b768a640 1 --2- 172.21.15.7:0/3041431489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4b01008c0 0x7fb4b0100ca0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:41.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.199+0000 7fb4b768a640 1 -- 172.21.15.7:0/3041431489 >> 172.21.15.7:0/3041431489 conn(0x7fb4b00fc7d0 msgr2=0x7fb4b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:41.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.200+0000 7fb4b768a640 1 -- 172.21.15.7:0/3041431489 shutdown_connections 2024-09-19T04:24:41.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.200+0000 7fb4b768a640 1 -- 172.21.15.7:0/3041431489 wait complete. 2024-09-19T04:24:41.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.201+0000 7fb4b768a640 1 Processor -- start 2024-09-19T04:24:41.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.201+0000 7fb4b768a640 1 -- start start 2024-09-19T04:24:41.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.201+0000 7fb4b768a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b01008c0 0x7fb4b0114d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:41.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.202+0000 7fb4b768a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4b01011e0 0x7fb4b0110e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:41.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.202+0000 7fb4b768a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4b0105ec0 0x7fb4b0111340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:41.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.202+0000 7fb4b768a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b01098c0 con 0x7fb4b0105ec0 2024-09-19T04:24:41.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.202+0000 7fb4b768a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b0109740 con 0x7fb4b01008c0 2024-09-19T04:24:41.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.202+0000 7fb4b768a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b0109a40 con 0x7fb4b01011e0 2024-09-19T04:24:41.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.202+0000 7fb4b4c25640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4b01011e0 0x7fb4b0110e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:41.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.202+0000 7fb4b4c25640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4b01011e0 0x7fb4b0110e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:42062/0 (socket says 172.21.15.7:42062) 2024-09-19T04:24:41.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.202+0000 7fb4b4c25640 1 -- 172.21.15.7:0/3964007480 learned_addr learned my addr 172.21.15.7:0/3964007480 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:41.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.202+0000 7fb4b5426640 1 --2- 172.21.15.7:0/3964007480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b01008c0 0x7fb4b0114d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:41.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.202+0000 7fb4b5426640 1 -- 172.21.15.7:0/3964007480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4b01011e0 msgr2=0x7fb4b0110e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:41.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.202+0000 7fb4b5426640 1 --2- 172.21.15.7:0/3964007480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4b01011e0 0x7fb4b0110e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:41.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.202+0000 7fb4b5426640 1 -- 172.21.15.7:0/3964007480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4b0105ec0 msgr2=0x7fb4b0111340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:41.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.202+0000 7fb4b5426640 1 --2- 172.21.15.7:0/3964007480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4b0105ec0 0x7fb4b0111340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:41.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.202+0000 7fb4b5426640 1 -- 172.21.15.7:0/3964007480 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4b0111900 con 0x7fb4b01008c0 2024-09-19T04:24:41.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.203+0000 7fb4b5426640 1 --2- 172.21.15.7:0/3964007480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b01008c0 0x7fb4b0114d60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac03ba20 tx=0x7fb4ac004740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:41.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.203+0000 7fb4a67fc640 1 -- 172.21.15.7:0/3964007480 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac04f020 con 0x7fb4b01008c0 2024-09-19T04:24:41.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.204+0000 7fb4a67fc640 1 -- 172.21.15.7:0/3964007480 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4ac004c00 con 0x7fb4b01008c0 2024-09-19T04:24:41.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.204+0000 7fb4a67fc640 1 -- 172.21.15.7:0/3964007480 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac046070 con 0x7fb4b01008c0 2024-09-19T04:24:41.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.204+0000 7fb4b768a640 1 -- 172.21.15.7:0/3964007480 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4b0111b90 con 0x7fb4b01008c0 2024-09-19T04:24:41.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.204+0000 7fb4b768a640 1 -- 172.21.15.7:0/3964007480 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4b01a2c90 con 0x7fb4b01008c0 2024-09-19T04:24:41.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.207+0000 7fb4b768a640 1 -- 172.21.15.7:0/3964007480 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4b006a850 con 0x7fb4b01008c0 2024-09-19T04:24:41.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.209+0000 7fb4a67fc640 1 -- 172.21.15.7:0/3964007480 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fb4ac052020 con 0x7fb4b01008c0 2024-09-19T04:24:41.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.211+0000 7fb4a67fc640 1 --2- 172.21.15.7:0/3964007480 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb49c0a3340 0x7fb49c0a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:41.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.211+0000 7fb4a67fc640 1 -- 172.21.15.7:0/3964007480 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fb4ac101160 con 0x7fb4b01008c0 2024-09-19T04:24:41.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.211+0000 7fb4b4c25640 1 --2- 172.21.15.7:0/3964007480 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb49c0a3340 0x7fb49c0a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:41.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.212+0000 7fb4b4c25640 1 --2- 172.21.15.7:0/3964007480 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb49c0a3340 0x7fb49c0a5800 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb4b01125c0 tx=0x7fb4a000b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:41.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.217+0000 7fb4a67fc640 1 -- 172.21.15.7:0/3964007480 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb4ac059020 con 0x7fb4b01008c0 2024-09-19T04:24:41.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:41 smithi007 ceph-mon[31360]: pgmap v587: 129 pgs: 129 active+clean; 487 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 922 op/s 2024-09-19T04:24:41.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:41 smithi102 ceph-mon[35446]: pgmap v587: 129 pgs: 129 active+clean; 487 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 922 op/s 2024-09-19T04:24:41.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.445+0000 7fb4b768a640 1 -- 172.21.15.7:0/3964007480 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb4b01059b0 con 0x7fb4b01008c0 2024-09-19T04:24:41.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.446+0000 7fb4a67fc640 1 -- 172.21.15.7:0/3964007480 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11964 (secure 0 0 0) 0x7fb4b01059b0 con 0x7fb4b01008c0 2024-09-19T04:24:41.448 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:24:41.448 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":38,"btime":"2024-09-19T04:24:15:074970+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:24:14.309726+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24496,"mds_2":24482,"mds_3":24478,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24472,24478,24482,24496,24506]},"id":1}]} 2024-09-19T04:24:41.448 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 38 2024-09-19T04:24:41.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.449+0000 7fb4b768a640 1 -- 172.21.15.7:0/3964007480 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb49c0a3340 msgr2=0x7fb49c0a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:41.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.449+0000 7fb4b768a640 1 --2- 172.21.15.7:0/3964007480 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb49c0a3340 0x7fb49c0a5800 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fb4b01125c0 tx=0x7fb4a000b480 comp rx=0 tx=0).stop 2024-09-19T04:24:41.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.449+0000 7fb4b768a640 1 -- 172.21.15.7:0/3964007480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b01008c0 msgr2=0x7fb4b0114d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:41.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.449+0000 7fb4b768a640 1 --2- 172.21.15.7:0/3964007480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b01008c0 0x7fb4b0114d60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac03ba20 tx=0x7fb4ac004740 comp rx=0 tx=0).stop 2024-09-19T04:24:41.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.449+0000 7fb4b768a640 1 -- 172.21.15.7:0/3964007480 shutdown_connections 2024-09-19T04:24:41.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.449+0000 7fb4b768a640 1 --2- 172.21.15.7:0/3964007480 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fb49c0a3340 0x7fb49c0a5800 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:41.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.449+0000 7fb4b768a640 1 --2- 172.21.15.7:0/3964007480 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4b0105ec0 0x7fb4b0111340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:41.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.449+0000 7fb4b768a640 1 --2- 172.21.15.7:0/3964007480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4b01011e0 0x7fb4b0110e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:41.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.449+0000 7fb4b768a640 1 --2- 172.21.15.7:0/3964007480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb4b01008c0 0x7fb4b0114d60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:41.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.449+0000 7fb4b768a640 1 -- 172.21.15.7:0/3964007480 >> 172.21.15.7:0/3964007480 conn(0x7fb4b00fc7d0 msgr2=0x7fb4b0103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:41.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.449+0000 7fb4b768a640 1 -- 172.21.15.7:0/3964007480 shutdown_connections 2024-09-19T04:24:41.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:41.449+0000 7fb4b768a640 1 -- 172.21.15.7:0/3964007480 wait complete. 2024-09-19T04:24:41.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:41 smithi092 ceph-mon[34940]: pgmap v587: 129 pgs: 129 active+clean; 487 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 922 op/s 2024-09-19T04:24:42.157 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24506 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0' 2024-09-19T04:24:42.157 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24506 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0 2024-09-19T04:24:42.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:42 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3964007480' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:24:42.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:42 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3964007480' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:24:42.423 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:24:42.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:42 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3964007480' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:24:43.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.228+0000 7f6585da0640 1 -- 172.21.15.7:0/2507625340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65801082a0 msgr2=0x7f658010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:43.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.228+0000 7f6585da0640 1 --2- 172.21.15.7:0/2507625340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65801082a0 0x7f658010ec40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6578009cd0 tx=0x7f657802ecf0 comp rx=0 tx=0).stop 2024-09-19T04:24:43.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.228+0000 7f6585da0640 1 -- 172.21.15.7:0/2507625340 shutdown_connections 2024-09-19T04:24:43.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.228+0000 7f6585da0640 1 --2- 172.21.15.7:0/2507625340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65801082a0 0x7f658010ec40 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:43.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.228+0000 7f6585da0640 1 --2- 172.21.15.7:0/2507625340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65801036e0 0x7f6580107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:43.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.228+0000 7f6585da0640 1 --2- 172.21.15.7:0/2507625340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6580102d30 0x7f6580103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:43.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.228+0000 7f6585da0640 1 -- 172.21.15.7:0/2507625340 >> 172.21.15.7:0/2507625340 conn(0x7f65800fc7d0 msgr2=0x7f65800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:43.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.228+0000 7f6585da0640 1 -- 172.21.15.7:0/2507625340 shutdown_connections 2024-09-19T04:24:43.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.228+0000 7f6585da0640 1 -- 172.21.15.7:0/2507625340 wait complete. 2024-09-19T04:24:43.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.228+0000 7f6585da0640 1 Processor -- start 2024-09-19T04:24:43.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.228+0000 7f6585da0640 1 -- start start 2024-09-19T04:24:43.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.229+0000 7f6585da0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6580102d30 0x7f6580073d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:43.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.229+0000 7f6585da0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65801036e0 0x7f658006bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:43.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.229+0000 7f6585da0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65801082a0 0x7f658006c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:43.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.229+0000 7f6585da0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f65801186a0 con 0x7f65801036e0 2024-09-19T04:24:43.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.229+0000 7f6585da0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6580118520 con 0x7f65801082a0 2024-09-19T04:24:43.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.229+0000 7f6585da0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6580118820 con 0x7f6580102d30 2024-09-19T04:24:43.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.229+0000 7f657f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6580102d30 0x7f6580073d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:43.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.229+0000 7f657f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6580102d30 0x7f6580073d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:42092/0 (socket says 172.21.15.7:42092) 2024-09-19T04:24:43.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.229+0000 7f657f7fe640 1 -- 172.21.15.7:0/851810635 learned_addr learned my addr 172.21.15.7:0/851810635 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:43.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.229+0000 7f6577fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65801036e0 0x7f658006bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:43.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.229+0000 7f657ffff640 1 --2- 172.21.15.7:0/851810635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65801082a0 0x7f658006c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:43.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.229+0000 7f657f7fe640 1 -- 172.21.15.7:0/851810635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65801082a0 msgr2=0x7f658006c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:43.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.229+0000 7f657f7fe640 1 --2- 172.21.15.7:0/851810635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65801082a0 0x7f658006c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:43.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.229+0000 7f657f7fe640 1 -- 172.21.15.7:0/851810635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65801036e0 msgr2=0x7f658006bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:43.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.229+0000 7f657f7fe640 1 --2- 172.21.15.7:0/851810635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65801036e0 0x7f658006bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:43.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.229+0000 7f657f7fe640 1 -- 172.21.15.7:0/851810635 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f658006ca40 con 0x7f6580102d30 2024-09-19T04:24:43.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.229+0000 7f6577fff640 1 --2- 172.21.15.7:0/851810635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65801036e0 0x7f658006bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:24:43.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.229+0000 7f657f7fe640 1 --2- 172.21.15.7:0/851810635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6580102d30 0x7f6580073d10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f657000e9f0 tx=0x7f657000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:43.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.229+0000 7f657d7fa640 1 -- 172.21.15.7:0/851810635 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657000cd80 con 0x7f6580102d30 2024-09-19T04:24:43.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.229+0000 7f657d7fa640 1 -- 172.21.15.7:0/851810635 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6570010910 con 0x7f6580102d30 2024-09-19T04:24:43.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.229+0000 7f6585da0640 1 -- 172.21.15.7:0/851810635 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65801b3930 con 0x7f6580102d30 2024-09-19T04:24:43.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.229+0000 7f657d7fa640 1 -- 172.21.15.7:0/851810635 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6570018990 con 0x7f6580102d30 2024-09-19T04:24:43.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.230+0000 7f6585da0640 1 -- 172.21.15.7:0/851810635 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65801b3e70 con 0x7f6580102d30 2024-09-19T04:24:43.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.232+0000 7f657d7fa640 1 -- 172.21.15.7:0/851810635 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f6570010ac0 con 0x7f6580102d30 2024-09-19T04:24:43.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.233+0000 7f6588179740 1 Processor -- start 2024-09-19T04:24:43.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.233+0000 7f6588179740 1 -- start start 2024-09-19T04:24:43.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.233+0000 7f6588179740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5638ec282850 0x5638ec282c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:43.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.233+0000 7f6588179740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638ec283170 0x5638ec28d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:43.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.233+0000 7f6588179740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638ec28da30 0x5638ec28fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:43.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.233+0000 7f6588179740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5638ec1e7160 con 0x5638ec283170 2024-09-19T04:24:43.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.233+0000 7f6588179740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5638ec18e720 con 0x5638ec282850 2024-09-19T04:24:43.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.233+0000 7f6588179740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5638ec1e3120 con 0x5638ec28da30 2024-09-19T04:24:43.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.233+0000 7f657f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638ec283170 0x5638ec28d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:43.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.233+0000 7f657ffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5638ec282850 0x5638ec282c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:43.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.233+0000 7f657f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638ec283170 0x5638ec28d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49560/0 (socket says 172.21.15.7:49560) 2024-09-19T04:24:43.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.233+0000 7f657d7fa640 1 --2- 172.21.15.7:0/851810635 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f656c0a3240 0x7f656c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:43.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.233+0000 7f657f7fe640 1 -- 172.21.15.7:0/4262317835 learned_addr learned my addr 172.21.15.7:0/4262317835 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:43.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.233+0000 7f6577fff640 1 --2- 172.21.15.7:0/4262317835 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638ec28da30 0x5638ec28fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:43.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.233+0000 7f657ffff640 1 --2- 172.21.15.7:0/851810635 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f656c0a3240 0x7f656c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:43.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.234+0000 7f657d7fa640 1 -- 172.21.15.7:0/851810635 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f65700cffd0 con 0x7f6580102d30 2024-09-19T04:24:43.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.234+0000 7f657f7fe640 1 -- 172.21.15.7:0/4262317835 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638ec28da30 msgr2=0x5638ec28fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:43.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.234+0000 7f657f7fe640 1 --2- 172.21.15.7:0/4262317835 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638ec28da30 0x5638ec28fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:43.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.234+0000 7f657f7fe640 1 -- 172.21.15.7:0/4262317835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5638ec282850 msgr2=0x5638ec282c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:43.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.234+0000 7f657f7fe640 1 --2- 172.21.15.7:0/4262317835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5638ec282850 0x5638ec282c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:43.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.234+0000 7f657f7fe640 1 -- 172.21.15.7:0/4262317835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638ebf58ba0 con 0x5638ec283170 2024-09-19T04:24:43.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.234+0000 7f6577fff640 1 --2- 172.21.15.7:0/4262317835 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638ec28da30 0x5638ec28fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:24:43.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.234+0000 7f657f7fe640 1 --2- 172.21.15.7:0/4262317835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638ec283170 0x5638ec28d4f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f657009bfd0 tx=0x7f6570018420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=933e9aff196bad4a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:43.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.234+0000 7f6575ffb640 1 -- 172.21.15.7:0/4262317835 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65700bae60 con 0x5638ec283170 2024-09-19T04:24:43.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.234+0000 7f6575ffb640 1 -- 172.21.15.7:0/4262317835 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6570098ac0 con 0x5638ec283170 2024-09-19T04:24:43.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.234+0000 7f6575ffb640 1 -- 172.21.15.7:0/4262317835 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65700d2110 con 0x5638ec283170 2024-09-19T04:24:43.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.235+0000 7f6588179740 1 -- 172.21.15.7:0/4262317835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638ec283170 msgr2=0x5638ec28d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:43.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.235+0000 7f6588179740 1 --2- 172.21.15.7:0/4262317835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638ec283170 0x5638ec28d4f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f657009bfd0 tx=0x7f6570018420 comp rx=0 tx=0).stop 2024-09-19T04:24:43.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.235+0000 7f657ffff640 1 --2- 172.21.15.7:0/851810635 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f656c0a3240 0x7f656c0a5700 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6578009ca0 tx=0x7f657802ecf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:43.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.235+0000 7f6588179740 1 -- 172.21.15.7:0/4262317835 shutdown_connections 2024-09-19T04:24:43.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.235+0000 7f6588179740 1 --2- 172.21.15.7:0/4262317835 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638ec28da30 0x5638ec28fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:43.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.235+0000 7f6588179740 1 --2- 172.21.15.7:0/4262317835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638ec283170 0x5638ec28d4f0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:43.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.235+0000 7f6588179740 1 --2- 172.21.15.7:0/4262317835 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5638ec282850 0x5638ec282c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:43.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.235+0000 7f6588179740 1 -- 172.21.15.7:0/4262317835 >> 172.21.15.7:0/4262317835 conn(0x5638ec27ede0 msgr2=0x5638ec27f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:43.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.235+0000 7f6588179740 1 -- 172.21.15.7:0/4262317835 shutdown_connections 2024-09-19T04:24:43.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.235+0000 7f6588179740 1 -- 172.21.15.7:0/4262317835 wait complete. 2024-09-19T04:24:43.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.235+0000 7f6588179740 1 -- start start 2024-09-19T04:24:43.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.235+0000 7f6588179740 1 Processor -- start 2024-09-19T04:24:43.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.236+0000 7f6588179740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638ec282850 0x5638ec28a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:43.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.236+0000 7f6588179740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638ec283170 0x5638ec28ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:43.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.236+0000 7f6588179740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5638ec28da30 0x5638ec28b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:43.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.236+0000 7f6588179740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5638ec2905a0 con 0x5638ec282850 2024-09-19T04:24:43.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.236+0000 7f6588179740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5638ec16f900 con 0x5638ec28da30 2024-09-19T04:24:43.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.236+0000 7f6588179740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5638ec290720 con 0x5638ec283170 2024-09-19T04:24:43.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.236+0000 7f6588179740 10 client.0 _ll_register_callbacks cb 0x5638ec16d780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:24:43.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.236+0000 7f657f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638ec282850 0x5638ec28a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:43.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.236+0000 7f657f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638ec282850 0x5638ec28a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49574/0 (socket says 172.21.15.7:49574) 2024-09-19T04:24:43.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.236+0000 7f657f7fe640 1 -- 172.21.15.7:0/4274330374 learned_addr learned my addr 172.21.15.7:0/4274330374 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:43.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.236+0000 7f6577fff640 1 --2- 172.21.15.7:0/4274330374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638ec283170 0x5638ec28ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:43.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.236+0000 7f657ffff640 1 --2- 172.21.15.7:0/4274330374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5638ec28da30 0x5638ec28b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:43.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.236+0000 7f657f7fe640 1 -- 172.21.15.7:0/4274330374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638ec283170 msgr2=0x5638ec28ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:43.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.236+0000 7f657f7fe640 1 --2- 172.21.15.7:0/4274330374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638ec283170 0x5638ec28ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:43.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.236+0000 7f657f7fe640 1 -- 172.21.15.7:0/4274330374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5638ec28da30 msgr2=0x5638ec28b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:43.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.236+0000 7f657f7fe640 1 --2- 172.21.15.7:0/4274330374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5638ec28da30 0x5638ec28b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:43.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.236+0000 7f657f7fe640 1 -- 172.21.15.7:0/4274330374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638ec1afc50 con 0x5638ec282850 2024-09-19T04:24:43.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.236+0000 7f657f7fe640 1 --2- 172.21.15.7:0/4274330374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638ec282850 0x5638ec28a950 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f657009c260 tx=0x7f65700bbe70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e135cf71a2b8c474 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:43.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.236+0000 7f655effd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:24:43.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.236+0000 7f655effd640 1 -- 172.21.15.7:0/4274330374 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657009a5d0 con 0x5638ec282850 2024-09-19T04:24:43.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.236+0000 7f655effd640 1 -- 172.21.15.7:0/4274330374 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f65700cdbc0 con 0x5638ec282850 2024-09-19T04:24:43.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.236+0000 7f6588179740 1 -- 172.21.15.7:0/4274330374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5638ec1f4890 con 0x5638ec282850 2024-09-19T04:24:43.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.237+0000 7f655effd640 1 -- 172.21.15.7:0/4274330374 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f65700b5200 con 0x5638ec282850 2024-09-19T04:24:43.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.237+0000 7f6588179740 10 client.16239 fetch_fsmap learned FSMap version 38 2024-09-19T04:24:43.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.237+0000 7f6588179740 1 -- 172.21.15.7:0/4274330374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5638ec29c280 con 0x5638ec282850 2024-09-19T04:24:43.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.237+0000 7f655effd640 1 -- 172.21.15.7:0/4274330374 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5638ec1f4890 con 0x5638ec282850 2024-09-19T04:24:43.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.237+0000 7f655effd640 1 -- 172.21.15.7:0/4274330374 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 38) ==== 8378+0+0 (secure 0 0 0) 0x7f6570018c50 con 0x5638ec282850 2024-09-19T04:24:43.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.237+0000 7f6588179740 10 client.16239 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T04:24:43.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.237+0000 7f6588179740 10 client.16239 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:24:43.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.237+0000 7f6588179740 20 client.16239 populate_metadata read hostname 'smithi007' 2024-09-19T04:24:43.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.237+0000 7f6588179740 1 --2- 172.21.15.7:0/4274330374 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5638ec29d5d0 0x5638ec29f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:43.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.237+0000 7f6588179740 4 client.16239 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:24:43.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.237+0000 7f6588179740 1 -- 172.21.15.7:0/4274330374 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638ec1eebe0 con 0x5638ec29d5d0 2024-09-19T04:24:43.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.237+0000 7f6577fff640 1 --2- 172.21.15.7:0/4274330374 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5638ec29d5d0 0x5638ec29f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:43.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.238+0000 7f655effd640 10 client.16239 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:24:43.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.238+0000 7f6577fff640 1 --2- 172.21.15.7:0/4274330374 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5638ec29d5d0 0x5638ec29f9c0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b3a0cf7736bb9ce server_cookie=19eeaa8ca045185 in_seq=0 out_seq=0 2024-09-19T04:24:43.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.238+0000 7f655effd640 1 -- 172.21.15.7:0/4274330374 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5638ec1eebe0 con 0x5638ec29d5d0 2024-09-19T04:24:43.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.238+0000 7f655effd640 10 client.16239 handle_command_reply: tid=0 2024-09-19T04:24:43.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.238+0000 7f6588179740 1 client.16239 shutdown 2024-09-19T04:24:43.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.239+0000 7f6588179740 1 -- 172.21.15.7:0/4274330374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638ec282850 msgr2=0x5638ec28a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:43.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.239+0000 7f6588179740 1 --2- 172.21.15.7:0/4274330374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638ec282850 0x5638ec28a950 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f657009c260 tx=0x7f65700bbe70 comp rx=0 tx=0).stop 2024-09-19T04:24:43.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.239+0000 7f6588179740 1 -- 172.21.15.7:0/4274330374 shutdown_connections 2024-09-19T04:24:43.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.239+0000 7f6588179740 1 --2- 172.21.15.7:0/4274330374 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5638ec29d5d0 0x5638ec29f9c0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:43.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.239+0000 7f6588179740 1 --2- 172.21.15.7:0/4274330374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5638ec28da30 0x5638ec28b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:43.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.239+0000 7f6588179740 1 --2- 172.21.15.7:0/4274330374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638ec283170 0x5638ec28ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:43.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.239+0000 7f655effd640 0 client.16239 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:24:43.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.239+0000 7f6588179740 1 --2- 172.21.15.7:0/4274330374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638ec282850 0x5638ec28a950 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:43.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.239+0000 7f6588179740 1 -- 172.21.15.7:0/4274330374 >> 172.21.15.7:0/4274330374 conn(0x5638ec27ede0 msgr2=0x5638ec284b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:43.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.239+0000 7f6588179740 1 -- 172.21.15.7:0/4274330374 shutdown_connections 2024-09-19T04:24:43.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.239+0000 7f6588179740 1 -- 172.21.15.7:0/4274330374 wait complete. 2024-09-19T04:24:43.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.239+0000 7f6588179740 20 client.16239 trim_cache size 0 max 16384 2024-09-19T04:24:43.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.256+0000 7f6588179740 1 Processor -- start 2024-09-19T04:24:43.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.256+0000 7f6588179740 1 -- start start 2024-09-19T04:24:43.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.256+0000 7f6588179740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5638ec282850 0x5638ec285e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:43.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.257+0000 7f6588179740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638ec283170 0x5638ec285300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:43.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.257+0000 7f6588179740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638ec28da30 0x5638ec27ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:43.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.257+0000 7f6588179740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f65801bdca0 con 0x5638ec283170 2024-09-19T04:24:43.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.257+0000 7f6588179740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f65801bf810 con 0x5638ec282850 2024-09-19T04:24:43.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.257+0000 7f6588179740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f65801be370 con 0x5638ec28da30 2024-09-19T04:24:43.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.257+0000 7f6577fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638ec283170 0x5638ec285300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:43.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.257+0000 7f657f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5638ec282850 0x5638ec285e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:43.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.257+0000 7f6577fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638ec283170 0x5638ec285300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49576/0 (socket says 172.21.15.7:49576) 2024-09-19T04:24:43.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.257+0000 7f6577fff640 1 -- 172.21.15.7:0/316691367 learned_addr learned my addr 172.21.15.7:0/316691367 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:43.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.257+0000 7f657ffff640 1 --2- 172.21.15.7:0/316691367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638ec28da30 0x5638ec27ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:43.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.257+0000 7f6577fff640 1 -- 172.21.15.7:0/316691367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638ec28da30 msgr2=0x5638ec27ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:43.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.257+0000 7f6577fff640 1 --2- 172.21.15.7:0/316691367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638ec28da30 0x5638ec27ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:43.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.257+0000 7f6577fff640 1 -- 172.21.15.7:0/316691367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5638ec282850 msgr2=0x5638ec285e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:43.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.257+0000 7f6577fff640 1 --2- 172.21.15.7:0/316691367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5638ec282850 0x5638ec285e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:43.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.257+0000 7f6577fff640 1 -- 172.21.15.7:0/316691367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638ec27ec10 con 0x5638ec283170 2024-09-19T04:24:43.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.257+0000 7f657f7fe640 1 --2- 172.21.15.7:0/316691367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5638ec282850 0x5638ec285e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:24:43.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.257+0000 7f6577fff640 1 --2- 172.21.15.7:0/316691367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638ec283170 0x5638ec285300 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6568000c00 tx=0x7f656800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb8540aa04c587b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:43.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.257+0000 7f65757fa640 1 -- 172.21.15.7:0/316691367 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6568023030 con 0x5638ec283170 2024-09-19T04:24:43.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.257+0000 7f65757fa640 1 -- 172.21.15.7:0/316691367 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6568005500 con 0x5638ec283170 2024-09-19T04:24:43.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.258+0000 7f65757fa640 1 -- 172.21.15.7:0/316691367 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656801f6e0 con 0x5638ec283170 2024-09-19T04:24:43.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.258+0000 7f6588179740 1 -- 172.21.15.7:0/316691367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638ec283170 msgr2=0x5638ec285300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:43.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.258+0000 7f6588179740 1 --2- 172.21.15.7:0/316691367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638ec283170 0x5638ec285300 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6568000c00 tx=0x7f656800b390 comp rx=0 tx=0).stop 2024-09-19T04:24:43.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.258+0000 7f6588179740 1 -- 172.21.15.7:0/316691367 shutdown_connections 2024-09-19T04:24:43.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.258+0000 7f6588179740 1 --2- 172.21.15.7:0/316691367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638ec28da30 0x5638ec27ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:43.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.258+0000 7f6588179740 1 --2- 172.21.15.7:0/316691367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638ec283170 0x5638ec285300 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:43.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.258+0000 7f6588179740 1 --2- 172.21.15.7:0/316691367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5638ec282850 0x5638ec285e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:43.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.258+0000 7f6588179740 1 -- 172.21.15.7:0/316691367 >> 172.21.15.7:0/316691367 conn(0x5638ec27ede0 msgr2=0x5638ec27d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:43.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.258+0000 7f6588179740 1 -- 172.21.15.7:0/316691367 shutdown_connections 2024-09-19T04:24:43.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.258+0000 7f6588179740 1 -- 172.21.15.7:0/316691367 wait complete. 2024-09-19T04:24:43.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.258+0000 7f6588179740 1 -- start start 2024-09-19T04:24:43.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.259+0000 7f6588179740 1 Processor -- start 2024-09-19T04:24:43.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.259+0000 7f6588179740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5638ec282850 0x5638ec296290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:43.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.259+0000 7f6588179740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638ec283170 0x5638ec287890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:43.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.259+0000 7f6588179740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638ec28da30 0x5638ec288020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:43.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.259+0000 7f6588179740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f65801bf110 con 0x5638ec283170 2024-09-19T04:24:43.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.259+0000 7f6588179740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f65801bea40 con 0x5638ec282850 2024-09-19T04:24:43.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.259+0000 7f6588179740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f65801bbc60 con 0x5638ec28da30 2024-09-19T04:24:43.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.259+0000 7f6588179740 10 client.0 _ll_register_callbacks cb 0x7f6580074370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:24:43.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.259+0000 7f6577fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638ec283170 0x5638ec287890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:43.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.259+0000 7f6577fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638ec283170 0x5638ec287890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49592/0 (socket says 172.21.15.7:49592) 2024-09-19T04:24:43.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.259+0000 7f657f7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5638ec282850 0x5638ec296290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:43.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.259+0000 7f6577fff640 1 -- 172.21.15.7:0/282618622 learned_addr learned my addr 172.21.15.7:0/282618622 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:43.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.259+0000 7f657ffff640 1 --2- 172.21.15.7:0/282618622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638ec28da30 0x5638ec288020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:43.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.260+0000 7f6577fff640 1 -- 172.21.15.7:0/282618622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638ec28da30 msgr2=0x5638ec288020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:43.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.260+0000 7f6577fff640 1 --2- 172.21.15.7:0/282618622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638ec28da30 0x5638ec288020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:43.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.260+0000 7f6577fff640 1 -- 172.21.15.7:0/282618622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5638ec282850 msgr2=0x5638ec296290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:43.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.260+0000 7f6577fff640 1 --2- 172.21.15.7:0/282618622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5638ec282850 0x5638ec296290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:43.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.260+0000 7f6577fff640 1 -- 172.21.15.7:0/282618622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638ec307020 con 0x5638ec283170 2024-09-19T04:24:43.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.260+0000 7f657f7fe640 1 --2- 172.21.15.7:0/282618622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5638ec282850 0x5638ec296290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:24:43.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.260+0000 7f6577fff640 1 --2- 172.21.15.7:0/282618622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638ec283170 0x5638ec287890 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f656800bd50 tx=0x7f656800bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983dbb3598a6e5ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:43.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.260+0000 7f655effd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:24:43.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.260+0000 7f655effd640 1 -- 172.21.15.7:0/282618622 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6568005230 con 0x5638ec283170 2024-09-19T04:24:43.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.260+0000 7f655effd640 1 -- 172.21.15.7:0/282618622 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f6568004020 con 0x5638ec283170 2024-09-19T04:24:43.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.260+0000 7f6588179740 1 -- 172.21.15.7:0/282618622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6568005500 con 0x5638ec283170 2024-09-19T04:24:43.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.260+0000 7f655effd640 1 -- 172.21.15.7:0/282618622 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f656803d050 con 0x5638ec283170 2024-09-19T04:24:43.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.260+0000 7f6588179740 10 client.16245 fetch_fsmap learned FSMap version 38 2024-09-19T04:24:43.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.260+0000 7f6588179740 1 -- 172.21.15.7:0/282618622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5638ec3081e0 con 0x5638ec283170 2024-09-19T04:24:43.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.260+0000 7f655effd640 1 -- 172.21.15.7:0/282618622 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6568005500 con 0x5638ec283170 2024-09-19T04:24:43.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.261+0000 7f655effd640 1 -- 172.21.15.7:0/282618622 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 38) ==== 8378+0+0 (secure 0 0 0) 0x7f656801f580 con 0x5638ec283170 2024-09-19T04:24:43.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.261+0000 7f6588179740 10 client.16245 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T04:24:43.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.261+0000 7f6588179740 10 client.16245 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:24:43.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.261+0000 7f6588179740 20 client.16245 populate_metadata read hostname 'smithi007' 2024-09-19T04:24:43.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.261+0000 7f6588179740 1 --2- 172.21.15.7:0/282618622 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5638ec308960 0x5638ec30ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:43.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.261+0000 7f6588179740 4 client.16245 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}] 2024-09-19T04:24:43.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.261+0000 7f6588179740 1 -- 172.21.15.7:0/282618622 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}) -- 0x5638ec16af40 con 0x5638ec308960 2024-09-19T04:24:43.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.261+0000 7f657f7fe640 1 --2- 172.21.15.7:0/282618622 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5638ec308960 0x5638ec30ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:43.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.261+0000 7f655effd640 10 client.16245 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:24:43.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:43.261+0000 7f657f7fe640 1 --2- 172.21.15.7:0/282618622 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5638ec308960 0x5638ec30ad80 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=131d2bd8f3df0cfc server_cookie=566f8a340ff8f4f in_seq=0 out_seq=0 2024-09-19T04:24:43.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:43 smithi007 ceph-mon[31360]: pgmap v588: 129 pgs: 129 active+clean; 486 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 758 op/s 2024-09-19T04:24:43.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:43 smithi102 ceph-mon[35446]: pgmap v588: 129 pgs: 129 active+clean; 486 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 758 op/s 2024-09-19T04:24:43.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:43 smithi092 ceph-mon[34940]: pgmap v588: 129 pgs: 129 active+clean; 486 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 758 op/s 2024-09-19T04:24:45.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:45 smithi102 ceph-mon[35446]: pgmap v589: 129 pgs: 129 active+clean; 485 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 724 op/s 2024-09-19T04:24:45.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:45 smithi092 ceph-mon[34940]: pgmap v589: 129 pgs: 129 active+clean; 485 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 724 op/s 2024-09-19T04:24:45.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:45 smithi007 ceph-mon[31360]: pgmap v589: 129 pgs: 129 active+clean; 485 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 724 op/s 2024-09-19T04:24:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.732+0000 7f97249bd640 1 -- 172.21.15.7:0/3501440679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9720104f20 msgr2=0x7f9720107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.732+0000 7f97249bd640 1 --2- 172.21.15.7:0/3501440679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9720104f20 0x7f9720107310 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f9714009900 tx=0x7f971402a410 comp rx=0 tx=0).stop 2024-09-19T04:24:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.732+0000 7f97249bd640 1 -- 172.21.15.7:0/3501440679 shutdown_connections 2024-09-19T04:24:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.732+0000 7f97249bd640 1 --2- 172.21.15.7:0/3501440679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9720107850 0x7f9720109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.732+0000 7f97249bd640 1 --2- 172.21.15.7:0/3501440679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9720104f20 0x7f9720107310 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.732+0000 7f97249bd640 1 --2- 172.21.15.7:0/3501440679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97201025f0 0x7f97201049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:46.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.732+0000 7f97249bd640 1 -- 172.21.15.7:0/3501440679 >> 172.21.15.7:0/3501440679 conn(0x7f97200fc1f0 msgr2=0x7f97200fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.732+0000 7f97249bd640 1 -- 172.21.15.7:0/3501440679 shutdown_connections 2024-09-19T04:24:46.735 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.732+0000 7f97249bd640 1 -- 172.21.15.7:0/3501440679 wait complete. 2024-09-19T04:24:46.736 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.733+0000 7f97249bd640 1 Processor -- start 2024-09-19T04:24:46.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.733+0000 7f97249bd640 1 -- start start 2024-09-19T04:24:46.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.733+0000 7f97249bd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97201025f0 0x7f972019a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:46.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.733+0000 7f97249bd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9720104f20 0x7f972019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:46.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.733+0000 7f97249bd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9720107850 0x7f97201a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:46.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.733+0000 7f97249bd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f972010d820 con 0x7f97201025f0 2024-09-19T04:24:46.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.733+0000 7f97249bd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f972010d6a0 con 0x7f9720104f20 2024-09-19T04:24:46.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.733+0000 7f97249bd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f972010d9a0 con 0x7f9720107850 2024-09-19T04:24:46.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.733+0000 7f971e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97201025f0 0x7f972019a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:46.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.733+0000 7f971e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97201025f0 0x7f972019a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49618/0 (socket says 172.21.15.7:49618) 2024-09-19T04:24:46.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.733+0000 7f971e59c640 1 -- 172.21.15.7:0/291574491 learned_addr learned my addr 172.21.15.7:0/291574491 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:46.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.733+0000 7f971dd9b640 1 --2- 172.21.15.7:0/291574491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9720104f20 0x7f972019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:46.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.734+0000 7f971ed9d640 1 --2- 172.21.15.7:0/291574491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9720107850 0x7f97201a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:46.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.734+0000 7f971e59c640 1 -- 172.21.15.7:0/291574491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9720107850 msgr2=0x7f97201a16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.734+0000 7f971e59c640 1 --2- 172.21.15.7:0/291574491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9720107850 0x7f97201a16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.734+0000 7f971e59c640 1 -- 172.21.15.7:0/291574491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9720104f20 msgr2=0x7f972019a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.734+0000 7f971e59c640 1 --2- 172.21.15.7:0/291574491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9720104f20 0x7f972019a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.734+0000 7f971e59c640 1 -- 172.21.15.7:0/291574491 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97201a1d60 con 0x7f97201025f0 2024-09-19T04:24:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.734+0000 7f971e59c640 1 --2- 172.21.15.7:0/291574491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97201025f0 0x7f972019a140 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f971000eb90 tx=0x7f971000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.734+0000 7f970f7fe640 1 -- 172.21.15.7:0/291574491 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9710004d20 con 0x7f97201025f0 2024-09-19T04:24:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.734+0000 7f970f7fe640 1 -- 172.21.15.7:0/291574491 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f971000ee90 con 0x7f97201025f0 2024-09-19T04:24:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.734+0000 7f97249bd640 1 -- 172.21.15.7:0/291574491 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97201a1ff0 con 0x7f97201025f0 2024-09-19T04:24:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.734+0000 7f970f7fe640 1 -- 172.21.15.7:0/291574491 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9710010830 con 0x7f97201025f0 2024-09-19T04:24:46.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.734+0000 7f97249bd640 1 -- 172.21.15.7:0/291574491 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97201a2460 con 0x7f97201025f0 2024-09-19T04:24:46.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.737+0000 7f970f7fe640 1 -- 172.21.15.7:0/291574491 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f9710005020 con 0x7f97201025f0 2024-09-19T04:24:46.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.737+0000 7f9727832740 1 Processor -- start 2024-09-19T04:24:46.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.737+0000 7f9727832740 1 -- start start 2024-09-19T04:24:46.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.737+0000 7f9727832740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564dbb86e9a0 0x564dbb86eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:46.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.737+0000 7f9727832740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564dbb86f2e0 0x564dbb873da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:46.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.737+0000 7f9727832740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dbb874370 0x564dbb876830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:46.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.737+0000 7f9727832740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564dbb7d22f0 con 0x564dbb874370 2024-09-19T04:24:46.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.737+0000 7f9727832740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564dbb77a270 con 0x564dbb86e9a0 2024-09-19T04:24:46.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.737+0000 7f9727832740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564dbb7ce2b0 con 0x564dbb86f2e0 2024-09-19T04:24:46.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.737+0000 7f971ed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564dbb86e9a0 0x564dbb86eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:46.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.737+0000 7f971dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dbb874370 0x564dbb876830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:46.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.737+0000 7f971ed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564dbb86e9a0 0x564dbb86eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:53008/0 (socket says 172.21.15.7:53008) 2024-09-19T04:24:46.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.737+0000 7f971ed9d640 1 -- 172.21.15.7:0/1651593699 learned_addr learned my addr 172.21.15.7:0/1651593699 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:46.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.738+0000 7f971e59c640 1 --2- 172.21.15.7:0/1651593699 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564dbb86f2e0 0x564dbb873da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:46.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.738+0000 7f970f7fe640 1 --2- 172.21.15.7:0/291574491 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f97080a3240 0x7f97080a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:46.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.738+0000 7f971ed9d640 1 -- 172.21.15.7:0/1651593699 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564dbb86f2e0 msgr2=0x564dbb873da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:46.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.738+0000 7f971ed9d640 1 --2- 172.21.15.7:0/1651593699 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564dbb86f2e0 0x564dbb873da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:46.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.738+0000 7f971ed9d640 1 -- 172.21.15.7:0/1651593699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dbb874370 msgr2=0x564dbb876830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:46.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.738+0000 7f971ed9d640 1 --2- 172.21.15.7:0/1651593699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dbb874370 0x564dbb876830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:46.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.738+0000 7f971ed9d640 1 -- 172.21.15.7:0/1651593699 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dbb779340 con 0x564dbb86e9a0 2024-09-19T04:24:46.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.738+0000 7f970f7fe640 1 -- 172.21.15.7:0/291574491 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f97100d0310 con 0x7f97201025f0 2024-09-19T04:24:46.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.738+0000 7f971ed9d640 1 --2- 172.21.15.7:0/291574491 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f97080a3240 0x7f97080a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:46.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.738+0000 7f971ed9d640 1 --2- 172.21.15.7:0/1651593699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564dbb86e9a0 0x564dbb86eda0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9718009c20 tx=0x7f9718011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69208b4a0ab0d578 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.738+0000 7f970cff9640 1 -- 172.21.15.7:0/1651593699 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971801b850 con 0x564dbb86e9a0 2024-09-19T04:24:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.738+0000 7f970cff9640 1 -- 172.21.15.7:0/1651593699 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9718019db0 con 0x564dbb86e9a0 2024-09-19T04:24:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.738+0000 7f970cff9640 1 -- 172.21.15.7:0/1651593699 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971800eda0 con 0x564dbb86e9a0 2024-09-19T04:24:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.739+0000 7f9727832740 1 -- 172.21.15.7:0/1651593699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564dbb86e9a0 msgr2=0x564dbb86eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.739+0000 7f971ed9d640 1 --2- 172.21.15.7:0/291574491 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f97080a3240 0x7f97080a5700 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9718009fd0 tx=0x7f9718021000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.739+0000 7f9727832740 1 --2- 172.21.15.7:0/1651593699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564dbb86e9a0 0x564dbb86eda0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9718009c20 tx=0x7f9718011810 comp rx=0 tx=0).stop 2024-09-19T04:24:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.739+0000 7f9727832740 1 -- 172.21.15.7:0/1651593699 shutdown_connections 2024-09-19T04:24:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.739+0000 7f9727832740 1 --2- 172.21.15.7:0/1651593699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dbb874370 0x564dbb876830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.739+0000 7f9727832740 1 --2- 172.21.15.7:0/1651593699 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564dbb86f2e0 0x564dbb873da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.739+0000 7f9727832740 1 --2- 172.21.15.7:0/1651593699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564dbb86e9a0 0x564dbb86eda0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.739+0000 7f9727832740 1 -- 172.21.15.7:0/1651593699 >> 172.21.15.7:0/1651593699 conn(0x564dbb86a010 msgr2=0x564dbb86a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.739+0000 7f9727832740 1 -- 172.21.15.7:0/1651593699 shutdown_connections 2024-09-19T04:24:46.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.739+0000 7f9727832740 1 -- 172.21.15.7:0/1651593699 wait complete. 2024-09-19T04:24:46.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.740+0000 7f9727832740 1 -- start start 2024-09-19T04:24:46.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.740+0000 7f9727832740 1 Processor -- start 2024-09-19T04:24:46.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.740+0000 7f9727832740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564dbb86e9a0 0x564dbb878b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:46.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.740+0000 7f9727832740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564dbb86f2e0 0x564dbb8790a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:46.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.740+0000 7f9727832740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dbb874370 0x564dbb8800e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:46.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.740+0000 7f9727832740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564dbb877340 con 0x564dbb874370 2024-09-19T04:24:46.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.740+0000 7f9727832740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564dbb75b290 con 0x564dbb86f2e0 2024-09-19T04:24:46.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.740+0000 7f9727832740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564dbb8774c0 con 0x564dbb86e9a0 2024-09-19T04:24:46.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.740+0000 7f9727832740 10 client.0 _ll_register_callbacks cb 0x564dbb78c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:24:46.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.740+0000 7f971ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dbb874370 0x564dbb8800e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:46.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.740+0000 7f971ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dbb874370 0x564dbb8800e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49630/0 (socket says 172.21.15.7:49630) 2024-09-19T04:24:46.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.740+0000 7f971ed9d640 1 -- 172.21.15.7:0/1099787596 learned_addr learned my addr 172.21.15.7:0/1099787596 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:46.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.740+0000 7f971dd9b640 1 --2- 172.21.15.7:0/1099787596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564dbb86f2e0 0x564dbb8790a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:46.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.740+0000 7f971e59c640 1 --2- 172.21.15.7:0/1099787596 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564dbb86e9a0 0x564dbb878b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:46.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.740+0000 7f971ed9d640 1 -- 172.21.15.7:0/1099787596 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564dbb86e9a0 msgr2=0x564dbb878b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:46.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.740+0000 7f971ed9d640 1 --2- 172.21.15.7:0/1099787596 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564dbb86e9a0 0x564dbb878b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:46.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.740+0000 7f971ed9d640 1 -- 172.21.15.7:0/1099787596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564dbb86f2e0 msgr2=0x564dbb8790a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:46.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.740+0000 7f971ed9d640 1 --2- 172.21.15.7:0/1099787596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564dbb86f2e0 0x564dbb8790a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:46.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.740+0000 7f971ed9d640 1 -- 172.21.15.7:0/1099787596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dbb4e5210 con 0x564dbb874370 2024-09-19T04:24:46.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.740+0000 7f971dd9b640 1 --2- 172.21.15.7:0/1099787596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564dbb86f2e0 0x564dbb8790a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:24:46.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.741+0000 7f971ed9d640 1 --2- 172.21.15.7:0/1099787596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dbb874370 0x564dbb8800e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f9718009330 tx=0x7f9718009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90dbb86e4ee63b93 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:46.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.741+0000 7f9705ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:24:46.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.741+0000 7f9705ffb640 1 -- 172.21.15.7:0/1099787596 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9718036060 con 0x564dbb874370 2024-09-19T04:24:46.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.741+0000 7f9705ffb640 1 -- 172.21.15.7:0/1099787596 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f971801b760 con 0x564dbb874370 2024-09-19T04:24:46.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.741+0000 7f9727832740 1 -- 172.21.15.7:0/1099787596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9718019db0 con 0x564dbb874370 2024-09-19T04:24:46.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.741+0000 7f9705ffb640 1 -- 172.21.15.7:0/1099787596 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f971803d050 con 0x564dbb874370 2024-09-19T04:24:46.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.741+0000 7f9727832740 10 client.16257 fetch_fsmap learned FSMap version 38 2024-09-19T04:24:46.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.741+0000 7f9727832740 1 -- 172.21.15.7:0/1099787596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x564dbb5b1620 con 0x564dbb874370 2024-09-19T04:24:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.741+0000 7f9705ffb640 1 -- 172.21.15.7:0/1099787596 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9718019db0 con 0x564dbb874370 2024-09-19T04:24:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.741+0000 7f9705ffb640 1 -- 172.21.15.7:0/1099787596 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 38) ==== 8378+0+0 (secure 0 0 0) 0x7f9718004680 con 0x564dbb874370 2024-09-19T04:24:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.741+0000 7f9727832740 10 client.16257 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T04:24:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.741+0000 7f9727832740 10 client.16257 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:24:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.742+0000 7f9727832740 20 client.16257 populate_metadata read hostname 'smithi007' 2024-09-19T04:24:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.742+0000 7f9727832740 1 --2- 172.21.15.7:0/1099787596 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564dbb8845d0 0x564dbb8869c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.742+0000 7f9727832740 4 client.16257 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:24:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.742+0000 7f9727832740 1 -- 172.21.15.7:0/1099787596 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564dbb7dfa20 con 0x564dbb8845d0 2024-09-19T04:24:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.742+0000 7f971e59c640 1 --2- 172.21.15.7:0/1099787596 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564dbb8845d0 0x564dbb8869c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.742+0000 7f971e59c640 1 --2- 172.21.15.7:0/1099787596 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564dbb8845d0 0x564dbb8869c0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e6aaf9122affe7a server_cookie=5f6783050bf9188d in_seq=0 out_seq=0 2024-09-19T04:24:46.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.742+0000 7f9705ffb640 10 client.16257 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:24:46.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.781+0000 7f9705ffb640 1 -- 172.21.15.7:0/1099787596 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564dbb7dfa20 con 0x564dbb8845d0 2024-09-19T04:24:46.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.781+0000 7f9705ffb640 10 client.16257 handle_command_reply: tid=0 2024-09-19T04:24:46.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.781+0000 7f9727832740 1 client.16257 shutdown 2024-09-19T04:24:46.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.781+0000 7f9727832740 1 -- 172.21.15.7:0/1099787596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dbb874370 msgr2=0x564dbb8800e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:46.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.781+0000 7f9727832740 1 --2- 172.21.15.7:0/1099787596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dbb874370 0x564dbb8800e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f9718009330 tx=0x7f9718009f10 comp rx=0 tx=0).stop 2024-09-19T04:24:46.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.781+0000 7f9727832740 1 -- 172.21.15.7:0/1099787596 shutdown_connections 2024-09-19T04:24:46.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.781+0000 7f9727832740 1 --2- 172.21.15.7:0/1099787596 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564dbb8845d0 0x564dbb8869c0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:46.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.781+0000 7f9727832740 1 --2- 172.21.15.7:0/1099787596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dbb874370 0x564dbb8800e0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:46.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.781+0000 7f9705ffb640 0 client.16257 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:24:46.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.781+0000 7f9727832740 1 --2- 172.21.15.7:0/1099787596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564dbb86f2e0 0x564dbb8790a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:46.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.781+0000 7f9727832740 1 --2- 172.21.15.7:0/1099787596 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564dbb86e9a0 0x564dbb878b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:46.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.781+0000 7f9727832740 1 -- 172.21.15.7:0/1099787596 >> 172.21.15.7:0/1099787596 conn(0x564dbb86a010 msgr2=0x564dbb86b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:46.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.781+0000 7f9727832740 1 -- 172.21.15.7:0/1099787596 shutdown_connections 2024-09-19T04:24:46.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.781+0000 7f9727832740 1 -- 172.21.15.7:0/1099787596 wait complete. 2024-09-19T04:24:46.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.781+0000 7f9727832740 20 client.16257 trim_cache size 0 max 16384 2024-09-19T04:24:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.796+0000 7f9727832740 1 Processor -- start 2024-09-19T04:24:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.796+0000 7f9727832740 1 -- start start 2024-09-19T04:24:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.796+0000 7f9727832740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564dbb86e9a0 0x564dbb86ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.796+0000 7f9727832740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dbb86f2e0 0x564dbb8800a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.796+0000 7f9727832740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564dbb874370 0x564dbb86af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.796+0000 7f9727832740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f97201acbd0 con 0x564dbb86f2e0 2024-09-19T04:24:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.796+0000 7f9727832740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f97201ae740 con 0x564dbb874370 2024-09-19T04:24:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.796+0000 7f9727832740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f97201ad2a0 con 0x564dbb86e9a0 2024-09-19T04:24:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.796+0000 7f971dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dbb86f2e0 0x564dbb8800a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.796+0000 7f971dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dbb86f2e0 0x564dbb8800a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49642/0 (socket says 172.21.15.7:49642) 2024-09-19T04:24:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.796+0000 7f971dd9b640 1 -- 172.21.15.7:0/618580752 learned_addr learned my addr 172.21.15.7:0/618580752 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.797+0000 7f971ed9d640 1 --2- 172.21.15.7:0/618580752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564dbb874370 0x564dbb86af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.797+0000 7f971e59c640 1 --2- 172.21.15.7:0/618580752 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564dbb86e9a0 0x564dbb86ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.797+0000 7f971dd9b640 1 -- 172.21.15.7:0/618580752 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564dbb86e9a0 msgr2=0x564dbb86ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.797+0000 7f971dd9b640 1 --2- 172.21.15.7:0/618580752 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564dbb86e9a0 0x564dbb86ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.797+0000 7f971dd9b640 1 -- 172.21.15.7:0/618580752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564dbb874370 msgr2=0x564dbb86af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.797+0000 7f971dd9b640 1 --2- 172.21.15.7:0/618580752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564dbb874370 0x564dbb86af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.797+0000 7f971dd9b640 1 -- 172.21.15.7:0/618580752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dbb876760 con 0x564dbb86f2e0 2024-09-19T04:24:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.797+0000 7f971dd9b640 1 --2- 172.21.15.7:0/618580752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dbb86f2e0 0x564dbb8800a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9714000c00 tx=0x7f9714031760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783ab075c94527ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.797+0000 7f9707fff640 1 -- 172.21.15.7:0/618580752 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9714035040 con 0x564dbb86f2e0 2024-09-19T04:24:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.797+0000 7f9707fff640 1 -- 172.21.15.7:0/618580752 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9714031890 con 0x564dbb86f2e0 2024-09-19T04:24:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.797+0000 7f9707fff640 1 -- 172.21.15.7:0/618580752 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9714003e10 con 0x564dbb86f2e0 2024-09-19T04:24:46.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.798+0000 7f9727832740 1 -- 172.21.15.7:0/618580752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dbb86f2e0 msgr2=0x564dbb8800a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:46.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.798+0000 7f9727832740 1 --2- 172.21.15.7:0/618580752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dbb86f2e0 0x564dbb8800a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9714000c00 tx=0x7f9714031760 comp rx=0 tx=0).stop 2024-09-19T04:24:46.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.798+0000 7f9727832740 1 -- 172.21.15.7:0/618580752 shutdown_connections 2024-09-19T04:24:46.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.798+0000 7f9727832740 1 --2- 172.21.15.7:0/618580752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564dbb874370 0x564dbb86af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:46.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.798+0000 7f9727832740 1 --2- 172.21.15.7:0/618580752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dbb86f2e0 0x564dbb8800a0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:46.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.798+0000 7f9727832740 1 --2- 172.21.15.7:0/618580752 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564dbb86e9a0 0x564dbb86ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:46.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.798+0000 7f9727832740 1 -- 172.21.15.7:0/618580752 >> 172.21.15.7:0/618580752 conn(0x564dbb86a010 msgr2=0x564dbb878b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:46.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.798+0000 7f9727832740 1 -- 172.21.15.7:0/618580752 shutdown_connections 2024-09-19T04:24:46.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.798+0000 7f9727832740 1 -- 172.21.15.7:0/618580752 wait complete. 2024-09-19T04:24:46.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.798+0000 7f9727832740 1 -- start start 2024-09-19T04:24:46.807 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.798+0000 7f9727832740 1 Processor -- start 2024-09-19T04:24:46.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.799+0000 7f9727832740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564dbb86e9a0 0x564dbb87cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:46.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.799+0000 7f9727832740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dbb86f2e0 0x564dbb87d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:46.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.799+0000 7f9727832740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564dbb874370 0x564dbb8ed220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:46.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.799+0000 7f9727832740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f97201ae040 con 0x564dbb86f2e0 2024-09-19T04:24:46.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.799+0000 7f9727832740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f97201ad970 con 0x564dbb874370 2024-09-19T04:24:46.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.799+0000 7f9727832740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f97201aab90 con 0x564dbb86e9a0 2024-09-19T04:24:46.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.799+0000 7f9727832740 10 client.0 _ll_register_callbacks cb 0x7f97100093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:24:46.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.799+0000 7f971dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dbb86f2e0 0x564dbb87d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:46.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.799+0000 7f971dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dbb86f2e0 0x564dbb87d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49648/0 (socket says 172.21.15.7:49648) 2024-09-19T04:24:46.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.799+0000 7f971dd9b640 1 -- 172.21.15.7:0/3951652170 learned_addr learned my addr 172.21.15.7:0/3951652170 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:24:46.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.799+0000 7f971ed9d640 1 --2- 172.21.15.7:0/3951652170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564dbb874370 0x564dbb8ed220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:46.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.799+0000 7f971e59c640 1 --2- 172.21.15.7:0/3951652170 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564dbb86e9a0 0x564dbb87cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:46.808 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.799+0000 7f971dd9b640 1 -- 172.21.15.7:0/3951652170 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564dbb86e9a0 msgr2=0x564dbb87cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:46.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.799+0000 7f971dd9b640 1 --2- 172.21.15.7:0/3951652170 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564dbb86e9a0 0x564dbb87cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:46.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.799+0000 7f971dd9b640 1 -- 172.21.15.7:0/3951652170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564dbb874370 msgr2=0x564dbb8ed220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:24:46.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.799+0000 7f971dd9b640 1 --2- 172.21.15.7:0/3951652170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564dbb874370 0x564dbb8ed220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:46.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.799+0000 7f971dd9b640 1 -- 172.21.15.7:0/3951652170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dbb8ed760 con 0x564dbb86f2e0 2024-09-19T04:24:46.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.799+0000 7f971dd9b640 1 --2- 172.21.15.7:0/3951652170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dbb86f2e0 0x564dbb87d500 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f9714005ab0 tx=0x7f9714003e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1346c1fdc7b962d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:46.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.799+0000 7f9705ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:24:46.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.800+0000 7f9705ffb640 1 -- 172.21.15.7:0/3951652170 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9714035040 con 0x564dbb86f2e0 2024-09-19T04:24:46.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.800+0000 7f9705ffb640 1 -- 172.21.15.7:0/3951652170 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f9714004240 con 0x564dbb86f2e0 2024-09-19T04:24:46.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.800+0000 7f9727832740 1 -- 172.21.15.7:0/3951652170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9714031890 con 0x564dbb86f2e0 2024-09-19T04:24:46.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.800+0000 7f9705ffb640 1 -- 172.21.15.7:0/3951652170 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f9714059050 con 0x564dbb86f2e0 2024-09-19T04:24:46.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.800+0000 7f9727832740 10 client.16263 fetch_fsmap learned FSMap version 38 2024-09-19T04:24:46.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.800+0000 7f9727832740 1 -- 172.21.15.7:0/3951652170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x564dbb8ee9f0 con 0x564dbb86f2e0 2024-09-19T04:24:46.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.800+0000 7f9705ffb640 1 -- 172.21.15.7:0/3951652170 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9714031890 con 0x564dbb86f2e0 2024-09-19T04:24:46.809 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.800+0000 7f9705ffb640 1 -- 172.21.15.7:0/3951652170 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 38) ==== 8378+0+0 (secure 0 0 0) 0x7f9714004a70 con 0x564dbb86f2e0 2024-09-19T04:24:46.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.800+0000 7f9727832740 10 client.16263 fetch_fsmap finished waiting for FSMap version 38 2024-09-19T04:24:46.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.800+0000 7f9727832740 10 client.16263 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:24:46.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.800+0000 7f9727832740 20 client.16263 populate_metadata read hostname 'smithi007' 2024-09-19T04:24:46.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.800+0000 7f9727832740 1 --2- 172.21.15.7:0/3951652170 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564dbb8ef400 0x564dbb8f1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:46.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.800+0000 7f9727832740 4 client.16263 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:24:46.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.800+0000 7f9727832740 1 -- 172.21.15.7:0/3951652170 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564dbb7d9d70 con 0x564dbb8ef400 2024-09-19T04:24:46.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.800+0000 7f971e59c640 1 --2- 172.21.15.7:0/3951652170 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564dbb8ef400 0x564dbb8f1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:46.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.801+0000 7f971e59c640 1 --2- 172.21.15.7:0/3951652170 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564dbb8ef400 0x564dbb8f1820 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86034f176e70384d server_cookie=6d3a24705375d24e in_seq=0 out_seq=0 2024-09-19T04:24:46.810 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:46.801+0000 7f9705ffb640 10 client.16263 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:24:47.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:47 smithi102 ceph-mon[35446]: pgmap v590: 129 pgs: 129 active+clean; 474 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 1.2 MiB/s wr, 506 op/s 2024-09-19T04:24:47.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:47 smithi092 ceph-mon[34940]: pgmap v590: 129 pgs: 129 active+clean; 474 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 1.2 MiB/s wr, 506 op/s 2024-09-19T04:24:47.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:47 smithi007 ceph-mon[31360]: pgmap v590: 129 pgs: 129 active+clean; 474 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 909 KiB/s rd, 1.2 MiB/s wr, 506 op/s 2024-09-19T04:24:47.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:47.800+0000 7f655effd640 1 -- 172.21.15.7:0/282618622 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5638ec16af40 con 0x5638ec308960 2024-09-19T04:24:47.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:47.800+0000 7f655effd640 10 client.16245 handle_command_reply: tid=0 2024-09-19T04:24:47.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:47.800+0000 7f6588179740 1 client.16245 shutdown 2024-09-19T04:24:47.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:47.801+0000 7f6588179740 1 -- 172.21.15.7:0/282618622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638ec283170 msgr2=0x5638ec287890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:47.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:47.801+0000 7f6588179740 1 --2- 172.21.15.7:0/282618622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638ec283170 0x5638ec287890 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f656800bd50 tx=0x7f656800bd80 comp rx=0 tx=0).stop 2024-09-19T04:24:47.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:47.801+0000 7f6588179740 1 -- 172.21.15.7:0/282618622 shutdown_connections 2024-09-19T04:24:47.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:47.801+0000 7f6588179740 1 --2- 172.21.15.7:0/282618622 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5638ec308960 0x5638ec30ad80 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:47.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:47.801+0000 7f6588179740 1 --2- 172.21.15.7:0/282618622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5638ec28da30 0x5638ec288020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:47.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:47.801+0000 7f6588179740 1 --2- 172.21.15.7:0/282618622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5638ec283170 0x5638ec287890 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:47.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:47.801+0000 7f6588179740 1 --2- 172.21.15.7:0/282618622 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5638ec282850 0x5638ec296290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:47.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:47.801+0000 7f6588179740 1 -- 172.21.15.7:0/282618622 >> 172.21.15.7:0/282618622 conn(0x5638ec27ede0 msgr2=0x5638ec27d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:47.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:47.801+0000 7f655effd640 0 client.16245 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:24:47.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:47.801+0000 7f6588179740 1 -- 172.21.15.7:0/282618622 shutdown_connections 2024-09-19T04:24:47.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:47.801+0000 7f6588179740 1 -- 172.21.15.7:0/282618622 wait complete. 2024-09-19T04:24:47.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:47.801+0000 7f6588179740 20 client.16245 trim_cache size 0 max 16384 2024-09-19T04:24:47.804 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:24:47.804 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 39, 2024-09-19T04:24:47.804 INFO:teuthology.orchestra.run.smithi007.stdout: "leader": 24506, 2024-09-19T04:24:47.804 INFO:teuthology.orchestra.run.smithi007.stdout: "set_version": 30, 2024-09-19T04:24:47.804 INFO:teuthology.orchestra.run.smithi007.stdout: "sets": { 2024-09-19T04:24:47.804 INFO:teuthology.orchestra.run.smithi007.stdout: "53799d07": { 2024-09-19T04:24:47.804 INFO:teuthology.orchestra.run.smithi007.stdout: "version": 30, 2024-09-19T04:24:47.804 INFO:teuthology.orchestra.run.smithi007.stdout: "age_ref": 0.0, 2024-09-19T04:24:47.805 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:24:47.805 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "QUIESCED", 2024-09-19T04:24:47.805 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:24:47.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:24:47.805 INFO:teuthology.orchestra.run.smithi007.stdout: "timeout": 90.0, 2024-09-19T04:24:47.805 INFO:teuthology.orchestra.run.smithi007.stdout: "expiration": 145.8, 2024-09-19T04:24:47.805 INFO:teuthology.orchestra.run.smithi007.stdout: "members": { 2024-09-19T04:24:47.805 INFO:teuthology.orchestra.run.smithi007.stdout: "file:/": { 2024-09-19T04:24:47.805 INFO:teuthology.orchestra.run.smithi007.stdout: "excluded": false, 2024-09-19T04:24:47.805 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:24:47.805 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "QUIESCED", 2024-09-19T04:24:47.805 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:24:47.805 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:24:47.805 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:24:47.806 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:24:47.806 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:24:47.806 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:24:47.806 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:24:47.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:47.803+0000 7f6585da0640 1 -- 172.21.15.7:0/851810635 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f656c0a3240 msgr2=0x7f656c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:47.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:47.803+0000 7f6585da0640 1 --2- 172.21.15.7:0/851810635 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f656c0a3240 0x7f656c0a5700 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6578009ca0 tx=0x7f657802ecf0 comp rx=0 tx=0).stop 2024-09-19T04:24:47.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:47.803+0000 7f6585da0640 1 -- 172.21.15.7:0/851810635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6580102d30 msgr2=0x7f6580073d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:47.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:47.803+0000 7f6585da0640 1 --2- 172.21.15.7:0/851810635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6580102d30 0x7f6580073d10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f657000e9f0 tx=0x7f657000eeb0 comp rx=0 tx=0).stop 2024-09-19T04:24:47.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:47.803+0000 7f6585da0640 1 -- 172.21.15.7:0/851810635 shutdown_connections 2024-09-19T04:24:47.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:47.803+0000 7f6585da0640 1 --2- 172.21.15.7:0/851810635 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f656c0a3240 0x7f656c0a5700 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:47.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:47.803+0000 7f6585da0640 1 --2- 172.21.15.7:0/851810635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65801082a0 0x7f658006c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:47.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:47.803+0000 7f6585da0640 1 --2- 172.21.15.7:0/851810635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65801036e0 0x7f658006bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:47.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:47.803+0000 7f6585da0640 1 --2- 172.21.15.7:0/851810635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6580102d30 0x7f6580073d10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:47.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:47.803+0000 7f6585da0640 1 -- 172.21.15.7:0/851810635 >> 172.21.15.7:0/851810635 conn(0x7f65800fc7d0 msgr2=0x7f6580105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:47.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:47.803+0000 7f6585da0640 1 -- 172.21.15.7:0/851810635 shutdown_connections 2024-09-19T04:24:47.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:24:47.803+0000 7f6585da0640 1 -- 172.21.15.7:0/851810635 wait complete. 2024-09-19T04:24:47.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:47.920+0000 7f9705ffb640 1 -- 172.21.15.7:0/3951652170 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564dbb7d9d70 con 0x564dbb8ef400 2024-09-19T04:24:47.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:47.920+0000 7f9705ffb640 10 client.16263 handle_command_reply: tid=0 2024-09-19T04:24:47.923 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:47.920+0000 7f9727832740 1 client.16263 shutdown 2024-09-19T04:24:47.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:47.921+0000 7f9727832740 1 -- 172.21.15.7:0/3951652170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dbb86f2e0 msgr2=0x564dbb87d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:47.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:47.921+0000 7f9727832740 1 --2- 172.21.15.7:0/3951652170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dbb86f2e0 0x564dbb87d500 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f9714005ab0 tx=0x7f9714003e40 comp rx=0 tx=0).stop 2024-09-19T04:24:47.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:47.921+0000 7f9727832740 1 -- 172.21.15.7:0/3951652170 shutdown_connections 2024-09-19T04:24:47.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:47.921+0000 7f9727832740 1 --2- 172.21.15.7:0/3951652170 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x564dbb8ef400 0x564dbb8f1820 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:47.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:47.921+0000 7f9705ffb640 0 client.16263 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:24:47.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:47.921+0000 7f9727832740 1 --2- 172.21.15.7:0/3951652170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564dbb874370 0x564dbb8ed220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:47.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:47.921+0000 7f9727832740 1 --2- 172.21.15.7:0/3951652170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564dbb86f2e0 0x564dbb87d500 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:47.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:47.921+0000 7f9727832740 1 --2- 172.21.15.7:0/3951652170 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564dbb86e9a0 0x564dbb87cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:47.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:47.921+0000 7f9727832740 1 -- 172.21.15.7:0/3951652170 >> 172.21.15.7:0/3951652170 conn(0x564dbb86a010 msgr2=0x564dbb8689a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:47.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:47.921+0000 7f9727832740 1 -- 172.21.15.7:0/3951652170 shutdown_connections 2024-09-19T04:24:47.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:47.922+0000 7f9727832740 1 -- 172.21.15.7:0/3951652170 wait complete. 2024-09-19T04:24:47.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:47.922+0000 7f9727832740 20 client.16263 trim_cache size 0 max 16384 2024-09-19T04:24:47.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:24:47.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:24:47.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:24:47.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:24:47.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:47.923+0000 7f97249bd640 1 -- 172.21.15.7:0/291574491 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f97080a3240 msgr2=0x7f97080a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:47.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:47.923+0000 7f97249bd640 1 --2- 172.21.15.7:0/291574491 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f97080a3240 0x7f97080a5700 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9718009fd0 tx=0x7f9718021000 comp rx=0 tx=0).stop 2024-09-19T04:24:47.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:47.923+0000 7f97249bd640 1 -- 172.21.15.7:0/291574491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97201025f0 msgr2=0x7f972019a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:47.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:47.923+0000 7f97249bd640 1 --2- 172.21.15.7:0/291574491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97201025f0 0x7f972019a140 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f971000eb90 tx=0x7f971000c6a0 comp rx=0 tx=0).stop 2024-09-19T04:24:47.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:47.923+0000 7f97249bd640 1 -- 172.21.15.7:0/291574491 shutdown_connections 2024-09-19T04:24:47.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:47.923+0000 7f97249bd640 1 --2- 172.21.15.7:0/291574491 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f97080a3240 0x7f97080a5700 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:47.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:47.923+0000 7f97249bd640 1 --2- 172.21.15.7:0/291574491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9720107850 0x7f97201a16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:47.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:47.923+0000 7f97249bd640 1 --2- 172.21.15.7:0/291574491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9720104f20 0x7f972019a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:47.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:47.923+0000 7f97249bd640 1 --2- 172.21.15.7:0/291574491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f97201025f0 0x7f972019a140 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:47.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:47.923+0000 7f97249bd640 1 -- 172.21.15.7:0/291574491 >> 172.21.15.7:0/291574491 conn(0x7f97200fc1f0 msgr2=0x7f9720101d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:47.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:47.923+0000 7f97249bd640 1 -- 172.21.15.7:0/291574491 shutdown_connections 2024-09-19T04:24:47.927 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:24:47.923+0000 7f97249bd640 1 -- 172.21.15.7:0/291574491 wait complete. 2024-09-19T04:24:48.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:48 smithi102 ceph-mon[35446]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:24:48.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:48 smithi092 ceph-mon[34940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:24:48.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:48 smithi007 ceph-mon[31360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:24:48.946 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '53799d07', quiesce took 8.6 seconds. Will release after: 17.15 2024-09-19T04:24:49.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:49 smithi007 ceph-mon[31360]: pgmap v591: 129 pgs: 129 active+clean; 473 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 616 KiB/s wr, 262 op/s 2024-09-19T04:24:49.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:49 smithi102 ceph-mon[35446]: pgmap v591: 129 pgs: 129 active+clean; 473 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 616 KiB/s wr, 262 op/s 2024-09-19T04:24:49.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:49 smithi092 ceph-mon[34940]: pgmap v591: 129 pgs: 129 active+clean; 473 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 588 KiB/s rd, 616 KiB/s wr, 262 op/s 2024-09-19T04:24:51.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:51 smithi102 ceph-mon[35446]: pgmap v592: 129 pgs: 129 active+clean; 464 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 833 KiB/s wr, 371 op/s 2024-09-19T04:24:51.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:51 smithi092 ceph-mon[34940]: pgmap v592: 129 pgs: 129 active+clean; 464 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 833 KiB/s wr, 371 op/s 2024-09-19T04:24:51.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:51 smithi007 ceph-mon[31360]: pgmap v592: 129 pgs: 129 active+clean; 464 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 833 KiB/s wr, 371 op/s 2024-09-19T04:24:53.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:53 smithi102 ceph-mon[35446]: pgmap v593: 129 pgs: 129 active+clean; 459 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 664 KiB/s wr, 307 op/s 2024-09-19T04:24:53.549 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:53 smithi092 ceph-mon[34940]: pgmap v593: 129 pgs: 129 active+clean; 459 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 664 KiB/s wr, 307 op/s 2024-09-19T04:24:53.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:53 smithi007 ceph-mon[31360]: pgmap v593: 129 pgs: 129 active+clean; 459 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 664 KiB/s wr, 307 op/s 2024-09-19T04:24:55.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:55 smithi102 ceph-mon[35446]: pgmap v594: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 690 KiB/s wr, 330 op/s 2024-09-19T04:24:55.429 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:55 smithi007 ceph-mon[31360]: pgmap v594: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 690 KiB/s wr, 330 op/s 2024-09-19T04:24:55.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:55 smithi092 ceph-mon[34940]: pgmap v594: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 690 KiB/s wr, 330 op/s 2024-09-19T04:24:57.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:57 smithi102 ceph-mon[35446]: pgmap v595: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 281 KiB/s wr, 255 op/s 2024-09-19T04:24:57.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:57 smithi092 ceph-mon[34940]: pgmap v595: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 281 KiB/s wr, 255 op/s 2024-09-19T04:24:57.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:57 smithi007 ceph-mon[31360]: pgmap v595: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 281 KiB/s wr, 255 op/s 2024-09-19T04:24:58.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:58 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:24:58.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:58 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:58.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:58 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:24:58.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:58 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:24:58.629 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:58 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:24:58.629 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:58 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:58.629 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:58 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:24:58.629 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:58 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:24:58.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:58 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:24:58.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:58 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:58.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:58 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:24:58.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:58 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:24:59.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:24:59 smithi092 ceph-mon[34940]: pgmap v596: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 257 KiB/s wr, 174 op/s 2024-09-19T04:24:59.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:24:59 smithi007 ceph-mon[31360]: pgmap v596: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 257 KiB/s wr, 174 op/s 2024-09-19T04:24:59.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:24:59 smithi102 ceph-mon[35446]: pgmap v596: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 257 KiB/s wr, 174 op/s 2024-09-19T04:25:01.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.029+0000 7fec079c4640 1 -- 172.21.15.7:0/2657705873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec00101c30 msgr2=0x7fec001020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:01.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.029+0000 7fec079c4640 1 --2- 172.21.15.7:0/2657705873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec00101c30 0x7fec001020b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7febf0009900 tx=0x7febf002a410 comp rx=0 tx=0).stop 2024-09-19T04:25:01.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.029+0000 7fec079c4640 1 -- 172.21.15.7:0/2657705873 shutdown_connections 2024-09-19T04:25:01.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.029+0000 7fec079c4640 1 --2- 172.21.15.7:0/2657705873 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec001025f0 0x7fec00108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.029+0000 7fec079c4640 1 --2- 172.21.15.7:0/2657705873 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec00101c30 0x7fec001020b0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.029+0000 7fec079c4640 1 --2- 172.21.15.7:0/2657705873 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec00100a40 0x7fec00100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.029+0000 7fec079c4640 1 -- 172.21.15.7:0/2657705873 >> 172.21.15.7:0/2657705873 conn(0x7fec000fc1c0 msgr2=0x7fec000fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:01.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.029+0000 7fec079c4640 1 -- 172.21.15.7:0/2657705873 shutdown_connections 2024-09-19T04:25:01.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.029+0000 7fec079c4640 1 -- 172.21.15.7:0/2657705873 wait complete. 2024-09-19T04:25:01.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.030+0000 7fec079c4640 1 Processor -- start 2024-09-19T04:25:01.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.030+0000 7fec079c4640 1 -- start start 2024-09-19T04:25:01.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.030+0000 7fec079c4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec00100a40 0x7fec00197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:01.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.030+0000 7fec079c4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec00101c30 0x7fec00198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:01.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.030+0000 7fec079c4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec001025f0 0x7fec0019f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:01.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.030+0000 7fec079c4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fec0010c6c0 con 0x7fec00100a40 2024-09-19T04:25:01.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.030+0000 7fec079c4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fec0010c540 con 0x7fec00101c30 2024-09-19T04:25:01.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.030+0000 7fec079c4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fec0010c840 con 0x7fec001025f0 2024-09-19T04:25:01.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.030+0000 7fec05760640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec00100a40 0x7fec00197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:01.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.030+0000 7fec05760640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec00100a40 0x7fec00197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34318/0 (socket says 172.21.15.7:34318) 2024-09-19T04:25:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.030+0000 7fec05760640 1 -- 172.21.15.7:0/759277495 learned_addr learned my addr 172.21.15.7:0/759277495 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.030+0000 7fec04f5f640 1 --2- 172.21.15.7:0/759277495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec00101c30 0x7fec00198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.031+0000 7fec05f61640 1 --2- 172.21.15.7:0/759277495 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec001025f0 0x7fec0019f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.031+0000 7fec05760640 1 -- 172.21.15.7:0/759277495 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec001025f0 msgr2=0x7fec0019f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.031+0000 7fec05760640 1 --2- 172.21.15.7:0/759277495 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec001025f0 0x7fec0019f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.031+0000 7fec05760640 1 -- 172.21.15.7:0/759277495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec00101c30 msgr2=0x7fec00198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.031+0000 7fec05760640 1 --2- 172.21.15.7:0/759277495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec00101c30 0x7fec00198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.031+0000 7fec05760640 1 -- 172.21.15.7:0/759277495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0019fa30 con 0x7fec00100a40 2024-09-19T04:25:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.031+0000 7fec05f61640 1 --2- 172.21.15.7:0/759277495 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec001025f0 0x7fec0019f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:25:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.031+0000 7fec05760640 1 --2- 172.21.15.7:0/759277495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec00100a40 0x7fec00197e10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7febfc00c970 tx=0x7febfc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.031+0000 7febf67fc640 1 -- 172.21.15.7:0/759277495 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc004220 con 0x7fec00100a40 2024-09-19T04:25:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.031+0000 7febf67fc640 1 -- 172.21.15.7:0/759277495 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febfc0043c0 con 0x7fec00100a40 2024-09-19T04:25:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.031+0000 7fec079c4640 1 -- 172.21.15.7:0/759277495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec0019fd20 con 0x7fec00100a40 2024-09-19T04:25:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.031+0000 7febf67fc640 1 -- 172.21.15.7:0/759277495 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc004a00 con 0x7fec00100a40 2024-09-19T04:25:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.031+0000 7fec079c4640 1 -- 172.21.15.7:0/759277495 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec001a0190 con 0x7fec00100a40 2024-09-19T04:25:01.040 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.034+0000 7febf67fc640 1 -- 172.21.15.7:0/759277495 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7febfc0079b0 con 0x7fec00100a40 2024-09-19T04:25:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.034+0000 7fec0a838740 1 Processor -- start 2024-09-19T04:25:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.034+0000 7fec0a838740 1 -- start start 2024-09-19T04:25:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.034+0000 7fec0a838740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632df5429a0 0x5632df542da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.034+0000 7fec0a838740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632df5432e0 0x5632df547da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.034+0000 7fec0a838740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632df548370 0x5632df54a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.034+0000 7fec0a838740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5632df4a62f0 con 0x5632df548370 2024-09-19T04:25:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.034+0000 7fec0a838740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5632df44e270 con 0x5632df5432e0 2024-09-19T04:25:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.034+0000 7fec0a838740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5632df4a22b0 con 0x5632df5429a0 2024-09-19T04:25:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.035+0000 7febf67fc640 1 --2- 172.21.15.7:0/759277495 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7febec0a3240 0x7febec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.035+0000 7fec05760640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632df5432e0 0x5632df547da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.035+0000 7fec04f5f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632df548370 0x5632df54a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:01.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.035+0000 7fec05760640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632df5432e0 0x5632df547da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:57674/0 (socket says 172.21.15.7:57674) 2024-09-19T04:25:01.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.035+0000 7fec05f61640 1 --2- 172.21.15.7:0/672243368 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632df5429a0 0x5632df542da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:01.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.035+0000 7fec05760640 1 -- 172.21.15.7:0/672243368 learned_addr learned my addr 172.21.15.7:0/672243368 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:01.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.035+0000 7fec05f61640 1 --2- 172.21.15.7:0/759277495 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7febec0a3240 0x7febec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:01.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.035+0000 7febf67fc640 1 -- 172.21.15.7:0/759277495 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7febfc0cfa80 con 0x7fec00100a40 2024-09-19T04:25:01.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.035+0000 7fec04f5f640 1 -- 172.21.15.7:0/672243368 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632df5429a0 msgr2=0x5632df542da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:01.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.035+0000 7fec04f5f640 1 --2- 172.21.15.7:0/672243368 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632df5429a0 0x5632df542da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.035+0000 7fec04f5f640 1 -- 172.21.15.7:0/672243368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632df5432e0 msgr2=0x5632df547da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:01.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.035+0000 7fec04f5f640 1 --2- 172.21.15.7:0/672243368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632df5432e0 0x5632df547da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.042 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.035+0000 7fec04f5f640 1 -- 172.21.15.7:0/672243368 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632df44d340 con 0x5632df548370 2024-09-19T04:25:01.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.035+0000 7fec05760640 1 --2- 172.21.15.7:0/672243368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632df5432e0 0x5632df547da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:25:01.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.035+0000 7fec05f61640 1 --2- 172.21.15.7:0/759277495 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7febec0a3240 0x7febec0a5700 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7febf8005fd0 tx=0x7febf8005f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:01.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.035+0000 7fec04f5f640 1 --2- 172.21.15.7:0/672243368 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632df548370 0x5632df54a830 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7febf0031440 tx=0x7febf0005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a0701ad1be3a799 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:01.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.036+0000 7febeb7fe640 1 -- 172.21.15.7:0/672243368 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf0040070 con 0x5632df548370 2024-09-19T04:25:01.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.036+0000 7febeb7fe640 1 -- 172.21.15.7:0/672243368 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febf0005500 con 0x5632df548370 2024-09-19T04:25:01.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.036+0000 7febeb7fe640 1 -- 172.21.15.7:0/672243368 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf0035040 con 0x5632df548370 2024-09-19T04:25:01.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.036+0000 7fec0a838740 1 -- 172.21.15.7:0/672243368 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632df548370 msgr2=0x5632df54a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:01.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.036+0000 7fec0a838740 1 --2- 172.21.15.7:0/672243368 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632df548370 0x5632df54a830 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7febf0031440 tx=0x7febf0005c00 comp rx=0 tx=0).stop 2024-09-19T04:25:01.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.036+0000 7fec0a838740 1 -- 172.21.15.7:0/672243368 shutdown_connections 2024-09-19T04:25:01.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.036+0000 7fec0a838740 1 --2- 172.21.15.7:0/672243368 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632df548370 0x5632df54a830 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.036+0000 7fec0a838740 1 --2- 172.21.15.7:0/672243368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632df5432e0 0x5632df547da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.036+0000 7fec0a838740 1 --2- 172.21.15.7:0/672243368 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632df5429a0 0x5632df542da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.043 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.036+0000 7fec0a838740 1 -- 172.21.15.7:0/672243368 >> 172.21.15.7:0/672243368 conn(0x5632df53e010 msgr2=0x5632df53e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:01.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.036+0000 7fec0a838740 1 -- 172.21.15.7:0/672243368 shutdown_connections 2024-09-19T04:25:01.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.036+0000 7fec0a838740 1 -- 172.21.15.7:0/672243368 wait complete. 2024-09-19T04:25:01.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.037+0000 7fec0a838740 1 -- start start 2024-09-19T04:25:01.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.037+0000 7fec0a838740 1 Processor -- start 2024-09-19T04:25:01.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.037+0000 7fec0a838740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632df5429a0 0x5632df54cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:01.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.037+0000 7fec0a838740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632df5432e0 0x5632df54d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:01.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.037+0000 7fec0a838740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632df548370 0x5632df554050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:01.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.037+0000 7fec0a838740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5632df54b2e0 con 0x5632df5429a0 2024-09-19T04:25:01.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.037+0000 7fec0a838740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5632df42f290 con 0x5632df5432e0 2024-09-19T04:25:01.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.037+0000 7fec0a838740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5632df54b460 con 0x5632df548370 2024-09-19T04:25:01.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.038+0000 7fec0a838740 10 client.0 _ll_register_callbacks cb 0x5632df460140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:25:01.044 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.038+0000 7fec05760640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632df5429a0 0x5632df54cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:01.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.038+0000 7fec05760640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632df5429a0 0x5632df54cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34336/0 (socket says 172.21.15.7:34336) 2024-09-19T04:25:01.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.038+0000 7fec05760640 1 -- 172.21.15.7:0/1917891187 learned_addr learned my addr 172.21.15.7:0/1917891187 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:01.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.038+0000 7fec04f5f640 1 --2- 172.21.15.7:0/1917891187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632df5432e0 0x5632df54d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:01.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.038+0000 7fec05f61640 1 --2- 172.21.15.7:0/1917891187 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632df548370 0x5632df554050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:01.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.038+0000 7fec05760640 1 -- 172.21.15.7:0/1917891187 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632df548370 msgr2=0x5632df554050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:01.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.038+0000 7fec05760640 1 --2- 172.21.15.7:0/1917891187 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632df548370 0x5632df554050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.038+0000 7fec05760640 1 -- 172.21.15.7:0/1917891187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632df5432e0 msgr2=0x5632df54d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:01.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.038+0000 7fec05760640 1 --2- 172.21.15.7:0/1917891187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632df5432e0 0x5632df54d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.038+0000 7fec05760640 1 -- 172.21.15.7:0/1917891187 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632df1b9210 con 0x5632df5429a0 2024-09-19T04:25:01.045 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.038+0000 7fec05760640 1 --2- 172.21.15.7:0/1917891187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632df5429a0 0x5632df54cad0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7febfc0986a0 tx=0x7febfc004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316bb18264f7cd37 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.038+0000 7febe8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:25:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.038+0000 7febe8ff9640 1 -- 172.21.15.7:0/1917891187 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc01d070 con 0x5632df5429a0 2024-09-19T04:25:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.038+0000 7febe8ff9640 1 -- 172.21.15.7:0/1917891187 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7febfc0a4b90 con 0x5632df5429a0 2024-09-19T04:25:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.038+0000 7fec0a838740 1 -- 172.21.15.7:0/1917891187 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febf0005500 con 0x5632df5429a0 2024-09-19T04:25:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.038+0000 7febe8ff9640 1 -- 172.21.15.7:0/1917891187 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7febfc0b9050 con 0x5632df5429a0 2024-09-19T04:25:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.038+0000 7fec0a838740 10 client.16275 fetch_fsmap learned FSMap version 39 2024-09-19T04:25:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.038+0000 7fec0a838740 1 -- 172.21.15.7:0/1917891187 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5632df285620 con 0x5632df5429a0 2024-09-19T04:25:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.039+0000 7febe8ff9640 1 -- 172.21.15.7:0/1917891187 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febf0005500 con 0x5632df5429a0 2024-09-19T04:25:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.039+0000 7febe8ff9640 1 -- 172.21.15.7:0/1917891187 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 39) ==== 8382+0+0 (secure 0 0 0) 0x7febfc09b120 con 0x5632df5429a0 2024-09-19T04:25:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.039+0000 7fec0a838740 10 client.16275 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T04:25:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.039+0000 7fec0a838740 10 client.16275 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:25:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.039+0000 7fec0a838740 20 client.16275 populate_metadata read hostname 'smithi007' 2024-09-19T04:25:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.039+0000 7fec0a838740 1 --2- 172.21.15.7:0/1917891187 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5632df558790 0x5632df55ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:01.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.039+0000 7fec0a838740 4 client.16275 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:25:01.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.039+0000 7fec0a838740 1 -- 172.21.15.7:0/1917891187 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632df4b3a20 con 0x5632df558790 2024-09-19T04:25:01.047 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.039+0000 7fec04f5f640 1 --2- 172.21.15.7:0/1917891187 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5632df558790 0x5632df55ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:01.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.040+0000 7febe8ff9640 10 client.16275 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:25:01.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.040+0000 7fec04f5f640 1 --2- 172.21.15.7:0/1917891187 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5632df558790 0x5632df55ab80 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cbc1eaa1214891a server_cookie=623370c4b594d346 in_seq=0 out_seq=0 2024-09-19T04:25:01.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.040+0000 7febe8ff9640 1 -- 172.21.15.7:0/1917891187 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5632df4b3a20 con 0x5632df558790 2024-09-19T04:25:01.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.040+0000 7febe8ff9640 10 client.16275 handle_command_reply: tid=0 2024-09-19T04:25:01.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.040+0000 7fec0a838740 1 client.16275 shutdown 2024-09-19T04:25:01.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.040+0000 7fec0a838740 1 -- 172.21.15.7:0/1917891187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632df5429a0 msgr2=0x5632df54cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:01.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.040+0000 7fec0a838740 1 --2- 172.21.15.7:0/1917891187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632df5429a0 0x5632df54cad0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7febfc0986a0 tx=0x7febfc004570 comp rx=0 tx=0).stop 2024-09-19T04:25:01.048 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.041+0000 7fec0a838740 1 -- 172.21.15.7:0/1917891187 shutdown_connections 2024-09-19T04:25:01.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.041+0000 7fec0a838740 1 --2- 172.21.15.7:0/1917891187 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5632df558790 0x5632df55ab80 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.041+0000 7fec0a838740 1 --2- 172.21.15.7:0/1917891187 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632df548370 0x5632df554050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.041+0000 7fec0a838740 1 --2- 172.21.15.7:0/1917891187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632df5432e0 0x5632df54d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.041+0000 7fec0a838740 1 --2- 172.21.15.7:0/1917891187 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632df5429a0 0x5632df54cad0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.041+0000 7febe8ff9640 0 client.16275 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:25:01.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.041+0000 7fec0a838740 1 -- 172.21.15.7:0/1917891187 >> 172.21.15.7:0/1917891187 conn(0x5632df53e010 msgr2=0x5632df53f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:01.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.041+0000 7fec0a838740 1 -- 172.21.15.7:0/1917891187 shutdown_connections 2024-09-19T04:25:01.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.041+0000 7fec0a838740 1 -- 172.21.15.7:0/1917891187 wait complete. 2024-09-19T04:25:01.049 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.041+0000 7fec0a838740 20 client.16275 trim_cache size 0 max 16384 2024-09-19T04:25:01.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.055+0000 7fec0a838740 1 Processor -- start 2024-09-19T04:25:01.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.055+0000 7fec0a838740 1 -- start start 2024-09-19T04:25:01.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.056+0000 7fec0a838740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632df5429a0 0x5632df53d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:01.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.056+0000 7fec0a838740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632df5432e0 0x5632df55f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:01.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.056+0000 7fec0a838740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632df548370 0x5632df55f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:01.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.056+0000 7fec0a838740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fec001aa7b0 con 0x5632df5432e0 2024-09-19T04:25:01.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.056+0000 7fec0a838740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fec001ac350 con 0x5632df548370 2024-09-19T04:25:01.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.056+0000 7fec0a838740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fec001aae80 con 0x5632df5429a0 2024-09-19T04:25:01.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.056+0000 7fec04f5f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632df5432e0 0x5632df55f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:01.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.056+0000 7fec04f5f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632df5432e0 0x5632df55f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34338/0 (socket says 172.21.15.7:34338) 2024-09-19T04:25:01.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.056+0000 7fec04f5f640 1 -- 172.21.15.7:0/1668463973 learned_addr learned my addr 172.21.15.7:0/1668463973 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:01.059 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.056+0000 7fec05f61640 1 --2- 172.21.15.7:0/1668463973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632df548370 0x5632df55f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:01.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.056+0000 7fec05760640 1 --2- 172.21.15.7:0/1668463973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632df5429a0 0x5632df53d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:01.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.056+0000 7fec04f5f640 1 -- 172.21.15.7:0/1668463973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632df5429a0 msgr2=0x5632df53d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:01.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.056+0000 7fec04f5f640 1 --2- 172.21.15.7:0/1668463973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632df5429a0 0x5632df53d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.056+0000 7fec04f5f640 1 -- 172.21.15.7:0/1668463973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632df548370 msgr2=0x5632df55f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:01.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.056+0000 7fec04f5f640 1 --2- 172.21.15.7:0/1668463973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632df548370 0x5632df55f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.056+0000 7fec04f5f640 1 -- 172.21.15.7:0/1668463973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632df5437c0 con 0x5632df5432e0 2024-09-19T04:25:01.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.056+0000 7fec04f5f640 1 --2- 172.21.15.7:0/1668463973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632df5432e0 0x5632df55f480 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x5632df53ee90 tx=0x7febf002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc7680b59e2aa22 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:01.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.056+0000 7febeaffd640 1 -- 172.21.15.7:0/1668463973 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf0040040 con 0x5632df5432e0 2024-09-19T04:25:01.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.056+0000 7febeaffd640 1 -- 172.21.15.7:0/1668463973 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febf00052e0 con 0x5632df5432e0 2024-09-19T04:25:01.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.056+0000 7febeaffd640 1 -- 172.21.15.7:0/1668463973 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf0035040 con 0x5632df5432e0 2024-09-19T04:25:01.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.057+0000 7fec0a838740 1 -- 172.21.15.7:0/1668463973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632df5432e0 msgr2=0x5632df55f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:01.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.057+0000 7fec0a838740 1 --2- 172.21.15.7:0/1668463973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632df5432e0 0x5632df55f480 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x5632df53ee90 tx=0x7febf002a410 comp rx=0 tx=0).stop 2024-09-19T04:25:01.060 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.057+0000 7fec0a838740 1 -- 172.21.15.7:0/1668463973 shutdown_connections 2024-09-19T04:25:01.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.057+0000 7fec0a838740 1 --2- 172.21.15.7:0/1668463973 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632df548370 0x5632df55f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.057+0000 7fec0a838740 1 --2- 172.21.15.7:0/1668463973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632df5432e0 0x5632df55f480 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.057+0000 7fec0a838740 1 --2- 172.21.15.7:0/1668463973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632df5429a0 0x5632df53d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.057+0000 7fec0a838740 1 -- 172.21.15.7:0/1668463973 >> 172.21.15.7:0/1668463973 conn(0x5632df53e010 msgr2=0x5632df53c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:01.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.057+0000 7fec0a838740 1 -- 172.21.15.7:0/1668463973 shutdown_connections 2024-09-19T04:25:01.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.057+0000 7fec0a838740 1 -- 172.21.15.7:0/1668463973 wait complete. 2024-09-19T04:25:01.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.057+0000 7fec0a838740 1 -- start start 2024-09-19T04:25:01.061 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.057+0000 7fec0a838740 1 Processor -- start 2024-09-19T04:25:01.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.058+0000 7fec0a838740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632df5429a0 0x5632df5be9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:01.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.058+0000 7fec0a838740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632df5432e0 0x5632df5bef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:01.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.058+0000 7fec0a838740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632df548370 0x5632df5c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:01.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.058+0000 7fec0a838740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fec001abc50 con 0x5632df5432e0 2024-09-19T04:25:01.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.058+0000 7fec0a838740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fec001ab580 con 0x5632df5429a0 2024-09-19T04:25:01.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.058+0000 7fec0a838740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fec001a8770 con 0x5632df548370 2024-09-19T04:25:01.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.058+0000 7fec0a838740 10 client.0 _ll_register_callbacks cb 0x7febfc00a4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:25:01.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.058+0000 7fec04f5f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632df5432e0 0x5632df5bef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:01.064 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.058+0000 7fec04f5f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632df5432e0 0x5632df5bef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34342/0 (socket says 172.21.15.7:34342) 2024-09-19T04:25:01.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.058+0000 7fec04f5f640 1 -- 172.21.15.7:0/716007564 learned_addr learned my addr 172.21.15.7:0/716007564 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:01.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.058+0000 7fec05760640 1 --2- 172.21.15.7:0/716007564 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632df5429a0 0x5632df5be9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:01.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.058+0000 7fec05f61640 1 --2- 172.21.15.7:0/716007564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632df548370 0x5632df5c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:01.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.058+0000 7fec04f5f640 1 -- 172.21.15.7:0/716007564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632df548370 msgr2=0x5632df5c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:01.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.058+0000 7fec04f5f640 1 --2- 172.21.15.7:0/716007564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632df548370 0x5632df5c5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.058+0000 7fec04f5f640 1 -- 172.21.15.7:0/716007564 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632df5429a0 msgr2=0x5632df5be9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:01.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.058+0000 7fec04f5f640 1 --2- 172.21.15.7:0/716007564 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632df5429a0 0x5632df5be9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.058+0000 7fec04f5f640 1 -- 172.21.15.7:0/716007564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632df5c6580 con 0x5632df5432e0 2024-09-19T04:25:01.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.058+0000 7fec05f61640 1 --2- 172.21.15.7:0/716007564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632df548370 0x5632df5c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:25:01.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.059+0000 7fec04f5f640 1 --2- 172.21.15.7:0/716007564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632df5432e0 0x5632df5bef30 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7febf00314e0 tx=0x7febf0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb251c841654d8f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:01.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.059+0000 7febe8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:25:01.065 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.059+0000 7febe8ff9640 1 -- 172.21.15.7:0/716007564 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf0035050 con 0x5632df5432e0 2024-09-19T04:25:01.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.059+0000 7febe8ff9640 1 -- 172.21.15.7:0/716007564 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7febf0004230 con 0x5632df5432e0 2024-09-19T04:25:01.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.059+0000 7fec0a838740 1 -- 172.21.15.7:0/716007564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febf00052e0 con 0x5632df5432e0 2024-09-19T04:25:01.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.059+0000 7febe8ff9640 1 -- 172.21.15.7:0/716007564 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7febf0040040 con 0x5632df5432e0 2024-09-19T04:25:01.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.059+0000 7fec0a838740 10 client.16281 fetch_fsmap learned FSMap version 39 2024-09-19T04:25:01.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.059+0000 7fec0a838740 1 -- 172.21.15.7:0/716007564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5632df5c7890 con 0x5632df5432e0 2024-09-19T04:25:01.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.059+0000 7febe8ff9640 1 -- 172.21.15.7:0/716007564 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febf00052e0 con 0x5632df5432e0 2024-09-19T04:25:01.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.059+0000 7febe8ff9640 1 -- 172.21.15.7:0/716007564 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 39) ==== 8382+0+0 (secure 0 0 0) 0x7febf003cc80 con 0x5632df5432e0 2024-09-19T04:25:01.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.059+0000 7fec0a838740 10 client.16281 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T04:25:01.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.059+0000 7fec0a838740 10 client.16281 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:25:01.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.059+0000 7fec0a838740 20 client.16281 populate_metadata read hostname 'smithi007' 2024-09-19T04:25:01.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.059+0000 7fec0a838740 1 --2- 172.21.15.7:0/716007564 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5632df5c7da0 0x5632df5ca190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:01.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.059+0000 7fec0a838740 4 client.16281 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:25:01.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.059+0000 7fec0a838740 1 -- 172.21.15.7:0/716007564 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5632df4add70 con 0x5632df5c7da0 2024-09-19T04:25:01.066 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.060+0000 7fec05760640 1 --2- 172.21.15.7:0/716007564 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5632df5c7da0 0x5632df5ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:01.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.060+0000 7fec05760640 1 --2- 172.21.15.7:0/716007564 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5632df5c7da0 0x5632df5ca190 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59e6024bafaaf0c8 server_cookie=95d4cb66b39ae602 in_seq=0 out_seq=0 2024-09-19T04:25:01.067 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.060+0000 7febe8ff9640 10 client.16281 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:25:01.085 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.083+0000 7febe8ff9640 1 -- 172.21.15.7:0/716007564 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5632df4add70 con 0x5632df5c7da0 2024-09-19T04:25:01.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.083+0000 7febe8ff9640 10 client.16281 handle_command_reply: tid=0 2024-09-19T04:25:01.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.083+0000 7fec0a838740 1 client.16281 shutdown 2024-09-19T04:25:01.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.083+0000 7fec0a838740 1 -- 172.21.15.7:0/716007564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632df5432e0 msgr2=0x5632df5bef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:01.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.083+0000 7fec0a838740 1 --2- 172.21.15.7:0/716007564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632df5432e0 0x5632df5bef30 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7febf00314e0 tx=0x7febf0005fd0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.083+0000 7fec0a838740 1 -- 172.21.15.7:0/716007564 shutdown_connections 2024-09-19T04:25:01.086 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.083+0000 7fec0a838740 1 --2- 172.21.15.7:0/716007564 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5632df5c7da0 0x5632df5ca190 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.083+0000 7fec0a838740 1 --2- 172.21.15.7:0/716007564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5632df548370 0x5632df5c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.083+0000 7febe8ff9640 0 client.16281 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:25:01.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.083+0000 7fec0a838740 1 --2- 172.21.15.7:0/716007564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5632df5432e0 0x5632df5bef30 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.083+0000 7fec0a838740 1 --2- 172.21.15.7:0/716007564 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5632df5429a0 0x5632df5be9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.083+0000 7fec0a838740 1 -- 172.21.15.7:0/716007564 >> 172.21.15.7:0/716007564 conn(0x5632df53e010 msgr2=0x5632df53d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:01.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.084+0000 7fec0a838740 1 -- 172.21.15.7:0/716007564 shutdown_connections 2024-09-19T04:25:01.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.084+0000 7fec0a838740 1 -- 172.21.15.7:0/716007564 wait complete. 2024-09-19T04:25:01.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.084+0000 7fec0a838740 20 client.16281 trim_cache size 0 max 16384 2024-09-19T04:25:01.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:25:01.087 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:25:01.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:25:01.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:25:01.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.084+0000 7fec079c4640 1 -- 172.21.15.7:0/759277495 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7febec0a3240 msgr2=0x7febec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:01.088 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.084+0000 7fec079c4640 1 --2- 172.21.15.7:0/759277495 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7febec0a3240 0x7febec0a5700 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7febf8005fd0 tx=0x7febf8005f40 comp rx=0 tx=0).stop 2024-09-19T04:25:01.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.084+0000 7fec079c4640 1 -- 172.21.15.7:0/759277495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec00100a40 msgr2=0x7fec00197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:01.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.084+0000 7fec079c4640 1 --2- 172.21.15.7:0/759277495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec00100a40 0x7fec00197e10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7febfc00c970 tx=0x7febfc00ce30 comp rx=0 tx=0).stop 2024-09-19T04:25:01.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.084+0000 7fec079c4640 1 -- 172.21.15.7:0/759277495 shutdown_connections 2024-09-19T04:25:01.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.084+0000 7fec079c4640 1 --2- 172.21.15.7:0/759277495 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7febec0a3240 0x7febec0a5700 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.084+0000 7fec079c4640 1 --2- 172.21.15.7:0/759277495 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec001025f0 0x7fec0019f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.084+0000 7fec079c4640 1 --2- 172.21.15.7:0/759277495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec00101c30 0x7fec00198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.084+0000 7fec079c4640 1 --2- 172.21.15.7:0/759277495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fec00100a40 0x7fec00197e10 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:01.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.084+0000 7fec079c4640 1 -- 172.21.15.7:0/759277495 >> 172.21.15.7:0/759277495 conn(0x7fec000fc1c0 msgr2=0x7fec00069a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:01.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.084+0000 7fec079c4640 1 -- 172.21.15.7:0/759277495 shutdown_connections 2024-09-19T04:25:01.089 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:01.085+0000 7fec079c4640 1 -- 172.21.15.7:0/759277495 wait complete. 2024-09-19T04:25:01.461 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:01 smithi102 ceph-mon[35446]: pgmap v597: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 260 KiB/s wr, 170 op/s 2024-09-19T04:25:01.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:01 smithi092 ceph-mon[34940]: pgmap v597: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 260 KiB/s wr, 170 op/s 2024-09-19T04:25:01.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:01 smithi007 ceph-mon[31360]: pgmap v597: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 260 KiB/s wr, 170 op/s 2024-09-19T04:25:03.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:03 smithi092 ceph-mon[34940]: pgmap v598: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 43 KiB/s wr, 58 op/s 2024-09-19T04:25:03.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:03 smithi007 ceph-mon[31360]: pgmap v598: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 43 KiB/s wr, 58 op/s 2024-09-19T04:25:03.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:03 smithi102 ceph-mon[35446]: pgmap v598: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 43 KiB/s wr, 58 op/s 2024-09-19T04:25:05.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:05 smithi092 ceph-mon[34940]: pgmap v599: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 35 KiB/s wr, 41 op/s 2024-09-19T04:25:05.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:05 smithi007 ceph-mon[31360]: pgmap v599: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 35 KiB/s wr, 41 op/s 2024-09-19T04:25:05.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:05 smithi102 ceph-mon[35446]: pgmap v599: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 35 KiB/s wr, 41 op/s 2024-09-19T04:25:06.097 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:25:06.372 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:25:06.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.885+0000 7fa5762c6640 1 -- 172.21.15.7:0/198032074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa570101400 msgr2=0x7fa57010d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:06.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.885+0000 7fa5762c6640 1 --2- 172.21.15.7:0/198032074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa570101400 0x7fa57010d930 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa568009cd0 tx=0x7fa56802a8e0 comp rx=0 tx=0).stop 2024-09-19T04:25:06.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.885+0000 7fa5762c6640 1 -- 172.21.15.7:0/198032074 shutdown_connections 2024-09-19T04:25:06.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.885+0000 7fa5762c6640 1 --2- 172.21.15.7:0/198032074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa570101400 0x7fa57010d930 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:06.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.885+0000 7fa5762c6640 1 --2- 172.21.15.7:0/198032074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa570100a60 0x7fa570100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:06.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.885+0000 7fa5762c6640 1 --2- 172.21.15.7:0/198032074 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa570106a60 0x7fa570106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:06.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.885+0000 7fa5762c6640 1 -- 172.21.15.7:0/198032074 >> 172.21.15.7:0/198032074 conn(0x7fa5700fc780 msgr2=0x7fa5700feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:06.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.885+0000 7fa5762c6640 1 -- 172.21.15.7:0/198032074 shutdown_connections 2024-09-19T04:25:06.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.885+0000 7fa5762c6640 1 -- 172.21.15.7:0/198032074 wait complete. 2024-09-19T04:25:06.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.886+0000 7fa5762c6640 1 Processor -- start 2024-09-19T04:25:06.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.886+0000 7fa5762c6640 1 -- start start 2024-09-19T04:25:06.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.886+0000 7fa5762c6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa570100a60 0x7fa570199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:06.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.886+0000 7fa5762c6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa570101400 0x7fa5701997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:06.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.886+0000 7fa5762c6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa570106a60 0x7fa5701a4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:06.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.886+0000 7fa5762c6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa570110e80 con 0x7fa570101400 2024-09-19T04:25:06.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.886+0000 7fa5762c6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa570110d00 con 0x7fa570106a60 2024-09-19T04:25:06.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.886+0000 7fa5762c6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa570111000 con 0x7fa570100a60 2024-09-19T04:25:06.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.886+0000 7fa567fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa570101400 0x7fa5701997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:06.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.886+0000 7fa567fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa570101400 0x7fa5701997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34360/0 (socket says 172.21.15.7:34360) 2024-09-19T04:25:06.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.886+0000 7fa567fff640 1 -- 172.21.15.7:0/1124567268 learned_addr learned my addr 172.21.15.7:0/1124567268 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:06.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.886+0000 7fa574863640 1 --2- 172.21.15.7:0/1124567268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa570106a60 0x7fa5701a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:06.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.886+0000 7fa56ffff640 1 --2- 172.21.15.7:0/1124567268 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa570100a60 0x7fa570199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:06.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.886+0000 7fa567fff640 1 -- 172.21.15.7:0/1124567268 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa570100a60 msgr2=0x7fa570199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:06.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.886+0000 7fa567fff640 1 --2- 172.21.15.7:0/1124567268 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa570100a60 0x7fa570199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:06.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.886+0000 7fa567fff640 1 -- 172.21.15.7:0/1124567268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa570106a60 msgr2=0x7fa5701a4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:06.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.886+0000 7fa567fff640 1 --2- 172.21.15.7:0/1124567268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa570106a60 0x7fa5701a4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:06.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.886+0000 7fa567fff640 1 -- 172.21.15.7:0/1124567268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5701a4850 con 0x7fa570101400 2024-09-19T04:25:06.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.886+0000 7fa56ffff640 1 --2- 172.21.15.7:0/1124567268 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa570100a60 0x7fa570199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:25:06.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.886+0000 7fa574863640 1 --2- 172.21.15.7:0/1124567268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa570106a60 0x7fa5701a4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:25:06.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.887+0000 7fa567fff640 1 --2- 172.21.15.7:0/1124567268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa570101400 0x7fa5701997d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa55800c920 tx=0x7fa55800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:06.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.887+0000 7fa56dffb640 1 -- 172.21.15.7:0/1124567268 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa558007c70 con 0x7fa570101400 2024-09-19T04:25:06.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.887+0000 7fa56dffb640 1 -- 172.21.15.7:0/1124567268 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa558007e10 con 0x7fa570101400 2024-09-19T04:25:06.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.887+0000 7fa5762c6640 1 -- 172.21.15.7:0/1124567268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5701a4a20 con 0x7fa570101400 2024-09-19T04:25:06.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.887+0000 7fa56dffb640 1 -- 172.21.15.7:0/1124567268 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa558018890 con 0x7fa570101400 2024-09-19T04:25:06.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.887+0000 7fa5762c6640 1 -- 172.21.15.7:0/1124567268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5701a4f30 con 0x7fa570101400 2024-09-19T04:25:06.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.888+0000 7fa5762c6640 1 -- 172.21.15.7:0/1124567268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa570100ec0 con 0x7fa570101400 2024-09-19T04:25:06.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.889+0000 7fa56dffb640 1 -- 172.21.15.7:0/1124567268 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fa558018a70 con 0x7fa570101400 2024-09-19T04:25:06.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.890+0000 7fa56dffb640 1 --2- 172.21.15.7:0/1124567268 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa55c0a3240 0x7fa55c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:06.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.890+0000 7fa56ffff640 1 --2- 172.21.15.7:0/1124567268 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa55c0a3240 0x7fa55c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:06.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.890+0000 7fa56dffb640 1 -- 172.21.15.7:0/1124567268 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fa5580cfee0 con 0x7fa570101400 2024-09-19T04:25:06.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.890+0000 7fa56ffff640 1 --2- 172.21.15.7:0/1124567268 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa55c0a3240 0x7fa55c0a5700 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa560006fd0 tx=0x7fa560008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:06.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:06.894+0000 7fa56dffb640 1 -- 172.21.15.7:0/1124567268 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa558014030 con 0x7fa570101400 2024-09-19T04:25:07.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:07.106+0000 7fa5762c6640 1 -- 172.21.15.7:0/1124567268 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5701a5220 con 0x7fa570101400 2024-09-19T04:25:07.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:07.107+0000 7fa56dffb640 1 -- 172.21.15.7:0/1124567268 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+11965 (secure 0 0 0) 0x7fa55800de20 con 0x7fa570101400 2024-09-19T04:25:07.109 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:25:07.109 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":39,"btime":"2024-09-19T04:24:47:129039+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:24:47.019864+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24496,"mds_2":24482,"mds_3":24478,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6835/4235013488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":4235013488},{"type":"v1","addr":"172.21.15.92:6835","nonce":4235013488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24506,24496,24482,24478,24472]},"id":1}]} 2024-09-19T04:25:07.109 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 39 2024-09-19T04:25:07.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:07.110+0000 7fa5762c6640 1 -- 172.21.15.7:0/1124567268 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa55c0a3240 msgr2=0x7fa55c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:07.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:07.110+0000 7fa5762c6640 1 --2- 172.21.15.7:0/1124567268 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa55c0a3240 0x7fa55c0a5700 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa560006fd0 tx=0x7fa560008040 comp rx=0 tx=0).stop 2024-09-19T04:25:07.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:07.110+0000 7fa5762c6640 1 -- 172.21.15.7:0/1124567268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa570101400 msgr2=0x7fa5701997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:07.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:07.110+0000 7fa5762c6640 1 --2- 172.21.15.7:0/1124567268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa570101400 0x7fa5701997d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa55800c920 tx=0x7fa55800cde0 comp rx=0 tx=0).stop 2024-09-19T04:25:07.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:07.110+0000 7fa5762c6640 1 -- 172.21.15.7:0/1124567268 shutdown_connections 2024-09-19T04:25:07.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:07.110+0000 7fa5762c6640 1 --2- 172.21.15.7:0/1124567268 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fa55c0a3240 0x7fa55c0a5700 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:07.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:07.110+0000 7fa5762c6640 1 --2- 172.21.15.7:0/1124567268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa570106a60 0x7fa5701a4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:07.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:07.110+0000 7fa5762c6640 1 --2- 172.21.15.7:0/1124567268 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa570101400 0x7fa5701997d0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:07.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:07.110+0000 7fa5762c6640 1 --2- 172.21.15.7:0/1124567268 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa570100a60 0x7fa570199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:07.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:07.110+0000 7fa5762c6640 1 -- 172.21.15.7:0/1124567268 >> 172.21.15.7:0/1124567268 conn(0x7fa5700fc780 msgr2=0x7fa5700fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:07.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:07.111+0000 7fa5762c6640 1 -- 172.21.15.7:0/1124567268 shutdown_connections 2024-09-19T04:25:07.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:07.111+0000 7fa5762c6640 1 -- 172.21.15.7:0/1124567268 wait complete. 2024-09-19T04:25:07.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:07 smithi007 ceph-mon[31360]: pgmap v600: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 16 op/s 2024-09-19T04:25:07.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:07 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1124567268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:25:07.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:07 smithi092 ceph-mon[34940]: pgmap v600: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 16 op/s 2024-09-19T04:25:07.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:07 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1124567268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:25:07.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:07 smithi102 ceph-mon[35446]: pgmap v600: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 16 op/s 2024-09-19T04:25:07.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:07 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1124567268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:25:07.814 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24506 quiesce db --set-id 53799d07 --release --await' 2024-09-19T04:25:07.815 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24506 quiesce db --set-id 53799d07 --release --await 2024-09-19T04:25:08.075 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:25:08.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.569+0000 7f62e9e89640 1 -- 172.21.15.7:0/3320343786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62e4103660 msgr2=0x7f62e410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:08.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.569+0000 7f62e9e89640 1 --2- 172.21.15.7:0/3320343786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62e4103660 0x7f62e410bb50 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f62d8009900 tx=0x7f62d802a480 comp rx=0 tx=0).stop 2024-09-19T04:25:08.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.569+0000 7f62e9e89640 1 -- 172.21.15.7:0/3320343786 shutdown_connections 2024-09-19T04:25:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.569+0000 7f62e9e89640 1 --2- 172.21.15.7:0/3320343786 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62e410c170 0x7f62e410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.569+0000 7f62e9e89640 1 --2- 172.21.15.7:0/3320343786 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62e4103660 0x7f62e410bb50 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.569+0000 7f62e9e89640 1 --2- 172.21.15.7:0/3320343786 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62e4102d40 0x7f62e4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.569+0000 7f62e9e89640 1 -- 172.21.15.7:0/3320343786 >> 172.21.15.7:0/3320343786 conn(0x7f62e40fc7a0 msgr2=0x7f62e40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.569+0000 7f62e9e89640 1 -- 172.21.15.7:0/3320343786 shutdown_connections 2024-09-19T04:25:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.569+0000 7f62e9e89640 1 -- 172.21.15.7:0/3320343786 wait complete. 2024-09-19T04:25:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.570+0000 7f62e9e89640 1 Processor -- start 2024-09-19T04:25:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.570+0000 7f62e9e89640 1 -- start start 2024-09-19T04:25:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.570+0000 7f62e9e89640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62e4102d40 0x7f62e41009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.570+0000 7f62e9e89640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62e4103660 0x7f62e4100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.570+0000 7f62e9e89640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62e410c170 0x7f62e4101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.570+0000 7f62e9e89640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f62e4111f70 con 0x7f62e4102d40 2024-09-19T04:25:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.570+0000 7f62e9e89640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f62e4111df0 con 0x7f62e4103660 2024-09-19T04:25:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.570+0000 7f62e9e89640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f62e41120f0 con 0x7f62e410c170 2024-09-19T04:25:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.570+0000 7f62e37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62e4102d40 0x7f62e41009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.570+0000 7f62e37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62e4102d40 0x7f62e41009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48800/0 (socket says 172.21.15.7:48800) 2024-09-19T04:25:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.570+0000 7f62e37fe640 1 -- 172.21.15.7:0/3720893266 learned_addr learned my addr 172.21.15.7:0/3720893266 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.571+0000 7f62e2ffd640 1 --2- 172.21.15.7:0/3720893266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62e4103660 0x7f62e4100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.571+0000 7f62e3fff640 1 --2- 172.21.15.7:0/3720893266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62e410c170 0x7f62e4101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.571+0000 7f62e37fe640 1 -- 172.21.15.7:0/3720893266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62e410c170 msgr2=0x7f62e4101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.571+0000 7f62e37fe640 1 --2- 172.21.15.7:0/3720893266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62e410c170 0x7f62e4101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.571+0000 7f62e37fe640 1 -- 172.21.15.7:0/3720893266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62e4103660 msgr2=0x7f62e4100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.571+0000 7f62e37fe640 1 --2- 172.21.15.7:0/3720893266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62e4103660 0x7f62e4100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.571+0000 7f62e37fe640 1 -- 172.21.15.7:0/3720893266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e41a6960 con 0x7f62e4102d40 2024-09-19T04:25:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.571+0000 7f62e2ffd640 1 --2- 172.21.15.7:0/3720893266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62e4103660 0x7f62e4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:25:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.571+0000 7f62e37fe640 1 --2- 172.21.15.7:0/3720893266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62e4102d40 0x7f62e41009a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f62d400d770 tx=0x7f62d400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.571+0000 7f62e0ff9640 1 -- 172.21.15.7:0/3720893266 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d4017070 con 0x7f62e4102d40 2024-09-19T04:25:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.571+0000 7f62e9e89640 1 -- 172.21.15.7:0/3720893266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62e41a6c50 con 0x7f62e4102d40 2024-09-19T04:25:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.571+0000 7f62e0ff9640 1 -- 172.21.15.7:0/3720893266 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62d4005500 con 0x7f62e4102d40 2024-09-19T04:25:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.571+0000 7f62e0ff9640 1 -- 172.21.15.7:0/3720893266 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d4004e00 con 0x7f62e4102d40 2024-09-19T04:25:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.571+0000 7f62e9e89640 1 -- 172.21.15.7:0/3720893266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62e41a7190 con 0x7f62e4102d40 2024-09-19T04:25:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.573+0000 7f62e0ff9640 1 -- 172.21.15.7:0/3720893266 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f62d4004fa0 con 0x7f62e4102d40 2024-09-19T04:25:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.574+0000 7f62ec262740 1 Processor -- start 2024-09-19T04:25:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.574+0000 7f62ec262740 1 -- start start 2024-09-19T04:25:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.574+0000 7f62ec262740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559764fd9060 0x559764fd9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.574+0000 7f62ec262740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559764fd9980 0x559764fe3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.574+0000 7f62ec262740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559764fe4240 0x559764fe6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.574+0000 7f62ec262740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559764f3e620 con 0x559764fd9060 2024-09-19T04:25:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.574+0000 7f62ec262740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559764ee5e50 con 0x559764fd9980 2024-09-19T04:25:08.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.574+0000 7f62ec262740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559764f3a5e0 con 0x559764fe4240 2024-09-19T04:25:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.574+0000 7f62e0ff9640 1 --2- 172.21.15.7:0/3720893266 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f62cc0a3240 0x7f62cc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.574+0000 7f62e3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559764fd9060 0x559764fd9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.574+0000 7f62e3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559764fd9060 0x559764fd9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48812/0 (socket says 172.21.15.7:48812) 2024-09-19T04:25:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.574+0000 7f62e3fff640 1 -- 172.21.15.7:0/3303344795 learned_addr learned my addr 172.21.15.7:0/3303344795 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.574+0000 7f62e0ff9640 1 -- 172.21.15.7:0/3720893266 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f62d40cf850 con 0x7f62e4102d40 2024-09-19T04:25:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.574+0000 7f62e2ffd640 1 --2- 172.21.15.7:0/3303344795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559764fe4240 0x559764fe6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.574+0000 7f62e3fff640 1 --2- 172.21.15.7:0/3720893266 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f62cc0a3240 0x7f62cc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.574+0000 7f62e37fe640 1 --2- 172.21.15.7:0/3303344795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559764fd9980 0x559764fe3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.575+0000 7f62e3fff640 1 -- 172.21.15.7:0/3303344795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559764fe4240 msgr2=0x559764fe6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.575+0000 7f62e3fff640 1 --2- 172.21.15.7:0/3303344795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559764fe4240 0x559764fe6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.575+0000 7f62e3fff640 1 -- 172.21.15.7:0/3303344795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559764fd9980 msgr2=0x559764fe3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.575+0000 7f62e3fff640 1 --2- 172.21.15.7:0/3303344795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559764fd9980 0x559764fe3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:08.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.575+0000 7f62e3fff640 1 -- 172.21.15.7:0/3303344795 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559764ed6d40 con 0x559764fd9060 2024-09-19T04:25:08.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.575+0000 7f62e2ffd640 1 --2- 172.21.15.7:0/3303344795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559764fe4240 0x559764fe6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:25:08.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.575+0000 7f62e3fff640 1 --2- 172.21.15.7:0/3303344795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559764fd9060 0x559764fd9440 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f62dc012890 tx=0x7f62dc012d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac0736f66b38c467 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:08.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.575+0000 7f62c9ffb640 1 -- 172.21.15.7:0/3303344795 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc005020 con 0x559764fd9060 2024-09-19T04:25:08.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.575+0000 7f62c9ffb640 1 -- 172.21.15.7:0/3303344795 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62dc0056a0 con 0x559764fd9060 2024-09-19T04:25:08.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.575+0000 7f62c9ffb640 1 -- 172.21.15.7:0/3303344795 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc01c810 con 0x559764fd9060 2024-09-19T04:25:08.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.575+0000 7f62e3fff640 1 --2- 172.21.15.7:0/3720893266 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f62cc0a3240 0x7f62cc0a5700 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f62dc01f000 tx=0x7f62dc01e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:08.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.576+0000 7f62ec262740 1 -- 172.21.15.7:0/3303344795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559764fd9060 msgr2=0x559764fd9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:08.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.576+0000 7f62ec262740 1 --2- 172.21.15.7:0/3303344795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559764fd9060 0x559764fd9440 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f62dc012890 tx=0x7f62dc012d50 comp rx=0 tx=0).stop 2024-09-19T04:25:08.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.576+0000 7f62ec262740 1 -- 172.21.15.7:0/3303344795 shutdown_connections 2024-09-19T04:25:08.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.576+0000 7f62ec262740 1 --2- 172.21.15.7:0/3303344795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559764fe4240 0x559764fe6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:08.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.576+0000 7f62ec262740 1 --2- 172.21.15.7:0/3303344795 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559764fd9980 0x559764fe3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:08.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.576+0000 7f62ec262740 1 --2- 172.21.15.7:0/3303344795 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559764fd9060 0x559764fd9440 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:08.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.576+0000 7f62ec262740 1 -- 172.21.15.7:0/3303344795 >> 172.21.15.7:0/3303344795 conn(0x559764fd55f0 msgr2=0x559764fd59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:08.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.576+0000 7f62ec262740 1 -- 172.21.15.7:0/3303344795 shutdown_connections 2024-09-19T04:25:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.576+0000 7f62ec262740 1 -- 172.21.15.7:0/3303344795 wait complete. 2024-09-19T04:25:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.576+0000 7f62ec262740 1 -- start start 2024-09-19T04:25:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.576+0000 7f62ec262740 1 Processor -- start 2024-09-19T04:25:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.577+0000 7f62ec262740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559764fd9060 0x559764fe10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.577+0000 7f62ec262740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559764fd9980 0x559764fe1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.577+0000 7f62ec262740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559764fe4240 0x559764fe1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.577+0000 7f62ec262740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559764fe6e10 con 0x559764fd9980 2024-09-19T04:25:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.577+0000 7f62ec262740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559764ec6f10 con 0x559764fd9060 2024-09-19T04:25:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.577+0000 7f62ec262740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559764fe6f90 con 0x559764fe4240 2024-09-19T04:25:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.577+0000 7f62ec262740 10 client.0 _ll_register_callbacks cb 0x559764eeadb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:25:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.577+0000 7f62e2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559764fd9980 0x559764fe1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.577+0000 7f62e2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559764fd9980 0x559764fe1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48816/0 (socket says 172.21.15.7:48816) 2024-09-19T04:25:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.577+0000 7f62e2ffd640 1 -- 172.21.15.7:0/1269609015 learned_addr learned my addr 172.21.15.7:0/1269609015 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.577+0000 7f62e3fff640 1 --2- 172.21.15.7:0/1269609015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559764fe4240 0x559764fe1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:08.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.577+0000 7f62e37fe640 1 --2- 172.21.15.7:0/1269609015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559764fd9060 0x559764fe10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:08.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.577+0000 7f62e2ffd640 1 -- 172.21.15.7:0/1269609015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559764fe4240 msgr2=0x559764fe1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:08.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.577+0000 7f62e2ffd640 1 --2- 172.21.15.7:0/1269609015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559764fe4240 0x559764fe1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:08.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.577+0000 7f62e2ffd640 1 -- 172.21.15.7:0/1269609015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559764fd9060 msgr2=0x559764fe10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:08.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.577+0000 7f62e2ffd640 1 --2- 172.21.15.7:0/1269609015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559764fd9060 0x559764fe10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:08.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.577+0000 7f62e2ffd640 1 -- 172.21.15.7:0/1269609015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559764c4d580 con 0x559764fd9980 2024-09-19T04:25:08.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.577+0000 7f62e2ffd640 1 --2- 172.21.15.7:0/1269609015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559764fd9980 0x559764fe1610 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f62d8009900 tx=0x7f62d80318d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a884ee8abd2051 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:08.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.577+0000 7f62c2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:25:08.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.578+0000 7f62c2ffd640 1 -- 172.21.15.7:0/1269609015 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d8035070 con 0x559764fd9980 2024-09-19T04:25:08.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.578+0000 7f62c2ffd640 1 -- 172.21.15.7:0/1269609015 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f62d8004240 con 0x559764fd9980 2024-09-19T04:25:08.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.578+0000 7f62ec262740 1 -- 172.21.15.7:0/1269609015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62dc0056a0 con 0x559764fd9980 2024-09-19T04:25:08.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.578+0000 7f62c2ffd640 1 -- 172.21.15.7:0/1269609015 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f62d804d050 con 0x559764fd9980 2024-09-19T04:25:08.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.578+0000 7f62ec262740 10 client.16299 fetch_fsmap learned FSMap version 39 2024-09-19T04:25:08.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.578+0000 7f62ec262740 1 -- 172.21.15.7:0/1269609015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x559764d17960 con 0x559764fd9980 2024-09-19T04:25:08.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.578+0000 7f62c2ffd640 1 -- 172.21.15.7:0/1269609015 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62dc0056a0 con 0x559764fd9980 2024-09-19T04:25:08.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.578+0000 7f62c2ffd640 1 -- 172.21.15.7:0/1269609015 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 39) ==== 8382+0+0 (secure 0 0 0) 0x7f62d80049f0 con 0x559764fd9980 2024-09-19T04:25:08.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.578+0000 7f62ec262740 10 client.16299 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T04:25:08.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.578+0000 7f62ec262740 10 client.16299 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:25:08.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.578+0000 7f62ec262740 20 client.16299 populate_metadata read hostname 'smithi007' 2024-09-19T04:25:08.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.578+0000 7f62ec262740 1 --2- 172.21.15.7:0/1269609015 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x559764ff3d40 0x559764ff6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:08.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.578+0000 7f62ec262740 4 client.16299 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:25:08.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.578+0000 7f62ec262740 1 -- 172.21.15.7:0/1269609015 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559764f4bb90 con 0x559764ff3d40 2024-09-19T04:25:08.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.579+0000 7f62e37fe640 1 --2- 172.21.15.7:0/1269609015 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x559764ff3d40 0x559764ff6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:08.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.579+0000 7f62e37fe640 1 --2- 172.21.15.7:0/1269609015 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x559764ff3d40 0x559764ff6150 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=954087982a0c5e93 server_cookie=46414657b5e1bff in_seq=0 out_seq=0 2024-09-19T04:25:08.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.579+0000 7f62c2ffd640 10 client.16299 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:25:08.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.580+0000 7f62c2ffd640 1 -- 172.21.15.7:0/1269609015 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559764f4bb90 con 0x559764ff3d40 2024-09-19T04:25:08.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.580+0000 7f62c2ffd640 10 client.16299 handle_command_reply: tid=0 2024-09-19T04:25:08.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.580+0000 7f62ec262740 1 client.16299 shutdown 2024-09-19T04:25:08.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.580+0000 7f62ec262740 1 -- 172.21.15.7:0/1269609015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559764fd9980 msgr2=0x559764fe1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:08.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.580+0000 7f62ec262740 1 --2- 172.21.15.7:0/1269609015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559764fd9980 0x559764fe1610 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f62d8009900 tx=0x7f62d80318d0 comp rx=0 tx=0).stop 2024-09-19T04:25:08.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.580+0000 7f62ec262740 1 -- 172.21.15.7:0/1269609015 shutdown_connections 2024-09-19T04:25:08.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.580+0000 7f62ec262740 1 --2- 172.21.15.7:0/1269609015 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x559764ff3d40 0x559764ff6150 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:08.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.580+0000 7f62ec262740 1 --2- 172.21.15.7:0/1269609015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559764fe4240 0x559764fe1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:08.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.580+0000 7f62ec262740 1 --2- 172.21.15.7:0/1269609015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559764fd9980 0x559764fe1610 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:08.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.580+0000 7f62c2ffd640 0 client.16299 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:25:08.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.580+0000 7f62ec262740 1 --2- 172.21.15.7:0/1269609015 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559764fd9060 0x559764fe10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:08.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.580+0000 7f62ec262740 1 -- 172.21.15.7:0/1269609015 >> 172.21.15.7:0/1269609015 conn(0x559764fd55f0 msgr2=0x559764fdb320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:08.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.580+0000 7f62ec262740 1 -- 172.21.15.7:0/1269609015 shutdown_connections 2024-09-19T04:25:08.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.580+0000 7f62ec262740 1 -- 172.21.15.7:0/1269609015 wait complete. 2024-09-19T04:25:08.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.580+0000 7f62ec262740 20 client.16299 trim_cache size 0 max 16384 2024-09-19T04:25:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.597+0000 7f62ec262740 1 Processor -- start 2024-09-19T04:25:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.597+0000 7f62ec262740 1 -- start start 2024-09-19T04:25:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.597+0000 7f62ec262740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559764fd9060 0x559764fe2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.597+0000 7f62ec262740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559764fd9980 0x559764fdbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.597+0000 7f62ec262740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559764fe4240 0x559764ffba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.597+0000 7f62ec262740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f62e41b0ed0 con 0x559764fd9060 2024-09-19T04:25:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.597+0000 7f62ec262740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f62e41b2a70 con 0x559764fd9980 2024-09-19T04:25:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.597+0000 7f62ec262740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f62e41b15a0 con 0x559764fe4240 2024-09-19T04:25:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.597+0000 7f62e37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559764fd9060 0x559764fe2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.597+0000 7f62e37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559764fd9060 0x559764fe2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48820/0 (socket says 172.21.15.7:48820) 2024-09-19T04:25:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.597+0000 7f62e37fe640 1 -- 172.21.15.7:0/2758959328 learned_addr learned my addr 172.21.15.7:0/2758959328 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.598+0000 7f62e2ffd640 1 --2- 172.21.15.7:0/2758959328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559764fd9980 0x559764fdbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.598+0000 7f62e3fff640 1 --2- 172.21.15.7:0/2758959328 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559764fe4240 0x559764ffba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.598+0000 7f62e37fe640 1 -- 172.21.15.7:0/2758959328 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559764fe4240 msgr2=0x559764ffba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.598+0000 7f62e37fe640 1 --2- 172.21.15.7:0/2758959328 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559764fe4240 0x559764ffba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.598+0000 7f62e37fe640 1 -- 172.21.15.7:0/2758959328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559764fd9980 msgr2=0x559764fdbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.598+0000 7f62e37fe640 1 --2- 172.21.15.7:0/2758959328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559764fd9980 0x559764fdbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.598+0000 7f62e37fe640 1 -- 172.21.15.7:0/2758959328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559764fd5090 con 0x559764fd9060 2024-09-19T04:25:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.598+0000 7f62e3fff640 1 --2- 172.21.15.7:0/2758959328 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559764fe4240 0x559764ffba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:25:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.598+0000 7f62e37fe640 1 --2- 172.21.15.7:0/2758959328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559764fd9060 0x559764fe2fa0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f62d4098430 tx=0x7f62d40cce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b36effedab129de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.598+0000 7f62c97fa640 1 -- 172.21.15.7:0/2758959328 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d4020040 con 0x559764fd9060 2024-09-19T04:25:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.598+0000 7f62c97fa640 1 -- 172.21.15.7:0/2758959328 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62d40a46d0 con 0x559764fd9060 2024-09-19T04:25:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.598+0000 7f62c97fa640 1 -- 172.21.15.7:0/2758959328 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d40980d0 con 0x559764fd9060 2024-09-19T04:25:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.599+0000 7f62ec262740 1 -- 172.21.15.7:0/2758959328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559764fd9060 msgr2=0x559764fe2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.599+0000 7f62ec262740 1 --2- 172.21.15.7:0/2758959328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559764fd9060 0x559764fe2fa0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f62d4098430 tx=0x7f62d40cce10 comp rx=0 tx=0).stop 2024-09-19T04:25:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.599+0000 7f62ec262740 1 -- 172.21.15.7:0/2758959328 shutdown_connections 2024-09-19T04:25:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.599+0000 7f62ec262740 1 --2- 172.21.15.7:0/2758959328 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559764fe4240 0x559764ffba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.599+0000 7f62ec262740 1 --2- 172.21.15.7:0/2758959328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559764fd9980 0x559764fdbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.599+0000 7f62ec262740 1 --2- 172.21.15.7:0/2758959328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559764fd9060 0x559764fe2fa0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.599+0000 7f62ec262740 1 -- 172.21.15.7:0/2758959328 >> 172.21.15.7:0/2758959328 conn(0x559764fd55f0 msgr2=0x559764fd4750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.599+0000 7f62ec262740 1 -- 172.21.15.7:0/2758959328 shutdown_connections 2024-09-19T04:25:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.599+0000 7f62ec262740 1 -- 172.21.15.7:0/2758959328 wait complete. 2024-09-19T04:25:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.599+0000 7f62ec262740 1 -- start start 2024-09-19T04:25:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.599+0000 7f62ec262740 1 Processor -- start 2024-09-19T04:25:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.600+0000 7f62ec262740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559764fd9060 0x559764fec590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.600+0000 7f62ec262740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559764fd9980 0x559764fecad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.600+0000 7f62ec262740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559764fe4240 0x559764fe8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.600+0000 7f62ec262740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f62e41b2370 con 0x559764fd9060 2024-09-19T04:25:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.600+0000 7f62ec262740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f62e41b1ca0 con 0x559764fd9980 2024-09-19T04:25:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.600+0000 7f62ec262740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f62e41aee90 con 0x559764fe4240 2024-09-19T04:25:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.600+0000 7f62ec262740 10 client.0 _ll_register_callbacks cb 0x7f62d8005de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:25:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.600+0000 7f62e37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559764fd9060 0x559764fec590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.600+0000 7f62e37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559764fd9060 0x559764fec590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48832/0 (socket says 172.21.15.7:48832) 2024-09-19T04:25:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.600+0000 7f62e37fe640 1 -- 172.21.15.7:0/1480939928 learned_addr learned my addr 172.21.15.7:0/1480939928 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.600+0000 7f62e2ffd640 1 --2- 172.21.15.7:0/1480939928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559764fd9980 0x559764fecad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.600+0000 7f62e3fff640 1 --2- 172.21.15.7:0/1480939928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559764fe4240 0x559764fe8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.600+0000 7f62e37fe640 1 -- 172.21.15.7:0/1480939928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559764fe4240 msgr2=0x559764fe8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.600+0000 7f62e37fe640 1 --2- 172.21.15.7:0/1480939928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559764fe4240 0x559764fe8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.600+0000 7f62e37fe640 1 -- 172.21.15.7:0/1480939928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559764fd9980 msgr2=0x559764fecad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.600+0000 7f62e37fe640 1 --2- 172.21.15.7:0/1480939928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559764fd9980 0x559764fecad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.600+0000 7f62e37fe640 1 -- 172.21.15.7:0/1480939928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559764fe9350 con 0x559764fd9060 2024-09-19T04:25:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.600+0000 7f62e37fe640 1 --2- 172.21.15.7:0/1480939928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559764fd9060 0x559764fec590 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f62d4009610 tx=0x7f62d40cfb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fbcb0d93b0acd94 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.600+0000 7f62c2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:25:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.600+0000 7f62c2ffd640 1 -- 172.21.15.7:0/1480939928 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d4020070 con 0x559764fd9060 2024-09-19T04:25:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.600+0000 7f62c2ffd640 1 -- 172.21.15.7:0/1480939928 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f62d40980d0 con 0x559764fd9060 2024-09-19T04:25:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.600+0000 7f62ec262740 1 -- 172.21.15.7:0/1480939928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62d40a46d0 con 0x559764fd9060 2024-09-19T04:25:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.601+0000 7f62c2ffd640 1 -- 172.21.15.7:0/1480939928 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f62d40860b0 con 0x559764fd9060 2024-09-19T04:25:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.601+0000 7f62ec262740 10 client.16305 fetch_fsmap learned FSMap version 39 2024-09-19T04:25:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.601+0000 7f62ec262740 1 -- 172.21.15.7:0/1480939928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55976505f660 con 0x559764fd9060 2024-09-19T04:25:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.601+0000 7f62c2ffd640 1 -- 172.21.15.7:0/1480939928 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62d40a46d0 con 0x559764fd9060 2024-09-19T04:25:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.601+0000 7f62c2ffd640 1 -- 172.21.15.7:0/1480939928 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 39) ==== 8382+0+0 (secure 0 0 0) 0x7f62d409a920 con 0x559764fd9060 2024-09-19T04:25:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.601+0000 7f62ec262740 10 client.16305 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T04:25:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.601+0000 7f62ec262740 10 client.16305 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:25:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.601+0000 7f62ec262740 20 client.16305 populate_metadata read hostname 'smithi007' 2024-09-19T04:25:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.601+0000 7f62ec262740 1 --2- 172.21.15.7:0/1480939928 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55976505fd00 0x559765062120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:08.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.601+0000 7f62ec262740 4 client.16305 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "53799d07", "release": true, "await": true}] 2024-09-19T04:25:08.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.601+0000 7f62ec262740 1 -- 172.21.15.7:0/1480939928 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "quiesce db", "set_id": "53799d07", "release": true, "await": true}) -- 0x559764f460a0 con 0x55976505fd00 2024-09-19T04:25:08.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.601+0000 7f62e2ffd640 1 --2- 172.21.15.7:0/1480939928 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55976505fd00 0x559765062120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:08.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.602+0000 7f62c2ffd640 10 client.16305 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:25:08.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:08.602+0000 7f62e2ffd640 1 --2- 172.21.15.7:0/1480939928 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55976505fd00 0x559765062120 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=552d8b7eed9144d server_cookie=1f4abd3c4a7294b in_seq=0 out_seq=0 2024-09-19T04:25:09.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:09.511+0000 7f62c2ffd640 1 -- 172.21.15.7:0/1480939928 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x559764f460a0 con 0x55976505fd00 2024-09-19T04:25:09.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:09.511+0000 7f62c2ffd640 10 client.16305 handle_command_reply: tid=0 2024-09-19T04:25:09.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:09.511+0000 7f62ec262740 1 client.16305 shutdown 2024-09-19T04:25:09.514 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:09 smithi007 ceph-mon[31360]: pgmap v601: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 14 op/s 2024-09-19T04:25:09.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:09.512+0000 7f62ec262740 1 -- 172.21.15.7:0/1480939928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559764fd9060 msgr2=0x559764fec590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:09.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:09.512+0000 7f62ec262740 1 --2- 172.21.15.7:0/1480939928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559764fd9060 0x559764fec590 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f62d4009610 tx=0x7f62d40cfb60 comp rx=0 tx=0).stop 2024-09-19T04:25:09.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:09.512+0000 7f62ec262740 1 -- 172.21.15.7:0/1480939928 shutdown_connections 2024-09-19T04:25:09.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:09.512+0000 7f62ec262740 1 --2- 172.21.15.7:0/1480939928 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55976505fd00 0x559765062120 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:09.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:09.512+0000 7f62c2ffd640 0 client.16305 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:25:09.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:09.512+0000 7f62ec262740 1 --2- 172.21.15.7:0/1480939928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559764fe4240 0x559764fe8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:09.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:09.512+0000 7f62ec262740 1 --2- 172.21.15.7:0/1480939928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559764fd9980 0x559764fecad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:09.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:09.512+0000 7f62ec262740 1 --2- 172.21.15.7:0/1480939928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559764fd9060 0x559764fec590 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:09.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:09.512+0000 7f62ec262740 1 -- 172.21.15.7:0/1480939928 >> 172.21.15.7:0/1480939928 conn(0x559764fd55f0 msgr2=0x559764fd3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:09.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:09.512+0000 7f62ec262740 1 -- 172.21.15.7:0/1480939928 shutdown_connections 2024-09-19T04:25:09.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:09.512+0000 7f62ec262740 1 -- 172.21.15.7:0/1480939928 wait complete. 2024-09-19T04:25:09.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:09.512+0000 7f62ec262740 20 client.16305 trim_cache size 0 max 16384 2024-09-19T04:25:09.515 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:25:09.515 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 39, 2024-09-19T04:25:09.515 INFO:teuthology.orchestra.run.smithi007.stdout: "leader": 24506, 2024-09-19T04:25:09.516 INFO:teuthology.orchestra.run.smithi007.stdout: "set_version": 32, 2024-09-19T04:25:09.516 INFO:teuthology.orchestra.run.smithi007.stdout: "sets": { 2024-09-19T04:25:09.516 INFO:teuthology.orchestra.run.smithi007.stdout: "53799d07": { 2024-09-19T04:25:09.516 INFO:teuthology.orchestra.run.smithi007.stdout: "version": 32, 2024-09-19T04:25:09.516 INFO:teuthology.orchestra.run.smithi007.stdout: "age_ref": 0.0, 2024-09-19T04:25:09.516 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:25:09.516 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RELEASED", 2024-09-19T04:25:09.516 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:25:09.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:25:09.516 INFO:teuthology.orchestra.run.smithi007.stdout: "timeout": 90.0, 2024-09-19T04:25:09.516 INFO:teuthology.orchestra.run.smithi007.stdout: "expiration": 145.8, 2024-09-19T04:25:09.516 INFO:teuthology.orchestra.run.smithi007.stdout: "members": { 2024-09-19T04:25:09.516 INFO:teuthology.orchestra.run.smithi007.stdout: "file:/": { 2024-09-19T04:25:09.516 INFO:teuthology.orchestra.run.smithi007.stdout: "excluded": false, 2024-09-19T04:25:09.517 INFO:teuthology.orchestra.run.smithi007.stdout: "state": { 2024-09-19T04:25:09.517 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RELEASED", 2024-09-19T04:25:09.517 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.0 2024-09-19T04:25:09.517 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:25:09.517 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:25:09.517 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:25:09.517 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:25:09.517 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:25:09.517 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:25:09.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:09.513+0000 7f62e9e89640 1 -- 172.21.15.7:0/3720893266 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f62cc0a3240 msgr2=0x7f62cc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:09.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:09.513+0000 7f62e9e89640 1 --2- 172.21.15.7:0/3720893266 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f62cc0a3240 0x7f62cc0a5700 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f62dc01f000 tx=0x7f62dc01e000 comp rx=0 tx=0).stop 2024-09-19T04:25:09.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:09.513+0000 7f62e9e89640 1 -- 172.21.15.7:0/3720893266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62e4102d40 msgr2=0x7f62e41009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:09.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:09.513+0000 7f62e9e89640 1 --2- 172.21.15.7:0/3720893266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62e4102d40 0x7f62e41009a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f62d400d770 tx=0x7f62d400dc30 comp rx=0 tx=0).stop 2024-09-19T04:25:09.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:09.513+0000 7f62e9e89640 1 -- 172.21.15.7:0/3720893266 shutdown_connections 2024-09-19T04:25:09.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:09.513+0000 7f62e9e89640 1 --2- 172.21.15.7:0/3720893266 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f62cc0a3240 0x7f62cc0a5700 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:09.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:09.513+0000 7f62e9e89640 1 --2- 172.21.15.7:0/3720893266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62e410c170 0x7f62e4101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:09.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:09.513+0000 7f62e9e89640 1 --2- 172.21.15.7:0/3720893266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62e4103660 0x7f62e4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:09.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:09.513+0000 7f62e9e89640 1 --2- 172.21.15.7:0/3720893266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62e4102d40 0x7f62e41009a0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:09.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:09.513+0000 7f62e9e89640 1 -- 172.21.15.7:0/3720893266 >> 172.21.15.7:0/3720893266 conn(0x7f62e40fc7a0 msgr2=0x7f62e40fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:09.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:09.513+0000 7f62e9e89640 1 -- 172.21.15.7:0/3720893266 shutdown_connections 2024-09-19T04:25:09.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:25:09.513+0000 7f62e9e89640 1 -- 172.21.15.7:0/3720893266 wait complete. 2024-09-19T04:25:09.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:09 smithi092 ceph-mon[34940]: pgmap v601: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 14 op/s 2024-09-19T04:25:09.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:09 smithi102 ceph-mon[35446]: pgmap v601: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 14 op/s 2024-09-19T04:25:10.158 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '53799d07', total seconds elapsed: 29.8 2024-09-19T04:25:11.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:11 smithi092 ceph-mon[34940]: pgmap v602: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 18 op/s 2024-09-19T04:25:11.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:11 smithi007 ceph-mon[31360]: pgmap v602: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 18 op/s 2024-09-19T04:25:11.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:11 smithi102 ceph-mon[35446]: pgmap v602: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 18 op/s 2024-09-19T04:25:13.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:13 smithi092 ceph-mon[34940]: pgmap v603: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 KiB/s wr, 13 op/s 2024-09-19T04:25:13.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:13 smithi007 ceph-mon[31360]: pgmap v603: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 KiB/s wr, 13 op/s 2024-09-19T04:25:13.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:13 smithi102 ceph-mon[35446]: pgmap v603: 129 pgs: 129 active+clean; 458 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 KiB/s wr, 13 op/s 2024-09-19T04:25:14.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.174+0000 7f981de1e640 1 -- 172.21.15.7:0/3128871663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9818104f50 msgr2=0x7f9818107340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:14.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.174+0000 7f981de1e640 1 --2- 172.21.15.7:0/3128871663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9818104f50 0x7f9818107340 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9800009900 tx=0x7f980002a410 comp rx=0 tx=0).stop 2024-09-19T04:25:14.176 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.174+0000 7f981de1e640 1 -- 172.21.15.7:0/3128871663 shutdown_connections 2024-09-19T04:25:14.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.174+0000 7f981de1e640 1 --2- 172.21.15.7:0/3128871663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9818107880 0x7f9818109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.174+0000 7f981de1e640 1 --2- 172.21.15.7:0/3128871663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9818104f50 0x7f9818107340 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.174+0000 7f981de1e640 1 --2- 172.21.15.7:0/3128871663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9818102620 0x7f9818104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.174+0000 7f981de1e640 1 -- 172.21.15.7:0/3128871663 >> 172.21.15.7:0/3128871663 conn(0x7f98180fc1c0 msgr2=0x7f98180fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:14.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.174+0000 7f981de1e640 1 -- 172.21.15.7:0/3128871663 shutdown_connections 2024-09-19T04:25:14.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.174+0000 7f981de1e640 1 -- 172.21.15.7:0/3128871663 wait complete. 2024-09-19T04:25:14.177 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.175+0000 7f981de1e640 1 Processor -- start 2024-09-19T04:25:14.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.175+0000 7f981de1e640 1 -- start start 2024-09-19T04:25:14.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.175+0000 7f981de1e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9818102620 0x7f9818197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:14.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.175+0000 7f981de1e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9818104f50 0x7f9818198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:14.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.175+0000 7f981de1e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9818107880 0x7f981819f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:14.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.175+0000 7f981de1e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f981810d800 con 0x7f9818104f50 2024-09-19T04:25:14.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.175+0000 7f981de1e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f981810d680 con 0x7f9818102620 2024-09-19T04:25:14.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.175+0000 7f981de1e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f981810d980 con 0x7f9818107880 2024-09-19T04:25:14.179 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.176+0000 7f9816ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9818104f50 0x7f9818198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:14.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.176+0000 7f98177fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9818102620 0x7f9818197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:14.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.176+0000 7f9816ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9818104f50 0x7f9818198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48842/0 (socket says 172.21.15.7:48842) 2024-09-19T04:25:14.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.176+0000 7f9816ffd640 1 -- 172.21.15.7:0/1490234667 learned_addr learned my addr 172.21.15.7:0/1490234667 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:14.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.176+0000 7f9817fff640 1 --2- 172.21.15.7:0/1490234667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9818107880 0x7f981819f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:14.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.176+0000 7f98177fe640 1 -- 172.21.15.7:0/1490234667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9818107880 msgr2=0x7f981819f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:14.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.176+0000 7f98177fe640 1 --2- 172.21.15.7:0/1490234667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9818107880 0x7f981819f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.176+0000 7f98177fe640 1 -- 172.21.15.7:0/1490234667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9818104f50 msgr2=0x7f9818198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:14.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.176+0000 7f98177fe640 1 --2- 172.21.15.7:0/1490234667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9818104f50 0x7f9818198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.176+0000 7f98177fe640 1 -- 172.21.15.7:0/1490234667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981819fb70 con 0x7f9818102620 2024-09-19T04:25:14.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.176+0000 7f9816ffd640 1 --2- 172.21.15.7:0/1490234667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9818104f50 0x7f9818198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:25:14.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.176+0000 7f98177fe640 1 --2- 172.21.15.7:0/1490234667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9818102620 0x7f9818197f50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9808005fd0 tx=0x7f980800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:14.180 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.176+0000 7f9814ff9640 1 -- 172.21.15.7:0/1490234667 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980800cd80 con 0x7f9818102620 2024-09-19T04:25:14.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.176+0000 7f9814ff9640 1 -- 172.21.15.7:0/1490234667 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9808005020 con 0x7f9818102620 2024-09-19T04:25:14.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.176+0000 7f981de1e640 1 -- 172.21.15.7:0/1490234667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f981819fe60 con 0x7f9818102620 2024-09-19T04:25:14.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.176+0000 7f9814ff9640 1 -- 172.21.15.7:0/1490234667 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98080116d0 con 0x7f9818102620 2024-09-19T04:25:14.181 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.176+0000 7f981de1e640 1 -- 172.21.15.7:0/1490234667 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98181a0270 con 0x7f9818102620 2024-09-19T04:25:14.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.179+0000 7f9814ff9640 1 -- 172.21.15.7:0/1490234667 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f9808005540 con 0x7f9818102620 2024-09-19T04:25:14.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.179+0000 7f9820c90740 1 Processor -- start 2024-09-19T04:25:14.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.179+0000 7f9820c90740 1 -- start start 2024-09-19T04:25:14.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.179+0000 7f9820c90740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ad46a0db0 0x557ad46a11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:14.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.179+0000 7f9820c90740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ad46a16f0 0x557ad46a61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:14.187 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.179+0000 7f9820c90740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557ad46a6780 0x557ad46a8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:14.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.179+0000 7f9820c90740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557ad46002f0 con 0x557ad46a16f0 2024-09-19T04:25:14.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.179+0000 7f9820c90740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557ad45a8270 con 0x557ad46a0db0 2024-09-19T04:25:14.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.179+0000 7f9820c90740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557ad45fc2b0 con 0x557ad46a6780 2024-09-19T04:25:14.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.179+0000 7f98177fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ad46a16f0 0x557ad46a61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:14.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.179+0000 7f98177fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ad46a16f0 0x557ad46a61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48844/0 (socket says 172.21.15.7:48844) 2024-09-19T04:25:14.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.179+0000 7f9817fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ad46a0db0 0x557ad46a11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:14.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.179+0000 7f98177fe640 1 -- 172.21.15.7:0/2080410533 learned_addr learned my addr 172.21.15.7:0/2080410533 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:14.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.179+0000 7f9816ffd640 1 --2- 172.21.15.7:0/2080410533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557ad46a6780 0x557ad46a8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:14.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.179+0000 7f9814ff9640 1 --2- 172.21.15.7:0/1490234667 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f98040a3240 0x7f98040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:14.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.180+0000 7f9817fff640 1 -- 172.21.15.7:0/2080410533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557ad46a6780 msgr2=0x557ad46a8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:14.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.180+0000 7f9817fff640 1 --2- 172.21.15.7:0/2080410533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557ad46a6780 0x557ad46a8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.188 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.180+0000 7f9817fff640 1 -- 172.21.15.7:0/2080410533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ad46a16f0 msgr2=0x557ad46a61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:14.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.180+0000 7f9817fff640 1 --2- 172.21.15.7:0/2080410533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ad46a16f0 0x557ad46a61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.180+0000 7f9817fff640 1 -- 172.21.15.7:0/2080410533 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ad45a7340 con 0x557ad46a0db0 2024-09-19T04:25:14.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.180+0000 7f98177fe640 1 --2- 172.21.15.7:0/2080410533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ad46a16f0 0x557ad46a61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:25:14.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.180+0000 7f9817fff640 1 --2- 172.21.15.7:0/1490234667 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f98040a3240 0x7f98040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:14.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.180+0000 7f9814ff9640 1 -- 172.21.15.7:0/1490234667 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f98080d01a0 con 0x7f9818102620 2024-09-19T04:25:14.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.180+0000 7f9817fff640 1 --2- 172.21.15.7:0/2080410533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ad46a0db0 0x557ad46a11b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9810009c70 tx=0x7f9810011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=770ae6f07d55955f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:14.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.180+0000 7f980dffb640 1 -- 172.21.15.7:0/2080410533 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9810017050 con 0x557ad46a0db0 2024-09-19T04:25:14.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.180+0000 7f980dffb640 1 -- 172.21.15.7:0/2080410533 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9810003c40 con 0x557ad46a0db0 2024-09-19T04:25:14.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.180+0000 7f980dffb640 1 -- 172.21.15.7:0/2080410533 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981000f3c0 con 0x557ad46a0db0 2024-09-19T04:25:14.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.181+0000 7f9820c90740 1 -- 172.21.15.7:0/2080410533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ad46a0db0 msgr2=0x557ad46a11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:14.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.181+0000 7f9820c90740 1 --2- 172.21.15.7:0/2080410533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ad46a0db0 0x557ad46a11b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9810009c70 tx=0x7f9810011810 comp rx=0 tx=0).stop 2024-09-19T04:25:14.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.181+0000 7f9817fff640 1 --2- 172.21.15.7:0/1490234667 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f98040a3240 0x7f98040a5700 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9810023000 tx=0x7f9810024000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:14.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.181+0000 7f9820c90740 1 -- 172.21.15.7:0/2080410533 shutdown_connections 2024-09-19T04:25:14.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.181+0000 7f9820c90740 1 --2- 172.21.15.7:0/2080410533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557ad46a6780 0x557ad46a8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.181+0000 7f9820c90740 1 --2- 172.21.15.7:0/2080410533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ad46a16f0 0x557ad46a61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.181+0000 7f9820c90740 1 --2- 172.21.15.7:0/2080410533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ad46a0db0 0x557ad46a11b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.181+0000 7f9820c90740 1 -- 172.21.15.7:0/2080410533 >> 172.21.15.7:0/2080410533 conn(0x557ad4698010 msgr2=0x557ad4698410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:14.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.181+0000 7f9820c90740 1 -- 172.21.15.7:0/2080410533 shutdown_connections 2024-09-19T04:25:14.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.181+0000 7f9820c90740 1 -- 172.21.15.7:0/2080410533 wait complete. 2024-09-19T04:25:14.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.181+0000 7f9820c90740 1 -- start start 2024-09-19T04:25:14.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.181+0000 7f9820c90740 1 Processor -- start 2024-09-19T04:25:14.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.181+0000 7f9820c90740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ad46a0db0 0x557ad46aaf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:14.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.181+0000 7f9820c90740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ad46a16f0 0x557ad46ab4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:14.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.182+0000 7f9820c90740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557ad46a6780 0x557ad46b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:14.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.182+0000 7f9820c90740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557ad46a9750 con 0x557ad46a0db0 2024-09-19T04:25:14.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.182+0000 7f9820c90740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557ad4589290 con 0x557ad46a16f0 2024-09-19T04:25:14.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.182+0000 7f9820c90740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557ad46a98d0 con 0x557ad46a6780 2024-09-19T04:25:14.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.182+0000 7f9820c90740 10 client.0 _ll_register_callbacks cb 0x557ad45ba140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:25:14.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.182+0000 7f98177fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ad46a0db0 0x557ad46aaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:14.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.182+0000 7f9816ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ad46a16f0 0x557ad46ab4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:14.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.182+0000 7f98177fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ad46a0db0 0x557ad46aaf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48848/0 (socket says 172.21.15.7:48848) 2024-09-19T04:25:14.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.182+0000 7f98177fe640 1 -- 172.21.15.7:0/3284259677 learned_addr learned my addr 172.21.15.7:0/3284259677 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:14.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.182+0000 7f9816ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ad46a16f0 0x557ad46ab4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:49262/0 (socket says 172.21.15.7:49262) 2024-09-19T04:25:14.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.182+0000 7f9817fff640 1 --2- 172.21.15.7:0/3284259677 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557ad46a6780 0x557ad46b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:14.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.182+0000 7f98177fe640 1 -- 172.21.15.7:0/3284259677 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557ad46a6780 msgr2=0x557ad46b24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:14.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.182+0000 7f98177fe640 1 --2- 172.21.15.7:0/3284259677 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557ad46a6780 0x557ad46b24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.182+0000 7f98177fe640 1 -- 172.21.15.7:0/3284259677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ad46a16f0 msgr2=0x557ad46ab4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:14.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.182+0000 7f98177fe640 1 --2- 172.21.15.7:0/3284259677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ad46a16f0 0x557ad46ab4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.182+0000 7f98177fe640 1 -- 172.21.15.7:0/3284259677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ad4313210 con 0x557ad46a0db0 2024-09-19T04:25:14.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.182+0000 7f9816ffd640 1 --2- 172.21.15.7:0/3284259677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ad46a16f0 0x557ad46ab4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:25:14.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.182+0000 7f98177fe640 1 --2- 172.21.15.7:0/3284259677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ad46a0db0 0x557ad46aaf70 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f98080a4b30 tx=0x7f9808005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed7fa1e0f6cdd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:14.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.182+0000 7f97f6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:25:14.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.182+0000 7f97f6ffd640 1 -- 172.21.15.7:0/3284259677 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980801f040 con 0x557ad46a0db0 2024-09-19T04:25:14.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.182+0000 7f97f6ffd640 1 -- 172.21.15.7:0/3284259677 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f98080051d0 con 0x557ad46a0db0 2024-09-19T04:25:14.195 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.182+0000 7f9820c90740 1 -- 172.21.15.7:0/3284259677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9810003c40 con 0x557ad46a0db0 2024-09-19T04:25:14.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.183+0000 7f97f6ffd640 1 -- 172.21.15.7:0/3284259677 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f980809be00 con 0x557ad46a0db0 2024-09-19T04:25:14.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.183+0000 7f9820c90740 10 client.16317 fetch_fsmap learned FSMap version 39 2024-09-19T04:25:14.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.183+0000 7f9820c90740 1 -- 172.21.15.7:0/3284259677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x557ad43df620 con 0x557ad46a0db0 2024-09-19T04:25:14.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.183+0000 7f97f6ffd640 1 -- 172.21.15.7:0/3284259677 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9810003c40 con 0x557ad46a0db0 2024-09-19T04:25:14.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.183+0000 7f97f6ffd640 1 -- 172.21.15.7:0/3284259677 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 39) ==== 8382+0+0 (secure 0 0 0) 0x7f980800f040 con 0x557ad46a0db0 2024-09-19T04:25:14.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.183+0000 7f9820c90740 10 client.16317 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T04:25:14.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.183+0000 7f9820c90740 10 client.16317 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:25:14.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.183+0000 7f9820c90740 20 client.16317 populate_metadata read hostname 'smithi007' 2024-09-19T04:25:14.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.183+0000 7f9820c90740 1 --2- 172.21.15.7:0/3284259677 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557ad46b6c90 0x557ad46b90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:14.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.183+0000 7f9820c90740 4 client.16317 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:25:14.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.183+0000 7f9820c90740 1 -- 172.21.15.7:0/3284259677 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ad460da20 con 0x557ad46b6c90 2024-09-19T04:25:14.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.183+0000 7f9816ffd640 1 --2- 172.21.15.7:0/3284259677 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557ad46b6c90 0x557ad46b90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:14.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.184+0000 7f97f6ffd640 10 client.16317 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:25:14.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.184+0000 7f9816ffd640 1 --2- 172.21.15.7:0/3284259677 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557ad46b6c90 0x557ad46b90a0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc6847ebd2f55cab server_cookie=e1de65fd987ded99 in_seq=0 out_seq=0 2024-09-19T04:25:14.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.185+0000 7f97f6ffd640 1 -- 172.21.15.7:0/3284259677 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557ad460da20 con 0x557ad46b6c90 2024-09-19T04:25:14.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.185+0000 7f97f6ffd640 10 client.16317 handle_command_reply: tid=0 2024-09-19T04:25:14.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.185+0000 7f9820c90740 1 client.16317 shutdown 2024-09-19T04:25:14.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.185+0000 7f9820c90740 1 -- 172.21.15.7:0/3284259677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ad46a0db0 msgr2=0x557ad46aaf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:14.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.185+0000 7f9820c90740 1 --2- 172.21.15.7:0/3284259677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ad46a0db0 0x557ad46aaf70 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f98080a4b30 tx=0x7f9808005830 comp rx=0 tx=0).stop 2024-09-19T04:25:14.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.185+0000 7f9820c90740 1 -- 172.21.15.7:0/3284259677 shutdown_connections 2024-09-19T04:25:14.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.185+0000 7f9820c90740 1 --2- 172.21.15.7:0/3284259677 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557ad46b6c90 0x557ad46b90a0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.185+0000 7f9820c90740 1 --2- 172.21.15.7:0/3284259677 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557ad46a6780 0x557ad46b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.185+0000 7f9820c90740 1 --2- 172.21.15.7:0/3284259677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ad46a16f0 0x557ad46ab4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.185+0000 7f9820c90740 1 --2- 172.21.15.7:0/3284259677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ad46a0db0 0x557ad46aaf70 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.185+0000 7f9820c90740 1 -- 172.21.15.7:0/3284259677 >> 172.21.15.7:0/3284259677 conn(0x557ad4698010 msgr2=0x557ad4699820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:14.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.185+0000 7f97f6ffd640 0 client.16317 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:25:14.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.185+0000 7f9820c90740 1 -- 172.21.15.7:0/3284259677 shutdown_connections 2024-09-19T04:25:14.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.185+0000 7f9820c90740 1 -- 172.21.15.7:0/3284259677 wait complete. 2024-09-19T04:25:14.198 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.185+0000 7f9820c90740 20 client.16317 trim_cache size 0 max 16384 2024-09-19T04:25:14.202 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.200+0000 7f9820c90740 1 Processor -- start 2024-09-19T04:25:14.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.200+0000 7f9820c90740 1 -- start start 2024-09-19T04:25:14.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.200+0000 7f9820c90740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557ad46a0db0 0x557ad46ab540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:14.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.200+0000 7f9820c90740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ad46a16f0 0x557ad46b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:14.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.200+0000 7f9820c90740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ad46a6780 0x557ad46970b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:14.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.200+0000 7f9820c90740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f98181a8740 con 0x557ad46a16f0 2024-09-19T04:25:14.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.200+0000 7f9820c90740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f98181aa2e0 con 0x557ad46a6780 2024-09-19T04:25:14.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.200+0000 7f9820c90740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f98181a8e10 con 0x557ad46a0db0 2024-09-19T04:25:14.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.200+0000 7f9816ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ad46a16f0 0x557ad46b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:14.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.200+0000 7f9816ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ad46a16f0 0x557ad46b24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48864/0 (socket says 172.21.15.7:48864) 2024-09-19T04:25:14.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.200+0000 7f9816ffd640 1 -- 172.21.15.7:0/739758492 learned_addr learned my addr 172.21.15.7:0/739758492 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:14.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.200+0000 7f9817fff640 1 --2- 172.21.15.7:0/739758492 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ad46a6780 0x557ad46970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:14.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.200+0000 7f98177fe640 1 --2- 172.21.15.7:0/739758492 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557ad46a0db0 0x557ad46ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:14.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.200+0000 7f9816ffd640 1 -- 172.21.15.7:0/739758492 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557ad46a0db0 msgr2=0x557ad46ab540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:14.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.200+0000 7f9816ffd640 1 --2- 172.21.15.7:0/739758492 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557ad46a0db0 0x557ad46ab540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.200+0000 7f9816ffd640 1 -- 172.21.15.7:0/739758492 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ad46a6780 msgr2=0x557ad46970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:14.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.200+0000 7f9816ffd640 1 --2- 172.21.15.7:0/739758492 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ad46a6780 0x557ad46970b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.201+0000 7f9816ffd640 1 -- 172.21.15.7:0/739758492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ad46aaab0 con 0x557ad46a16f0 2024-09-19T04:25:14.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.201+0000 7f9816ffd640 1 --2- 172.21.15.7:0/739758492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ad46a16f0 0x557ad46b24b0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f9800031440 tx=0x7f9800009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939601b76c3fc879 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:14.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.201+0000 7f980d7fa640 1 -- 172.21.15.7:0/739758492 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9800035040 con 0x557ad46a16f0 2024-09-19T04:25:14.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.201+0000 7f980d7fa640 1 -- 172.21.15.7:0/739758492 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9800005500 con 0x557ad46a16f0 2024-09-19T04:25:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.201+0000 7f980d7fa640 1 -- 172.21.15.7:0/739758492 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9800004d90 con 0x557ad46a16f0 2024-09-19T04:25:14.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.202+0000 7f9820c90740 1 -- 172.21.15.7:0/739758492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ad46a16f0 msgr2=0x557ad46b24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:14.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.202+0000 7f9820c90740 1 --2- 172.21.15.7:0/739758492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ad46a16f0 0x557ad46b24b0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f9800031440 tx=0x7f9800009260 comp rx=0 tx=0).stop 2024-09-19T04:25:14.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.202+0000 7f9820c90740 1 -- 172.21.15.7:0/739758492 shutdown_connections 2024-09-19T04:25:14.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.202+0000 7f9820c90740 1 --2- 172.21.15.7:0/739758492 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ad46a6780 0x557ad46970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.202+0000 7f9820c90740 1 --2- 172.21.15.7:0/739758492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ad46a16f0 0x557ad46b24b0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.202+0000 7f9820c90740 1 --2- 172.21.15.7:0/739758492 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557ad46a0db0 0x557ad46ab540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.202+0000 7f9820c90740 1 -- 172.21.15.7:0/739758492 >> 172.21.15.7:0/739758492 conn(0x557ad4698010 msgr2=0x557ad46969a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.202+0000 7f9820c90740 1 -- 172.21.15.7:0/739758492 shutdown_connections 2024-09-19T04:25:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.202+0000 7f9820c90740 1 -- 172.21.15.7:0/739758492 wait complete. 2024-09-19T04:25:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.202+0000 7f9820c90740 1 -- start start 2024-09-19T04:25:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.202+0000 7f9820c90740 1 Processor -- start 2024-09-19T04:25:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.202+0000 7f9820c90740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ad46a0db0 0x557ad46af4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.202+0000 7f9820c90740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ad46a16f0 0x557ad46afa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.202+0000 7f9820c90740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557ad46a6780 0x557ad46b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.202+0000 7f9820c90740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f98181a9be0 con 0x557ad46a0db0 2024-09-19T04:25:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.202+0000 7f9820c90740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f98181a9510 con 0x557ad46a16f0 2024-09-19T04:25:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.202+0000 7f9820c90740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f98181a6700 con 0x557ad46a6780 2024-09-19T04:25:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.202+0000 7f9820c90740 10 client.0 _ll_register_callbacks cb 0x7f9808005b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:25:14.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.203+0000 7f98177fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ad46a0db0 0x557ad46af4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:14.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.203+0000 7f98177fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ad46a0db0 0x557ad46af4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48868/0 (socket says 172.21.15.7:48868) 2024-09-19T04:25:14.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.203+0000 7f98177fe640 1 -- 172.21.15.7:0/4163040053 learned_addr learned my addr 172.21.15.7:0/4163040053 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:14.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.203+0000 7f9816ffd640 1 --2- 172.21.15.7:0/4163040053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ad46a16f0 0x557ad46afa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:14.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.203+0000 7f9817fff640 1 --2- 172.21.15.7:0/4163040053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557ad46a6780 0x557ad46b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:14.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.203+0000 7f98177fe640 1 -- 172.21.15.7:0/4163040053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557ad46a6780 msgr2=0x557ad46b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:14.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.203+0000 7f98177fe640 1 --2- 172.21.15.7:0/4163040053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557ad46a6780 0x557ad46b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.203+0000 7f98177fe640 1 -- 172.21.15.7:0/4163040053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ad46a16f0 msgr2=0x557ad46afa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:14.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.203+0000 7f98177fe640 1 --2- 172.21.15.7:0/4163040053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ad46a16f0 0x557ad46afa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.203+0000 7f98177fe640 1 -- 172.21.15.7:0/4163040053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ad46b1050 con 0x557ad46a0db0 2024-09-19T04:25:14.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.203+0000 7f98177fe640 1 --2- 172.21.15.7:0/4163040053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ad46a0db0 0x557ad46af4f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9808009fd0 tx=0x7f98080b5230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=224c2c6b64c03e68 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:14.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.203+0000 7f97f6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:25:14.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.203+0000 7f97f6ffd640 1 -- 172.21.15.7:0/4163040053 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980801f070 con 0x557ad46a0db0 2024-09-19T04:25:14.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.203+0000 7f97f6ffd640 1 -- 172.21.15.7:0/4163040053 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f980809b8f0 con 0x557ad46a0db0 2024-09-19T04:25:14.210 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.203+0000 7f9820c90740 1 -- 172.21.15.7:0/4163040053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9800005500 con 0x557ad46a0db0 2024-09-19T04:25:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.203+0000 7f97f6ffd640 1 -- 172.21.15.7:0/4163040053 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f980809c700 con 0x557ad46a0db0 2024-09-19T04:25:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.203+0000 7f9820c90740 10 client.16323 fetch_fsmap learned FSMap version 39 2024-09-19T04:25:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.203+0000 7f9820c90740 1 -- 172.21.15.7:0/4163040053 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x557ad46b23d0 con 0x557ad46a0db0 2024-09-19T04:25:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.204+0000 7f97f6ffd640 1 -- 172.21.15.7:0/4163040053 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9800005500 con 0x557ad46a0db0 2024-09-19T04:25:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.204+0000 7f97f6ffd640 1 -- 172.21.15.7:0/4163040053 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 39) ==== 8382+0+0 (secure 0 0 0) 0x7f980809b360 con 0x557ad46a0db0 2024-09-19T04:25:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.204+0000 7f9820c90740 10 client.16323 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T04:25:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.204+0000 7f9820c90740 10 client.16323 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:25:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.204+0000 7f9820c90740 20 client.16323 populate_metadata read hostname 'smithi007' 2024-09-19T04:25:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.204+0000 7f9820c90740 1 --2- 172.21.15.7:0/4163040053 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557ad4721d90 0x557ad47241b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.204+0000 7f9820c90740 4 client.16323 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:25:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.204+0000 7f9820c90740 1 -- 172.21.15.7:0/4163040053 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557ad4607d70 con 0x557ad4721d90 2024-09-19T04:25:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.204+0000 7f9816ffd640 1 --2- 172.21.15.7:0/4163040053 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557ad4721d90 0x557ad47241b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:14.211 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.204+0000 7f9816ffd640 1 --2- 172.21.15.7:0/4163040053 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557ad4721d90 0x557ad47241b0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f75d29912d37486e server_cookie=98de66017e7ea948 in_seq=0 out_seq=0 2024-09-19T04:25:14.212 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.204+0000 7f97f6ffd640 10 client.16323 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:25:14.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.492+0000 7f97f6ffd640 1 -- 172.21.15.7:0/4163040053 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557ad4607d70 con 0x557ad4721d90 2024-09-19T04:25:14.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.492+0000 7f97f6ffd640 10 client.16323 handle_command_reply: tid=0 2024-09-19T04:25:14.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.492+0000 7f9820c90740 1 client.16323 shutdown 2024-09-19T04:25:14.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.492+0000 7f9820c90740 1 -- 172.21.15.7:0/4163040053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ad46a0db0 msgr2=0x557ad46af4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:14.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.492+0000 7f9820c90740 1 --2- 172.21.15.7:0/4163040053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ad46a0db0 0x557ad46af4f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9808009fd0 tx=0x7f98080b5230 comp rx=0 tx=0).stop 2024-09-19T04:25:14.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.492+0000 7f9820c90740 1 -- 172.21.15.7:0/4163040053 shutdown_connections 2024-09-19T04:25:14.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.492+0000 7f9820c90740 1 --2- 172.21.15.7:0/4163040053 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557ad4721d90 0x557ad47241b0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.492+0000 7f9820c90740 1 --2- 172.21.15.7:0/4163040053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557ad46a6780 0x557ad46b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.492+0000 7f9820c90740 1 --2- 172.21.15.7:0/4163040053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557ad46a16f0 0x557ad46afa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.494 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.492+0000 7f9820c90740 1 --2- 172.21.15.7:0/4163040053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557ad46a0db0 0x557ad46af4f0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.492+0000 7f9820c90740 1 -- 172.21.15.7:0/4163040053 >> 172.21.15.7:0/4163040053 conn(0x557ad4698010 msgr2=0x557ad46971c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:14.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.492+0000 7f97f6ffd640 0 client.16323 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:25:14.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.492+0000 7f9820c90740 1 -- 172.21.15.7:0/4163040053 shutdown_connections 2024-09-19T04:25:14.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.492+0000 7f9820c90740 1 -- 172.21.15.7:0/4163040053 wait complete. 2024-09-19T04:25:14.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.492+0000 7f9820c90740 20 client.16323 trim_cache size 0 max 16384 2024-09-19T04:25:14.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:25:14.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:25:14.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:25:14.495 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:25:14.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.493+0000 7f981de1e640 1 -- 172.21.15.7:0/1490234667 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f98040a3240 msgr2=0x7f98040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:14.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.493+0000 7f981de1e640 1 --2- 172.21.15.7:0/1490234667 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f98040a3240 0x7f98040a5700 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9810023000 tx=0x7f9810024000 comp rx=0 tx=0).stop 2024-09-19T04:25:14.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.493+0000 7f981de1e640 1 -- 172.21.15.7:0/1490234667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9818102620 msgr2=0x7f9818197f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:14.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.493+0000 7f981de1e640 1 --2- 172.21.15.7:0/1490234667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9818102620 0x7f9818197f50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9808005fd0 tx=0x7f980800ee80 comp rx=0 tx=0).stop 2024-09-19T04:25:14.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.493+0000 7f981de1e640 1 -- 172.21.15.7:0/1490234667 shutdown_connections 2024-09-19T04:25:14.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.493+0000 7f981de1e640 1 --2- 172.21.15.7:0/1490234667 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f98040a3240 0x7f98040a5700 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.493+0000 7f981de1e640 1 --2- 172.21.15.7:0/1490234667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9818107880 0x7f981819f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.493+0000 7f981de1e640 1 --2- 172.21.15.7:0/1490234667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9818104f50 0x7f9818198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.493+0000 7f981de1e640 1 --2- 172.21.15.7:0/1490234667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9818102620 0x7f9818197f50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.493+0000 7f981de1e640 1 -- 172.21.15.7:0/1490234667 >> 172.21.15.7:0/1490234667 conn(0x7f98180fc1c0 msgr2=0x7f9818103060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:14.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.493+0000 7f981de1e640 1 -- 172.21.15.7:0/1490234667 shutdown_connections 2024-09-19T04:25:14.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:14.493+0000 7f981de1e640 1 -- 172.21.15.7:0/1490234667 wait complete. 2024-09-19T04:25:15.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:15 smithi092 ceph-mon[34940]: pgmap v604: 129 pgs: 129 active+clean; 454 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 390 KiB/s wr, 83 op/s 2024-09-19T04:25:15.547 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:25:15 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-e[64832]: *** Caught signal (Segmentation fault) ** 2024-09-19T04:25:15.547 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:25:15 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-e[64832]: in thread 7fc79a15a640 thread_name:ms_dispatch 2024-09-19T04:25:15.547 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:25:15 smithi092 podman[68756]: 2024-09-19 04:25:15.269509278 +0000 UTC m=+0.019349710 container died 0a8e9ccc06fa876c5e6da6d5a9418b0e77ff7b1a4252b19feab6ccc44a78a816 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-e, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T04:25:15.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:15 smithi007 ceph-mon[31360]: pgmap v604: 129 pgs: 129 active+clean; 454 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 390 KiB/s wr, 83 op/s 2024-09-19T04:25:15.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:15 smithi102 ceph-mon[35446]: pgmap v604: 129 pgs: 129 active+clean; 454 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 390 KiB/s wr, 83 op/s 2024-09-19T04:25:16.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:16 smithi092 ceph-mon[34940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:25:16.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:16 smithi007 ceph-mon[31360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:25:16.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:16 smithi102 ceph-mon[35446]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:25:17.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:17 smithi092 ceph-mon[34940]: pgmap v605: 129 pgs: 129 active+clean; 438 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 384 KiB/s wr, 187 op/s 2024-09-19T04:25:17.297 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:25:16 smithi092 podman[68756]: 2024-09-19 04:25:16.99878328 +0000 UTC m=+1.748623706 container remove 0a8e9ccc06fa876c5e6da6d5a9418b0e77ff7b1a4252b19feab6ccc44a78a816 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-e, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T04:25:17.297 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:25:17 smithi092 systemd[1]: ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.e.service: Main process exited, code=exited, status=139/n/a 2024-09-19T04:25:17.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:17 smithi007 ceph-mon[31360]: pgmap v605: 129 pgs: 129 active+clean; 438 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 384 KiB/s wr, 187 op/s 2024-09-19T04:25:17.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:17 smithi102 ceph-mon[35446]: pgmap v605: 129 pgs: 129 active+clean; 438 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 384 KiB/s wr, 187 op/s 2024-09-19T04:25:17.797 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:25:17 smithi092 systemd[1]: ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.e.service: Failed with result 'exit-code'. 2024-09-19T04:25:17.797 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:25:17 smithi092 systemd[1]: ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.e.service: Consumed 39.557s CPU time. 2024-09-19T04:25:19.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:19 smithi092 ceph-mon[34940]: pgmap v606: 129 pgs: 129 active+clean; 436 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 384 KiB/s wr, 212 op/s 2024-09-19T04:25:19.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:19 smithi007 ceph-mon[31360]: pgmap v606: 129 pgs: 129 active+clean; 436 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 384 KiB/s wr, 212 op/s 2024-09-19T04:25:19.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:19 smithi102 ceph-mon[35446]: pgmap v606: 129 pgs: 129 active+clean; 436 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 384 KiB/s wr, 212 op/s 2024-09-19T04:25:21.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:21 smithi092 ceph-mon[34940]: pgmap v607: 129 pgs: 129 active+clean; 412 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 1.1 MiB/s wr, 480 op/s 2024-09-19T04:25:21.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:21 smithi007 ceph-mon[31360]: pgmap v607: 129 pgs: 129 active+clean; 412 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 1.1 MiB/s wr, 480 op/s 2024-09-19T04:25:21.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:21 smithi102 ceph-mon[35446]: pgmap v607: 129 pgs: 129 active+clean; 412 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 1.1 MiB/s wr, 480 op/s 2024-09-19T04:25:23.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:23 smithi092 ceph-mon[34940]: pgmap v608: 129 pgs: 129 active+clean; 406 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 1.1 MiB/s wr, 526 op/s 2024-09-19T04:25:23.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:23 smithi007 ceph-mon[31360]: pgmap v608: 129 pgs: 129 active+clean; 406 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 1.1 MiB/s wr, 526 op/s 2024-09-19T04:25:23.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:23 smithi102 ceph-mon[35446]: pgmap v608: 129 pgs: 129 active+clean; 406 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 1.1 MiB/s wr, 526 op/s 2024-09-19T04:25:25.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:25 smithi092 ceph-mon[34940]: pgmap v609: 129 pgs: 129 active+clean; 394 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 1.2 MiB/s wr, 688 op/s 2024-09-19T04:25:25.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:25 smithi007 ceph-mon[31360]: pgmap v609: 129 pgs: 129 active+clean; 394 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 1.2 MiB/s wr, 688 op/s 2024-09-19T04:25:25.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:25 smithi102 ceph-mon[35446]: pgmap v609: 129 pgs: 129 active+clean; 394 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 1.2 MiB/s wr, 688 op/s 2024-09-19T04:25:27.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:27 smithi092 ceph-mon[34940]: pgmap v610: 129 pgs: 129 active+clean; 383 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 1.2 MiB/s wr, 757 op/s 2024-09-19T04:25:27.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:27 smithi007 ceph-mon[31360]: pgmap v610: 129 pgs: 129 active+clean; 383 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 1.2 MiB/s wr, 757 op/s 2024-09-19T04:25:27.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.639+0000 7fe2db4a6640 1 -- 172.21.15.7:0/698796321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2d41003b0 msgr2=0x7fe2d41027c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:27.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.639+0000 7fe2db4a6640 1 --2- 172.21.15.7:0/698796321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2d41003b0 0x7fe2d41027c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0009900 tx=0x7fe2d002a410 comp rx=0 tx=0).stop 2024-09-19T04:25:27.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.640+0000 7fe2db4a6640 1 -- 172.21.15.7:0/698796321 shutdown_connections 2024-09-19T04:25:27.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.640+0000 7fe2db4a6640 1 --2- 172.21.15.7:0/698796321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2d41056b0 0x7fe2d4105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:27.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.640+0000 7fe2db4a6640 1 --2- 172.21.15.7:0/698796321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2d4102d00 0x7fe2d4105170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:27.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.640+0000 7fe2db4a6640 1 --2- 172.21.15.7:0/698796321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2d41003b0 0x7fe2d41027c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:27.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.640+0000 7fe2db4a6640 1 -- 172.21.15.7:0/698796321 >> 172.21.15.7:0/698796321 conn(0x7fe2d40fc1c0 msgr2=0x7fe2d40fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:27.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.641+0000 7fe2db4a6640 1 -- 172.21.15.7:0/698796321 shutdown_connections 2024-09-19T04:25:27.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.641+0000 7fe2db4a6640 1 -- 172.21.15.7:0/698796321 wait complete. 2024-09-19T04:25:27.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.641+0000 7fe2db4a6640 1 Processor -- start 2024-09-19T04:25:27.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.642+0000 7fe2db4a6640 1 -- start start 2024-09-19T04:25:27.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.642+0000 7fe2db4a6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2d41003b0 0x7fe2d410b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:27.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.642+0000 7fe2db4a6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2d4102d00 0x7fe2d410be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:27.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.642+0000 7fe2db4a6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2d41056b0 0x7fe2d41ae610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:27.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.642+0000 7fe2db4a6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d4113f00 con 0x7fe2d4102d00 2024-09-19T04:25:27.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.642+0000 7fe2db4a6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d4113d80 con 0x7fe2d41003b0 2024-09-19T04:25:27.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.642+0000 7fe2db4a6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d4114080 con 0x7fe2d41056b0 2024-09-19T04:25:27.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.642+0000 7fe2d8a41640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2d4102d00 0x7fe2d410be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:27.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.642+0000 7fe2d8a41640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2d4102d00 0x7fe2d410be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58186/0 (socket says 172.21.15.7:58186) 2024-09-19T04:25:27.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.642+0000 7fe2d8a41640 1 -- 172.21.15.7:0/3649507498 learned_addr learned my addr 172.21.15.7:0/3649507498 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:27.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.642+0000 7fe2d9a43640 1 --2- 172.21.15.7:0/3649507498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2d41056b0 0x7fe2d41ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:27.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.643+0000 7fe2d8a41640 1 -- 172.21.15.7:0/3649507498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2d41056b0 msgr2=0x7fe2d41ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:27.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.643+0000 7fe2d8a41640 1 --2- 172.21.15.7:0/3649507498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2d41056b0 0x7fe2d41ae610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:27.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.643+0000 7fe2d8a41640 1 -- 172.21.15.7:0/3649507498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2d41003b0 msgr2=0x7fe2d410b8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T04:25:27.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.643+0000 7fe2d8a41640 1 --2- 172.21.15.7:0/3649507498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2d41003b0 0x7fe2d410b8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:27.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.643+0000 7fe2d8a41640 1 -- 172.21.15.7:0/3649507498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d410c4d0 con 0x7fe2d4102d00 2024-09-19T04:25:27.645 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.643+0000 7fe2d8a41640 1 --2- 172.21.15.7:0/3649507498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2d4102d00 0x7fe2d410be30 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400c890 tx=0x7fe2c400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:27.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.644+0000 7fe2ca7fc640 1 -- 172.21.15.7:0/3649507498 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c4004220 con 0x7fe2d4102d00 2024-09-19T04:25:27.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.644+0000 7fe2db4a6640 1 -- 172.21.15.7:0/3649507498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2d41aec70 con 0x7fe2d4102d00 2024-09-19T04:25:27.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.644+0000 7fe2ca7fc640 1 -- 172.21.15.7:0/3649507498 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2c40043c0 con 0x7fe2d4102d00 2024-09-19T04:25:27.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.644+0000 7fe2ca7fc640 1 -- 172.21.15.7:0/3649507498 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c40049e0 con 0x7fe2d4102d00 2024-09-19T04:25:27.646 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.644+0000 7fe2db4a6640 1 -- 172.21.15.7:0/3649507498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2d41af210 con 0x7fe2d4102d00 2024-09-19T04:25:27.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.648+0000 7fe2de23c740 1 Processor -- start 2024-09-19T04:25:27.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.649+0000 7fe2ca7fc640 1 -- 172.21.15.7:0/3649507498 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fe2c4005120 con 0x7fe2d4102d00 2024-09-19T04:25:27.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.650+0000 7fe2de23c740 1 -- start start 2024-09-19T04:25:27.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.650+0000 7fe2de23c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f614c559a0 0x55f614c55da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:27.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.650+0000 7fe2ca7fc640 1 --2- 172.21.15.7:0/3649507498 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe2c00a3300 0x7fe2c00a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:27.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.651+0000 7fe2de23c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f614c562e0 0x55f614c5ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:27.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.651+0000 7fe2ca7fc640 1 -- 172.21.15.7:0/3649507498 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fe2c40cfc80 con 0x7fe2d4102d00 2024-09-19T04:25:27.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.651+0000 7fe2d9a43640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f614c559a0 0x55f614c55da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:27.652 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.651+0000 7fe2d9a43640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f614c559a0 0x55f614c55da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:48880/0 (socket says 172.21.15.7:48880) 2024-09-19T04:25:27.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.651+0000 7fe2d9a43640 1 -- 172.21.15.7:0/2778918014 learned_addr learned my addr 172.21.15.7:0/2778918014 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:27.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.651+0000 7fe2de23c740 1 --2- 172.21.15.7:0/2778918014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f614c5b370 0x55f614c5d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:27.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.651+0000 7fe2de23c740 1 -- 172.21.15.7:0/2778918014 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f614bb92f0 con 0x55f614c5b370 2024-09-19T04:25:27.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.651+0000 7fe2de23c740 1 -- 172.21.15.7:0/2778918014 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f614b61270 con 0x55f614c562e0 2024-09-19T04:25:27.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.651+0000 7fe2de23c740 1 -- 172.21.15.7:0/2778918014 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f614bb52b0 con 0x55f614c559a0 2024-09-19T04:25:27.653 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.651+0000 7fe2d9242640 1 --2- 172.21.15.7:0/3649507498 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe2c00a3300 0x7fe2c00a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:27.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.651+0000 7fe2d8a41640 1 --2- 172.21.15.7:0/2778918014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f614c562e0 0x55f614c5ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:27.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.652+0000 7fe2d9242640 1 --2- 172.21.15.7:0/3649507498 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe2c00a3300 0x7fe2c00a57c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0005c20 tx=0x7fe2d0005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:27.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.653+0000 7fe2d9a43640 1 --2- 172.21.15.7:0/2778918014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f614c5b370 0x55f614c5d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:27.654 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.653+0000 7fe2d9a43640 1 -- 172.21.15.7:0/2778918014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f614c562e0 msgr2=0x55f614c5ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:27.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.653+0000 7fe2d9a43640 1 --2- 172.21.15.7:0/2778918014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f614c562e0 0x55f614c5ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:27.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.653+0000 7fe2d9a43640 1 -- 172.21.15.7:0/2778918014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f614c5b370 msgr2=0x55f614c5d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:27.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.653+0000 7fe2d9a43640 1 --2- 172.21.15.7:0/2778918014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f614c5b370 0x55f614c5d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:27.655 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.653+0000 7fe2d9a43640 1 -- 172.21.15.7:0/2778918014 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f614b60340 con 0x55f614c559a0 2024-09-19T04:25:27.656 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.655+0000 7fe2d9a43640 1 --2- 172.21.15.7:0/2778918014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f614c559a0 0x55f614c55da0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00a7d0 tx=0x7fe2cc009650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7441a078b0180d79 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:27.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.657+0000 7fe2bf7fe640 1 -- 172.21.15.7:0/2778918014 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc00ae10 con 0x55f614c559a0 2024-09-19T04:25:27.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.657+0000 7fe2bf7fe640 1 -- 172.21.15.7:0/2778918014 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2cc010cd0 con 0x55f614c559a0 2024-09-19T04:25:27.658 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.657+0000 7fe2bf7fe640 1 -- 172.21.15.7:0/2778918014 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc019d20 con 0x55f614c559a0 2024-09-19T04:25:27.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:27 smithi102 ceph-mon[35446]: pgmap v610: 129 pgs: 129 active+clean; 383 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 1.2 MiB/s wr, 757 op/s 2024-09-19T04:25:27.660 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.658+0000 7fe2de23c740 1 -- 172.21.15.7:0/2778918014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f614c559a0 msgr2=0x55f614c55da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:27.661 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.658+0000 7fe2de23c740 1 --2- 172.21.15.7:0/2778918014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f614c559a0 0x55f614c55da0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00a7d0 tx=0x7fe2cc009650 comp rx=0 tx=0).stop 2024-09-19T04:25:27.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.661+0000 7fe2de23c740 1 -- 172.21.15.7:0/2778918014 shutdown_connections 2024-09-19T04:25:27.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.661+0000 7fe2de23c740 1 --2- 172.21.15.7:0/2778918014 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f614c5b370 0x55f614c5d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.661+0000 7fe2de23c740 1 --2- 172.21.15.7:0/2778918014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f614c562e0 0x55f614c5ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.661+0000 7fe2de23c740 1 --2- 172.21.15.7:0/2778918014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f614c559a0 0x55f614c55da0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.661+0000 7fe2de23c740 1 -- 172.21.15.7:0/2778918014 >> 172.21.15.7:0/2778918014 conn(0x55f614c51010 msgr2=0x55f614c51410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.661+0000 7fe2de23c740 1 -- 172.21.15.7:0/2778918014 shutdown_connections 2024-09-19T04:25:27.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.661+0000 7fe2de23c740 1 -- 172.21.15.7:0/2778918014 wait complete. 2024-09-19T04:25:27.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.662+0000 7fe2de23c740 1 -- start start 2024-09-19T04:25:27.664 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.662+0000 7fe2de23c740 1 Processor -- start 2024-09-19T04:25:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.663+0000 7fe2de23c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f614c559a0 0x55f614c5fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.663+0000 7fe2de23c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f614c562e0 0x55f614c601f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.663+0000 7fe2de23c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f614c5b370 0x55f614c67230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:27.665 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.663+0000 7fe2de23c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f614c5e340 con 0x55f614c562e0 2024-09-19T04:25:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.663+0000 7fe2de23c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f614b42290 con 0x55f614c5b370 2024-09-19T04:25:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.663+0000 7fe2de23c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f614c5e4c0 con 0x55f614c559a0 2024-09-19T04:25:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.663+0000 7fe2de23c740 10 client.0 _ll_register_callbacks cb 0x55f614b73140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:25:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.664+0000 7fe2d9242640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f614c559a0 0x55f614c5fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.664+0000 7fe2d8a41640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f614c562e0 0x55f614c601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.664+0000 7fe2d9242640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f614c559a0 0x55f614c5fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:48892/0 (socket says 172.21.15.7:48892) 2024-09-19T04:25:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.664+0000 7fe2d9242640 1 -- 172.21.15.7:0/2266101833 learned_addr learned my addr 172.21.15.7:0/2266101833 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:27.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.664+0000 7fe2d9a43640 1 --2- 172.21.15.7:0/2266101833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f614c5b370 0x55f614c67230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:27.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.664+0000 7fe2d9242640 1 -- 172.21.15.7:0/2266101833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f614c5b370 msgr2=0x55f614c67230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.664+0000 7fe2d9242640 1 --2- 172.21.15.7:0/2266101833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f614c5b370 0x55f614c67230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.664+0000 7fe2d9242640 1 -- 172.21.15.7:0/2266101833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f614c562e0 msgr2=0x55f614c601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.664+0000 7fe2d9242640 1 --2- 172.21.15.7:0/2266101833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f614c562e0 0x55f614c601f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.664+0000 7fe2d9242640 1 -- 172.21.15.7:0/2266101833 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6148cc210 con 0x55f614c559a0 2024-09-19T04:25:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.665+0000 7fe2d9242640 1 --2- 172.21.15.7:0/2266101833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f614c559a0 0x55f614c5fcb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0009900 tx=0x7fe2d0031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=936ff4ebe8b3f2ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.665+0000 7fe2bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-19T04:25:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.665+0000 7fe2bcff9640 1 -- 172.21.15.7:0/2266101833 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0040070 con 0x55f614c559a0 2024-09-19T04:25:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.665+0000 7fe2bcff9640 1 -- 172.21.15.7:0/2266101833 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fe2d0031c80 con 0x55f614c559a0 2024-09-19T04:25:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.665+0000 7fe2de23c740 1 -- 172.21.15.7:0/2266101833 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2cc010cd0 con 0x55f614c559a0 2024-09-19T04:25:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.666+0000 7fe2bcff9640 1 -- 172.21.15.7:0/2266101833 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fe2d0055050 con 0x55f614c559a0 2024-09-19T04:25:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.666+0000 7fe2de23c740 10 client.25960 fetch_fsmap learned FSMap version 41 2024-09-19T04:25:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.666+0000 7fe2de23c740 1 -- 172.21.15.7:0/2266101833 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55f614998620 con 0x55f614c559a0 2024-09-19T04:25:27.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.666+0000 7fe2bcff9640 1 -- 172.21.15.7:0/2266101833 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2cc010cd0 con 0x55f614c559a0 2024-09-19T04:25:27.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.666+0000 7fe2bcff9640 1 -- 172.21.15.7:0/2266101833 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 41) ==== 8390+0+0 (secure 0 0 0) 0x7fe2d0047880 con 0x55f614c559a0 2024-09-19T04:25:27.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.666+0000 7fe2de23c740 10 client.25960 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T04:25:27.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.666+0000 7fe2de23c740 10 client.25960 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:25:27.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.666+0000 7fe2de23c740 20 client.25960 populate_metadata read hostname 'smithi007' 2024-09-19T04:25:27.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.666+0000 7fe2de23c740 1 --2- 172.21.15.7:0/2266101833 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55f614c7cdc0 0x55f614c7f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:27.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.666+0000 7fe2de23c740 4 client.25960 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:25:27.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.666+0000 7fe2de23c740 1 -- 172.21.15.7:0/2266101833 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f614bc6a20 con 0x55f614c7cdc0 2024-09-19T04:25:27.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.668+0000 7fe2d8a41640 1 --2- 172.21.15.7:0/2266101833 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55f614c7cdc0 0x55f614c7f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:27.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.669+0000 7fe2d8a41640 1 --2- 172.21.15.7:0/2266101833 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55f614c7cdc0 0x55f614c7f260 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8411f6195e5c777 server_cookie=843e809235df7bb in_seq=0 out_seq=0 2024-09-19T04:25:27.671 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.669+0000 7fe2bcff9640 10 client.25960 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:25:27.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.671+0000 7fe2bcff9640 1 -- 172.21.15.7:0/2266101833 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f614bc6a20 con 0x55f614c7cdc0 2024-09-19T04:25:27.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.672+0000 7fe2bcff9640 10 client.25960 handle_command_reply: tid=0 2024-09-19T04:25:27.673 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.672+0000 7fe2de23c740 1 client.25960 shutdown 2024-09-19T04:25:27.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.672+0000 7fe2de23c740 1 -- 172.21.15.7:0/2266101833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f614c559a0 msgr2=0x55f614c5fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:27.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.672+0000 7fe2de23c740 1 --2- 172.21.15.7:0/2266101833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f614c559a0 0x55f614c5fcb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0009900 tx=0x7fe2d0031400 comp rx=0 tx=0).stop 2024-09-19T04:25:27.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.672+0000 7fe2de23c740 1 -- 172.21.15.7:0/2266101833 shutdown_connections 2024-09-19T04:25:27.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.672+0000 7fe2de23c740 1 --2- 172.21.15.7:0/2266101833 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55f614c7cdc0 0x55f614c7f260 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:27.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.672+0000 7fe2de23c740 1 --2- 172.21.15.7:0/2266101833 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f614c5b370 0x55f614c67230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:27.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.672+0000 7fe2de23c740 1 --2- 172.21.15.7:0/2266101833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f614c562e0 0x55f614c601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:27.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.673+0000 7fe2de23c740 1 --2- 172.21.15.7:0/2266101833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f614c559a0 0x55f614c5fcb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:27.674 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.673+0000 7fe2de23c740 1 -- 172.21.15.7:0/2266101833 >> 172.21.15.7:0/2266101833 conn(0x55f614c51010 msgr2=0x55f614c52820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:27.675 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.673+0000 7fe2bcff9640 0 client.25960 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:25:27.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.675+0000 7fe2de23c740 1 -- 172.21.15.7:0/2266101833 shutdown_connections 2024-09-19T04:25:27.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.676+0000 7fe2de23c740 1 -- 172.21.15.7:0/2266101833 wait complete. 2024-09-19T04:25:27.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.676+0000 7fe2de23c740 20 client.25960 trim_cache size 0 max 16384 2024-09-19T04:25:27.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.705+0000 7fe2de23c740 1 Processor -- start 2024-09-19T04:25:27.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.705+0000 7fe2de23c740 1 -- start start 2024-09-19T04:25:27.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.705+0000 7fe2de23c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f614c559a0 0x55f614c52400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:27.707 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.706+0000 7fe2de23c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f614c562e0 0x55f614c67150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:27.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.706+0000 7fe2d9242640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f614c559a0 0x55f614c52400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:27.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.706+0000 7fe2d9242640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f614c559a0 0x55f614c52400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:42396/0 (socket says 172.21.15.7:42396) 2024-09-19T04:25:27.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.706+0000 7fe2d9242640 1 -- 172.21.15.7:0/1204813976 learned_addr learned my addr 172.21.15.7:0/1204813976 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:27.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.706+0000 7fe2de23c740 1 --2- 172.21.15.7:0/1204813976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f614c5b370 0x55f614c52940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:27.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.706+0000 7fe2de23c740 1 -- 172.21.15.7:0/1204813976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d41b1020 con 0x55f614c5b370 2024-09-19T04:25:27.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.706+0000 7fe2de23c740 1 -- 172.21.15.7:0/1204813976 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d41b2c20 con 0x55f614c559a0 2024-09-19T04:25:27.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.706+0000 7fe2de23c740 1 -- 172.21.15.7:0/1204813976 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d41b1720 con 0x55f614c562e0 2024-09-19T04:25:27.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.706+0000 7fe2d8a41640 1 --2- 172.21.15.7:0/1204813976 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f614c562e0 0x55f614c67150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:27.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.706+0000 7fe2d9a43640 1 --2- 172.21.15.7:0/1204813976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f614c5b370 0x55f614c52940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:27.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.706+0000 7fe2d8a41640 1 -- 172.21.15.7:0/1204813976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f614c559a0 msgr2=0x55f614c52400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:27.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.706+0000 7fe2d8a41640 1 --2- 172.21.15.7:0/1204813976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f614c559a0 0x55f614c52400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:27.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.706+0000 7fe2d8a41640 1 -- 172.21.15.7:0/1204813976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f614c5b370 msgr2=0x55f614c52940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:27.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.706+0000 7fe2d8a41640 1 --2- 172.21.15.7:0/1204813976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f614c5b370 0x55f614c52940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:27.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.706+0000 7fe2d8a41640 1 -- 172.21.15.7:0/1204813976 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f614c50e30 con 0x55f614c562e0 2024-09-19T04:25:27.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.707+0000 7fe2d8a41640 1 --2- 172.21.15.7:0/1204813976 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f614c562e0 0x55f614c67150 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55f614c56d10 tx=0x7fe2c40057e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e63c8b6588dc914 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:27.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.707+0000 7fe2beffd640 1 -- 172.21.15.7:0/1204813976 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c40b7020 con 0x55f614c562e0 2024-09-19T04:25:27.709 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.707+0000 7fe2beffd640 1 -- 172.21.15.7:0/1204813976 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2c4099f70 con 0x55f614c562e0 2024-09-19T04:25:27.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.707+0000 7fe2beffd640 1 -- 172.21.15.7:0/1204813976 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c401d040 con 0x55f614c562e0 2024-09-19T04:25:27.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.707+0000 7fe2de23c740 1 -- 172.21.15.7:0/1204813976 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f614c562e0 msgr2=0x55f614c67150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:27.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.707+0000 7fe2de23c740 1 --2- 172.21.15.7:0/1204813976 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f614c562e0 0x55f614c67150 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55f614c56d10 tx=0x7fe2c40057e0 comp rx=0 tx=0).stop 2024-09-19T04:25:27.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.707+0000 7fe2de23c740 1 -- 172.21.15.7:0/1204813976 shutdown_connections 2024-09-19T04:25:27.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.707+0000 7fe2de23c740 1 --2- 172.21.15.7:0/1204813976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f614c5b370 0x55f614c52940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:27.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.707+0000 7fe2de23c740 1 --2- 172.21.15.7:0/1204813976 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f614c562e0 0x55f614c67150 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:27.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.707+0000 7fe2de23c740 1 --2- 172.21.15.7:0/1204813976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f614c559a0 0x55f614c52400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:27.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.707+0000 7fe2de23c740 1 -- 172.21.15.7:0/1204813976 >> 172.21.15.7:0/1204813976 conn(0x55f614c51010 msgr2=0x55f614c501c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:27.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.708+0000 7fe2de23c740 1 -- 172.21.15.7:0/1204813976 shutdown_connections 2024-09-19T04:25:27.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.708+0000 7fe2de23c740 1 -- 172.21.15.7:0/1204813976 wait complete. 2024-09-19T04:25:27.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.708+0000 7fe2de23c740 1 -- start start 2024-09-19T04:25:27.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.708+0000 7fe2de23c740 1 Processor -- start 2024-09-19T04:25:27.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.708+0000 7fe2de23c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f614c559a0 0x55f614c64390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:27.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.708+0000 7fe2de23c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f614c562e0 0x55f614c648d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:27.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.709+0000 7fe2de23c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f614c5b370 0x55f614c658e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.709+0000 7fe2de23c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d41b2520 con 0x55f614c5b370 2024-09-19T04:25:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.709+0000 7fe2d8a41640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f614c562e0 0x55f614c648d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.709+0000 7fe2d9242640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f614c559a0 0x55f614c64390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.709+0000 7fe2de23c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d41b1e20 con 0x55f614c562e0 2024-09-19T04:25:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.709+0000 7fe2de23c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d4073ef0 con 0x55f614c559a0 2024-09-19T04:25:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.709+0000 7fe2d9242640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f614c559a0 0x55f614c64390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:48910/0 (socket says 172.21.15.7:48910) 2024-09-19T04:25:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.709+0000 7fe2d9242640 1 -- 172.21.15.7:0/4266893451 learned_addr learned my addr 172.21.15.7:0/4266893451 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.709+0000 7fe2d8a41640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f614c562e0 0x55f614c648d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:42400/0 (socket says 172.21.15.7:42400) 2024-09-19T04:25:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.709+0000 7fe2de23c740 10 client.0 _ll_register_callbacks cb 0x7fe2d0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:25:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.709+0000 7fe2d9a43640 1 --2- 172.21.15.7:0/4266893451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f614c5b370 0x55f614c658e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.709+0000 7fe2d9242640 1 -- 172.21.15.7:0/4266893451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f614c562e0 msgr2=0x55f614c648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.709+0000 7fe2d9242640 1 --2- 172.21.15.7:0/4266893451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f614c562e0 0x55f614c648d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:27.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.709+0000 7fe2d9242640 1 -- 172.21.15.7:0/4266893451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f614c5b370 msgr2=0x55f614c658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:27.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.709+0000 7fe2d9242640 1 --2- 172.21.15.7:0/4266893451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f614c5b370 0x55f614c658e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:27.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.709+0000 7fe2d9242640 1 -- 172.21.15.7:0/4266893451 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f614c65ef0 con 0x55f614c559a0 2024-09-19T04:25:27.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.709+0000 7fe2d8a41640 1 --2- 172.21.15.7:0/4266893451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f614c562e0 0x55f614c648d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:25:27.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.709+0000 7fe2d9242640 1 --2- 172.21.15.7:0/4266893451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f614c559a0 0x55f614c64390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0047e90 tx=0x7fe2d0031cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a08784f540387fac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:27.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.709+0000 7fe2bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-19T04:25:27.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.709+0000 7fe2bcff9640 1 -- 172.21.15.7:0/4266893451 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0040040 con 0x55f614c559a0 2024-09-19T04:25:27.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.710+0000 7fe2de23c740 1 -- 172.21.15.7:0/4266893451 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2c4099f70 con 0x55f614c559a0 2024-09-19T04:25:27.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.710+0000 7fe2bcff9640 1 -- 172.21.15.7:0/4266893451 <== mon.1 v2:172.21.15.102:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fe2d0047880 con 0x55f614c559a0 2024-09-19T04:25:27.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.710+0000 7fe2bcff9640 1 -- 172.21.15.7:0/4266893451 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fe2d0035040 con 0x55f614c559a0 2024-09-19T04:25:27.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.710+0000 7fe2de23c740 10 client.25966 fetch_fsmap learned FSMap version 41 2024-09-19T04:25:27.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.710+0000 7fe2de23c740 1 -- 172.21.15.7:0/4266893451 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55f614c67200 con 0x55f614c559a0 2024-09-19T04:25:27.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.710+0000 7fe2bcff9640 1 -- 172.21.15.7:0/4266893451 <== mon.1 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2c4099f70 con 0x55f614c559a0 2024-09-19T04:25:27.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.712+0000 7fe2bcff9640 1 -- 172.21.15.7:0/4266893451 <== mon.1 v2:172.21.15.102:3300/0 5 ==== fsmap(e 41) ==== 8390+0+0 (secure 0 0 0) 0x7fe2d00514b0 con 0x55f614c559a0 2024-09-19T04:25:27.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.712+0000 7fe2de23c740 10 client.25966 fetch_fsmap finished waiting for FSMap version 41 2024-09-19T04:25:27.716 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.712+0000 7fe2de23c740 10 client.25966 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:25:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.712+0000 7fe2de23c740 20 client.25966 populate_metadata read hostname 'smithi007' 2024-09-19T04:25:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.712+0000 7fe2de23c740 1 --2- 172.21.15.7:0/4266893451 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55f614ce80c0 0x55f614cea4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.712+0000 7fe2de23c740 4 client.25966 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:25:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.712+0000 7fe2de23c740 1 -- 172.21.15.7:0/4266893451 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f614bc0d70 con 0x55f614ce80c0 2024-09-19T04:25:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.712+0000 7fe2d8a41640 1 --2- 172.21.15.7:0/4266893451 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55f614ce80c0 0x55f614cea4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.713+0000 7fe2d8a41640 1 --2- 172.21.15.7:0/4266893451 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55f614ce80c0 0x55f614cea4e0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5c9f07e627307ba server_cookie=3193686ec30db33d in_seq=0 out_seq=0 2024-09-19T04:25:27.717 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:27.714+0000 7fe2bcff9640 10 client.25966 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:25:28.047 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:25:27 smithi092 systemd[1]: ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.e.service: Scheduled restart job, restart counter is at 1. 2024-09-19T04:25:28.047 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:25:27 smithi092 systemd[1]: Stopped Ceph mds.e for 77957c0a-763c-11ef-bceb-c7b262605968. 2024-09-19T04:25:28.047 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:25:27 smithi092 systemd[1]: ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.e.service: Consumed 39.557s CPU time. 2024-09-19T04:25:28.047 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:25:27 smithi092 systemd[1]: Starting Ceph mds.e for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:25:28.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:28 smithi092 ceph-mon[34940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:25:28.547 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:25:28 smithi092 podman[68842]: 2024-09-19 04:25:27.955003276 +0000 UTC m=+0.032970762 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:25:28.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:28 smithi007 ceph-mon[31360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:25:28.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:28.635+0000 7fe2bcff9640 1 -- 172.21.15.7:0/4266893451 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f614bc0d70 con 0x55f614ce80c0 2024-09-19T04:25:28.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:28.635+0000 7fe2bcff9640 10 client.25966 handle_command_reply: tid=0 2024-09-19T04:25:28.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:28.635+0000 7fe2de23c740 1 client.25966 shutdown 2024-09-19T04:25:28.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:28.635+0000 7fe2de23c740 1 -- 172.21.15.7:0/4266893451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f614c559a0 msgr2=0x55f614c64390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:28.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:28.635+0000 7fe2de23c740 1 --2- 172.21.15.7:0/4266893451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f614c559a0 0x55f614c64390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0047e90 tx=0x7fe2d0031cb0 comp rx=0 tx=0).stop 2024-09-19T04:25:28.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:28.635+0000 7fe2de23c740 1 -- 172.21.15.7:0/4266893451 shutdown_connections 2024-09-19T04:25:28.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:28.635+0000 7fe2de23c740 1 --2- 172.21.15.7:0/4266893451 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55f614ce80c0 0x55f614cea4e0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:28.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:28.635+0000 7fe2de23c740 1 --2- 172.21.15.7:0/4266893451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f614c5b370 0x55f614c658e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:28.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:28.635+0000 7fe2de23c740 1 --2- 172.21.15.7:0/4266893451 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f614c562e0 0x55f614c648d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:28.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:28.635+0000 7fe2bcff9640 0 client.25966 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:25:28.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:28.635+0000 7fe2de23c740 1 --2- 172.21.15.7:0/4266893451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f614c559a0 0x55f614c64390 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:28.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:28.635+0000 7fe2de23c740 1 -- 172.21.15.7:0/4266893451 >> 172.21.15.7:0/4266893451 conn(0x55f614c51010 msgr2=0x55f614c513f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:28.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:28.636+0000 7fe2de23c740 1 -- 172.21.15.7:0/4266893451 shutdown_connections 2024-09-19T04:25:28.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:28.636+0000 7fe2de23c740 1 -- 172.21.15.7:0/4266893451 wait complete. 2024-09-19T04:25:28.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:28.636+0000 7fe2de23c740 20 client.25966 trim_cache size 0 max 16384 2024-09-19T04:25:28.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:25:28.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:25:28.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:25:28.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:25:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:28.636+0000 7fe2db4a6640 1 -- 172.21.15.7:0/3649507498 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe2c00a3300 msgr2=0x7fe2c00a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:28.636+0000 7fe2db4a6640 1 --2- 172.21.15.7:0/3649507498 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe2c00a3300 0x7fe2c00a57c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0005c20 tx=0x7fe2d0005fd0 comp rx=0 tx=0).stop 2024-09-19T04:25:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:28.636+0000 7fe2db4a6640 1 -- 172.21.15.7:0/3649507498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2d4102d00 msgr2=0x7fe2d410be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:28.636+0000 7fe2db4a6640 1 --2- 172.21.15.7:0/3649507498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2d4102d00 0x7fe2d410be30 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400c890 tx=0x7fe2c400cd50 comp rx=0 tx=0).stop 2024-09-19T04:25:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:28.636+0000 7fe2db4a6640 1 -- 172.21.15.7:0/3649507498 shutdown_connections 2024-09-19T04:25:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:28.636+0000 7fe2db4a6640 1 --2- 172.21.15.7:0/3649507498 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe2c00a3300 0x7fe2c00a57c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:28.636+0000 7fe2db4a6640 1 --2- 172.21.15.7:0/3649507498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2d41056b0 0x7fe2d41ae610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:28.636+0000 7fe2db4a6640 1 --2- 172.21.15.7:0/3649507498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2d4102d00 0x7fe2d410be30 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:28.636+0000 7fe2db4a6640 1 --2- 172.21.15.7:0/3649507498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2d41003b0 0x7fe2d410b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:28.640 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:28.636+0000 7fe2db4a6640 1 -- 172.21.15.7:0/3649507498 >> 172.21.15.7:0/3649507498 conn(0x7fe2d40fc1c0 msgr2=0x7fe2d4100cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:28.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:28.636+0000 7fe2db4a6640 1 -- 172.21.15.7:0/3649507498 shutdown_connections 2024-09-19T04:25:28.641 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:28.637+0000 7fe2db4a6640 1 -- 172.21.15.7:0/3649507498 wait complete. 2024-09-19T04:25:28.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:28 smithi102 ceph-mon[35446]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:25:29.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:29 smithi092 ceph-mon[34940]: pgmap v611: 129 pgs: 129 active+clean; 381 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 1.2 MiB/s wr, 669 op/s 2024-09-19T04:25:29.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:29 smithi092 ceph-mon[34940]: MDS daemon mds.e is removed because it is dead or otherwise unavailable. 2024-09-19T04:25:29.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:29 smithi092 ceph-mon[34940]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2024-09-19T04:25:29.297 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:25:29 smithi092 podman[68842]: 2024-09-19 04:25:29.000015724 +0000 UTC m=+1.077983207 container create 7e1d815fcaa0a43737b85753a03d3af0f00174b3357e6083ea66afcf934ea5ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-e, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T04:25:29.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:29 smithi007 ceph-mon[31360]: pgmap v611: 129 pgs: 129 active+clean; 381 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 1.2 MiB/s wr, 669 op/s 2024-09-19T04:25:29.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:29 smithi007 ceph-mon[31360]: MDS daemon mds.e is removed because it is dead or otherwise unavailable. 2024-09-19T04:25:29.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:29 smithi007 ceph-mon[31360]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2024-09-19T04:25:29.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:29 smithi102 ceph-mon[35446]: pgmap v611: 129 pgs: 129 active+clean; 381 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 1.2 MiB/s wr, 669 op/s 2024-09-19T04:25:29.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:29 smithi102 ceph-mon[35446]: MDS daemon mds.e is removed because it is dead or otherwise unavailable. 2024-09-19T04:25:29.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:29 smithi102 ceph-mon[35446]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2024-09-19T04:25:31.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:31 smithi092 ceph-mon[34940]: pgmap v612: 129 pgs: 129 active+clean; 350 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 1.8 MiB/s wr, 909 op/s 2024-09-19T04:25:31.547 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:25:31 smithi092 podman[68842]: 2024-09-19 04:25:31.299520716 +0000 UTC m=+3.377488185 container init 7e1d815fcaa0a43737b85753a03d3af0f00174b3357e6083ea66afcf934ea5ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T04:25:31.547 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:25:31 smithi092 podman[68842]: 2024-09-19 04:25:31.308949862 +0000 UTC m=+3.386917334 container start 7e1d815fcaa0a43737b85753a03d3af0f00174b3357e6083ea66afcf934ea5ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-19T04:25:31.547 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:25:31 smithi092 ceph-mds[68859]: -- 172.21.15.92:0/529680704 <== mon.2 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5603c04b7860 con 0x5603c0494800 2024-09-19T04:25:31.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:31 smithi007 ceph-mon[31360]: pgmap v612: 129 pgs: 129 active+clean; 350 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 1.8 MiB/s wr, 909 op/s 2024-09-19T04:25:31.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:31 smithi102 ceph-mon[35446]: pgmap v612: 129 pgs: 129 active+clean; 350 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 1.8 MiB/s wr, 909 op/s 2024-09-19T04:25:32.047 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:25:31 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-e[68854]: starting mds.e at 2024-09-19T04:25:33.047 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:25:32 smithi092 bash[68842]: 7e1d815fcaa0a43737b85753a03d3af0f00174b3357e6083ea66afcf934ea5ce 2024-09-19T04:25:33.047 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:25:32 smithi092 systemd[1]: Started Ceph mds.e for 77957c0a-763c-11ef-bceb-c7b262605968. 2024-09-19T04:25:33.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:33 smithi092 ceph-mon[34940]: pgmap v613: 129 pgs: 129 active+clean; 345 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 1.0 MiB/s wr, 671 op/s 2024-09-19T04:25:33.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:33 smithi092 ceph-mon[34940]: mds.? [v2:172.21.15.92:6834/3968218417,v1:172.21.15.92:6835/3968218417] up:boot 2024-09-19T04:25:33.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:33 smithi092 ceph-mon[34940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:25:33.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:33 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T04:25:33.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:33 smithi007 ceph-mon[31360]: pgmap v613: 129 pgs: 129 active+clean; 345 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 1.0 MiB/s wr, 671 op/s 2024-09-19T04:25:33.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:33 smithi007 ceph-mon[31360]: mds.? [v2:172.21.15.92:6834/3968218417,v1:172.21.15.92:6835/3968218417] up:boot 2024-09-19T04:25:33.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:33 smithi007 ceph-mon[31360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:25:33.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:33 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T04:25:33.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:33 smithi102 ceph-mon[35446]: pgmap v613: 129 pgs: 129 active+clean; 345 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 1.0 MiB/s wr, 671 op/s 2024-09-19T04:25:33.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:33 smithi102 ceph-mon[35446]: mds.? [v2:172.21.15.92:6834/3968218417,v1:172.21.15.92:6835/3968218417] up:boot 2024-09-19T04:25:33.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:33 smithi102 ceph-mon[35446]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:25:33.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:33 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T04:25:35.499 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:35 smithi092 ceph-mon[34940]: pgmap v614: 129 pgs: 129 active+clean; 330 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 1.5 MiB/s wr, 791 op/s 2024-09-19T04:25:35.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:35 smithi007 ceph-mon[31360]: pgmap v614: 129 pgs: 129 active+clean; 330 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 1.5 MiB/s wr, 791 op/s 2024-09-19T04:25:35.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:35 smithi102 ceph-mon[35446]: pgmap v614: 129 pgs: 129 active+clean; 330 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 1.5 MiB/s wr, 791 op/s 2024-09-19T04:25:37.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:37 smithi092 ceph-mon[34940]: pgmap v615: 129 pgs: 129 active+clean; 316 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 1.5 MiB/s wr, 758 op/s 2024-09-19T04:25:37.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:37 smithi007 ceph-mon[31360]: pgmap v615: 129 pgs: 129 active+clean; 316 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 1.5 MiB/s wr, 758 op/s 2024-09-19T04:25:37.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:37 smithi102 ceph-mon[35446]: pgmap v615: 129 pgs: 129 active+clean; 316 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 1.5 MiB/s wr, 758 op/s 2024-09-19T04:25:39.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:39 smithi092 ceph-mon[34940]: pgmap v616: 129 pgs: 129 active+clean; 314 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 1.1 MiB/s wr, 642 op/s 2024-09-19T04:25:39.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:39 smithi007 ceph-mon[31360]: pgmap v616: 129 pgs: 129 active+clean; 314 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 1.1 MiB/s wr, 642 op/s 2024-09-19T04:25:39.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:39 smithi102 ceph-mon[35446]: pgmap v616: 129 pgs: 129 active+clean; 314 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 1.1 MiB/s wr, 642 op/s 2024-09-19T04:25:41.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:41 smithi092 ceph-mon[34940]: pgmap v617: 129 pgs: 129 active+clean; 292 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 879 op/s 2024-09-19T04:25:41.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:41 smithi007 ceph-mon[31360]: pgmap v617: 129 pgs: 129 active+clean; 292 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 879 op/s 2024-09-19T04:25:41.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:41 smithi102 ceph-mon[35446]: pgmap v617: 129 pgs: 129 active+clean; 292 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 879 op/s 2024-09-19T04:25:41.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.727+0000 7ffaf5131640 1 -- 172.21.15.7:0/2712029312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffaf0100a40 msgr2=0x7ffaf0100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:41.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.727+0000 7ffaf5131640 1 --2- 172.21.15.7:0/2712029312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffaf0100a40 0x7ffaf0100e40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009900 tx=0x7ffae002a410 comp rx=0 tx=0).stop 2024-09-19T04:25:41.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.727+0000 7ffaf5131640 1 -- 172.21.15.7:0/2712029312 shutdown_connections 2024-09-19T04:25:41.731 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.727+0000 7ffaf5131640 1 --2- 172.21.15.7:0/2712029312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffaf01025f0 0x7ffaf0108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.727+0000 7ffaf5131640 1 --2- 172.21.15.7:0/2712029312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffaf0101c30 0x7ffaf01020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.727+0000 7ffaf5131640 1 --2- 172.21.15.7:0/2712029312 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffaf0100a40 0x7ffaf0100e40 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.727+0000 7ffaf5131640 1 -- 172.21.15.7:0/2712029312 >> 172.21.15.7:0/2712029312 conn(0x7ffaf00fc1c0 msgr2=0x7ffaf00fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.727+0000 7ffaf5131640 1 -- 172.21.15.7:0/2712029312 shutdown_connections 2024-09-19T04:25:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.727+0000 7ffaf5131640 1 -- 172.21.15.7:0/2712029312 wait complete. 2024-09-19T04:25:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.728+0000 7ffaf5131640 1 Processor -- start 2024-09-19T04:25:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.728+0000 7ffaf5131640 1 -- start start 2024-09-19T04:25:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.728+0000 7ffaf5131640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffaf0100a40 0x7ffaf0197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.728+0000 7ffaf5131640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffaf0101c30 0x7ffaf0198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.728+0000 7ffaf5131640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffaf01025f0 0x7ffaf019f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.728+0000 7ffaf5131640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf010c720 con 0x7ffaf01025f0 2024-09-19T04:25:41.732 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.728+0000 7ffaf5131640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf010c5a0 con 0x7ffaf0100a40 2024-09-19T04:25:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.728+0000 7ffaf5131640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf010c8a0 con 0x7ffaf0101c30 2024-09-19T04:25:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.728+0000 7ffaef59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffaf01025f0 0x7ffaf019f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.728+0000 7ffaeed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffaf0100a40 0x7ffaf0197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.728+0000 7ffaef59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffaf01025f0 0x7ffaf019f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58000/0 (socket says 172.21.15.7:58000) 2024-09-19T04:25:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.728+0000 7ffaeed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffaf0100a40 0x7ffaf0197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:51574/0 (socket says 172.21.15.7:51574) 2024-09-19T04:25:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.728+0000 7ffaef59e640 1 -- 172.21.15.7:0/3880281843 learned_addr learned my addr 172.21.15.7:0/3880281843 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.729+0000 7ffaee59c640 1 --2- 172.21.15.7:0/3880281843 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffaf0101c30 0x7ffaf0198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.729+0000 7ffaef59e640 1 -- 172.21.15.7:0/3880281843 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffaf0101c30 msgr2=0x7ffaf0198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.729+0000 7ffaef59e640 1 --2- 172.21.15.7:0/3880281843 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffaf0101c30 0x7ffaf0198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.729+0000 7ffaef59e640 1 -- 172.21.15.7:0/3880281843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffaf0100a40 msgr2=0x7ffaf0197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:41.733 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.729+0000 7ffaef59e640 1 --2- 172.21.15.7:0/3880281843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffaf0100a40 0x7ffaf0197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.729+0000 7ffaef59e640 1 -- 172.21.15.7:0/3880281843 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf019fb60 con 0x7ffaf01025f0 2024-09-19T04:25:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.729+0000 7ffaeed9d640 1 --2- 172.21.15.7:0/3880281843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffaf0100a40 0x7ffaf0197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:25:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.729+0000 7ffaef59e640 1 --2- 172.21.15.7:0/3880281843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffaf01025f0 0x7ffaf019f4f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ffae800b970 tx=0x7ffae800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.729+0000 7ffad7fff640 1 -- 172.21.15.7:0/3880281843 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae8019070 con 0x7ffaf01025f0 2024-09-19T04:25:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.729+0000 7ffaf5131640 1 -- 172.21.15.7:0/3880281843 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaf019fe50 con 0x7ffaf01025f0 2024-09-19T04:25:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.729+0000 7ffad7fff640 1 -- 172.21.15.7:0/3880281843 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffae800cb40 con 0x7ffaf01025f0 2024-09-19T04:25:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.729+0000 7ffad7fff640 1 -- 172.21.15.7:0/3880281843 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae8007610 con 0x7ffaf01025f0 2024-09-19T04:25:41.734 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.729+0000 7ffaf5131640 1 -- 172.21.15.7:0/3880281843 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaf01a0390 con 0x7ffaf01025f0 2024-09-19T04:25:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.731+0000 7ffad7fff640 1 -- 172.21.15.7:0/3880281843 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7ffae801c070 con 0x7ffaf01025f0 2024-09-19T04:25:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.732+0000 7ffaf7ecf740 1 Processor -- start 2024-09-19T04:25:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.732+0000 7ffaf7ecf740 1 -- start start 2024-09-19T04:25:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.732+0000 7ffaf7ecf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c23f92c9a0 0x55c23f92cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.732+0000 7ffaf7ecf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c23f92d2e0 0x55c23f931da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.732+0000 7ffaf7ecf740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c23f932370 0x55c23f934830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:41.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.732+0000 7ffaf7ecf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c23f8902f0 con 0x55c23f92c9a0 2024-09-19T04:25:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.732+0000 7ffaf7ecf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c23f838270 con 0x55c23f92d2e0 2024-09-19T04:25:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.732+0000 7ffaf7ecf740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c23f88c2b0 con 0x55c23f932370 2024-09-19T04:25:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.732+0000 7ffaee59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c23f92c9a0 0x55c23f92cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.732+0000 7ffaeed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c23f92d2e0 0x55c23f931da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.732+0000 7ffad7fff640 1 --2- 172.21.15.7:0/3880281843 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffad80a3240 0x7ffad80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.732+0000 7ffaee59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c23f92c9a0 0x55c23f92cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58010/0 (socket says 172.21.15.7:58010) 2024-09-19T04:25:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.732+0000 7ffaee59c640 1 -- 172.21.15.7:0/3030264418 learned_addr learned my addr 172.21.15.7:0/3030264418 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.732+0000 7ffaeed9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c23f92d2e0 0x55c23f931da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:51590/0 (socket says 172.21.15.7:51590) 2024-09-19T04:25:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.732+0000 7ffaee59c640 1 --2- 172.21.15.7:0/3030264418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c23f932370 0x55c23f934830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.732+0000 7ffaef59e640 1 --2- 172.21.15.7:0/3880281843 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffad80a3240 0x7ffad80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.732+0000 7ffad7fff640 1 -- 172.21.15.7:0/3880281843 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7ffae80cf290 con 0x7ffaf01025f0 2024-09-19T04:25:41.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.732+0000 7ffaee59c640 1 -- 172.21.15.7:0/3030264418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c23f932370 msgr2=0x55c23f934830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:41.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.733+0000 7ffaee59c640 1 --2- 172.21.15.7:0/3030264418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c23f932370 0x55c23f934830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:41.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.733+0000 7ffaee59c640 1 -- 172.21.15.7:0/3030264418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c23f92d2e0 msgr2=0x55c23f931da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:41.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.733+0000 7ffaee59c640 1 --2- 172.21.15.7:0/3030264418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c23f92d2e0 0x55c23f931da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:41.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.733+0000 7ffaee59c640 1 -- 172.21.15.7:0/3030264418 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c23f837340 con 0x55c23f92c9a0 2024-09-19T04:25:41.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.733+0000 7ffaeed9d640 1 --2- 172.21.15.7:0/3030264418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c23f92d2e0 0x55c23f931da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:25:41.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.733+0000 7ffaee59c640 1 --2- 172.21.15.7:0/3030264418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c23f92c9a0 0x55c23f92cda0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ffae40137f0 tx=0x7ffae40097a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca4e33bf7f1953dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:41.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.733+0000 7ffaef59e640 1 --2- 172.21.15.7:0/3880281843 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffad80a3240 0x7ffad80a5700 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ffae809b4e0 tx=0x7ffae8004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:41.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.733+0000 7ffad57fa640 1 -- 172.21.15.7:0/3030264418 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae4013d70 con 0x55c23f92c9a0 2024-09-19T04:25:41.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.733+0000 7ffad57fa640 1 -- 172.21.15.7:0/3030264418 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffae4005020 con 0x55c23f92c9a0 2024-09-19T04:25:41.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.733+0000 7ffad57fa640 1 -- 172.21.15.7:0/3030264418 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae4004a30 con 0x55c23f92c9a0 2024-09-19T04:25:41.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.734+0000 7ffaf7ecf740 1 -- 172.21.15.7:0/3030264418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c23f92c9a0 msgr2=0x55c23f92cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:41.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.734+0000 7ffaf7ecf740 1 --2- 172.21.15.7:0/3030264418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c23f92c9a0 0x55c23f92cda0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ffae40137f0 tx=0x7ffae40097a0 comp rx=0 tx=0).stop 2024-09-19T04:25:41.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.734+0000 7ffaf7ecf740 1 -- 172.21.15.7:0/3030264418 shutdown_connections 2024-09-19T04:25:41.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.734+0000 7ffaf7ecf740 1 --2- 172.21.15.7:0/3030264418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c23f932370 0x55c23f934830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.734+0000 7ffaf7ecf740 1 --2- 172.21.15.7:0/3030264418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c23f92d2e0 0x55c23f931da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.734+0000 7ffaf7ecf740 1 --2- 172.21.15.7:0/3030264418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c23f92c9a0 0x55c23f92cda0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.734+0000 7ffaf7ecf740 1 -- 172.21.15.7:0/3030264418 >> 172.21.15.7:0/3030264418 conn(0x55c23f928010 msgr2=0x55c23f928410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.734+0000 7ffaf7ecf740 1 -- 172.21.15.7:0/3030264418 shutdown_connections 2024-09-19T04:25:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.734+0000 7ffaf7ecf740 1 -- 172.21.15.7:0/3030264418 wait complete. 2024-09-19T04:25:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.734+0000 7ffaf7ecf740 1 -- start start 2024-09-19T04:25:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.734+0000 7ffaf7ecf740 1 Processor -- start 2024-09-19T04:25:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.734+0000 7ffaf7ecf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c23f92c9a0 0x55c23f936ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.734+0000 7ffaf7ecf740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c23f92d2e0 0x55c23f937010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.734+0000 7ffaf7ecf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c23f932370 0x55c23f93e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.734+0000 7ffaf7ecf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c23f9352e0 con 0x55c23f92c9a0 2024-09-19T04:25:41.743 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.734+0000 7ffaf7ecf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c23f819290 con 0x55c23f932370 2024-09-19T04:25:41.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.734+0000 7ffaf7ecf740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c23f935460 con 0x55c23f92d2e0 2024-09-19T04:25:41.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.734+0000 7ffaf7ecf740 10 client.0 _ll_register_callbacks cb 0x55c23f84a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:25:41.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.734+0000 7ffaee59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c23f92c9a0 0x55c23f936ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:41.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.734+0000 7ffaee59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c23f92c9a0 0x55c23f936ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58016/0 (socket says 172.21.15.7:58016) 2024-09-19T04:25:41.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.734+0000 7ffaee59c640 1 -- 172.21.15.7:0/3981847580 learned_addr learned my addr 172.21.15.7:0/3981847580 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:41.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.735+0000 7ffaee59c640 1 --2- 172.21.15.7:0/3981847580 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c23f932370 0x55c23f93e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:41.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.735+0000 7ffaeed9d640 1 --2- 172.21.15.7:0/3981847580 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c23f92d2e0 0x55c23f937010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:41.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.735+0000 7ffaee59c640 1 -- 172.21.15.7:0/3981847580 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c23f92d2e0 msgr2=0x55c23f937010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:41.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.735+0000 7ffaee59c640 1 --2- 172.21.15.7:0/3981847580 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c23f92d2e0 0x55c23f937010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:41.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.735+0000 7ffaee59c640 1 -- 172.21.15.7:0/3981847580 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c23f932370 msgr2=0x55c23f93e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:41.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.735+0000 7ffaee59c640 1 --2- 172.21.15.7:0/3981847580 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c23f932370 0x55c23f93e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:41.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.735+0000 7ffaee59c640 1 -- 172.21.15.7:0/3981847580 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c23f5a3210 con 0x55c23f92c9a0 2024-09-19T04:25:41.744 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.735+0000 7ffaee59c640 1 --2- 172.21.15.7:0/3981847580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c23f92c9a0 0x55c23f936ad0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ffae4006010 tx=0x7ffae4009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7deb05dba9f10f00 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:41.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.735+0000 7ffad2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:25:41.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.735+0000 7ffad2ff5640 1 -- 172.21.15.7:0/3981847580 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae4004bd0 con 0x55c23f92c9a0 2024-09-19T04:25:41.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.735+0000 7ffaf7ecf740 1 -- 172.21.15.7:0/3981847580 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffae4005020 con 0x55c23f92c9a0 2024-09-19T04:25:41.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.735+0000 7ffad2ff5640 1 -- 172.21.15.7:0/3981847580 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7ffae4004d70 con 0x55c23f92c9a0 2024-09-19T04:25:41.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.735+0000 7ffad2ff5640 1 -- 172.21.15.7:0/3981847580 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7ffae4030840 con 0x55c23f92c9a0 2024-09-19T04:25:41.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.735+0000 7ffaf7ecf740 10 client.16356 fetch_fsmap learned FSMap version 43 2024-09-19T04:25:41.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.735+0000 7ffaf7ecf740 1 -- 172.21.15.7:0/3981847580 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55c23f66f620 con 0x55c23f92c9a0 2024-09-19T04:25:41.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.736+0000 7ffad2ff5640 1 -- 172.21.15.7:0/3981847580 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffae4005020 con 0x55c23f92c9a0 2024-09-19T04:25:41.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.736+0000 7ffad2ff5640 1 -- 172.21.15.7:0/3981847580 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7ffae4011c60 con 0x55c23f92c9a0 2024-09-19T04:25:41.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.736+0000 7ffaf7ecf740 10 client.16356 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T04:25:41.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.736+0000 7ffaf7ecf740 10 client.16356 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:25:41.745 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.736+0000 7ffaf7ecf740 20 client.16356 populate_metadata read hostname 'smithi007' 2024-09-19T04:25:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.736+0000 7ffaf7ecf740 1 --2- 172.21.15.7:0/3981847580 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55c23f942540 0x55c23f944950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.736+0000 7ffaf7ecf740 4 client.16356 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:25:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.736+0000 7ffaf7ecf740 1 -- 172.21.15.7:0/3981847580 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c23f89da20 con 0x55c23f942540 2024-09-19T04:25:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.736+0000 7ffaeed9d640 1 --2- 172.21.15.7:0/3981847580 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55c23f942540 0x55c23f944950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.736+0000 7ffad2ff5640 10 client.16356 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:25:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.736+0000 7ffaeed9d640 1 --2- 172.21.15.7:0/3981847580 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55c23f942540 0x55c23f944950 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1c93cc7fe494114 server_cookie=9da478f0bb70b5e9 in_seq=0 out_seq=0 2024-09-19T04:25:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.737+0000 7ffad2ff5640 1 -- 172.21.15.7:0/3981847580 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c23f89da20 con 0x55c23f942540 2024-09-19T04:25:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.737+0000 7ffad2ff5640 10 client.16356 handle_command_reply: tid=0 2024-09-19T04:25:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.737+0000 7ffaf7ecf740 1 client.16356 shutdown 2024-09-19T04:25:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.737+0000 7ffaf7ecf740 1 -- 172.21.15.7:0/3981847580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c23f92c9a0 msgr2=0x55c23f936ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.737+0000 7ffaf7ecf740 1 --2- 172.21.15.7:0/3981847580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c23f92c9a0 0x55c23f936ad0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ffae4006010 tx=0x7ffae4009f00 comp rx=0 tx=0).stop 2024-09-19T04:25:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.737+0000 7ffaf7ecf740 1 -- 172.21.15.7:0/3981847580 shutdown_connections 2024-09-19T04:25:41.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.737+0000 7ffaf7ecf740 1 --2- 172.21.15.7:0/3981847580 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55c23f942540 0x55c23f944950 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.737+0000 7ffaf7ecf740 1 --2- 172.21.15.7:0/3981847580 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c23f932370 0x55c23f93e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.737+0000 7ffaf7ecf740 1 --2- 172.21.15.7:0/3981847580 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c23f92d2e0 0x55c23f937010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.737+0000 7ffaf7ecf740 1 --2- 172.21.15.7:0/3981847580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c23f92c9a0 0x55c23f936ad0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.737+0000 7ffad2ff5640 0 client.16356 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:25:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.737+0000 7ffaf7ecf740 1 -- 172.21.15.7:0/3981847580 >> 172.21.15.7:0/3981847580 conn(0x55c23f928010 msgr2=0x55c23f929820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.737+0000 7ffaf7ecf740 1 -- 172.21.15.7:0/3981847580 shutdown_connections 2024-09-19T04:25:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.737+0000 7ffaf7ecf740 1 -- 172.21.15.7:0/3981847580 wait complete. 2024-09-19T04:25:41.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.737+0000 7ffaf7ecf740 20 client.16356 trim_cache size 0 max 16384 2024-09-19T04:25:41.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.752+0000 7ffaf7ecf740 1 Processor -- start 2024-09-19T04:25:41.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.752+0000 7ffaf7ecf740 1 -- start start 2024-09-19T04:25:41.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.752+0000 7ffaf7ecf740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c23f92c9a0 0x55c23f936f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.752+0000 7ffaf7ecf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c23f92d2e0 0x55c23f93e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.752+0000 7ffaf7ecf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c23f932370 0x55c23f928f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.752+0000 7ffaf7ecf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf01aa9e0 con 0x55c23f92d2e0 2024-09-19T04:25:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.752+0000 7ffaf7ecf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf01ac5e0 con 0x55c23f932370 2024-09-19T04:25:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.752+0000 7ffaf7ecf740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf01ab0e0 con 0x55c23f92c9a0 2024-09-19T04:25:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.752+0000 7ffaeed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c23f92d2e0 0x55c23f93e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.752+0000 7ffaeed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c23f92d2e0 0x55c23f93e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58028/0 (socket says 172.21.15.7:58028) 2024-09-19T04:25:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.752+0000 7ffaeed9d640 1 -- 172.21.15.7:0/3377070019 learned_addr learned my addr 172.21.15.7:0/3377070019 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.752+0000 7ffaee59c640 1 --2- 172.21.15.7:0/3377070019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c23f932370 0x55c23f928f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.752+0000 7ffaee59c640 1 --2- 172.21.15.7:0/3377070019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c23f92c9a0 0x55c23f936f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.752+0000 7ffaeed9d640 1 -- 172.21.15.7:0/3377070019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c23f92c9a0 msgr2=0x55c23f936f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:41.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.752+0000 7ffaeed9d640 1 --2- 172.21.15.7:0/3377070019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c23f92c9a0 0x55c23f936f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:41.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.752+0000 7ffaeed9d640 1 -- 172.21.15.7:0/3377070019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c23f932370 msgr2=0x55c23f928f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:41.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.752+0000 7ffaeed9d640 1 --2- 172.21.15.7:0/3377070019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c23f932370 0x55c23f928f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:41.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.752+0000 7ffaeed9d640 1 -- 172.21.15.7:0/3377070019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c23f9355b0 con 0x55c23f92d2e0 2024-09-19T04:25:41.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.752+0000 7ffaee59c640 1 --2- 172.21.15.7:0/3377070019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c23f932370 0x55c23f928f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:25:41.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.753+0000 7ffaeed9d640 1 --2- 172.21.15.7:0/3377070019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c23f92d2e0 0x55c23f93e010 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ffae0031610 tx=0x7ffae0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a781d385dd76c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:41.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.753+0000 7ffad4ff9640 1 -- 172.21.15.7:0/3377070019 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae0035040 con 0x55c23f92d2e0 2024-09-19T04:25:41.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.753+0000 7ffad4ff9640 1 -- 172.21.15.7:0/3377070019 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffae00044d0 con 0x55c23f92d2e0 2024-09-19T04:25:41.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.753+0000 7ffad4ff9640 1 -- 172.21.15.7:0/3377070019 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae00035f0 con 0x55c23f92d2e0 2024-09-19T04:25:41.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.753+0000 7ffaf7ecf740 1 -- 172.21.15.7:0/3377070019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c23f92d2e0 msgr2=0x55c23f93e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:41.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.753+0000 7ffaf7ecf740 1 --2- 172.21.15.7:0/3377070019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c23f92d2e0 0x55c23f93e010 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ffae0031610 tx=0x7ffae0005fd0 comp rx=0 tx=0).stop 2024-09-19T04:25:41.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.753+0000 7ffaf7ecf740 1 -- 172.21.15.7:0/3377070019 shutdown_connections 2024-09-19T04:25:41.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.753+0000 7ffaf7ecf740 1 --2- 172.21.15.7:0/3377070019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c23f932370 0x55c23f928f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:41.759 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.753+0000 7ffaf7ecf740 1 --2- 172.21.15.7:0/3377070019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c23f92d2e0 0x55c23f93e010 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.753+0000 7ffaf7ecf740 1 --2- 172.21.15.7:0/3377070019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c23f92c9a0 0x55c23f936f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.753+0000 7ffaf7ecf740 1 -- 172.21.15.7:0/3377070019 >> 172.21.15.7:0/3377070019 conn(0x55c23f928010 msgr2=0x55c23f936880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.753+0000 7ffaf7ecf740 1 -- 172.21.15.7:0/3377070019 shutdown_connections 2024-09-19T04:25:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.753+0000 7ffaf7ecf740 1 -- 172.21.15.7:0/3377070019 wait complete. 2024-09-19T04:25:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.754+0000 7ffaf7ecf740 1 -- start start 2024-09-19T04:25:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.754+0000 7ffaf7ecf740 1 Processor -- start 2024-09-19T04:25:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.754+0000 7ffaf7ecf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c23f92c9a0 0x55c23f93b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.754+0000 7ffaf7ecf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c23f92d2e0 0x55c23f93bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.754+0000 7ffaf7ecf740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c23f932370 0x55c23f93cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.754+0000 7ffaf7ecf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf01abee0 con 0x55c23f92d2e0 2024-09-19T04:25:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.754+0000 7ffaf7ecf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf01ab7e0 con 0x55c23f92c9a0 2024-09-19T04:25:41.760 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.754+0000 7ffaf7ecf740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf01a89a0 con 0x55c23f932370 2024-09-19T04:25:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.754+0000 7ffaf7ecf740 10 client.0 _ll_register_callbacks cb 0x7ffae0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:25:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.754+0000 7ffaeed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c23f92d2e0 0x55c23f93bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.754+0000 7ffaeed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c23f92d2e0 0x55c23f93bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58034/0 (socket says 172.21.15.7:58034) 2024-09-19T04:25:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.754+0000 7ffaeed9d640 1 -- 172.21.15.7:0/961218297 learned_addr learned my addr 172.21.15.7:0/961218297 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.754+0000 7ffaee59c640 1 --2- 172.21.15.7:0/961218297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c23f92c9a0 0x55c23f93b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.754+0000 7ffaee59c640 1 --2- 172.21.15.7:0/961218297 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c23f932370 0x55c23f93cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.754+0000 7ffaeed9d640 1 -- 172.21.15.7:0/961218297 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c23f932370 msgr2=0x55c23f93cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.754+0000 7ffaeed9d640 1 --2- 172.21.15.7:0/961218297 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c23f932370 0x55c23f93cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.754+0000 7ffaeed9d640 1 -- 172.21.15.7:0/961218297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c23f92c9a0 msgr2=0x55c23f93b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.754+0000 7ffaeed9d640 1 --2- 172.21.15.7:0/961218297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c23f92c9a0 0x55c23f93b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.754+0000 7ffaeed9d640 1 -- 172.21.15.7:0/961218297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c23f93d210 con 0x55c23f92d2e0 2024-09-19T04:25:41.761 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.754+0000 7ffaee59c640 1 --2- 172.21.15.7:0/961218297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c23f92c9a0 0x55c23f93b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:25:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.755+0000 7ffaeed9d640 1 --2- 172.21.15.7:0/961218297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c23f92d2e0 0x55c23f93bc40 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ffae002a450 tx=0x7ffae00042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=340515b423941ab0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.755+0000 7ffad2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:25:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.755+0000 7ffad2ff5640 1 -- 172.21.15.7:0/961218297 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae0053030 con 0x55c23f92d2e0 2024-09-19T04:25:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.755+0000 7ffad2ff5640 1 -- 172.21.15.7:0/961218297 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7ffae00035f0 con 0x55c23f92d2e0 2024-09-19T04:25:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.755+0000 7ffaf7ecf740 1 -- 172.21.15.7:0/961218297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffae00044d0 con 0x55c23f92d2e0 2024-09-19T04:25:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.755+0000 7ffad2ff5640 1 -- 172.21.15.7:0/961218297 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7ffae0060050 con 0x55c23f92d2e0 2024-09-19T04:25:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.755+0000 7ffaf7ecf740 10 client.16362 fetch_fsmap learned FSMap version 43 2024-09-19T04:25:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.755+0000 7ffaf7ecf740 1 -- 172.21.15.7:0/961218297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55c23f9ad1f0 con 0x55c23f92d2e0 2024-09-19T04:25:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.755+0000 7ffad2ff5640 1 -- 172.21.15.7:0/961218297 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffae00044d0 con 0x55c23f92d2e0 2024-09-19T04:25:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.755+0000 7ffad2ff5640 1 -- 172.21.15.7:0/961218297 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7ffae0005140 con 0x55c23f92d2e0 2024-09-19T04:25:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.755+0000 7ffaf7ecf740 10 client.16362 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T04:25:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.755+0000 7ffaf7ecf740 10 client.16362 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:25:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.755+0000 7ffaf7ecf740 20 client.16362 populate_metadata read hostname 'smithi007' 2024-09-19T04:25:41.762 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.755+0000 7ffaf7ecf740 1 --2- 172.21.15.7:0/961218297 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55c23f9ada80 0x55c23f9afea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:41.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.755+0000 7ffaf7ecf740 4 client.16362 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:25:41.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.755+0000 7ffaf7ecf740 1 -- 172.21.15.7:0/961218297 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c23f897d70 con 0x55c23f9ada80 2024-09-19T04:25:41.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.756+0000 7ffaee59c640 1 --2- 172.21.15.7:0/961218297 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55c23f9ada80 0x55c23f9afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:41.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.756+0000 7ffad2ff5640 10 client.16362 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:25:41.763 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:41.756+0000 7ffaee59c640 1 --2- 172.21.15.7:0/961218297 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55c23f9ada80 0x55c23f9afea0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a967eec32751962 server_cookie=bf93ddf80b572509 in_seq=0 out_seq=0 2024-09-19T04:25:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:42.533+0000 7ffad2ff5640 1 -- 172.21.15.7:0/961218297 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c23f897d70 con 0x55c23f9ada80 2024-09-19T04:25:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:42.533+0000 7ffad2ff5640 10 client.16362 handle_command_reply: tid=0 2024-09-19T04:25:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:42.533+0000 7ffaf7ecf740 1 client.16362 shutdown 2024-09-19T04:25:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:42.533+0000 7ffaf7ecf740 1 -- 172.21.15.7:0/961218297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c23f92d2e0 msgr2=0x55c23f93bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:42.533+0000 7ffaf7ecf740 1 --2- 172.21.15.7:0/961218297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c23f92d2e0 0x55c23f93bc40 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ffae002a450 tx=0x7ffae00042d0 comp rx=0 tx=0).stop 2024-09-19T04:25:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:42.534+0000 7ffaf7ecf740 1 -- 172.21.15.7:0/961218297 shutdown_connections 2024-09-19T04:25:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:42.534+0000 7ffaf7ecf740 1 --2- 172.21.15.7:0/961218297 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55c23f9ada80 0x55c23f9afea0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:42.534+0000 7ffaf7ecf740 1 --2- 172.21.15.7:0/961218297 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c23f932370 0x55c23f93cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:42.534+0000 7ffaf7ecf740 1 --2- 172.21.15.7:0/961218297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c23f92d2e0 0x55c23f93bc40 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:42.534+0000 7ffaf7ecf740 1 --2- 172.21.15.7:0/961218297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c23f92c9a0 0x55c23f93b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:42.534+0000 7ffad2ff5640 0 client.16362 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:25:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:42.534+0000 7ffaf7ecf740 1 -- 172.21.15.7:0/961218297 >> 172.21.15.7:0/961218297 conn(0x55c23f928010 msgr2=0x55c23f9269a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:42.534+0000 7ffaf7ecf740 1 -- 172.21.15.7:0/961218297 shutdown_connections 2024-09-19T04:25:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:42.534+0000 7ffaf7ecf740 1 -- 172.21.15.7:0/961218297 wait complete. 2024-09-19T04:25:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:42.534+0000 7ffaf7ecf740 20 client.16362 trim_cache size 0 max 16384 2024-09-19T04:25:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:25:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:25:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:25:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:25:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:42.535+0000 7ffaf5131640 1 -- 172.21.15.7:0/3880281843 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffad80a3240 msgr2=0x7ffad80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:42.535+0000 7ffaf5131640 1 --2- 172.21.15.7:0/3880281843 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffad80a3240 0x7ffad80a5700 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ffae809b4e0 tx=0x7ffae8004a40 comp rx=0 tx=0).stop 2024-09-19T04:25:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:42.535+0000 7ffaf5131640 1 -- 172.21.15.7:0/3880281843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffaf01025f0 msgr2=0x7ffaf019f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:42.535+0000 7ffaf5131640 1 --2- 172.21.15.7:0/3880281843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffaf01025f0 0x7ffaf019f4f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ffae800b970 tx=0x7ffae800be30 comp rx=0 tx=0).stop 2024-09-19T04:25:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:42.535+0000 7ffaf5131640 1 -- 172.21.15.7:0/3880281843 shutdown_connections 2024-09-19T04:25:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:42.535+0000 7ffaf5131640 1 --2- 172.21.15.7:0/3880281843 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffad80a3240 0x7ffad80a5700 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:42.535+0000 7ffaf5131640 1 --2- 172.21.15.7:0/3880281843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffaf01025f0 0x7ffaf019f4f0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:42.535+0000 7ffaf5131640 1 --2- 172.21.15.7:0/3880281843 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffaf0101c30 0x7ffaf0198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:42.535+0000 7ffaf5131640 1 --2- 172.21.15.7:0/3880281843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffaf0100a40 0x7ffaf0197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:42.535+0000 7ffaf5131640 1 -- 172.21.15.7:0/3880281843 >> 172.21.15.7:0/3880281843 conn(0x7ffaf00fc1c0 msgr2=0x7ffaf0069ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:42.535+0000 7ffaf5131640 1 -- 172.21.15.7:0/3880281843 shutdown_connections 2024-09-19T04:25:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:42.535+0000 7ffaf5131640 1 -- 172.21.15.7:0/3880281843 wait complete. 2024-09-19T04:25:43.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:43 smithi092 ceph-mon[34940]: pgmap v618: 129 pgs: 129 active+clean; 288 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 641 op/s 2024-09-19T04:25:43.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:43 smithi007 ceph-mon[31360]: pgmap v618: 129 pgs: 129 active+clean; 288 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 641 op/s 2024-09-19T04:25:43.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:43 smithi102 ceph-mon[35446]: pgmap v618: 129 pgs: 129 active+clean; 288 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 641 op/s 2024-09-19T04:25:45.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:45 smithi092 ceph-mon[34940]: pgmap v619: 129 pgs: 129 active+clean; 270 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 769 op/s 2024-09-19T04:25:45.626 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:45 smithi007 ceph-mon[31360]: pgmap v619: 129 pgs: 129 active+clean; 270 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 769 op/s 2024-09-19T04:25:45.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:45 smithi102 ceph-mon[35446]: pgmap v619: 129 pgs: 129 active+clean; 270 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 769 op/s 2024-09-19T04:25:47.547 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:47 smithi092 ceph-mon[34940]: pgmap v620: 129 pgs: 129 active+clean; 249 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 734 op/s 2024-09-19T04:25:47.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:47 smithi007 ceph-mon[31360]: pgmap v620: 129 pgs: 129 active+clean; 249 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 734 op/s 2024-09-19T04:25:47.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:47 smithi102 ceph-mon[35446]: pgmap v620: 129 pgs: 129 active+clean; 249 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 734 op/s 2024-09-19T04:25:48.546 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:48 smithi092 ceph-mon[34940]: pgmap v621: 129 pgs: 129 active+clean; 247 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 628 op/s 2024-09-19T04:25:48.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:48 smithi007 ceph-mon[31360]: pgmap v621: 129 pgs: 129 active+clean; 247 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 628 op/s 2024-09-19T04:25:48.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:48 smithi102 ceph-mon[35446]: pgmap v621: 129 pgs: 129 active+clean; 247 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 628 op/s 2024-09-19T04:25:50.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:50 smithi092 ceph-mon[34940]: pgmap v622: 129 pgs: 129 active+clean; 230 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 827 op/s 2024-09-19T04:25:50.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:50 smithi007 ceph-mon[31360]: pgmap v622: 129 pgs: 129 active+clean; 230 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 827 op/s 2024-09-19T04:25:50.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:50 smithi102 ceph-mon[35446]: pgmap v622: 129 pgs: 129 active+clean; 230 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 827 op/s 2024-09-19T04:25:52.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:52 smithi092 ceph-mon[34940]: pgmap v623: 129 pgs: 129 active+clean; 226 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 593 op/s 2024-09-19T04:25:52.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:52 smithi007 ceph-mon[31360]: pgmap v623: 129 pgs: 129 active+clean; 226 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 593 op/s 2024-09-19T04:25:52.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:52 smithi102 ceph-mon[35446]: pgmap v623: 129 pgs: 129 active+clean; 226 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 593 op/s 2024-09-19T04:25:54.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:54 smithi092 ceph-mon[34940]: pgmap v624: 129 pgs: 129 active+clean; 220 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 709 op/s 2024-09-19T04:25:54.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:54 smithi007 ceph-mon[31360]: pgmap v624: 129 pgs: 129 active+clean; 220 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 709 op/s 2024-09-19T04:25:54.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:54 smithi102 ceph-mon[35446]: pgmap v624: 129 pgs: 129 active+clean; 220 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 709 op/s 2024-09-19T04:25:55.681 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.679+0000 7f99721a6640 1 -- 172.21.15.7:0/3144901229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f996c1001b0 msgr2=0x7f996c1005b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:55.681 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.679+0000 7f99721a6640 1 --2- 172.21.15.7:0/3144901229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f996c1001b0 0x7f996c1005b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f995400a970 tx=0x7f995402b670 comp rx=0 tx=0).stop 2024-09-19T04:25:55.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.680+0000 7f99721a6640 1 -- 172.21.15.7:0/3144901229 shutdown_connections 2024-09-19T04:25:55.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.680+0000 7f99721a6640 1 --2- 172.21.15.7:0/3144901229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f996c101d60 0x7f996c1085f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:55.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.680+0000 7f99721a6640 1 --2- 172.21.15.7:0/3144901229 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f996c1013a0 0x7f996c101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:55.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.680+0000 7f99721a6640 1 --2- 172.21.15.7:0/3144901229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f996c1001b0 0x7f996c1005b0 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f995400a970 tx=0x7f995402b670 comp rx=0 tx=0).stop 2024-09-19T04:25:55.682 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.680+0000 7f99721a6640 1 -- 172.21.15.7:0/3144901229 >> 172.21.15.7:0/3144901229 conn(0x7f996c0fb930 msgr2=0x7f996c0fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.682+0000 7f99721a6640 1 -- 172.21.15.7:0/3144901229 shutdown_connections 2024-09-19T04:25:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.683+0000 7f99721a6640 1 -- 172.21.15.7:0/3144901229 wait complete. 2024-09-19T04:25:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.684+0000 7f99721a6640 1 Processor -- start 2024-09-19T04:25:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.684+0000 7f99721a6640 1 -- start start 2024-09-19T04:25:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.684+0000 7f99721a6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f996c1013a0 0x7f996c070e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.684+0000 7f99721a6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f996c101d60 0x7f996c071340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.685+0000 7f99721a6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f996c1ac4e0 0x7f996c1ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.685+0000 7f99721a6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f996c10b5f0 con 0x7f996c101d60 2024-09-19T04:25:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.685+0000 7f99721a6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f996c10b470 con 0x7f996c1013a0 2024-09-19T04:25:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.685+0000 7f99721a6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f996c10b770 con 0x7f996c1ac4e0 2024-09-19T04:25:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.685+0000 7f996b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f996c1013a0 0x7f996c070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.685+0000 7f996b7fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f996c1013a0 0x7f996c070e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:49270/0 (socket says 172.21.15.7:49270) 2024-09-19T04:25:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.685+0000 7f996b7fe640 1 -- 172.21.15.7:0/2407036517 learned_addr learned my addr 172.21.15.7:0/2407036517 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.685+0000 7f996affd640 1 --2- 172.21.15.7:0/2407036517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f996c101d60 0x7f996c071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.685+0000 7f996b7fe640 1 -- 172.21.15.7:0/2407036517 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f996c1ac4e0 msgr2=0x7f996c1ae8d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T04:25:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.685+0000 7f996b7fe640 1 --2- 172.21.15.7:0/2407036517 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f996c1ac4e0 0x7f996c1ae8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.686+0000 7f996b7fe640 1 -- 172.21.15.7:0/2407036517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f996c101d60 msgr2=0x7f996c071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.686+0000 7f996b7fe640 1 --2- 172.21.15.7:0/2407036517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f996c101d60 0x7f996c071340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.686+0000 7f996b7fe640 1 -- 172.21.15.7:0/2407036517 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f996c1aeec0 con 0x7f996c1013a0 2024-09-19T04:25:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.686+0000 7f996b7fe640 1 --2- 172.21.15.7:0/2407036517 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f996c1013a0 0x7f996c070e00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9954000c00 tx=0x7f99540052f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.686+0000 7f9968ff9640 1 -- 172.21.15.7:0/2407036517 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9954005c90 con 0x7f996c1013a0 2024-09-19T04:25:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.686+0000 7f9968ff9640 1 -- 172.21.15.7:0/2407036517 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99540309f0 con 0x7f996c1013a0 2024-09-19T04:25:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.686+0000 7f9968ff9640 1 -- 172.21.15.7:0/2407036517 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9954004bc0 con 0x7f996c1013a0 2024-09-19T04:25:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.687+0000 7f99721a6640 1 -- 172.21.15.7:0/2407036517 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f996c1af150 con 0x7f996c1013a0 2024-09-19T04:25:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.687+0000 7f99721a6640 1 -- 172.21.15.7:0/2407036517 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f996c1af5f0 con 0x7f996c1013a0 2024-09-19T04:25:55.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.692+0000 7f9975021740 1 Processor -- start 2024-09-19T04:25:55.694 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.692+0000 7f9975021740 1 -- start start 2024-09-19T04:25:55.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.694+0000 7f9975021740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557feb8b79e0 0x557feb8b7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:55.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.694+0000 7f9975021740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557feb8b8320 0x557feb8bcde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:55.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.694+0000 7f9975021740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557feb8bd3b0 0x557feb8bf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:55.696 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.695+0000 7f9975021740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557feb81b2f0 con 0x557feb8b8320 2024-09-19T04:25:55.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.695+0000 7f9975021740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557feb7c3270 con 0x557feb8b79e0 2024-09-19T04:25:55.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.695+0000 7f9975021740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557feb8172b0 con 0x557feb8bd3b0 2024-09-19T04:25:55.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.695+0000 7f996affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557feb8bd3b0 0x557feb8bf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:55.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.695+0000 7f996affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557feb8bd3b0 0x557feb8bf870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:46462/0 (socket says 172.21.15.7:46462) 2024-09-19T04:25:55.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.695+0000 7f996affd640 1 -- 172.21.15.7:0/775774821 learned_addr learned my addr 172.21.15.7:0/775774821 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:55.697 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.696+0000 7f996bfff640 1 --2- 172.21.15.7:0/775774821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557feb8b79e0 0x557feb8b7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:55.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.696+0000 7f996affd640 1 -- 172.21.15.7:0/775774821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557feb8b79e0 msgr2=0x557feb8b7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:55.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.696+0000 7f996affd640 1 --2- 172.21.15.7:0/775774821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557feb8b79e0 0x557feb8b7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:55.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.696+0000 7f996affd640 1 -- 172.21.15.7:0/775774821 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557feb8b8320 msgr2=0x557feb8bcde0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T04:25:55.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.696+0000 7f996affd640 1 --2- 172.21.15.7:0/775774821 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557feb8b8320 0x557feb8bcde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:55.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.696+0000 7f996affd640 1 -- 172.21.15.7:0/775774821 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557feb7c2340 con 0x557feb8bd3b0 2024-09-19T04:25:55.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.697+0000 7f996affd640 1 --2- 172.21.15.7:0/775774821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557feb8bd3b0 0x557feb8bf870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f995c009c60 tx=0x7f995c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29cd8baac3e34cf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:55.698 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.697+0000 7f9968ff9640 1 -- 172.21.15.7:0/2407036517 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f99540035f0 con 0x7f996c1013a0 2024-09-19T04:25:55.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.697+0000 7f9961ffb640 1 -- 172.21.15.7:0/775774821 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c004230 con 0x557feb8bd3b0 2024-09-19T04:25:55.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.697+0000 7f9961ffb640 1 -- 172.21.15.7:0/775774821 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f995c0043d0 con 0x557feb8bd3b0 2024-09-19T04:25:55.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.697+0000 7f9961ffb640 1 -- 172.21.15.7:0/775774821 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c004db0 con 0x557feb8bd3b0 2024-09-19T04:25:55.699 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.698+0000 7f9968ff9640 1 --2- 172.21.15.7:0/2407036517 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f99580a3400 0x7f99580a58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:55.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.698+0000 7f9968ff9640 1 -- 172.21.15.7:0/2407036517 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f99540f0e90 con 0x7f996c1013a0 2024-09-19T04:25:55.700 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.698+0000 7f996bfff640 1 --2- 172.21.15.7:0/2407036517 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f99580a3400 0x7f99580a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.699+0000 7f9975021740 1 -- 172.21.15.7:0/775774821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557feb8bd3b0 msgr2=0x557feb8bf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.699+0000 7f9975021740 1 --2- 172.21.15.7:0/775774821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557feb8bd3b0 0x557feb8bf870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f995c009c60 tx=0x7f995c011810 comp rx=0 tx=0).stop 2024-09-19T04:25:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.699+0000 7f996bfff640 1 --2- 172.21.15.7:0/2407036517 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f99580a3400 0x7f99580a58c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9964005fd0 tx=0x7f9964009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.699+0000 7f9975021740 1 -- 172.21.15.7:0/775774821 shutdown_connections 2024-09-19T04:25:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.699+0000 7f9975021740 1 --2- 172.21.15.7:0/775774821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557feb8bd3b0 0x557feb8bf870 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.699+0000 7f9975021740 1 --2- 172.21.15.7:0/775774821 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557feb8b8320 0x557feb8bcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.699+0000 7f9975021740 1 --2- 172.21.15.7:0/775774821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557feb8b79e0 0x557feb8b7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.699+0000 7f9975021740 1 -- 172.21.15.7:0/775774821 >> 172.21.15.7:0/775774821 conn(0x557feb8b3050 msgr2=0x557feb8b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.700+0000 7f9975021740 1 -- 172.21.15.7:0/775774821 shutdown_connections 2024-09-19T04:25:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.700+0000 7f9975021740 1 -- 172.21.15.7:0/775774821 wait complete. 2024-09-19T04:25:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.700+0000 7f9975021740 1 -- start start 2024-09-19T04:25:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.700+0000 7f9975021740 1 Processor -- start 2024-09-19T04:25:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.701+0000 7f9975021740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557feb8b79e0 0x557feb8c1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.701+0000 7f9975021740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557feb8b8320 0x557feb8c2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.701+0000 7f9975021740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557feb8c7480 0x557feb8c9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.701+0000 7f9975021740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557feb8c0380 con 0x557feb8b8320 2024-09-19T04:25:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.701+0000 7f9975021740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557feb7a4290 con 0x557feb8b79e0 2024-09-19T04:25:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.701+0000 7f9975021740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557feb8c0500 con 0x557feb8c7480 2024-09-19T04:25:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.701+0000 7f9975021740 10 client.0 _ll_register_callbacks cb 0x557feb7d5140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:25:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.701+0000 7f996bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557feb8c7480 0x557feb8c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.701+0000 7f996bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557feb8c7480 0x557feb8c9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:46468/0 (socket says 172.21.15.7:46468) 2024-09-19T04:25:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.701+0000 7f996bfff640 1 -- 172.21.15.7:0/2755784113 learned_addr learned my addr 172.21.15.7:0/2755784113 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.702+0000 7f996b7fe640 1 --2- 172.21.15.7:0/2755784113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557feb8b79e0 0x557feb8c1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.702+0000 7f996affd640 1 --2- 172.21.15.7:0/2755784113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557feb8b8320 0x557feb8c2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.703+0000 7f996affd640 1 -- 172.21.15.7:0/2755784113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557feb8c7480 msgr2=0x557feb8c9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.703+0000 7f996affd640 1 --2- 172.21.15.7:0/2755784113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557feb8c7480 0x557feb8c9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.703+0000 7f996affd640 1 -- 172.21.15.7:0/2755784113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557feb8b79e0 msgr2=0x557feb8c1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.703+0000 7f996affd640 1 --2- 172.21.15.7:0/2755784113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557feb8b79e0 0x557feb8c1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.703+0000 7f996affd640 1 -- 172.21.15.7:0/2755784113 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557feb52e210 con 0x557feb8b8320 2024-09-19T04:25:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.703+0000 7f996affd640 1 --2- 172.21.15.7:0/2755784113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557feb8b8320 0x557feb8c2450 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f995c004000 tx=0x7f995c003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b15c9f09aa6760 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.703+0000 7f994affd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:25:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.704+0000 7f994affd640 1 -- 172.21.15.7:0/2755784113 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c028020 con 0x557feb8b8320 2024-09-19T04:25:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.704+0000 7f994affd640 1 -- 172.21.15.7:0/2755784113 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f995c003da0 con 0x557feb8b8320 2024-09-19T04:25:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.704+0000 7f9975021740 1 -- 172.21.15.7:0/2755784113 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f995c0043d0 con 0x557feb8b8320 2024-09-19T04:25:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.704+0000 7f994affd640 1 -- 172.21.15.7:0/2755784113 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f995c009850 con 0x557feb8b8320 2024-09-19T04:25:55.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.705+0000 7f9975021740 10 client.16371 fetch_fsmap learned FSMap version 43 2024-09-19T04:25:55.708 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.705+0000 7f9975021740 1 -- 172.21.15.7:0/2755784113 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x557feb5fa620 con 0x557feb8b8320 2024-09-19T04:25:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.709+0000 7f994affd640 1 -- 172.21.15.7:0/2755784113 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f995c0043d0 con 0x557feb8b8320 2024-09-19T04:25:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.710+0000 7f994affd640 1 -- 172.21.15.7:0/2755784113 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7f995c018070 con 0x557feb8b8320 2024-09-19T04:25:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.710+0000 7f9975021740 10 client.16371 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T04:25:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.710+0000 7f9975021740 10 client.16371 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:25:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.710+0000 7f9975021740 20 client.16371 populate_metadata read hostname 'smithi007' 2024-09-19T04:25:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.710+0000 7f9975021740 1 --2- 172.21.15.7:0/2755784113 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557feb8df190 0x557feb8e15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.710+0000 7f9975021740 4 client.16371 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:25:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.710+0000 7f9975021740 1 -- 172.21.15.7:0/2755784113 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557feb828a20 con 0x557feb8df190 2024-09-19T04:25:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.711+0000 7f996b7fe640 1 --2- 172.21.15.7:0/2755784113 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557feb8df190 0x557feb8e15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:55.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.711+0000 7f996b7fe640 1 --2- 172.21.15.7:0/2755784113 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557feb8df190 0x557feb8e15a0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7460001fc3d228de server_cookie=2dbe1fa08324f81d in_seq=0 out_seq=0 2024-09-19T04:25:55.713 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.711+0000 7f994affd640 10 client.16371 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:25:55.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.713+0000 7f994affd640 1 -- 172.21.15.7:0/2755784113 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557feb828a20 con 0x557feb8df190 2024-09-19T04:25:55.714 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.713+0000 7f994affd640 10 client.16371 handle_command_reply: tid=0 2024-09-19T04:25:55.715 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.713+0000 7f9975021740 1 client.16371 shutdown 2024-09-19T04:25:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.714+0000 7f9975021740 1 -- 172.21.15.7:0/2755784113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557feb8b8320 msgr2=0x557feb8c2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.714+0000 7f9975021740 1 --2- 172.21.15.7:0/2755784113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557feb8b8320 0x557feb8c2450 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f995c004000 tx=0x7f995c003820 comp rx=0 tx=0).stop 2024-09-19T04:25:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.716+0000 7f9975021740 1 -- 172.21.15.7:0/2755784113 shutdown_connections 2024-09-19T04:25:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.716+0000 7f9975021740 1 --2- 172.21.15.7:0/2755784113 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557feb8df190 0x557feb8e15a0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.716+0000 7f9975021740 1 --2- 172.21.15.7:0/2755784113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557feb8c7480 0x557feb8c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.716+0000 7f9975021740 1 --2- 172.21.15.7:0/2755784113 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557feb8b8320 0x557feb8c2450 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:55.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.716+0000 7f9975021740 1 --2- 172.21.15.7:0/2755784113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557feb8b79e0 0x557feb8c1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:55.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.716+0000 7f9975021740 1 -- 172.21.15.7:0/2755784113 >> 172.21.15.7:0/2755784113 conn(0x557feb8b3050 msgr2=0x557feb8b4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:55.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.716+0000 7f994affd640 0 client.16371 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:25:55.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.717+0000 7f9975021740 1 -- 172.21.15.7:0/2755784113 shutdown_connections 2024-09-19T04:25:55.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.717+0000 7f9975021740 1 -- 172.21.15.7:0/2755784113 wait complete. 2024-09-19T04:25:55.719 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.717+0000 7f9975021740 20 client.16371 trim_cache size 0 max 16384 2024-09-19T04:25:55.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.744+0000 7f9975021740 1 Processor -- start 2024-09-19T04:25:55.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.744+0000 7f9975021740 1 -- start start 2024-09-19T04:25:55.746 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.745+0000 7f9975021740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557feb8b79e0 0x557feb8aded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:55.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.745+0000 7f9975021740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557feb8b8320 0x557feb8b9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:55.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.745+0000 7f9975021740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557feb8c7480 0x557feb8b9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:55.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.745+0000 7f9975021740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f996c1b1250 con 0x557feb8b8320 2024-09-19T04:25:55.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.745+0000 7f9975021740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f996c1b2e50 con 0x557feb8c7480 2024-09-19T04:25:55.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.745+0000 7f9975021740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f996c1b1950 con 0x557feb8b79e0 2024-09-19T04:25:55.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.745+0000 7f996b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557feb8b79e0 0x557feb8aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:55.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.745+0000 7f996b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557feb8b79e0 0x557feb8aded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:46484/0 (socket says 172.21.15.7:46484) 2024-09-19T04:25:55.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.745+0000 7f996b7fe640 1 -- 172.21.15.7:0/101502183 learned_addr learned my addr 172.21.15.7:0/101502183 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:55.747 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.745+0000 7f996affd640 1 --2- 172.21.15.7:0/101502183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557feb8b8320 0x557feb8b9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:55.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.746+0000 7f996affd640 1 -- 172.21.15.7:0/101502183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557feb8b79e0 msgr2=0x557feb8aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:55.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.746+0000 7f996affd640 1 --2- 172.21.15.7:0/101502183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557feb8b79e0 0x557feb8aded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:55.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.746+0000 7f996affd640 1 -- 172.21.15.7:0/101502183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557feb8c7480 msgr2=0x557feb8b9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:55.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.746+0000 7f996affd640 1 --2- 172.21.15.7:0/101502183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557feb8c7480 0x557feb8b9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:55.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.746+0000 7f996affd640 1 -- 172.21.15.7:0/101502183 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557feb8b8b70 con 0x557feb8b8320 2024-09-19T04:25:55.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.746+0000 7f996affd640 1 --2- 172.21.15.7:0/101502183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557feb8b8320 0x557feb8b9740 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f995c011d10 tx=0x7f995c005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c420c95f789890 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:55.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.746+0000 7f99617fa640 1 -- 172.21.15.7:0/101502183 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c028040 con 0x557feb8b8320 2024-09-19T04:25:55.748 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.746+0000 7f99617fa640 1 -- 172.21.15.7:0/101502183 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f995c01f040 con 0x557feb8b8320 2024-09-19T04:25:55.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.746+0000 7f99617fa640 1 -- 172.21.15.7:0/101502183 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c0197d0 con 0x557feb8b8320 2024-09-19T04:25:55.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.747+0000 7f9975021740 1 -- 172.21.15.7:0/101502183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557feb8b8320 msgr2=0x557feb8b9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:55.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.747+0000 7f9975021740 1 --2- 172.21.15.7:0/101502183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557feb8b8320 0x557feb8b9740 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f995c011d10 tx=0x7f995c005d30 comp rx=0 tx=0).stop 2024-09-19T04:25:55.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.748+0000 7f9975021740 1 -- 172.21.15.7:0/101502183 shutdown_connections 2024-09-19T04:25:55.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.748+0000 7f9975021740 1 --2- 172.21.15.7:0/101502183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557feb8c7480 0x557feb8b9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:55.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.748+0000 7f9975021740 1 --2- 172.21.15.7:0/101502183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557feb8b8320 0x557feb8b9740 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:55.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.748+0000 7f9975021740 1 --2- 172.21.15.7:0/101502183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557feb8b79e0 0x557feb8aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:55.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.748+0000 7f9975021740 1 -- 172.21.15.7:0/101502183 >> 172.21.15.7:0/101502183 conn(0x557feb8b3050 msgr2=0x557feb8c1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:55.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.749+0000 7f9975021740 1 -- 172.21.15.7:0/101502183 shutdown_connections 2024-09-19T04:25:55.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.749+0000 7f9975021740 1 -- 172.21.15.7:0/101502183 wait complete. 2024-09-19T04:25:55.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.749+0000 7f9975021740 1 -- start start 2024-09-19T04:25:55.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.750+0000 7f9975021740 1 Processor -- start 2024-09-19T04:25:55.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.750+0000 7f9975021740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557feb8b79e0 0x557feb8f00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:55.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.750+0000 7f9975021740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557feb8b8320 0x557feb8f0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:55.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.750+0000 7f9975021740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557feb8c7480 0x557feb947cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.750+0000 7f9975021740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f996c1b2750 con 0x557feb8b8320 2024-09-19T04:25:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.750+0000 7f9975021740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f996c1b2050 con 0x557feb8b79e0 2024-09-19T04:25:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.750+0000 7f9975021740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f996c1a9f60 con 0x557feb8c7480 2024-09-19T04:25:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.750+0000 7f9975021740 10 client.0 _ll_register_callbacks cb 0x7f9964009480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:25:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.750+0000 7f996affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557feb8b8320 0x557feb8f0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.750+0000 7f996affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557feb8b8320 0x557feb8f0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39424/0 (socket says 172.21.15.7:39424) 2024-09-19T04:25:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.750+0000 7f996affd640 1 -- 172.21.15.7:0/1908611151 learned_addr learned my addr 172.21.15.7:0/1908611151 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:25:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.750+0000 7f996b7fe640 1 --2- 172.21.15.7:0/1908611151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557feb8b79e0 0x557feb8f00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.750+0000 7f996bfff640 1 --2- 172.21.15.7:0/1908611151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557feb8c7480 0x557feb947cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.751+0000 7f996affd640 1 -- 172.21.15.7:0/1908611151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557feb8c7480 msgr2=0x557feb947cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.751+0000 7f996affd640 1 --2- 172.21.15.7:0/1908611151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557feb8c7480 0x557feb947cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:55.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.751+0000 7f996affd640 1 -- 172.21.15.7:0/1908611151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557feb8b79e0 msgr2=0x557feb8f00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:25:55.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.751+0000 7f996affd640 1 --2- 172.21.15.7:0/1908611151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557feb8b79e0 0x557feb8f00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:55.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.751+0000 7f996affd640 1 -- 172.21.15.7:0/1908611151 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557feb8f36b0 con 0x557feb8b8320 2024-09-19T04:25:55.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.751+0000 7f996b7fe640 1 --2- 172.21.15.7:0/1908611151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557feb8b79e0 0x557feb8f00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:25:55.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.751+0000 7f996affd640 1 --2- 172.21.15.7:0/1908611151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557feb8b8320 0x557feb8f0610 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f995c003860 tx=0x7f995c0194c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44133c6f85b9934 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:55.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.751+0000 7f994affd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:25:55.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.751+0000 7f994affd640 1 -- 172.21.15.7:0/1908611151 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995c03a070 con 0x557feb8b8320 2024-09-19T04:25:55.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.751+0000 7f994affd640 1 -- 172.21.15.7:0/1908611151 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f995c005040 con 0x557feb8b8320 2024-09-19T04:25:55.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.751+0000 7f9975021740 1 -- 172.21.15.7:0/1908611151 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f995c01f040 con 0x557feb8b8320 2024-09-19T04:25:55.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.752+0000 7f994affd640 1 -- 172.21.15.7:0/1908611151 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f995c009ab0 con 0x557feb8b8320 2024-09-19T04:25:55.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.752+0000 7f9975021740 10 client.16377 fetch_fsmap learned FSMap version 43 2024-09-19T04:25:55.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.752+0000 7f9975021740 1 -- 172.21.15.7:0/1908611151 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x557feb9491a0 con 0x557feb8b8320 2024-09-19T04:25:55.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.752+0000 7f994affd640 1 -- 172.21.15.7:0/1908611151 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f995c01f040 con 0x557feb8b8320 2024-09-19T04:25:55.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.752+0000 7f994affd640 1 -- 172.21.15.7:0/1908611151 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7f995c018070 con 0x557feb8b8320 2024-09-19T04:25:55.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.752+0000 7f9975021740 10 client.16377 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T04:25:55.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.752+0000 7f9975021740 10 client.16377 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:25:55.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.752+0000 7f9975021740 20 client.16377 populate_metadata read hostname 'smithi007' 2024-09-19T04:25:55.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.752+0000 7f9975021740 1 --2- 172.21.15.7:0/1908611151 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557feb949a80 0x557feb94be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:55.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.752+0000 7f9975021740 4 client.16377 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:25:55.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.752+0000 7f9975021740 1 -- 172.21.15.7:0/1908611151 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557feb822d70 con 0x557feb949a80 2024-09-19T04:25:55.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.753+0000 7f996b7fe640 1 --2- 172.21.15.7:0/1908611151 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557feb949a80 0x557feb94be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:55.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.756+0000 7f994affd640 10 client.16377 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:25:55.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:55.756+0000 7f996b7fe640 1 --2- 172.21.15.7:0/1908611151 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557feb949a80 0x557feb94be70 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bf377d2aab40781 server_cookie=d26c0d2e9dfe0345 in_seq=0 out_seq=0 2024-09-19T04:25:56.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:56.225+0000 7f994affd640 1 -- 172.21.15.7:0/1908611151 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557feb822d70 con 0x557feb949a80 2024-09-19T04:25:56.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:56.225+0000 7f994affd640 10 client.16377 handle_command_reply: tid=0 2024-09-19T04:25:56.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:56.225+0000 7f9975021740 1 client.16377 shutdown 2024-09-19T04:25:56.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:56.226+0000 7f9975021740 1 -- 172.21.15.7:0/1908611151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557feb8b8320 msgr2=0x557feb8f0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:56.229 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:56.226+0000 7f9975021740 1 --2- 172.21.15.7:0/1908611151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557feb8b8320 0x557feb8f0610 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f995c003860 tx=0x7f995c0194c0 comp rx=0 tx=0).stop 2024-09-19T04:25:56.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:56.226+0000 7f9975021740 1 -- 172.21.15.7:0/1908611151 shutdown_connections 2024-09-19T04:25:56.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:56.226+0000 7f9975021740 1 --2- 172.21.15.7:0/1908611151 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x557feb949a80 0x557feb94be70 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:56.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:56.226+0000 7f9975021740 1 --2- 172.21.15.7:0/1908611151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557feb8c7480 0x557feb947cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:56.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:56.226+0000 7f9975021740 1 --2- 172.21.15.7:0/1908611151 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557feb8b8320 0x557feb8f0610 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:56.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:56.226+0000 7f994affd640 0 client.16377 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:25:56.230 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:56.226+0000 7f9975021740 1 --2- 172.21.15.7:0/1908611151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557feb8b79e0 0x557feb8f00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:56.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:56.226+0000 7f9975021740 1 -- 172.21.15.7:0/1908611151 >> 172.21.15.7:0/1908611151 conn(0x557feb8b3050 msgr2=0x557feb8b1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:56.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:56.226+0000 7f9975021740 1 -- 172.21.15.7:0/1908611151 shutdown_connections 2024-09-19T04:25:56.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:56.226+0000 7f9975021740 1 -- 172.21.15.7:0/1908611151 wait complete. 2024-09-19T04:25:56.231 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:56.226+0000 7f9975021740 20 client.16377 trim_cache size 0 max 16384 2024-09-19T04:25:56.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:25:56.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:25:56.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:25:56.232 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:25:56.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:56.226+0000 7f99721a6640 1 -- 172.21.15.7:0/2407036517 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f99580a3400 msgr2=0x7f99580a58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:56.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:56.226+0000 7f99721a6640 1 --2- 172.21.15.7:0/2407036517 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f99580a3400 0x7f99580a58c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9964005fd0 tx=0x7f9964009560 comp rx=0 tx=0).stop 2024-09-19T04:25:56.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:56.226+0000 7f99721a6640 1 -- 172.21.15.7:0/2407036517 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f996c1013a0 msgr2=0x7f996c070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:56.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:56.226+0000 7f99721a6640 1 --2- 172.21.15.7:0/2407036517 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f996c1013a0 0x7f996c070e00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9954000c00 tx=0x7f99540052f0 comp rx=0 tx=0).stop 2024-09-19T04:25:56.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:56.227+0000 7f99721a6640 1 -- 172.21.15.7:0/2407036517 shutdown_connections 2024-09-19T04:25:56.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:56.227+0000 7f99721a6640 1 --2- 172.21.15.7:0/2407036517 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f99580a3400 0x7f99580a58c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:56.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:56.227+0000 7f99721a6640 1 --2- 172.21.15.7:0/2407036517 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f996c1ac4e0 0x7f996c1ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:56.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:56.227+0000 7f99721a6640 1 --2- 172.21.15.7:0/2407036517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f996c101d60 0x7f996c071340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:56.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:56.227+0000 7f99721a6640 1 --2- 172.21.15.7:0/2407036517 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f996c1013a0 0x7f996c070e00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:56.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:56.227+0000 7f99721a6640 1 -- 172.21.15.7:0/2407036517 >> 172.21.15.7:0/2407036517 conn(0x7f996c0fb930 msgr2=0x7f996c104880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:56.235 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:56.227+0000 7f99721a6640 1 -- 172.21.15.7:0/2407036517 shutdown_connections 2024-09-19T04:25:56.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:25:56.227+0000 7f99721a6640 1 -- 172.21.15.7:0/2407036517 wait complete. 2024-09-19T04:25:56.796 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:56 smithi092 ceph-mon[34940]: pgmap v625: 129 pgs: 129 active+clean; 202 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 688 op/s 2024-09-19T04:25:56.876 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:56 smithi007 ceph-mon[31360]: pgmap v625: 129 pgs: 129 active+clean; 202 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 688 op/s 2024-09-19T04:25:56.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:56 smithi102 ceph-mon[35446]: pgmap v625: 129 pgs: 129 active+clean; 202 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 688 op/s 2024-09-19T04:25:58.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:58 smithi092 ceph-mon[34940]: pgmap v626: 129 pgs: 129 active+clean; 201 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 985 KiB/s wr, 579 op/s 2024-09-19T04:25:58.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:58 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:25:58.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:58 smithi007 ceph-mon[31360]: pgmap v626: 129 pgs: 129 active+clean; 201 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 985 KiB/s wr, 579 op/s 2024-09-19T04:25:58.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:58 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:25:58.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:58 smithi102 ceph-mon[35446]: pgmap v626: 129 pgs: 129 active+clean; 201 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 985 KiB/s wr, 579 op/s 2024-09-19T04:25:58.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:58 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:25:59.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:59 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:59.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:59 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:25:59.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:25:59 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:25:59.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:59 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:59.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:59 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:25:59.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:25:59 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:25:59.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:59 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:59.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:59 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:25:59.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:25:59 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:26:01.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:00 smithi007 ceph-mon[31360]: pgmap v627: 129 pgs: 129 active+clean; 164 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 833 op/s 2024-09-19T04:26:01.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:00 smithi102 ceph-mon[35446]: pgmap v627: 129 pgs: 129 active+clean; 164 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 833 op/s 2024-09-19T04:26:01.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:00 smithi092 ceph-mon[34940]: pgmap v627: 129 pgs: 129 active+clean; 164 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 833 op/s 2024-09-19T04:26:03.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:02 smithi007 ceph-mon[31360]: pgmap v628: 129 pgs: 129 active+clean; 164 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 645 op/s 2024-09-19T04:26:03.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:02 smithi102 ceph-mon[35446]: pgmap v628: 129 pgs: 129 active+clean; 164 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 645 op/s 2024-09-19T04:26:03.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:02 smithi092 ceph-mon[34940]: pgmap v628: 129 pgs: 129 active+clean; 164 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 645 op/s 2024-09-19T04:26:05.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:04 smithi007 ceph-mon[31360]: pgmap v629: 129 pgs: 129 active+clean; 152 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 766 op/s 2024-09-19T04:26:05.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:04 smithi102 ceph-mon[35446]: pgmap v629: 129 pgs: 129 active+clean; 152 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 766 op/s 2024-09-19T04:26:05.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:04 smithi092 ceph-mon[34940]: pgmap v629: 129 pgs: 129 active+clean; 152 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 766 op/s 2024-09-19T04:26:07.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:06 smithi007 ceph-mon[31360]: pgmap v630: 129 pgs: 129 active+clean; 138 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 761 op/s 2024-09-19T04:26:07.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:06 smithi102 ceph-mon[35446]: pgmap v630: 129 pgs: 129 active+clean; 138 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 761 op/s 2024-09-19T04:26:07.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:06 smithi092 ceph-mon[34940]: pgmap v630: 129 pgs: 129 active+clean; 138 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 761 op/s 2024-09-19T04:26:09.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:08 smithi007 ceph-mon[31360]: pgmap v631: 129 pgs: 129 active+clean; 136 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 650 op/s 2024-09-19T04:26:09.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:08 smithi102 ceph-mon[35446]: pgmap v631: 129 pgs: 129 active+clean; 136 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 650 op/s 2024-09-19T04:26:09.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:08 smithi092 ceph-mon[34940]: pgmap v631: 129 pgs: 129 active+clean; 136 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 650 op/s 2024-09-19T04:26:09.370 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.369+0000 7ffbbd34b640 1 -- 172.21.15.7:0/517242060 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbb81056a0 msgr2=0x7ffbb8105b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:09.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.369+0000 7ffbbd34b640 1 --2- 172.21.15.7:0/517242060 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbb81056a0 0x7ffbb8105b50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffba801a910 tx=0x7ffba803b450 comp rx=0 tx=0).stop 2024-09-19T04:26:09.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.369+0000 7ffbbd34b640 1 -- 172.21.15.7:0/517242060 shutdown_connections 2024-09-19T04:26:09.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.369+0000 7ffbbd34b640 1 --2- 172.21.15.7:0/517242060 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbb81056a0 0x7ffbb8105b50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:09.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.369+0000 7ffbbd34b640 1 --2- 172.21.15.7:0/517242060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbb8102cf0 0x7ffbb8105160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:09.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.369+0000 7ffbbd34b640 1 --2- 172.21.15.7:0/517242060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbb81003a0 0x7ffbb81027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:09.371 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.369+0000 7ffbbd34b640 1 -- 172.21.15.7:0/517242060 >> 172.21.15.7:0/517242060 conn(0x7ffbb80fc190 msgr2=0x7ffbb80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:09.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.369+0000 7ffbbd34b640 1 -- 172.21.15.7:0/517242060 shutdown_connections 2024-09-19T04:26:09.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.369+0000 7ffbbd34b640 1 -- 172.21.15.7:0/517242060 wait complete. 2024-09-19T04:26:09.372 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.370+0000 7ffbbd34b640 1 Processor -- start 2024-09-19T04:26:09.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.370+0000 7ffbbd34b640 1 -- start start 2024-09-19T04:26:09.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.371+0000 7ffbbd34b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbb81003a0 0x7ffbb8195c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:09.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.371+0000 7ffbbd34b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbb8102cf0 0x7ffbb8196180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:09.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.371+0000 7ffbbd34b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbb81056a0 0x7ffbb819d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:09.374 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.371+0000 7ffbbd34b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb81095c0 con 0x7ffbb8102cf0 2024-09-19T04:26:09.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.371+0000 7ffbbd34b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb8109440 con 0x7ffbb81056a0 2024-09-19T04:26:09.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.371+0000 7ffbbd34b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb8109740 con 0x7ffbb81003a0 2024-09-19T04:26:09.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.371+0000 7ffbb67fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbb8102cf0 0x7ffbb8196180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:09.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.371+0000 7ffbb6ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbb81003a0 0x7ffbb8195c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:09.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.371+0000 7ffbb67fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbb8102cf0 0x7ffbb8196180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52088/0 (socket says 172.21.15.7:52088) 2024-09-19T04:26:09.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.371+0000 7ffbb67fc640 1 -- 172.21.15.7:0/1762328595 learned_addr learned my addr 172.21.15.7:0/1762328595 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:26:09.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.371+0000 7ffbb6ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbb81003a0 0x7ffbb8195c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.7:48380/0 (socket says 172.21.15.7:48380) 2024-09-19T04:26:09.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.372+0000 7ffbb77fe640 1 --2- 172.21.15.7:0/1762328595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbb81056a0 0x7ffbb819d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:09.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.372+0000 7ffbb67fc640 1 -- 172.21.15.7:0/1762328595 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbb81003a0 msgr2=0x7ffbb8195c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:09.375 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.372+0000 7ffbb67fc640 1 --2- 172.21.15.7:0/1762328595 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbb81003a0 0x7ffbb8195c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:09.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.372+0000 7ffbb67fc640 1 -- 172.21.15.7:0/1762328595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbb81056a0 msgr2=0x7ffbb819d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:09.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.372+0000 7ffbb67fc640 1 --2- 172.21.15.7:0/1762328595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbb81056a0 0x7ffbb819d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:09.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.372+0000 7ffbb67fc640 1 -- 172.21.15.7:0/1762328595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbb806bd40 con 0x7ffbb8102cf0 2024-09-19T04:26:09.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.372+0000 7ffbb6ffd640 1 --2- 172.21.15.7:0/1762328595 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbb81003a0 0x7ffbb8195c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:26:09.376 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.372+0000 7ffbb67fc640 1 --2- 172.21.15.7:0/1762328595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbb8102cf0 0x7ffbb8196180 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000ebc0 tx=0x7ffbb000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:09.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.373+0000 7ffb9ffff640 1 -- 172.21.15.7:0/1762328595 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0010630 con 0x7ffbb8102cf0 2024-09-19T04:26:09.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.373+0000 7ffb9ffff640 1 -- 172.21.15.7:0/1762328595 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbb0010cb0 con 0x7ffbb8102cf0 2024-09-19T04:26:09.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.373+0000 7ffb9ffff640 1 -- 172.21.15.7:0/1762328595 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0010630 con 0x7ffbb8102cf0 2024-09-19T04:26:09.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.375+0000 7ffbbd34b640 1 -- 172.21.15.7:0/1762328595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbb806c030 con 0x7ffbb8102cf0 2024-09-19T04:26:09.377 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.375+0000 7ffbbd34b640 1 -- 172.21.15.7:0/1762328595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbb806c500 con 0x7ffbb8102cf0 2024-09-19T04:26:09.381 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.379+0000 7ffb9ffff640 1 -- 172.21.15.7:0/1762328595 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7ffbb001f020 con 0x7ffbb8102cf0 2024-09-19T04:26:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.382+0000 7ffb9ffff640 1 --2- 172.21.15.7:0/1762328595 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffba00a3490 0x7ffba00a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.382+0000 7ffb9ffff640 1 -- 172.21.15.7:0/1762328595 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7ffbb00d0010 con 0x7ffbb8102cf0 2024-09-19T04:26:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.383+0000 7ffbc01c3740 1 Processor -- start 2024-09-19T04:26:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.383+0000 7ffbb6ffd640 1 --2- 172.21.15.7:0/1762328595 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffba00a3490 0x7ffba00a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:09.384 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.383+0000 7ffbc01c3740 1 -- start start 2024-09-19T04:26:09.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.383+0000 7ffbc01c3740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4e6bb19a0 0x55f4e6bb1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:09.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.383+0000 7ffbc01c3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4e6bb22e0 0x55f4e6bb6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:09.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.383+0000 7ffbc01c3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f4e6bb7370 0x55f4e6bb9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:09.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.383+0000 7ffbc01c3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f4e6b152f0 con 0x55f4e6bb7370 2024-09-19T04:26:09.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.383+0000 7ffbc01c3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f4e6abd270 con 0x55f4e6bb22e0 2024-09-19T04:26:09.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.383+0000 7ffbc01c3740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f4e6b112b0 con 0x55f4e6bb19a0 2024-09-19T04:26:09.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.383+0000 7ffbb77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f4e6bb7370 0x55f4e6bb9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:09.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.383+0000 7ffbb77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f4e6bb7370 0x55f4e6bb9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52102/0 (socket says 172.21.15.7:52102) 2024-09-19T04:26:09.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.383+0000 7ffbb77fe640 1 -- 172.21.15.7:0/2554428802 learned_addr learned my addr 172.21.15.7:0/2554428802 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:26:09.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.383+0000 7ffbb67fc640 1 --2- 172.21.15.7:0/2554428802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4e6bb22e0 0x55f4e6bb6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:09.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.384+0000 7ffbb77fe640 1 -- 172.21.15.7:0/2554428802 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4e6bb19a0 msgr2=0x55f4e6bb1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:26:09.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.384+0000 7ffbb77fe640 1 --2- 172.21.15.7:0/2554428802 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4e6bb19a0 0x55f4e6bb1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:09.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.384+0000 7ffbb77fe640 1 -- 172.21.15.7:0/2554428802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4e6bb22e0 msgr2=0x55f4e6bb6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:26:09.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.384+0000 7ffbb77fe640 1 --2- 172.21.15.7:0/2554428802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4e6bb22e0 0x55f4e6bb6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:09.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.384+0000 7ffbb77fe640 1 -- 172.21.15.7:0/2554428802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4e6abc340 con 0x55f4e6bb7370 2024-09-19T04:26:09.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.385+0000 7ffbb77fe640 1 --2- 172.21.15.7:0/2554428802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f4e6bb7370 0x55f4e6bb9830 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ffba801a910 tx=0x7ffba8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f733fddc8ff306f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:09.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.385+0000 7ffbb6ffd640 1 --2- 172.21.15.7:0/1762328595 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffba00a3490 0x7ffba00a5950 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8197110 tx=0x7ffbac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.386+0000 7ffb9d7fa640 1 -- 172.21.15.7:0/2554428802 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba8051020 con 0x55f4e6bb7370 2024-09-19T04:26:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.386+0000 7ffb9d7fa640 1 -- 172.21.15.7:0/2554428802 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffba8004050 con 0x55f4e6bb7370 2024-09-19T04:26:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.386+0000 7ffb9d7fa640 1 -- 172.21.15.7:0/2554428802 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba8046070 con 0x55f4e6bb7370 2024-09-19T04:26:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.388+0000 7ffbc01c3740 1 -- 172.21.15.7:0/2554428802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f4e6bb7370 msgr2=0x55f4e6bb9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.388+0000 7ffbc01c3740 1 --2- 172.21.15.7:0/2554428802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f4e6bb7370 0x55f4e6bb9830 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ffba801a910 tx=0x7ffba8004750 comp rx=0 tx=0).stop 2024-09-19T04:26:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.389+0000 7ffbc01c3740 1 -- 172.21.15.7:0/2554428802 shutdown_connections 2024-09-19T04:26:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.389+0000 7ffbc01c3740 1 --2- 172.21.15.7:0/2554428802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f4e6bb7370 0x55f4e6bb9830 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.389+0000 7ffbc01c3740 1 --2- 172.21.15.7:0/2554428802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4e6bb22e0 0x55f4e6bb6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.389+0000 7ffbc01c3740 1 --2- 172.21.15.7:0/2554428802 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4e6bb19a0 0x55f4e6bb1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.389+0000 7ffbc01c3740 1 -- 172.21.15.7:0/2554428802 >> 172.21.15.7:0/2554428802 conn(0x55f4e6bad010 msgr2=0x55f4e6bad410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:09.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.390+0000 7ffbc01c3740 1 -- 172.21.15.7:0/2554428802 shutdown_connections 2024-09-19T04:26:09.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.390+0000 7ffbc01c3740 1 -- 172.21.15.7:0/2554428802 wait complete. 2024-09-19T04:26:09.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.390+0000 7ffbc01c3740 1 -- start start 2024-09-19T04:26:09.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.391+0000 7ffbc01c3740 1 Processor -- start 2024-09-19T04:26:09.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.391+0000 7ffbc01c3740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4e6bb19a0 0x55f4e6bbbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:09.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.391+0000 7ffbc01c3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4e6bb22e0 0x55f4e6bbc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:09.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.391+0000 7ffbc01c3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f4e6bb7370 0x55f4e6bc3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:09.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.391+0000 7ffbc01c3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f4e6bba2e0 con 0x55f4e6bb7370 2024-09-19T04:26:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.391+0000 7ffbc01c3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f4e6a9e290 con 0x55f4e6bb22e0 2024-09-19T04:26:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.391+0000 7ffbc01c3740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f4e6bba460 con 0x55f4e6bb19a0 2024-09-19T04:26:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.391+0000 7ffbc01c3740 10 client.0 _ll_register_callbacks cb 0x55f4e6acf140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:26:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.392+0000 7ffbb67fc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4e6bb22e0 0x55f4e6bbc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.392+0000 7ffbb77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f4e6bb7370 0x55f4e6bc3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.392+0000 7ffbb77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f4e6bb7370 0x55f4e6bc3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52118/0 (socket says 172.21.15.7:52118) 2024-09-19T04:26:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.392+0000 7ffbb77fe640 1 -- 172.21.15.7:0/3061991296 learned_addr learned my addr 172.21.15.7:0/3061991296 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:26:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.392+0000 7ffbb77fe640 1 -- 172.21.15.7:0/3061991296 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4e6bb19a0 msgr2=0x55f4e6bbbbd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T04:26:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.392+0000 7ffbb77fe640 1 --2- 172.21.15.7:0/3061991296 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4e6bb19a0 0x55f4e6bbbbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.392+0000 7ffbb77fe640 1 -- 172.21.15.7:0/3061991296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4e6bb22e0 msgr2=0x55f4e6bbc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:26:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.392+0000 7ffbb77fe640 1 --2- 172.21.15.7:0/3061991296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4e6bb22e0 0x55f4e6bbc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.392+0000 7ffbb77fe640 1 -- 172.21.15.7:0/3061991296 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4e6828210 con 0x55f4e6bb7370 2024-09-19T04:26:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.392+0000 7ffbb67fc640 1 --2- 172.21.15.7:0/3061991296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4e6bb22e0 0x55f4e6bbc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:26:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.393+0000 7ffbb77fe640 1 --2- 172.21.15.7:0/3061991296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f4e6bb7370 0x55f4e6bc3150 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ffba801a860 tx=0x7ffba801a5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4471fded1de4fa50 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:09.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.393+0000 7ffb9aff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:26:09.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.393+0000 7ffb9aff5640 1 -- 172.21.15.7:0/3061991296 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba8051070 con 0x55f4e6bb7370 2024-09-19T04:26:09.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.393+0000 7ffb9aff5640 1 -- 172.21.15.7:0/3061991296 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7ffba8004200 con 0x55f4e6bb7370 2024-09-19T04:26:09.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.393+0000 7ffbc01c3740 1 -- 172.21.15.7:0/3061991296 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffba8004050 con 0x55f4e6bb7370 2024-09-19T04:26:09.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.393+0000 7ffb9aff5640 1 -- 172.21.15.7:0/3061991296 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7ffba8046040 con 0x55f4e6bb7370 2024-09-19T04:26:09.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.394+0000 7ffbc01c3740 10 client.16389 fetch_fsmap learned FSMap version 43 2024-09-19T04:26:09.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.394+0000 7ffbc01c3740 1 -- 172.21.15.7:0/3061991296 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55f4e68f4620 con 0x55f4e6bb7370 2024-09-19T04:26:09.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.395+0000 7ffb9aff5640 1 -- 172.21.15.7:0/3061991296 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffba8004400 con 0x55f4e6bb7370 2024-09-19T04:26:09.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.395+0000 7ffb9aff5640 1 -- 172.21.15.7:0/3061991296 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7ffba804b040 con 0x55f4e6bb7370 2024-09-19T04:26:09.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.395+0000 7ffbc01c3740 10 client.16389 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T04:26:09.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.395+0000 7ffbc01c3740 10 client.16389 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:26:09.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.395+0000 7ffbc01c3740 20 client.16389 populate_metadata read hostname 'smithi007' 2024-09-19T04:26:09.397 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.395+0000 7ffbc01c3740 1 --2- 172.21.15.7:0/3061991296 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55f4e6bc7450 0x55f4e6bc9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:09.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.395+0000 7ffbc01c3740 4 client.16389 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:26:09.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.395+0000 7ffbc01c3740 1 -- 172.21.15.7:0/3061991296 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ffba8004050 con 0x55f4e6bc7450 2024-09-19T04:26:09.398 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.397+0000 7ffbb6ffd640 1 --2- 172.21.15.7:0/3061991296 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55f4e6bc7450 0x55f4e6bc9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:09.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.398+0000 7ffb9aff5640 10 client.16389 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:26:09.399 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.398+0000 7ffbb6ffd640 1 --2- 172.21.15.7:0/3061991296 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55f4e6bc7450 0x55f4e6bc9840 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e40a4a5caf0a9049 server_cookie=d5454729997439bf in_seq=0 out_seq=0 2024-09-19T04:26:09.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.400+0000 7ffb9aff5640 1 -- 172.21.15.7:0/3061991296 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7ffba8004050 con 0x55f4e6bc7450 2024-09-19T04:26:09.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.400+0000 7ffb9aff5640 10 client.16389 handle_command_reply: tid=0 2024-09-19T04:26:09.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.400+0000 7ffbc01c3740 1 client.16389 shutdown 2024-09-19T04:26:09.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.401+0000 7ffbc01c3740 1 -- 172.21.15.7:0/3061991296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f4e6bb7370 msgr2=0x55f4e6bc3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:09.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.401+0000 7ffbc01c3740 1 --2- 172.21.15.7:0/3061991296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f4e6bb7370 0x55f4e6bc3150 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ffba801a860 tx=0x7ffba801a5e0 comp rx=0 tx=0).stop 2024-09-19T04:26:09.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.402+0000 7ffbc01c3740 1 -- 172.21.15.7:0/3061991296 shutdown_connections 2024-09-19T04:26:09.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.402+0000 7ffbc01c3740 1 --2- 172.21.15.7:0/3061991296 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55f4e6bc7450 0x55f4e6bc9840 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:09.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.402+0000 7ffbc01c3740 1 --2- 172.21.15.7:0/3061991296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f4e6bb7370 0x55f4e6bc3150 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:09.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.402+0000 7ffbc01c3740 1 --2- 172.21.15.7:0/3061991296 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4e6bb22e0 0x55f4e6bbc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:09.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.402+0000 7ffbc01c3740 1 --2- 172.21.15.7:0/3061991296 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4e6bb19a0 0x55f4e6bbbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:09.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.402+0000 7ffbc01c3740 1 -- 172.21.15.7:0/3061991296 >> 172.21.15.7:0/3061991296 conn(0x55f4e6bad010 msgr2=0x55f4e6bae820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:09.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.402+0000 7ffb9aff5640 0 client.16389 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:26:09.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.402+0000 7ffbc01c3740 1 -- 172.21.15.7:0/3061991296 shutdown_connections 2024-09-19T04:26:09.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.402+0000 7ffbc01c3740 1 -- 172.21.15.7:0/3061991296 wait complete. 2024-09-19T04:26:09.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.403+0000 7ffbc01c3740 20 client.16389 trim_cache size 0 max 16384 2024-09-19T04:26:09.435 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.434+0000 7ffbc01c3740 1 Processor -- start 2024-09-19T04:26:09.436 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.434+0000 7ffbc01c3740 1 -- start start 2024-09-19T04:26:09.437 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.434+0000 7ffbc01c3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f4e6bb19a0 0x55f4e6bac0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:09.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.435+0000 7ffbc01c3740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4e6bb22e0 0x55f4e6bc3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:09.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.435+0000 7ffbc01c3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4e6bb7370 0x55f4e6bae400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:09.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.435+0000 7ffbc01c3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb81b1080 con 0x55f4e6bb19a0 2024-09-19T04:26:09.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.435+0000 7ffbc01c3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb81b2c80 con 0x55f4e6bb7370 2024-09-19T04:26:09.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.435+0000 7ffbc01c3740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb81b1780 con 0x55f4e6bb22e0 2024-09-19T04:26:09.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.435+0000 7ffbb6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f4e6bb19a0 0x55f4e6bac0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:09.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.435+0000 7ffbb67fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4e6bb22e0 0x55f4e6bc3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:09.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.435+0000 7ffbb6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f4e6bb19a0 0x55f4e6bac0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52132/0 (socket says 172.21.15.7:52132) 2024-09-19T04:26:09.438 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.435+0000 7ffbb6ffd640 1 -- 172.21.15.7:0/1514412963 learned_addr learned my addr 172.21.15.7:0/1514412963 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:26:09.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.435+0000 7ffbb6ffd640 1 -- 172.21.15.7:0/1514412963 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4e6bb22e0 msgr2=0x55f4e6bc3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:26:09.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.435+0000 7ffbb6ffd640 1 --2- 172.21.15.7:0/1514412963 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4e6bb22e0 0x55f4e6bc3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:09.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.435+0000 7ffbb6ffd640 1 -- 172.21.15.7:0/1514412963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4e6bb7370 msgr2=0x55f4e6bae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:26:09.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.435+0000 7ffbb6ffd640 1 --2- 172.21.15.7:0/1514412963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4e6bb7370 0x55f4e6bae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:09.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.435+0000 7ffbb6ffd640 1 -- 172.21.15.7:0/1514412963 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4e6bb9dd0 con 0x55f4e6bb19a0 2024-09-19T04:26:09.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.435+0000 7ffbb6ffd640 1 --2- 172.21.15.7:0/1514412963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f4e6bb19a0 0x55f4e6bac0b0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ffbac011f60 tx=0x7ffbac014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d39c071082bae5d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:09.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.436+0000 7ffb9cff9640 1 -- 172.21.15.7:0/1514412963 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbac01f620 con 0x55f4e6bb19a0 2024-09-19T04:26:09.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.436+0000 7ffb9cff9640 1 -- 172.21.15.7:0/1514412963 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffba8004050 con 0x55f4e6bb19a0 2024-09-19T04:26:09.439 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.436+0000 7ffb9cff9640 1 -- 172.21.15.7:0/1514412963 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbac0269d0 con 0x55f4e6bb19a0 2024-09-19T04:26:09.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.437+0000 7ffbc01c3740 1 -- 172.21.15.7:0/1514412963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f4e6bb19a0 msgr2=0x55f4e6bac0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:09.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.437+0000 7ffbc01c3740 1 --2- 172.21.15.7:0/1514412963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f4e6bb19a0 0x55f4e6bac0b0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ffbac011f60 tx=0x7ffbac014000 comp rx=0 tx=0).stop 2024-09-19T04:26:09.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.438+0000 7ffbc01c3740 1 -- 172.21.15.7:0/1514412963 shutdown_connections 2024-09-19T04:26:09.442 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.438+0000 7ffbc01c3740 1 --2- 172.21.15.7:0/1514412963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4e6bb7370 0x55f4e6bae400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.438+0000 7ffbc01c3740 1 --2- 172.21.15.7:0/1514412963 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4e6bb22e0 0x55f4e6bc3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.438+0000 7ffbc01c3740 1 --2- 172.21.15.7:0/1514412963 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f4e6bb19a0 0x55f4e6bac0b0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.438+0000 7ffbc01c3740 1 -- 172.21.15.7:0/1514412963 >> 172.21.15.7:0/1514412963 conn(0x55f4e6bad010 msgr2=0x55f4e6bab9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.438+0000 7ffbc01c3740 1 -- 172.21.15.7:0/1514412963 shutdown_connections 2024-09-19T04:26:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.439+0000 7ffbc01c3740 1 -- 172.21.15.7:0/1514412963 wait complete. 2024-09-19T04:26:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.439+0000 7ffbc01c3740 1 -- start start 2024-09-19T04:26:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.439+0000 7ffbc01c3740 1 Processor -- start 2024-09-19T04:26:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.440+0000 7ffbc01c3740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4e6bb19a0 0x55f4e6bc0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.440+0000 7ffbc01c3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f4e6bb22e0 0x55f4e6bc07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.440+0000 7ffbc01c3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4e6bb7370 0x55f4e6bc17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:09.443 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.440+0000 7ffbc01c3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb81b2580 con 0x55f4e6bb22e0 2024-09-19T04:26:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.440+0000 7ffbc01c3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb81b1e80 con 0x55f4e6bb7370 2024-09-19T04:26:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.441+0000 7ffbc01c3740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb81af040 con 0x55f4e6bb19a0 2024-09-19T04:26:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.441+0000 7ffbc01c3740 10 client.0 _ll_register_callbacks cb 0x7ffbb0018420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:26:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.441+0000 7ffbb67fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f4e6bb22e0 0x55f4e6bc07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.441+0000 7ffbb67fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f4e6bb22e0 0x55f4e6bc07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52148/0 (socket says 172.21.15.7:52148) 2024-09-19T04:26:09.444 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.441+0000 7ffbb67fc640 1 -- 172.21.15.7:0/141562992 learned_addr learned my addr 172.21.15.7:0/141562992 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:26:09.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.441+0000 7ffbb77fe640 1 --2- 172.21.15.7:0/141562992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4e6bb7370 0x55f4e6bc17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:09.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.441+0000 7ffbb6ffd640 1 --2- 172.21.15.7:0/141562992 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4e6bb19a0 0x55f4e6bc0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:09.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.442+0000 7ffbb77fe640 1 -- 172.21.15.7:0/141562992 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4e6bb19a0 msgr2=0x55f4e6bc0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:26:09.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.442+0000 7ffbb77fe640 1 --2- 172.21.15.7:0/141562992 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4e6bb19a0 0x55f4e6bc0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:09.446 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.442+0000 7ffbb77fe640 1 -- 172.21.15.7:0/141562992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f4e6bb22e0 msgr2=0x55f4e6bc07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:26:09.446 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.442+0000 7ffbb77fe640 1 --2- 172.21.15.7:0/141562992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f4e6bb22e0 0x55f4e6bc07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:09.446 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.442+0000 7ffbb77fe640 1 -- 172.21.15.7:0/141562992 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4e6ba82d0 con 0x55f4e6bb7370 2024-09-19T04:26:09.446 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.443+0000 7ffbb77fe640 1 --2- 172.21.15.7:0/141562992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4e6bb7370 0x55f4e6bc17c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffba8003f10 tx=0x7ffba8004410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a496a048a7a4599 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:09.446 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.443+0000 7ffb9aff5640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-09-19T04:26:09.446 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.444+0000 7ffbb67fc640 1 --2- 172.21.15.7:0/141562992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f4e6bb22e0 0x55f4e6bc07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:26:09.446 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.444+0000 7ffb9aff5640 1 -- 172.21.15.7:0/141562992 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba8069030 con 0x55f4e6bb7370 2024-09-19T04:26:09.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.444+0000 7ffb9aff5640 1 -- 172.21.15.7:0/141562992 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7ffba8019070 con 0x55f4e6bb7370 2024-09-19T04:26:09.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.444+0000 7ffbc01c3740 1 -- 172.21.15.7:0/141562992 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffba8004050 con 0x55f4e6bb7370 2024-09-19T04:26:09.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.445+0000 7ffb9aff5640 1 -- 172.21.15.7:0/141562992 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7ffba8051040 con 0x55f4e6bb7370 2024-09-19T04:26:09.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.445+0000 7ffbc01c3740 10 client.25958 fetch_fsmap learned FSMap version 43 2024-09-19T04:26:09.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.445+0000 7ffbc01c3740 1 -- 172.21.15.7:0/141562992 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55f4e6bc2f10 con 0x55f4e6bb7370 2024-09-19T04:26:09.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.445+0000 7ffb9aff5640 1 -- 172.21.15.7:0/141562992 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffba8004050 con 0x55f4e6bb7370 2024-09-19T04:26:09.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.446+0000 7ffb9aff5640 1 -- 172.21.15.7:0/141562992 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7ffba80035f0 con 0x55f4e6bb7370 2024-09-19T04:26:09.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.447+0000 7ffbc01c3740 10 client.25958 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T04:26:09.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.447+0000 7ffbc01c3740 10 client.25958 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:26:09.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.447+0000 7ffbc01c3740 20 client.25958 populate_metadata read hostname 'smithi007' 2024-09-19T04:26:09.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.447+0000 7ffbc01c3740 1 --2- 172.21.15.7:0/141562992 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55f4e6c321e0 0x55f4e6c345d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:09.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.447+0000 7ffbc01c3740 4 client.25958 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:26:09.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.447+0000 7ffbc01c3740 1 -- 172.21.15.7:0/141562992 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f4e6b22a20 con 0x55f4e6c321e0 2024-09-19T04:26:09.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.450+0000 7ffbb6ffd640 1 --2- 172.21.15.7:0/141562992 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55f4e6c321e0 0x55f4e6c345d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.452+0000 7ffbb6ffd640 1 --2- 172.21.15.7:0/141562992 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55f4e6c321e0 0x55f4e6c345d0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4479f55c340dd91 server_cookie=24e0dc46b9b86901 in_seq=0 out_seq=0 2024-09-19T04:26:09.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:09.452+0000 7ffb9aff5640 10 client.25958 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:26:10.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:10.188+0000 7ffb9aff5640 1 -- 172.21.15.7:0/141562992 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f4e6b22a20 con 0x55f4e6c321e0 2024-09-19T04:26:10.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:10.188+0000 7ffb9aff5640 10 client.25958 handle_command_reply: tid=0 2024-09-19T04:26:10.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:10.188+0000 7ffbc01c3740 1 client.25958 shutdown 2024-09-19T04:26:10.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:10.188+0000 7ffbc01c3740 1 -- 172.21.15.7:0/141562992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4e6bb7370 msgr2=0x55f4e6bc17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:10.188+0000 7ffbc01c3740 1 --2- 172.21.15.7:0/141562992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4e6bb7370 0x55f4e6bc17c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffba8003f10 tx=0x7ffba8004410 comp rx=0 tx=0).stop 2024-09-19T04:26:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:10.188+0000 7ffbc01c3740 1 -- 172.21.15.7:0/141562992 shutdown_connections 2024-09-19T04:26:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:10.188+0000 7ffbc01c3740 1 --2- 172.21.15.7:0/141562992 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x55f4e6c321e0 0x55f4e6c345d0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:10.188+0000 7ffb9aff5640 0 client.25958 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:26:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:10.188+0000 7ffbc01c3740 1 --2- 172.21.15.7:0/141562992 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f4e6bb7370 0x55f4e6bc17c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:10.188+0000 7ffbc01c3740 1 --2- 172.21.15.7:0/141562992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f4e6bb22e0 0x55f4e6bc07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:10.188+0000 7ffbc01c3740 1 --2- 172.21.15.7:0/141562992 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4e6bb19a0 0x55f4e6bc0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:10.188+0000 7ffbc01c3740 1 -- 172.21.15.7:0/141562992 >> 172.21.15.7:0/141562992 conn(0x55f4e6bad010 msgr2=0x55f4e6bac1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:10.188+0000 7ffbc01c3740 1 -- 172.21.15.7:0/141562992 shutdown_connections 2024-09-19T04:26:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:10.188+0000 7ffbc01c3740 1 -- 172.21.15.7:0/141562992 wait complete. 2024-09-19T04:26:10.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:10.189+0000 7ffbc01c3740 20 client.25958 trim_cache size 0 max 16384 2024-09-19T04:26:10.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:26:10.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:26:10.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:26:10.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:26:10.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:10.189+0000 7ffbbd34b640 1 -- 172.21.15.7:0/1762328595 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffba00a3490 msgr2=0x7ffba00a5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:10.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:10.189+0000 7ffbbd34b640 1 --2- 172.21.15.7:0/1762328595 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffba00a3490 0x7ffba00a5950 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8197110 tx=0x7ffbac005f90 comp rx=0 tx=0).stop 2024-09-19T04:26:10.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:10.189+0000 7ffbbd34b640 1 -- 172.21.15.7:0/1762328595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbb8102cf0 msgr2=0x7ffbb8196180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:10.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:10.189+0000 7ffbbd34b640 1 --2- 172.21.15.7:0/1762328595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbb8102cf0 0x7ffbb8196180 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000ebc0 tx=0x7ffbb000c6a0 comp rx=0 tx=0).stop 2024-09-19T04:26:10.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:10.189+0000 7ffbbd34b640 1 -- 172.21.15.7:0/1762328595 shutdown_connections 2024-09-19T04:26:10.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:10.189+0000 7ffbbd34b640 1 --2- 172.21.15.7:0/1762328595 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffba00a3490 0x7ffba00a5950 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:10.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:10.189+0000 7ffbbd34b640 1 --2- 172.21.15.7:0/1762328595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffbb81056a0 0x7ffbb819d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:10.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:10.189+0000 7ffbbd34b640 1 --2- 172.21.15.7:0/1762328595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffbb8102cf0 0x7ffbb8196180 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:10.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:10.189+0000 7ffbbd34b640 1 --2- 172.21.15.7:0/1762328595 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbb81003a0 0x7ffbb8195c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:10.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:10.189+0000 7ffbbd34b640 1 -- 172.21.15.7:0/1762328595 >> 172.21.15.7:0/1762328595 conn(0x7ffbb80fc190 msgr2=0x7ffbb80fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:10.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:10.190+0000 7ffbbd34b640 1 -- 172.21.15.7:0/1762328595 shutdown_connections 2024-09-19T04:26:10.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:10.190+0000 7ffbbd34b640 1 -- 172.21.15.7:0/1762328595 wait complete. 2024-09-19T04:26:11.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:10 smithi007 ceph-mon[31360]: pgmap v632: 129 pgs: 129 active+clean; 115 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 857 op/s 2024-09-19T04:26:11.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:10 smithi102 ceph-mon[35446]: pgmap v632: 129 pgs: 129 active+clean; 115 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 857 op/s 2024-09-19T04:26:11.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:10 smithi092 ceph-mon[34940]: pgmap v632: 129 pgs: 129 active+clean; 115 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 857 op/s 2024-09-19T04:26:13.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:12 smithi007 ceph-mon[31360]: pgmap v633: 129 pgs: 129 active+clean; 111 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 606 op/s 2024-09-19T04:26:13.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:12 smithi102 ceph-mon[35446]: pgmap v633: 129 pgs: 129 active+clean; 111 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 606 op/s 2024-09-19T04:26:13.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:12 smithi092 ceph-mon[34940]: pgmap v633: 129 pgs: 129 active+clean; 111 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 606 op/s 2024-09-19T04:26:15.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:14 smithi007 ceph-mon[31360]: pgmap v634: 129 pgs: 129 active+clean; 96 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 734 op/s 2024-09-19T04:26:15.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:14 smithi102 ceph-mon[35446]: pgmap v634: 129 pgs: 129 active+clean; 96 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 734 op/s 2024-09-19T04:26:15.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:14 smithi092 ceph-mon[34940]: pgmap v634: 129 pgs: 129 active+clean; 96 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 734 op/s 2024-09-19T04:26:17.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:16 smithi007 ceph-mon[31360]: pgmap v635: 129 pgs: 129 active+clean; 70 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 749 op/s 2024-09-19T04:26:17.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:16 smithi102 ceph-mon[35446]: pgmap v635: 129 pgs: 129 active+clean; 70 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 749 op/s 2024-09-19T04:26:17.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:16 smithi092 ceph-mon[34940]: pgmap v635: 129 pgs: 129 active+clean; 70 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 749 op/s 2024-09-19T04:26:19.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:18 smithi007 ceph-mon[31360]: pgmap v636: 129 pgs: 129 active+clean; 68 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 637 op/s 2024-09-19T04:26:19.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:18 smithi102 ceph-mon[35446]: pgmap v636: 129 pgs: 129 active+clean; 68 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 637 op/s 2024-09-19T04:26:19.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:18 smithi092 ceph-mon[34940]: pgmap v636: 129 pgs: 129 active+clean; 68 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 637 op/s 2024-09-19T04:26:20.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:19 smithi007 ceph-mon[31360]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:26:20.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:19 smithi102 ceph-mon[35446]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:26:20.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:19 smithi092 ceph-mon[34940]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T04:26:20.545 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2024-09-19T04:26:20.546 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T04:26:21.013 DEBUG:teuthology.parallel:result is None 2024-09-19T04:26:21.014 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T04:26:21.047 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T04:26:21.047 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-19T04:26:21.058 INFO:tasks.quiescer:joining Quiescers 2024-09-19T04:26:21.058 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-19T04:26:21.059 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:26:21.109 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:20 smithi007 ceph-mon[31360]: pgmap v637: 129 pgs: 129 active+clean; 49 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 831 op/s 2024-09-19T04:26:21.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:20 smithi102 ceph-mon[35446]: pgmap v637: 129 pgs: 129 active+clean; 49 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 831 op/s 2024-09-19T04:26:21.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:20 smithi092 ceph-mon[34940]: pgmap v637: 129 pgs: 129 active+clean; 49 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 831 op/s 2024-09-19T04:26:21.344 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:26:21.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.853+0000 7f31d72f9640 1 -- 172.21.15.7:0/894676110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31d0108290 msgr2=0x7f31d010ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:21.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.853+0000 7f31d72f9640 1 --2- 172.21.15.7:0/894676110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31d0108290 0x7f31d010ec30 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f31c8009cd0 tx=0x7f31c802a8e0 comp rx=0 tx=0).stop 2024-09-19T04:26:21.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.853+0000 7f31d72f9640 1 -- 172.21.15.7:0/894676110 shutdown_connections 2024-09-19T04:26:21.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.853+0000 7f31d72f9640 1 --2- 172.21.15.7:0/894676110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31d0108290 0x7f31d010ec30 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:21.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.853+0000 7f31d72f9640 1 --2- 172.21.15.7:0/894676110 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31d0103740 0x7f31d0107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:21.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.853+0000 7f31d72f9640 1 --2- 172.21.15.7:0/894676110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d0102d90 0x7f31d0103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:21.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.853+0000 7f31d72f9640 1 -- 172.21.15.7:0/894676110 >> 172.21.15.7:0/894676110 conn(0x7f31d00fc7d0 msgr2=0x7f31d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:21.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.854+0000 7f31d72f9640 1 -- 172.21.15.7:0/894676110 shutdown_connections 2024-09-19T04:26:21.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.854+0000 7f31d72f9640 1 -- 172.21.15.7:0/894676110 wait complete. 2024-09-19T04:26:21.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.854+0000 7f31d72f9640 1 Processor -- start 2024-09-19T04:26:21.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.854+0000 7f31d72f9640 1 -- start start 2024-09-19T04:26:21.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.854+0000 7f31d72f9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31d0102d90 0x7f31d01009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:21.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.854+0000 7f31d72f9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31d0103740 0x7f31d0100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:21.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.855+0000 7f31d72f9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d0108290 0x7f31d0101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:21.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.855+0000 7f31d72f9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f31d0112090 con 0x7f31d0102d90 2024-09-19T04:26:21.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.855+0000 7f31d72f9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f31d0111f10 con 0x7f31d0108290 2024-09-19T04:26:21.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.855+0000 7f31d72f9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f31d0112210 con 0x7f31d0103740 2024-09-19T04:26:21.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.855+0000 7f31d5095640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31d0102d90 0x7f31d01009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:21.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.855+0000 7f31d5095640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31d0102d90 0x7f31d01009f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38828/0 (socket says 172.21.15.7:38828) 2024-09-19T04:26:21.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.855+0000 7f31d5095640 1 -- 172.21.15.7:0/1521408175 learned_addr learned my addr 172.21.15.7:0/1521408175 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:26:21.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.855+0000 7f31d4894640 1 --2- 172.21.15.7:0/1521408175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31d0103740 0x7f31d0100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:21.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.855+0000 7f31d5896640 1 --2- 172.21.15.7:0/1521408175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d0108290 0x7f31d0101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:21.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.855+0000 7f31d5095640 1 -- 172.21.15.7:0/1521408175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31d0103740 msgr2=0x7f31d0100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:21.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.855+0000 7f31d5095640 1 --2- 172.21.15.7:0/1521408175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31d0103740 0x7f31d0100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:21.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.855+0000 7f31d5095640 1 -- 172.21.15.7:0/1521408175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d0108290 msgr2=0x7f31d0101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:21.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.855+0000 7f31d5095640 1 --2- 172.21.15.7:0/1521408175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d0108290 0x7f31d0101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:21.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.855+0000 7f31d5095640 1 -- 172.21.15.7:0/1521408175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d01a6aa0 con 0x7f31d0102d90 2024-09-19T04:26:21.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.855+0000 7f31d4894640 1 --2- 172.21.15.7:0/1521408175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31d0103740 0x7f31d0100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:26:21.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.855+0000 7f31d5095640 1 --2- 172.21.15.7:0/1521408175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31d0102d90 0x7f31d01009f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00e9f0 tx=0x7f31cc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:21.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.855+0000 7f31c67fc640 1 -- 172.21.15.7:0/1521408175 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc00cd80 con 0x7f31d0102d90 2024-09-19T04:26:21.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.855+0000 7f31d72f9640 1 -- 172.21.15.7:0/1521408175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31d01a6d90 con 0x7f31d0102d90 2024-09-19T04:26:21.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.855+0000 7f31c67fc640 1 -- 172.21.15.7:0/1521408175 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31cc010910 con 0x7f31d0102d90 2024-09-19T04:26:21.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.856+0000 7f31c67fc640 1 -- 172.21.15.7:0/1521408175 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31cc0188f0 con 0x7f31d0102d90 2024-09-19T04:26:21.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.856+0000 7f31d72f9640 1 -- 172.21.15.7:0/1521408175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d01a7270 con 0x7f31d0102d90 2024-09-19T04:26:21.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.857+0000 7f31d72f9640 1 -- 172.21.15.7:0/1521408175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31d0103170 con 0x7f31d0102d90 2024-09-19T04:26:21.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.858+0000 7f31c67fc640 1 -- 172.21.15.7:0/1521408175 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f31cc010ac0 con 0x7f31d0102d90 2024-09-19T04:26:21.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.858+0000 7f31c67fc640 1 --2- 172.21.15.7:0/1521408175 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f31bc0a3240 0x7f31bc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:21.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.859+0000 7f31d4894640 1 --2- 172.21.15.7:0/1521408175 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f31bc0a3240 0x7f31bc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:21.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.859+0000 7f31c67fc640 1 -- 172.21.15.7:0/1521408175 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f31cc0d00a0 con 0x7f31d0102d90 2024-09-19T04:26:21.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.859+0000 7f31d4894640 1 --2- 172.21.15.7:0/1521408175 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f31bc0a3240 0x7f31bc0a5700 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f31d0102480 tx=0x7f31c0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:21.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:21.863+0000 7f31c67fc640 1 -- 172.21.15.7:0/1521408175 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f31cc09c3a0 con 0x7f31d0102d90 2024-09-19T04:26:22.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:22.077+0000 7f31d72f9640 1 -- 172.21.15.7:0/1521408175 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31d010a2a0 con 0x7f31d0102d90 2024-09-19T04:26:22.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:22.077+0000 7f31c67fc640 1 -- 172.21.15.7:0/1521408175 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+11967 (secure 0 0 0) 0x7f31cc0a06a0 con 0x7f31d0102d90 2024-09-19T04:26:22.079 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:26:22.079 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":44,"btime":"2024-09-19T04:26:18:827298+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":25972,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3968218417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3968218417},{"type":"v1","addr":"172.21.15.92:6835","nonce":3968218417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":44,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:26:18.414223+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24496,"mds_2":24482,"mds_3":24478,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14541":{"gid":14541,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24472,24478,24482,24496,24506]},"id":1}]} 2024-09-19T04:26:22.080 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 44 2024-09-19T04:26:22.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:22.079+0000 7f31d72f9640 1 -- 172.21.15.7:0/1521408175 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f31bc0a3240 msgr2=0x7f31bc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:22.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:22.079+0000 7f31d72f9640 1 --2- 172.21.15.7:0/1521408175 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f31bc0a3240 0x7f31bc0a5700 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f31d0102480 tx=0x7f31c0005f90 comp rx=0 tx=0).stop 2024-09-19T04:26:22.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:22.079+0000 7f31d72f9640 1 -- 172.21.15.7:0/1521408175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31d0102d90 msgr2=0x7f31d01009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:22.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:22.080+0000 7f31d72f9640 1 --2- 172.21.15.7:0/1521408175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31d0102d90 0x7f31d01009f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00e9f0 tx=0x7f31cc00eeb0 comp rx=0 tx=0).stop 2024-09-19T04:26:22.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:22.080+0000 7f31d72f9640 1 -- 172.21.15.7:0/1521408175 shutdown_connections 2024-09-19T04:26:22.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:22.080+0000 7f31d72f9640 1 --2- 172.21.15.7:0/1521408175 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f31bc0a3240 0x7f31bc0a5700 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:22.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:22.080+0000 7f31d72f9640 1 --2- 172.21.15.7:0/1521408175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d0108290 0x7f31d0101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:22.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:22.080+0000 7f31d72f9640 1 --2- 172.21.15.7:0/1521408175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31d0103740 0x7f31d0100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:22.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:22.080+0000 7f31d72f9640 1 --2- 172.21.15.7:0/1521408175 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31d0102d90 0x7f31d01009f0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:22.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:22.080+0000 7f31d72f9640 1 -- 172.21.15.7:0/1521408175 >> 172.21.15.7:0/1521408175 conn(0x7f31d00fc7d0 msgr2=0x7f31d0106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:22.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:22.080+0000 7f31d72f9640 1 -- 172.21.15.7:0/1521408175 shutdown_connections 2024-09-19T04:26:22.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:22.080+0000 7f31d72f9640 1 -- 172.21.15.7:0/1521408175 wait complete. 2024-09-19T04:26:22.866 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24506 quiesce db --cancel --all' 2024-09-19T04:26:22.866 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24506 quiesce db --cancel --all 2024-09-19T04:26:23.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:22 smithi007 ceph-mon[31360]: pgmap v638: 129 pgs: 129 active+clean; 45 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 1007 KiB/s wr, 623 op/s 2024-09-19T04:26:23.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:22 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1521408175' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:26:23.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:22 smithi102 ceph-mon[35446]: pgmap v638: 129 pgs: 129 active+clean; 45 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 1007 KiB/s wr, 623 op/s 2024-09-19T04:26:23.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:22 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1521408175' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:26:23.168 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:26:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.279+0000 7f89172e6640 1 -- 172.21.15.7:0/3310090943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89101025f0 msgr2=0x7f89101049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.279+0000 7f89172e6640 1 --2- 172.21.15.7:0/3310090943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89101025f0 0x7f89101049e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f890c009900 tx=0x7f890c02a410 comp rx=0 tx=0).stop 2024-09-19T04:26:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.279+0000 7f89172e6640 1 -- 172.21.15.7:0/3310090943 shutdown_connections 2024-09-19T04:26:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.279+0000 7f89172e6640 1 --2- 172.21.15.7:0/3310090943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8910107850 0x7f8910109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.279+0000 7f89172e6640 1 --2- 172.21.15.7:0/3310090943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8910104f20 0x7f8910107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.279+0000 7f89172e6640 1 --2- 172.21.15.7:0/3310090943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89101025f0 0x7f89101049e0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.279+0000 7f89172e6640 1 -- 172.21.15.7:0/3310090943 >> 172.21.15.7:0/3310090943 conn(0x7f89100fc1f0 msgr2=0x7f89100fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.279+0000 7f89172e6640 1 -- 172.21.15.7:0/3310090943 shutdown_connections 2024-09-19T04:26:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.279+0000 7f89172e6640 1 -- 172.21.15.7:0/3310090943 wait complete. 2024-09-19T04:26:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.279+0000 7f89172e6640 1 Processor -- start 2024-09-19T04:26:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.279+0000 7f89172e6640 1 -- start start 2024-09-19T04:26:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.279+0000 7f89172e6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89101025f0 0x7f8910197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.279+0000 7f89172e6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8910104f20 0x7f89101984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.279+0000 7f89172e6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8910107850 0x7f891019f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.279+0000 7f89172e6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f891010d860 con 0x7f8910107850 2024-09-19T04:26:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.279+0000 7f89172e6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f891010d6e0 con 0x7f89101025f0 2024-09-19T04:26:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.279+0000 7f89172e6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f891010d9e0 con 0x7f8910104f20 2024-09-19T04:26:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.280+0000 7f8915883640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8910107850 0x7f891019f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.280+0000 7f8915883640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8910107850 0x7f891019f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38854/0 (socket says 172.21.15.7:38854) 2024-09-19T04:26:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.280+0000 7f8915883640 1 -- 172.21.15.7:0/2986486643 learned_addr learned my addr 172.21.15.7:0/2986486643 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:26:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.280+0000 7f8914881640 1 --2- 172.21.15.7:0/2986486643 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8910104f20 0x7f89101984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.280+0000 7f8915082640 1 --2- 172.21.15.7:0/2986486643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89101025f0 0x7f8910197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.280+0000 7f8915883640 1 -- 172.21.15.7:0/2986486643 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8910104f20 msgr2=0x7f89101984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.280+0000 7f8915883640 1 --2- 172.21.15.7:0/2986486643 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8910104f20 0x7f89101984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.280+0000 7f8915883640 1 -- 172.21.15.7:0/2986486643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89101025f0 msgr2=0x7f8910197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.280+0000 7f8915883640 1 --2- 172.21.15.7:0/2986486643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89101025f0 0x7f8910197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.280+0000 7f8915883640 1 -- 172.21.15.7:0/2986486643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f891019fb90 con 0x7f8910107850 2024-09-19T04:26:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.280+0000 7f8915883640 1 --2- 172.21.15.7:0/2986486643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8910107850 0x7f891019f520 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f890800e9d0 tx=0x7f890800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.280+0000 7f89067fc640 1 -- 172.21.15.7:0/2986486643 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890800cd80 con 0x7f8910107850 2024-09-19T04:26:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.280+0000 7f89067fc640 1 -- 172.21.15.7:0/2986486643 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8908005020 con 0x7f8910107850 2024-09-19T04:26:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.280+0000 7f89172e6640 1 -- 172.21.15.7:0/2986486643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f891019fe80 con 0x7f8910107850 2024-09-19T04:26:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.280+0000 7f89067fc640 1 -- 172.21.15.7:0/2986486643 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89080116d0 con 0x7f8910107850 2024-09-19T04:26:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.280+0000 7f89172e6640 1 -- 172.21.15.7:0/2986486643 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89101a0390 con 0x7f8910107850 2024-09-19T04:26:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.282+0000 7f89067fc640 1 -- 172.21.15.7:0/2986486643 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f89080051d0 con 0x7f8910107850 2024-09-19T04:26:23.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.283+0000 7f891a07f740 1 Processor -- start 2024-09-19T04:26:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.283+0000 7f891a07f740 1 -- start start 2024-09-19T04:26:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.283+0000 7f891a07f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5620d7ab59a0 0x5620d7ab5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.283+0000 7f891a07f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5620d7ab62e0 0x5620d7abada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.283+0000 7f891a07f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d7abb370 0x5620d7abd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.283+0000 7f891a07f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5620d7a192f0 con 0x5620d7ab59a0 2024-09-19T04:26:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.283+0000 7f891a07f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5620d79c1270 con 0x5620d7abb370 2024-09-19T04:26:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.283+0000 7f891a07f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5620d7a152b0 con 0x5620d7ab62e0 2024-09-19T04:26:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.283+0000 7f8914881640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5620d7ab59a0 0x5620d7ab5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.283+0000 7f8914881640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5620d7ab59a0 0x5620d7ab5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38864/0 (socket says 172.21.15.7:38864) 2024-09-19T04:26:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.283+0000 7f8914881640 1 -- 172.21.15.7:0/1163596857 learned_addr learned my addr 172.21.15.7:0/1163596857 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:26:23.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.283+0000 7f89067fc640 1 --2- 172.21.15.7:0/2986486643 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f88fc0a32c0 0x7f88fc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.283+0000 7f8914881640 1 --2- 172.21.15.7:0/1163596857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d7abb370 0x5620d7abd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.283+0000 7f8915082640 1 --2- 172.21.15.7:0/1163596857 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5620d7ab62e0 0x5620d7abada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.284+0000 7f8914881640 1 -- 172.21.15.7:0/1163596857 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5620d7ab62e0 msgr2=0x5620d7abada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:26:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.284+0000 7f8914881640 1 --2- 172.21.15.7:0/1163596857 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5620d7ab62e0 0x5620d7abada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.284+0000 7f8915883640 1 --2- 172.21.15.7:0/2986486643 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f88fc0a32c0 0x7f88fc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.284+0000 7f8914881640 1 -- 172.21.15.7:0/1163596857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d7abb370 msgr2=0x5620d7abd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:26:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.284+0000 7f8914881640 1 --2- 172.21.15.7:0/1163596857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d7abb370 0x5620d7abd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.284+0000 7f8914881640 1 -- 172.21.15.7:0/1163596857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620d79c0340 con 0x5620d7ab59a0 2024-09-19T04:26:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.284+0000 7f89067fc640 1 -- 172.21.15.7:0/2986486643 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f89080d01a0 con 0x7f8910107850 2024-09-19T04:26:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.284+0000 7f8914881640 1 --2- 172.21.15.7:0/1163596857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5620d7ab59a0 0x5620d7ab5da0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f89000058a0 tx=0x7f890000b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b1aaa2a9ac99f4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.284+0000 7f88fb7fe640 1 -- 172.21.15.7:0/1163596857 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8900004030 con 0x5620d7ab59a0 2024-09-19T04:26:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.284+0000 7f8915883640 1 --2- 172.21.15.7:0/2986486643 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f88fc0a32c0 0x7f88fc0a5780 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f890800c640 tx=0x7f890806b130 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.284+0000 7f88fb7fe640 1 -- 172.21.15.7:0/1163596857 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8900005500 con 0x5620d7ab59a0 2024-09-19T04:26:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.284+0000 7f88fb7fe640 1 -- 172.21.15.7:0/1163596857 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8900004c00 con 0x5620d7ab59a0 2024-09-19T04:26:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.285+0000 7f891a07f740 1 -- 172.21.15.7:0/1163596857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5620d7ab59a0 msgr2=0x5620d7ab5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.285+0000 7f891a07f740 1 --2- 172.21.15.7:0/1163596857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5620d7ab59a0 0x5620d7ab5da0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f89000058a0 tx=0x7f890000b820 comp rx=0 tx=0).stop 2024-09-19T04:26:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.285+0000 7f891a07f740 1 -- 172.21.15.7:0/1163596857 shutdown_connections 2024-09-19T04:26:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.285+0000 7f891a07f740 1 --2- 172.21.15.7:0/1163596857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d7abb370 0x5620d7abd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.285+0000 7f891a07f740 1 --2- 172.21.15.7:0/1163596857 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5620d7ab62e0 0x5620d7abada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.285+0000 7f891a07f740 1 --2- 172.21.15.7:0/1163596857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5620d7ab59a0 0x5620d7ab5da0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.285+0000 7f891a07f740 1 -- 172.21.15.7:0/1163596857 >> 172.21.15.7:0/1163596857 conn(0x5620d7ab1010 msgr2=0x5620d7ab1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.285+0000 7f891a07f740 1 -- 172.21.15.7:0/1163596857 shutdown_connections 2024-09-19T04:26:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.285+0000 7f891a07f740 1 -- 172.21.15.7:0/1163596857 wait complete. 2024-09-19T04:26:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.285+0000 7f891a07f740 1 -- start start 2024-09-19T04:26:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.285+0000 7f891a07f740 1 Processor -- start 2024-09-19T04:26:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.286+0000 7f891a07f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5620d7ab59a0 0x5620d7abfba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.286+0000 7f891a07f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d7ab62e0 0x5620d7ac00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.286+0000 7f891a07f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5620d7abb370 0x5620d7ac7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.286+0000 7f891a07f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5620d7abe340 con 0x5620d7abb370 2024-09-19T04:26:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.286+0000 7f891a07f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5620d79a2290 con 0x5620d7ab62e0 2024-09-19T04:26:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.286+0000 7f891a07f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5620d7abe4c0 con 0x5620d7ab59a0 2024-09-19T04:26:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.286+0000 7f891a07f740 10 client.0 _ll_register_callbacks cb 0x5620d79d3140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:26:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.286+0000 7f8914881640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5620d7abb370 0x5620d7ac7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.286+0000 7f8914881640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5620d7abb370 0x5620d7ac7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38868/0 (socket says 172.21.15.7:38868) 2024-09-19T04:26:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.286+0000 7f8914881640 1 -- 172.21.15.7:0/3756755828 learned_addr learned my addr 172.21.15.7:0/3756755828 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:26:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.286+0000 7f8914881640 1 --2- 172.21.15.7:0/3756755828 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5620d7ab59a0 0x5620d7abfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.286+0000 7f8915082640 1 --2- 172.21.15.7:0/3756755828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d7ab62e0 0x5620d7ac00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.286+0000 7f8914881640 1 -- 172.21.15.7:0/3756755828 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5620d7ab59a0 msgr2=0x5620d7abfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:26:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.286+0000 7f8914881640 1 --2- 172.21.15.7:0/3756755828 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5620d7ab59a0 0x5620d7abfba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.286+0000 7f8914881640 1 -- 172.21.15.7:0/3756755828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d7ab62e0 msgr2=0x5620d7ac00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:26:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.286+0000 7f8914881640 1 --2- 172.21.15.7:0/3756755828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d7ab62e0 0x5620d7ac00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.286+0000 7f8914881640 1 -- 172.21.15.7:0/3756755828 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620d772c210 con 0x5620d7abb370 2024-09-19T04:26:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.286+0000 7f8914881640 1 --2- 172.21.15.7:0/3756755828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5620d7abb370 0x5620d7ac7120 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f8900004500 tx=0x7f8900005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eecad4b9d18072d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.286+0000 7f88f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:26:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.286+0000 7f88f8ff9640 1 -- 172.21.15.7:0/3756755828 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8900027040 con 0x5620d7abb370 2024-09-19T04:26:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.286+0000 7f891a07f740 1 -- 172.21.15.7:0/3756755828 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8900005500 con 0x5620d7abb370 2024-09-19T04:26:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.286+0000 7f88f8ff9640 1 -- 172.21.15.7:0/3756755828 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f89000049a0 con 0x5620d7abb370 2024-09-19T04:26:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.287+0000 7f88f8ff9640 1 -- 172.21.15.7:0/3756755828 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f8900004ba0 con 0x5620d7abb370 2024-09-19T04:26:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.287+0000 7f891a07f740 10 client.16413 fetch_fsmap learned FSMap version 44 2024-09-19T04:26:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.287+0000 7f891a07f740 1 -- 172.21.15.7:0/3756755828 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5620d77f8620 con 0x5620d7abb370 2024-09-19T04:26:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.287+0000 7f88f8ff9640 1 -- 172.21.15.7:0/3756755828 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8900005500 con 0x5620d7abb370 2024-09-19T04:26:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.287+0000 7f88f8ff9640 1 -- 172.21.15.7:0/3756755828 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 44) ==== 8386+0+0 (secure 0 0 0) 0x7f890001c020 con 0x5620d7abb370 2024-09-19T04:26:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.287+0000 7f891a07f740 10 client.16413 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T04:26:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.287+0000 7f891a07f740 10 client.16413 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:26:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.287+0000 7f891a07f740 20 client.16413 populate_metadata read hostname 'smithi007' 2024-09-19T04:26:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.287+0000 7f891a07f740 1 --2- 172.21.15.7:0/3756755828 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5620d7acb5a0 0x5620d7acd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.287+0000 7f891a07f740 4 client.16413 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:26:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.287+0000 7f891a07f740 1 -- 172.21.15.7:0/3756755828 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620d7a26a20 con 0x5620d7acb5a0 2024-09-19T04:26:23.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.288+0000 7f8915082640 1 --2- 172.21.15.7:0/3756755828 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5620d7acb5a0 0x5620d7acd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:23.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.288+0000 7f8915082640 1 --2- 172.21.15.7:0/3756755828 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5620d7acb5a0 0x5620d7acd990 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97e43fc7349fed84 server_cookie=3994d3174d0ac9a8 in_seq=0 out_seq=0 2024-09-19T04:26:23.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.288+0000 7f88f8ff9640 10 client.16413 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:26:23.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.289+0000 7f88f8ff9640 1 -- 172.21.15.7:0/3756755828 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5620d7a26a20 con 0x5620d7acb5a0 2024-09-19T04:26:23.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.289+0000 7f88f8ff9640 10 client.16413 handle_command_reply: tid=0 2024-09-19T04:26:23.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.289+0000 7f891a07f740 1 client.16413 shutdown 2024-09-19T04:26:23.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.289+0000 7f891a07f740 1 -- 172.21.15.7:0/3756755828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5620d7abb370 msgr2=0x5620d7ac7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:23.303 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.289+0000 7f891a07f740 1 --2- 172.21.15.7:0/3756755828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5620d7abb370 0x5620d7ac7120 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f8900004500 tx=0x7f8900005c50 comp rx=0 tx=0).stop 2024-09-19T04:26:23.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.289+0000 7f891a07f740 1 -- 172.21.15.7:0/3756755828 shutdown_connections 2024-09-19T04:26:23.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.289+0000 7f891a07f740 1 --2- 172.21.15.7:0/3756755828 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5620d7acb5a0 0x5620d7acd990 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.289+0000 7f891a07f740 1 --2- 172.21.15.7:0/3756755828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5620d7abb370 0x5620d7ac7120 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.289+0000 7f891a07f740 1 --2- 172.21.15.7:0/3756755828 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d7ab62e0 0x5620d7ac00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.289+0000 7f88f8ff9640 0 client.16413 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:26:23.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.289+0000 7f891a07f740 1 --2- 172.21.15.7:0/3756755828 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5620d7ab59a0 0x5620d7abfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.289+0000 7f891a07f740 1 -- 172.21.15.7:0/3756755828 >> 172.21.15.7:0/3756755828 conn(0x5620d7ab1010 msgr2=0x5620d7ab2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:23.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.289+0000 7f891a07f740 1 -- 172.21.15.7:0/3756755828 shutdown_connections 2024-09-19T04:26:23.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.289+0000 7f891a07f740 1 -- 172.21.15.7:0/3756755828 wait complete. 2024-09-19T04:26:23.304 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.289+0000 7f891a07f740 20 client.16413 trim_cache size 0 max 16384 2024-09-19T04:26:23.305 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:22 smithi092 ceph-mon[34940]: pgmap v638: 129 pgs: 129 active+clean; 45 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 1007 KiB/s wr, 623 op/s 2024-09-19T04:26:23.305 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:22 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1521408175' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:26:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.304+0000 7f891a07f740 1 Processor -- start 2024-09-19T04:26:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.304+0000 7f891a07f740 1 -- start start 2024-09-19T04:26:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.304+0000 7f891a07f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5620d7ab59a0 0x5620d7ab00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.304+0000 7f891a07f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d7ab62e0 0x5620d7ac70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.304+0000 7f891a07f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5620d7abb370 0x5620d7ad2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.304+0000 7f891a07f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f89101aaa50 con 0x5620d7ab59a0 2024-09-19T04:26:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.304+0000 7f891a07f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f89101ac620 con 0x5620d7ab62e0 2024-09-19T04:26:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.304+0000 7f891a07f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f89101ab150 con 0x5620d7abb370 2024-09-19T04:26:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.304+0000 7f8914881640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5620d7ab59a0 0x5620d7ab00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.304+0000 7f8914881640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5620d7ab59a0 0x5620d7ab00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38870/0 (socket says 172.21.15.7:38870) 2024-09-19T04:26:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.304+0000 7f8914881640 1 -- 172.21.15.7:0/2414024595 learned_addr learned my addr 172.21.15.7:0/2414024595 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:26:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.304+0000 7f8915082640 1 --2- 172.21.15.7:0/2414024595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d7ab62e0 0x5620d7ac70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.304+0000 7f8914881640 1 -- 172.21.15.7:0/2414024595 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5620d7abb370 msgr2=0x5620d7ad2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:26:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.304+0000 7f8914881640 1 --2- 172.21.15.7:0/2414024595 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5620d7abb370 0x5620d7ad2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.304+0000 7f8914881640 1 -- 172.21.15.7:0/2414024595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d7ab62e0 msgr2=0x5620d7ac70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:26:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.304+0000 7f8914881640 1 --2- 172.21.15.7:0/2414024595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d7ab62e0 0x5620d7ac70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.304+0000 7f8914881640 1 -- 172.21.15.7:0/2414024595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620d7ab67c0 con 0x5620d7ab59a0 2024-09-19T04:26:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.304+0000 7f8915082640 1 --2- 172.21.15.7:0/2414024595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d7ab62e0 0x5620d7ac70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:26:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.305+0000 7f8914881640 1 --2- 172.21.15.7:0/2414024595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5620d7ab59a0 0x5620d7ab00b0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f89000124e0 tx=0x7f89000057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a6770cbb0a072b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:23.312 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.305+0000 7f88faffd640 1 -- 172.21.15.7:0/2414024595 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890000b770 con 0x5620d7ab59a0 2024-09-19T04:26:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.305+0000 7f88faffd640 1 -- 172.21.15.7:0/2414024595 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f890001ee50 con 0x5620d7ab59a0 2024-09-19T04:26:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.305+0000 7f88faffd640 1 -- 172.21.15.7:0/2414024595 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890001e430 con 0x5620d7ab59a0 2024-09-19T04:26:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.305+0000 7f891a07f740 1 -- 172.21.15.7:0/2414024595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5620d7ab59a0 msgr2=0x5620d7ab00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.305+0000 7f891a07f740 1 --2- 172.21.15.7:0/2414024595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5620d7ab59a0 0x5620d7ab00b0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f89000124e0 tx=0x7f89000057a0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.305+0000 7f891a07f740 1 -- 172.21.15.7:0/2414024595 shutdown_connections 2024-09-19T04:26:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.305+0000 7f891a07f740 1 --2- 172.21.15.7:0/2414024595 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5620d7abb370 0x5620d7ad2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.305+0000 7f891a07f740 1 --2- 172.21.15.7:0/2414024595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d7ab62e0 0x5620d7ac70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.305+0000 7f891a07f740 1 --2- 172.21.15.7:0/2414024595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5620d7ab59a0 0x5620d7ab00b0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.305+0000 7f891a07f740 1 -- 172.21.15.7:0/2414024595 >> 172.21.15.7:0/2414024595 conn(0x5620d7ab1010 msgr2=0x5620d7aaf9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.306+0000 7f891a07f740 1 -- 172.21.15.7:0/2414024595 shutdown_connections 2024-09-19T04:26:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.306+0000 7f891a07f740 1 -- 172.21.15.7:0/2414024595 wait complete. 2024-09-19T04:26:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.306+0000 7f891a07f740 1 -- start start 2024-09-19T04:26:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.306+0000 7f891a07f740 1 Processor -- start 2024-09-19T04:26:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.306+0000 7f891a07f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5620d7ab59a0 0x5620d7ac4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.306+0000 7f891a07f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5620d7ab62e0 0x5620d7ac54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.306+0000 7f891a07f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d7abb370 0x5620d7ac64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.306+0000 7f891a07f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f89101abf50 con 0x5620d7ab62e0 2024-09-19T04:26:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.306+0000 7f891a07f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f89101ab850 con 0x5620d7abb370 2024-09-19T04:26:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.306+0000 7f891a07f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f89101a8a10 con 0x5620d7ab59a0 2024-09-19T04:26:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.306+0000 7f891a07f740 10 client.0 _ll_register_callbacks cb 0x7f89000123f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:26:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.306+0000 7f8915082640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5620d7ab62e0 0x5620d7ac54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.306+0000 7f8915082640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5620d7ab62e0 0x5620d7ac54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38876/0 (socket says 172.21.15.7:38876) 2024-09-19T04:26:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.306+0000 7f8915082640 1 -- 172.21.15.7:0/2868300227 learned_addr learned my addr 172.21.15.7:0/2868300227 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:26:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.306+0000 7f8914881640 1 --2- 172.21.15.7:0/2868300227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d7abb370 0x5620d7ac64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.307+0000 7f8914881640 1 --2- 172.21.15.7:0/2868300227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5620d7ab59a0 0x5620d7ac4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.307+0000 7f8915082640 1 -- 172.21.15.7:0/2868300227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5620d7ab59a0 msgr2=0x5620d7ac4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:26:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.307+0000 7f8915082640 1 --2- 172.21.15.7:0/2868300227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5620d7ab59a0 0x5620d7ac4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.307+0000 7f8915082640 1 -- 172.21.15.7:0/2868300227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d7abb370 msgr2=0x5620d7ac64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:26:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.307+0000 7f8915082640 1 --2- 172.21.15.7:0/2868300227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d7abb370 0x5620d7ac64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.307+0000 7f8915082640 1 -- 172.21.15.7:0/2868300227 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620d7ac6ae0 con 0x5620d7ab62e0 2024-09-19T04:26:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.307+0000 7f8914881640 1 --2- 172.21.15.7:0/2868300227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d7abb370 0x5620d7ac64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:26:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.307+0000 7f8915082640 1 --2- 172.21.15.7:0/2868300227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5620d7ab62e0 0x5620d7ac54c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f890c009900 tx=0x7f890c032ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2469937b8cfd7cd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.307+0000 7f88f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:26:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.307+0000 7f88f8ff9640 1 -- 172.21.15.7:0/2868300227 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890c035050 con 0x5620d7ab62e0 2024-09-19T04:26:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.307+0000 7f88f8ff9640 1 -- 172.21.15.7:0/2868300227 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f890c005040 con 0x5620d7ab62e0 2024-09-19T04:26:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.307+0000 7f891a07f740 1 -- 172.21.15.7:0/2868300227 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f890001ee50 con 0x5620d7ab62e0 2024-09-19T04:26:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.307+0000 7f88f8ff9640 1 -- 172.21.15.7:0/2868300227 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f890c050050 con 0x5620d7ab62e0 2024-09-19T04:26:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.307+0000 7f891a07f740 10 client.16419 fetch_fsmap learned FSMap version 44 2024-09-19T04:26:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.307+0000 7f891a07f740 1 -- 172.21.15.7:0/2868300227 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5620d7b36950 con 0x5620d7ab62e0 2024-09-19T04:26:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.307+0000 7f88f8ff9640 1 -- 172.21.15.7:0/2868300227 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f890001ee50 con 0x5620d7ab62e0 2024-09-19T04:26:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.308+0000 7f88f8ff9640 1 -- 172.21.15.7:0/2868300227 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 44) ==== 8386+0+0 (secure 0 0 0) 0x7f890c04b030 con 0x5620d7ab62e0 2024-09-19T04:26:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.308+0000 7f891a07f740 10 client.16419 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T04:26:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.308+0000 7f891a07f740 10 client.16419 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T04:26:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.308+0000 7f891a07f740 20 client.16419 populate_metadata read hostname 'smithi007' 2024-09-19T04:26:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.308+0000 7f891a07f740 1 --2- 172.21.15.7:0/2868300227 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5620d7b37380 0x5620d7b397a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.308+0000 7f891a07f740 4 client.16419 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T04:26:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.308+0000 7f891a07f740 1 -- 172.21.15.7:0/2868300227 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5620d7a20d70 con 0x5620d7b37380 2024-09-19T04:26:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.308+0000 7f8914881640 1 --2- 172.21.15.7:0/2868300227 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5620d7b37380 0x5620d7b397a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.308+0000 7f8914881640 1 --2- 172.21.15.7:0/2868300227 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5620d7b37380 0x5620d7b397a0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65214ac8c4e5e76f server_cookie=cf012497ec11c0c3 in_seq=0 out_seq=0 2024-09-19T04:26:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.308+0000 7f88f8ff9640 10 client.16419 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:26:23.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.417+0000 7f88f8ff9640 1 -- 172.21.15.7:0/2868300227 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5620d7a20d70 con 0x5620d7b37380 2024-09-19T04:26:23.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.417+0000 7f88f8ff9640 10 client.16419 handle_command_reply: tid=0 2024-09-19T04:26:23.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.417+0000 7f891a07f740 1 client.16419 shutdown 2024-09-19T04:26:23.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.417+0000 7f891a07f740 1 -- 172.21.15.7:0/2868300227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5620d7ab62e0 msgr2=0x5620d7ac54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:23.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.417+0000 7f891a07f740 1 --2- 172.21.15.7:0/2868300227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5620d7ab62e0 0x5620d7ac54c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f890c009900 tx=0x7f890c032ef0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.417+0000 7f891a07f740 1 -- 172.21.15.7:0/2868300227 shutdown_connections 2024-09-19T04:26:23.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.417+0000 7f891a07f740 1 --2- 172.21.15.7:0/2868300227 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x5620d7b37380 0x5620d7b397a0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.419 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.417+0000 7f891a07f740 1 --2- 172.21.15.7:0/2868300227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5620d7abb370 0x5620d7ac64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.417+0000 7f891a07f740 1 --2- 172.21.15.7:0/2868300227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5620d7ab62e0 0x5620d7ac54c0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.417+0000 7f88f8ff9640 0 client.16419 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:26:23.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.417+0000 7f891a07f740 1 --2- 172.21.15.7:0/2868300227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5620d7ab59a0 0x5620d7ac4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.417+0000 7f891a07f740 1 -- 172.21.15.7:0/2868300227 >> 172.21.15.7:0/2868300227 conn(0x5620d7ab1010 msgr2=0x5620d7ab01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:23.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.417+0000 7f891a07f740 1 -- 172.21.15.7:0/2868300227 shutdown_connections 2024-09-19T04:26:23.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.417+0000 7f891a07f740 1 -- 172.21.15.7:0/2868300227 wait complete. 2024-09-19T04:26:23.420 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.417+0000 7f891a07f740 20 client.16419 trim_cache size 0 max 16384 2024-09-19T04:26:23.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-19T04:26:23.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-19T04:26:23.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-19T04:26:23.421 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-19T04:26:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.418+0000 7f89172e6640 1 -- 172.21.15.7:0/2986486643 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f88fc0a32c0 msgr2=0x7f88fc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.418+0000 7f89172e6640 1 --2- 172.21.15.7:0/2986486643 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f88fc0a32c0 0x7f88fc0a5780 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f890800c640 tx=0x7f890806b130 comp rx=0 tx=0).stop 2024-09-19T04:26:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.418+0000 7f89172e6640 1 -- 172.21.15.7:0/2986486643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8910107850 msgr2=0x7f891019f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.418+0000 7f89172e6640 1 --2- 172.21.15.7:0/2986486643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8910107850 0x7f891019f520 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f890800e9d0 tx=0x7f890800ee90 comp rx=0 tx=0).stop 2024-09-19T04:26:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.418+0000 7f89172e6640 1 -- 172.21.15.7:0/2986486643 shutdown_connections 2024-09-19T04:26:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.418+0000 7f89172e6640 1 --2- 172.21.15.7:0/2986486643 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f88fc0a32c0 0x7f88fc0a5780 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.418+0000 7f89172e6640 1 --2- 172.21.15.7:0/2986486643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8910107850 0x7f891019f520 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.418+0000 7f89172e6640 1 --2- 172.21.15.7:0/2986486643 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8910104f20 0x7f89101984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.418+0000 7f89172e6640 1 --2- 172.21.15.7:0/2986486643 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89101025f0 0x7f8910197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.418+0000 7f89172e6640 1 -- 172.21.15.7:0/2986486643 >> 172.21.15.7:0/2986486643 conn(0x7f89100fc1f0 msgr2=0x7f8910102f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.418+0000 7f89172e6640 1 -- 172.21.15.7:0/2986486643 shutdown_connections 2024-09-19T04:26:23.423 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-19T04:26:23.418+0000 7f89172e6640 1 -- 172.21.15.7:0/2986486643 wait complete. 2024-09-19T04:26:24.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.180+0000 7fbb1571f640 1 -- 172.21.15.7:0/1657505986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb10102ef0 msgr2=0x7fbb1010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:24.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.180+0000 7fbb1571f640 1 --2- 172.21.15.7:0/1657505986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb10102ef0 0x7fbb1010da40 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009ca0 tx=0x7fbb0802a950 comp rx=0 tx=0).stop 2024-09-19T04:26:24.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.180+0000 7fbb1571f640 1 -- 172.21.15.7:0/1657505986 shutdown_connections 2024-09-19T04:26:24.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.180+0000 7fbb1571f640 1 --2- 172.21.15.7:0/1657505986 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb10102ef0 0x7fbb1010da40 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.180+0000 7fbb1571f640 1 --2- 172.21.15.7:0/1657505986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb10102570 0x7fbb101029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.180+0000 7fbb1571f640 1 --2- 172.21.15.7:0/1657505986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb10100e20 0x7fbb10101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.180+0000 7fbb1571f640 1 -- 172.21.15.7:0/1657505986 >> 172.21.15.7:0/1657505986 conn(0x7fbb100fc7d0 msgr2=0x7fbb100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:24.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.180+0000 7fbb1571f640 1 -- 172.21.15.7:0/1657505986 shutdown_connections 2024-09-19T04:26:24.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.180+0000 7fbb1571f640 1 -- 172.21.15.7:0/1657505986 wait complete. 2024-09-19T04:26:24.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.181+0000 7fbb1571f640 1 Processor -- start 2024-09-19T04:26:24.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.181+0000 7fbb1571f640 1 -- start start 2024-09-19T04:26:24.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.181+0000 7fbb1571f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb10100e20 0x7fbb10199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:24.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.181+0000 7fbb1571f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb10102570 0x7fbb101997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:24.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.181+0000 7fbb1571f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb10102ef0 0x7fbb101a42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:24.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.181+0000 7fbb1571f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbb10110f80 con 0x7fbb10102ef0 2024-09-19T04:26:24.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.181+0000 7fbb1571f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbb10110e00 con 0x7fbb10102570 2024-09-19T04:26:24.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.181+0000 7fbb1571f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbb10111100 con 0x7fbb10100e20 2024-09-19T04:26:24.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.181+0000 7fbb0f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb10102ef0 0x7fbb101a42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:24.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.181+0000 7fbb0f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb10102ef0 0x7fbb101a42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38902/0 (socket says 172.21.15.7:38902) 2024-09-19T04:26:24.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.181+0000 7fbb0f7fe640 1 -- 172.21.15.7:0/124756562 learned_addr learned my addr 172.21.15.7:0/124756562 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:26:24.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.181+0000 7fbb0e7fc640 1 --2- 172.21.15.7:0/124756562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb10102570 0x7fbb101997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:24.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.181+0000 7fbb0effd640 1 --2- 172.21.15.7:0/124756562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb10100e20 0x7fbb10199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:24.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.181+0000 7fbb0f7fe640 1 -- 172.21.15.7:0/124756562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb10100e20 msgr2=0x7fbb10199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:24.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.181+0000 7fbb0f7fe640 1 --2- 172.21.15.7:0/124756562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb10100e20 0x7fbb10199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.181+0000 7fbb0f7fe640 1 -- 172.21.15.7:0/124756562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb10102570 msgr2=0x7fbb101997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:24.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.182+0000 7fbb0f7fe640 1 --2- 172.21.15.7:0/124756562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb10102570 0x7fbb101997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.182+0000 7fbb0f7fe640 1 -- 172.21.15.7:0/124756562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb101a4830 con 0x7fbb10102ef0 2024-09-19T04:26:24.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.182+0000 7fbb0f7fe640 1 --2- 172.21.15.7:0/124756562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb10102ef0 0x7fbb101a42f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fbb0802ae70 tx=0x7fbb0802f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:24.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.182+0000 7fbaf7fff640 1 -- 172.21.15.7:0/124756562 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb08034040 con 0x7fbb10102ef0 2024-09-19T04:26:24.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.182+0000 7fbb1571f640 1 -- 172.21.15.7:0/124756562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb101a4a00 con 0x7fbb10102ef0 2024-09-19T04:26:24.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.182+0000 7fbaf7fff640 1 -- 172.21.15.7:0/124756562 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb08030920 con 0x7fbb10102ef0 2024-09-19T04:26:24.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.182+0000 7fbaf7fff640 1 -- 172.21.15.7:0/124756562 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb08045480 con 0x7fbb10102ef0 2024-09-19T04:26:24.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.182+0000 7fbb1571f640 1 -- 172.21.15.7:0/124756562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb101a4eb0 con 0x7fbb10102ef0 2024-09-19T04:26:24.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.184+0000 7fbaf7fff640 1 -- 172.21.15.7:0/124756562 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fbb08037020 con 0x7fbb10102ef0 2024-09-19T04:26:24.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.185+0000 7fbb17af8740 1 Processor -- start 2024-09-19T04:26:24.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.185+0000 7fbb17af8740 1 -- start start 2024-09-19T04:26:24.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.185+0000 7fbb17af8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d067f9a00 0x556d067f9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:24.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.185+0000 7fbb17af8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d067fa320 0x556d068046a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:24.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.185+0000 7fbb17af8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d06804be0 0x556d06806fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:24.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.185+0000 7fbb17af8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556d0675e200 con 0x556d06804be0 2024-09-19T04:26:24.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.185+0000 7fbb17af8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556d06704dc0 con 0x556d067fa320 2024-09-19T04:26:24.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.185+0000 7fbb17af8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556d0675a1c0 con 0x556d067f9a00 2024-09-19T04:26:24.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.185+0000 7fbb0e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d06804be0 0x556d06806fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:24.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.185+0000 7fbb0e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d06804be0 0x556d06806fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38906/0 (socket says 172.21.15.7:38906) 2024-09-19T04:26:24.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.185+0000 7fbb0e7fc640 1 -- 172.21.15.7:0/2154982938 learned_addr learned my addr 172.21.15.7:0/2154982938 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:26:24.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.185+0000 7fbaf7fff640 1 --2- 172.21.15.7:0/124756562 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fbaf80a3240 0x7fbaf80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:24.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.185+0000 7fbb0effd640 1 --2- 172.21.15.7:0/2154982938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d067fa320 0x556d068046a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:24.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.185+0000 7fbb0e7fc640 1 --2- 172.21.15.7:0/2154982938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d067f9a00 0x556d067f9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:24.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.185+0000 7fbb0f7fe640 1 --2- 172.21.15.7:0/124756562 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fbaf80a3240 0x7fbaf80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:24.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.185+0000 7fbb0e7fc640 1 -- 172.21.15.7:0/2154982938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d067f9a00 msgr2=0x556d067f9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:26:24.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.185+0000 7fbb0e7fc640 1 --2- 172.21.15.7:0/2154982938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d067f9a00 0x556d067f9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.185+0000 7fbaf7fff640 1 -- 172.21.15.7:0/124756562 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fbb080f0b40 con 0x7fbb10102ef0 2024-09-19T04:26:24.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.185+0000 7fbb0e7fc640 1 -- 172.21.15.7:0/2154982938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d067fa320 msgr2=0x556d068046a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:26:24.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.185+0000 7fbb0e7fc640 1 --2- 172.21.15.7:0/2154982938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d067fa320 0x556d068046a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.186+0000 7fbb0e7fc640 1 -- 172.21.15.7:0/2154982938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d064cf620 con 0x556d06804be0 2024-09-19T04:26:24.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.186+0000 7fbb0effd640 1 --2- 172.21.15.7:0/2154982938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d067fa320 0x556d068046a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:26:24.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.186+0000 7fbb0e7fc640 1 --2- 172.21.15.7:0/2154982938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d06804be0 0x556d06806fd0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fbb04012740 tx=0x7fbb0400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9688bded7cb9d51b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:24.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.186+0000 7fbb0f7fe640 1 --2- 172.21.15.7:0/124756562 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fbaf80a3240 0x7fbaf80a5700 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbb08006010 tx=0x7fbb080877d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:24.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.186+0000 7fbaf57fa640 1 -- 172.21.15.7:0/2154982938 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb04012cc0 con 0x556d06804be0 2024-09-19T04:26:24.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.186+0000 7fbaf57fa640 1 -- 172.21.15.7:0/2154982938 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb04010c50 con 0x556d06804be0 2024-09-19T04:26:24.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.186+0000 7fbaf57fa640 1 -- 172.21.15.7:0/2154982938 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0401eaf0 con 0x556d06804be0 2024-09-19T04:26:24.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.187+0000 7fbb17af8740 1 -- 172.21.15.7:0/2154982938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d06804be0 msgr2=0x556d06806fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:24.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.187+0000 7fbb17af8740 1 --2- 172.21.15.7:0/2154982938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d06804be0 0x556d06806fd0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fbb04012740 tx=0x7fbb0400b700 comp rx=0 tx=0).stop 2024-09-19T04:26:24.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.187+0000 7fbb17af8740 1 -- 172.21.15.7:0/2154982938 shutdown_connections 2024-09-19T04:26:24.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.187+0000 7fbb17af8740 1 --2- 172.21.15.7:0/2154982938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d06804be0 0x556d06806fd0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.187+0000 7fbb17af8740 1 --2- 172.21.15.7:0/2154982938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d067fa320 0x556d068046a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.187+0000 7fbb17af8740 1 --2- 172.21.15.7:0/2154982938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d067f9a00 0x556d067f9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.187+0000 7fbb17af8740 1 -- 172.21.15.7:0/2154982938 >> 172.21.15.7:0/2154982938 conn(0x556d067f5f90 msgr2=0x556d067f6370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:24.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.187+0000 7fbb17af8740 1 -- 172.21.15.7:0/2154982938 shutdown_connections 2024-09-19T04:26:24.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.187+0000 7fbb17af8740 1 -- 172.21.15.7:0/2154982938 wait complete. 2024-09-19T04:26:24.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.187+0000 7fbb17af8740 1 -- start start 2024-09-19T04:26:24.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.187+0000 7fbb17af8740 1 Processor -- start 2024-09-19T04:26:24.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.187+0000 7fbb17af8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d067f9a00 0x556d06804520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:24.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.188+0000 7fbb17af8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d067fa320 0x556d068017d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:24.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.188+0000 7fbb17af8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d06804be0 0x556d06801d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:24.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.188+0000 7fbb17af8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556d068077b0 con 0x556d067fa320 2024-09-19T04:26:24.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.188+0000 7fbb17af8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556d066f8c50 con 0x556d06804be0 2024-09-19T04:26:24.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.188+0000 7fbb17af8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556d06807930 con 0x556d067f9a00 2024-09-19T04:26:24.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.188+0000 7fbb17af8740 10 client.0 _ll_register_callbacks cb 0x556d0670aba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:26:24.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.188+0000 7fbb0effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d067fa320 0x556d068017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:24.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.188+0000 7fbb0effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d067fa320 0x556d068017d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38914/0 (socket says 172.21.15.7:38914) 2024-09-19T04:26:24.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.188+0000 7fbb0effd640 1 -- 172.21.15.7:0/1842990826 learned_addr learned my addr 172.21.15.7:0/1842990826 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:26:24.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.188+0000 7fbb0e7fc640 1 --2- 172.21.15.7:0/1842990826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d06804be0 0x556d06801d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:24.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.188+0000 7fbb0e7fc640 1 --2- 172.21.15.7:0/1842990826 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d067f9a00 0x556d06804520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:24.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.188+0000 7fbb0effd640 1 -- 172.21.15.7:0/1842990826 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d067f9a00 msgr2=0x556d06804520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:26:24.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.188+0000 7fbb0effd640 1 --2- 172.21.15.7:0/1842990826 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d067f9a00 0x556d06804520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.188+0000 7fbb0effd640 1 -- 172.21.15.7:0/1842990826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d06804be0 msgr2=0x556d06801d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:26:24.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.188+0000 7fbb0effd640 1 --2- 172.21.15.7:0/1842990826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d06804be0 0x556d06801d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.188+0000 7fbb0effd640 1 -- 172.21.15.7:0/1842990826 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d06802540 con 0x556d067fa320 2024-09-19T04:26:24.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.188+0000 7fbb0e7fc640 1 --2- 172.21.15.7:0/1842990826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d06804be0 0x556d06801d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:26:24.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.188+0000 7fbb0effd640 1 --2- 172.21.15.7:0/1842990826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d067fa320 0x556d068017d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fbb00010820 tx=0x7fbb00010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6baf4425d08a9a0a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:24.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.188+0000 7fbaf2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:26:24.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.188+0000 7fbaf2ff5640 1 -- 172.21.15.7:0/1842990826 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0000fb90 con 0x556d067fa320 2024-09-19T04:26:24.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.188+0000 7fbaf2ff5640 1 -- 172.21.15.7:0/1842990826 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fbb0000fd30 con 0x556d067fa320 2024-09-19T04:26:24.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.188+0000 7fbb17af8740 1 -- 172.21.15.7:0/1842990826 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb04010c50 con 0x556d067fa320 2024-09-19T04:26:24.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.189+0000 7fbaf2ff5640 1 -- 172.21.15.7:0/1842990826 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fbb00024050 con 0x556d067fa320 2024-09-19T04:26:24.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.189+0000 7fbb17af8740 10 client.16431 fetch_fsmap learned FSMap version 44 2024-09-19T04:26:24.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.189+0000 7fbb17af8740 1 -- 172.21.15.7:0/1842990826 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x556d06813410 con 0x556d067fa320 2024-09-19T04:26:24.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.189+0000 7fbaf2ff5640 1 -- 172.21.15.7:0/1842990826 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb04010c50 con 0x556d067fa320 2024-09-19T04:26:24.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.189+0000 7fbaf2ff5640 1 -- 172.21.15.7:0/1842990826 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 44) ==== 8386+0+0 (secure 0 0 0) 0x7fbb00019410 con 0x556d067fa320 2024-09-19T04:26:24.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.189+0000 7fbb17af8740 10 client.16431 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T04:26:24.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.189+0000 7fbb17af8740 10 client.16431 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:26:24.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.189+0000 7fbb17af8740 20 client.16431 populate_metadata read hostname 'smithi007' 2024-09-19T04:26:24.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.189+0000 7fbb17af8740 1 --2- 172.21.15.7:0/1842990826 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x556d06814970 0x556d06816d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:24.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.189+0000 7fbb17af8740 4 client.16431 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:26:24.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.189+0000 7fbb17af8740 1 -- 172.21.15.7:0/1842990826 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d0676b770 con 0x556d06814970 2024-09-19T04:26:24.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.189+0000 7fbb0e7fc640 1 --2- 172.21.15.7:0/1842990826 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x556d06814970 0x556d06816d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:24.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.190+0000 7fbaf2ff5640 10 client.16431 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:26:24.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.190+0000 7fbb0e7fc640 1 --2- 172.21.15.7:0/1842990826 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x556d06814970 0x556d06816d90 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=928c7e80415ab483 server_cookie=e5366baf9ad9ac7b in_seq=0 out_seq=0 2024-09-19T04:26:24.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.190+0000 7fbaf2ff5640 1 -- 172.21.15.7:0/1842990826 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556d0676b770 con 0x556d06814970 2024-09-19T04:26:24.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.190+0000 7fbaf2ff5640 10 client.16431 handle_command_reply: tid=0 2024-09-19T04:26:24.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.190+0000 7fbb17af8740 1 client.16431 shutdown 2024-09-19T04:26:24.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.190+0000 7fbb17af8740 1 -- 172.21.15.7:0/1842990826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d067fa320 msgr2=0x556d068017d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:24.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.190+0000 7fbb17af8740 1 --2- 172.21.15.7:0/1842990826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d067fa320 0x556d068017d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fbb00010820 tx=0x7fbb00010ce0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.191+0000 7fbb17af8740 1 -- 172.21.15.7:0/1842990826 shutdown_connections 2024-09-19T04:26:24.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.191+0000 7fbb17af8740 1 --2- 172.21.15.7:0/1842990826 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x556d06814970 0x556d06816d90 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.191+0000 7fbb17af8740 1 --2- 172.21.15.7:0/1842990826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d06804be0 0x556d06801d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.191+0000 7fbb17af8740 1 --2- 172.21.15.7:0/1842990826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d067fa320 0x556d068017d0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.191+0000 7fbaf2ff5640 0 client.16431 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:26:24.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.191+0000 7fbb17af8740 1 --2- 172.21.15.7:0/1842990826 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d067f9a00 0x556d06804520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.191+0000 7fbb17af8740 1 -- 172.21.15.7:0/1842990826 >> 172.21.15.7:0/1842990826 conn(0x556d067f5f90 msgr2=0x556d067f51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:24.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.191+0000 7fbb17af8740 1 -- 172.21.15.7:0/1842990826 shutdown_connections 2024-09-19T04:26:24.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.191+0000 7fbb17af8740 1 -- 172.21.15.7:0/1842990826 wait complete. 2024-09-19T04:26:24.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.191+0000 7fbb17af8740 20 client.16431 trim_cache size 0 max 16384 2024-09-19T04:26:24.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.208+0000 7fbb17af8740 1 Processor -- start 2024-09-19T04:26:24.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.208+0000 7fbb17af8740 1 -- start start 2024-09-19T04:26:24.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.208+0000 7fbb17af8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d067f5f90 0x556d06800af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:24.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.208+0000 7fbb17af8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d067f9a00 0x556d068036a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:24.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.208+0000 7fbb17af8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d067fa320 0x556d06810a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:24.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.208+0000 7fbb17af8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbb101aecc0 con 0x556d067f5f90 2024-09-19T04:26:24.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.208+0000 7fbb17af8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbb101b0890 con 0x556d067f9a00 2024-09-19T04:26:24.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.208+0000 7fbb17af8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbb101af3c0 con 0x556d067fa320 2024-09-19T04:26:24.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.208+0000 7fbb0e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d067f5f90 0x556d06800af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:24.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.208+0000 7fbb0e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d067f5f90 0x556d06800af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38920/0 (socket says 172.21.15.7:38920) 2024-09-19T04:26:24.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.208+0000 7fbb0e7fc640 1 -- 172.21.15.7:0/796737432 learned_addr learned my addr 172.21.15.7:0/796737432 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:26:24.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.208+0000 7fbb0effd640 1 --2- 172.21.15.7:0/796737432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d067f9a00 0x556d068036a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:24.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.208+0000 7fbb0e7fc640 1 -- 172.21.15.7:0/796737432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d067fa320 msgr2=0x556d06810a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:26:24.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.208+0000 7fbb0e7fc640 1 --2- 172.21.15.7:0/796737432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d067fa320 0x556d06810a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.208+0000 7fbb0e7fc640 1 -- 172.21.15.7:0/796737432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d067f9a00 msgr2=0x556d068036a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:26:24.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.208+0000 7fbb0e7fc640 1 --2- 172.21.15.7:0/796737432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d067f9a00 0x556d068036a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.208+0000 7fbb0e7fc640 1 -- 172.21.15.7:0/796737432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d067f7120 con 0x556d067f5f90 2024-09-19T04:26:24.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.209+0000 7fbb0e7fc640 1 --2- 172.21.15.7:0/796737432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d067f5f90 0x556d06800af0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fbb0401e700 tx=0x7fbb0401e730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8add3d835aa853e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:24.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.209+0000 7fbaf4ff9640 1 -- 172.21.15.7:0/796737432 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb04024040 con 0x556d067f5f90 2024-09-19T04:26:24.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.209+0000 7fbaf4ff9640 1 -- 172.21.15.7:0/796737432 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb04005520 con 0x556d067f5f90 2024-09-19T04:26:24.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.209+0000 7fbaf4ff9640 1 -- 172.21.15.7:0/796737432 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0401ea00 con 0x556d067f5f90 2024-09-19T04:26:24.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.209+0000 7fbb17af8740 1 -- 172.21.15.7:0/796737432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d067f5f90 msgr2=0x556d06800af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:24.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.209+0000 7fbb17af8740 1 --2- 172.21.15.7:0/796737432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d067f5f90 0x556d06800af0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fbb0401e700 tx=0x7fbb0401e730 comp rx=0 tx=0).stop 2024-09-19T04:26:24.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.209+0000 7fbb17af8740 1 -- 172.21.15.7:0/796737432 shutdown_connections 2024-09-19T04:26:24.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.209+0000 7fbb17af8740 1 --2- 172.21.15.7:0/796737432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d067fa320 0x556d06810a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.209+0000 7fbb17af8740 1 --2- 172.21.15.7:0/796737432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d067f9a00 0x556d068036a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.209+0000 7fbb17af8740 1 --2- 172.21.15.7:0/796737432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d067f5f90 0x556d06800af0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.209+0000 7fbb17af8740 1 -- 172.21.15.7:0/796737432 >> 172.21.15.7:0/796737432 conn(0x556d067f1520 msgr2=0x556d067f49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:24.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.210+0000 7fbb17af8740 1 -- 172.21.15.7:0/796737432 shutdown_connections 2024-09-19T04:26:24.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.210+0000 7fbb17af8740 1 -- 172.21.15.7:0/796737432 wait complete. 2024-09-19T04:26:24.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.210+0000 7fbb17af8740 1 -- start start 2024-09-19T04:26:24.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.210+0000 7fbb17af8740 1 Processor -- start 2024-09-19T04:26:24.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.210+0000 7fbb17af8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d067f5f90 0x556d06809050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:24.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.210+0000 7fbb17af8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d067f9a00 0x556d06809590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:24.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.210+0000 7fbb17af8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d067fa320 0x556d0687e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:24.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.210+0000 7fbb17af8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbb101b01c0 con 0x556d067f9a00 2024-09-19T04:26:24.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.210+0000 7fbb17af8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbb101afac0 con 0x556d067fa320 2024-09-19T04:26:24.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.210+0000 7fbb17af8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbb101acc80 con 0x556d067f5f90 2024-09-19T04:26:24.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.210+0000 7fbb17af8740 10 client.0 _ll_register_callbacks cb 0x7fbb00010430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:26:24.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.210+0000 7fbb0effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d067f9a00 0x556d06809590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:24.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.210+0000 7fbb0effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d067f9a00 0x556d06809590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38930/0 (socket says 172.21.15.7:38930) 2024-09-19T04:26:24.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.210+0000 7fbb0effd640 1 -- 172.21.15.7:0/2648226950 learned_addr learned my addr 172.21.15.7:0/2648226950 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:26:24.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.211+0000 7fbb0e7fc640 1 --2- 172.21.15.7:0/2648226950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d067fa320 0x556d0687e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:24.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.211+0000 7fbb0e7fc640 1 --2- 172.21.15.7:0/2648226950 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d067f5f90 0x556d06809050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:24.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.211+0000 7fbb0effd640 1 -- 172.21.15.7:0/2648226950 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d067f5f90 msgr2=0x556d06809050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:26:24.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.211+0000 7fbb0effd640 1 --2- 172.21.15.7:0/2648226950 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d067f5f90 0x556d06809050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.211+0000 7fbb0effd640 1 -- 172.21.15.7:0/2648226950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d067fa320 msgr2=0x556d0687e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:26:24.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.211+0000 7fbb0effd640 1 --2- 172.21.15.7:0/2648226950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d067fa320 0x556d0687e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.211+0000 7fbb0effd640 1 -- 172.21.15.7:0/2648226950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d0687eb70 con 0x556d067f9a00 2024-09-19T04:26:24.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.211+0000 7fbb0e7fc640 1 --2- 172.21.15.7:0/2648226950 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d067f5f90 0x556d06809050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:26:24.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.211+0000 7fbb0effd640 1 --2- 172.21.15.7:0/2648226950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d067f9a00 0x556d06809590 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fbb00019830 tx=0x7fbb00019b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b17b6a697523823d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:24.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.211+0000 7fbaf2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-19T04:26:24.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.211+0000 7fbaf2ff5640 1 -- 172.21.15.7:0/2648226950 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb00019620 con 0x556d067f9a00 2024-09-19T04:26:24.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.211+0000 7fbaf2ff5640 1 -- 172.21.15.7:0/2648226950 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fbb0000fb90 con 0x556d067f9a00 2024-09-19T04:26:24.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.211+0000 7fbb17af8740 1 -- 172.21.15.7:0/2648226950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb04005520 con 0x556d067f9a00 2024-09-19T04:26:24.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.211+0000 7fbaf2ff5640 1 -- 172.21.15.7:0/2648226950 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fbb00035050 con 0x556d067f9a00 2024-09-19T04:26:24.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.211+0000 7fbb17af8740 10 client.16437 fetch_fsmap learned FSMap version 44 2024-09-19T04:26:24.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.211+0000 7fbb17af8740 1 -- 172.21.15.7:0/2648226950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x556d0687fe50 con 0x556d067f9a00 2024-09-19T04:26:24.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.212+0000 7fbaf2ff5640 1 -- 172.21.15.7:0/2648226950 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb04005520 con 0x556d067f9a00 2024-09-19T04:26:24.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.212+0000 7fbaf2ff5640 1 -- 172.21.15.7:0/2648226950 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 44) ==== 8386+0+0 (secure 0 0 0) 0x7fbb00030030 con 0x556d067f9a00 2024-09-19T04:26:24.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.212+0000 7fbb17af8740 10 client.16437 fetch_fsmap finished waiting for FSMap version 44 2024-09-19T04:26:24.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.212+0000 7fbb17af8740 10 client.16437 resolve_mds: validated gid 24506 aka daemon mds.b 2024-09-19T04:26:24.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.212+0000 7fbb17af8740 20 client.16437 populate_metadata read hostname 'smithi007' 2024-09-19T04:26:24.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.212+0000 7fbb17af8740 1 --2- 172.21.15.7:0/2648226950 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x556d06804be0 0x556d06882690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:24.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.212+0000 7fbb17af8740 4 client.16437 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-19T04:26:24.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.212+0000 7fbb17af8740 1 -- 172.21.15.7:0/2648226950 --> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x556d06765c80 con 0x556d06804be0 2024-09-19T04:26:24.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.212+0000 7fbb0e7fc640 1 --2- 172.21.15.7:0/2648226950 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x556d06804be0 0x556d06882690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:24.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.212+0000 7fbb0e7fc640 1 --2- 172.21.15.7:0/2648226950 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x556d06804be0 0x556d06882690 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd79f11a2ba4174d server_cookie=6713a286d7d9805a in_seq=0 out_seq=0 2024-09-19T04:26:24.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.212+0000 7fbaf2ff5640 10 client.16437 ms_handle_connect on v2:172.21.15.92:6838/3805481296 2024-09-19T04:26:24.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.213+0000 7fbaf2ff5640 1 -- 172.21.15.7:0/2648226950 <== mds.0 v2:172.21.15.92:6838/3805481296 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x556d06765c80 con 0x556d06804be0 2024-09-19T04:26:24.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.213+0000 7fbaf2ff5640 10 client.16437 handle_command_reply: tid=0 2024-09-19T04:26:24.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.213+0000 7fbb17af8740 1 client.16437 shutdown 2024-09-19T04:26:24.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.213+0000 7fbb17af8740 1 -- 172.21.15.7:0/2648226950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d067f9a00 msgr2=0x556d06809590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:24.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.213+0000 7fbb17af8740 1 --2- 172.21.15.7:0/2648226950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d067f9a00 0x556d06809590 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fbb00019830 tx=0x7fbb00019b20 comp rx=0 tx=0).stop 2024-09-19T04:26:24.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.213+0000 7fbb17af8740 1 -- 172.21.15.7:0/2648226950 shutdown_connections 2024-09-19T04:26:24.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.213+0000 7fbb17af8740 1 --2- 172.21.15.7:0/2648226950 >> [v2:172.21.15.92:6838/3805481296,v1:172.21.15.92:6839/3805481296] conn(0x556d06804be0 0x556d06882690 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.213+0000 7fbb17af8740 1 --2- 172.21.15.7:0/2648226950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556d067fa320 0x556d0687e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.213+0000 7fbb17af8740 1 --2- 172.21.15.7:0/2648226950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556d067f9a00 0x556d06809590 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.213+0000 7fbaf2ff5640 0 client.16437 ms_handle_reset on v2:172.21.15.92:6838/3805481296 2024-09-19T04:26:24.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.213+0000 7fbb17af8740 1 --2- 172.21.15.7:0/2648226950 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d067f5f90 0x556d06809050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.213+0000 7fbb17af8740 1 -- 172.21.15.7:0/2648226950 >> 172.21.15.7:0/2648226950 conn(0x556d067f1520 msgr2=0x556d067f51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:24.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.213+0000 7fbb17af8740 1 -- 172.21.15.7:0/2648226950 shutdown_connections 2024-09-19T04:26:24.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.213+0000 7fbb17af8740 1 -- 172.21.15.7:0/2648226950 wait complete. 2024-09-19T04:26:24.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.213+0000 7fbb17af8740 20 client.16437 trim_cache size 0 max 16384 2024-09-19T04:26:24.363 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:26:24.363 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 44, 2024-09-19T04:26:24.363 INFO:teuthology.orchestra.run.smithi007.stdout: "leader": 24506, 2024-09-19T04:26:24.363 INFO:teuthology.orchestra.run.smithi007.stdout: "set_version": 32, 2024-09-19T04:26:24.363 INFO:teuthology.orchestra.run.smithi007.stdout: "sets": {} 2024-09-19T04:26:24.363 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:26:24.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.214+0000 7fbb1571f640 1 -- 172.21.15.7:0/124756562 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fbaf80a3240 msgr2=0x7fbaf80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:24.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.214+0000 7fbb1571f640 1 --2- 172.21.15.7:0/124756562 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fbaf80a3240 0x7fbaf80a5700 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbb08006010 tx=0x7fbb080877d0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.214+0000 7fbb1571f640 1 -- 172.21.15.7:0/124756562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb10102ef0 msgr2=0x7fbb101a42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:24.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.214+0000 7fbb1571f640 1 --2- 172.21.15.7:0/124756562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb10102ef0 0x7fbb101a42f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fbb0802ae70 tx=0x7fbb0802f5d0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.214+0000 7fbb1571f640 1 -- 172.21.15.7:0/124756562 shutdown_connections 2024-09-19T04:26:24.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.214+0000 7fbb1571f640 1 --2- 172.21.15.7:0/124756562 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fbaf80a3240 0x7fbaf80a5700 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.214+0000 7fbb1571f640 1 --2- 172.21.15.7:0/124756562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbb10102ef0 0x7fbb101a42f0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.214+0000 7fbb1571f640 1 --2- 172.21.15.7:0/124756562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb10102570 0x7fbb101997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.214+0000 7fbb1571f640 1 --2- 172.21.15.7:0/124756562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb10100e20 0x7fbb10199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:24.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.214+0000 7fbb1571f640 1 -- 172.21.15.7:0/124756562 >> 172.21.15.7:0/124756562 conn(0x7fbb100fc7d0 msgr2=0x7fbb100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:24.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.214+0000 7fbb1571f640 1 -- 172.21.15.7:0/124756562 shutdown_connections 2024-09-19T04:26:24.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:24.214+0000 7fbb1571f640 1 -- 172.21.15.7:0/124756562 wait complete. 2024-09-19T04:26:24.907 INFO:tasks.quiescer:done joining Quiescers 2024-09-19T04:26:24.908 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-19T04:26:24.920 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi007.front.sepia.ceph.com 2024-09-19T04:26:24.928 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-19T04:26:24.938 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T04:26:25.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.074+0000 7fe4210a6640 1 -- 172.21.15.7:0/1290842677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe41c1025d0 msgr2=0x7fe41c1049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:25.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.074+0000 7fe4210a6640 1 --2- 172.21.15.7:0/1290842677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe41c1025d0 0x7fe41c1049c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fe40c009ca0 tx=0x7fe40c02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.074+0000 7fe4210a6640 1 -- 172.21.15.7:0/1290842677 shutdown_connections 2024-09-19T04:26:25.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.074+0000 7fe4210a6640 1 --2- 172.21.15.7:0/1290842677 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe41c107830 0x7fe41c109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.074+0000 7fe4210a6640 1 --2- 172.21.15.7:0/1290842677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe41c104f00 0x7fe41c1072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.074+0000 7fe4210a6640 1 --2- 172.21.15.7:0/1290842677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe41c1025d0 0x7fe41c1049c0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.074+0000 7fe4210a6640 1 -- 172.21.15.7:0/1290842677 >> 172.21.15.7:0/1290842677 conn(0x7fe41c0fc190 msgr2=0x7fe41c0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:25.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.074+0000 7fe4210a6640 1 -- 172.21.15.7:0/1290842677 shutdown_connections 2024-09-19T04:26:25.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.074+0000 7fe4210a6640 1 -- 172.21.15.7:0/1290842677 wait complete. 2024-09-19T04:26:25.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.075+0000 7fe4210a6640 1 Processor -- start 2024-09-19T04:26:25.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.075+0000 7fe4210a6640 1 -- start start 2024-09-19T04:26:25.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.075+0000 7fe4210a6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe41c1025d0 0x7fe41c197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:25.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.075+0000 7fe4210a6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe41c104f00 0x7fe41c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:25.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.075+0000 7fe4210a6640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe41c107830 0x7fe41c19f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:25.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.075+0000 7fe4210a6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe41c10d810 con 0x7fe41c1025d0 2024-09-19T04:26:25.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.075+0000 7fe4210a6640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe41c10d690 con 0x7fe41c107830 2024-09-19T04:26:25.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.075+0000 7fe4210a6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe41c10d990 con 0x7fe41c104f00 2024-09-19T04:26:25.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.075+0000 7fe41ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe41c1025d0 0x7fe41c197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:25.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.075+0000 7fe41ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe41c1025d0 0x7fe41c197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38950/0 (socket says 172.21.15.7:38950) 2024-09-19T04:26:25.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.075+0000 7fe41ad9d640 1 -- 172.21.15.7:0/493166200 learned_addr learned my addr 172.21.15.7:0/493166200 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:26:25.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.076+0000 7fe41a59c640 1 --2- 172.21.15.7:0/493166200 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe41c104f00 0x7fe41c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:25.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.076+0000 7fe41b59e640 1 --2- 172.21.15.7:0/493166200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe41c107830 0x7fe41c19f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:25.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.076+0000 7fe41ad9d640 1 -- 172.21.15.7:0/493166200 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe41c104f00 msgr2=0x7fe41c198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:25.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.076+0000 7fe41ad9d640 1 --2- 172.21.15.7:0/493166200 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe41c104f00 0x7fe41c198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.076+0000 7fe41ad9d640 1 -- 172.21.15.7:0/493166200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe41c107830 msgr2=0x7fe41c19f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:25.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.076+0000 7fe41ad9d640 1 --2- 172.21.15.7:0/493166200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe41c107830 0x7fe41c19f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.076+0000 7fe41ad9d640 1 -- 172.21.15.7:0/493166200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe41c19faf0 con 0x7fe41c1025d0 2024-09-19T04:26:25.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.076+0000 7fe41ad9d640 1 --2- 172.21.15.7:0/493166200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe41c1025d0 0x7fe41c197ed0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fe40c031a40 tx=0x7fe40c031ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:25.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.076+0000 7fe413fff640 1 -- 172.21.15.7:0/493166200 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40c02faa0 con 0x7fe41c1025d0 2024-09-19T04:26:25.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.076+0000 7fe4210a6640 1 -- 172.21.15.7:0/493166200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe41c19fd80 con 0x7fe41c1025d0 2024-09-19T04:26:25.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.076+0000 7fe413fff640 1 -- 172.21.15.7:0/493166200 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe40c02fc40 con 0x7fe41c1025d0 2024-09-19T04:26:25.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.076+0000 7fe413fff640 1 -- 172.21.15.7:0/493166200 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40c03a790 con 0x7fe41c1025d0 2024-09-19T04:26:25.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.076+0000 7fe4210a6640 1 -- 172.21.15.7:0/493166200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe41c1a0240 con 0x7fe41c1025d0 2024-09-19T04:26:25.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.077+0000 7fe4210a6640 1 -- 172.21.15.7:0/493166200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe41c0fdc80 con 0x7fe41c1025d0 2024-09-19T04:26:25.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.079+0000 7fe413fff640 1 -- 172.21.15.7:0/493166200 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fe40c030b30 con 0x7fe41c1025d0 2024-09-19T04:26:25.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.079+0000 7fe413fff640 1 --2- 172.21.15.7:0/493166200 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe4080a3250 0x7fe4080a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:25.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.079+0000 7fe413fff640 1 -- 172.21.15.7:0/493166200 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fe40c0f1550 con 0x7fe41c1025d0 2024-09-19T04:26:25.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.079+0000 7fe41a59c640 1 --2- 172.21.15.7:0/493166200 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe4080a3250 0x7fe4080a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:25.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.080+0000 7fe41a59c640 1 --2- 172.21.15.7:0/493166200 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe4080a3250 0x7fe4080a5710 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe41c1993e0 tx=0x7fe40400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:25.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.083+0000 7fe413fff640 1 -- 172.21.15.7:0/493166200 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe40c0bdea0 con 0x7fe41c1025d0 2024-09-19T04:26:25.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:24 smithi007 ceph-mon[31360]: pgmap v639: 129 pgs: 129 active+clean; 38 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 705 op/s 2024-09-19T04:26:25.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:24 smithi102 ceph-mon[35446]: pgmap v639: 129 pgs: 129 active+clean; 38 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 705 op/s 2024-09-19T04:26:25.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.263+0000 7fe4210a6640 1 -- 172.21.15.7:0/493166200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe41c02d9c0 con 0x7fe41c1025d0 2024-09-19T04:26:25.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.265+0000 7fe413fff640 1 -- 172.21.15.7:0/493166200 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24861 (secure 0 0 0) 0x7fe40c0bd7a0 con 0x7fe41c1025d0 2024-09-19T04:26:25.267 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:26:25.268 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":90,"fsid":"77957c0a-763c-11ef-bceb-c7b262605968","created":"2024-09-19T04:06:58.337394+0000","modified":"2024-09-19T04:16:47.053920+0000","last_up_change":"2024-09-19T04:13:42.312137+0000","last_in_change":"2024-09-19T04:13:18.757925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:09:59.544984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:14:30.225637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:14:32.252497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T04:14:38.781821+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d9b93bd5-ee22-4fb0-ba29-bfa208430a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6803","nonce":240599233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6805","nonce":240599233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6809","nonce":240599233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6807","nonce":240599233}]},"public_addr":"172.21.15.7:6803/240599233","cluster_addr":"172.21.15.7:6805/240599233","heartbeat_back_addr":"172.21.15.7:6809/240599233","heartbeat_front_addr":"172.21.15.7:6807/240599233","state":["exists","up"]},{"osd":1,"uuid":"db5793e6-f3ad-4075-a02b-206bf7f1e59a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6801","nonce":902403333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6803","nonce":902403333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6807","nonce":902403333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6805","nonce":902403333}]},"public_addr":"172.21.15.92:6801/902403333","cluster_addr":"172.21.15.92:6803/902403333","heartbeat_back_addr":"172.21.15.92:6807/902403333","heartbeat_front_addr":"172.21.15.92:6805/902403333","state":["exists","up"]},{"osd":2,"uuid":"1eb83a1b-82d8-4983-bae3-b161adb3a33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6801","nonce":2078441772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6803","nonce":2078441772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6807","nonce":2078441772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6805","nonce":2078441772}]},"public_addr":"172.21.15.102:6801/2078441772","cluster_addr":"172.21.15.102:6803/2078441772","heartbeat_back_addr":"172.21.15.102:6807/2078441772","heartbeat_front_addr":"172.21.15.102:6805/2078441772","state":["exists","up"]},{"osd":3,"uuid":"68ba79e5-bcf0-4349-9e14-42f2fa9c11b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6811","nonce":2729561132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6813","nonce":2729561132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6817","nonce":2729561132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6815","nonce":2729561132}]},"public_addr":"172.21.15.7:6811/2729561132","cluster_addr":"172.21.15.7:6813/2729561132","heartbeat_back_addr":"172.21.15.7:6817/2729561132","heartbeat_front_addr":"172.21.15.7:6815/2729561132","state":["exists","up"]},{"osd":4,"uuid":"f20d4a51-121f-4ac8-afeb-5962d83bd697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6809","nonce":2799734294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6811","nonce":2799734294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6815","nonce":2799734294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6813","nonce":2799734294}]},"public_addr":"172.21.15.92:6809/2799734294","cluster_addr":"172.21.15.92:6811/2799734294","heartbeat_back_addr":"172.21.15.92:6815/2799734294","heartbeat_front_addr":"172.21.15.92:6813/2799734294","state":["exists","up"]},{"osd":5,"uuid":"aac02b0a-99dc-4457-8898-c68dc196517a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6809","nonce":3099678146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6811","nonce":3099678146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6815","nonce":3099678146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6813","nonce":3099678146}]},"public_addr":"172.21.15.102:6809/3099678146","cluster_addr":"172.21.15.102:6811/3099678146","heartbeat_back_addr":"172.21.15.102:6815/3099678146","heartbeat_front_addr":"172.21.15.102:6813/3099678146","state":["exists","up"]},{"osd":6,"uuid":"7e5a8b30-8406-486c-ace5-79158a3757a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6819","nonce":1569704304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6821","nonce":1569704304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6825","nonce":1569704304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6823","nonce":1569704304}]},"public_addr":"172.21.15.7:6819/1569704304","cluster_addr":"172.21.15.7:6821/1569704304","heartbeat_back_addr":"172.21.15.7:6825/1569704304","heartbeat_front_addr":"172.21.15.7:6823/1569704304","state":["exists","up"]},{"osd":7,"uuid":"e6a7049a-17a1-43b2-8ecd-5f4ca7c337be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6817","nonce":3411102480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6819","nonce":3411102480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6823","nonce":3411102480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6821","nonce":3411102480}]},"public_addr":"172.21.15.92:6817/3411102480","cluster_addr":"172.21.15.92:6819/3411102480","heartbeat_back_addr":"172.21.15.92:6823/3411102480","heartbeat_front_addr":"172.21.15.92:6821/3411102480","state":["exists","up"]},{"osd":8,"uuid":"31879baa-861d-4322-990f-0b9a42b8b610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6817","nonce":2990859925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6819","nonce":2990859925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6823","nonce":2990859925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6821","nonce":2990859925}]},"public_addr":"172.21.15.102:6817/2990859925","cluster_addr":"172.21.15.102:6819/2990859925","heartbeat_back_addr":"172.21.15.102:6823/2990859925","heartbeat_front_addr":"172.21.15.102:6821/2990859925","state":["exists","up"]},{"osd":9,"uuid":"6d65db33-926c-4a6e-a072-707e9c9de92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6827","nonce":1710319475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6829","nonce":1710319475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6833","nonce":1710319475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6831","nonce":1710319475}]},"public_addr":"172.21.15.7:6827/1710319475","cluster_addr":"172.21.15.7:6829/1710319475","heartbeat_back_addr":"172.21.15.7:6833/1710319475","heartbeat_front_addr":"172.21.15.7:6831/1710319475","state":["exists","up"]},{"osd":10,"uuid":"9ab681ee-0bef-47bd-bf3d-20b17c6b870c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6825","nonce":1063265541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6827","nonce":1063265541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6831","nonce":1063265541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6829","nonce":1063265541}]},"public_addr":"172.21.15.92:6825/1063265541","cluster_addr":"172.21.15.92:6827/1063265541","heartbeat_back_addr":"172.21.15.92:6831/1063265541","heartbeat_front_addr":"172.21.15.92:6829/1063265541","state":["exists","up"]},{"osd":11,"uuid":"dc398e14-5f9e-4f0a-b158-35cbc1f73a83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6825","nonce":1175425599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6827","nonce":1175425599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6831","nonce":1175425599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6829","nonce":1175425599}]},"public_addr":"172.21.15.102:6825/1175425599","cluster_addr":"172.21.15.102:6827/1175425599","heartbeat_back_addr":"172.21.15.102:6831/1175425599","heartbeat_front_addr":"172.21.15.102:6829/1175425599","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:07.857319+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:31.430120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:56.892301+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:10:22.011884+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:10:46.326025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:11:10.339084+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:11:35.365906+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:01.104309+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:25.717295+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:51.387644+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:13:15.076355+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:13:40.253150+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9},{"from":5,"to":8}]},{"pgid":"3.c","mappings":[{"from":5,"to":6}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1d","mappings":[{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/2883028938":"2024-09-20T04:07:45.039922+0000","172.21.15.7:0/1186412739":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6800/751091002":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6801/751091002":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6801/940106179":"2024-09-20T04:07:20.364033+0000","172.21.15.7:6800/940106179":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/1450115700":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/2954294373":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/1996930242":"2024-09-20T04:07:45.039922+0000","172.21.15.7:0/3562231347":"2024-09-20T04:07:20.364033+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:26:25.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.267+0000 7fe4210a6640 1 -- 172.21.15.7:0/493166200 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe4080a3250 msgr2=0x7fe4080a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:25.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.267+0000 7fe4210a6640 1 --2- 172.21.15.7:0/493166200 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe4080a3250 0x7fe4080a5710 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe41c1993e0 tx=0x7fe40400b390 comp rx=0 tx=0).stop 2024-09-19T04:26:25.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.267+0000 7fe4210a6640 1 -- 172.21.15.7:0/493166200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe41c1025d0 msgr2=0x7fe41c197ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:25.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.267+0000 7fe4210a6640 1 --2- 172.21.15.7:0/493166200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe41c1025d0 0x7fe41c197ed0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fe40c031a40 tx=0x7fe40c031ec0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.267+0000 7fe4210a6640 1 -- 172.21.15.7:0/493166200 shutdown_connections 2024-09-19T04:26:25.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.267+0000 7fe4210a6640 1 --2- 172.21.15.7:0/493166200 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fe4080a3250 0x7fe4080a5710 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.267+0000 7fe4210a6640 1 --2- 172.21.15.7:0/493166200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe41c107830 0x7fe41c19f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.267+0000 7fe4210a6640 1 --2- 172.21.15.7:0/493166200 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe41c104f00 0x7fe41c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.267+0000 7fe4210a6640 1 --2- 172.21.15.7:0/493166200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe41c1025d0 0x7fe41c197ed0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.267+0000 7fe4210a6640 1 -- 172.21.15.7:0/493166200 >> 172.21.15.7:0/493166200 conn(0x7fe41c0fc190 msgr2=0x7fe41c102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:25.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.267+0000 7fe4210a6640 1 -- 172.21.15.7:0/493166200 shutdown_connections 2024-09-19T04:26:25.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.267+0000 7fe4210a6640 1 -- 172.21.15.7:0/493166200 wait complete. 2024-09-19T04:26:25.280 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T04:09:59.544984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T04:14:30.225637+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T04:14:32.252497+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-19T04:14:38.781821+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-19T04:26:25.281 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T04:26:25.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:24 smithi092 ceph-mon[34940]: pgmap v639: 129 pgs: 129 active+clean; 38 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 705 op/s 2024-09-19T04:26:25.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.388+0000 7f7edad52640 1 -- 172.21.15.7:0/714561164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ed41025e0 msgr2=0x7f7ed4108e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:25.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.388+0000 7f7edad52640 1 --2- 172.21.15.7:0/714561164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ed41025e0 0x7f7ed4108e70 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc009ca0 tx=0x7f7ecc02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.388+0000 7f7edad52640 1 -- 172.21.15.7:0/714561164 shutdown_connections 2024-09-19T04:26:25.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.388+0000 7f7edad52640 1 --2- 172.21.15.7:0/714561164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ed41025e0 0x7f7ed4108e70 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.388+0000 7f7edad52640 1 --2- 172.21.15.7:0/714561164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ed4101c20 0x7f7ed41020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.388+0000 7f7edad52640 1 --2- 172.21.15.7:0/714561164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ed4100a30 0x7f7ed4100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.388+0000 7f7edad52640 1 -- 172.21.15.7:0/714561164 >> 172.21.15.7:0/714561164 conn(0x7f7ed40fc190 msgr2=0x7f7ed40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:25.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.388+0000 7f7edad52640 1 -- 172.21.15.7:0/714561164 shutdown_connections 2024-09-19T04:26:25.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.388+0000 7f7edad52640 1 -- 172.21.15.7:0/714561164 wait complete. 2024-09-19T04:26:25.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.388+0000 7f7edad52640 1 Processor -- start 2024-09-19T04:26:25.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.388+0000 7f7edad52640 1 -- start start 2024-09-19T04:26:25.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.389+0000 7f7edad52640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ed4100a30 0x7f7ed4197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:25.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.389+0000 7f7edad52640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ed4101c20 0x7f7ed4198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:25.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.389+0000 7f7edad52640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ed41025e0 0x7f7ed419f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:25.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.389+0000 7f7edad52640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed410c6e0 con 0x7f7ed41025e0 2024-09-19T04:26:25.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.389+0000 7f7edad52640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed410c560 con 0x7f7ed4100a30 2024-09-19T04:26:25.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.389+0000 7f7edad52640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed410c860 con 0x7f7ed4101c20 2024-09-19T04:26:25.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.389+0000 7f7ed92ef640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ed41025e0 0x7f7ed419f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:25.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.389+0000 7f7ed92ef640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ed41025e0 0x7f7ed419f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38970/0 (socket says 172.21.15.7:38970) 2024-09-19T04:26:25.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.389+0000 7f7ed92ef640 1 -- 172.21.15.7:0/4286860031 learned_addr learned my addr 172.21.15.7:0/4286860031 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:26:25.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.389+0000 7f7ed3fff640 1 --2- 172.21.15.7:0/4286860031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ed4101c20 0x7f7ed4198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:25.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.389+0000 7f7ed8aee640 1 --2- 172.21.15.7:0/4286860031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ed4100a30 0x7f7ed4197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:25.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.389+0000 7f7ed92ef640 1 -- 172.21.15.7:0/4286860031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ed4101c20 msgr2=0x7f7ed4198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:25.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.389+0000 7f7ed92ef640 1 --2- 172.21.15.7:0/4286860031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ed4101c20 0x7f7ed4198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.389+0000 7f7ed92ef640 1 -- 172.21.15.7:0/4286860031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ed4100a30 msgr2=0x7f7ed4197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:25.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.389+0000 7f7ed92ef640 1 --2- 172.21.15.7:0/4286860031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ed4100a30 0x7f7ed4197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.389+0000 7f7ed92ef640 1 -- 172.21.15.7:0/4286860031 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed419fa20 con 0x7f7ed41025e0 2024-09-19T04:26:25.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.389+0000 7f7ed3fff640 1 --2- 172.21.15.7:0/4286860031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ed4101c20 0x7f7ed4198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:26:25.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.389+0000 7f7ed92ef640 1 --2- 172.21.15.7:0/4286860031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ed41025e0 0x7f7ed419f3b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc02f540 tx=0x7f7ecc031750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:25.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.389+0000 7f7ed1ffb640 1 -- 172.21.15.7:0/4286860031 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc003b70 con 0x7f7ed41025e0 2024-09-19T04:26:25.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.390+0000 7f7ed1ffb640 1 -- 172.21.15.7:0/4286860031 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ecc003d10 con 0x7f7ed41025e0 2024-09-19T04:26:25.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.390+0000 7f7edad52640 1 -- 172.21.15.7:0/4286860031 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ed419fcb0 con 0x7f7ed41025e0 2024-09-19T04:26:25.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.390+0000 7f7ed1ffb640 1 -- 172.21.15.7:0/4286860031 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc02fb50 con 0x7f7ed41025e0 2024-09-19T04:26:25.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.390+0000 7f7edad52640 1 -- 172.21.15.7:0/4286860031 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ed41a01b0 con 0x7f7ed41025e0 2024-09-19T04:26:25.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.391+0000 7f7edad52640 1 -- 172.21.15.7:0/4286860031 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ed41a03e0 con 0x7f7ed41025e0 2024-09-19T04:26:25.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.392+0000 7f7ed1ffb640 1 -- 172.21.15.7:0/4286860031 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f7ecc02fcf0 con 0x7f7ed41025e0 2024-09-19T04:26:25.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.393+0000 7f7ed1ffb640 1 --2- 172.21.15.7:0/4286860031 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f7ebc0a3250 0x7f7ebc0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:25.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.393+0000 7f7ed8aee640 1 --2- 172.21.15.7:0/4286860031 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f7ebc0a3250 0x7f7ebc0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:25.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.393+0000 7f7ed1ffb640 1 -- 172.21.15.7:0/4286860031 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f7ecc0f1280 con 0x7f7ed41025e0 2024-09-19T04:26:25.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.393+0000 7f7ed8aee640 1 --2- 172.21.15.7:0/4286860031 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f7ebc0a3250 0x7f7ebc0a5710 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4101a80 tx=0x7f7ec4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:25.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.396+0000 7f7ed1ffb640 1 -- 172.21.15.7:0/4286860031 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7ecc0bdbd0 con 0x7f7ed41025e0 2024-09-19T04:26:25.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.572+0000 7f7edad52640 1 -- 172.21.15.7:0/4286860031 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7ed41a06d0 con 0x7f7ed41025e0 2024-09-19T04:26:25.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.572+0000 7f7ed1ffb640 1 -- 172.21.15.7:0/4286860031 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7f7ecc0bd4d0 con 0x7f7ed41025e0 2024-09-19T04:26:25.574 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-19T04:26:25.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.574+0000 7f7edad52640 1 -- 172.21.15.7:0/4286860031 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f7ebc0a3250 msgr2=0x7f7ebc0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:25.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.574+0000 7f7edad52640 1 --2- 172.21.15.7:0/4286860031 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f7ebc0a3250 0x7f7ebc0a5710 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4101a80 tx=0x7f7ec4005f90 comp rx=0 tx=0).stop 2024-09-19T04:26:25.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.574+0000 7f7edad52640 1 -- 172.21.15.7:0/4286860031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ed41025e0 msgr2=0x7f7ed419f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:25.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.574+0000 7f7edad52640 1 --2- 172.21.15.7:0/4286860031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ed41025e0 0x7f7ed419f3b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc02f540 tx=0x7f7ecc031750 comp rx=0 tx=0).stop 2024-09-19T04:26:25.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.574+0000 7f7edad52640 1 -- 172.21.15.7:0/4286860031 shutdown_connections 2024-09-19T04:26:25.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.574+0000 7f7edad52640 1 --2- 172.21.15.7:0/4286860031 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f7ebc0a3250 0x7f7ebc0a5710 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.574+0000 7f7edad52640 1 --2- 172.21.15.7:0/4286860031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ed41025e0 0x7f7ed419f3b0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.574+0000 7f7edad52640 1 --2- 172.21.15.7:0/4286860031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ed4101c20 0x7f7ed4198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.574+0000 7f7edad52640 1 --2- 172.21.15.7:0/4286860031 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ed4100a30 0x7f7ed4197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.574+0000 7f7edad52640 1 -- 172.21.15.7:0/4286860031 >> 172.21.15.7:0/4286860031 conn(0x7f7ed40fc190 msgr2=0x7f7ed40fdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:25.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.574+0000 7f7edad52640 1 -- 172.21.15.7:0/4286860031 shutdown_connections 2024-09-19T04:26:25.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.574+0000 7f7edad52640 1 -- 172.21.15.7:0/4286860031 wait complete. 2024-09-19T04:26:25.587 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T04:26:25.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.692+0000 7f1b9c6a5640 1 -- 172.21.15.7:0/1589363887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b941025d0 msgr2=0x7f1b941049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:25.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.692+0000 7f1b9c6a5640 1 --2- 172.21.15.7:0/1589363887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b941025d0 0x7f1b941049c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f1b90009900 tx=0x7f1b9002a410 comp rx=0 tx=0).stop 2024-09-19T04:26:25.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.692+0000 7f1b9c6a5640 1 -- 172.21.15.7:0/1589363887 shutdown_connections 2024-09-19T04:26:25.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.692+0000 7f1b9c6a5640 1 --2- 172.21.15.7:0/1589363887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b94107830 0x7f1b94109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.692+0000 7f1b9c6a5640 1 --2- 172.21.15.7:0/1589363887 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b94104f00 0x7f1b941072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.692+0000 7f1b9c6a5640 1 --2- 172.21.15.7:0/1589363887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b941025d0 0x7f1b941049c0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.692+0000 7f1b9c6a5640 1 -- 172.21.15.7:0/1589363887 >> 172.21.15.7:0/1589363887 conn(0x7f1b940fc190 msgr2=0x7f1b940fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:25.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.692+0000 7f1b9c6a5640 1 -- 172.21.15.7:0/1589363887 shutdown_connections 2024-09-19T04:26:25.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.692+0000 7f1b9c6a5640 1 -- 172.21.15.7:0/1589363887 wait complete. 2024-09-19T04:26:25.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.693+0000 7f1b9c6a5640 1 Processor -- start 2024-09-19T04:26:25.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.693+0000 7f1b9c6a5640 1 -- start start 2024-09-19T04:26:25.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.693+0000 7f1b9c6a5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b941025d0 0x7f1b94197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:25.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.693+0000 7f1b9c6a5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b94104f00 0x7f1b941984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:25.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.693+0000 7f1b9c6a5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b94107830 0x7f1b9419f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:25.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.693+0000 7f1b9c6a5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9410d830 con 0x7f1b941025d0 2024-09-19T04:26:25.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.693+0000 7f1b9c6a5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9410d6b0 con 0x7f1b94104f00 2024-09-19T04:26:25.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.693+0000 7f1b9c6a5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9410d9b0 con 0x7f1b94107830 2024-09-19T04:26:25.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.693+0000 7f1b9a441640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b941025d0 0x7f1b94197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:25.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.693+0000 7f1b9a441640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b941025d0 0x7f1b94197f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38994/0 (socket says 172.21.15.7:38994) 2024-09-19T04:26:25.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.693+0000 7f1b9a441640 1 -- 172.21.15.7:0/356868974 learned_addr learned my addr 172.21.15.7:0/356868974 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:26:25.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.693+0000 7f1b99c40640 1 --2- 172.21.15.7:0/356868974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b94104f00 0x7f1b941984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:25.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.693+0000 7f1b9ac42640 1 --2- 172.21.15.7:0/356868974 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b94107830 0x7f1b9419f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:25.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.694+0000 7f1b9a441640 1 -- 172.21.15.7:0/356868974 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b94107830 msgr2=0x7f1b9419f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:25.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.694+0000 7f1b9a441640 1 --2- 172.21.15.7:0/356868974 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b94107830 0x7f1b9419f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.694+0000 7f1b9a441640 1 -- 172.21.15.7:0/356868974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b94104f00 msgr2=0x7f1b941984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:25.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.694+0000 7f1b9a441640 1 --2- 172.21.15.7:0/356868974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b94104f00 0x7f1b941984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.694+0000 7f1b9a441640 1 -- 172.21.15.7:0/356868974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b9419fba0 con 0x7f1b941025d0 2024-09-19T04:26:25.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.694+0000 7f1b9a441640 1 --2- 172.21.15.7:0/356868974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b941025d0 0x7f1b94197f80 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1b90005940 tx=0x7f1b90004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:25.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.694+0000 7f1b8b7fe640 1 -- 172.21.15.7:0/356868974 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9003f030 con 0x7f1b941025d0 2024-09-19T04:26:25.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.694+0000 7f1b8b7fe640 1 -- 172.21.15.7:0/356868974 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b90003ce0 con 0x7f1b941025d0 2024-09-19T04:26:25.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.694+0000 7f1b9c6a5640 1 -- 172.21.15.7:0/356868974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b9419fe30 con 0x7f1b941025d0 2024-09-19T04:26:25.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.694+0000 7f1b8b7fe640 1 -- 172.21.15.7:0/356868974 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b90035070 con 0x7f1b941025d0 2024-09-19T04:26:25.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.694+0000 7f1b9c6a5640 1 -- 172.21.15.7:0/356868974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b941a0230 con 0x7f1b941025d0 2024-09-19T04:26:25.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.695+0000 7f1b9c6a5640 1 -- 172.21.15.7:0/356868974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b940fdc80 con 0x7f1b941025d0 2024-09-19T04:26:25.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.696+0000 7f1b8b7fe640 1 -- 172.21.15.7:0/356868974 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f1b90042030 con 0x7f1b941025d0 2024-09-19T04:26:25.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.697+0000 7f1b8b7fe640 1 --2- 172.21.15.7:0/356868974 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1b800a3250 0x7f1b800a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:25.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.697+0000 7f1b99c40640 1 --2- 172.21.15.7:0/356868974 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1b800a3250 0x7f1b800a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:25.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.697+0000 7f1b8b7fe640 1 -- 172.21.15.7:0/356868974 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f1b900f05e0 con 0x7f1b941025d0 2024-09-19T04:26:25.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.698+0000 7f1b99c40640 1 --2- 172.21.15.7:0/356868974 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1b800a3250 0x7f1b800a5710 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1b94199490 tx=0x7f1b8400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:25.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.701+0000 7f1b8b7fe640 1 -- 172.21.15.7:0/356868974 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1b900bc8e0 con 0x7f1b941025d0 2024-09-19T04:26:25.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.878+0000 7f1b9c6a5640 1 -- 172.21.15.7:0/356868974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1b94062e90 con 0x7f1b941025d0 2024-09-19T04:26:25.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.878+0000 7f1b8b7fe640 1 -- 172.21.15.7:0/356868974 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) ==== 104+0+11 (secure 0 0 0) 0x7f1b900c0be0 con 0x7f1b941025d0 2024-09-19T04:26:25.880 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-19T04:26:25.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.880+0000 7f1b9c6a5640 1 -- 172.21.15.7:0/356868974 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1b800a3250 msgr2=0x7f1b800a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:25.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.880+0000 7f1b9c6a5640 1 --2- 172.21.15.7:0/356868974 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1b800a3250 0x7f1b800a5710 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1b94199490 tx=0x7f1b8400b390 comp rx=0 tx=0).stop 2024-09-19T04:26:25.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.880+0000 7f1b9c6a5640 1 -- 172.21.15.7:0/356868974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b941025d0 msgr2=0x7f1b94197f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:25.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.880+0000 7f1b9c6a5640 1 --2- 172.21.15.7:0/356868974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b941025d0 0x7f1b94197f80 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1b90005940 tx=0x7f1b90004360 comp rx=0 tx=0).stop 2024-09-19T04:26:25.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.880+0000 7f1b9c6a5640 1 -- 172.21.15.7:0/356868974 shutdown_connections 2024-09-19T04:26:25.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.880+0000 7f1b9c6a5640 1 --2- 172.21.15.7:0/356868974 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f1b800a3250 0x7f1b800a5710 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.880+0000 7f1b9c6a5640 1 --2- 172.21.15.7:0/356868974 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b94107830 0x7f1b9419f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.880+0000 7f1b9c6a5640 1 --2- 172.21.15.7:0/356868974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b94104f00 0x7f1b941984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.880+0000 7f1b9c6a5640 1 --2- 172.21.15.7:0/356868974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1b941025d0 0x7f1b94197f80 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:25.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.880+0000 7f1b9c6a5640 1 -- 172.21.15.7:0/356868974 >> 172.21.15.7:0/356868974 conn(0x7f1b940fc190 msgr2=0x7f1b94102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:25.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.881+0000 7f1b9c6a5640 1 -- 172.21.15.7:0/356868974 shutdown_connections 2024-09-19T04:26:25.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.881+0000 7f1b9c6a5640 1 -- 172.21.15.7:0/356868974 wait complete. 2024-09-19T04:26:25.893 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T04:26:26.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.999+0000 7f4fa2ffd640 1 -- 172.21.15.7:0/1976938403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f9c1036e0 msgr2=0x7f4f9c109f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:26.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.999+0000 7f4fa2ffd640 1 --2- 172.21.15.7:0/1976938403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f9c1036e0 0x7f4f9c109f70 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4f94009ca0 tx=0x7f4f9402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:26:26.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.999+0000 7f4fa2ffd640 1 -- 172.21.15.7:0/1976938403 shutdown_connections 2024-09-19T04:26:26.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.999+0000 7f4fa2ffd640 1 --2- 172.21.15.7:0/1976938403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f9c1036e0 0x7f4f9c109f70 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:26.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.999+0000 7f4fa2ffd640 1 --2- 172.21.15.7:0/1976938403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f9c102d20 0x7f4f9c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:26.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.999+0000 7f4fa2ffd640 1 --2- 172.21.15.7:0/1976938403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f9c101b30 0x7f4f9c101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:26.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.999+0000 7f4fa2ffd640 1 -- 172.21.15.7:0/1976938403 >> 172.21.15.7:0/1976938403 conn(0x7f4f9c0fd270 msgr2=0x7f4f9c0ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:26.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.999+0000 7f4fa2ffd640 1 -- 172.21.15.7:0/1976938403 shutdown_connections 2024-09-19T04:26:26.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.999+0000 7f4fa2ffd640 1 -- 172.21.15.7:0/1976938403 wait complete. 2024-09-19T04:26:26.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.999+0000 7f4fa2ffd640 1 Processor -- start 2024-09-19T04:26:26.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.999+0000 7f4fa2ffd640 1 -- start start 2024-09-19T04:26:26.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.999+0000 7f4fa2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f9c101b30 0x7f4f9c197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:26.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.999+0000 7f4fa2ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f9c102d20 0x7f4f9c198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:26.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.999+0000 7f4fa2ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f9c1036e0 0x7f4f9c19f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:26.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.999+0000 7f4fa2ffd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c10d7b0 con 0x7f4f9c101b30 2024-09-19T04:26:26.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.999+0000 7f4fa2ffd640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c10d630 con 0x7f4f9c1036e0 2024-09-19T04:26:26.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:25.999+0000 7f4fa2ffd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c10d930 con 0x7f4f9c102d20 2024-09-19T04:26:26.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.000+0000 7f4fa0d99640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f9c101b30 0x7f4f9c197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:26.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.000+0000 7f4fa0d99640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f9c101b30 0x7f4f9c197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39008/0 (socket says 172.21.15.7:39008) 2024-09-19T04:26:26.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.000+0000 7f4fa0d99640 1 -- 172.21.15.7:0/3011837710 learned_addr learned my addr 172.21.15.7:0/3011837710 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:26:26.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.000+0000 7f4fa159a640 1 --2- 172.21.15.7:0/3011837710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f9c1036e0 0x7f4f9c19f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:26.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.000+0000 7f4fa0d99640 1 -- 172.21.15.7:0/3011837710 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f9c102d20 msgr2=0x7f4f9c198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:26.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.000+0000 7f4f9bfff640 1 --2- 172.21.15.7:0/3011837710 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f9c102d20 0x7f4f9c198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:26.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.000+0000 7f4fa0d99640 1 --2- 172.21.15.7:0/3011837710 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f9c102d20 0x7f4f9c198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:26.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.000+0000 7f4fa0d99640 1 -- 172.21.15.7:0/3011837710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f9c1036e0 msgr2=0x7f4f9c19f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:26.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.000+0000 7f4fa0d99640 1 --2- 172.21.15.7:0/3011837710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f9c1036e0 0x7f4f9c19f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:26.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.000+0000 7f4fa0d99640 1 -- 172.21.15.7:0/3011837710 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9c19f9f0 con 0x7f4f9c101b30 2024-09-19T04:26:26.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.000+0000 7f4fa0d99640 1 --2- 172.21.15.7:0/3011837710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f9c101b30 0x7f4f9c197dd0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00e9c0 tx=0x7f4f8c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:26.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.000+0000 7f4f99ffb640 1 -- 172.21.15.7:0/3011837710 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c00cd80 con 0x7f4f9c101b30 2024-09-19T04:26:26.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.000+0000 7f4f99ffb640 1 -- 172.21.15.7:0/3011837710 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f8c0035f0 con 0x7f4f9c101b30 2024-09-19T04:26:26.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.000+0000 7f4fa2ffd640 1 -- 172.21.15.7:0/3011837710 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f9c19fce0 con 0x7f4f9c101b30 2024-09-19T04:26:26.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.000+0000 7f4f99ffb640 1 -- 172.21.15.7:0/3011837710 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c010690 con 0x7f4f9c101b30 2024-09-19T04:26:26.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.000+0000 7f4fa2ffd640 1 -- 172.21.15.7:0/3011837710 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f9c1a0180 con 0x7f4f9c101b30 2024-09-19T04:26:26.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.001+0000 7f4fa2ffd640 1 -- 172.21.15.7:0/3011837710 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f9c108ea0 con 0x7f4f9c101b30 2024-09-19T04:26:26.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.003+0000 7f4f99ffb640 1 -- 172.21.15.7:0/3011837710 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f4f8c0037a0 con 0x7f4f9c101b30 2024-09-19T04:26:26.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.003+0000 7f4f99ffb640 1 --2- 172.21.15.7:0/3011837710 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4f840a3250 0x7f4f840a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:26.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.003+0000 7f4f99ffb640 1 -- 172.21.15.7:0/3011837710 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f4f8c0d00e0 con 0x7f4f9c101b30 2024-09-19T04:26:26.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.003+0000 7f4f9bfff640 1 --2- 172.21.15.7:0/3011837710 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4f840a3250 0x7f4f840a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:26.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.004+0000 7f4f9bfff640 1 --2- 172.21.15.7:0/3011837710 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4f840a3250 0x7f4f840a5710 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4f90005fd0 tx=0x7f4f90009470 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:26.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.007+0000 7f4f99ffb640 1 -- 172.21.15.7:0/3011837710 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4f8c09ca30 con 0x7f4f9c101b30 2024-09-19T04:26:26.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:25 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/493166200' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:26:26.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:25 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/4286860031' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T04:26:26.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:25 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/493166200' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:26:26.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:25 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/4286860031' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T04:26:26.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.184+0000 7f4fa2ffd640 1 -- 172.21.15.7:0/3011837710 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4f9c062e90 con 0x7f4f9c101b30 2024-09-19T04:26:26.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.185+0000 7f4f99ffb640 1 -- 172.21.15.7:0/3011837710 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) ==== 100+0+11 (secure 0 0 0) 0x7f4f8c09c330 con 0x7f4f9c101b30 2024-09-19T04:26:26.187 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-09-19T04:26:26.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.187+0000 7f4fa2ffd640 1 -- 172.21.15.7:0/3011837710 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4f840a3250 msgr2=0x7f4f840a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:26.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.187+0000 7f4fa2ffd640 1 --2- 172.21.15.7:0/3011837710 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4f840a3250 0x7f4f840a5710 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4f90005fd0 tx=0x7f4f90009470 comp rx=0 tx=0).stop 2024-09-19T04:26:26.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.187+0000 7f4fa2ffd640 1 -- 172.21.15.7:0/3011837710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f9c101b30 msgr2=0x7f4f9c197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:26.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.187+0000 7f4fa2ffd640 1 --2- 172.21.15.7:0/3011837710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f9c101b30 0x7f4f9c197dd0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00e9c0 tx=0x7f4f8c00ee80 comp rx=0 tx=0).stop 2024-09-19T04:26:26.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.187+0000 7f4fa2ffd640 1 -- 172.21.15.7:0/3011837710 shutdown_connections 2024-09-19T04:26:26.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.187+0000 7f4fa2ffd640 1 --2- 172.21.15.7:0/3011837710 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f4f840a3250 0x7f4f840a5710 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:26.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.187+0000 7f4fa2ffd640 1 --2- 172.21.15.7:0/3011837710 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f9c1036e0 0x7f4f9c19f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:26.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.187+0000 7f4fa2ffd640 1 --2- 172.21.15.7:0/3011837710 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f9c102d20 0x7f4f9c198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:26.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.187+0000 7f4fa2ffd640 1 --2- 172.21.15.7:0/3011837710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f9c101b30 0x7f4f9c197dd0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:26.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.187+0000 7f4fa2ffd640 1 -- 172.21.15.7:0/3011837710 >> 172.21.15.7:0/3011837710 conn(0x7f4f9c0fd270 msgr2=0x7f4f9c106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:26.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.187+0000 7f4fa2ffd640 1 -- 172.21.15.7:0/3011837710 shutdown_connections 2024-09-19T04:26:26.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.187+0000 7f4fa2ffd640 1 -- 172.21.15.7:0/3011837710 wait complete. 2024-09-19T04:26:26.199 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-19T04:26:26.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:25 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/493166200' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:26:26.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:25 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/4286860031' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T04:26:26.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.305+0000 7f27b3d11640 1 -- 172.21.15.7:0/2718362178 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27ac104ee0 msgr2=0x7f27ac1072d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:26.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.305+0000 7f27b3d11640 1 --2- 172.21.15.7:0/2718362178 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27ac104ee0 0x7f27ac1072d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f279c009900 tx=0x7f279c02a410 comp rx=0 tx=0).stop 2024-09-19T04:26:26.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.305+0000 7f27b3d11640 1 -- 172.21.15.7:0/2718362178 shutdown_connections 2024-09-19T04:26:26.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.305+0000 7f27b3d11640 1 --2- 172.21.15.7:0/2718362178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27ac107810 0x7f27ac109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:26.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.305+0000 7f27b3d11640 1 --2- 172.21.15.7:0/2718362178 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27ac104ee0 0x7f27ac1072d0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:26.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.305+0000 7f27b3d11640 1 --2- 172.21.15.7:0/2718362178 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27ac1025b0 0x7f27ac1049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:26.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.305+0000 7f27b3d11640 1 -- 172.21.15.7:0/2718362178 >> 172.21.15.7:0/2718362178 conn(0x7f27ac0fc190 msgr2=0x7f27ac0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:26.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.305+0000 7f27b3d11640 1 -- 172.21.15.7:0/2718362178 shutdown_connections 2024-09-19T04:26:26.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.305+0000 7f27b3d11640 1 -- 172.21.15.7:0/2718362178 wait complete. 2024-09-19T04:26:26.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.305+0000 7f27b3d11640 1 Processor -- start 2024-09-19T04:26:26.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.306+0000 7f27b3d11640 1 -- start start 2024-09-19T04:26:26.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.306+0000 7f27b3d11640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27ac1025b0 0x7f27ac197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:26.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.306+0000 7f27b3d11640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27ac104ee0 0x7f27ac198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:26.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.306+0000 7f27b3d11640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27ac107810 0x7f27ac19f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:26.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.306+0000 7f27b3d11640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f27ac10d7c0 con 0x7f27ac104ee0 2024-09-19T04:26:26.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.306+0000 7f27b3d11640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f27ac10d640 con 0x7f27ac1025b0 2024-09-19T04:26:26.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.306+0000 7f27b3d11640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f27ac10d940 con 0x7f27ac107810 2024-09-19T04:26:26.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.306+0000 7f27b12ac640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27ac104ee0 0x7f27ac198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:26.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.306+0000 7f27b12ac640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27ac104ee0 0x7f27ac198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39028/0 (socket says 172.21.15.7:39028) 2024-09-19T04:26:26.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.306+0000 7f27b12ac640 1 -- 172.21.15.7:0/131522657 learned_addr learned my addr 172.21.15.7:0/131522657 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:26:26.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.306+0000 7f27b22ae640 1 --2- 172.21.15.7:0/131522657 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27ac107810 0x7f27ac19f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:26.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.306+0000 7f27b1aad640 1 --2- 172.21.15.7:0/131522657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27ac1025b0 0x7f27ac197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:26.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.306+0000 7f27b12ac640 1 -- 172.21.15.7:0/131522657 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27ac107810 msgr2=0x7f27ac19f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:26.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.306+0000 7f27b12ac640 1 --2- 172.21.15.7:0/131522657 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27ac107810 0x7f27ac19f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:26.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.306+0000 7f27b12ac640 1 -- 172.21.15.7:0/131522657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27ac1025b0 msgr2=0x7f27ac197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:26.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.306+0000 7f27b12ac640 1 --2- 172.21.15.7:0/131522657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27ac1025b0 0x7f27ac197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:26.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.306+0000 7f27b12ac640 1 -- 172.21.15.7:0/131522657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27ac19fb20 con 0x7f27ac104ee0 2024-09-19T04:26:26.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.306+0000 7f27b1aad640 1 --2- 172.21.15.7:0/131522657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27ac1025b0 0x7f27ac197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:26:26.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.306+0000 7f27b22ae640 1 --2- 172.21.15.7:0/131522657 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27ac107810 0x7f27ac19f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:26:26.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.306+0000 7f27b12ac640 1 --2- 172.21.15.7:0/131522657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27ac104ee0 0x7f27ac198440 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f279c031610 tx=0x7f279c0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:26.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.307+0000 7f27a2ffd640 1 -- 172.21.15.7:0/131522657 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c03f030 con 0x7f27ac104ee0 2024-09-19T04:26:26.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.307+0000 7f27a2ffd640 1 -- 172.21.15.7:0/131522657 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f279c003ce0 con 0x7f27ac104ee0 2024-09-19T04:26:26.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.307+0000 7f27b3d11640 1 -- 172.21.15.7:0/131522657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27ac19fdb0 con 0x7f27ac104ee0 2024-09-19T04:26:26.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.307+0000 7f27a2ffd640 1 -- 172.21.15.7:0/131522657 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279c035070 con 0x7f27ac104ee0 2024-09-19T04:26:26.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.307+0000 7f27b3d11640 1 -- 172.21.15.7:0/131522657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27ac1a0260 con 0x7f27ac104ee0 2024-09-19T04:26:26.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.308+0000 7f27b3d11640 1 -- 172.21.15.7:0/131522657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27ac0fdc80 con 0x7f27ac104ee0 2024-09-19T04:26:26.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.309+0000 7f27a2ffd640 1 -- 172.21.15.7:0/131522657 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f279c042030 con 0x7f27ac104ee0 2024-09-19T04:26:26.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.309+0000 7f27a2ffd640 1 --2- 172.21.15.7:0/131522657 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f27980a32d0 0x7f27980a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:26.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.309+0000 7f27a2ffd640 1 -- 172.21.15.7:0/131522657 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f279c0eff80 con 0x7f27ac104ee0 2024-09-19T04:26:26.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.309+0000 7f27b1aad640 1 --2- 172.21.15.7:0/131522657 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f27980a32d0 0x7f27980a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:26.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.310+0000 7f27b1aad640 1 --2- 172.21.15.7:0/131522657 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f27980a32d0 0x7f27980a5790 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f27a8009b40 tx=0x7f27a8005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:26.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.314+0000 7f27a2ffd640 1 -- 172.21.15.7:0/131522657 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f279c0bc8d0 con 0x7f27ac104ee0 2024-09-19T04:26:26.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.494+0000 7f27b3d11640 1 -- 172.21.15.7:0/131522657 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f27ac062ef0 con 0x7f27ac104ee0 2024-09-19T04:26:26.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.494+0000 7f27a2ffd640 1 -- 172.21.15.7:0/131522657 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) ==== 103+0+11 (secure 0 0 0) 0x7f279c0bc1d0 con 0x7f27ac104ee0 2024-09-19T04:26:26.496 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-19T04:26:26.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.496+0000 7f27b3d11640 1 -- 172.21.15.7:0/131522657 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f27980a32d0 msgr2=0x7f27980a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:26.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.496+0000 7f27b3d11640 1 --2- 172.21.15.7:0/131522657 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f27980a32d0 0x7f27980a5790 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f27a8009b40 tx=0x7f27a8005e50 comp rx=0 tx=0).stop 2024-09-19T04:26:26.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.496+0000 7f27b3d11640 1 -- 172.21.15.7:0/131522657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27ac104ee0 msgr2=0x7f27ac198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:26.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.496+0000 7f27b3d11640 1 --2- 172.21.15.7:0/131522657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27ac104ee0 0x7f27ac198440 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f279c031610 tx=0x7f279c0043b0 comp rx=0 tx=0).stop 2024-09-19T04:26:26.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.496+0000 7f27b3d11640 1 -- 172.21.15.7:0/131522657 shutdown_connections 2024-09-19T04:26:26.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.496+0000 7f27b3d11640 1 --2- 172.21.15.7:0/131522657 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f27980a32d0 0x7f27980a5790 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:26.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.496+0000 7f27b3d11640 1 --2- 172.21.15.7:0/131522657 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27ac107810 0x7f27ac19f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:26.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.496+0000 7f27b3d11640 1 --2- 172.21.15.7:0/131522657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27ac104ee0 0x7f27ac198440 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:26.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.496+0000 7f27b3d11640 1 --2- 172.21.15.7:0/131522657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27ac1025b0 0x7f27ac197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:26.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.496+0000 7f27b3d11640 1 -- 172.21.15.7:0/131522657 >> 172.21.15.7:0/131522657 conn(0x7f27ac0fc190 msgr2=0x7f27ac102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:26.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.497+0000 7f27b3d11640 1 -- 172.21.15.7:0/131522657 shutdown_connections 2024-09-19T04:26:26.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.497+0000 7f27b3d11640 1 -- 172.21.15.7:0/131522657 wait complete. 2024-09-19T04:26:26.509 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-19T04:26:26.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.611+0000 7f05b6578640 1 -- 172.21.15.7:0/64675677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b0100a50 msgr2=0x7f05b0100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:26.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.611+0000 7f05b6578640 1 --2- 172.21.15.7:0/64675677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b0100a50 0x7f05b0100e50 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f05a0009900 tx=0x7f05a002a410 comp rx=0 tx=0).stop 2024-09-19T04:26:26.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.611+0000 7f05b6578640 1 -- 172.21.15.7:0/64675677 shutdown_connections 2024-09-19T04:26:26.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.611+0000 7f05b6578640 1 --2- 172.21.15.7:0/64675677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05b0102600 0x7f05b0108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:26.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.611+0000 7f05b6578640 1 --2- 172.21.15.7:0/64675677 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f05b0101c40 0x7f05b01020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:26.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.611+0000 7f05b6578640 1 --2- 172.21.15.7:0/64675677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b0100a50 0x7f05b0100e50 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:26.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.611+0000 7f05b6578640 1 -- 172.21.15.7:0/64675677 >> 172.21.15.7:0/64675677 conn(0x7f05b00fc190 msgr2=0x7f05b00fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:26.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.611+0000 7f05b6578640 1 -- 172.21.15.7:0/64675677 shutdown_connections 2024-09-19T04:26:26.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.611+0000 7f05b6578640 1 -- 172.21.15.7:0/64675677 wait complete. 2024-09-19T04:26:26.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.611+0000 7f05b6578640 1 Processor -- start 2024-09-19T04:26:26.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.612+0000 7f05b6578640 1 -- start start 2024-09-19T04:26:26.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.612+0000 7f05b6578640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b0100a50 0x7f05b0197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:26.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.612+0000 7f05b6578640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05b0101c40 0x7f05b01983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:26.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.612+0000 7f05b6578640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f05b0102600 0x7f05b019f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:26.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.612+0000 7f05b6578640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f05b010d820 con 0x7f05b0100a50 2024-09-19T04:26:26.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.612+0000 7f05b6578640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f05b010d6a0 con 0x7f05b0101c40 2024-09-19T04:26:26.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.612+0000 7f05b6578640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f05b010d9a0 con 0x7f05b0102600 2024-09-19T04:26:26.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.612+0000 7f05affff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b0100a50 0x7f05b0197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:26.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.612+0000 7f05affff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b0100a50 0x7f05b0197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39046/0 (socket says 172.21.15.7:39046) 2024-09-19T04:26:26.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.612+0000 7f05affff640 1 -- 172.21.15.7:0/433176832 learned_addr learned my addr 172.21.15.7:0/433176832 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:26:26.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.612+0000 7f05af7fe640 1 --2- 172.21.15.7:0/433176832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05b0101c40 0x7f05b01983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:26.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.612+0000 7f05b4b15640 1 --2- 172.21.15.7:0/433176832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f05b0102600 0x7f05b019f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:26.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.612+0000 7f05affff640 1 -- 172.21.15.7:0/433176832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f05b0102600 msgr2=0x7f05b019f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:26.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.612+0000 7f05affff640 1 --2- 172.21.15.7:0/433176832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f05b0102600 0x7f05b019f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:26.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.612+0000 7f05affff640 1 -- 172.21.15.7:0/433176832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05b0101c40 msgr2=0x7f05b01983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:26.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.612+0000 7f05affff640 1 --2- 172.21.15.7:0/433176832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05b0101c40 0x7f05b01983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:26.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.612+0000 7f05affff640 1 -- 172.21.15.7:0/433176832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05b019fac0 con 0x7f05b0100a50 2024-09-19T04:26:26.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.612+0000 7f05b4b15640 1 --2- 172.21.15.7:0/433176832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f05b0102600 0x7f05b019f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:26:26.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.613+0000 7f05affff640 1 --2- 172.21.15.7:0/433176832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b0100a50 0x7f05b0197ea0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f05a0031610 tx=0x7f05a0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:26.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.613+0000 7f05ad7fa640 1 -- 172.21.15.7:0/433176832 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a003f030 con 0x7f05b0100a50 2024-09-19T04:26:26.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.613+0000 7f05ad7fa640 1 -- 172.21.15.7:0/433176832 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05a0003ad0 con 0x7f05b0100a50 2024-09-19T04:26:26.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.613+0000 7f05ad7fa640 1 -- 172.21.15.7:0/433176832 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a0035070 con 0x7f05b0100a50 2024-09-19T04:26:26.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.613+0000 7f05b6578640 1 -- 172.21.15.7:0/433176832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05b019fd50 con 0x7f05b0100a50 2024-09-19T04:26:26.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.613+0000 7f05b6578640 1 -- 172.21.15.7:0/433176832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05b01a0190 con 0x7f05b0100a50 2024-09-19T04:26:26.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.614+0000 7f05b6578640 1 -- 172.21.15.7:0/433176832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05b0107e60 con 0x7f05b0100a50 2024-09-19T04:26:26.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.615+0000 7f05ad7fa640 1 -- 172.21.15.7:0/433176832 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f05a0042030 con 0x7f05b0100a50 2024-09-19T04:26:26.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.616+0000 7f05ad7fa640 1 --2- 172.21.15.7:0/433176832 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f05980a3250 0x7f05980a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:26.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.616+0000 7f05af7fe640 1 --2- 172.21.15.7:0/433176832 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f05980a3250 0x7f05980a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:26.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.616+0000 7f05ad7fa640 1 -- 172.21.15.7:0/433176832 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f05a00f0450 con 0x7f05b0100a50 2024-09-19T04:26:26.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.616+0000 7f05af7fe640 1 --2- 172.21.15.7:0/433176832 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f05980a3250 0x7f05980a5710 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f05b01993b0 tx=0x7f05a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:26.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.620+0000 7f05ad7fa640 1 -- 172.21.15.7:0/433176832 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f05a00bcd60 con 0x7f05b0100a50 2024-09-19T04:26:26.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.846+0000 7f05b6578640 1 -- 172.21.15.7:0/433176832 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f05b0062df0 con 0x7f05b0100a50 2024-09-19T04:26:26.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.854+0000 7f05ad7fa640 1 -- 172.21.15.7:0/433176832 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) ==== 81+0+742332 (secure 0 0 0) 0x7f05a00bc660 con 0x7f05b0100a50 2024-09-19T04:26:26.865 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:26:26.865 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:26:26.866 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 20, 2024-09-19T04:26:26.866 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.866 INFO:teuthology.orchestra.run.smithi007.stdout: "active_gid": 14150, 2024-09-19T04:26:26.866 INFO:teuthology.orchestra.run.smithi007.stdout: "active_name": "x", 2024-09-19T04:26:26.866 INFO:teuthology.orchestra.run.smithi007.stdout: "active_addrs": { 2024-09-19T04:26:26.866 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-19T04:26:26.866 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:26.866 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-19T04:26:26.866 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6800", 2024-09-19T04:26:26.866 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1262394163 2024-09-19T04:26:26.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.866 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:26.867 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2024-09-19T04:26:26.867 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6801", 2024-09-19T04:26:26.867 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1262394163 2024-09-19T04:26:26.867 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:26.867 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-19T04:26:26.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.867 INFO:teuthology.orchestra.run.smithi007.stdout: "active_addr": "172.21.15.7:6801/1262394163", 2024-09-19T04:26:26.867 INFO:teuthology.orchestra.run.smithi007.stdout: "active_change": "2024-09-19T04:07:45.040027+0000", 2024-09-19T04:26:26.867 INFO:teuthology.orchestra.run.smithi007.stdout: "active_mgr_features": 4540701547738038271, 2024-09-19T04:26:26.867 INFO:teuthology.orchestra.run.smithi007.stdout: "available": true, 2024-09-19T04:26:26.867 INFO:teuthology.orchestra.run.smithi007.stdout: "standbys": [ 2024-09-19T04:26:26.867 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:26.868 INFO:teuthology.orchestra.run.smithi007.stdout: "gid": 24106, 2024-09-19T04:26:26.868 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "z", 2024-09-19T04:26:26.868 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_features": 4540701547738038271, 2024-09-19T04:26:26.868 INFO:teuthology.orchestra.run.smithi007.stdout: "available_modules": [ 2024-09-19T04:26:26.868 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:26.868 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "alerts", 2024-09-19T04:26:26.868 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:26.868 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:26.868 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:26.868 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T04:26:26.868 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T04:26:26.868 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:26.869 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.869 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.869 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T04:26:26.869 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.869 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.869 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.869 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T04:26:26.869 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.869 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.869 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.869 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:26.869 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:26.870 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.870 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.870 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.870 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:26.870 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.870 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.870 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:26.870 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:26.870 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:26.870 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:26.870 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:26.870 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:26.870 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:26.871 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:26.871 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:26.871 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.871 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.871 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.871 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:26.871 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:26.871 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.871 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.871 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.871 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:26.871 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.872 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.872 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.872 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:26.872 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.872 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.872 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.872 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:26.872 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:26.872 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.872 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.872 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.873 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:26.873 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.873 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.873 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:26.873 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:26.873 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:26.873 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:26.873 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:26.873 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:26.873 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:26.873 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:26.873 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:26.873 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.874 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.874 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.874 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:26.874 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:26.874 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.874 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.874 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.874 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:26.874 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.874 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.874 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.874 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:26.875 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.875 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.875 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.875 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_destination": { 2024-09-19T04:26:26.875 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_destination", 2024-09-19T04:26:26.875 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.875 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.875 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.875 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:26.875 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.875 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.875 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.876 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email address to send alerts to", 2024-09-19T04:26:26.876 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.876 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.876 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.876 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_from_name": { 2024-09-19T04:26:26.876 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_from_name", 2024-09-19T04:26:26.876 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.876 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.876 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.876 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "Ceph", 2024-09-19T04:26:26.876 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.876 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.877 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.877 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email From: name", 2024-09-19T04:26:26.877 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.877 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.877 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.877 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_host": { 2024-09-19T04:26:26.877 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_host", 2024-09-19T04:26:26.877 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.877 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.877 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.877 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:26.878 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.878 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.878 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.878 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP server", 2024-09-19T04:26:26.878 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.878 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.878 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.878 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_password": { 2024-09-19T04:26:26.878 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_password", 2024-09-19T04:26:26.878 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.878 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.878 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.878 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:26.879 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.879 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.879 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.879 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Password to authenticate with", 2024-09-19T04:26:26.879 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.879 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.879 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.879 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_port": { 2024-09-19T04:26:26.879 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_port", 2024-09-19T04:26:26.879 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:26.879 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.879 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.880 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "465", 2024-09-19T04:26:26.880 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.880 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.880 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.880 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP port", 2024-09-19T04:26:26.880 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.880 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.880 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.880 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_sender": { 2024-09-19T04:26:26.880 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_sender", 2024-09-19T04:26:26.880 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.880 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.881 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.881 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:26.881 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.881 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.881 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.881 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP envelope sender", 2024-09-19T04:26:26.881 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.881 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.881 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.881 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_ssl": { 2024-09-19T04:26:26.881 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_ssl", 2024-09-19T04:26:26.882 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.882 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.882 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.882 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:26.882 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.882 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.882 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.882 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T04:26:26.882 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.882 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.882 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.882 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_user": { 2024-09-19T04:26:26.883 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_user", 2024-09-19T04:26:26.883 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.883 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.883 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.883 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:26.883 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.883 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.883 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.883 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "User to authenticate as", 2024-09-19T04:26:26.883 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.883 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.883 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.883 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:26.884 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:26.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:26.884 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "balancer", 2024-09-19T04:26:26.884 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:26.884 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:26.884 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:26.884 INFO:teuthology.orchestra.run.smithi007.stdout: "active": { 2024-09-19T04:26:26.884 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "active", 2024-09-19T04:26:26.884 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.884 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.884 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.885 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:26.885 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.885 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.885 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.885 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T04:26:26.885 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.885 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.885 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.885 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_time": { 2024-09-19T04:26:26.885 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_time", 2024-09-19T04:26:26.885 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.885 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.886 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.886 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0000", 2024-09-19T04:26:26.886 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.886 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.886 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.886 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T04:26:26.886 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T04:26:26.886 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.886 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.886 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_weekday": { 2024-09-19T04:26:26.886 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_weekday", 2024-09-19T04:26:26.886 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T04:26:26.886 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.887 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.887 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T04:26:26.887 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-19T04:26:26.887 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-19T04:26:26.887 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.887 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T04:26:26.887 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T04:26:26.887 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.887 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.887 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_max_iterations": { 2024-09-19T04:26:26.887 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_max_iterations", 2024-09-19T04:26:26.887 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T04:26:26.888 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.888 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.888 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "25", 2024-09-19T04:26:26.888 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-19T04:26:26.888 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "250", 2024-09-19T04:26:26.888 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.888 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T04:26:26.888 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.888 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.888 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.888 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_metrics": { 2024-09-19T04:26:26.888 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_metrics", 2024-09-19T04:26:26.889 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.889 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.889 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.889 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T04:26:26.889 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.889 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.889 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.889 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T04:26:26.889 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T04:26:26.889 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.889 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.889 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_step": { 2024-09-19T04:26:26.890 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_step", 2024-09-19T04:26:26.890 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T04:26:26.890 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.890 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.890 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.5", 2024-09-19T04:26:26.890 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0.001", 2024-09-19T04:26:26.890 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "0.999", 2024-09-19T04:26:26.890 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.890 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "aggressiveness of optimization", 2024-09-19T04:26:26.890 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T04:26:26.890 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.890 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.891 INFO:teuthology.orchestra.run.smithi007.stdout: "end_time": { 2024-09-19T04:26:26.891 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_time", 2024-09-19T04:26:26.891 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.891 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.891 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.891 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2359", 2024-09-19T04:26:26.891 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.891 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.891 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.891 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T04:26:26.891 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T04:26:26.892 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.892 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.892 INFO:teuthology.orchestra.run.smithi007.stdout: "end_weekday": { 2024-09-19T04:26:26.892 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_weekday", 2024-09-19T04:26:26.892 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T04:26:26.892 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.892 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.892 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T04:26:26.892 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-19T04:26:26.892 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-19T04:26:26.892 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.892 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T04:26:26.893 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T04:26:26.893 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.893 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.893 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:26.893 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:26.893 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.893 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.893 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.893 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:26.893 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.893 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.894 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:26.894 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:26.894 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:26.894 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:26.894 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:26.894 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:26.894 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:26.894 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:26.894 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:26.894 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.894 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.894 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.895 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:26.895 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:26.895 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.895 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.895 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.895 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:26.895 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.895 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.895 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.895 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:26.895 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.895 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.895 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.896 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:26.896 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:26.896 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.896 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.896 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.896 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:26.896 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.896 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.896 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:26.896 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:26.896 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:26.896 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:26.897 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:26.897 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:26.897 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:26.897 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:26.897 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:26.897 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.897 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.897 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.897 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:26.897 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:26.897 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.898 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.898 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.898 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:26.898 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.898 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.898 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.898 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:26.898 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.898 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.898 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.898 INFO:teuthology.orchestra.run.smithi007.stdout: "min_score": { 2024-09-19T04:26:26.899 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_score", 2024-09-19T04:26:26.899 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T04:26:26.899 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.899 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.899 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T04:26:26.899 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.899 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.899 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.899 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T04:26:26.899 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.899 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.899 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.900 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-19T04:26:26.900 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-19T04:26:26.900 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.900 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.900 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.900 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "upmap", 2024-09-19T04:26:26.900 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.900 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.900 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:26.900 INFO:teuthology.orchestra.run.smithi007.stdout: "crush-compat", 2024-09-19T04:26:26.900 INFO:teuthology.orchestra.run.smithi007.stdout: "none", 2024-09-19T04:26:26.901 INFO:teuthology.orchestra.run.smithi007.stdout: "read", 2024-09-19T04:26:26.901 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap", 2024-09-19T04:26:26.901 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap-read" 2024-09-19T04:26:26.901 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:26.901 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Balancer mode", 2024-09-19T04:26:26.901 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.901 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.901 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.901 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_ids": { 2024-09-19T04:26:26.901 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_ids", 2024-09-19T04:26:26.901 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.902 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.902 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.902 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:26.902 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.902 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.902 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.902 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T04:26:26.902 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.902 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.902 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.902 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T04:26:26.902 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T04:26:26.903 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:26.903 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.903 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.903 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T04:26:26.903 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.903 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.903 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.903 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T04:26:26.903 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.903 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.903 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.903 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_deviation": { 2024-09-19T04:26:26.904 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_deviation", 2024-09-19T04:26:26.904 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:26.904 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.904 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.904 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T04:26:26.904 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-19T04:26:26.904 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.904 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.904 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T04:26:26.904 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T04:26:26.904 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.904 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.905 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_optimizations": { 2024-09-19T04:26:26.905 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_optimizations", 2024-09-19T04:26:26.905 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T04:26:26.905 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.905 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.905 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T04:26:26.905 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.905 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.905 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.905 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T04:26:26.905 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.906 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.906 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.906 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:26.906 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:26.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:26.906 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm", 2024-09-19T04:26:26.906 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:26.906 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:26.906 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:26.906 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_down_multiplier": { 2024-09-19T04:26:26.906 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_down_multiplier", 2024-09-19T04:26:26.907 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T04:26:26.907 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.907 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.907 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-19T04:26:26.907 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.907 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.907 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.907 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T04:26:26.907 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.907 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.907 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.907 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_refresh_rate": { 2024-09-19T04:26:26.908 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_refresh_rate", 2024-09-19T04:26:26.908 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:26.908 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.908 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.908 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "20", 2024-09-19T04:26:26.908 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.908 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.908 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.908 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T04:26:26.908 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.908 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.908 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.909 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_starting_port": { 2024-09-19T04:26:26.909 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_starting_port", 2024-09-19T04:26:26.909 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:26.909 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.909 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.909 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4721", 2024-09-19T04:26:26.909 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.909 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.909 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.909 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T04:26:26.909 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.910 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.910 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.910 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_ptrace": { 2024-09-19T04:26:26.910 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_ptrace", 2024-09-19T04:26:26.910 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.910 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.910 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.910 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:26.910 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.910 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.910 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.910 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T04:26:26.911 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T04:26:26.911 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.911 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.911 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_interval": { 2024-09-19T04:26:26.911 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_interval", 2024-09-19T04:26:26.911 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:26.911 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.911 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.911 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T04:26:26.911 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.911 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.911 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.912 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T04:26:26.912 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.912 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.912 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.912 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_memory_target_ratio": { 2024-09-19T04:26:26.912 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T04:26:26.912 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T04:26:26.912 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.912 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.912 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.7", 2024-09-19T04:26:26.912 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.913 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.913 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.913 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T04:26:26.913 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.913 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.913 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.913 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm_log_destination": { 2024-09-19T04:26:26.913 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm_log_destination", 2024-09-19T04:26:26.913 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.913 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.913 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.914 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:26.914 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.914 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.914 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:26.914 INFO:teuthology.orchestra.run.smithi007.stdout: "file", 2024-09-19T04:26:26.914 INFO:teuthology.orchestra.run.smithi007.stdout: "file,syslog", 2024-09-19T04:26:26.914 INFO:teuthology.orchestra.run.smithi007.stdout: "syslog" 2024-09-19T04:26:26.914 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:26.914 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T04:26:26.914 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.914 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.914 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.915 INFO:teuthology.orchestra.run.smithi007.stdout: "cgroups_split": { 2024-09-19T04:26:26.915 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cgroups_split", 2024-09-19T04:26:26.915 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.915 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.915 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.915 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:26.915 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.915 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.915 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.915 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T04:26:26.915 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.915 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.915 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.916 INFO:teuthology.orchestra.run.smithi007.stdout: "config_checks_enabled": { 2024-09-19T04:26:26.916 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_checks_enabled", 2024-09-19T04:26:26.916 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.916 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.916 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.916 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:26.916 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.916 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.916 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.916 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T04:26:26.916 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.916 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.917 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.917 INFO:teuthology.orchestra.run.smithi007.stdout: "config_dashboard": { 2024-09-19T04:26:26.917 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_dashboard", 2024-09-19T04:26:26.917 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.917 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.917 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.917 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:26.917 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.917 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.917 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.917 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T04:26:26.917 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.918 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.918 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.918 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_alertmanager": { 2024-09-19T04:26:26.918 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_alertmanager", 2024-09-19T04:26:26.918 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.918 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.918 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.918 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T04:26:26.918 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.918 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.918 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_base": { 2024-09-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_base", 2024-09-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.919 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.920 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Container image name, without the tag", 2024-09-19T04:26:26.920 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.920 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.920 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.920 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_elasticsearch": { 2024-09-19T04:26:26.920 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_elasticsearch", 2024-09-19T04:26:26.920 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.920 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.920 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.920 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T04:26:26.920 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.921 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.921 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.921 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "elasticsearch container image", 2024-09-19T04:26:26.921 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.921 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.921 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.921 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_grafana": { 2024-09-19T04:26:26.921 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_grafana", 2024-09-19T04:26:26.921 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.921 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.921 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.921 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T04:26:26.921 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.922 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.922 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.922 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-19T04:26:26.922 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.922 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.922 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.922 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_haproxy": { 2024-09-19T04:26:26.922 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_haproxy", 2024-09-19T04:26:26.922 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.922 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.922 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.922 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T04:26:26.923 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.923 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.923 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.923 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "HAproxy container image", 2024-09-19T04:26:26.923 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.923 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.923 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.923 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_agent": { 2024-09-19T04:26:26.923 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_agent", 2024-09-19T04:26:26.923 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.924 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.924 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.924 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T04:26:26.924 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.924 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.924 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.924 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger agent container image", 2024-09-19T04:26:26.924 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.924 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.924 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.924 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_collector": { 2024-09-19T04:26:26.925 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_collector", 2024-09-19T04:26:26.925 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.925 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.925 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.925 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T04:26:26.925 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.925 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.925 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.925 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger collector container image", 2024-09-19T04:26:26.925 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.925 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.925 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.926 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_query": { 2024-09-19T04:26:26.926 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_query", 2024-09-19T04:26:26.926 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.926 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.926 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.926 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T04:26:26.926 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.926 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.926 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.926 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger query container image", 2024-09-19T04:26:26.926 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.927 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.927 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.927 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_keepalived": { 2024-09-19T04:26:26.927 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_keepalived", 2024-09-19T04:26:26.927 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.927 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.927 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.927 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T04:26:26.927 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.927 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.927 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.927 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Keepalived container image", 2024-09-19T04:26:26.928 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.928 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.928 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.928 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_loki": { 2024-09-19T04:26:26.928 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_loki", 2024-09-19T04:26:26.928 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.928 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.928 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.928 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T04:26:26.928 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.928 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.928 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.929 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Loki container image", 2024-09-19T04:26:26.929 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.929 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.929 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.929 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_node_exporter": { 2024-09-19T04:26:26.929 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_node_exporter", 2024-09-19T04:26:26.929 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.929 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.929 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.929 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T04:26:26.929 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.929 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.930 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.930 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-19T04:26:26.930 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.930 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.930 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.930 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_nvmeof": { 2024-09-19T04:26:26.930 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_nvmeof", 2024-09-19T04:26:26.930 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.930 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.930 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.930 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T04:26:26.930 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.930 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.931 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.931 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Nvme-of container image", 2024-09-19T04:26:26.931 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.931 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.931 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.931 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_prometheus": { 2024-09-19T04:26:26.931 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_prometheus", 2024-09-19T04:26:26.931 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.931 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.931 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.931 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T04:26:26.931 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.931 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.932 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.932 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-19T04:26:26.932 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.932 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.932 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.932 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_promtail": { 2024-09-19T04:26:26.932 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_promtail", 2024-09-19T04:26:26.932 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.932 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.932 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.932 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T04:26:26.932 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.933 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.933 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.933 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Promtail container image", 2024-09-19T04:26:26.933 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.933 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.933 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.933 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_samba": { 2024-09-19T04:26:26.933 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_samba", 2024-09-19T04:26:26.933 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.933 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.933 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.934 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T04:26:26.934 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.934 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.934 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.934 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Samba/SMB container image", 2024-09-19T04:26:26.934 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.934 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.934 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.934 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_snmp_gateway": { 2024-09-19T04:26:26.934 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_snmp_gateway", 2024-09-19T04:26:26.934 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.934 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.934 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.935 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T04:26:26.935 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.935 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.935 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.935 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SNMP Gateway container image", 2024-09-19T04:26:26.935 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.935 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.935 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.935 INFO:teuthology.orchestra.run.smithi007.stdout: "container_init": { 2024-09-19T04:26:26.935 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_init", 2024-09-19T04:26:26.935 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.936 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.936 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.936 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:26.936 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.936 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.936 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.936 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T04:26:26.936 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.936 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.936 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.936 INFO:teuthology.orchestra.run.smithi007.stdout: "daemon_cache_timeout": { 2024-09-19T04:26:26.937 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "daemon_cache_timeout", 2024-09-19T04:26:26.937 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:26.937 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.937 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.937 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T04:26:26.937 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.937 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.937 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.937 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T04:26:26.937 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.937 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.937 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.938 INFO:teuthology.orchestra.run.smithi007.stdout: "default_cephadm_command_timeout": { 2024-09-19T04:26:26.938 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T04:26:26.938 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:26.938 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.938 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.938 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "900", 2024-09-19T04:26:26.938 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.938 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.938 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.938 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T04:26:26.938 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.938 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.939 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.939 INFO:teuthology.orchestra.run.smithi007.stdout: "default_registry": { 2024-09-19T04:26:26.939 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_registry", 2024-09-19T04:26:26.939 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.939 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.939 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.939 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io", 2024-09-19T04:26:26.939 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.939 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.939 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.940 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T04:26:26.940 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.940 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.940 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.940 INFO:teuthology.orchestra.run.smithi007.stdout: "device_cache_timeout": { 2024-09-19T04:26:26.940 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_cache_timeout", 2024-09-19T04:26:26.940 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:26.940 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.940 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.940 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1800", 2024-09-19T04:26:26.940 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.941 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.941 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.941 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache device inventory", 2024-09-19T04:26:26.941 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.941 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.941 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.941 INFO:teuthology.orchestra.run.smithi007.stdout: "device_enhanced_scan": { 2024-09-19T04:26:26.941 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_enhanced_scan", 2024-09-19T04:26:26.941 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.941 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.941 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.942 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:26.942 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.942 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.942 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.942 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T04:26:26.942 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.942 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.942 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.942 INFO:teuthology.orchestra.run.smithi007.stdout: "facts_cache_timeout": { 2024-09-19T04:26:26.942 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "facts_cache_timeout", 2024-09-19T04:26:26.942 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:26.943 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.943 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.943 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T04:26:26.943 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.943 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.943 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.943 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache host facts data", 2024-09-19T04:26:26.943 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.943 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.943 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.943 INFO:teuthology.orchestra.run.smithi007.stdout: "grafana_dashboards_path": { 2024-09-19T04:26:26.944 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "grafana_dashboards_path", 2024-09-19T04:26:26.944 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.944 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.944 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.944 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T04:26:26.944 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.944 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.944 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.944 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T04:26:26.944 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.945 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.945 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.945 INFO:teuthology.orchestra.run.smithi007.stdout: "host_check_interval": { 2024-09-19T04:26:26.945 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "host_check_interval", 2024-09-19T04:26:26.945 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:26.945 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.945 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.945 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T04:26:26.946 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.946 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.946 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.946 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to perform a host check", 2024-09-19T04:26:26.946 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.946 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.946 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.946 INFO:teuthology.orchestra.run.smithi007.stdout: "hw_monitoring": { 2024-09-19T04:26:26.946 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hw_monitoring", 2024-09-19T04:26:26.946 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.947 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.947 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.947 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:26.947 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.947 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.947 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.947 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T04:26:26.947 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.947 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.947 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.947 INFO:teuthology.orchestra.run.smithi007.stdout: "inventory_list_all": { 2024-09-19T04:26:26.947 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "inventory_list_all", 2024-09-19T04:26:26.947 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.948 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.948 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.948 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:26.948 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.948 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.948 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.948 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T04:26:26.948 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.948 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.948 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.948 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:26.948 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:26.949 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.949 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.949 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.949 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:26.949 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.949 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.949 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:26.949 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:26.949 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:26.950 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:26.950 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:26.950 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:26.950 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:26.950 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:26.950 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:26.950 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.950 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.950 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.950 INFO:teuthology.orchestra.run.smithi007.stdout: "log_refresh_metadata": { 2024-09-19T04:26:26.950 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_refresh_metadata", 2024-09-19T04:26:26.951 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.951 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.951 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.951 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:26.951 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.951 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.951 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.951 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T04:26:26.951 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.951 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.951 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.952 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:26.952 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:26.952 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.952 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.952 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.952 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:26.952 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.952 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.952 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.952 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T04:26:26.952 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.953 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.953 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.953 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:26.953 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:26.953 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.953 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.953 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.953 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:26.953 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.953 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.954 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:26.954 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:26.954 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:26.954 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:26.954 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:26.954 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:26.954 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:26.954 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:26.954 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:26.954 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.954 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.954 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.955 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:26.955 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:26.955 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.955 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.955 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.955 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:26.955 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.955 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.955 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.955 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:26.955 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.955 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.955 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.956 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T04:26:26.956 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T04:26:26.956 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.956 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.956 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.956 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:26.956 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.956 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.956 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.956 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T04:26:26.956 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.957 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.957 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.957 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T04:26:26.957 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T04:26:26.957 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.957 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.957 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.957 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "*", 2024-09-19T04:26:26.957 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.957 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.958 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.958 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T04:26:26.958 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.958 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.958 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.958 INFO:teuthology.orchestra.run.smithi007.stdout: "max_count_per_host": { 2024-09-19T04:26:26.958 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_count_per_host", 2024-09-19T04:26:26.958 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:26.958 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.958 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.958 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T04:26:26.958 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.959 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.959 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.959 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of daemons per service per host", 2024-09-19T04:26:26.959 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.959 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.959 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.959 INFO:teuthology.orchestra.run.smithi007.stdout: "max_osd_draining_count": { 2024-09-19T04:26:26.959 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_osd_draining_count", 2024-09-19T04:26:26.959 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:26.959 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.959 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.959 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T04:26:26.959 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.960 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.960 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.960 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T04:26:26.960 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.960 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.960 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.960 INFO:teuthology.orchestra.run.smithi007.stdout: "migration_current": { 2024-09-19T04:26:26.960 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "migration_current", 2024-09-19T04:26:26.960 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:26.960 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.960 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.961 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:26.961 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.961 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.961 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.961 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "internal - do not modify", 2024-09-19T04:26:26.961 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.961 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.961 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.961 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-19T04:26:26.961 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-19T04:26:26.961 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.962 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.962 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.962 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "root", 2024-09-19T04:26:26.962 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.962 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.962 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:26.962 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm-package", 2024-09-19T04:26:26.962 INFO:teuthology.orchestra.run.smithi007.stdout: "root" 2024-09-19T04:26:26.962 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:26.962 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T04:26:26.962 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.962 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.962 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.963 INFO:teuthology.orchestra.run.smithi007.stdout: "oob_default_addr": { 2024-09-19T04:26:26.963 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "oob_default_addr", 2024-09-19T04:26:26.963 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.963 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.963 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.963 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "169.254.1.1", 2024-09-19T04:26:26.963 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.963 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.963 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.963 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T04:26:26.963 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.964 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.964 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.964 INFO:teuthology.orchestra.run.smithi007.stdout: "prometheus_alerts_path": { 2024-09-19T04:26:26.964 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus_alerts_path", 2024-09-19T04:26:26.964 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.964 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.964 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.964 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T04:26:26.964 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.964 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.964 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.964 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T04:26:26.965 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.965 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.965 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.965 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_insecure": { 2024-09-19T04:26:26.965 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_insecure", 2024-09-19T04:26:26.965 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.965 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.965 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.965 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:26.965 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.966 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.966 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.966 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T04:26:26.966 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.966 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.966 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.966 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_password": { 2024-09-19T04:26:26.966 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_password", 2024-09-19T04:26:26.966 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.966 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.966 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.967 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:26.967 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.967 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.967 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.967 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T04:26:26.967 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.967 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.967 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.967 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_url": { 2024-09-19T04:26:26.967 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_url", 2024-09-19T04:26:26.967 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.968 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.968 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.968 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:26.968 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.968 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.968 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.968 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T04:26:26.968 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.968 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.968 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.968 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_username": { 2024-09-19T04:26:26.968 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_username", 2024-09-19T04:26:26.969 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.969 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.969 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.969 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:26.969 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.969 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.969 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.969 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T04:26:26.969 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.969 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.969 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.970 INFO:teuthology.orchestra.run.smithi007.stdout: "secure_monitoring_stack": { 2024-09-19T04:26:26.970 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secure_monitoring_stack", 2024-09-19T04:26:26.970 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.970 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.970 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.970 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:26.970 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.970 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.970 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.970 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T04:26:26.970 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.970 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.971 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.971 INFO:teuthology.orchestra.run.smithi007.stdout: "service_discovery_port": { 2024-09-19T04:26:26.971 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "service_discovery_port", 2024-09-19T04:26:26.971 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:26.971 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.971 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.971 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8765", 2024-09-19T04:26:26.971 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.971 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.971 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.971 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "cephadm service discovery port", 2024-09-19T04:26:26.971 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.972 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.972 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.972 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_config_file": { 2024-09-19T04:26:26.972 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_config_file", 2024-09-19T04:26:26.972 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.972 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.972 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.972 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:26.972 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.972 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.972 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.972 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T04:26:26.973 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.973 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.973 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.973 INFO:teuthology.orchestra.run.smithi007.stdout: "use_agent": { 2024-09-19T04:26:26.973 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_agent", 2024-09-19T04:26:26.973 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.973 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.973 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.973 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:26.973 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.973 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.973 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.974 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T04:26:26.974 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.974 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.974 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.974 INFO:teuthology.orchestra.run.smithi007.stdout: "use_repo_digest": { 2024-09-19T04:26:26.974 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_repo_digest", 2024-09-19T04:26:26.974 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.974 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.974 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.974 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:26.974 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.975 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.975 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.975 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T04:26:26.975 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.975 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.975 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.975 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_failed_host_check": { 2024-09-19T04:26:26.975 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_failed_host_check", 2024-09-19T04:26:26.975 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.975 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.975 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.976 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:26.976 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.976 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.976 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.976 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T04:26:26.976 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.976 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.976 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.976 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_daemons": { 2024-09-19T04:26:26.976 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_daemons", 2024-09-19T04:26:26.976 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.976 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.977 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.977 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:26.977 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.977 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.977 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.977 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T04:26:26.977 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.977 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.977 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.977 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_hosts": { 2024-09-19T04:26:26.977 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_hosts", 2024-09-19T04:26:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T04:26:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crash", 2024-09-19T04:26:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.980 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.980 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:26.980 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:26.980 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:26.980 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:26.980 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:26.980 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:26.980 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:26.980 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:26.980 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:26.980 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: "retain_interval": { 2024-09-19T04:26:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retain_interval", 2024-09-19T04:26:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "31536000", 2024-09-19T04:26:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T04:26:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_recent_interval": { 2024-09-19T04:26:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_recent_interval", 2024-09-19T04:26:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1209600", 2024-09-19T04:26:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.987 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T04:26:26.987 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.987 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.987 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.987 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:26.987 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:26.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:26.987 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dashboard", 2024-09-19T04:26:26.987 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:26.987 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:26.987 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:26.987 INFO:teuthology.orchestra.run.smithi007.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T04:26:26.988 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T04:26:26.988 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:26.988 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.988 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.988 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T04:26:26.988 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.988 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.988 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.988 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:26.988 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.988 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.988 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.989 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T04:26:26.989 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T04:26:26.989 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:26.989 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.989 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.989 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:26.989 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.989 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.989 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.989 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:26.989 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.989 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.990 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.990 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T04:26:26.990 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T04:26:26.990 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.990 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.990 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.990 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:26.990 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.990 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.990 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.990 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:26.990 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.991 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.991 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.991 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_ENABLED": { 2024-09-19T04:26:26.991 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T04:26:26.991 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.991 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.991 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.991 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:26.991 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.991 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.991 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.991 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:26.992 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.992 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.992 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.992 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T04:26:26.992 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T04:26:26.992 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.992 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.992 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.992 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:26.992 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.992 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.992 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.993 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:26.993 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.993 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.993 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.993 INFO:teuthology.orchestra.run.smithi007.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T04:26:26.993 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T04:26:26.993 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.993 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.993 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.993 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:26.993 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.993 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.994 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.994 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:26.994 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.994 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.994 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.994 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T04:26:26.994 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T04:26:26.994 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.994 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.994 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.994 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:26.995 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.995 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.995 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.995 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:26.995 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.995 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.995 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.995 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T04:26:26.995 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T04:26:26.995 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.995 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.995 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.996 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:26.996 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.996 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.996 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.996 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:26.996 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.996 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.996 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.996 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T04:26:26.996 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T04:26:26.996 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.996 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.997 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.997 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:26.997 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.997 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.997 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.997 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:26.997 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.997 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.997 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.997 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T04:26:26.998 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T04:26:26.998 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.998 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.998 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.998 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:26.998 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.998 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.998 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.998 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:26.998 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.998 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:26.998 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:26.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:26.999 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T04:26:26.999 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T04:26:26.999 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:26.999 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:26.999 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:26.999 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:26.999 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:26.999 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:26.999 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:26.999 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:26.999 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:26.999 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.000 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.000 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T04:26:27.000 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T04:26:27.000 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.000 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.000 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.000 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.000 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.000 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.000 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.000 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.001 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.001 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.001 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.001 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T04:26:27.001 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T04:26:27.001 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.001 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.001 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.001 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.001 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.001 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.002 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.002 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.002 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.002 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.002 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.002 INFO:teuthology.orchestra.run.smithi007.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T04:26:27.002 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T04:26:27.002 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.002 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.002 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.002 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.002 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.003 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.003 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.003 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.003 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.003 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.003 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.003 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T04:26:27.003 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T04:26:27.003 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.003 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.003 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.004 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-19T04:26:27.004 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.004 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.004 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.004 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.004 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.004 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.004 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.004 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T04:26:27.004 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T04:26:27.004 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.004 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.005 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.005 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.005 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.005 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.005 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.005 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.005 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.005 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.005 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.005 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_URL": { 2024-09-19T04:26:27.005 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_URL", 2024-09-19T04:26:27.006 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.006 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.006 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.006 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.006 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.006 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.006 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.006 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.006 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.006 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.006 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.006 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T04:26:27.007 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T04:26:27.007 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.007 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.007 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.007 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-19T04:26:27.007 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.007 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.007 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.007 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.007 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.007 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.007 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.008 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T04:26:27.008 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T04:26:27.008 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.008 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.008 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.008 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.008 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.008 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.008 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.008 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.008 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.008 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.008 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.009 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T04:26:27.009 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T04:26:27.009 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.009 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.009 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.009 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.009 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.009 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.009 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.009 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.010 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.010 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.010 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.010 INFO:teuthology.orchestra.run.smithi007.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T04:26:27.010 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T04:26:27.010 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.010 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.010 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.010 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.010 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.010 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.010 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.011 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.011 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.011 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.011 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.011 INFO:teuthology.orchestra.run.smithi007.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T04:26:27.011 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T04:26:27.011 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.011 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.011 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.011 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.011 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.012 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.012 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.012 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.012 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.012 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.012 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.012 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T04:26:27.012 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T04:26:27.012 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.012 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.012 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.013 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.013 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.013 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.013 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.013 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.013 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.013 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.013 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.013 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T04:26:27.013 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T04:26:27.013 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.014 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.014 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.014 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.014 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.014 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.014 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.014 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.014 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.014 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.014 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.014 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T04:26:27.014 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T04:26:27.015 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.015 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.015 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.015 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.015 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.015 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.015 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.015 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.015 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.015 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.015 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.015 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T04:26:27.016 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T04:26:27.016 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.016 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.016 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.016 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.016 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.016 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.016 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.016 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.016 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.016 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.016 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.017 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T04:26:27.017 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T04:26:27.017 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.017 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.017 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.017 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.017 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.017 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.017 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.017 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.017 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.017 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.018 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.018 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T04:26:27.018 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T04:26:27.018 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.018 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.018 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.018 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.018 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.018 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.018 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.018 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.018 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.019 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.019 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.019 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T04:26:27.019 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T04:26:27.019 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.019 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.019 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.019 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.019 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.019 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.019 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.020 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.020 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.020 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.020 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.020 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T04:26:27.020 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T04:26:27.020 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.020 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.020 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.020 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.020 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.021 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.021 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.021 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.021 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.021 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.021 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.021 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T04:26:27.021 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T04:26:27.021 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.021 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.021 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.022 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.022 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.022 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.022 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.022 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.022 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.022 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.022 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.022 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T04:26:27.022 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T04:26:27.022 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.022 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.023 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.023 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.023 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.023 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.023 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.023 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.023 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.023 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.023 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.023 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T04:26:27.023 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T04:26:27.024 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.024 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.024 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.024 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T04:26:27.024 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.024 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.024 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.024 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.024 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.024 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.024 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.024 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T04:26:27.025 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T04:26:27.025 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.025 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.025 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.025 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T04:26:27.025 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.025 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.025 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.025 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.025 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.025 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.025 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.025 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T04:26:27.026 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T04:26:27.026 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.026 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.026 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.026 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8", 2024-09-19T04:26:27.026 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.026 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.026 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.026 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.026 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.026 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.026 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.027 INFO:teuthology.orchestra.run.smithi007.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T04:26:27.027 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T04:26:27.027 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.027 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.027 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.027 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "45", 2024-09-19T04:26:27.027 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.027 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.027 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.027 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.027 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.027 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.027 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.028 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T04:26:27.028 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T04:26:27.028 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.028 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.028 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.028 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.028 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.028 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.028 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.028 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.028 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.028 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.028 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.029 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T04:26:27.029 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T04:26:27.029 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.029 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.029 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.029 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-19T04:26:27.029 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.029 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.029 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.029 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.029 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.030 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.030 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.030 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T04:26:27.030 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T04:26:27.030 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.030 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.030 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.030 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.030 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.030 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.030 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.030 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.030 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.031 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.031 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.031 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T04:26:27.031 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T04:26:27.031 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.031 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.031 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.031 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.031 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.031 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.031 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.031 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.031 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.032 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.032 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.032 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T04:26:27.032 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T04:26:27.032 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.032 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.032 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.032 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T04:26:27.032 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.032 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.032 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.032 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.032 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.033 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.033 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.033 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T04:26:27.033 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T04:26:27.033 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.033 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.033 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.033 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T04:26:27.033 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.033 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.033 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.034 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.034 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.034 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.034 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.034 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T04:26:27.034 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T04:26:27.034 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.034 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.034 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.034 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T04:26:27.034 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.034 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.035 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.035 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.035 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.035 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.035 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.035 INFO:teuthology.orchestra.run.smithi007.stdout: "cross_origin_url": { 2024-09-19T04:26:27.035 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cross_origin_url", 2024-09-19T04:26:27.035 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.035 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.035 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.035 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.035 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.036 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.036 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.036 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.036 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.036 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.036 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.036 INFO:teuthology.orchestra.run.smithi007.stdout: "crt_file": { 2024-09-19T04:26:27.036 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crt_file", 2024-09-19T04:26:27.036 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.036 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.036 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.036 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.037 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.037 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.037 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.037 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.037 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.037 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.037 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.037 INFO:teuthology.orchestra.run.smithi007.stdout: "debug": { 2024-09-19T04:26:27.037 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "debug", 2024-09-19T04:26:27.037 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.037 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.038 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.038 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.038 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.038 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.038 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.038 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable/disable debug options", 2024-09-19T04:26:27.038 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.038 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.038 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.038 INFO:teuthology.orchestra.run.smithi007.stdout: "jwt_token_ttl": { 2024-09-19T04:26:27.038 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "jwt_token_ttl", 2024-09-19T04:26:27.038 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.038 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.039 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.039 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "28800", 2024-09-19T04:26:27.039 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.039 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.039 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.039 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.039 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.039 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.039 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.039 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-19T04:26:27.039 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-19T04:26:27.039 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.039 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.039 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.040 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.040 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.040 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.040 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.040 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.040 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.040 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.040 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.040 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.040 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.040 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.040 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.041 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.041 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.041 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.041 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.041 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.041 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.041 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.041 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.041 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.041 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.041 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.041 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.041 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.042 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.042 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.042 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.042 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.042 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.042 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.042 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.042 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.042 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.042 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.042 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.043 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.043 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.043 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.043 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.043 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.043 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.043 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.043 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.043 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.043 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.043 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.043 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.044 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.044 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.044 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.044 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.044 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.044 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.044 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.044 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.044 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.044 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.044 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.044 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.045 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.045 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.045 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.045 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.045 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.045 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.045 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.045 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.045 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.045 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.045 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.045 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.046 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.046 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.046 INFO:teuthology.orchestra.run.smithi007.stdout: "motd": { 2024-09-19T04:26:27.046 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "motd", 2024-09-19T04:26:27.046 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.046 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.046 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.046 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.046 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.046 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.046 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.046 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "The message of the day", 2024-09-19T04:26:27.046 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.047 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.047 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.047 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect_resolve_ip_addr": { 2024-09-19T04:26:27.047 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T04:26:27.047 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.047 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.047 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.047 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.047 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.047 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.047 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.047 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.047 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.048 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.048 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.048 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-19T04:26:27.048 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-19T04:26:27.048 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.048 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.048 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.048 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-19T04:26:27.048 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.048 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.048 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.049 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.049 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.049 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.049 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.049 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-19T04:26:27.049 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-19T04:26:27.049 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.050 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.050 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.050 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8080", 2024-09-19T04:26:27.050 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.050 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.050 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.050 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.050 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.050 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.050 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.050 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-19T04:26:27.051 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-19T04:26:27.051 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.051 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.051 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.051 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.051 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.051 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.051 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.051 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.051 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.051 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.051 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.052 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl_server_port": { 2024-09-19T04:26:27.052 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl_server_port", 2024-09-19T04:26:27.052 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.052 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.052 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.052 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8443", 2024-09-19T04:26:27.052 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.052 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.052 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.052 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.052 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.053 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.053 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.053 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-19T04:26:27.053 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-19T04:26:27.053 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.053 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.053 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.053 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "redirect", 2024-09-19T04:26:27.053 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.053 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.053 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.053 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.054 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect" 2024-09-19T04:26:27.054 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.054 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.054 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.054 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.054 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.054 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-19T04:26:27.054 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-19T04:26:27.054 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.054 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.054 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.055 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-19T04:26:27.055 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-19T04:26:27.055 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-19T04:26:27.055 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.055 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.055 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.055 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.055 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.055 INFO:teuthology.orchestra.run.smithi007.stdout: "url_prefix": { 2024-09-19T04:26:27.055 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url_prefix", 2024-09-19T04:26:27.055 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.055 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.055 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.056 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.056 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.056 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.056 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.056 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.056 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.056 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.056 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.056 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.056 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.056 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.057 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "devicehealth", 2024-09-19T04:26:27.057 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.057 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.057 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.057 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_monitoring": { 2024-09-19T04:26:27.057 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_monitoring", 2024-09-19T04:26:27.057 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.057 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.057 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.057 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.057 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.057 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.057 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.058 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "monitor device health metrics", 2024-09-19T04:26:27.058 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.058 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.058 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.058 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.058 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.058 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.058 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.059 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.059 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.059 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.059 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.059 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.059 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.059 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.059 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.059 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.059 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.059 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.059 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.060 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.060 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.060 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.060 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.060 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.060 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.060 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.060 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.060 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.060 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.060 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.061 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.061 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.061 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.061 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.061 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.061 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.061 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.061 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.061 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.061 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.061 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.062 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.062 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.062 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.062 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.062 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.062 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.062 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.062 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.062 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.062 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.062 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.062 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.062 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.063 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.063 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.063 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.063 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.063 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.063 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.063 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.063 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.063 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.063 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.063 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.063 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.064 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.064 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.064 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.064 INFO:teuthology.orchestra.run.smithi007.stdout: "mark_out_threshold": { 2024-09-19T04:26:27.064 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mark_out_threshold", 2024-09-19T04:26:27.064 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.064 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.064 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.064 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2419200", 2024-09-19T04:26:27.064 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.065 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.065 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.065 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T04:26:27.065 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.065 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.065 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.065 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": { 2024-09-19T04:26:27.065 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_name", 2024-09-19T04:26:27.065 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.065 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.065 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.066 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "device_health_metrics", 2024-09-19T04:26:27.066 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.066 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.066 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.066 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T04:26:27.066 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.066 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.066 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.066 INFO:teuthology.orchestra.run.smithi007.stdout: "retention_period": { 2024-09-19T04:26:27.066 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retention_period", 2024-09-19T04:26:27.066 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.066 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.067 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.067 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15552000", 2024-09-19T04:26:27.067 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.067 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.067 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.067 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain device health metrics", 2024-09-19T04:26:27.067 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.067 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.067 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.067 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_frequency": { 2024-09-19T04:26:27.067 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_frequency", 2024-09-19T04:26:27.067 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.068 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.068 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.068 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-19T04:26:27.068 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.068 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.068 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.068 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T04:26:27.068 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.068 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.068 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.068 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.069 INFO:teuthology.orchestra.run.smithi007.stdout: "self_heal": { 2024-09-19T04:26:27.069 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "self_heal", 2024-09-19T04:26:27.069 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.069 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.069 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.069 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.069 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.069 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.069 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.069 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T04:26:27.069 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.069 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.070 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.070 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T04:26:27.070 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T04:26:27.070 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.070 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.070 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.070 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T04:26:27.070 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.070 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.070 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.070 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T04:26:27.070 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.071 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.071 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.071 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_threshold": { 2024-09-19T04:26:27.071 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_threshold", 2024-09-19T04:26:27.071 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.071 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.071 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.071 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7257600", 2024-09-19T04:26:27.071 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.071 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.071 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.072 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T04:26:27.072 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.072 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.072 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.072 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.072 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.072 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.072 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "diskprediction_local", 2024-09-19T04:26:27.072 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.072 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.072 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.073 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.073 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.073 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.073 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.073 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.073 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.073 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.073 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.073 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.073 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.073 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.073 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.073 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.074 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.074 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.074 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.074 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.074 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.074 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.074 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.074 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.074 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.074 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.074 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.074 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.074 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.075 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.075 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.075 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.075 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.075 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.075 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.075 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.075 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.075 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.075 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.075 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.076 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.076 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.076 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.076 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.076 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.076 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.076 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.076 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.076 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.076 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.076 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.076 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.076 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.077 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.077 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.077 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.077 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.077 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.077 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.077 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.077 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.077 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.077 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.077 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.078 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.078 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.078 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.078 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.078 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.078 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.078 INFO:teuthology.orchestra.run.smithi007.stdout: "predict_interval": { 2024-09-19T04:26:27.078 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predict_interval", 2024-09-19T04:26:27.078 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.078 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.078 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.079 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-19T04:26:27.079 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.079 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.079 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.079 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.079 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.079 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.079 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.079 INFO:teuthology.orchestra.run.smithi007.stdout: "predictor_model": { 2024-09-19T04:26:27.079 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predictor_model", 2024-09-19T04:26:27.079 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.079 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.079 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.080 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "prophetstor", 2024-09-19T04:26:27.080 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.080 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.080 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.080 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.080 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.080 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.080 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.080 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T04:26:27.080 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T04:26:27.080 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.080 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.081 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.081 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T04:26:27.081 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.081 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.081 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.081 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.081 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.081 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.081 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.081 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.081 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.081 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.082 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "influx", 2024-09-19T04:26:27.082 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": false, 2024-09-19T04:26:27.082 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "influxdb python module not found", 2024-09-19T04:26:27.082 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.082 INFO:teuthology.orchestra.run.smithi007.stdout: "batch_size": { 2024-09-19T04:26:27.082 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "batch_size", 2024-09-19T04:26:27.082 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.082 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.082 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.082 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5000", 2024-09-19T04:26:27.082 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.082 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.082 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.083 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T04:26:27.083 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.083 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.083 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.083 INFO:teuthology.orchestra.run.smithi007.stdout: "database": { 2024-09-19T04:26:27.083 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "database", 2024-09-19T04:26:27.083 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.083 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.083 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.083 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "ceph", 2024-09-19T04:26:27.083 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.083 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.084 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.084 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T04:26:27.084 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.084 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.084 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.084 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": { 2024-09-19T04:26:27.084 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hostname", 2024-09-19T04:26:27.084 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.084 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.084 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.084 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.085 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.085 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.085 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.085 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server hostname", 2024-09-19T04:26:27.085 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.085 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.085 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.085 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.085 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T04:26:27.085 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T04:26:27.085 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.085 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.086 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.086 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "30", 2024-09-19T04:26:27.086 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "5", 2024-09-19T04:26:27.086 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.086 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.086 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T04:26:27.086 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.086 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.086 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.086 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.086 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.087 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.087 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.087 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.087 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.087 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.087 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.087 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.087 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.087 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.087 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.087 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.087 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.088 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.088 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.088 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.088 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.088 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.088 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.088 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.088 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.088 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.088 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.088 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.088 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.088 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.089 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.089 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.089 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.089 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.089 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.089 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.089 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.089 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.089 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.089 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.089 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.089 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.090 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.090 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.090 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.090 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.090 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.090 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.090 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.090 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.090 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.090 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.090 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.090 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.090 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.091 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.091 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.091 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.091 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.091 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.091 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.091 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.091 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.091 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.091 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.091 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.091 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.092 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.092 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.092 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.092 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.092 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.092 INFO:teuthology.orchestra.run.smithi007.stdout: "password": { 2024-09-19T04:26:27.092 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "password", 2024-09-19T04:26:27.092 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.092 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.092 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.092 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.092 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.092 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.093 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.093 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "password of InfluxDB server user", 2024-09-19T04:26:27.093 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.093 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.093 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.093 INFO:teuthology.orchestra.run.smithi007.stdout: "port": { 2024-09-19T04:26:27.093 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "port", 2024-09-19T04:26:27.093 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.093 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.093 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.093 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8086", 2024-09-19T04:26:27.094 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.094 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.094 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.094 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server port", 2024-09-19T04:26:27.094 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.094 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.094 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.094 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-19T04:26:27.094 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-19T04:26:27.094 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.094 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.094 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.095 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "false", 2024-09-19T04:26:27.095 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.095 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.095 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.095 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T04:26:27.095 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.095 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.095 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.095 INFO:teuthology.orchestra.run.smithi007.stdout: "threads": { 2024-09-19T04:26:27.095 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threads", 2024-09-19T04:26:27.095 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.095 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.096 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.096 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T04:26:27.096 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-19T04:26:27.096 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "32", 2024-09-19T04:26:27.096 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.096 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T04:26:27.096 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.096 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.096 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.096 INFO:teuthology.orchestra.run.smithi007.stdout: "username": { 2024-09-19T04:26:27.096 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "username", 2024-09-19T04:26:27.096 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.097 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.097 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.097 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.097 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.097 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.097 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.097 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "username of InfluxDB server user", 2024-09-19T04:26:27.097 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.097 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.097 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.097 INFO:teuthology.orchestra.run.smithi007.stdout: "verify_ssl": { 2024-09-19T04:26:27.098 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "verify_ssl", 2024-09-19T04:26:27.098 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.098 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.098 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.098 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "true", 2024-09-19T04:26:27.098 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.098 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.098 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.098 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T04:26:27.098 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.098 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.098 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.098 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.099 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.099 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "insights", 2024-09-19T04:26:27.099 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.099 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.099 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.099 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.099 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.099 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.099 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.099 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.100 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.100 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.100 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.100 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.100 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.100 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.100 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.100 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.100 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.100 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.100 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.100 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.101 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.101 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.101 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.101 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.101 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.101 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.101 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.101 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.101 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.101 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.101 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.101 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.102 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.102 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.102 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.102 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.102 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.102 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.102 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.102 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.102 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.102 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.102 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.102 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.103 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.103 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.103 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.103 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.103 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.103 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.103 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.103 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.103 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.103 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.103 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.103 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.103 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.104 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.104 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.104 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.104 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.104 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.104 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.104 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.104 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.104 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.104 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.104 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.104 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.105 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.105 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.105 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.105 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "iostat", 2024-09-19T04:26:27.105 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.105 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.105 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.105 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.105 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.105 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.105 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.106 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.106 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.106 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.106 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.106 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.106 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.106 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.106 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.106 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.106 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.106 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.106 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.107 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.107 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.107 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.107 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.107 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.107 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.107 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.107 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.107 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.107 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.107 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.107 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.108 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.108 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.108 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.108 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.108 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.108 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.108 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.108 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.108 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.108 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.108 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.109 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.109 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.109 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.109 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.109 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.109 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.109 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.109 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.109 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.109 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.109 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.109 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.109 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.110 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.110 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.110 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.110 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.110 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.110 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.110 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.110 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.110 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.110 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.110 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.111 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.111 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.111 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.111 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.111 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.111 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.111 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "k8sevents", 2024-09-19T04:26:27.111 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.111 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.111 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.111 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_event_retention_days": { 2024-09-19T04:26:27.111 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ceph_event_retention_days", 2024-09-19T04:26:27.112 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.112 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.112 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.112 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7", 2024-09-19T04:26:27.112 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.112 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.112 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.112 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T04:26:27.112 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.112 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.112 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.113 INFO:teuthology.orchestra.run.smithi007.stdout: "config_check_secs": { 2024-09-19T04:26:27.113 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_check_secs", 2024-09-19T04:26:27.113 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.113 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.113 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.113 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T04:26:27.113 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "10", 2024-09-19T04:26:27.113 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.113 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.113 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T04:26:27.113 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.114 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.114 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.114 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.114 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.114 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.114 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.114 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.114 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.114 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.114 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.114 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.115 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.115 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.115 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.115 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.115 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.115 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.115 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.115 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.115 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.115 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.115 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.115 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.115 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.115 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.116 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.116 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.116 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.116 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.116 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.116 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.116 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.116 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.116 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.116 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.116 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.117 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.117 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.117 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.117 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.117 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.117 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.117 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.117 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.117 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.117 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.117 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.117 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.117 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.118 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.118 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.118 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.118 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.118 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.118 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.118 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.118 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.118 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.118 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.118 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.118 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.119 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.119 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.119 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.119 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.119 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.119 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.119 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.119 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.119 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.119 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.119 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.120 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "localpool", 2024-09-19T04:26:27.120 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.120 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.120 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.120 INFO:teuthology.orchestra.run.smithi007.stdout: "failure_domain": { 2024-09-19T04:26:27.120 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "failure_domain", 2024-09-19T04:26:27.120 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.120 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.120 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.120 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "host", 2024-09-19T04:26:27.120 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.120 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.121 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.121 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "failure domain for any created local pool", 2024-09-19T04:26:27.121 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T04:26:27.121 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.121 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.121 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.121 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.121 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.121 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.121 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.121 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.121 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.121 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.122 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.122 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.122 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.122 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.122 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.122 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.122 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.122 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.122 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.122 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.122 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.122 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.122 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.123 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.123 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.123 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.123 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.123 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.123 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.123 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.123 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.123 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.123 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.123 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.123 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.124 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.124 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.124 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.124 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.124 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.124 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.124 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.124 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.124 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.124 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.124 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.124 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.125 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.125 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.125 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.125 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.125 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.125 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.125 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.125 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.125 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.125 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.125 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.125 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.126 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.126 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.126 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.126 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.126 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.126 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.126 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.126 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.126 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.126 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.126 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": { 2024-09-19T04:26:27.126 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_size", 2024-09-19T04:26:27.127 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.127 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.127 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.127 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.127 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.127 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.127 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.127 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default min_size for any created local pool", 2024-09-19T04:26:27.127 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T04:26:27.127 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.127 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.127 INFO:teuthology.orchestra.run.smithi007.stdout: "num_rep": { 2024-09-19T04:26:27.127 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "num_rep", 2024-09-19T04:26:27.128 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.128 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.128 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.128 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3", 2024-09-19T04:26:27.128 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.128 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.128 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.128 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default replica count for any created local pool", 2024-09-19T04:26:27.128 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.128 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.128 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.129 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": { 2024-09-19T04:26:27.129 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_num", 2024-09-19T04:26:27.129 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.129 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.129 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.129 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "128", 2024-09-19T04:26:27.129 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.129 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.129 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.129 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T04:26:27.129 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.129 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.130 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.130 INFO:teuthology.orchestra.run.smithi007.stdout: "prefix": { 2024-09-19T04:26:27.130 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prefix", 2024-09-19T04:26:27.130 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.130 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.130 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.130 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.130 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.130 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.130 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.130 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name prefix for any created local pool", 2024-09-19T04:26:27.130 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.131 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.131 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.131 INFO:teuthology.orchestra.run.smithi007.stdout: "subtree": { 2024-09-19T04:26:27.131 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "subtree", 2024-09-19T04:26:27.131 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.131 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.131 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.131 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "rack", 2024-09-19T04:26:27.131 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.131 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.131 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.131 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T04:26:27.132 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T04:26:27.132 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.132 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.132 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.132 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.132 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.132 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mds_autoscaler", 2024-09-19T04:26:27.132 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.132 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.132 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.132 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.133 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.133 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.133 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.133 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.133 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.133 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.133 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.133 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.133 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.133 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.133 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.133 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.133 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.134 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.134 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.134 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.134 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.134 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.134 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.134 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.134 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.134 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.134 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.134 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.135 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.135 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.135 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.135 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.135 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.135 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.135 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.135 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.135 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.135 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.135 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.135 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.136 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.136 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.136 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.136 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.136 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.136 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.136 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.136 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.136 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.136 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.136 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.136 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.136 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.137 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.137 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.137 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.137 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.137 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.137 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.137 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.137 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.137 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.137 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.137 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.138 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.138 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.138 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.138 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.138 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.138 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.138 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.138 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.138 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirroring", 2024-09-19T04:26:27.138 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.138 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.138 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.138 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.139 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.139 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.139 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.139 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.139 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.139 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.139 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.139 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.139 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.139 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.139 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.139 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.140 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.140 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.140 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.140 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.140 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.140 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.140 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.140 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.140 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.140 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.140 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.140 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.141 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.141 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.141 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.141 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.141 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.141 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.141 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.141 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.141 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.141 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.141 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.142 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.142 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.142 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.142 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.142 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.142 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.142 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.142 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.142 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.142 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.142 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.142 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.142 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.143 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.143 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.143 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.143 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.143 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.143 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.143 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.143 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.143 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.143 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.144 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.144 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.144 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.144 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.144 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.144 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.144 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.144 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.144 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.144 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.144 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "nfs", 2024-09-19T04:26:27.144 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.145 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.145 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.145 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.145 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.145 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.145 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.145 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.145 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.145 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.145 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.145 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.145 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.145 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.146 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.146 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.146 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.146 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.146 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.146 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.146 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.146 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.146 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.146 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.146 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.146 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.146 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.147 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.147 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.147 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.147 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.147 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.147 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.147 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.147 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.147 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.147 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.147 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.147 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.147 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.148 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.148 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.148 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.148 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.148 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.148 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.148 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.148 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.148 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.148 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.148 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.148 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.149 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.149 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.149 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.149 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.149 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.149 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.149 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.149 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.149 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.149 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.149 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.149 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.150 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.150 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.150 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.150 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.150 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.150 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.150 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.150 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.150 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-19T04:26:27.150 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.150 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.150 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.151 INFO:teuthology.orchestra.run.smithi007.stdout: "fail_fs": { 2024-09-19T04:26:27.151 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "fail_fs", 2024-09-19T04:26:27.151 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.151 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.151 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.151 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.151 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.151 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.151 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.151 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T04:26:27.151 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.151 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.151 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.152 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.152 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.152 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.152 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.152 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.152 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.152 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.152 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.152 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.152 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.152 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.152 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.153 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.153 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.153 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.153 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.153 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.153 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.153 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.153 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.153 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.153 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.153 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.153 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.154 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.154 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.154 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.154 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.154 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.154 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.154 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.154 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.154 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.154 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.154 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.154 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.155 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.155 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.155 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.155 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.155 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.155 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.155 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.155 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.155 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.155 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.155 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.155 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.155 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.156 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.156 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.156 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.156 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.156 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.156 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.156 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.156 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.156 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.156 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.156 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.156 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.157 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.157 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.157 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.157 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.157 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.157 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.157 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.157 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator": { 2024-09-19T04:26:27.157 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-19T04:26:27.157 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.157 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.157 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.158 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.158 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.158 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.158 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.158 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm", 2024-09-19T04:26:27.158 INFO:teuthology.orchestra.run.smithi007.stdout: "rook", 2024-09-19T04:26:27.158 INFO:teuthology.orchestra.run.smithi007.stdout: "test_orchestrator" 2024-09-19T04:26:27.158 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.158 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Orchestrator backend", 2024-09-19T04:26:27.158 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.158 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.158 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.158 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.159 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.159 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.159 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_perf_query", 2024-09-19T04:26:27.159 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.159 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.159 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.159 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.159 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.159 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.159 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.160 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.160 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.160 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.160 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.160 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.160 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.160 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.160 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.160 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.160 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.160 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.160 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.160 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.161 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.161 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.161 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.161 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.161 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.161 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.161 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.161 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.161 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.161 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.161 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.161 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.162 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.162 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.162 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.162 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.162 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.162 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.162 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.162 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.162 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.162 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.162 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.162 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.162 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.163 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.163 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.163 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.163 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.163 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.163 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.163 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.163 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.163 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.163 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.163 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.163 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.164 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.164 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.164 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.164 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.164 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.164 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.164 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.164 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.164 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.164 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.164 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.164 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.165 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.165 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.165 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.165 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.165 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_support", 2024-09-19T04:26:27.165 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.165 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.165 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.165 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.165 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.165 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.165 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.166 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.166 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.166 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.166 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.166 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.166 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.166 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.166 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.166 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.166 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.166 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.166 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.166 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.167 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.167 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.167 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.167 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.167 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.167 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.167 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.167 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.167 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.167 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.167 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.167 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.167 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.168 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.168 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.168 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.168 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.168 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.168 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.168 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.168 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.168 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.168 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.168 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.169 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.169 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.169 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.169 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.169 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.169 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.169 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.169 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.169 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.169 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.169 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.169 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.170 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.170 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.170 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.170 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.170 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.170 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.170 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.170 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.170 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.170 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.170 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.170 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.171 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.171 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.171 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.171 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.171 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.171 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_autoscaler", 2024-09-19T04:26:27.171 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.171 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.171 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.171 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.171 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.171 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.172 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.172 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.172 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.172 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.172 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.172 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.172 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.172 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.172 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.172 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.172 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.172 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.173 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.173 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.173 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.173 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.173 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.173 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.173 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.173 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.173 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.173 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.173 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.173 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.174 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.174 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.174 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.174 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.174 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.174 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.174 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.174 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.174 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.174 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.175 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.175 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.175 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.175 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.175 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.175 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.175 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.175 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.175 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.175 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.175 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.175 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.176 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.176 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.176 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.176 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.176 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.176 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.176 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.176 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.176 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.176 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.176 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.177 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.177 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.177 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.177 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.177 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.177 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.177 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T04:26:27.177 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T04:26:27.177 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.177 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.177 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.178 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T04:26:27.178 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.178 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.178 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.178 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.178 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.178 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.178 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.178 INFO:teuthology.orchestra.run.smithi007.stdout: "threshold": { 2024-09-19T04:26:27.178 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threshold", 2024-09-19T04:26:27.178 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T04:26:27.178 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.179 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.179 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-19T04:26:27.179 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1.0", 2024-09-19T04:26:27.179 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.179 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.179 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "scaling threshold", 2024-09-19T04:26:27.179 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T04:26:27.179 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.179 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.179 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.179 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.180 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "progress", 2024-09-19T04:26:27.180 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.180 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.180 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.180 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_pg_recovery_event": { 2024-09-19T04:26:27.180 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_pg_recovery_event", 2024-09-19T04:26:27.180 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.180 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.180 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.180 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.180 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.180 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.181 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.181 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T04:26:27.181 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.181 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.181 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.181 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-19T04:26:27.181 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-19T04:26:27.181 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.181 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.181 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.181 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.181 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.182 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.182 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.182 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.182 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.182 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.182 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.182 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.182 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.182 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.182 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.182 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.182 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.183 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.183 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.183 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.183 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.183 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.183 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.183 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.183 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.183 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.183 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.183 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.183 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.184 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.184 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.184 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.184 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.184 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.184 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.184 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.184 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.184 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.184 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.184 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.184 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.185 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.185 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.188 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.188 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.188 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.188 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.188 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.188 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.188 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.189 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.189 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.189 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.189 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.189 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.189 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.189 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.189 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.190 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.190 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.190 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.190 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.190 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.190 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.190 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.190 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.190 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.190 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.190 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.190 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.191 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.191 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.191 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.191 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.191 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.191 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.191 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.191 INFO:teuthology.orchestra.run.smithi007.stdout: "max_completed_events": { 2024-09-19T04:26:27.191 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_completed_events", 2024-09-19T04:26:27.191 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.191 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.192 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.192 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "50", 2024-09-19T04:26:27.192 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.192 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.192 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.192 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "number of past completed events to remember", 2024-09-19T04:26:27.192 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.192 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.192 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.192 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T04:26:27.193 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T04:26:27.193 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.193 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.193 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.193 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T04:26:27.193 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.193 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.193 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.193 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long the module is going to sleep", 2024-09-19T04:26:27.194 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.194 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.194 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.194 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.194 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.194 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus", 2024-09-19T04:26:27.194 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.194 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.194 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.194 INFO:teuthology.orchestra.run.smithi007.stdout: "cache": { 2024-09-19T04:26:27.194 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cache", 2024-09-19T04:26:27.195 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.195 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.195 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.195 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.195 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.195 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.195 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.195 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.195 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.195 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.196 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.196 INFO:teuthology.orchestra.run.smithi007.stdout: "exclude_perf_counters": { 2024-09-19T04:26:27.196 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "exclude_perf_counters", 2024-09-19T04:26:27.196 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.196 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.196 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.196 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.196 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.196 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.196 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.197 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T04:26:27.197 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T04:26:27.197 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.197 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.197 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.197 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.197 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.197 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.197 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.198 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.198 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.198 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.198 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.198 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.198 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.198 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.198 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.198 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.198 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.198 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.198 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.199 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.199 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.199 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.199 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.199 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.199 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.199 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.199 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.199 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.199 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.200 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.200 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.200 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.200 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.200 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.200 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.200 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.200 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.200 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.200 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.200 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.201 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.201 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.201 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.201 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.201 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.201 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.201 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.201 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.201 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.201 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.201 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.202 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.202 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.202 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.202 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.202 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.202 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.202 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.202 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.202 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.202 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.202 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.203 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.203 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.203 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.203 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.203 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.203 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.203 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools": { 2024-09-19T04:26:27.203 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools", 2024-09-19T04:26:27.203 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.203 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.203 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.204 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.204 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.204 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.204 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.204 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.204 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.204 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.204 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.204 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T04:26:27.204 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T04:26:27.204 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.204 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.205 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.205 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "300", 2024-09-19T04:26:27.205 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.205 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.205 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.205 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.205 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.205 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.205 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.205 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_interval": { 2024-09-19T04:26:27.205 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_interval", 2024-09-19T04:26:27.206 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T04:26:27.206 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.206 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.206 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15.0", 2024-09-19T04:26:27.206 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.206 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.206 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.206 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.206 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.206 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.206 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.206 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-19T04:26:27.206 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-19T04:26:27.207 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.207 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.207 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.207 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-19T04:26:27.207 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.207 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.207 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.207 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T04:26:27.207 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.207 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.207 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.207 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-19T04:26:27.207 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-19T04:26:27.208 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.208 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.208 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.208 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "9283", 2024-09-19T04:26:27.208 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.208 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.208 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.208 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T04:26:27.208 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.208 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.208 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.208 INFO:teuthology.orchestra.run.smithi007.stdout: "stale_cache_strategy": { 2024-09-19T04:26:27.208 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stale_cache_strategy", 2024-09-19T04:26:27.209 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.209 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.209 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.209 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "log", 2024-09-19T04:26:27.209 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.209 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.209 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.209 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.209 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.209 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.209 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.210 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-19T04:26:27.210 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-19T04:26:27.210 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.210 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.210 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.210 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "default", 2024-09-19T04:26:27.210 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.210 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.210 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.210 INFO:teuthology.orchestra.run.smithi007.stdout: "default", 2024-09-19T04:26:27.210 INFO:teuthology.orchestra.run.smithi007.stdout: "error" 2024-09-19T04:26:27.210 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.210 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.211 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.211 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.211 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.211 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-19T04:26:27.211 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-19T04:26:27.211 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.211 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.211 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.211 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-19T04:26:27.211 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-19T04:26:27.211 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-19T04:26:27.211 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.211 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.212 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.212 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.212 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.212 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.212 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.212 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_support", 2024-09-19T04:26:27.212 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.212 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.212 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.212 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.212 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.213 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.213 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.213 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.213 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.213 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.213 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.213 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.213 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.213 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.213 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.213 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.213 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.214 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.214 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.214 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.214 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.214 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.214 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.214 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.214 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.214 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.214 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.215 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.215 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.215 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.215 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.215 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.215 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.215 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.215 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.215 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.215 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.215 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.215 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.215 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.216 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.216 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.216 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.216 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.216 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.216 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.216 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.216 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.216 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.216 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.216 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.216 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.216 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.217 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.217 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.217 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.217 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.217 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.217 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.217 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.217 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.217 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.217 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.217 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.218 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.218 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.218 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.218 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.218 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.218 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_snap_create": { 2024-09-19T04:26:27.218 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_snap_create", 2024-09-19T04:26:27.218 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.218 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.218 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.218 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T04:26:27.218 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.219 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.219 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.219 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.219 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.219 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.219 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.219 INFO:teuthology.orchestra.run.smithi007.stdout: "mirror_snapshot_schedule": { 2024-09-19T04:26:27.219 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T04:26:27.219 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.219 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.219 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.220 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.220 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.220 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.220 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.220 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.220 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.220 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.220 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.220 INFO:teuthology.orchestra.run.smithi007.stdout: "trash_purge_schedule": { 2024-09-19T04:26:27.220 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "trash_purge_schedule", 2024-09-19T04:26:27.220 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.221 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.221 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.221 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.221 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.221 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.221 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.221 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.221 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.221 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.221 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.221 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.222 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.222 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "restful", 2024-09-19T04:26:27.222 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.222 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.222 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.222 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_auth": { 2024-09-19T04:26:27.222 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_auth", 2024-09-19T04:26:27.222 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.222 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.222 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.223 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.223 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.223 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.223 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.223 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.223 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.223 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.223 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.223 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-19T04:26:27.223 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-19T04:26:27.223 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.224 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.224 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.224 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.224 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.224 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.224 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.224 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.224 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.224 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.225 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.225 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.225 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.225 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.225 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.225 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.225 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.225 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.225 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.226 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.226 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.226 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.226 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.226 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.226 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.226 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.226 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.226 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.226 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.226 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.226 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.227 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.227 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.227 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.227 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.227 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.227 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.227 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.227 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.227 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.227 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.227 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.227 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.227 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.228 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.228 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.228 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.228 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.228 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.228 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.228 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.228 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.228 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.228 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.228 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.228 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.228 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.228 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.229 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.229 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.229 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.229 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.229 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.229 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.229 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.229 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.229 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.229 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.229 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.230 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.230 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.230 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.230 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.230 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.230 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.230 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.230 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.230 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-19T04:26:27.230 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-19T04:26:27.230 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.230 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.231 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.231 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.231 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.231 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.231 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.231 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.231 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.231 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.231 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.231 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-19T04:26:27.231 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-19T04:26:27.231 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.231 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.232 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.232 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.232 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.232 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.232 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.232 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.232 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.232 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.232 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.232 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.232 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.233 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rgw", 2024-09-19T04:26:27.233 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.233 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.233 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.233 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.233 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.233 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.233 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.233 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.233 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.233 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.233 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.233 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.233 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.234 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.234 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.234 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.234 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.234 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.234 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.234 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.234 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.234 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.234 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.234 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.234 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.234 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.234 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.235 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.235 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.235 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.235 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.235 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.235 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.235 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.235 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.235 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.235 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.235 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.235 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.235 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.236 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.236 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.236 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.236 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.236 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.236 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.236 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.236 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.236 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.236 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.236 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.236 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.237 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.237 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.237 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.237 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.237 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.237 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.237 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.237 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.237 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.237 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.237 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.237 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.237 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.238 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.238 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.238 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.238 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.238 INFO:teuthology.orchestra.run.smithi007.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T04:26:27.238 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T04:26:27.238 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.238 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.238 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.238 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T04:26:27.238 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.238 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.238 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.239 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T04:26:27.239 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.239 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.239 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.239 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.239 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.239 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rook", 2024-09-19T04:26:27.239 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.239 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.239 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.240 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.240 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.240 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.240 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.240 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.240 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.240 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.240 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.240 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.240 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.240 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.241 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.241 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.241 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.241 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.241 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.241 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.241 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.241 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.241 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.241 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.241 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.241 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.242 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.242 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.242 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.242 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.242 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.242 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.242 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.242 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.242 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.242 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.243 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.243 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.243 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.243 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.243 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.243 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.243 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.243 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.243 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.243 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.243 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.243 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.243 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.244 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.244 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.244 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.244 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.244 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.244 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.244 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.244 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.244 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.244 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.244 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.244 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.245 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.245 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.245 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.245 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.245 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.245 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.245 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.245 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.245 INFO:teuthology.orchestra.run.smithi007.stdout: "storage_class": { 2024-09-19T04:26:27.245 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "storage_class", 2024-09-19T04:26:27.245 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.245 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.245 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.246 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "local", 2024-09-19T04:26:27.246 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.246 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.246 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.246 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T04:26:27.246 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.246 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.246 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.246 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.246 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.246 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "selftest", 2024-09-19T04:26:27.246 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.247 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.247 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.247 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.247 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.247 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.247 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.247 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.247 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.247 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.247 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.247 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.247 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.247 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.247 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.248 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.248 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.248 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.248 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.248 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.248 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.248 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.248 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.248 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.248 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.248 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.248 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.249 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.249 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.249 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.249 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.249 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.249 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.249 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.249 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.249 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.249 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.249 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.249 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.249 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.249 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.250 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.250 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.250 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.250 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.250 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.250 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.250 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.250 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.250 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.250 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.250 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.250 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.251 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.251 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.251 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.251 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.251 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.251 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.251 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.251 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.251 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.251 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.251 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.251 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.252 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.252 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.252 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.252 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.252 INFO:teuthology.orchestra.run.smithi007.stdout: "roption1": { 2024-09-19T04:26:27.252 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption1", 2024-09-19T04:26:27.252 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.252 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.252 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.252 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.252 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.252 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.252 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.253 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.253 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.253 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.253 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.253 INFO:teuthology.orchestra.run.smithi007.stdout: "roption2": { 2024-09-19T04:26:27.253 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption2", 2024-09-19T04:26:27.253 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.253 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.253 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.253 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "xyz", 2024-09-19T04:26:27.253 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.253 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.254 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.254 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.254 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.254 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.254 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.254 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption1": { 2024-09-19T04:26:27.254 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption1", 2024-09-19T04:26:27.254 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.254 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.254 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.254 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.254 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.254 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.255 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.255 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.255 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.255 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.255 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.255 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption2": { 2024-09-19T04:26:27.255 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption2", 2024-09-19T04:26:27.255 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.255 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.255 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.255 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.255 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.255 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.256 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.256 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.256 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.256 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.256 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.256 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption3": { 2024-09-19T04:26:27.256 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption3", 2024-09-19T04:26:27.256 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T04:26:27.256 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.256 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.256 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.256 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.256 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.257 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.257 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.257 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.257 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.257 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.257 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption4": { 2024-09-19T04:26:27.257 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption4", 2024-09-19T04:26:27.257 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.257 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.257 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.257 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.257 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.258 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.258 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.258 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.258 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.258 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.258 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.258 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption5": { 2024-09-19T04:26:27.258 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption5", 2024-09-19T04:26:27.258 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.258 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.258 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.258 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.258 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.258 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.259 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.259 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.259 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.259 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.259 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.259 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption6": { 2024-09-19T04:26:27.259 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption6", 2024-09-19T04:26:27.259 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.259 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.259 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.259 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.259 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.260 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.260 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.260 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.260 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.260 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.260 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.260 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption7": { 2024-09-19T04:26:27.260 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption7", 2024-09-19T04:26:27.260 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.260 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.260 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.260 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.261 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-19T04:26:27.261 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "42", 2024-09-19T04:26:27.261 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.261 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.261 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.261 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.261 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.261 INFO:teuthology.orchestra.run.smithi007.stdout: "testkey": { 2024-09-19T04:26:27.261 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testkey", 2024-09-19T04:26:27.261 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.261 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.261 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.262 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.262 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.262 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.262 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.262 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.262 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.262 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.262 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.262 INFO:teuthology.orchestra.run.smithi007.stdout: "testlkey": { 2024-09-19T04:26:27.262 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testlkey", 2024-09-19T04:26:27.262 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.262 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.262 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.263 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.263 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.263 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.263 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.263 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.263 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.263 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.263 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.263 INFO:teuthology.orchestra.run.smithi007.stdout: "testnewline": { 2024-09-19T04:26:27.263 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testnewline", 2024-09-19T04:26:27.263 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.264 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.264 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.264 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.264 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.264 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.264 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.264 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.264 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.264 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.264 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.264 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.264 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.265 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snap_schedule", 2024-09-19T04:26:27.265 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.265 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.265 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.265 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_m_granularity": { 2024-09-19T04:26:27.265 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_m_granularity", 2024-09-19T04:26:27.265 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.265 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.265 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.265 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.265 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.265 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.265 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.266 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T04:26:27.266 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.266 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.266 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.266 INFO:teuthology.orchestra.run.smithi007.stdout: "dump_on_update": { 2024-09-19T04:26:27.266 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dump_on_update", 2024-09-19T04:26:27.266 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.266 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.266 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.266 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.266 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.266 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.266 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.267 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "dump database to debug log on update", 2024-09-19T04:26:27.267 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.267 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.267 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.267 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.267 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.267 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.267 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.267 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.267 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.267 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.267 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.267 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.267 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.268 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.268 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.268 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.268 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.268 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.268 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.268 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.268 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.268 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.268 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.268 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.268 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.268 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.269 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.269 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.269 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.269 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.269 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.269 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.269 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.269 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.269 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.269 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.269 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.269 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.270 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.270 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.270 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.270 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.270 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.270 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.270 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.270 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.270 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.270 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.270 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.270 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.270 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.270 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.271 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.271 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.271 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.271 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.271 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.271 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.271 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.271 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.271 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.271 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.271 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.271 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.271 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.272 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.272 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.272 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.272 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.272 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.272 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.272 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stats", 2024-09-19T04:26:27.272 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.272 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.272 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.272 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.272 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.272 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.273 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.273 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.273 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.273 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.273 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.273 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.273 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.273 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.273 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.273 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.273 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.273 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.273 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.274 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.274 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.274 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.274 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.274 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.274 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.274 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.274 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.274 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.274 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.274 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.274 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.275 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.275 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.275 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.275 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.275 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.275 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.275 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.275 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.275 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.275 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.275 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.275 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.275 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.275 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.276 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.276 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.276 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.276 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.276 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.276 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.276 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.276 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.276 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.276 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.276 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.276 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.276 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.276 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.277 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.277 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.277 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.277 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.277 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.277 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.277 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.277 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.277 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.277 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.277 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.277 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.278 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "status", 2024-09-19T04:26:27.278 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.278 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.278 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.278 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.278 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.278 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.278 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.278 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.278 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.278 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.278 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.278 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.279 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.279 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.279 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.279 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.279 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.279 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.279 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.279 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.279 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.279 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.279 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.279 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.280 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.280 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.280 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.280 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.280 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.280 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.280 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.280 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.280 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.280 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.280 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.280 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.281 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.281 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.281 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.281 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.281 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.281 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.281 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.281 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.281 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.281 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.281 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.281 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.282 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.282 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.282 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.282 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.282 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.282 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.282 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.282 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.282 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.282 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.282 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.282 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.282 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.283 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.283 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.283 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.283 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.283 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.283 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.283 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.283 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.283 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.283 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.284 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telegraf", 2024-09-19T04:26:27.284 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.284 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.284 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.284 INFO:teuthology.orchestra.run.smithi007.stdout: "address": { 2024-09-19T04:26:27.284 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "address", 2024-09-19T04:26:27.284 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.284 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.284 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.284 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T04:26:27.284 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.285 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.285 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.285 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.285 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.285 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.285 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.285 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T04:26:27.285 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T04:26:27.285 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.285 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.285 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.286 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15", 2024-09-19T04:26:27.286 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.286 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.286 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.286 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.286 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.286 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.286 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.286 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.286 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.286 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.286 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.287 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.287 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.287 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.287 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.287 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.287 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.287 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.287 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.287 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.287 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.287 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.287 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.287 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.287 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.288 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.288 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.288 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.288 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.288 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.288 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.288 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.288 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.288 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.288 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.288 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.289 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.289 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.289 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.289 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.289 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.289 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.289 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.289 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.289 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.289 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.289 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.289 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.290 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.290 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.290 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.290 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.290 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.290 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.290 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.290 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.290 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.290 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.290 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.290 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.290 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.291 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.291 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.291 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.291 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.291 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.291 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.291 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.291 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.291 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.291 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.291 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.291 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.291 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.291 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.292 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telemetry", 2024-09-19T04:26:27.292 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.292 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.292 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.292 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_basic": { 2024-09-19T04:26:27.292 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_basic", 2024-09-19T04:26:27.292 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.292 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.292 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.292 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.292 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.292 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.293 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.293 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T04:26:27.293 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.293 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.293 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.293 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_crash": { 2024-09-19T04:26:27.293 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_crash", 2024-09-19T04:26:27.293 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.293 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.293 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.293 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.294 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.294 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.294 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.294 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T04:26:27.294 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.294 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.294 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.294 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_device": { 2024-09-19T04:26:27.294 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_device", 2024-09-19T04:26:27.294 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.294 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.294 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.294 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.295 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.295 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.295 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.295 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T04:26:27.295 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.295 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.295 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.295 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_ident": { 2024-09-19T04:26:27.295 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_ident", 2024-09-19T04:26:27.295 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.296 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.296 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.296 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.296 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.296 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.296 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.296 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T04:26:27.296 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.296 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.296 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.296 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_perf": { 2024-09-19T04:26:27.296 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_perf", 2024-09-19T04:26:27.297 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.297 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.297 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.297 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.297 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.297 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.297 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.297 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T04:26:27.297 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.297 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.297 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.297 INFO:teuthology.orchestra.run.smithi007.stdout: "contact": { 2024-09-19T04:26:27.297 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "contact", 2024-09-19T04:26:27.298 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.298 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.298 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.298 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.298 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.298 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.298 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.298 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.298 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.298 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.298 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.299 INFO:teuthology.orchestra.run.smithi007.stdout: "description": { 2024-09-19T04:26:27.299 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "description", 2024-09-19T04:26:27.299 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.299 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.299 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.299 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.299 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.299 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.299 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.299 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.299 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.299 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.299 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.300 INFO:teuthology.orchestra.run.smithi007.stdout: "device_url": { 2024-09-19T04:26:27.300 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_url", 2024-09-19T04:26:27.300 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.300 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.300 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.300 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T04:26:27.300 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.300 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.300 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.301 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.301 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.301 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.301 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.301 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-19T04:26:27.301 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-19T04:26:27.301 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.301 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.301 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.301 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.302 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.302 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.302 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.302 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.302 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.302 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.302 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.302 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T04:26:27.302 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T04:26:27.302 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.302 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.302 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.303 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "24", 2024-09-19T04:26:27.303 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "8", 2024-09-19T04:26:27.303 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.303 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.303 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.303 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.303 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.303 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.303 INFO:teuthology.orchestra.run.smithi007.stdout: "last_opt_revision": { 2024-09-19T04:26:27.303 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "last_opt_revision", 2024-09-19T04:26:27.304 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.304 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.304 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.304 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1", 2024-09-19T04:26:27.304 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.304 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.304 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.304 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.304 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.304 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.304 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.305 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard": { 2024-09-19T04:26:27.305 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard", 2024-09-19T04:26:27.305 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.305 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.305 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.305 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.305 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.305 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.305 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.305 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.305 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.305 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.306 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.306 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard_description": { 2024-09-19T04:26:27.306 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard_description", 2024-09-19T04:26:27.306 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.306 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.306 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.306 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.306 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.306 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.306 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.306 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.306 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.307 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.307 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.307 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.307 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.307 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.307 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.307 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.307 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.307 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.307 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.307 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.308 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.308 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.308 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.308 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.308 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.308 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.308 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.308 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.308 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.308 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.308 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.308 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.309 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.309 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.309 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.309 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.309 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.309 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.309 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.309 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.309 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.309 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.309 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.309 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.309 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.310 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.310 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.310 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.310 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.310 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.310 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.310 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.310 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.310 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.310 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.310 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.310 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.310 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.310 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.310 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.311 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.311 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.311 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.311 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.311 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.311 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.311 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.311 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.311 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.311 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.311 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.311 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.312 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.312 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.312 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.312 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.312 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.312 INFO:teuthology.orchestra.run.smithi007.stdout: "organization": { 2024-09-19T04:26:27.312 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "organization", 2024-09-19T04:26:27.312 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.312 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.312 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.312 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.312 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.313 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.313 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.313 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.313 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.313 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.313 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.313 INFO:teuthology.orchestra.run.smithi007.stdout: "proxy": { 2024-09-19T04:26:27.313 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "proxy", 2024-09-19T04:26:27.313 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.313 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.314 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.314 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.314 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.314 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.314 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.314 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.314 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.314 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.314 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.314 INFO:teuthology.orchestra.run.smithi007.stdout: "url": { 2024-09-19T04:26:27.314 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url", 2024-09-19T04:26:27.314 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.314 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.315 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.315 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T04:26:27.315 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.315 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.315 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.315 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.315 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.315 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.315 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.315 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.315 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.316 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "test_orchestrator", 2024-09-19T04:26:27.316 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.316 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.316 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.316 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.316 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.316 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.316 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.316 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.316 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.317 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.317 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.317 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.317 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.317 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.317 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.317 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.317 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.317 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.317 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.317 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.317 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.317 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.318 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.318 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.318 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.318 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.318 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.318 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.318 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.318 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.318 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.318 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.318 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.319 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.319 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.319 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.319 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.319 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.319 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.319 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.319 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.319 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.319 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.320 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.320 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.320 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.320 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.320 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.320 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.320 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.320 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.320 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.320 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.320 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.320 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.321 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.321 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.321 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.321 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.321 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.321 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.321 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.321 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.321 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.321 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.322 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.322 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.322 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.322 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.322 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.322 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.322 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volumes", 2024-09-19T04:26:27.322 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.322 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.322 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.323 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.323 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.323 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.323 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.323 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.323 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.323 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.323 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.323 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.323 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.323 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.323 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.324 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.324 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.324 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.324 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.324 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.324 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.324 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.324 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.324 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.324 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.324 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.324 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.325 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.325 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.325 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.325 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.325 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.325 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.325 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.325 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.325 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.325 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.325 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.325 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.326 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.326 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.326 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.326 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.326 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.326 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.326 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.326 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.326 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.326 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.326 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.326 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.326 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.326 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.327 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.327 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.327 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.327 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.327 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.327 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.327 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.327 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.327 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.327 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.327 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.327 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.328 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.328 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.328 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.328 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.328 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_clones": { 2024-09-19T04:26:27.328 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_clones", 2024-09-19T04:26:27.328 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.328 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.328 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.328 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4", 2024-09-19T04:26:27.329 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.329 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.329 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.329 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T04:26:27.329 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.329 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.329 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.329 INFO:teuthology.orchestra.run.smithi007.stdout: "periodic_async_work": { 2024-09-19T04:26:27.329 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "periodic_async_work", 2024-09-19T04:26:27.329 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.330 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.330 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.330 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.330 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.330 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.330 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.330 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Periodically check for async work", 2024-09-19T04:26:27.330 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.330 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.330 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.330 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_delay": { 2024-09-19T04:26:27.330 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_delay", 2024-09-19T04:26:27.330 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.331 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.331 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.331 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T04:26:27.331 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.331 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.331 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.331 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T04:26:27.331 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.331 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.331 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.331 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_no_wait": { 2024-09-19T04:26:27.331 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T04:26:27.331 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.332 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.332 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.332 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.332 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.332 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.332 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.332 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T04:26:27.332 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.332 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.332 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.332 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.332 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.333 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix", 2024-09-19T04:26:27.333 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.333 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.333 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.333 INFO:teuthology.orchestra.run.smithi007.stdout: "discovery_interval": { 2024-09-19T04:26:27.333 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "discovery_interval", 2024-09-19T04:26:27.333 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T04:26:27.333 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.333 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.333 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "100", 2024-09-19T04:26:27.333 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.333 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.334 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.334 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.334 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.334 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.334 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.334 INFO:teuthology.orchestra.run.smithi007.stdout: "identifier": { 2024-09-19T04:26:27.334 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "identifier", 2024-09-19T04:26:27.334 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.334 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.334 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.334 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.334 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.334 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.335 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.335 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.335 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.335 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.335 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.335 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T04:26:27.335 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T04:26:27.335 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.335 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.335 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.335 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T04:26:27.335 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.335 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.336 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.336 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.336 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.336 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.336 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.336 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.336 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.336 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.336 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.336 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.336 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.336 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.337 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.337 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.337 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.337 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.337 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.337 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.337 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.337 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.337 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.337 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.337 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.337 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.338 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.338 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.338 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.338 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.338 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.338 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.338 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.338 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.338 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.338 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.338 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.338 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.339 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.339 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.339 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.339 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.339 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.339 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.339 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.339 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.339 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.339 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.339 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.340 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.340 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.340 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.340 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.340 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.340 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.340 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.340 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.340 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.340 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.341 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.341 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.341 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.341 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.341 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.341 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.341 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.341 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.341 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.341 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.341 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.341 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.342 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.342 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.342 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_host": { 2024-09-19T04:26:27.342 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_host", 2024-09-19T04:26:27.342 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.342 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.342 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.342 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.342 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.342 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.342 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.343 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.343 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.343 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.343 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.343 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_port": { 2024-09-19T04:26:27.343 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_port", 2024-09-19T04:26:27.343 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.343 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.343 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.343 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10051", 2024-09-19T04:26:27.343 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.343 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.344 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.344 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.344 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.344 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.344 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.344 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_sender": { 2024-09-19T04:26:27.344 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_sender", 2024-09-19T04:26:27.344 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.344 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.345 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.345 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T04:26:27.345 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.345 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.345 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.345 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.345 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.345 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.345 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.345 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.345 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.346 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.346 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-19T04:26:27.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.346 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.346 INFO:teuthology.orchestra.run.smithi007.stdout: "gid": 24116, 2024-09-19T04:26:27.346 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "y", 2024-09-19T04:26:27.346 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_features": 4540701547738038271, 2024-09-19T04:26:27.346 INFO:teuthology.orchestra.run.smithi007.stdout: "available_modules": [ 2024-09-19T04:26:27.346 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.346 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "alerts", 2024-09-19T04:26:27.346 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.346 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.347 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.347 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T04:26:27.347 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T04:26:27.347 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.347 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.347 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.347 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T04:26:27.347 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.347 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.347 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.347 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T04:26:27.347 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.347 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.348 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.348 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.348 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.348 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.348 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.348 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.348 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.348 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.348 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.348 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.348 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.348 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.349 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.349 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.349 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.349 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.349 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.349 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.349 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.349 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.349 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.349 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.349 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.349 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.350 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.350 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.350 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.350 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.350 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.350 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.350 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.350 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.350 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.350 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.351 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.351 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.351 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.351 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.351 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.351 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.351 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.351 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.351 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.351 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.351 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.352 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.352 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.352 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.352 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.352 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.352 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.352 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.352 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.352 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.352 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.352 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.353 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.353 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.353 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.353 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.353 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.353 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.353 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.353 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.353 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.353 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.353 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.354 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_destination": { 2024-09-19T04:26:27.354 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_destination", 2024-09-19T04:26:27.354 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.354 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.354 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.354 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.354 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.354 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.354 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.354 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email address to send alerts to", 2024-09-19T04:26:27.354 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.354 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.355 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.355 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_from_name": { 2024-09-19T04:26:27.355 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_from_name", 2024-09-19T04:26:27.355 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.355 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.355 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.355 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "Ceph", 2024-09-19T04:26:27.355 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.355 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.355 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.355 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email From: name", 2024-09-19T04:26:27.356 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.356 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.356 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.356 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_host": { 2024-09-19T04:26:27.356 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_host", 2024-09-19T04:26:27.356 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.356 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.356 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.356 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.356 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.357 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.357 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.357 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP server", 2024-09-19T04:26:27.357 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.357 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.357 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.357 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_password": { 2024-09-19T04:26:27.357 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_password", 2024-09-19T04:26:27.357 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.357 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.357 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.358 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.358 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.358 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.358 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.358 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Password to authenticate with", 2024-09-19T04:26:27.358 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.358 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.358 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.358 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_port": { 2024-09-19T04:26:27.358 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_port", 2024-09-19T04:26:27.359 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.359 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.359 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.359 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "465", 2024-09-19T04:26:27.359 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.359 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.359 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.359 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP port", 2024-09-19T04:26:27.359 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.359 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.359 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.360 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_sender": { 2024-09-19T04:26:27.360 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_sender", 2024-09-19T04:26:27.360 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.360 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.360 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.360 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.360 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.360 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.360 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.360 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP envelope sender", 2024-09-19T04:26:27.360 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.361 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.361 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.361 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_ssl": { 2024-09-19T04:26:27.361 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_ssl", 2024-09-19T04:26:27.361 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.361 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.361 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.361 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.361 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.361 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.362 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.362 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T04:26:27.362 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.362 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.362 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.362 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_user": { 2024-09-19T04:26:27.362 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_user", 2024-09-19T04:26:27.362 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.362 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.362 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.362 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.363 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.363 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.363 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.363 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "User to authenticate as", 2024-09-19T04:26:27.363 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.363 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.363 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.363 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.363 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.364 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "balancer", 2024-09-19T04:26:27.364 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.364 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.364 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.364 INFO:teuthology.orchestra.run.smithi007.stdout: "active": { 2024-09-19T04:26:27.364 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "active", 2024-09-19T04:26:27.364 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.364 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.364 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.364 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.365 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.365 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.365 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.365 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T04:26:27.365 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.365 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.365 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.365 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_time": { 2024-09-19T04:26:27.365 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_time", 2024-09-19T04:26:27.365 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.365 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.366 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.366 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0000", 2024-09-19T04:26:27.366 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.366 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.366 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.366 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T04:26:27.366 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T04:26:27.366 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.366 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.366 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_weekday": { 2024-09-19T04:26:27.367 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_weekday", 2024-09-19T04:26:27.367 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T04:26:27.367 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.367 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.367 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T04:26:27.367 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-19T04:26:27.367 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-19T04:26:27.367 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.367 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T04:26:27.367 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T04:26:27.367 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.367 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.367 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_max_iterations": { 2024-09-19T04:26:27.368 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_max_iterations", 2024-09-19T04:26:27.368 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T04:26:27.368 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.368 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.368 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "25", 2024-09-19T04:26:27.368 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-19T04:26:27.368 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "250", 2024-09-19T04:26:27.368 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.368 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T04:26:27.368 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.368 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.368 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.368 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_metrics": { 2024-09-19T04:26:27.369 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_metrics", 2024-09-19T04:26:27.369 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.369 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.369 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.369 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T04:26:27.369 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.369 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.369 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.369 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T04:26:27.369 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T04:26:27.369 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.369 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.370 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_step": { 2024-09-19T04:26:27.370 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_step", 2024-09-19T04:26:27.370 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T04:26:27.370 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.370 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.370 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.5", 2024-09-19T04:26:27.370 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0.001", 2024-09-19T04:26:27.370 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "0.999", 2024-09-19T04:26:27.370 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.370 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "aggressiveness of optimization", 2024-09-19T04:26:27.370 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T04:26:27.371 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.371 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.371 INFO:teuthology.orchestra.run.smithi007.stdout: "end_time": { 2024-09-19T04:26:27.371 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_time", 2024-09-19T04:26:27.371 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.371 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.371 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.371 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2359", 2024-09-19T04:26:27.371 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.371 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.371 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.371 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T04:26:27.372 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T04:26:27.372 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.372 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.372 INFO:teuthology.orchestra.run.smithi007.stdout: "end_weekday": { 2024-09-19T04:26:27.372 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_weekday", 2024-09-19T04:26:27.372 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T04:26:27.372 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.372 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.372 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T04:26:27.372 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-19T04:26:27.372 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-19T04:26:27.373 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.373 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T04:26:27.373 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T04:26:27.373 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.373 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.373 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.373 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.373 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.373 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.373 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.373 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.373 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.374 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.374 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.374 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.374 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.374 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.374 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.374 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.374 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.374 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.374 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.374 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.374 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.374 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.375 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.375 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.375 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.375 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.375 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.375 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.375 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.375 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.375 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.376 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.376 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.376 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.376 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.376 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.376 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.376 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.376 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.376 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.376 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.376 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.377 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.377 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.377 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.377 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.377 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.377 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.377 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.377 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.377 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.377 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.377 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.377 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.378 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.378 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.378 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.378 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.378 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.378 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.378 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.378 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.378 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.378 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.378 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.378 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.378 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.379 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.379 INFO:teuthology.orchestra.run.smithi007.stdout: "min_score": { 2024-09-19T04:26:27.379 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_score", 2024-09-19T04:26:27.379 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T04:26:27.379 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.379 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.379 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T04:26:27.379 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.379 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.379 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.379 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T04:26:27.380 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.380 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.380 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.380 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-19T04:26:27.380 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-19T04:26:27.380 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.380 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.380 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.380 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "upmap", 2024-09-19T04:26:27.380 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.380 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.380 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.381 INFO:teuthology.orchestra.run.smithi007.stdout: "crush-compat", 2024-09-19T04:26:27.381 INFO:teuthology.orchestra.run.smithi007.stdout: "none", 2024-09-19T04:26:27.381 INFO:teuthology.orchestra.run.smithi007.stdout: "read", 2024-09-19T04:26:27.381 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap", 2024-09-19T04:26:27.381 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap-read" 2024-09-19T04:26:27.381 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.381 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Balancer mode", 2024-09-19T04:26:27.381 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.381 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.381 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.381 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_ids": { 2024-09-19T04:26:27.381 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_ids", 2024-09-19T04:26:27.382 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.382 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.382 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.382 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.382 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.382 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.382 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.382 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T04:26:27.382 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.382 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.382 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.383 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T04:26:27.383 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T04:26:27.383 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.383 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.383 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.383 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T04:26:27.383 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.383 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.383 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.383 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T04:26:27.383 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.383 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.384 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.384 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_deviation": { 2024-09-19T04:26:27.384 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_deviation", 2024-09-19T04:26:27.384 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.384 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.384 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.384 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T04:26:27.384 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-19T04:26:27.384 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.385 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.385 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T04:26:27.385 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T04:26:27.385 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.385 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.385 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_optimizations": { 2024-09-19T04:26:27.385 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_optimizations", 2024-09-19T04:26:27.385 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T04:26:27.385 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.385 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.386 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T04:26:27.386 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.386 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.386 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.386 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T04:26:27.386 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.386 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.386 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.386 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.386 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.387 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm", 2024-09-19T04:26:27.387 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.387 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.387 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.387 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_down_multiplier": { 2024-09-19T04:26:27.387 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_down_multiplier", 2024-09-19T04:26:27.387 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T04:26:27.387 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.387 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.387 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-19T04:26:27.387 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.388 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.388 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.388 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T04:26:27.388 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.388 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.388 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.388 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_refresh_rate": { 2024-09-19T04:26:27.388 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_refresh_rate", 2024-09-19T04:26:27.389 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.389 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.389 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.389 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "20", 2024-09-19T04:26:27.389 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.389 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.389 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.392 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T04:26:27.392 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.392 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.392 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.392 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_starting_port": { 2024-09-19T04:26:27.392 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_starting_port", 2024-09-19T04:26:27.392 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.392 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.392 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.392 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4721", 2024-09-19T04:26:27.393 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.393 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.393 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.393 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T04:26:27.393 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.393 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.393 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.393 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_ptrace": { 2024-09-19T04:26:27.393 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_ptrace", 2024-09-19T04:26:27.393 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.394 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.394 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.394 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.394 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.394 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.394 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.394 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T04:26:27.394 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T04:26:27.394 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.394 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.395 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_interval": { 2024-09-19T04:26:27.395 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_interval", 2024-09-19T04:26:27.395 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.395 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.395 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.395 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T04:26:27.395 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.395 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.395 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.395 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T04:26:27.395 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.395 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.396 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.396 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_memory_target_ratio": { 2024-09-19T04:26:27.396 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T04:26:27.396 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T04:26:27.396 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.396 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.396 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.7", 2024-09-19T04:26:27.396 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.396 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.396 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.396 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T04:26:27.397 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.397 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.397 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.397 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm_log_destination": { 2024-09-19T04:26:27.397 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm_log_destination", 2024-09-19T04:26:27.397 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.397 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.397 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.397 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.397 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.397 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.398 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.398 INFO:teuthology.orchestra.run.smithi007.stdout: "file", 2024-09-19T04:26:27.398 INFO:teuthology.orchestra.run.smithi007.stdout: "file,syslog", 2024-09-19T04:26:27.398 INFO:teuthology.orchestra.run.smithi007.stdout: "syslog" 2024-09-19T04:26:27.398 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.398 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T04:26:27.398 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.398 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.398 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.398 INFO:teuthology.orchestra.run.smithi007.stdout: "cgroups_split": { 2024-09-19T04:26:27.398 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cgroups_split", 2024-09-19T04:26:27.399 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.399 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.399 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.399 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.399 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.399 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.399 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.399 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T04:26:27.399 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.399 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.399 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.399 INFO:teuthology.orchestra.run.smithi007.stdout: "config_checks_enabled": { 2024-09-19T04:26:27.400 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_checks_enabled", 2024-09-19T04:26:27.400 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.400 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.400 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.400 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.400 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.400 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.400 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.400 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T04:26:27.400 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.400 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.400 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.401 INFO:teuthology.orchestra.run.smithi007.stdout: "config_dashboard": { 2024-09-19T04:26:27.401 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_dashboard", 2024-09-19T04:26:27.401 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.401 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.401 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.401 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.401 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.401 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.401 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.401 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T04:26:27.401 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.401 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.402 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.402 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_alertmanager": { 2024-09-19T04:26:27.402 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_alertmanager", 2024-09-19T04:26:27.402 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.402 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.402 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.402 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T04:26:27.402 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.402 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.402 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.402 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-19T04:26:27.403 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.403 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.403 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.403 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_base": { 2024-09-19T04:26:27.403 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_base", 2024-09-19T04:26:27.403 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.403 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.403 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.403 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T04:26:27.403 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.403 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.404 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.404 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Container image name, without the tag", 2024-09-19T04:26:27.404 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.404 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.404 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.404 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_elasticsearch": { 2024-09-19T04:26:27.404 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_elasticsearch", 2024-09-19T04:26:27.404 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.404 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.404 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.404 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T04:26:27.405 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.405 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.405 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.405 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "elasticsearch container image", 2024-09-19T04:26:27.405 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.405 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.405 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.405 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_grafana": { 2024-09-19T04:26:27.405 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_grafana", 2024-09-19T04:26:27.405 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.405 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.405 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.406 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T04:26:27.406 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.406 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.406 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.406 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-19T04:26:27.406 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.406 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.406 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.406 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_haproxy": { 2024-09-19T04:26:27.406 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_haproxy", 2024-09-19T04:26:27.406 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.406 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.406 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.407 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T04:26:27.407 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.407 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.407 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.407 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "HAproxy container image", 2024-09-19T04:26:27.407 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.407 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.407 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.407 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_agent": { 2024-09-19T04:26:27.407 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_agent", 2024-09-19T04:26:27.407 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.407 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.407 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.408 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T04:26:27.408 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.408 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.408 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.408 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger agent container image", 2024-09-19T04:26:27.408 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.408 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.408 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.408 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_collector": { 2024-09-19T04:26:27.408 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_collector", 2024-09-19T04:26:27.408 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.408 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.408 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.409 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T04:26:27.409 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.409 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.409 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.409 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger collector container image", 2024-09-19T04:26:27.409 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.409 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.409 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.409 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_query": { 2024-09-19T04:26:27.409 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_query", 2024-09-19T04:26:27.409 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.410 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.410 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.410 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T04:26:27.410 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.410 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.410 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.410 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger query container image", 2024-09-19T04:26:27.410 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.410 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.410 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.410 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_keepalived": { 2024-09-19T04:26:27.410 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_keepalived", 2024-09-19T04:26:27.411 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.411 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.411 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.411 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T04:26:27.411 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.411 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.411 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.411 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Keepalived container image", 2024-09-19T04:26:27.411 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.411 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.411 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.411 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_loki": { 2024-09-19T04:26:27.412 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_loki", 2024-09-19T04:26:27.412 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.412 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.412 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.412 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T04:26:27.412 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.412 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.412 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.412 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Loki container image", 2024-09-19T04:26:27.412 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.412 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.412 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.412 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_node_exporter": { 2024-09-19T04:26:27.413 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_node_exporter", 2024-09-19T04:26:27.413 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.413 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.413 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.413 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T04:26:27.413 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.413 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.413 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.413 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-19T04:26:27.413 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.413 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.413 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.414 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_nvmeof": { 2024-09-19T04:26:27.414 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_nvmeof", 2024-09-19T04:26:27.414 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.414 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.414 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.414 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T04:26:27.414 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.414 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.414 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.414 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Nvme-of container image", 2024-09-19T04:26:27.414 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.414 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.414 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.415 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_prometheus": { 2024-09-19T04:26:27.415 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_prometheus", 2024-09-19T04:26:27.415 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.415 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.415 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.415 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T04:26:27.415 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.415 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.415 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.415 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-19T04:26:27.415 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.415 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.415 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.416 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_promtail": { 2024-09-19T04:26:27.416 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_promtail", 2024-09-19T04:26:27.416 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.416 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.416 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.416 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T04:26:27.416 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.416 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.416 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.416 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Promtail container image", 2024-09-19T04:26:27.416 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.416 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.416 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.417 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_samba": { 2024-09-19T04:26:27.417 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_samba", 2024-09-19T04:26:27.417 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.417 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.417 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.417 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T04:26:27.417 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.417 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.417 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.417 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Samba/SMB container image", 2024-09-19T04:26:27.417 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.417 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.417 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.418 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_snmp_gateway": { 2024-09-19T04:26:27.418 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_snmp_gateway", 2024-09-19T04:26:27.418 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.418 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.418 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.418 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T04:26:27.418 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.418 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.418 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.418 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SNMP Gateway container image", 2024-09-19T04:26:27.418 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.418 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.419 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.419 INFO:teuthology.orchestra.run.smithi007.stdout: "container_init": { 2024-09-19T04:26:27.419 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_init", 2024-09-19T04:26:27.419 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.419 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.419 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.419 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.419 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.419 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.419 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.419 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T04:26:27.420 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.420 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.420 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.420 INFO:teuthology.orchestra.run.smithi007.stdout: "daemon_cache_timeout": { 2024-09-19T04:26:27.420 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "daemon_cache_timeout", 2024-09-19T04:26:27.420 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.420 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.420 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.420 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T04:26:27.420 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.420 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.420 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.421 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T04:26:27.421 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.421 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.421 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.421 INFO:teuthology.orchestra.run.smithi007.stdout: "default_cephadm_command_timeout": { 2024-09-19T04:26:27.421 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T04:26:27.421 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.421 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.421 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.421 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "900", 2024-09-19T04:26:27.421 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.421 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.421 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.422 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T04:26:27.422 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.422 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.422 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.422 INFO:teuthology.orchestra.run.smithi007.stdout: "default_registry": { 2024-09-19T04:26:27.422 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_registry", 2024-09-19T04:26:27.422 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.422 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.422 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.422 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io", 2024-09-19T04:26:27.422 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.422 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.423 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.423 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T04:26:27.423 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.423 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.423 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.423 INFO:teuthology.orchestra.run.smithi007.stdout: "device_cache_timeout": { 2024-09-19T04:26:27.423 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_cache_timeout", 2024-09-19T04:26:27.423 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.423 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.423 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.424 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1800", 2024-09-19T04:26:27.424 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.424 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.424 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.424 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache device inventory", 2024-09-19T04:26:27.424 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.424 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.424 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.424 INFO:teuthology.orchestra.run.smithi007.stdout: "device_enhanced_scan": { 2024-09-19T04:26:27.424 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_enhanced_scan", 2024-09-19T04:26:27.425 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.425 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.425 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.425 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.425 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.425 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.425 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.425 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T04:26:27.425 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.425 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.425 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.426 INFO:teuthology.orchestra.run.smithi007.stdout: "facts_cache_timeout": { 2024-09-19T04:26:27.426 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "facts_cache_timeout", 2024-09-19T04:26:27.426 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.426 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.426 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.426 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T04:26:27.426 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.426 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.426 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.426 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache host facts data", 2024-09-19T04:26:27.426 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.426 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.427 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.427 INFO:teuthology.orchestra.run.smithi007.stdout: "grafana_dashboards_path": { 2024-09-19T04:26:27.427 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "grafana_dashboards_path", 2024-09-19T04:26:27.427 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.427 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.427 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.427 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T04:26:27.427 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.427 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.427 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.427 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T04:26:27.428 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.428 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.428 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.428 INFO:teuthology.orchestra.run.smithi007.stdout: "host_check_interval": { 2024-09-19T04:26:27.428 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "host_check_interval", 2024-09-19T04:26:27.428 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.428 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.428 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.428 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T04:26:27.428 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.428 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.428 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.429 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to perform a host check", 2024-09-19T04:26:27.429 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.429 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.429 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.429 INFO:teuthology.orchestra.run.smithi007.stdout: "hw_monitoring": { 2024-09-19T04:26:27.429 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hw_monitoring", 2024-09-19T04:26:27.429 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.429 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.429 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.429 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.429 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.430 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.430 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.430 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T04:26:27.430 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.430 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.430 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.430 INFO:teuthology.orchestra.run.smithi007.stdout: "inventory_list_all": { 2024-09-19T04:26:27.430 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "inventory_list_all", 2024-09-19T04:26:27.430 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.430 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.430 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.431 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.431 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.431 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.431 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.431 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T04:26:27.431 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.431 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.431 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.431 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.431 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.431 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.431 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.432 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.432 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.432 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.432 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.432 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.432 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.432 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.432 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.432 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.432 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.432 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.433 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.433 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.433 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.433 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.433 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.433 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.433 INFO:teuthology.orchestra.run.smithi007.stdout: "log_refresh_metadata": { 2024-09-19T04:26:27.433 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_refresh_metadata", 2024-09-19T04:26:27.433 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.433 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.433 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.434 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.434 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.434 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.434 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.434 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T04:26:27.434 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.434 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.434 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.434 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.434 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.434 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.435 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.435 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.435 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.435 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.435 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.435 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.435 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T04:26:27.435 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.435 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.435 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.435 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.435 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.435 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.436 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.436 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.436 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.436 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.436 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.436 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.436 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.436 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.436 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.436 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.436 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.436 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.437 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.437 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.437 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.437 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.437 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.437 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.437 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.437 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.437 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.437 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.437 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.438 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.438 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.438 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.438 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.438 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.438 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.438 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.438 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T04:26:27.438 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T04:26:27.438 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.438 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.438 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.438 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.439 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.439 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.439 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.439 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T04:26:27.439 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.439 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.439 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.439 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T04:26:27.439 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T04:26:27.439 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.439 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.440 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.440 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "*", 2024-09-19T04:26:27.440 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.440 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.440 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.440 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T04:26:27.440 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.440 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.440 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.440 INFO:teuthology.orchestra.run.smithi007.stdout: "max_count_per_host": { 2024-09-19T04:26:27.440 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_count_per_host", 2024-09-19T04:26:27.440 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.440 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.441 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.441 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T04:26:27.441 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.441 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.441 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.441 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of daemons per service per host", 2024-09-19T04:26:27.441 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.441 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.441 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.441 INFO:teuthology.orchestra.run.smithi007.stdout: "max_osd_draining_count": { 2024-09-19T04:26:27.441 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_osd_draining_count", 2024-09-19T04:26:27.442 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.442 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.442 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.442 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T04:26:27.442 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.442 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.442 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.442 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T04:26:27.442 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.442 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.442 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.442 INFO:teuthology.orchestra.run.smithi007.stdout: "migration_current": { 2024-09-19T04:26:27.443 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "migration_current", 2024-09-19T04:26:27.443 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.443 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.443 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.443 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.443 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.443 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.443 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.443 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "internal - do not modify", 2024-09-19T04:26:27.443 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.443 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.443 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.444 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-19T04:26:27.444 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-19T04:26:27.444 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.444 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.444 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.444 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "root", 2024-09-19T04:26:27.444 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.444 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.444 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.444 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm-package", 2024-09-19T04:26:27.444 INFO:teuthology.orchestra.run.smithi007.stdout: "root" 2024-09-19T04:26:27.444 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.444 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T04:26:27.445 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.445 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.445 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.445 INFO:teuthology.orchestra.run.smithi007.stdout: "oob_default_addr": { 2024-09-19T04:26:27.445 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "oob_default_addr", 2024-09-19T04:26:27.445 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.445 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.445 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.445 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "169.254.1.1", 2024-09-19T04:26:27.445 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.445 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.445 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.446 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T04:26:27.446 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.446 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.446 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.446 INFO:teuthology.orchestra.run.smithi007.stdout: "prometheus_alerts_path": { 2024-09-19T04:26:27.446 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus_alerts_path", 2024-09-19T04:26:27.446 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.446 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.446 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.446 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T04:26:27.446 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.446 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.446 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.447 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T04:26:27.447 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.447 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.447 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.447 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_insecure": { 2024-09-19T04:26:27.447 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_insecure", 2024-09-19T04:26:27.447 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.447 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.447 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.447 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.447 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.447 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.447 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.448 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T04:26:27.448 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.448 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.448 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.448 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_password": { 2024-09-19T04:26:27.448 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_password", 2024-09-19T04:26:27.448 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.448 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.448 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.448 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.448 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.448 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.448 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.449 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T04:26:27.449 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.449 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.449 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.449 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_url": { 2024-09-19T04:26:27.449 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_url", 2024-09-19T04:26:27.449 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.449 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.449 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.449 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.449 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.449 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.450 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.450 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T04:26:27.450 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.450 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.450 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.450 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_username": { 2024-09-19T04:26:27.450 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_username", 2024-09-19T04:26:27.450 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.450 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.450 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.450 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.450 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.450 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.451 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.451 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T04:26:27.451 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.451 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.451 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.451 INFO:teuthology.orchestra.run.smithi007.stdout: "secure_monitoring_stack": { 2024-09-19T04:26:27.451 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secure_monitoring_stack", 2024-09-19T04:26:27.451 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.451 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.451 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.451 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.451 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.451 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.452 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.452 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T04:26:27.452 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.452 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.452 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.452 INFO:teuthology.orchestra.run.smithi007.stdout: "service_discovery_port": { 2024-09-19T04:26:27.452 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "service_discovery_port", 2024-09-19T04:26:27.452 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.452 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.452 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.452 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8765", 2024-09-19T04:26:27.452 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.453 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.453 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.453 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "cephadm service discovery port", 2024-09-19T04:26:27.453 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.453 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.453 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.453 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_config_file": { 2024-09-19T04:26:27.453 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_config_file", 2024-09-19T04:26:27.453 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.453 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.453 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.453 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.454 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.454 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.454 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.454 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T04:26:27.454 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.454 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.454 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.454 INFO:teuthology.orchestra.run.smithi007.stdout: "use_agent": { 2024-09-19T04:26:27.454 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_agent", 2024-09-19T04:26:27.454 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.454 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.454 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.455 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.455 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.455 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.455 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.455 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T04:26:27.455 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.455 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.455 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.455 INFO:teuthology.orchestra.run.smithi007.stdout: "use_repo_digest": { 2024-09-19T04:26:27.455 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_repo_digest", 2024-09-19T04:26:27.455 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.455 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.456 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.456 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.456 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.456 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.456 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.456 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T04:26:27.456 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.456 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.456 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.456 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_failed_host_check": { 2024-09-19T04:26:27.456 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_failed_host_check", 2024-09-19T04:26:27.456 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.457 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.457 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.457 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.457 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.457 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.457 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.457 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T04:26:27.457 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.457 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.457 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.457 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_daemons": { 2024-09-19T04:26:27.457 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_daemons", 2024-09-19T04:26:27.457 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.458 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.458 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.458 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.458 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.458 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.458 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.458 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T04:26:27.458 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.458 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.458 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.458 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_hosts": { 2024-09-19T04:26:27.458 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_hosts", 2024-09-19T04:26:27.458 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.458 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.459 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.459 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.459 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.459 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.459 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.459 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T04:26:27.459 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.459 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.459 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.459 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.459 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.460 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crash", 2024-09-19T04:26:27.460 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.460 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.460 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.460 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.460 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.460 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.460 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.460 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.460 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.460 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.460 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.460 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.460 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.461 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.461 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.461 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.461 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.461 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.461 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.461 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.461 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.461 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.461 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.461 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.461 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.462 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.462 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.462 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.462 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.462 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.462 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.462 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.462 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.462 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.462 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.462 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.463 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.463 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.463 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.463 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.463 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.463 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.463 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.463 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.463 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.463 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.463 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.463 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.464 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.464 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.464 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.464 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.464 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.464 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.464 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.464 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.464 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.464 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.464 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.464 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.465 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.465 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.465 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.465 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.465 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.465 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.465 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.465 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.465 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.465 INFO:teuthology.orchestra.run.smithi007.stdout: "retain_interval": { 2024-09-19T04:26:27.465 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retain_interval", 2024-09-19T04:26:27.466 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.466 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.466 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.466 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "31536000", 2024-09-19T04:26:27.466 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.466 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.466 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.466 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T04:26:27.466 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.466 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.466 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.467 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_recent_interval": { 2024-09-19T04:26:27.467 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_recent_interval", 2024-09-19T04:26:27.467 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.467 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.467 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.467 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1209600", 2024-09-19T04:26:27.467 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.467 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.467 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.467 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T04:26:27.467 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.468 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.468 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.468 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.468 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.468 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dashboard", 2024-09-19T04:26:27.468 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.468 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.468 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.468 INFO:teuthology.orchestra.run.smithi007.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T04:26:27.468 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T04:26:27.469 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.469 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.469 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.469 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T04:26:27.469 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.469 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.469 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.469 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.469 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.469 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.469 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.469 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T04:26:27.469 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T04:26:27.470 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.470 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.470 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.470 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.470 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.470 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.470 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.470 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.470 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.470 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.470 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.470 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T04:26:27.470 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T04:26:27.470 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.471 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.471 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.471 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.471 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.471 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.471 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.471 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.471 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.471 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.471 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.471 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_ENABLED": { 2024-09-19T04:26:27.471 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T04:26:27.471 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.472 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.472 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.472 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.472 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.472 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.472 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.472 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.472 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.472 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.472 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.472 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T04:26:27.472 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T04:26:27.473 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.473 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.473 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.473 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.473 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.473 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.473 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.473 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.473 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.473 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.473 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.473 INFO:teuthology.orchestra.run.smithi007.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T04:26:27.474 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T04:26:27.474 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.474 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.474 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.474 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.474 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.474 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.474 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.474 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.474 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.474 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.474 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.475 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T04:26:27.475 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T04:26:27.475 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.475 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.475 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.475 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.475 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.475 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.475 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.475 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.475 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.475 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.476 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.476 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T04:26:27.476 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T04:26:27.476 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.476 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.476 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.476 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.476 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.476 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.476 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.476 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.476 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.477 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.477 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.477 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T04:26:27.477 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T04:26:27.477 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.477 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.477 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.477 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.477 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.477 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.477 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.478 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.478 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.478 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.478 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.478 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T04:26:27.478 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T04:26:27.478 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.478 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.478 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.478 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.479 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.479 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.479 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.479 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.479 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.479 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.479 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.479 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T04:26:27.479 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T04:26:27.479 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.479 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.479 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.480 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.480 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.480 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.480 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.480 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.480 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.480 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.480 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.480 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T04:26:27.480 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T04:26:27.481 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.481 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.481 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.481 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.481 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.481 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.481 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.481 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.481 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.481 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.481 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.482 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T04:26:27.482 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T04:26:27.482 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.482 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.482 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.482 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.482 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.482 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.482 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.482 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.482 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.482 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.482 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.483 INFO:teuthology.orchestra.run.smithi007.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T04:26:27.483 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T04:26:27.483 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.483 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.483 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.483 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.483 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.483 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.483 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.483 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.483 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.484 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.484 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.484 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T04:26:27.484 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T04:26:27.484 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.484 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.484 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.484 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-19T04:26:27.484 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.484 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.484 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.484 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.485 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.485 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.485 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.485 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T04:26:27.485 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T04:26:27.485 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.485 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.485 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.485 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.485 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.485 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.485 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.485 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.486 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.486 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.486 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.486 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_URL": { 2024-09-19T04:26:27.486 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_URL", 2024-09-19T04:26:27.486 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.486 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.486 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.486 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.486 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.486 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.486 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.486 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.486 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.487 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.487 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.487 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T04:26:27.487 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T04:26:27.487 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.487 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.487 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.487 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-19T04:26:27.487 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.487 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.487 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.488 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.488 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.488 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.488 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.488 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T04:26:27.488 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T04:26:27.488 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.488 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.488 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.488 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.489 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.489 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.489 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.489 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.489 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.489 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.489 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.489 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T04:26:27.489 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T04:26:27.489 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.490 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.490 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.490 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.490 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.490 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.490 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.490 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.490 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.490 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.490 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.490 INFO:teuthology.orchestra.run.smithi007.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T04:26:27.491 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T04:26:27.491 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.491 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.491 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.491 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.491 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.491 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.491 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.491 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.491 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.491 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.491 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.491 INFO:teuthology.orchestra.run.smithi007.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T04:26:27.492 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T04:26:27.492 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.492 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.492 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.492 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.492 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.492 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.492 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.492 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.492 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.492 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.492 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.493 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T04:26:27.493 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T04:26:27.493 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.493 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.493 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.493 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.493 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.493 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.493 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.493 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.494 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.494 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.494 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.494 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T04:26:27.494 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T04:26:27.494 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.494 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.494 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.494 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.494 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.494 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.495 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.495 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.495 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.495 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.495 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.495 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T04:26:27.495 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T04:26:27.495 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.495 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.495 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.496 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.496 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.496 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.496 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.496 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.496 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.496 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.496 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.496 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T04:26:27.496 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T04:26:27.496 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.497 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.497 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.497 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.497 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.497 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.497 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.497 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.497 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.497 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.497 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.497 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T04:26:27.498 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T04:26:27.498 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.498 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.498 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.498 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.498 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.498 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.498 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.498 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.498 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.498 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.498 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.499 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T04:26:27.499 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T04:26:27.499 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.499 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.499 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.499 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.499 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.499 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.499 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.499 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.499 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.499 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.500 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.500 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T04:26:27.500 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T04:26:27.500 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.500 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.500 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.500 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.500 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.500 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.500 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.500 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.500 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.500 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.501 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.501 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T04:26:27.501 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T04:26:27.501 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.501 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.501 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.501 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.501 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.501 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.501 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.501 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.502 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.502 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.502 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.502 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T04:26:27.502 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T04:26:27.502 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.502 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.502 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.502 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.502 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.502 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.502 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.503 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.503 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.503 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.503 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.503 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T04:26:27.503 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T04:26:27.503 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.503 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.503 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.503 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.503 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.503 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.503 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.504 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.504 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.504 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.504 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.504 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T04:26:27.504 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T04:26:27.504 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.504 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.504 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.504 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T04:26:27.504 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.505 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.505 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.505 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.505 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.505 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.505 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.505 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T04:26:27.505 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T04:26:27.505 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.505 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.506 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.506 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T04:26:27.506 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.506 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.506 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.506 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.506 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.506 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.506 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.506 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T04:26:27.506 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T04:26:27.506 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.507 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.507 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.507 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8", 2024-09-19T04:26:27.507 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.507 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.507 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.507 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.507 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.507 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.507 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.507 INFO:teuthology.orchestra.run.smithi007.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T04:26:27.507 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T04:26:27.508 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.508 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.508 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.508 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "45", 2024-09-19T04:26:27.508 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.508 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.508 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.508 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.508 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.508 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.508 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.508 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T04:26:27.509 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T04:26:27.509 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.509 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.509 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.509 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.509 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.509 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.509 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.509 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.509 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.509 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.509 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.509 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T04:26:27.510 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T04:26:27.510 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.510 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.510 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.510 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-19T04:26:27.510 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.510 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.510 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.510 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.510 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.510 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.510 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.511 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T04:26:27.511 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T04:26:27.511 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.511 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.511 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.511 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.511 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.511 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.511 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.511 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.511 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.511 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.511 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.511 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T04:26:27.512 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T04:26:27.512 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.512 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.512 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.512 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.512 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.512 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.512 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.512 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.512 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.512 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.512 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.513 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T04:26:27.513 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T04:26:27.513 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.513 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.513 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.513 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T04:26:27.513 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.513 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.513 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.513 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.513 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.513 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.513 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.514 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T04:26:27.514 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T04:26:27.514 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.514 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.514 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.514 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T04:26:27.514 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.514 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.514 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.514 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.514 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.514 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.514 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.514 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T04:26:27.515 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T04:26:27.515 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.515 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.515 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.515 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T04:26:27.515 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.515 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.515 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.515 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.515 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.515 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.515 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.515 INFO:teuthology.orchestra.run.smithi007.stdout: "cross_origin_url": { 2024-09-19T04:26:27.516 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cross_origin_url", 2024-09-19T04:26:27.516 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.516 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.516 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.516 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.516 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.516 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.516 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.516 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.516 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.516 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.516 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.517 INFO:teuthology.orchestra.run.smithi007.stdout: "crt_file": { 2024-09-19T04:26:27.517 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crt_file", 2024-09-19T04:26:27.517 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.517 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.517 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.517 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.517 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.517 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.517 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.517 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.517 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.517 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.517 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.518 INFO:teuthology.orchestra.run.smithi007.stdout: "debug": { 2024-09-19T04:26:27.518 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "debug", 2024-09-19T04:26:27.518 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.518 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.518 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.518 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.518 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.518 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.518 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.518 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable/disable debug options", 2024-09-19T04:26:27.518 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.518 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.518 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.519 INFO:teuthology.orchestra.run.smithi007.stdout: "jwt_token_ttl": { 2024-09-19T04:26:27.519 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "jwt_token_ttl", 2024-09-19T04:26:27.519 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.519 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.519 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.519 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "28800", 2024-09-19T04:26:27.519 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.519 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.519 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.519 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.519 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.519 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.519 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.520 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-19T04:26:27.520 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-19T04:26:27.520 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.520 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.520 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.520 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.520 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.520 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.520 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.520 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.521 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.521 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.521 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.521 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.521 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.521 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.521 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.521 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.521 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.521 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.521 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.521 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.522 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.522 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.522 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.522 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.522 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.522 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.522 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.522 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.522 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.522 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.522 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.523 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.523 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.523 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.523 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.523 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.523 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.523 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.523 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.523 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.523 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.523 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.523 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.523 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.524 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.524 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.524 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.524 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.524 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.524 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.524 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.524 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.524 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.524 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.524 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.525 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.525 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.525 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.525 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.525 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.525 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.525 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.525 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.525 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.525 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.525 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.525 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.525 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.526 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.526 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.526 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.526 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.526 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.526 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.526 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.526 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.526 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.526 INFO:teuthology.orchestra.run.smithi007.stdout: "motd": { 2024-09-19T04:26:27.526 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "motd", 2024-09-19T04:26:27.526 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.526 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.527 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.527 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.527 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.527 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.527 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.527 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "The message of the day", 2024-09-19T04:26:27.527 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.527 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.527 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.527 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect_resolve_ip_addr": { 2024-09-19T04:26:27.527 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T04:26:27.527 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.527 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.528 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.528 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.528 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.528 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.528 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.528 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.528 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.528 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.528 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.528 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-19T04:26:27.528 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-19T04:26:27.528 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.528 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.529 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.529 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-19T04:26:27.529 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.529 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.529 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.529 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.529 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.529 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.529 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.529 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-19T04:26:27.529 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-19T04:26:27.529 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.529 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.530 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.530 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8080", 2024-09-19T04:26:27.530 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.530 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.530 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.530 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.530 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.530 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.530 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.530 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-19T04:26:27.530 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-19T04:26:27.531 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.531 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.531 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.531 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.531 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.531 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.531 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.531 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.531 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.531 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.531 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.531 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl_server_port": { 2024-09-19T04:26:27.531 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl_server_port", 2024-09-19T04:26:27.531 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.532 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.532 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.532 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8443", 2024-09-19T04:26:27.532 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.532 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.532 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.532 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.532 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.532 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.532 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.532 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-19T04:26:27.532 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-19T04:26:27.533 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.533 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.533 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.533 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "redirect", 2024-09-19T04:26:27.533 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.533 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.533 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.533 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.533 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect" 2024-09-19T04:26:27.533 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.533 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.533 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.534 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.534 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.534 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-19T04:26:27.534 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-19T04:26:27.534 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.534 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.534 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.534 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-19T04:26:27.534 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-19T04:26:27.534 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-19T04:26:27.534 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.535 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.535 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.535 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.535 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.535 INFO:teuthology.orchestra.run.smithi007.stdout: "url_prefix": { 2024-09-19T04:26:27.535 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url_prefix", 2024-09-19T04:26:27.535 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.535 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.535 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.535 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.535 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.535 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.536 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.536 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.536 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.536 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.536 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.536 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.536 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.536 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "devicehealth", 2024-09-19T04:26:27.536 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.536 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.537 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.537 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_monitoring": { 2024-09-19T04:26:27.537 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_monitoring", 2024-09-19T04:26:27.537 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.537 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.537 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.537 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.537 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.537 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.537 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.537 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "monitor device health metrics", 2024-09-19T04:26:27.537 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.537 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.538 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.538 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.538 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.538 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.538 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.538 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.538 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.538 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.538 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.538 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.538 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.538 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.539 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.539 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.539 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.539 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.539 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.539 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.539 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.539 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.539 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.539 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.539 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.539 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.539 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.540 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.540 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.540 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.540 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.540 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.540 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.540 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.540 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.540 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.540 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.540 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.541 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.541 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.541 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.541 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.541 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.541 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.541 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.541 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.541 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.541 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.541 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.541 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.541 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.542 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.542 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.542 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.542 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.542 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.542 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.542 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.542 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.542 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.542 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.542 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.542 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.543 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.543 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.543 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.543 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.543 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.543 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.543 INFO:teuthology.orchestra.run.smithi007.stdout: "mark_out_threshold": { 2024-09-19T04:26:27.543 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mark_out_threshold", 2024-09-19T04:26:27.543 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.543 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.543 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.544 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2419200", 2024-09-19T04:26:27.544 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.544 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.544 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.544 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T04:26:27.544 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.544 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.544 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.544 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": { 2024-09-19T04:26:27.544 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_name", 2024-09-19T04:26:27.544 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.545 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.545 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.545 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "device_health_metrics", 2024-09-19T04:26:27.545 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.545 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.545 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.545 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T04:26:27.545 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.545 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.545 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.545 INFO:teuthology.orchestra.run.smithi007.stdout: "retention_period": { 2024-09-19T04:26:27.545 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retention_period", 2024-09-19T04:26:27.545 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.546 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.546 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.546 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15552000", 2024-09-19T04:26:27.546 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.546 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.546 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.546 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain device health metrics", 2024-09-19T04:26:27.546 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.546 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.546 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.547 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_frequency": { 2024-09-19T04:26:27.547 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_frequency", 2024-09-19T04:26:27.547 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.547 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.547 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.547 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-19T04:26:27.547 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.547 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.547 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.547 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T04:26:27.547 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.547 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.547 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.548 INFO:teuthology.orchestra.run.smithi007.stdout: "self_heal": { 2024-09-19T04:26:27.548 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "self_heal", 2024-09-19T04:26:27.548 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.548 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.548 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.548 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.548 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.548 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.548 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.548 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T04:26:27.548 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.549 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.549 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.549 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T04:26:27.549 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T04:26:27.549 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.549 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.549 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.549 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T04:26:27.549 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.549 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.549 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.549 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T04:26:27.550 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.550 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.550 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.550 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_threshold": { 2024-09-19T04:26:27.550 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_threshold", 2024-09-19T04:26:27.550 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.550 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.550 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.550 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7257600", 2024-09-19T04:26:27.550 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.550 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.550 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.551 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T04:26:27.551 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.551 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.551 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.551 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.551 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.551 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.551 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "diskprediction_local", 2024-09-19T04:26:27.551 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.551 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.551 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.552 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.552 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.552 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.552 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.552 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.552 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.552 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.552 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.552 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.552 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.552 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.552 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.553 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.553 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.553 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.553 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.553 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.553 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.553 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.553 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.553 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.553 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.553 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.553 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.554 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.554 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.554 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.554 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.554 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.554 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.554 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.554 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.554 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.554 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.554 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.554 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.555 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.555 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.555 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.555 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.555 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.555 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.555 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.555 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.555 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.555 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.555 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.555 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.555 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.555 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.555 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.556 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.556 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.556 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.556 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.556 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.556 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.556 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.556 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.556 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.556 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.556 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.556 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.557 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.557 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.557 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.557 INFO:teuthology.orchestra.run.smithi007.stdout: "predict_interval": { 2024-09-19T04:26:27.557 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predict_interval", 2024-09-19T04:26:27.557 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.557 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.557 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.557 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-19T04:26:27.557 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.558 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.558 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.558 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.558 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.558 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.558 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.558 INFO:teuthology.orchestra.run.smithi007.stdout: "predictor_model": { 2024-09-19T04:26:27.558 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predictor_model", 2024-09-19T04:26:27.558 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.558 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.558 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.558 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "prophetstor", 2024-09-19T04:26:27.558 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.559 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.559 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.559 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.559 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.559 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.559 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.559 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T04:26:27.559 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T04:26:27.559 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.559 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.559 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.559 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T04:26:27.559 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.560 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.560 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.560 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.560 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.560 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.560 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.560 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.560 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.560 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "influx", 2024-09-19T04:26:27.560 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": false, 2024-09-19T04:26:27.560 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "influxdb python module not found", 2024-09-19T04:26:27.560 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.561 INFO:teuthology.orchestra.run.smithi007.stdout: "batch_size": { 2024-09-19T04:26:27.561 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "batch_size", 2024-09-19T04:26:27.561 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.561 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.561 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.561 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5000", 2024-09-19T04:26:27.561 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.561 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.561 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.561 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T04:26:27.561 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.561 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.562 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.562 INFO:teuthology.orchestra.run.smithi007.stdout: "database": { 2024-09-19T04:26:27.562 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "database", 2024-09-19T04:26:27.562 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.562 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.562 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.562 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "ceph", 2024-09-19T04:26:27.562 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.562 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.562 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.562 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T04:26:27.563 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.563 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.563 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.563 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": { 2024-09-19T04:26:27.563 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hostname", 2024-09-19T04:26:27.563 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.563 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.563 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.563 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.563 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.563 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.563 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.564 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server hostname", 2024-09-19T04:26:27.564 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.564 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.564 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.564 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T04:26:27.564 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T04:26:27.564 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.564 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.564 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.564 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "30", 2024-09-19T04:26:27.564 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "5", 2024-09-19T04:26:27.564 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.564 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.565 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T04:26:27.565 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.565 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.565 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.565 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.565 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.565 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.565 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.565 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.565 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.565 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.565 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.565 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.566 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.566 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.566 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.566 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.566 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.566 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.566 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.566 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.566 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.566 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.566 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.566 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.567 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.567 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.567 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.567 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.567 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.567 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.567 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.567 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.567 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.567 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.567 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.567 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.567 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.567 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.568 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.568 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.568 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.568 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.568 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.568 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.568 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.568 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.568 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.568 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.568 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.568 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.568 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.568 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.569 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.569 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.569 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.569 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.569 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.569 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.569 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.569 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.569 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.569 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.569 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.569 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.569 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.570 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.570 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.570 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.570 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.570 INFO:teuthology.orchestra.run.smithi007.stdout: "password": { 2024-09-19T04:26:27.570 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "password", 2024-09-19T04:26:27.570 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.570 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.570 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.570 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.570 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.570 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.571 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.571 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "password of InfluxDB server user", 2024-09-19T04:26:27.571 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.571 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.571 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.571 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.571 INFO:teuthology.orchestra.run.smithi007.stdout: "port": { 2024-09-19T04:26:27.571 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "port", 2024-09-19T04:26:27.571 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.571 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.571 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.571 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8086", 2024-09-19T04:26:27.571 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.571 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.572 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.572 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server port", 2024-09-19T04:26:27.572 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.572 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.572 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.572 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-19T04:26:27.572 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-19T04:26:27.572 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.572 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.572 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.572 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "false", 2024-09-19T04:26:27.572 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.573 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.573 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.573 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T04:26:27.573 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.573 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.573 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.573 INFO:teuthology.orchestra.run.smithi007.stdout: "threads": { 2024-09-19T04:26:27.573 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threads", 2024-09-19T04:26:27.573 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.573 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.573 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.573 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T04:26:27.574 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-19T04:26:27.574 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "32", 2024-09-19T04:26:27.574 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.574 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T04:26:27.574 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.574 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.574 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.574 INFO:teuthology.orchestra.run.smithi007.stdout: "username": { 2024-09-19T04:26:27.574 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "username", 2024-09-19T04:26:27.574 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.574 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.574 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.575 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.575 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.575 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.575 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.575 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "username of InfluxDB server user", 2024-09-19T04:26:27.575 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.575 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.575 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.575 INFO:teuthology.orchestra.run.smithi007.stdout: "verify_ssl": { 2024-09-19T04:26:27.575 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "verify_ssl", 2024-09-19T04:26:27.575 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.576 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.576 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.576 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "true", 2024-09-19T04:26:27.576 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.576 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.576 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.576 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T04:26:27.576 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.576 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.576 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.576 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.576 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.577 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "insights", 2024-09-19T04:26:27.577 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.577 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.577 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.577 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.577 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.577 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.577 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.577 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.577 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.577 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.577 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.578 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.578 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.578 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.578 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.578 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.578 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.578 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.578 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.578 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.578 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.578 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.578 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.579 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.579 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.579 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.579 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.579 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.579 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.579 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.579 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.579 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.579 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.579 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.579 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.579 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.580 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.580 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.580 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.580 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.580 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.580 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.580 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.580 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.580 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.580 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.580 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.581 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.581 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.581 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.581 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.581 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.581 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.581 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.581 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.581 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.581 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.581 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.581 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.582 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.582 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.582 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.582 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.582 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.582 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.582 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.582 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.582 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.582 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.582 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.583 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.583 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.583 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "iostat", 2024-09-19T04:26:27.583 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.583 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.583 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.583 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.583 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.583 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.583 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.584 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.584 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.584 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.584 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.584 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.584 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.584 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.584 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.584 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.584 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.584 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.585 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.585 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.585 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.585 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.585 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.585 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.585 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.585 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.585 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.585 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.585 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.586 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.586 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.586 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.586 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.586 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.586 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.586 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.586 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.586 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.586 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.586 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.587 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.587 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.587 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.587 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.587 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.587 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.587 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.587 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.587 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.587 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.587 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.587 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.588 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.588 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.588 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.588 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.588 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.588 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.588 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.588 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.588 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.588 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.588 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.588 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.589 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.589 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.589 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.589 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.589 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.589 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.589 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.589 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "k8sevents", 2024-09-19T04:26:27.589 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.589 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.590 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.590 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_event_retention_days": { 2024-09-19T04:26:27.590 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ceph_event_retention_days", 2024-09-19T04:26:27.590 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.590 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.590 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.590 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7", 2024-09-19T04:26:27.590 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.590 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.590 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.590 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T04:26:27.590 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.591 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.591 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.591 INFO:teuthology.orchestra.run.smithi007.stdout: "config_check_secs": { 2024-09-19T04:26:27.591 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_check_secs", 2024-09-19T04:26:27.591 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.591 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.591 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.591 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T04:26:27.591 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "10", 2024-09-19T04:26:27.592 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.592 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.592 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T04:26:27.592 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.592 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.592 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.592 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.592 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.592 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.592 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.593 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.593 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.593 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.593 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.593 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.593 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.593 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.593 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.595 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.596 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.596 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.596 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.596 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.596 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.596 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.596 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.596 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.596 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.597 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.597 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.597 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.597 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.597 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.597 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.597 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.597 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.597 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.597 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.597 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.598 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.598 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.598 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.598 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.598 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.598 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.598 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.598 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.598 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.598 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.598 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.598 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.599 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.599 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.599 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.599 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.599 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.599 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.599 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.599 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.599 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.599 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.600 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.600 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.600 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.600 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.600 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.600 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.600 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.600 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.600 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.600 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.600 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.600 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.601 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.601 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.601 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.601 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.601 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "localpool", 2024-09-19T04:26:27.601 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.601 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.601 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.601 INFO:teuthology.orchestra.run.smithi007.stdout: "failure_domain": { 2024-09-19T04:26:27.601 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "failure_domain", 2024-09-19T04:26:27.601 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.601 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.602 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.602 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "host", 2024-09-19T04:26:27.602 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.602 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.602 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.602 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "failure domain for any created local pool", 2024-09-19T04:26:27.602 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T04:26:27.602 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.602 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.602 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.602 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.603 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.603 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.603 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.603 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.603 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.603 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.603 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.603 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.603 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.603 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.603 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.603 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.603 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.604 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.604 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.604 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.604 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.604 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.604 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.604 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.604 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.604 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.604 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.604 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.604 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.605 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.605 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.605 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.605 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.605 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.605 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.605 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.605 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.605 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.605 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.605 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.606 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.606 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.606 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.606 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.606 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.606 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.606 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.606 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.606 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.606 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.606 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.606 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.606 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.606 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.607 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.607 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.607 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.607 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.607 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.607 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.607 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.607 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.607 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.607 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.607 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.607 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.607 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.608 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.608 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": { 2024-09-19T04:26:27.608 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_size", 2024-09-19T04:26:27.608 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.608 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.608 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.608 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.608 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.608 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.608 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.608 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default min_size for any created local pool", 2024-09-19T04:26:27.608 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T04:26:27.608 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.609 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.609 INFO:teuthology.orchestra.run.smithi007.stdout: "num_rep": { 2024-09-19T04:26:27.609 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "num_rep", 2024-09-19T04:26:27.609 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.609 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.609 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.609 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3", 2024-09-19T04:26:27.609 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.610 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.610 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.610 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default replica count for any created local pool", 2024-09-19T04:26:27.610 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.610 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.610 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.610 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": { 2024-09-19T04:26:27.610 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_num", 2024-09-19T04:26:27.610 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.610 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.610 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.610 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "128", 2024-09-19T04:26:27.610 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.610 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.611 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.611 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T04:26:27.611 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.611 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.611 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.611 INFO:teuthology.orchestra.run.smithi007.stdout: "prefix": { 2024-09-19T04:26:27.611 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prefix", 2024-09-19T04:26:27.611 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.611 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.611 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.611 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.611 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.611 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.612 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.612 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name prefix for any created local pool", 2024-09-19T04:26:27.612 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.612 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.612 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.612 INFO:teuthology.orchestra.run.smithi007.stdout: "subtree": { 2024-09-19T04:26:27.612 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "subtree", 2024-09-19T04:26:27.612 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.612 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.612 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.612 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "rack", 2024-09-19T04:26:27.612 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.613 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.613 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.613 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T04:26:27.613 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T04:26:27.613 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.613 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.613 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.613 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.613 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.613 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.613 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mds_autoscaler", 2024-09-19T04:26:27.613 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.613 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.614 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.614 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.614 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.614 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.614 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.614 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.614 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.614 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.614 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.614 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.614 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.614 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.614 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.614 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.615 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.615 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.615 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.615 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.615 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.615 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.615 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.615 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.615 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.615 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.615 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.615 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.615 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.616 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.616 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.616 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.616 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.616 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.616 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.616 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.616 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.616 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.616 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.616 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.616 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.616 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.617 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.617 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.617 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.617 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.617 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.617 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.617 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.617 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.617 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.617 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.617 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.617 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.617 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.617 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.618 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.618 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.618 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.618 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.618 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.618 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.618 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.618 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.618 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.618 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.618 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.618 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.618 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.619 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.619 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.619 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.619 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirroring", 2024-09-19T04:26:27.619 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.619 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.619 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.619 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.619 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.619 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.619 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.619 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.619 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.620 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.620 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.620 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.620 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.620 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.620 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.620 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.620 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.620 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.620 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.620 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.620 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.620 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.621 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.621 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.621 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.621 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.621 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.621 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.621 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.621 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.621 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.621 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.621 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.621 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.622 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.622 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.622 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.622 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.622 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.622 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.622 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.622 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.622 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.622 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.622 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.622 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.623 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.623 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.623 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.623 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.623 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.623 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.623 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.623 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.623 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.623 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.623 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.623 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.624 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.624 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.624 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.624 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.624 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.624 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.624 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.624 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.624 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.624 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.624 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.625 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.625 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.625 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.625 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "nfs", 2024-09-19T04:26:27.625 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.625 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.625 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.625 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.625 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.626 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.626 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.626 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.626 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.626 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.626 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.626 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.626 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.626 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.626 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.626 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.626 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.626 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.627 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.627 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.627 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.627 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.627 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.627 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.627 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.627 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.627 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.627 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.627 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.628 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.628 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.628 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.628 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.628 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.628 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.628 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.628 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.628 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.628 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.628 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.628 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.629 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.629 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.629 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.629 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.629 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.629 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.629 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.629 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.629 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.629 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.629 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.629 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.629 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.630 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.630 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.630 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.630 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.630 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.630 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.630 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.630 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.630 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.630 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.631 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.631 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.631 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.631 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.631 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.631 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.631 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.631 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-19T04:26:27.631 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.631 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.632 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.632 INFO:teuthology.orchestra.run.smithi007.stdout: "fail_fs": { 2024-09-19T04:26:27.632 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "fail_fs", 2024-09-19T04:26:27.632 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.632 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.632 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.632 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.632 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.632 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.632 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.632 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T04:26:27.632 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.633 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.633 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.633 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.633 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.633 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.633 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.633 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.633 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.633 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.633 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.633 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.634 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.634 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.634 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.634 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.634 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.634 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.634 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.634 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.634 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.634 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.634 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.634 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.635 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.635 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.635 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.635 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.635 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.635 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.635 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.635 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.635 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.635 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.635 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.635 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.636 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.636 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.636 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.636 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.636 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.636 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.636 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.636 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.636 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.636 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.636 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.636 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.637 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.637 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.637 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.637 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.637 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.637 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.637 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.637 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.637 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.637 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.637 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.637 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.638 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.638 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.638 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.638 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.638 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.638 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.638 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.638 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.638 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.638 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator": { 2024-09-19T04:26:27.638 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-19T04:26:27.639 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.639 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.639 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.639 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.639 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.639 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.639 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.639 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm", 2024-09-19T04:26:27.639 INFO:teuthology.orchestra.run.smithi007.stdout: "rook", 2024-09-19T04:26:27.639 INFO:teuthology.orchestra.run.smithi007.stdout: "test_orchestrator" 2024-09-19T04:26:27.639 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.639 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Orchestrator backend", 2024-09-19T04:26:27.640 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.640 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.640 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.640 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.640 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.640 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.640 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_perf_query", 2024-09-19T04:26:27.640 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.640 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.640 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.640 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.640 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.640 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.641 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.641 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.641 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.641 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.641 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.641 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.641 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.641 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.641 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.641 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.641 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.641 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.641 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.642 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.642 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.642 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.642 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.642 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.642 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.642 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.642 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.642 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.642 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.642 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.642 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.643 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.643 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.643 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.643 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.643 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.643 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.643 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.643 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.643 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.643 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.643 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.643 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.643 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.643 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.644 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.644 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.644 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.644 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.644 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.644 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.644 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.644 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.644 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.644 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.644 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.644 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.645 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.645 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.645 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.645 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.645 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.645 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.645 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.645 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.645 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.645 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.645 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.646 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.646 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.646 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.646 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.646 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_support", 2024-09-19T04:26:27.646 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.646 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.646 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.646 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.646 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.646 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.647 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.647 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.647 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.647 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.647 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.647 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.647 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.647 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.647 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.647 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.647 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.647 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.648 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.648 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.648 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.648 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.648 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.648 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.648 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.648 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.648 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.648 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.648 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.648 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.649 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.649 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.649 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.649 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.649 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.649 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.649 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.649 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.649 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.649 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.649 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.649 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.650 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.650 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.650 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.650 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.650 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.650 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.650 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.650 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.650 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.650 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.650 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.650 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.650 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.651 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.651 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.651 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.651 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.651 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.651 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.651 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.651 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.651 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.651 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.651 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.652 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.652 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.652 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.652 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.652 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.652 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_autoscaler", 2024-09-19T04:26:27.652 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.652 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.652 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.652 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.652 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.653 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.653 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.653 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.653 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.653 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.653 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.653 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.653 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.653 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.653 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.653 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.653 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.653 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.654 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.654 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.654 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.654 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.654 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.654 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.654 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.654 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.654 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.654 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.654 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.654 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.655 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.655 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.655 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.655 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.655 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.655 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.655 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.655 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.655 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.655 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.655 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.655 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.656 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.656 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.656 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.656 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.656 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.656 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.656 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.656 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.656 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.656 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.656 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.656 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.656 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.657 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.657 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.657 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.657 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.657 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.657 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.657 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.657 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.657 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.657 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.657 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.658 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.658 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.658 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.658 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T04:26:27.658 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T04:26:27.658 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.658 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.658 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.658 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T04:26:27.658 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.658 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.658 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.659 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.659 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.659 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.659 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.659 INFO:teuthology.orchestra.run.smithi007.stdout: "threshold": { 2024-09-19T04:26:27.659 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threshold", 2024-09-19T04:26:27.659 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T04:26:27.659 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.659 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.659 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-19T04:26:27.659 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1.0", 2024-09-19T04:26:27.659 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.660 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.660 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "scaling threshold", 2024-09-19T04:26:27.660 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T04:26:27.660 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.660 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.660 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.660 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.660 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "progress", 2024-09-19T04:26:27.660 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.660 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.661 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.661 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_pg_recovery_event": { 2024-09-19T04:26:27.661 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_pg_recovery_event", 2024-09-19T04:26:27.661 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.661 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.661 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.661 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.661 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.661 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.661 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.661 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T04:26:27.661 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.662 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.662 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.662 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-19T04:26:27.662 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-19T04:26:27.662 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.662 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.662 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.662 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.662 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.662 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.662 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.662 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.663 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.663 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.663 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.663 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.663 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.663 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.663 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.663 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.663 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.663 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.663 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.664 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.664 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.664 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.664 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.664 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.664 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.664 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.664 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.664 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.664 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.664 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.664 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.665 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.665 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.665 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.665 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.665 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.665 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.665 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.665 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.665 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.665 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.665 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.665 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.665 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.666 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.666 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.666 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.666 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.666 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.666 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.666 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.666 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.666 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.666 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.666 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.667 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.667 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.667 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.667 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.667 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.667 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.667 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.667 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.667 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.667 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.667 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.667 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.668 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.668 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.668 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.668 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.668 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.668 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.668 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.668 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.668 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.668 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.668 INFO:teuthology.orchestra.run.smithi007.stdout: "max_completed_events": { 2024-09-19T04:26:27.669 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_completed_events", 2024-09-19T04:26:27.669 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.669 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.669 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.669 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "50", 2024-09-19T04:26:27.669 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.669 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.669 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.669 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "number of past completed events to remember", 2024-09-19T04:26:27.669 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.669 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.669 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.670 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T04:26:27.670 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T04:26:27.670 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.670 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.670 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.670 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T04:26:27.670 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.670 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.670 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.670 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long the module is going to sleep", 2024-09-19T04:26:27.670 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.670 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.670 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.670 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.671 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.671 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus", 2024-09-19T04:26:27.671 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.671 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.671 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.671 INFO:teuthology.orchestra.run.smithi007.stdout: "cache": { 2024-09-19T04:26:27.671 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cache", 2024-09-19T04:26:27.671 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.671 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.671 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.672 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.672 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.672 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.672 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.672 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.672 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.672 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.672 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.672 INFO:teuthology.orchestra.run.smithi007.stdout: "exclude_perf_counters": { 2024-09-19T04:26:27.672 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "exclude_perf_counters", 2024-09-19T04:26:27.672 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.673 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.673 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.673 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.673 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.673 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.673 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.673 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T04:26:27.673 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T04:26:27.673 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.673 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.674 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.674 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.674 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.674 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.674 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.674 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.674 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.674 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.674 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.674 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.674 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.674 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.674 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.675 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.675 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.675 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.675 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.675 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.675 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.675 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.675 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.675 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.675 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.675 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.675 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.676 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.676 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.676 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.676 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.676 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.676 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.676 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.676 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.676 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.676 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.676 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.677 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.677 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.677 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.677 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.677 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.677 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.677 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.677 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.677 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.677 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.677 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.677 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.677 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.678 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.678 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.678 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.678 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.678 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.678 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.678 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.678 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.678 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.678 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.678 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.678 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.678 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.679 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.679 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.679 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.679 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.679 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools": { 2024-09-19T04:26:27.679 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools", 2024-09-19T04:26:27.679 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.679 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.679 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.679 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.679 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.679 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.679 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.680 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.680 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.680 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.680 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.680 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T04:26:27.680 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T04:26:27.680 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.680 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.680 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.680 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "300", 2024-09-19T04:26:27.680 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.680 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.681 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.681 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.681 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.681 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.681 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.681 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_interval": { 2024-09-19T04:26:27.681 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_interval", 2024-09-19T04:26:27.681 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T04:26:27.681 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.681 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.682 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15.0", 2024-09-19T04:26:27.682 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.682 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.682 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.682 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.682 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.682 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.682 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.682 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-19T04:26:27.682 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-19T04:26:27.682 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.682 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.683 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.683 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-19T04:26:27.683 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.683 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.683 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.683 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T04:26:27.683 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.683 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.683 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.683 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-19T04:26:27.683 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-19T04:26:27.684 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.684 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.684 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.684 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "9283", 2024-09-19T04:26:27.684 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.684 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.684 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.684 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T04:26:27.684 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.684 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.684 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.684 INFO:teuthology.orchestra.run.smithi007.stdout: "stale_cache_strategy": { 2024-09-19T04:26:27.685 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stale_cache_strategy", 2024-09-19T04:26:27.685 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.685 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.685 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.685 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "log", 2024-09-19T04:26:27.685 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.685 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.685 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.685 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.685 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.685 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.685 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.686 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-19T04:26:27.686 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-19T04:26:27.686 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.686 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.686 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.686 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "default", 2024-09-19T04:26:27.686 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.686 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.686 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.686 INFO:teuthology.orchestra.run.smithi007.stdout: "default", 2024-09-19T04:26:27.686 INFO:teuthology.orchestra.run.smithi007.stdout: "error" 2024-09-19T04:26:27.686 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.686 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.687 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.687 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.687 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.687 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-19T04:26:27.687 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-19T04:26:27.687 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.687 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.687 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.687 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-19T04:26:27.687 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-19T04:26:27.687 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-19T04:26:27.687 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.687 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.687 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.688 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.688 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.688 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.688 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.688 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_support", 2024-09-19T04:26:27.688 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.688 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.688 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.688 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.688 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.688 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.689 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.689 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.689 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.689 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.689 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.689 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.689 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.689 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.689 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.689 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.689 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.689 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.690 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.690 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.690 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.690 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.690 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.690 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.690 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.690 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.690 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.690 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.690 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.690 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.690 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.691 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.691 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.691 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.691 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.691 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.691 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.691 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.691 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.691 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.691 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.691 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.691 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.691 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.691 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.692 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.692 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.692 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.692 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.692 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.692 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.692 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.692 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.692 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.692 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.692 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.693 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.693 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.693 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.693 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.693 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.693 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.693 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.693 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.693 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.693 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.693 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.693 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.693 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.694 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_snap_create": { 2024-09-19T04:26:27.694 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_snap_create", 2024-09-19T04:26:27.694 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.694 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.694 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.694 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T04:26:27.694 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.694 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.694 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.694 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.694 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.694 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.694 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.695 INFO:teuthology.orchestra.run.smithi007.stdout: "mirror_snapshot_schedule": { 2024-09-19T04:26:27.695 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T04:26:27.695 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.695 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.695 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.695 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.695 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.695 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.695 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.695 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.695 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.695 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.695 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.696 INFO:teuthology.orchestra.run.smithi007.stdout: "trash_purge_schedule": { 2024-09-19T04:26:27.696 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "trash_purge_schedule", 2024-09-19T04:26:27.696 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.696 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.696 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.696 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.696 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.696 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.696 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.696 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.696 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.696 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.697 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.697 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.697 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.697 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "restful", 2024-09-19T04:26:27.697 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.697 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.697 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.697 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_auth": { 2024-09-19T04:26:27.697 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_auth", 2024-09-19T04:26:27.697 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.698 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.698 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.698 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.698 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.698 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.698 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.698 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.698 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.698 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.698 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.698 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-19T04:26:27.698 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-19T04:26:27.699 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.699 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.699 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.699 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.699 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.699 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.699 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.699 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.699 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.699 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.699 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.699 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.699 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.700 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.700 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.700 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.700 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.700 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.700 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.700 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.700 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.700 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.700 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.700 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.700 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.701 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.701 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.701 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.701 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.701 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.701 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.701 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.701 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.701 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.701 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.701 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.702 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.702 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.702 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.702 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.702 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.702 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.702 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.702 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.702 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.702 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.702 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.703 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.703 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.703 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.703 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.703 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.703 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.703 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.703 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.703 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.703 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.703 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.703 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.703 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.704 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.704 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.704 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.704 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.704 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.704 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.704 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.704 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.704 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.704 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.704 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.705 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.705 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.705 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.705 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.705 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.705 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.705 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-19T04:26:27.705 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-19T04:26:27.705 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.705 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.705 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.706 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.706 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.706 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.706 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.706 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.706 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.706 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.706 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.706 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-19T04:26:27.706 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-19T04:26:27.706 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.707 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.707 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.707 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.707 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.707 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.707 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.707 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.707 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.707 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.707 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.707 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.707 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.707 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rgw", 2024-09-19T04:26:27.708 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.708 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.708 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.708 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.708 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.708 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.708 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.708 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.708 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.708 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.708 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.708 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.709 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.709 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.709 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.709 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.709 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.709 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.709 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.709 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.709 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.709 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.709 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.710 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.710 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.710 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.710 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.710 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.710 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.710 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.710 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.710 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.710 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.710 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.710 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.711 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.711 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.711 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.711 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.711 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.711 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.711 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.711 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.711 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.711 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.711 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.711 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.711 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.711 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.712 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.712 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.712 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.712 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.712 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.712 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.712 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.712 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.712 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.712 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.712 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.712 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.713 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.713 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.713 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.713 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.713 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.713 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.713 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.713 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.713 INFO:teuthology.orchestra.run.smithi007.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T04:26:27.713 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T04:26:27.713 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.713 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.714 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.714 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T04:26:27.714 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.714 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.714 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.714 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T04:26:27.714 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.714 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.714 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.714 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.714 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.714 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rook", 2024-09-19T04:26:27.715 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.715 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.715 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.715 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.715 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.715 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.715 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.715 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.715 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.715 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.715 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.715 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.715 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.715 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.716 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.716 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.716 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.716 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.716 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.716 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.716 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.716 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.716 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.716 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.717 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.717 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.717 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.717 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.717 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.717 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.717 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.717 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.717 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.717 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.717 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.717 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.718 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.718 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.718 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.718 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.718 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.718 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.718 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.718 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.718 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.718 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.718 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.718 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.719 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.719 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.719 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.719 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.719 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.719 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.719 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.719 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.719 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.719 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.719 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.719 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.719 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.719 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.720 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.720 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.720 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.720 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.720 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.720 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.720 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.720 INFO:teuthology.orchestra.run.smithi007.stdout: "storage_class": { 2024-09-19T04:26:27.720 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "storage_class", 2024-09-19T04:26:27.720 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.720 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.720 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.721 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "local", 2024-09-19T04:26:27.721 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.721 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.721 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.721 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T04:26:27.721 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.721 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.721 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.721 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.721 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.721 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "selftest", 2024-09-19T04:26:27.721 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.722 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.722 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.722 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.722 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.722 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.722 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.722 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.722 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.722 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.722 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.722 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.722 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.722 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.722 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.723 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.723 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.723 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.723 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.723 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.723 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.723 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.723 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.723 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.723 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.723 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.723 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.724 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.724 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.724 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.724 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.724 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.724 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.724 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.724 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.724 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.724 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.724 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.724 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.724 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.725 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.725 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.725 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.725 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.725 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.725 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.725 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.725 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.725 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.725 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.725 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.725 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.725 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.726 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.726 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.726 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.726 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.726 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.726 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.726 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.726 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.726 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.726 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.726 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.726 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.726 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.727 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.727 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.727 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.727 INFO:teuthology.orchestra.run.smithi007.stdout: "roption1": { 2024-09-19T04:26:27.727 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption1", 2024-09-19T04:26:27.727 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.727 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.727 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.727 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.727 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.727 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.728 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.728 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.728 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.728 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.728 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.728 INFO:teuthology.orchestra.run.smithi007.stdout: "roption2": { 2024-09-19T04:26:27.728 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption2", 2024-09-19T04:26:27.728 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.728 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.728 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.728 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "xyz", 2024-09-19T04:26:27.729 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.729 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.729 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.729 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.729 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.729 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.729 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.729 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption1": { 2024-09-19T04:26:27.729 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption1", 2024-09-19T04:26:27.729 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.729 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.730 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.730 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.730 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.730 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.730 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.730 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.730 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.730 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.730 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.730 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption2": { 2024-09-19T04:26:27.731 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption2", 2024-09-19T04:26:27.731 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.731 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.731 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.731 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.731 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.731 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.731 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.731 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.731 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.731 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.732 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.732 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption3": { 2024-09-19T04:26:27.732 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption3", 2024-09-19T04:26:27.732 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T04:26:27.732 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.732 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.732 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.732 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.732 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.732 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.732 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.733 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.733 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.733 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.733 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption4": { 2024-09-19T04:26:27.733 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption4", 2024-09-19T04:26:27.733 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.733 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.733 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.733 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.733 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.733 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.734 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.734 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.734 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.734 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.734 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.734 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption5": { 2024-09-19T04:26:27.734 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption5", 2024-09-19T04:26:27.734 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.734 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.734 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.734 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.735 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.735 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.735 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.735 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.735 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.735 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.735 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.735 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption6": { 2024-09-19T04:26:27.735 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption6", 2024-09-19T04:26:27.735 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.735 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.736 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.736 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.736 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.736 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.736 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.736 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.736 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.736 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.736 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.736 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption7": { 2024-09-19T04:26:27.736 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption7", 2024-09-19T04:26:27.737 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.737 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.737 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.737 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.737 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-19T04:26:27.737 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "42", 2024-09-19T04:26:27.737 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.737 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.737 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.737 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.737 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.738 INFO:teuthology.orchestra.run.smithi007.stdout: "testkey": { 2024-09-19T04:26:27.738 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testkey", 2024-09-19T04:26:27.738 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.738 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.738 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.738 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.738 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.738 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.738 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.738 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.738 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.738 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.738 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.739 INFO:teuthology.orchestra.run.smithi007.stdout: "testlkey": { 2024-09-19T04:26:27.739 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testlkey", 2024-09-19T04:26:27.739 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.739 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.739 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.739 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.739 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.739 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.739 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.739 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.739 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.739 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.740 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.740 INFO:teuthology.orchestra.run.smithi007.stdout: "testnewline": { 2024-09-19T04:26:27.740 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testnewline", 2024-09-19T04:26:27.740 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.740 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.740 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.740 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.740 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.740 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.740 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.740 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.740 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.741 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.741 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.741 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.741 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.741 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snap_schedule", 2024-09-19T04:26:27.741 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.741 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.741 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.741 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_m_granularity": { 2024-09-19T04:26:27.742 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_m_granularity", 2024-09-19T04:26:27.742 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.742 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.742 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.742 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.742 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.742 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.742 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.742 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T04:26:27.742 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.742 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.742 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.743 INFO:teuthology.orchestra.run.smithi007.stdout: "dump_on_update": { 2024-09-19T04:26:27.743 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dump_on_update", 2024-09-19T04:26:27.743 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.743 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.743 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.743 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.743 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.743 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.743 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.743 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "dump database to debug log on update", 2024-09-19T04:26:27.743 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.744 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.744 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.744 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.744 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.744 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.744 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.744 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.744 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.744 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.744 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.745 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.745 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.745 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.745 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.745 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.745 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.745 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.745 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.745 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.745 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.745 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.746 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.746 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.746 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.746 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.746 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.746 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.746 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.746 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.746 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.746 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.747 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.747 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.747 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.747 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.747 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.747 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.747 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.747 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.747 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.747 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.747 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.747 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.747 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.748 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.748 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.748 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.748 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.748 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.748 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.748 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.748 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.748 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.748 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.748 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.749 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.749 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.749 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.749 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.749 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.749 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.749 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.749 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.749 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.749 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.749 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.749 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.750 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.750 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.750 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.750 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stats", 2024-09-19T04:26:27.750 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.750 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.750 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.750 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.750 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.750 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.750 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.751 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.751 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.751 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.751 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.751 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.751 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.751 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.751 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.751 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.751 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.751 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.751 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.752 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.752 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.752 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.752 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.752 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.752 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.752 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.752 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.752 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.752 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.752 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.753 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.753 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.753 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.753 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.753 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.753 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.753 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.753 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.753 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.753 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.754 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.754 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.754 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.754 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.754 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.754 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.754 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.754 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.754 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.754 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.754 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.755 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.755 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.755 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.755 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.755 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.755 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.755 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.755 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.755 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.755 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.755 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.755 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.755 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.756 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.756 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.756 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.756 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.756 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.756 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.756 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.756 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "status", 2024-09-19T04:26:27.756 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.756 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.756 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.757 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.757 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.757 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.757 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.757 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.757 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.757 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.757 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.757 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.757 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.757 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.758 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.758 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.758 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.758 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.758 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.758 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.758 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.758 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.758 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.758 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.758 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.758 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.759 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.759 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.759 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.759 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.759 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.759 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.759 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.759 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.759 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.759 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.760 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.760 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.760 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.760 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.760 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.760 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.760 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.760 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.760 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.760 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.760 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.760 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.760 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.761 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.761 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.761 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.761 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.761 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.761 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.761 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.761 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.761 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.761 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.761 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.761 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.761 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.762 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.762 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.762 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.762 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.762 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.762 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.762 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.762 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.762 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.762 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telegraf", 2024-09-19T04:26:27.762 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.762 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.763 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.763 INFO:teuthology.orchestra.run.smithi007.stdout: "address": { 2024-09-19T04:26:27.763 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "address", 2024-09-19T04:26:27.763 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.763 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.763 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.763 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T04:26:27.763 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.763 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.763 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.763 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.763 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.764 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.764 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.764 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T04:26:27.764 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T04:26:27.764 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.764 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.764 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.764 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15", 2024-09-19T04:26:27.764 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.764 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.764 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.764 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.764 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.765 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.765 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.765 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.765 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.765 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.765 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.765 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.765 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.765 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.765 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.765 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.765 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.765 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.766 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.766 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.766 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.766 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.766 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.766 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.766 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.766 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.766 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.766 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.766 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.766 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.767 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.767 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.767 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.767 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.767 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.767 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.767 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.767 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.767 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.767 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.767 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.767 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.767 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.768 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.768 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.768 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.768 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.768 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.768 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.768 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.768 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.768 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.768 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.768 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.768 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.768 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.768 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.769 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.769 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.769 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.769 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.769 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.769 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.769 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.769 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.769 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.769 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.769 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.770 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.770 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.770 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.770 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.770 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.770 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.770 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.770 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telemetry", 2024-09-19T04:26:27.770 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.770 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.770 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.771 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_basic": { 2024-09-19T04:26:27.771 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_basic", 2024-09-19T04:26:27.771 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.771 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.771 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.771 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.771 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.771 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.771 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.771 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T04:26:27.771 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.771 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.771 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.772 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_crash": { 2024-09-19T04:26:27.772 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_crash", 2024-09-19T04:26:27.772 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.772 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.772 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.772 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.772 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.772 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.772 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.772 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T04:26:27.773 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.773 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.773 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.773 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_device": { 2024-09-19T04:26:27.773 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_device", 2024-09-19T04:26:27.773 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.773 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.773 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.774 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.774 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.774 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.774 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.774 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T04:26:27.774 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.774 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.774 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.774 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_ident": { 2024-09-19T04:26:27.774 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_ident", 2024-09-19T04:26:27.774 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.775 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.775 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.775 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.775 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.775 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.775 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.775 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T04:26:27.775 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.775 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.775 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.775 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_perf": { 2024-09-19T04:26:27.775 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_perf", 2024-09-19T04:26:27.776 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.776 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.776 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.776 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.776 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.776 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.776 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.776 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T04:26:27.776 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.776 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.776 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.777 INFO:teuthology.orchestra.run.smithi007.stdout: "contact": { 2024-09-19T04:26:27.777 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "contact", 2024-09-19T04:26:27.777 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.777 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.777 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.777 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.777 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.777 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.777 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.777 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.777 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.778 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.778 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.778 INFO:teuthology.orchestra.run.smithi007.stdout: "description": { 2024-09-19T04:26:27.778 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "description", 2024-09-19T04:26:27.778 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.778 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.778 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.778 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.778 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.778 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.779 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.779 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.779 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.779 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.779 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.779 INFO:teuthology.orchestra.run.smithi007.stdout: "device_url": { 2024-09-19T04:26:27.779 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_url", 2024-09-19T04:26:27.779 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.779 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.779 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.779 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T04:26:27.779 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.780 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.780 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.780 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.780 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.780 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.780 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.780 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-19T04:26:27.780 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-19T04:26:27.780 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.780 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.780 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.780 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.781 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.781 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.781 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.781 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.781 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.781 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.781 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.781 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T04:26:27.781 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T04:26:27.781 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.781 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.782 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.782 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "24", 2024-09-19T04:26:27.782 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "8", 2024-09-19T04:26:27.782 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.782 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.782 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.782 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.782 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.782 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.782 INFO:teuthology.orchestra.run.smithi007.stdout: "last_opt_revision": { 2024-09-19T04:26:27.782 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "last_opt_revision", 2024-09-19T04:26:27.782 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.783 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.783 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.783 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1", 2024-09-19T04:26:27.783 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.783 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.783 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.783 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.783 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.783 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.783 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.783 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard": { 2024-09-19T04:26:27.783 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard", 2024-09-19T04:26:27.784 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.784 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.784 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.784 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.784 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.784 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.784 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.784 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.784 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.784 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.784 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.785 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard_description": { 2024-09-19T04:26:27.785 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard_description", 2024-09-19T04:26:27.785 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.785 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.785 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.785 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.785 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.785 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.785 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.785 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.785 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.785 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.786 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.786 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.786 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.786 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.786 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.786 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.786 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.786 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.786 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.786 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.786 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.786 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.787 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.787 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.787 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.787 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.787 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.787 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.787 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.787 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.787 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.787 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.787 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.787 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.788 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.788 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.788 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.788 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.788 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.788 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.788 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.788 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.788 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.788 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.788 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.789 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.789 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.789 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.789 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.789 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.789 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.789 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.789 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.789 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.789 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.789 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.789 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.789 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.790 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.790 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.790 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.790 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.790 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.790 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.790 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.790 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.790 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.790 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.790 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.790 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.791 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.791 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.791 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.791 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.791 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.791 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.791 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.791 INFO:teuthology.orchestra.run.smithi007.stdout: "organization": { 2024-09-19T04:26:27.791 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "organization", 2024-09-19T04:26:27.791 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.791 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.791 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.792 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.792 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.792 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.792 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.792 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.792 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.792 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.792 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.792 INFO:teuthology.orchestra.run.smithi007.stdout: "proxy": { 2024-09-19T04:26:27.792 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "proxy", 2024-09-19T04:26:27.793 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.793 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.793 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.793 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.793 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.793 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.793 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.793 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.793 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.793 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.793 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.794 INFO:teuthology.orchestra.run.smithi007.stdout: "url": { 2024-09-19T04:26:27.794 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url", 2024-09-19T04:26:27.794 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.794 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.794 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.794 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T04:26:27.794 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.794 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.794 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.794 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.794 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.795 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.795 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.795 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.795 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.795 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "test_orchestrator", 2024-09-19T04:26:27.795 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.795 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.795 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.795 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.795 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.795 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.796 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.796 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.796 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.796 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.796 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.796 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.796 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.796 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.796 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.796 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.796 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.796 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.796 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.796 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.797 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.797 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.797 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.797 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.797 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.797 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.797 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.797 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.797 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.797 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.797 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.797 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.797 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.798 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.798 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.798 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.798 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.798 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.798 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.798 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.800 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.800 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.800 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.800 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.800 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.800 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.800 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.800 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.800 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.801 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.801 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.801 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.801 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.801 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.801 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.801 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.801 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.801 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.801 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.801 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.802 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.802 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.802 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.802 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.802 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.802 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.802 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.802 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.802 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.802 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.802 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.803 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volumes", 2024-09-19T04:26:27.803 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.803 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.803 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.803 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.803 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.803 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.803 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.803 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.803 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.803 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.803 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.803 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.804 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.804 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.804 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.804 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.804 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.804 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.804 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.804 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.804 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.804 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.804 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.804 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.805 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.805 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.805 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.805 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.805 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.805 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.805 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.805 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.805 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.805 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.805 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.805 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.806 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.806 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.806 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.806 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.806 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.806 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.806 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.806 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.806 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.806 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.806 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.806 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.806 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.807 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.807 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.807 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.807 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.807 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.807 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.807 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.807 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.807 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.807 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.807 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.807 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.808 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.808 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.808 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.808 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.808 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.808 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.808 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.808 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.808 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_clones": { 2024-09-19T04:26:27.808 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_clones", 2024-09-19T04:26:27.808 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.808 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.809 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.809 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4", 2024-09-19T04:26:27.809 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.809 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.809 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.809 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T04:26:27.809 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.809 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.809 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.809 INFO:teuthology.orchestra.run.smithi007.stdout: "periodic_async_work": { 2024-09-19T04:26:27.810 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "periodic_async_work", 2024-09-19T04:26:27.810 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.810 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.810 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.810 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.810 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.810 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.810 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.810 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Periodically check for async work", 2024-09-19T04:26:27.810 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.810 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.810 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.810 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_delay": { 2024-09-19T04:26:27.811 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_delay", 2024-09-19T04:26:27.811 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.811 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.811 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.811 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T04:26:27.811 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.811 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.811 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.811 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T04:26:27.811 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.811 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.811 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.811 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_no_wait": { 2024-09-19T04:26:27.812 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T04:26:27.812 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.812 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.812 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.812 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.812 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.812 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.812 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.812 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T04:26:27.812 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.812 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.812 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.812 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.812 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.813 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix", 2024-09-19T04:26:27.813 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.813 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.813 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.813 INFO:teuthology.orchestra.run.smithi007.stdout: "discovery_interval": { 2024-09-19T04:26:27.813 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "discovery_interval", 2024-09-19T04:26:27.813 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T04:26:27.813 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.813 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.813 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "100", 2024-09-19T04:26:27.813 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.814 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.814 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.814 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.814 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.814 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.814 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.814 INFO:teuthology.orchestra.run.smithi007.stdout: "identifier": { 2024-09-19T04:26:27.814 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "identifier", 2024-09-19T04:26:27.814 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.814 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.814 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.814 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.815 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.815 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.815 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.815 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.815 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.815 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.815 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.815 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T04:26:27.815 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T04:26:27.815 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.815 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.815 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.816 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T04:26:27.816 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.816 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.816 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.816 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.816 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.816 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.816 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.816 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.816 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.816 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.816 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.817 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.817 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.817 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.817 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.817 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.817 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.817 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.817 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.817 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.817 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.817 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.817 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.817 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.817 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.818 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.818 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.818 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.818 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.818 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.818 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.818 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.818 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.818 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.818 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.818 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.818 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.819 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.819 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.819 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.819 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.819 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.819 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.819 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.819 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.819 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.819 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.819 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.819 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.819 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.820 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.820 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.820 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.820 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.820 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.820 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.820 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.820 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.820 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.820 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.820 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.820 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.820 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.821 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.821 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.821 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.821 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.821 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.821 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.821 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.821 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.821 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.821 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.821 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_host": { 2024-09-19T04:26:27.821 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_host", 2024-09-19T04:26:27.822 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.822 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.822 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.822 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.822 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.822 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.822 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.822 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.822 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.822 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.822 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.822 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_port": { 2024-09-19T04:26:27.822 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_port", 2024-09-19T04:26:27.823 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.823 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.823 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.823 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10051", 2024-09-19T04:26:27.823 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.823 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.823 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.823 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.823 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.823 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.823 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.824 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_sender": { 2024-09-19T04:26:27.824 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_sender", 2024-09-19T04:26:27.824 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.824 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.824 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.824 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T04:26:27.824 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.824 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.824 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.824 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.824 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.824 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.825 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.825 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.825 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.825 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.825 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-19T04:26:27.825 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.825 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.825 INFO:teuthology.orchestra.run.smithi007.stdout: "modules": [ 2024-09-19T04:26:27.825 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm", 2024-09-19T04:26:27.825 INFO:teuthology.orchestra.run.smithi007.stdout: "dashboard", 2024-09-19T04:26:27.825 INFO:teuthology.orchestra.run.smithi007.stdout: "iostat", 2024-09-19T04:26:27.825 INFO:teuthology.orchestra.run.smithi007.stdout: "nfs", 2024-09-19T04:26:27.825 INFO:teuthology.orchestra.run.smithi007.stdout: "restful" 2024-09-19T04:26:27.826 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.826 INFO:teuthology.orchestra.run.smithi007.stdout: "available_modules": [ 2024-09-19T04:26:27.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.826 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "alerts", 2024-09-19T04:26:27.826 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.826 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.826 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.826 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T04:26:27.826 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T04:26:27.826 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.826 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.826 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.826 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T04:26:27.826 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.827 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.827 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.827 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T04:26:27.827 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.827 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.827 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.827 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.827 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.827 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.827 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.827 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.828 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.828 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.828 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.828 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.828 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.828 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.828 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.828 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.828 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.828 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.828 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.828 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.828 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.829 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.829 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.829 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.829 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.829 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.829 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.829 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.829 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.829 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.829 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.829 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.830 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.830 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.830 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.830 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.830 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.830 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.830 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.830 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.830 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.830 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.830 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.830 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.830 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.831 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.831 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.831 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.831 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.831 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.831 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.831 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.831 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.831 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.831 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.831 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.831 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.832 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.832 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.832 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.832 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.832 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.832 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.832 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.832 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.832 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.832 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.832 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.832 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.833 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_destination": { 2024-09-19T04:26:27.833 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_destination", 2024-09-19T04:26:27.833 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.833 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.833 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.833 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.833 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.833 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.833 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.833 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email address to send alerts to", 2024-09-19T04:26:27.833 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.834 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.834 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.834 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_from_name": { 2024-09-19T04:26:27.834 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_from_name", 2024-09-19T04:26:27.834 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.834 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.834 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.834 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "Ceph", 2024-09-19T04:26:27.834 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.834 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.834 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.834 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email From: name", 2024-09-19T04:26:27.835 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.835 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.835 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.835 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_host": { 2024-09-19T04:26:27.835 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_host", 2024-09-19T04:26:27.835 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.835 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.835 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.835 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.835 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.835 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.836 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.836 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP server", 2024-09-19T04:26:27.836 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.836 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.836 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.836 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_password": { 2024-09-19T04:26:27.836 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_password", 2024-09-19T04:26:27.836 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.836 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.836 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.836 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.837 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.837 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.837 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.837 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Password to authenticate with", 2024-09-19T04:26:27.837 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.837 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.837 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.837 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_port": { 2024-09-19T04:26:27.837 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_port", 2024-09-19T04:26:27.837 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.837 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.838 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.838 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "465", 2024-09-19T04:26:27.838 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.838 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.838 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.838 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP port", 2024-09-19T04:26:27.838 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.838 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.838 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.838 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_sender": { 2024-09-19T04:26:27.838 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_sender", 2024-09-19T04:26:27.838 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.839 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.839 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.839 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.839 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.839 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.839 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.839 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP envelope sender", 2024-09-19T04:26:27.839 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.839 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.839 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.839 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_ssl": { 2024-09-19T04:26:27.839 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_ssl", 2024-09-19T04:26:27.840 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.840 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.840 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.840 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.840 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.840 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.840 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.840 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T04:26:27.840 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.840 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.840 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.840 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_user": { 2024-09-19T04:26:27.841 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_user", 2024-09-19T04:26:27.841 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.841 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.841 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.841 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.841 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.841 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.841 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.841 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "User to authenticate as", 2024-09-19T04:26:27.841 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.841 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.841 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.842 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.842 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.842 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "balancer", 2024-09-19T04:26:27.842 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.842 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.842 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.842 INFO:teuthology.orchestra.run.smithi007.stdout: "active": { 2024-09-19T04:26:27.842 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "active", 2024-09-19T04:26:27.842 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.842 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.842 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.842 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.843 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.843 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.843 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.843 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T04:26:27.843 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.843 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.843 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.843 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_time": { 2024-09-19T04:26:27.843 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_time", 2024-09-19T04:26:27.843 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.843 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.843 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.844 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0000", 2024-09-19T04:26:27.844 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.844 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.844 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.844 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T04:26:27.844 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T04:26:27.844 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.844 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.844 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_weekday": { 2024-09-19T04:26:27.844 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_weekday", 2024-09-19T04:26:27.844 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T04:26:27.844 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.845 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.845 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T04:26:27.845 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-19T04:26:27.845 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-19T04:26:27.845 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.845 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T04:26:27.845 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T04:26:27.845 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.845 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.845 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_max_iterations": { 2024-09-19T04:26:27.845 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_max_iterations", 2024-09-19T04:26:27.846 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T04:26:27.846 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.846 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.846 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "25", 2024-09-19T04:26:27.846 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-19T04:26:27.846 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "250", 2024-09-19T04:26:27.846 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.846 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T04:26:27.846 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.846 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.846 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.846 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_metrics": { 2024-09-19T04:26:27.846 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_metrics", 2024-09-19T04:26:27.847 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.847 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.847 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.847 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T04:26:27.847 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.847 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.847 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.847 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T04:26:27.847 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T04:26:27.847 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.847 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.847 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_step": { 2024-09-19T04:26:27.847 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_step", 2024-09-19T04:26:27.848 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T04:26:27.848 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.848 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.848 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.5", 2024-09-19T04:26:27.848 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0.001", 2024-09-19T04:26:27.848 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "0.999", 2024-09-19T04:26:27.848 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.848 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "aggressiveness of optimization", 2024-09-19T04:26:27.848 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T04:26:27.848 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.848 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.849 INFO:teuthology.orchestra.run.smithi007.stdout: "end_time": { 2024-09-19T04:26:27.849 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_time", 2024-09-19T04:26:27.849 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.849 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.849 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.849 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2359", 2024-09-19T04:26:27.849 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.849 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.849 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.849 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T04:26:27.849 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T04:26:27.849 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.850 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.850 INFO:teuthology.orchestra.run.smithi007.stdout: "end_weekday": { 2024-09-19T04:26:27.850 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_weekday", 2024-09-19T04:26:27.850 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T04:26:27.850 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.850 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.850 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T04:26:27.850 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-19T04:26:27.850 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-19T04:26:27.850 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.850 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T04:26:27.850 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T04:26:27.850 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.851 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.851 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.851 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.851 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.851 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.851 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.851 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.851 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.851 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.851 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.851 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.851 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.852 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.852 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.852 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.852 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.852 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.852 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.852 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.852 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.852 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.852 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.852 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.852 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.853 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.853 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.853 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.853 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.853 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.853 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.853 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.853 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.853 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.853 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.853 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.854 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.854 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.854 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.854 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.854 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.854 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.854 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.854 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.854 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.854 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.854 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.854 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.854 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.855 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.855 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.855 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.855 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.855 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.855 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.855 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.855 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.855 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.855 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.855 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.855 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.856 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.856 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.856 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.856 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.856 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.856 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.856 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.856 INFO:teuthology.orchestra.run.smithi007.stdout: "min_score": { 2024-09-19T04:26:27.856 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_score", 2024-09-19T04:26:27.856 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T04:26:27.856 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.856 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.857 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T04:26:27.857 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.857 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.857 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.857 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T04:26:27.857 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.857 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.857 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.857 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-19T04:26:27.857 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-19T04:26:27.857 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.858 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.858 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.858 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "upmap", 2024-09-19T04:26:27.858 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.858 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.858 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.858 INFO:teuthology.orchestra.run.smithi007.stdout: "crush-compat", 2024-09-19T04:26:27.858 INFO:teuthology.orchestra.run.smithi007.stdout: "none", 2024-09-19T04:26:27.858 INFO:teuthology.orchestra.run.smithi007.stdout: "read", 2024-09-19T04:26:27.858 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap", 2024-09-19T04:26:27.858 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap-read" 2024-09-19T04:26:27.858 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.859 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Balancer mode", 2024-09-19T04:26:27.859 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.859 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.859 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.859 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_ids": { 2024-09-19T04:26:27.859 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_ids", 2024-09-19T04:26:27.859 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.859 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.859 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.859 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.859 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.859 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.859 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.860 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T04:26:27.860 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.860 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.860 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.860 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T04:26:27.860 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T04:26:27.860 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.860 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.860 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.860 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T04:26:27.860 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.861 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.861 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.861 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T04:26:27.861 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.861 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.861 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.861 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_deviation": { 2024-09-19T04:26:27.861 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_deviation", 2024-09-19T04:26:27.861 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.861 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.861 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.862 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T04:26:27.862 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-19T04:26:27.862 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.862 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.862 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T04:26:27.862 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T04:26:27.862 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.862 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.862 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_optimizations": { 2024-09-19T04:26:27.862 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_optimizations", 2024-09-19T04:26:27.862 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T04:26:27.862 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.863 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.863 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T04:26:27.863 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.863 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.863 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.863 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T04:26:27.863 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.863 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.863 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.863 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.863 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.863 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.864 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm", 2024-09-19T04:26:27.864 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.864 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.864 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.864 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_down_multiplier": { 2024-09-19T04:26:27.864 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_down_multiplier", 2024-09-19T04:26:27.864 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T04:26:27.864 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.864 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.864 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-19T04:26:27.864 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.864 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.864 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.865 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T04:26:27.865 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.865 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.865 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.865 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_refresh_rate": { 2024-09-19T04:26:27.865 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_refresh_rate", 2024-09-19T04:26:27.865 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.865 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.865 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.865 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "20", 2024-09-19T04:26:27.865 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.865 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.866 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.866 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T04:26:27.866 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.866 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.866 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.866 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_starting_port": { 2024-09-19T04:26:27.866 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_starting_port", 2024-09-19T04:26:27.866 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.866 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.866 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.866 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4721", 2024-09-19T04:26:27.866 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.866 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.867 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.867 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T04:26:27.867 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.867 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.867 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.867 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_ptrace": { 2024-09-19T04:26:27.867 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_ptrace", 2024-09-19T04:26:27.867 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.867 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.867 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.867 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.867 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.867 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.867 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.868 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T04:26:27.868 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T04:26:27.868 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.868 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.868 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_interval": { 2024-09-19T04:26:27.868 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_interval", 2024-09-19T04:26:27.868 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.868 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.868 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.868 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T04:26:27.868 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.868 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.868 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.869 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T04:26:27.869 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.869 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.869 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.869 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_memory_target_ratio": { 2024-09-19T04:26:27.869 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T04:26:27.869 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T04:26:27.869 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.869 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.869 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.7", 2024-09-19T04:26:27.869 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.870 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.870 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.870 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T04:26:27.870 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.870 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.870 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.870 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm_log_destination": { 2024-09-19T04:26:27.870 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm_log_destination", 2024-09-19T04:26:27.870 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.870 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.870 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.870 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.870 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.871 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.871 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.871 INFO:teuthology.orchestra.run.smithi007.stdout: "file", 2024-09-19T04:26:27.871 INFO:teuthology.orchestra.run.smithi007.stdout: "file,syslog", 2024-09-19T04:26:27.871 INFO:teuthology.orchestra.run.smithi007.stdout: "syslog" 2024-09-19T04:26:27.871 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.871 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T04:26:27.871 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.871 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.871 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.871 INFO:teuthology.orchestra.run.smithi007.stdout: "cgroups_split": { 2024-09-19T04:26:27.872 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cgroups_split", 2024-09-19T04:26:27.872 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.872 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.872 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.872 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.872 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.872 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.872 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.872 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T04:26:27.872 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.872 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.872 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.873 INFO:teuthology.orchestra.run.smithi007.stdout: "config_checks_enabled": { 2024-09-19T04:26:27.873 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_checks_enabled", 2024-09-19T04:26:27.873 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.873 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.873 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.873 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.873 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.873 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.873 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.873 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T04:26:27.873 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.873 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.873 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.874 INFO:teuthology.orchestra.run.smithi007.stdout: "config_dashboard": { 2024-09-19T04:26:27.874 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_dashboard", 2024-09-19T04:26:27.874 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.874 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.874 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.874 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.874 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.874 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.874 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.874 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T04:26:27.874 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.874 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.875 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.875 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_alertmanager": { 2024-09-19T04:26:27.875 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_alertmanager", 2024-09-19T04:26:27.875 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.875 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.875 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.875 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T04:26:27.875 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.875 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.875 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.875 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-19T04:26:27.875 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.876 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.876 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.876 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_base": { 2024-09-19T04:26:27.876 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_base", 2024-09-19T04:26:27.876 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.876 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.876 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.876 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T04:26:27.876 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.876 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.876 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.877 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Container image name, without the tag", 2024-09-19T04:26:27.877 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.877 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.877 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.877 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_elasticsearch": { 2024-09-19T04:26:27.877 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_elasticsearch", 2024-09-19T04:26:27.877 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.877 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.877 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.877 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T04:26:27.877 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.877 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.878 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.878 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "elasticsearch container image", 2024-09-19T04:26:27.878 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.878 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.878 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.878 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_grafana": { 2024-09-19T04:26:27.878 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_grafana", 2024-09-19T04:26:27.878 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.878 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.878 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.878 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T04:26:27.878 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.878 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.879 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.879 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-19T04:26:27.879 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.879 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.879 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.879 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_haproxy": { 2024-09-19T04:26:27.879 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_haproxy", 2024-09-19T04:26:27.879 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.879 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.879 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.879 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T04:26:27.879 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.879 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.880 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.880 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "HAproxy container image", 2024-09-19T04:26:27.880 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.880 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.880 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.880 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_agent": { 2024-09-19T04:26:27.880 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_agent", 2024-09-19T04:26:27.880 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.880 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.880 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.880 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T04:26:27.880 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.881 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.881 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.881 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger agent container image", 2024-09-19T04:26:27.881 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.881 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.881 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.881 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_collector": { 2024-09-19T04:26:27.881 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_collector", 2024-09-19T04:26:27.881 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.881 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.881 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.882 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T04:26:27.882 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.882 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.882 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.882 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger collector container image", 2024-09-19T04:26:27.882 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.882 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.882 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.882 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_query": { 2024-09-19T04:26:27.882 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_query", 2024-09-19T04:26:27.882 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.882 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.883 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.883 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T04:26:27.883 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.883 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.883 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.883 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger query container image", 2024-09-19T04:26:27.883 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.883 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.883 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.883 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_keepalived": { 2024-09-19T04:26:27.883 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_keepalived", 2024-09-19T04:26:27.883 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.884 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.884 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.884 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T04:26:27.884 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.884 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.884 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.884 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Keepalived container image", 2024-09-19T04:26:27.884 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.884 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.884 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.884 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_loki": { 2024-09-19T04:26:27.884 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_loki", 2024-09-19T04:26:27.885 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.885 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.885 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.885 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T04:26:27.885 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.885 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.885 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.885 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Loki container image", 2024-09-19T04:26:27.885 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.885 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.885 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.885 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_node_exporter": { 2024-09-19T04:26:27.886 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_node_exporter", 2024-09-19T04:26:27.886 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.886 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.886 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.886 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T04:26:27.886 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.886 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.886 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.886 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-19T04:26:27.886 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.886 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.886 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.887 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_nvmeof": { 2024-09-19T04:26:27.887 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_nvmeof", 2024-09-19T04:26:27.887 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.887 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.887 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.887 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T04:26:27.887 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.887 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.887 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.887 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Nvme-of container image", 2024-09-19T04:26:27.887 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.887 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.888 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.888 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_prometheus": { 2024-09-19T04:26:27.888 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_prometheus", 2024-09-19T04:26:27.888 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.888 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.888 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.888 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T04:26:27.888 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.888 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.888 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.888 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-19T04:26:27.888 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.889 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.889 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.889 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_promtail": { 2024-09-19T04:26:27.889 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_promtail", 2024-09-19T04:26:27.889 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.889 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.889 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.889 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T04:26:27.889 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.889 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.889 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.889 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Promtail container image", 2024-09-19T04:26:27.890 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.890 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.890 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.890 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_samba": { 2024-09-19T04:26:27.890 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_samba", 2024-09-19T04:26:27.890 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.890 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.890 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.890 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T04:26:27.890 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.890 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.890 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.891 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Samba/SMB container image", 2024-09-19T04:26:27.891 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.891 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.891 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.891 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_snmp_gateway": { 2024-09-19T04:26:27.891 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_snmp_gateway", 2024-09-19T04:26:27.891 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.891 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.891 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.891 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T04:26:27.891 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.891 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.892 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.892 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SNMP Gateway container image", 2024-09-19T04:26:27.892 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.892 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.892 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.892 INFO:teuthology.orchestra.run.smithi007.stdout: "container_init": { 2024-09-19T04:26:27.892 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_init", 2024-09-19T04:26:27.892 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.892 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.892 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.892 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.892 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.893 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.893 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.893 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T04:26:27.893 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.893 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.893 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.893 INFO:teuthology.orchestra.run.smithi007.stdout: "daemon_cache_timeout": { 2024-09-19T04:26:27.893 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "daemon_cache_timeout", 2024-09-19T04:26:27.893 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.893 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.893 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.893 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T04:26:27.894 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.894 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.894 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.894 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T04:26:27.894 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.894 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.894 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.894 INFO:teuthology.orchestra.run.smithi007.stdout: "default_cephadm_command_timeout": { 2024-09-19T04:26:27.894 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T04:26:27.894 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.894 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.894 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.895 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "900", 2024-09-19T04:26:27.895 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.895 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.895 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.895 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T04:26:27.895 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.895 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.895 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.895 INFO:teuthology.orchestra.run.smithi007.stdout: "default_registry": { 2024-09-19T04:26:27.895 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_registry", 2024-09-19T04:26:27.895 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.895 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.895 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.896 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io", 2024-09-19T04:26:27.896 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.896 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.896 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.896 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T04:26:27.896 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.896 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.896 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.896 INFO:teuthology.orchestra.run.smithi007.stdout: "device_cache_timeout": { 2024-09-19T04:26:27.896 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_cache_timeout", 2024-09-19T04:26:27.896 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.896 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.897 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.897 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1800", 2024-09-19T04:26:27.897 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.897 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.897 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.897 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache device inventory", 2024-09-19T04:26:27.897 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.897 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.897 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.897 INFO:teuthology.orchestra.run.smithi007.stdout: "device_enhanced_scan": { 2024-09-19T04:26:27.897 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_enhanced_scan", 2024-09-19T04:26:27.898 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.898 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.898 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.898 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.898 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.898 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.898 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.898 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T04:26:27.898 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.898 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.898 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.898 INFO:teuthology.orchestra.run.smithi007.stdout: "facts_cache_timeout": { 2024-09-19T04:26:27.899 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "facts_cache_timeout", 2024-09-19T04:26:27.899 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.899 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.899 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.899 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T04:26:27.899 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.899 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.899 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.899 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache host facts data", 2024-09-19T04:26:27.899 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.899 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.899 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.900 INFO:teuthology.orchestra.run.smithi007.stdout: "grafana_dashboards_path": { 2024-09-19T04:26:27.900 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "grafana_dashboards_path", 2024-09-19T04:26:27.900 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.900 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.900 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.900 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T04:26:27.900 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.900 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.900 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.900 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T04:26:27.900 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.900 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.900 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.901 INFO:teuthology.orchestra.run.smithi007.stdout: "host_check_interval": { 2024-09-19T04:26:27.901 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "host_check_interval", 2024-09-19T04:26:27.901 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.901 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.901 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.901 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T04:26:27.901 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.901 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.901 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.901 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to perform a host check", 2024-09-19T04:26:27.901 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.901 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.901 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.902 INFO:teuthology.orchestra.run.smithi007.stdout: "hw_monitoring": { 2024-09-19T04:26:27.902 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hw_monitoring", 2024-09-19T04:26:27.902 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.902 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.902 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.902 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.902 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.902 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.902 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.902 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T04:26:27.902 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.902 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi007.stdout: "inventory_list_all": { 2024-09-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "inventory_list_all", 2024-09-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.903 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.904 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.904 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.904 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.904 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.904 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.904 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.904 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.904 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.904 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.904 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.904 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.904 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.905 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.905 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.905 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.905 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.905 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.905 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.905 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.905 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.905 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.905 INFO:teuthology.orchestra.run.smithi007.stdout: "log_refresh_metadata": { 2024-09-19T04:26:27.905 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_refresh_metadata", 2024-09-19T04:26:27.906 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.906 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.906 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.906 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.906 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.906 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.906 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.906 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T04:26:27.906 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.906 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.906 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.907 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.907 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.907 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.907 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.907 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.907 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.907 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.907 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.907 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.907 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T04:26:27.907 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.907 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.907 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.908 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.908 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.908 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.908 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.908 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.908 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.908 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.908 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.908 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.908 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.908 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.908 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.909 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.909 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.909 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.909 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.909 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.909 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.909 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.909 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.909 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.909 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.909 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.909 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.910 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.910 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.910 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.910 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.910 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.910 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.910 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.910 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.910 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.910 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T04:26:27.910 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T04:26:27.910 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.911 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.911 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.911 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.911 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.911 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.911 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.911 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T04:26:27.911 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.911 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.911 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.911 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T04:26:27.911 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T04:26:27.912 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.912 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.912 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.912 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "*", 2024-09-19T04:26:27.912 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.912 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.912 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.912 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T04:26:27.912 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.912 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.912 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.913 INFO:teuthology.orchestra.run.smithi007.stdout: "max_count_per_host": { 2024-09-19T04:26:27.913 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_count_per_host", 2024-09-19T04:26:27.913 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.913 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.913 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.913 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T04:26:27.913 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.913 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.913 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.913 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of daemons per service per host", 2024-09-19T04:26:27.913 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.913 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.914 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.914 INFO:teuthology.orchestra.run.smithi007.stdout: "max_osd_draining_count": { 2024-09-19T04:26:27.914 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_osd_draining_count", 2024-09-19T04:26:27.914 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.914 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.914 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.914 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T04:26:27.914 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.914 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.914 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.914 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T04:26:27.915 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.915 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.915 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.915 INFO:teuthology.orchestra.run.smithi007.stdout: "migration_current": { 2024-09-19T04:26:27.915 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "migration_current", 2024-09-19T04:26:27.915 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.915 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.915 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.915 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.915 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.915 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.915 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.916 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "internal - do not modify", 2024-09-19T04:26:27.916 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.916 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.916 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.916 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-19T04:26:27.916 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-19T04:26:27.916 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.916 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.916 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.916 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "root", 2024-09-19T04:26:27.916 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.916 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.917 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.917 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm-package", 2024-09-19T04:26:27.917 INFO:teuthology.orchestra.run.smithi007.stdout: "root" 2024-09-19T04:26:27.917 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.917 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T04:26:27.917 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.917 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.917 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.917 INFO:teuthology.orchestra.run.smithi007.stdout: "oob_default_addr": { 2024-09-19T04:26:27.917 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "oob_default_addr", 2024-09-19T04:26:27.917 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.917 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.918 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.918 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "169.254.1.1", 2024-09-19T04:26:27.918 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.918 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.918 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.918 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T04:26:27.918 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.918 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.918 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.918 INFO:teuthology.orchestra.run.smithi007.stdout: "prometheus_alerts_path": { 2024-09-19T04:26:27.918 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus_alerts_path", 2024-09-19T04:26:27.918 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.919 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.919 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.919 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T04:26:27.919 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.919 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.919 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.919 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T04:26:27.919 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.919 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.919 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.919 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_insecure": { 2024-09-19T04:26:27.919 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_insecure", 2024-09-19T04:26:27.920 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.920 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.920 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.920 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.920 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.920 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.920 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.920 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T04:26:27.920 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.920 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.920 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.920 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_password": { 2024-09-19T04:26:27.921 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_password", 2024-09-19T04:26:27.921 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.921 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.921 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.921 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.921 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.921 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.921 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.921 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T04:26:27.921 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.921 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.921 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.922 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_url": { 2024-09-19T04:26:27.922 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_url", 2024-09-19T04:26:27.922 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.922 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.922 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.922 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.922 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.922 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.922 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.922 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T04:26:27.922 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.922 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.922 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.923 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_username": { 2024-09-19T04:26:27.923 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_username", 2024-09-19T04:26:27.923 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.923 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.923 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.923 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.923 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.923 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.923 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.923 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T04:26:27.923 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.924 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.924 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.924 INFO:teuthology.orchestra.run.smithi007.stdout: "secure_monitoring_stack": { 2024-09-19T04:26:27.924 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secure_monitoring_stack", 2024-09-19T04:26:27.924 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.924 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.924 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.924 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.924 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.924 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.924 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.924 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T04:26:27.925 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.925 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.925 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.925 INFO:teuthology.orchestra.run.smithi007.stdout: "service_discovery_port": { 2024-09-19T04:26:27.925 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "service_discovery_port", 2024-09-19T04:26:27.925 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.925 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.925 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.925 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8765", 2024-09-19T04:26:27.925 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.925 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.926 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.926 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "cephadm service discovery port", 2024-09-19T04:26:27.926 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.926 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.926 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.926 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_config_file": { 2024-09-19T04:26:27.926 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_config_file", 2024-09-19T04:26:27.926 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.926 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.926 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.926 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.926 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.927 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.927 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.927 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T04:26:27.927 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.927 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.927 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.927 INFO:teuthology.orchestra.run.smithi007.stdout: "use_agent": { 2024-09-19T04:26:27.927 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_agent", 2024-09-19T04:26:27.927 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.927 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.927 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.927 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.928 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.928 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.928 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.928 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T04:26:27.928 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.928 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.928 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.928 INFO:teuthology.orchestra.run.smithi007.stdout: "use_repo_digest": { 2024-09-19T04:26:27.928 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_repo_digest", 2024-09-19T04:26:27.928 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.928 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.929 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.929 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.929 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.929 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.929 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.929 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T04:26:27.929 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.929 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.929 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.929 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_failed_host_check": { 2024-09-19T04:26:27.929 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_failed_host_check", 2024-09-19T04:26:27.929 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.930 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.930 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.930 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.930 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.930 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.930 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.930 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T04:26:27.930 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.930 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.930 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.930 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_daemons": { 2024-09-19T04:26:27.930 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_daemons", 2024-09-19T04:26:27.931 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.931 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.931 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.931 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.931 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.931 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.931 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.931 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T04:26:27.931 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.931 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.931 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.931 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_hosts": { 2024-09-19T04:26:27.932 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_hosts", 2024-09-19T04:26:27.932 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.932 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.932 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.932 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.932 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.932 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.932 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.932 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T04:26:27.932 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.932 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.932 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.932 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.933 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.933 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crash", 2024-09-19T04:26:27.933 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.933 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.933 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.933 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.933 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.933 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.933 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.933 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.933 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.934 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.934 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.934 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.934 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.934 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.934 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.934 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.934 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.934 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.934 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.934 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.934 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.934 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.935 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.935 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.935 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.935 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.935 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.935 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.935 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.935 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.935 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.935 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.935 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.935 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.936 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.936 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.936 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.936 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.936 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.936 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.936 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.936 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.936 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.936 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.936 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.937 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.937 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.937 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.937 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.937 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.937 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.937 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.937 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.937 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.937 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.937 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.937 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.937 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.938 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.938 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.938 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.938 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.938 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.938 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.938 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.938 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.938 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.938 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.938 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.938 INFO:teuthology.orchestra.run.smithi007.stdout: "retain_interval": { 2024-09-19T04:26:27.939 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retain_interval", 2024-09-19T04:26:27.939 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.939 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.939 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.939 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "31536000", 2024-09-19T04:26:27.939 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.939 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.939 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.939 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T04:26:27.939 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.939 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.939 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.940 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_recent_interval": { 2024-09-19T04:26:27.940 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_recent_interval", 2024-09-19T04:26:27.940 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:27.940 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.940 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.940 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1209600", 2024-09-19T04:26:27.940 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.940 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.940 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.940 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T04:26:27.940 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.940 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.940 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.941 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.941 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:27.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.941 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:27.941 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dashboard", 2024-09-19T04:26:27.941 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:27.941 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:27.941 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:27.941 INFO:teuthology.orchestra.run.smithi007.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T04:26:27.941 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T04:26:27.941 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.941 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.942 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.942 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T04:26:27.942 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.942 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.942 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.942 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.942 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.942 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.942 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.942 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T04:26:27.942 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T04:26:27.943 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.943 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.943 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.943 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.943 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.943 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.943 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.943 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.943 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.943 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.943 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.943 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T04:26:27.944 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T04:26:27.944 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.944 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.944 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.944 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.944 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.944 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.944 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.944 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.944 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.944 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.944 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.945 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_ENABLED": { 2024-09-19T04:26:27.945 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T04:26:27.945 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.945 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.945 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.945 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.945 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.945 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.945 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.945 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.945 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.945 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.945 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.946 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T04:26:27.946 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T04:26:27.946 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.946 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.946 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.946 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.946 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.946 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.946 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.946 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.946 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.946 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.947 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.947 INFO:teuthology.orchestra.run.smithi007.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T04:26:27.947 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T04:26:27.947 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.947 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.947 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.947 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.947 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.947 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.947 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.947 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.947 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.948 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.948 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.948 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T04:26:27.948 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T04:26:27.948 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.948 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.948 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.948 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.948 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.948 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.948 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.948 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.949 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.949 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.949 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.949 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T04:26:27.949 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T04:26:27.949 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.949 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.949 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.949 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.949 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.949 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.950 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.950 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.950 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.950 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.950 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.950 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T04:26:27.950 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T04:26:27.950 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.950 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.950 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.950 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.950 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.950 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.951 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.951 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.951 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.951 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.951 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.951 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T04:26:27.951 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T04:26:27.951 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.951 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.951 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.951 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.951 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.951 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.952 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.952 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.952 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.952 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.952 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.952 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T04:26:27.952 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T04:26:27.952 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.952 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.952 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.952 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.952 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.953 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.953 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.953 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.953 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.953 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.953 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.953 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T04:26:27.953 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T04:26:27.953 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.953 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.953 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.954 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.954 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.954 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.954 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.954 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.954 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.954 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.954 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.954 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T04:26:27.954 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T04:26:27.954 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.954 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.955 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.955 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.955 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.955 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.955 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.955 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.955 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.955 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.955 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.955 INFO:teuthology.orchestra.run.smithi007.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T04:26:27.955 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T04:26:27.955 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.956 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.956 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.956 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.956 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.956 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.956 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.956 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.956 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.956 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.956 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.956 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T04:26:27.956 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T04:26:27.957 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.957 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.957 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.957 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-19T04:26:27.957 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.957 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.957 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.957 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.957 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.957 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.957 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.957 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T04:26:27.958 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T04:26:27.958 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.958 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.958 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.958 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.958 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.958 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.958 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.958 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.958 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.958 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.958 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.958 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_URL": { 2024-09-19T04:26:27.959 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_URL", 2024-09-19T04:26:27.959 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.959 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.959 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.959 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.959 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.959 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.959 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.959 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.959 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.959 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.959 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.960 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T04:26:27.960 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T04:26:27.960 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.960 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.960 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.960 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-19T04:26:27.960 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.960 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.960 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.960 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.960 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.960 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.960 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.961 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T04:26:27.961 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T04:26:27.961 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.961 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.961 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.961 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.961 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.961 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.961 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.961 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.961 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.962 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.962 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.962 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T04:26:27.962 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T04:26:27.962 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.962 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.962 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.962 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.962 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.962 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.962 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.962 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.963 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.963 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.963 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.963 INFO:teuthology.orchestra.run.smithi007.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T04:26:27.963 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T04:26:27.963 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.963 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.963 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.963 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.963 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.963 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.964 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.964 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.964 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.964 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.964 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.964 INFO:teuthology.orchestra.run.smithi007.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T04:26:27.964 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T04:26:27.964 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.964 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.964 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.964 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.964 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.965 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.965 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.965 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.965 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.965 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.965 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.965 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T04:26:27.965 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T04:26:27.965 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.965 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.965 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.966 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.966 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.966 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.966 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.966 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.966 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.966 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.966 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.966 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T04:26:27.966 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T04:26:27.966 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.966 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.966 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.967 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.967 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.967 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.967 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.967 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.967 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.967 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.967 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.967 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T04:26:27.967 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T04:26:27.967 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.968 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.968 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.968 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.968 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.968 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.968 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.968 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.968 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.968 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.968 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.968 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T04:26:27.968 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T04:26:27.969 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.969 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.969 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.969 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.969 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.969 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.969 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.969 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.969 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.969 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.969 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.970 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T04:26:27.970 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T04:26:27.970 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.970 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.970 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.970 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.970 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.970 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.970 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.970 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.970 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.970 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.970 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.971 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T04:26:27.971 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T04:26:27.971 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.971 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.971 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.971 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.971 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.971 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.971 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.971 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.971 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.971 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.972 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.972 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T04:26:27.972 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T04:26:27.972 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.972 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.972 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.972 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.972 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.972 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.972 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.972 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.973 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.973 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.973 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.973 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T04:26:27.973 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T04:26:27.973 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.973 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.973 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.973 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.973 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.973 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.974 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.974 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.974 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.974 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.974 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.974 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T04:26:27.974 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T04:26:27.974 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.974 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.974 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.974 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.975 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.975 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.975 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.975 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.975 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.975 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.975 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.975 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T04:26:27.975 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T04:26:27.975 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.975 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.976 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.976 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.976 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.976 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.976 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.976 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.976 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.976 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.976 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.976 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T04:26:27.976 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T04:26:27.976 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.977 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.977 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.977 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T04:26:27.977 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.977 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.977 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.977 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.977 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.977 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.977 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.977 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T04:26:27.978 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T04:26:27.978 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.978 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.978 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.978 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T04:26:27.978 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.978 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.978 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.978 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.978 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.978 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.978 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.979 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T04:26:27.979 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T04:26:27.979 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.979 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.979 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.979 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8", 2024-09-19T04:26:27.979 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.979 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.979 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.979 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.979 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.979 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.979 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.980 INFO:teuthology.orchestra.run.smithi007.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T04:26:27.980 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T04:26:27.980 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.980 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.980 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.980 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "45", 2024-09-19T04:26:27.980 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.980 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.980 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.980 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.980 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.981 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.981 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.981 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T04:26:27.981 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T04:26:27.981 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.981 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.981 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.981 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.981 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.981 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.981 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.981 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.982 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.982 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.982 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.982 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T04:26:27.982 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T04:26:27.982 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.982 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.982 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.982 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-19T04:26:27.982 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.982 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.982 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.982 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.983 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.983 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.983 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.983 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T04:26:27.983 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T04:26:27.983 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.983 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.983 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.983 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.983 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.983 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.983 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.984 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.984 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.984 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.984 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.984 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T04:26:27.984 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T04:26:27.984 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.984 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.984 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.984 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:27.984 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.984 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.985 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.985 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.985 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.985 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.985 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.985 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T04:26:27.985 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T04:26:27.985 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.985 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.985 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.985 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T04:26:27.985 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.986 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.986 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.986 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.986 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.986 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.986 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.986 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T04:26:27.986 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T04:26:27.986 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.986 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.986 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.986 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T04:26:27.987 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.987 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.987 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.987 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.987 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.987 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.987 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.987 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T04:26:27.987 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T04:26:27.987 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.987 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.987 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.988 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T04:26:27.988 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.988 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.988 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.988 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.988 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.988 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.988 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.988 INFO:teuthology.orchestra.run.smithi007.stdout: "cross_origin_url": { 2024-09-19T04:26:27.988 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cross_origin_url", 2024-09-19T04:26:27.988 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.988 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: "crt_file": { 2024-09-19T04:26:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crt_file", 2024-09-19T04:26:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: "debug": { 2024-09-19T04:26:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "debug", 2024-09-19T04:26:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable/disable debug options", 2024-09-19T04:26:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.992 INFO:teuthology.orchestra.run.smithi007.stdout: "jwt_token_ttl": { 2024-09-19T04:26:27.992 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "jwt_token_ttl", 2024-09-19T04:26:27.992 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:27.992 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.992 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.992 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "28800", 2024-09-19T04:26:27.992 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.992 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.992 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.992 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.992 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.992 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.992 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-19T04:26:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-19T04:26:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:27.998 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:27.998 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:27.998 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:27.998 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.998 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.998 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.998 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.998 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:27.998 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:27.998 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:27.998 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.998 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:27.999 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:27.999 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:27.999 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:27.999 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:27.999 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:27.999 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:27.999 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:27.999 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:27.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:27.999 INFO:teuthology.orchestra.run.smithi007.stdout: "motd": { 2024-09-19T04:26:27.999 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "motd", 2024-09-19T04:26:27.999 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:27.999 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:27.999 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.000 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.000 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.000 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.000 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.000 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "The message of the day", 2024-09-19T04:26:28.000 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.000 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.000 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.000 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect_resolve_ip_addr": { 2024-09-19T04:26:28.000 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T04:26:28.001 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.001 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.001 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.001 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.001 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.001 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.001 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.001 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.001 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.001 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.001 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.001 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-19T04:26:28.002 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-19T04:26:28.002 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.002 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.002 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.002 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-19T04:26:28.002 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.002 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.002 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.002 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.002 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.002 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.002 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.002 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-19T04:26:28.003 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-19T04:26:28.003 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:28.003 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.003 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.003 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8080", 2024-09-19T04:26:28.003 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.003 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.003 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.003 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.003 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.003 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.003 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.004 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-19T04:26:28.004 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-19T04:26:28.004 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.004 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.004 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.004 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:28.004 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.004 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.004 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.004 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.004 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.004 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.005 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.005 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl_server_port": { 2024-09-19T04:26:28.005 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl_server_port", 2024-09-19T04:26:28.005 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:28.005 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.005 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.005 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8443", 2024-09-19T04:26:28.005 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.005 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.005 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.005 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.005 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.006 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.006 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.006 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-19T04:26:28.006 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-19T04:26:28.006 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.006 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.006 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.006 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "redirect", 2024-09-19T04:26:28.006 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.006 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.006 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.007 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.007 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect" 2024-09-19T04:26:28.007 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.007 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.007 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.007 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.007 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.007 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-19T04:26:28.007 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-19T04:26:28.007 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:28.007 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.007 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.008 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-19T04:26:28.008 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-19T04:26:28.008 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-19T04:26:28.008 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.008 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.008 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.008 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.008 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.008 INFO:teuthology.orchestra.run.smithi007.stdout: "url_prefix": { 2024-09-19T04:26:28.008 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url_prefix", 2024-09-19T04:26:28.008 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.008 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.009 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.009 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.009 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.009 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.009 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.009 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.009 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.009 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.009 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.009 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.009 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.009 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "devicehealth", 2024-09-19T04:26:28.010 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:28.010 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:28.010 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:28.010 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_monitoring": { 2024-09-19T04:26:28.010 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_monitoring", 2024-09-19T04:26:28.010 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.010 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.010 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.010 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:28.010 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.010 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.010 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.011 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "monitor device health metrics", 2024-09-19T04:26:28.011 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.011 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.011 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.011 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:28.011 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:28.011 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.011 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.011 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.011 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.011 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.011 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.012 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.012 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.012 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.012 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.012 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.012 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.012 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.012 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.012 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.012 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.012 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.012 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.013 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:28.013 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:28.013 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.013 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.013 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.013 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.013 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.013 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.013 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.013 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.013 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.014 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.014 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.014 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:28.014 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:28.014 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.014 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.014 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.014 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:28.014 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.014 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.014 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.014 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.015 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.015 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.015 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.015 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.015 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.015 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.015 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.015 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.015 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.015 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.015 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:28.015 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:28.016 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.016 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.016 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.016 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.016 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.016 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.016 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.016 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.016 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.016 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.016 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.017 INFO:teuthology.orchestra.run.smithi007.stdout: "mark_out_threshold": { 2024-09-19T04:26:28.017 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mark_out_threshold", 2024-09-19T04:26:28.017 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:28.017 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.017 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.017 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2419200", 2024-09-19T04:26:28.017 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.017 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.017 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.017 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T04:26:28.017 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.017 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.017 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.018 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": { 2024-09-19T04:26:28.018 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_name", 2024-09-19T04:26:28.018 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.018 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.018 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.018 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "device_health_metrics", 2024-09-19T04:26:28.018 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.018 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.018 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.018 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T04:26:28.018 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.018 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.019 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.019 INFO:teuthology.orchestra.run.smithi007.stdout: "retention_period": { 2024-09-19T04:26:28.019 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retention_period", 2024-09-19T04:26:28.019 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:28.019 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.019 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.019 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15552000", 2024-09-19T04:26:28.019 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.019 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.019 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.019 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain device health metrics", 2024-09-19T04:26:28.019 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.020 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.020 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.020 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_frequency": { 2024-09-19T04:26:28.020 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_frequency", 2024-09-19T04:26:28.020 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:28.020 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.020 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.020 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-19T04:26:28.020 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.020 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.020 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.021 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T04:26:28.021 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.021 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.021 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.021 INFO:teuthology.orchestra.run.smithi007.stdout: "self_heal": { 2024-09-19T04:26:28.021 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "self_heal", 2024-09-19T04:26:28.021 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.021 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.021 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.021 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:28.021 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.022 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.022 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.022 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T04:26:28.022 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.022 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.022 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.022 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T04:26:28.022 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T04:26:28.022 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:28.022 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.022 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.023 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T04:26:28.023 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.023 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.023 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.023 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T04:26:28.023 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.023 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.023 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.023 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_threshold": { 2024-09-19T04:26:28.023 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_threshold", 2024-09-19T04:26:28.023 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:28.023 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.024 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.024 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7257600", 2024-09-19T04:26:28.024 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.024 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.024 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.024 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T04:26:28.024 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.024 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.024 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.024 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.024 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.025 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "diskprediction_local", 2024-09-19T04:26:28.025 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:28.025 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:28.025 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:28.025 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:28.025 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:28.025 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.025 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.025 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.025 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.025 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.025 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.025 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.026 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.026 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.026 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.026 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.026 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.026 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.026 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.026 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.026 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.026 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.026 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.027 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:28.027 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:28.027 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.027 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.027 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.027 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.027 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.027 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.027 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.027 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.027 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.027 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.027 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.028 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:28.028 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:28.028 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.028 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.028 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.028 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:28.028 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.028 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.028 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.029 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.029 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.029 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.029 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.029 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.029 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.029 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.029 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.029 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.029 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.029 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.029 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:28.030 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:28.030 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.030 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.030 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.030 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.030 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.030 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.030 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.030 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.030 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.030 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.030 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.031 INFO:teuthology.orchestra.run.smithi007.stdout: "predict_interval": { 2024-09-19T04:26:28.031 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predict_interval", 2024-09-19T04:26:28.031 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.031 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.031 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.031 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-19T04:26:28.031 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.031 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.031 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.031 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.031 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.031 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.031 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.032 INFO:teuthology.orchestra.run.smithi007.stdout: "predictor_model": { 2024-09-19T04:26:28.032 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predictor_model", 2024-09-19T04:26:28.032 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.032 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.032 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.032 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "prophetstor", 2024-09-19T04:26:28.032 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.032 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.032 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.032 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.032 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.033 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.033 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.033 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T04:26:28.033 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T04:26:28.033 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.033 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.033 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.033 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-19T04:26:28.033 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.033 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.033 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.033 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.034 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.034 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.034 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.034 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.034 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.034 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "influx", 2024-09-19T04:26:28.034 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": false, 2024-09-19T04:26:28.034 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "influxdb python module not found", 2024-09-19T04:26:28.034 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:28.034 INFO:teuthology.orchestra.run.smithi007.stdout: "batch_size": { 2024-09-19T04:26:28.035 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "batch_size", 2024-09-19T04:26:28.035 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:28.035 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.035 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.035 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5000", 2024-09-19T04:26:28.035 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.035 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.035 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.035 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T04:26:28.035 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.035 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.035 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.036 INFO:teuthology.orchestra.run.smithi007.stdout: "database": { 2024-09-19T04:26:28.036 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "database", 2024-09-19T04:26:28.036 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.036 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.036 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.036 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "ceph", 2024-09-19T04:26:28.036 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.036 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.036 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.036 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T04:26:28.036 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.036 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.037 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.037 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": { 2024-09-19T04:26:28.037 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hostname", 2024-09-19T04:26:28.037 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.037 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.037 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.037 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.037 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.037 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.037 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.037 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server hostname", 2024-09-19T04:26:28.038 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.038 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.038 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.038 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T04:26:28.038 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T04:26:28.038 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:28.038 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.038 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.038 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "30", 2024-09-19T04:26:28.038 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "5", 2024-09-19T04:26:28.038 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.038 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.039 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T04:26:28.039 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.039 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.039 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.039 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:28.039 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:28.039 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.039 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.039 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.039 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.039 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.039 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.039 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.040 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.040 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.040 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.040 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.040 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.040 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.040 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.040 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.040 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.040 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.040 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.041 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:28.041 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:28.041 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.041 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.041 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.041 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.041 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.041 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.041 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.041 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.041 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.041 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.041 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.042 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:28.042 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:28.042 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.042 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.042 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.042 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:28.042 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.042 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.042 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.042 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.042 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.042 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.043 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.043 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.043 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.043 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.043 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.043 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.043 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.043 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.043 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:28.043 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:28.043 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.044 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.044 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.044 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.044 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.044 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.044 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.044 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.044 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.044 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.044 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.044 INFO:teuthology.orchestra.run.smithi007.stdout: "password": { 2024-09-19T04:26:28.045 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "password", 2024-09-19T04:26:28.045 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.045 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.045 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.045 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.045 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.045 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.045 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.045 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "password of InfluxDB server user", 2024-09-19T04:26:28.045 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.045 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.045 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.046 INFO:teuthology.orchestra.run.smithi007.stdout: "port": { 2024-09-19T04:26:28.046 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "port", 2024-09-19T04:26:28.046 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:28.046 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.046 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.046 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8086", 2024-09-19T04:26:28.046 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.046 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.046 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.046 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server port", 2024-09-19T04:26:28.046 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.046 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.047 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.047 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-19T04:26:28.047 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-19T04:26:28.047 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.047 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.047 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.047 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "false", 2024-09-19T04:26:28.047 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.047 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.047 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.047 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T04:26:28.048 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.048 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.048 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.048 INFO:teuthology.orchestra.run.smithi007.stdout: "threads": { 2024-09-19T04:26:28.048 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threads", 2024-09-19T04:26:28.048 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:28.048 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.048 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.048 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T04:26:28.048 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-19T04:26:28.048 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "32", 2024-09-19T04:26:28.048 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.049 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T04:26:28.049 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.049 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.049 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.049 INFO:teuthology.orchestra.run.smithi007.stdout: "username": { 2024-09-19T04:26:28.049 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "username", 2024-09-19T04:26:28.049 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.049 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.049 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.049 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.049 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.050 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.050 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.050 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "username of InfluxDB server user", 2024-09-19T04:26:28.050 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.050 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.050 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.050 INFO:teuthology.orchestra.run.smithi007.stdout: "verify_ssl": { 2024-09-19T04:26:28.050 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "verify_ssl", 2024-09-19T04:26:28.050 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.050 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.050 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.051 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "true", 2024-09-19T04:26:28.051 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.051 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.051 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.051 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T04:26:28.051 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.051 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.051 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.051 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.051 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.051 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.051 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "insights", 2024-09-19T04:26:28.051 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:28.052 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:28.052 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:28.052 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:28.052 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:28.052 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.052 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.052 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.052 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.052 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.052 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.052 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.052 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.053 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.053 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.053 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.053 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.053 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.053 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.053 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.053 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.053 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.053 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.053 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:28.053 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:28.054 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.054 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.054 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.054 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.054 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.054 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.054 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.054 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.054 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.054 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.054 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.055 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:28.055 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:28.055 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.055 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.055 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.055 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:28.055 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.055 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.055 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.055 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.055 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.055 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.055 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.055 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.055 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.056 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.056 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.056 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.056 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.056 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.056 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:28.056 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:28.056 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.056 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.056 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.056 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.057 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.057 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.057 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.057 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.057 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.057 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.057 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.057 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.057 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.057 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.057 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.057 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "iostat", 2024-09-19T04:26:28.057 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:28.058 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:28.058 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:28.058 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:28.058 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:28.058 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.058 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.058 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.058 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.058 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.058 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.058 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.058 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.058 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.059 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.059 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.059 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.059 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.059 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.059 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.059 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.059 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.059 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.059 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:28.059 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:28.059 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.060 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.060 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.060 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.060 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.060 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.060 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.060 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.060 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.060 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.060 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.060 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:28.060 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:28.061 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.061 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.061 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.061 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:28.061 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.061 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.061 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.061 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.061 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.061 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.061 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.061 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.061 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.062 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.062 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.062 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.062 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.062 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.062 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:28.062 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:28.062 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.062 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.062 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.062 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.062 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.063 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.063 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.063 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.063 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.063 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.063 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.063 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.063 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.063 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "k8sevents", 2024-09-19T04:26:28.063 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:28.063 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:28.063 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:28.064 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_event_retention_days": { 2024-09-19T04:26:28.064 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ceph_event_retention_days", 2024-09-19T04:26:28.064 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:28.064 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.064 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.064 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7", 2024-09-19T04:26:28.064 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.064 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.064 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.064 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T04:26:28.064 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.064 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.065 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.065 INFO:teuthology.orchestra.run.smithi007.stdout: "config_check_secs": { 2024-09-19T04:26:28.065 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_check_secs", 2024-09-19T04:26:28.065 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:28.065 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.065 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.065 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T04:26:28.065 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "10", 2024-09-19T04:26:28.065 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.065 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.065 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T04:26:28.065 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.066 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.066 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.066 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:28.066 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:28.066 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.066 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.066 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.066 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.066 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.066 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.066 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.066 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.067 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.067 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.067 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.067 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.067 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.067 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.067 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.067 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.067 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.067 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.067 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:28.067 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:28.068 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.068 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.068 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.068 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.068 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.068 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.068 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.068 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.068 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.068 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.068 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.068 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.068 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:28.069 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:28.069 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.069 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.069 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.069 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:28.069 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.069 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.069 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.069 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.069 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.069 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.069 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.069 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.070 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.070 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.070 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.070 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.070 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.070 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.070 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:28.070 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:28.070 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.070 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.070 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.071 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.071 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.071 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.071 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.071 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.071 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.071 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.071 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.071 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.071 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.072 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "localpool", 2024-09-19T04:26:28.072 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:28.072 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:28.072 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:28.072 INFO:teuthology.orchestra.run.smithi007.stdout: "failure_domain": { 2024-09-19T04:26:28.072 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "failure_domain", 2024-09-19T04:26:28.072 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.072 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.072 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.072 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "host", 2024-09-19T04:26:28.072 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.072 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.072 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.073 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "failure domain for any created local pool", 2024-09-19T04:26:28.073 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T04:26:28.073 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.073 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.073 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:28.073 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:28.073 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.073 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.073 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.073 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.073 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.074 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.074 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.074 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.074 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.074 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.074 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.074 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.074 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.074 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.074 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.074 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.074 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.074 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.075 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:28.075 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:28.075 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.075 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.075 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.075 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.075 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.075 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.075 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.075 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.075 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.075 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.075 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.076 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:28.076 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:28.076 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.076 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.076 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.076 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:28.076 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.076 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.076 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.076 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.076 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.076 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.077 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.077 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.077 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.077 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.077 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.077 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.077 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.077 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.077 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:28.077 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:28.077 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.078 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.078 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.078 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.078 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.078 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.078 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.078 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.078 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.078 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.078 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.078 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": { 2024-09-19T04:26:28.078 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_size", 2024-09-19T04:26:28.079 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:28.079 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.079 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.079 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.079 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.079 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.079 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.079 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default min_size for any created local pool", 2024-09-19T04:26:28.079 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T04:26:28.079 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.079 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.079 INFO:teuthology.orchestra.run.smithi007.stdout: "num_rep": { 2024-09-19T04:26:28.080 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "num_rep", 2024-09-19T04:26:28.080 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:28.080 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.080 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.080 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3", 2024-09-19T04:26:28.080 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.080 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.080 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.080 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default replica count for any created local pool", 2024-09-19T04:26:28.080 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.080 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.080 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.081 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": { 2024-09-19T04:26:28.081 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_num", 2024-09-19T04:26:28.081 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:28.081 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.081 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.081 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "128", 2024-09-19T04:26:28.081 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.081 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.081 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.081 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T04:26:28.081 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.081 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.082 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.082 INFO:teuthology.orchestra.run.smithi007.stdout: "prefix": { 2024-09-19T04:26:28.082 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prefix", 2024-09-19T04:26:28.082 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.082 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.082 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.082 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.082 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.082 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.082 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.082 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name prefix for any created local pool", 2024-09-19T04:26:28.082 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.083 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.083 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.083 INFO:teuthology.orchestra.run.smithi007.stdout: "subtree": { 2024-09-19T04:26:28.083 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "subtree", 2024-09-19T04:26:28.083 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.083 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.083 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.083 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "rack", 2024-09-19T04:26:28.083 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.083 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.083 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.083 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T04:26:28.084 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T04:26:28.084 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.084 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.084 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.084 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.084 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.084 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mds_autoscaler", 2024-09-19T04:26:28.084 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:28.084 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:28.084 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:28.084 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:28.085 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:28.085 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.085 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.085 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.085 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.085 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.085 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.085 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.085 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.085 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.085 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.085 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.085 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.086 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.086 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.086 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.086 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.086 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.086 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.086 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:28.086 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:28.086 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.086 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.086 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.086 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.087 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.087 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.087 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.087 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.087 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.087 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.087 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.087 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:28.087 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:28.087 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.087 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.087 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.087 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:28.088 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.088 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.088 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.088 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.088 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.088 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.088 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.088 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.088 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.088 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.088 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.088 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.089 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.089 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.089 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.089 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:28.089 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:28.089 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.089 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.089 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.089 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.089 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.089 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.089 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.089 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.089 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.090 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.090 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.090 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.090 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.090 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.090 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.090 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirroring", 2024-09-19T04:26:28.090 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:28.090 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:28.090 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:28.090 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:28.090 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:28.090 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.091 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.091 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.091 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.091 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.091 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.091 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.091 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.091 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.091 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.091 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.091 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.091 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.091 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.092 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.092 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.092 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.092 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.092 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.092 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:28.092 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:28.092 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.092 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.092 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.092 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.092 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.092 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.093 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.093 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.093 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.093 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.093 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.093 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:28.093 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:28.093 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.093 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.093 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.093 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:28.093 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.094 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.094 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.094 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.094 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.094 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.094 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.094 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.094 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.094 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.094 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.094 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.094 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.094 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.095 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:28.095 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:28.095 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.095 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.095 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.095 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.095 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.095 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.095 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.095 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.095 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.095 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.096 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.096 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.096 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.096 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.096 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "nfs", 2024-09-19T04:26:28.096 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:28.096 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:28.096 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:28.096 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:28.096 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:28.096 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.096 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.097 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.097 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.097 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.097 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.097 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.097 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.097 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.097 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.097 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.097 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.097 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.097 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.097 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.098 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.098 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.098 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.098 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:28.098 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:28.098 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.098 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.098 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.098 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.098 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.098 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.098 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.099 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.099 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.099 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.099 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.099 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:28.099 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:28.099 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.099 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.099 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.099 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:28.099 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.099 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.100 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.100 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.100 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.100 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.100 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.100 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.100 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.100 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.100 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.100 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.100 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.100 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.101 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:28.101 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:28.101 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.101 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.101 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.101 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.101 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.101 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.101 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.101 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.101 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.101 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.101 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.102 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.102 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.102 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.102 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-19T04:26:28.102 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:28.102 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:28.102 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:28.102 INFO:teuthology.orchestra.run.smithi007.stdout: "fail_fs": { 2024-09-19T04:26:28.102 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "fail_fs", 2024-09-19T04:26:28.102 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.102 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.102 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.103 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.103 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.103 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.103 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.103 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T04:26:28.103 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.103 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.103 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.103 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:28.103 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:28.103 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.103 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.104 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.104 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.104 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.104 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.104 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.104 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.104 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.104 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.104 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.104 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.104 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.104 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.105 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.105 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.105 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.105 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.105 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:28.105 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:28.105 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.105 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.105 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.105 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.105 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.105 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.105 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.106 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.106 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.106 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.106 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.106 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:28.106 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:28.106 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.106 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.106 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.106 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:28.106 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.106 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.107 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.107 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.107 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.107 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.107 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.107 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.107 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.107 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.107 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.107 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.107 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.107 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.108 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:28.108 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:28.108 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.108 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.108 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.108 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.108 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.108 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.108 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.108 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.108 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.108 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.109 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.109 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator": { 2024-09-19T04:26:28.109 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-19T04:26:28.109 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.109 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.109 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.109 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.109 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.109 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.109 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.109 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm", 2024-09-19T04:26:28.109 INFO:teuthology.orchestra.run.smithi007.stdout: "rook", 2024-09-19T04:26:28.110 INFO:teuthology.orchestra.run.smithi007.stdout: "test_orchestrator" 2024-09-19T04:26:28.110 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.110 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Orchestrator backend", 2024-09-19T04:26:28.110 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.110 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.110 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.110 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.110 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.110 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.110 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_perf_query", 2024-09-19T04:26:28.110 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:28.111 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:28.111 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:28.111 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:28.111 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:28.111 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.111 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.111 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.111 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.111 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.111 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.111 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.111 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.111 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.111 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.112 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.112 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.112 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.112 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.112 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.112 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.112 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.112 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.112 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:28.112 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:28.112 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.113 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.113 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.113 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.113 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.113 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.113 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.113 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.113 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.113 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.113 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.113 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:28.114 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:28.114 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.114 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.114 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.114 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:28.114 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.114 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.114 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.114 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.114 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.114 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.114 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.114 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.114 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.115 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.115 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.115 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.115 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.115 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.115 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.115 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:28.115 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:28.115 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.115 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.115 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.115 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.115 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.115 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.116 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.116 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.116 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.116 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.116 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.116 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.116 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.116 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.116 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_support", 2024-09-19T04:26:28.116 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:28.116 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:28.116 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:28.117 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:28.117 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:28.117 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.117 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.117 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.117 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.117 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.117 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.117 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.117 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.117 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.117 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.117 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.118 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.118 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.118 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.118 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.118 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.118 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.118 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.118 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:28.118 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:28.118 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.118 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.118 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.119 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.119 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.119 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.119 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.119 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.119 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.119 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.119 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.119 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:28.119 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:28.119 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.119 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.119 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.120 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:28.120 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.120 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.120 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.120 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.120 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.120 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.120 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.120 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.120 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.120 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.120 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.121 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.121 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.121 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.121 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.121 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:28.121 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:28.121 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.121 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.121 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.121 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.121 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.121 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.122 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.122 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.122 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.122 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.122 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.122 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.122 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.122 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.122 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_autoscaler", 2024-09-19T04:26:28.122 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:28.122 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:28.122 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:28.122 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:28.123 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:28.123 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.123 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.123 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.123 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.123 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.123 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.123 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.123 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.123 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.123 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.123 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.123 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.124 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.124 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.124 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.124 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.124 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.124 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.124 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:28.124 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:28.124 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.124 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.124 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.125 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.125 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.125 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.125 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.125 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.125 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.125 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.125 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.125 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:28.125 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:28.125 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.126 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.126 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.126 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:28.126 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.126 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.126 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.126 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.126 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.126 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.126 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.126 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.126 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.127 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.127 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.127 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.127 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.127 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.127 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:28.127 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:28.127 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.127 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.127 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.127 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.127 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.128 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.128 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.128 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.128 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.128 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.128 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.128 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T04:26:28.128 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T04:26:28.128 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:28.128 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.128 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.128 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T04:26:28.129 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.129 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.129 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.129 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.129 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.129 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.129 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.129 INFO:teuthology.orchestra.run.smithi007.stdout: "threshold": { 2024-09-19T04:26:28.129 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threshold", 2024-09-19T04:26:28.129 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T04:26:28.129 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.130 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.130 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-19T04:26:28.130 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1.0", 2024-09-19T04:26:28.130 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.130 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.130 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "scaling threshold", 2024-09-19T04:26:28.130 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T04:26:28.130 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.130 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.130 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.130 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.130 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "progress", 2024-09-19T04:26:28.131 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:28.131 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:28.131 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:28.131 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_pg_recovery_event": { 2024-09-19T04:26:28.131 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_pg_recovery_event", 2024-09-19T04:26:28.131 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.131 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.131 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.131 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.131 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.131 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.131 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.132 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T04:26:28.132 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.132 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.132 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.132 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-19T04:26:28.132 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-19T04:26:28.132 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.132 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.132 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.132 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:28.132 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.132 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.133 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.133 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.133 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.133 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.133 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.133 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:28.133 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:28.133 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.133 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.133 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.133 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.133 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.134 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.134 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.134 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.134 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.134 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.134 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.134 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.134 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.134 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.134 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.134 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.134 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.134 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.135 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:28.135 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:28.135 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.135 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.135 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.135 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.135 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.135 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.135 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.135 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.135 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.135 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.136 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.136 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:28.136 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:28.136 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.136 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.136 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.136 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:28.136 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.136 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.136 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.136 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.136 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.137 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.137 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.137 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.137 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.137 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.137 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.137 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.137 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.137 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.137 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:28.137 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:28.137 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.138 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.138 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.138 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.138 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.138 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.138 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.138 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.138 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.138 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.138 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.138 INFO:teuthology.orchestra.run.smithi007.stdout: "max_completed_events": { 2024-09-19T04:26:28.139 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_completed_events", 2024-09-19T04:26:28.139 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:28.139 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.139 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.139 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "50", 2024-09-19T04:26:28.139 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.139 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.139 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.139 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "number of past completed events to remember", 2024-09-19T04:26:28.139 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.139 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.139 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.140 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-19T04:26:28.140 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-19T04:26:28.140 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:28.140 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.140 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.140 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T04:26:28.140 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.140 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.140 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.140 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long the module is going to sleep", 2024-09-19T04:26:28.140 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.140 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.141 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.141 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.141 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.141 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.141 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus", 2024-09-19T04:26:28.141 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:28.141 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:28.141 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:28.141 INFO:teuthology.orchestra.run.smithi007.stdout: "cache": { 2024-09-19T04:26:28.141 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cache", 2024-09-19T04:26:28.141 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.142 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.142 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.142 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:28.142 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.142 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.142 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.142 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.142 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.142 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.142 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.142 INFO:teuthology.orchestra.run.smithi007.stdout: "exclude_perf_counters": { 2024-09-19T04:26:28.142 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "exclude_perf_counters", 2024-09-19T04:26:28.143 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.143 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.143 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.143 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:28.143 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.143 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.143 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.143 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T04:26:28.143 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T04:26:28.143 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.143 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.143 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:28.143 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:28.144 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.144 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.144 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.144 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.144 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.144 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.144 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.144 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.144 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.144 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.144 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.144 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.144 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.145 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.145 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.145 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.145 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.145 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.145 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.145 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:28.145 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:28.145 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.145 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.145 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.145 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.145 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.146 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.146 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.146 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.146 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.146 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.146 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.146 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:28.146 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:28.146 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.146 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.146 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.147 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:28.147 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.147 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.147 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.147 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.147 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.147 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.147 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.147 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.147 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.147 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.147 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.147 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.147 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.148 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.148 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:28.148 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:28.148 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.148 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.148 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.148 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.148 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.148 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.148 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.148 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.148 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.149 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.149 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.149 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools": { 2024-09-19T04:26:28.149 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools", 2024-09-19T04:26:28.149 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.149 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.149 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.149 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.149 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.149 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.149 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.149 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.150 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.150 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.150 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.150 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T04:26:28.150 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T04:26:28.150 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:28.150 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.150 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.150 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "300", 2024-09-19T04:26:28.150 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.150 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.150 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.150 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.150 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.151 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.151 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.151 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.151 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_interval": { 2024-09-19T04:26:28.151 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_interval", 2024-09-19T04:26:28.151 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T04:26:28.151 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.151 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.151 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15.0", 2024-09-19T04:26:28.151 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.151 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.151 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.151 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.152 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.152 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.152 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.152 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-19T04:26:28.152 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-19T04:26:28.152 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.152 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.152 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.152 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-19T04:26:28.152 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.152 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.152 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.153 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T04:26:28.153 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.153 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.153 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.153 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-19T04:26:28.153 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-19T04:26:28.153 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:28.153 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.153 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.153 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "9283", 2024-09-19T04:26:28.153 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.153 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.154 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.154 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T04:26:28.154 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.154 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.154 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.154 INFO:teuthology.orchestra.run.smithi007.stdout: "stale_cache_strategy": { 2024-09-19T04:26:28.154 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stale_cache_strategy", 2024-09-19T04:26:28.154 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.154 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.154 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.154 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "log", 2024-09-19T04:26:28.154 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.155 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.155 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.155 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.155 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.155 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.155 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.155 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-19T04:26:28.155 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-19T04:26:28.155 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.155 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.155 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.156 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "default", 2024-09-19T04:26:28.156 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.156 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.156 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.156 INFO:teuthology.orchestra.run.smithi007.stdout: "default", 2024-09-19T04:26:28.156 INFO:teuthology.orchestra.run.smithi007.stdout: "error" 2024-09-19T04:26:28.156 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.156 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.156 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.156 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.156 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.156 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.157 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-19T04:26:28.157 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-19T04:26:28.157 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:28.157 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.157 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.157 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-19T04:26:28.157 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-19T04:26:28.157 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-19T04:26:28.157 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.157 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.157 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.157 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.157 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.158 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.158 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.158 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.158 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_support", 2024-09-19T04:26:28.158 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:28.158 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:28.158 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:28.158 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:28.158 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:28.158 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.158 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.158 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.159 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.159 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.159 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.159 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.159 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.159 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.159 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.159 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.159 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.159 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.159 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.159 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.159 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.160 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.160 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.160 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:28.160 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:28.160 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.160 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.160 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.160 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.160 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.160 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.160 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.160 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.161 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.161 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.161 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.161 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:28.161 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:28.161 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.161 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.161 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.161 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:28.161 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.161 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.162 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.162 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.162 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.162 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.162 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.162 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.162 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.162 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.162 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.162 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.162 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.162 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.162 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.162 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:28.163 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:28.163 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.163 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.163 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.163 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.163 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.163 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.163 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.163 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.163 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.163 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.163 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.164 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_snap_create": { 2024-09-19T04:26:28.164 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_snap_create", 2024-09-19T04:26:28.164 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:28.164 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.164 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.164 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-19T04:26:28.164 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.164 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.164 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.164 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.164 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.164 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.164 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.165 INFO:teuthology.orchestra.run.smithi007.stdout: "mirror_snapshot_schedule": { 2024-09-19T04:26:28.165 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T04:26:28.165 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.165 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.165 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.165 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.165 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.165 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.165 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.165 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.165 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.165 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.166 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.166 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.166 INFO:teuthology.orchestra.run.smithi007.stdout: "trash_purge_schedule": { 2024-09-19T04:26:28.166 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "trash_purge_schedule", 2024-09-19T04:26:28.166 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.166 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.166 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.166 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.166 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.166 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.166 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.166 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.166 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.166 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.167 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.167 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.167 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.167 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.167 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.167 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "restful", 2024-09-19T04:26:28.167 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:28.167 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:28.167 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:28.167 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_auth": { 2024-09-19T04:26:28.167 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_auth", 2024-09-19T04:26:28.167 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.168 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.168 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.168 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:28.168 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.168 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.168 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.168 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.168 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.168 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.168 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.168 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-19T04:26:28.168 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-19T04:26:28.168 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.169 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.169 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.169 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.169 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.169 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.169 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.169 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.169 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.169 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.169 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.169 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:28.169 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:28.170 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.170 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.170 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.170 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.170 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.170 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.170 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.170 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.170 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.170 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.170 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.170 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.170 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.171 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.171 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.171 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.171 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.171 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.171 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:28.171 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:28.171 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.171 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.171 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.171 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.171 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.172 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.172 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.172 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.172 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.172 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.172 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.172 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:28.172 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:28.172 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.172 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.172 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.173 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:28.173 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.173 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.173 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.173 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.173 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.173 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.173 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.173 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.173 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.173 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.173 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.173 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.173 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.174 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.174 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:28.174 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:28.174 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.174 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.174 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.174 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.174 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.174 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.174 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.174 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.174 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.175 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.175 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.175 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-19T04:26:28.175 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-19T04:26:28.175 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.175 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.175 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.175 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.175 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.175 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.175 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.175 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.176 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.176 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.176 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.176 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-19T04:26:28.176 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-19T04:26:28.176 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.176 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.176 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.176 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.176 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.176 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.177 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.177 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.177 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.177 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.177 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.177 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.177 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.177 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rgw", 2024-09-19T04:26:28.177 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:28.177 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:28.177 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:28.177 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:28.178 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:28.178 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.178 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.178 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.178 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.178 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.178 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.178 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.178 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.178 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.178 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.178 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.178 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.178 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.178 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.179 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.180 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.180 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.180 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.180 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:28.180 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:28.180 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.180 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.180 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.180 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:28.180 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.180 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.180 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.181 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.181 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.181 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.181 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.181 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.181 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.181 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.181 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.181 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.181 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.181 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.182 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:28.182 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:28.182 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.182 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.182 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.182 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.182 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.182 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.182 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.182 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.182 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.182 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.182 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.183 INFO:teuthology.orchestra.run.smithi007.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T04:26:28.183 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T04:26:28.183 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:28.183 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.183 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.183 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-19T04:26:28.183 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.183 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.183 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.183 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T04:26:28.183 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.183 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.184 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.184 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.184 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.184 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rook", 2024-09-19T04:26:28.184 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:28.184 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:28.184 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:28.184 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:28.184 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:28.184 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.184 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.185 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.185 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.185 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.185 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.185 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.185 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.185 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.185 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.185 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.185 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.185 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.185 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.185 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.185 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.186 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.186 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.186 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:28.186 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:28.186 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.186 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.186 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.186 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.186 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.186 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.186 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.186 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.186 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.187 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.187 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.187 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:28.187 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:28.187 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.187 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.187 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.187 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:28.187 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.187 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.187 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.187 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.188 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.188 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.188 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.188 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.188 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.188 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.188 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.188 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.188 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.188 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.188 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:28.188 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:28.189 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.189 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.189 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.189 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.189 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.189 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.189 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.189 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.189 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.189 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.189 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.189 INFO:teuthology.orchestra.run.smithi007.stdout: "storage_class": { 2024-09-19T04:26:28.190 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "storage_class", 2024-09-19T04:26:28.190 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.190 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.190 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.190 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "local", 2024-09-19T04:26:28.190 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.190 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.190 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.190 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T04:26:28.190 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.190 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.190 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.190 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.190 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.191 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.191 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "selftest", 2024-09-19T04:26:28.191 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:28.191 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:28.191 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:28.191 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:28.191 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:28.191 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.191 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.191 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.191 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.191 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.191 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.192 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.192 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.192 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.192 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.192 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.192 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.192 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.192 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.192 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.192 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.192 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.192 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.193 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:28.193 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:28.193 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.193 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.193 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.193 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.193 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.193 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.193 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.193 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.193 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.193 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.193 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.194 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:28.194 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:28.194 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.194 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.194 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.194 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:28.194 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.194 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.194 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.194 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.194 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.194 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.195 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.195 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.195 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.195 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.195 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.195 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.195 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.195 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.195 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:28.195 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:28.195 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.195 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.196 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.196 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.196 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.196 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.196 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.196 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.196 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.196 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.196 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.196 INFO:teuthology.orchestra.run.smithi007.stdout: "roption1": { 2024-09-19T04:26:28.196 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption1", 2024-09-19T04:26:28.196 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.197 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.197 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.197 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.197 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.197 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.197 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.197 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.197 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.197 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.197 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.197 INFO:teuthology.orchestra.run.smithi007.stdout: "roption2": { 2024-09-19T04:26:28.198 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption2", 2024-09-19T04:26:28.198 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.198 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.198 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.198 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "xyz", 2024-09-19T04:26:28.198 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.198 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.198 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.198 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.198 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.198 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.198 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.199 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption1": { 2024-09-19T04:26:28.199 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption1", 2024-09-19T04:26:28.199 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.199 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.199 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.199 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.199 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.199 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.199 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.199 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.199 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.199 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.200 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.200 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption2": { 2024-09-19T04:26:28.200 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption2", 2024-09-19T04:26:28.200 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:28.200 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.200 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.200 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.200 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.200 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.200 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.200 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.200 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.200 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.201 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.201 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption3": { 2024-09-19T04:26:28.201 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption3", 2024-09-19T04:26:28.201 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-19T04:26:28.201 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.201 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.201 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.201 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.201 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.201 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.201 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.202 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.202 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.202 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.202 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption4": { 2024-09-19T04:26:28.202 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption4", 2024-09-19T04:26:28.202 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.202 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.202 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.202 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.202 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.202 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.202 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.203 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.203 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.203 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.203 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.203 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption5": { 2024-09-19T04:26:28.203 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption5", 2024-09-19T04:26:28.203 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.203 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.203 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.203 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.203 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.203 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.203 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.204 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.204 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.204 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.204 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.204 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption6": { 2024-09-19T04:26:28.204 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption6", 2024-09-19T04:26:28.204 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.204 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.204 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.204 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:28.204 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.205 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.205 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.205 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.205 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.205 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.205 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.205 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption7": { 2024-09-19T04:26:28.205 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption7", 2024-09-19T04:26:28.205 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:28.205 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.205 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.205 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.206 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-19T04:26:28.206 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "42", 2024-09-19T04:26:28.206 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.206 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.206 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.206 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.206 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.206 INFO:teuthology.orchestra.run.smithi007.stdout: "testkey": { 2024-09-19T04:26:28.206 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testkey", 2024-09-19T04:26:28.206 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.206 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.206 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.207 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.207 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.207 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.207 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.207 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.207 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.207 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.207 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.207 INFO:teuthology.orchestra.run.smithi007.stdout: "testlkey": { 2024-09-19T04:26:28.207 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testlkey", 2024-09-19T04:26:28.207 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.207 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.207 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.208 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.208 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.208 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.208 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.208 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.208 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.208 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.208 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.208 INFO:teuthology.orchestra.run.smithi007.stdout: "testnewline": { 2024-09-19T04:26:28.208 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testnewline", 2024-09-19T04:26:28.208 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.209 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.209 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.209 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.209 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.209 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.209 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.209 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.209 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.209 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.209 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.209 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.209 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.210 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snap_schedule", 2024-09-19T04:26:28.210 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:28.210 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:28.210 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:28.210 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_m_granularity": { 2024-09-19T04:26:28.210 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_m_granularity", 2024-09-19T04:26:28.210 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.210 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.210 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.210 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.211 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.211 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.211 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.211 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T04:26:28.211 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.211 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.211 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.211 INFO:teuthology.orchestra.run.smithi007.stdout: "dump_on_update": { 2024-09-19T04:26:28.211 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dump_on_update", 2024-09-19T04:26:28.211 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.211 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.211 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.211 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.212 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.212 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.212 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.212 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "dump database to debug log on update", 2024-09-19T04:26:28.212 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.212 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.212 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.212 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:28.212 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:28.212 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.212 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.212 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.212 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.213 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.213 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.213 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.213 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.213 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.213 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.213 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.213 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.213 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.213 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.213 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.213 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.213 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.214 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.214 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:28.214 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:28.214 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.214 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.214 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.214 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.214 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.214 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.214 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.214 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.214 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.214 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.215 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.215 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:28.215 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:28.215 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.215 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.215 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.215 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:28.215 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.215 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.215 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.215 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.216 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.216 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.216 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.216 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.216 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.216 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.216 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.216 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.216 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.216 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.216 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:28.217 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:28.217 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.217 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.217 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.217 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.217 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.217 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.217 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.217 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.217 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.217 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.217 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.217 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.218 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.218 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stats", 2024-09-19T04:26:28.218 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:28.218 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:28.218 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:28.218 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:28.218 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:28.218 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.218 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.218 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.218 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.219 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.219 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.219 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.219 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.219 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.219 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.219 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.219 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.219 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.219 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.219 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.219 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.219 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.220 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.220 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:28.220 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:28.220 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.220 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.220 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.220 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.220 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.220 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.220 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.220 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.220 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.221 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.221 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.221 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:28.221 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:28.221 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.221 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.221 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.221 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:28.221 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.221 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.221 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.222 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.222 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.222 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.222 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.222 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.222 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.222 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.222 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.222 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.222 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.222 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.222 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:28.222 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:28.222 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.223 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.223 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.223 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.223 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.223 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.223 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.223 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.223 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.223 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.223 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.223 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.223 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.224 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "status", 2024-09-19T04:26:28.224 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:28.224 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:28.224 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:28.224 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:28.224 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:28.224 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.224 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.224 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.224 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.224 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.224 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.224 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.224 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.225 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.225 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.225 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.225 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.225 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.225 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.225 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.225 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.225 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.225 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.225 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:28.225 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:28.226 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.226 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.226 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.226 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.226 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.226 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.226 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.226 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.226 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.226 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.226 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.226 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:28.227 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:28.227 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.227 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.227 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.227 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:28.227 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.227 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.227 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.227 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.227 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.227 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.227 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.227 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.227 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.228 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.228 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.228 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.228 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.228 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.228 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:28.228 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:28.228 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.228 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.228 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.228 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.228 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.228 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.229 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.229 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.229 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.229 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.229 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.229 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.229 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.229 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telegraf", 2024-09-19T04:26:28.229 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:28.229 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:28.230 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:28.230 INFO:teuthology.orchestra.run.smithi007.stdout: "address": { 2024-09-19T04:26:28.230 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "address", 2024-09-19T04:26:28.230 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.230 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.230 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.230 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T04:26:28.230 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.230 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.230 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.230 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.230 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.230 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.231 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.231 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T04:26:28.231 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T04:26:28.231 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:28.231 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.231 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.231 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15", 2024-09-19T04:26:28.231 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.231 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.231 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.231 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.231 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.231 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.231 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.232 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:28.232 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:28.232 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.232 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.232 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.232 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.232 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.232 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.232 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.232 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.232 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.232 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.232 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.233 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.233 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.233 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.233 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.233 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.233 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.233 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.233 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:28.233 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:28.233 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.233 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.233 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.234 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.234 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.234 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.234 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.234 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.234 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.234 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.234 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.234 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:28.234 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:28.234 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.234 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.235 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.235 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:28.235 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.235 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.235 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.235 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.235 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.235 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.235 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.235 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.235 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.235 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.235 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.235 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.236 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.236 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.236 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:28.236 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:28.236 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.236 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.236 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.236 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.236 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.236 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.236 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.236 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.237 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.237 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.237 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.237 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.237 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.237 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telemetry", 2024-09-19T04:26:28.237 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:28.237 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:28.237 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:28.237 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_basic": { 2024-09-19T04:26:28.237 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_basic", 2024-09-19T04:26:28.238 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.238 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.238 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.238 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:28.238 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.238 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.238 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.238 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T04:26:28.238 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.238 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.238 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.238 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_crash": { 2024-09-19T04:26:28.238 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_crash", 2024-09-19T04:26:28.238 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.239 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.239 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.239 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:28.239 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.239 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.239 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.239 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T04:26:28.239 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.239 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.239 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.239 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_device": { 2024-09-19T04:26:28.239 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_device", 2024-09-19T04:26:28.240 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.240 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.240 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.240 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:28.240 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.240 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.240 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.240 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T04:26:28.240 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.240 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.240 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.240 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_ident": { 2024-09-19T04:26:28.240 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_ident", 2024-09-19T04:26:28.241 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.241 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.241 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.241 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.241 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.241 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.241 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.241 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T04:26:28.241 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.241 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.241 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.241 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_perf": { 2024-09-19T04:26:28.242 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_perf", 2024-09-19T04:26:28.242 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.242 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.242 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.242 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.242 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.242 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.242 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.242 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T04:26:28.242 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.242 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.242 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.243 INFO:teuthology.orchestra.run.smithi007.stdout: "contact": { 2024-09-19T04:26:28.243 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "contact", 2024-09-19T04:26:28.243 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.243 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.243 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.243 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.243 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.243 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.243 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.243 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.243 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.243 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.244 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.244 INFO:teuthology.orchestra.run.smithi007.stdout: "description": { 2024-09-19T04:26:28.244 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "description", 2024-09-19T04:26:28.244 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.244 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.244 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.244 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.244 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.244 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.244 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.244 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.245 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.245 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.245 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.245 INFO:teuthology.orchestra.run.smithi007.stdout: "device_url": { 2024-09-19T04:26:28.245 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_url", 2024-09-19T04:26:28.245 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.245 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.245 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.245 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T04:26:28.245 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.245 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.245 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.246 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.246 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.246 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.246 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.246 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-19T04:26:28.246 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-19T04:26:28.246 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.246 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.246 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.246 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.246 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.246 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.247 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.247 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.247 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.247 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.247 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.247 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T04:26:28.247 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T04:26:28.247 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:28.247 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.247 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.247 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "24", 2024-09-19T04:26:28.247 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "8", 2024-09-19T04:26:28.248 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.248 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.248 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.248 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.248 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.248 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.248 INFO:teuthology.orchestra.run.smithi007.stdout: "last_opt_revision": { 2024-09-19T04:26:28.248 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "last_opt_revision", 2024-09-19T04:26:28.248 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:28.248 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.248 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.249 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1", 2024-09-19T04:26:28.249 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.249 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.249 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.249 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.249 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.249 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.249 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.249 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard": { 2024-09-19T04:26:28.249 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard", 2024-09-19T04:26:28.249 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.250 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.250 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.250 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.250 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.250 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.250 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.250 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.250 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.250 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.250 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.250 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard_description": { 2024-09-19T04:26:28.250 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard_description", 2024-09-19T04:26:28.251 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.251 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.251 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.251 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.251 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.251 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.251 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.251 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.251 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.251 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.251 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.252 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:28.252 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:28.252 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.252 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.252 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.252 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.252 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.252 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.252 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.252 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.252 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.252 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.252 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.253 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.253 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.253 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.253 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.253 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.253 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.253 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.253 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:28.253 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:28.253 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.253 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.253 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.254 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.254 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.254 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.254 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.254 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.254 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.254 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.254 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.254 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:28.254 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:28.254 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.254 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.255 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.255 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:28.255 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.255 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.255 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.255 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.255 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.255 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.255 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.255 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.255 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.255 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.255 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.256 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.256 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.256 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.256 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:28.256 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:28.256 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.256 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.256 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.256 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.256 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.256 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.256 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.257 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.257 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.257 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.257 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.257 INFO:teuthology.orchestra.run.smithi007.stdout: "organization": { 2024-09-19T04:26:28.257 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "organization", 2024-09-19T04:26:28.257 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.257 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.257 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.257 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.257 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.257 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.258 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.258 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.258 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.258 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.258 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.258 INFO:teuthology.orchestra.run.smithi007.stdout: "proxy": { 2024-09-19T04:26:28.258 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "proxy", 2024-09-19T04:26:28.258 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.258 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.258 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.258 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.258 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.259 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.259 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.259 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.259 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.259 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.259 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.259 INFO:teuthology.orchestra.run.smithi007.stdout: "url": { 2024-09-19T04:26:28.259 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url", 2024-09-19T04:26:28.259 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.259 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.259 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.259 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T04:26:28.259 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.260 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.260 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.260 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.260 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.260 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.260 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.260 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.260 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.260 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "test_orchestrator", 2024-09-19T04:26:28.260 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:28.260 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:28.261 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:28.261 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:28.261 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:28.261 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.261 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.261 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.261 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.261 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.261 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.261 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.261 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.261 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.261 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.262 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.262 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.262 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.262 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.262 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.262 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.262 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.262 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.262 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:28.262 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:28.262 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.263 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.263 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.263 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.263 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.263 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.263 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.263 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.263 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.263 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.263 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.263 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:28.263 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:28.264 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.264 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.264 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.264 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:28.264 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.264 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.264 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.264 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.264 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.264 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.264 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.264 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.264 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.265 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.265 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.265 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.265 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.265 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.265 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:28.265 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:28.265 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.265 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.265 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.265 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.266 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.266 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.266 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.266 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.266 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.266 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.266 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.266 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.266 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.266 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volumes", 2024-09-19T04:26:28.266 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:28.267 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:28.267 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:28.267 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:28.267 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:28.267 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.267 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.267 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.267 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.267 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.267 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.267 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.267 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.267 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.268 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.268 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.268 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.268 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.268 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.268 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.268 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.268 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.268 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.268 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:28.268 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:28.269 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.269 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.269 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.269 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.269 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.269 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.269 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.269 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.269 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.269 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.269 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.269 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:28.270 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:28.270 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.270 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.270 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.270 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:28.270 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.270 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.270 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.270 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.270 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.270 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.270 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.270 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.270 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.271 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.271 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.271 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.271 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.271 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.271 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:28.271 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:28.271 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.271 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.271 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.271 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.271 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.271 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.272 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.272 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.272 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.272 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.272 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.272 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_clones": { 2024-09-19T04:26:28.272 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_clones", 2024-09-19T04:26:28.272 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:28.272 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.272 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.272 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4", 2024-09-19T04:26:28.272 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.273 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.273 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.273 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T04:26:28.273 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.273 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.273 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.273 INFO:teuthology.orchestra.run.smithi007.stdout: "periodic_async_work": { 2024-09-19T04:26:28.273 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "periodic_async_work", 2024-09-19T04:26:28.273 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.273 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.273 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.274 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.274 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.274 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.274 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.274 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Periodically check for async work", 2024-09-19T04:26:28.274 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.274 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.274 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.274 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_delay": { 2024-09-19T04:26:28.274 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_delay", 2024-09-19T04:26:28.274 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:28.274 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.275 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.275 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-19T04:26:28.275 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.275 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.275 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.275 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T04:26:28.275 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.275 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.275 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.275 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_no_wait": { 2024-09-19T04:26:28.275 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T04:26:28.275 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.276 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.276 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.276 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-19T04:26:28.276 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.276 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.276 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.276 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T04:26:28.276 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.276 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.276 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.276 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.276 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.277 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix", 2024-09-19T04:26:28.277 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-19T04:26:28.277 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-19T04:26:28.277 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-19T04:26:28.277 INFO:teuthology.orchestra.run.smithi007.stdout: "discovery_interval": { 2024-09-19T04:26:28.277 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "discovery_interval", 2024-09-19T04:26:28.277 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-19T04:26:28.277 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.277 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.277 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "100", 2024-09-19T04:26:28.277 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.277 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.278 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.278 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.278 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.278 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.278 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.278 INFO:teuthology.orchestra.run.smithi007.stdout: "identifier": { 2024-09-19T04:26:28.278 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "identifier", 2024-09-19T04:26:28.278 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.278 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.278 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.278 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.278 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.278 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.279 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.279 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.279 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.279 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.279 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.279 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-19T04:26:28.279 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-19T04:26:28.279 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-19T04:26:28.279 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.279 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.279 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-19T04:26:28.279 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.280 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.280 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.280 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.280 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.280 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.280 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.280 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-19T04:26:28.280 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-19T04:26:28.280 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.280 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.280 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.280 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.281 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.281 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.281 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.281 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.281 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.281 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.281 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.281 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.281 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.281 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.281 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.281 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.281 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.282 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.282 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-19T04:26:28.282 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-19T04:26:28.282 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.282 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.282 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.282 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.282 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.282 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.282 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.282 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.282 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.283 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.283 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.283 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-19T04:26:28.283 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-19T04:26:28.283 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.283 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.283 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.283 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-19T04:26:28.283 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.283 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.283 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-19T04:26:28.283 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-19T04:26:28.284 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-19T04:26:28.284 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-19T04:26:28.284 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-19T04:26:28.284 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-19T04:26:28.284 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-19T04:26:28.284 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.284 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.284 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.284 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.284 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.284 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-19T04:26:28.284 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-19T04:26:28.285 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-19T04:26:28.285 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.285 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-19T04:26:28.285 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-19T04:26:28.285 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.285 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.285 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.285 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.285 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.285 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.285 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.285 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_host": { 2024-09-19T04:26:28.286 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_host", 2024-09-19T04:26:28.286 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.286 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.286 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.286 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-19T04:26:28.286 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.286 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.286 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.286 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.286 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.286 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.286 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.286 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_port": { 2024-09-19T04:26:28.287 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_port", 2024-09-19T04:26:28.287 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-19T04:26:28.287 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.287 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.287 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10051", 2024-09-19T04:26:28.287 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.287 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.287 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.287 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.287 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.287 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.287 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.288 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_sender": { 2024-09-19T04:26:28.288 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_sender", 2024-09-19T04:26:28.288 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-19T04:26:28.288 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-19T04:26:28.288 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-19T04:26:28.288 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T04:26:28.288 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-19T04:26:28.288 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-19T04:26:28.288 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-19T04:26:28.288 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-19T04:26:28.288 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-19T04:26:28.288 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-19T04:26:28.288 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-19T04:26:28.289 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.289 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.289 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.289 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.289 INFO:teuthology.orchestra.run.smithi007.stdout: "services": { 2024-09-19T04:26:28.289 INFO:teuthology.orchestra.run.smithi007.stdout: "dashboard": "https://172.21.15.7:8443/" 2024-09-19T04:26:28.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.289 INFO:teuthology.orchestra.run.smithi007.stdout: "always_on_modules": { 2024-09-19T04:26:28.289 INFO:teuthology.orchestra.run.smithi007.stdout: "octopus": [ 2024-09-19T04:26:28.289 INFO:teuthology.orchestra.run.smithi007.stdout: "balancer", 2024-09-19T04:26:28.289 INFO:teuthology.orchestra.run.smithi007.stdout: "crash", 2024-09-19T04:26:28.289 INFO:teuthology.orchestra.run.smithi007.stdout: "devicehealth", 2024-09-19T04:26:28.289 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator", 2024-09-19T04:26:28.289 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscaler", 2024-09-19T04:26:28.290 INFO:teuthology.orchestra.run.smithi007.stdout: "progress", 2024-09-19T04:26:28.290 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_support", 2024-09-19T04:26:28.290 INFO:teuthology.orchestra.run.smithi007.stdout: "status", 2024-09-19T04:26:28.290 INFO:teuthology.orchestra.run.smithi007.stdout: "telemetry", 2024-09-19T04:26:28.290 INFO:teuthology.orchestra.run.smithi007.stdout: "volumes" 2024-09-19T04:26:28.290 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.290 INFO:teuthology.orchestra.run.smithi007.stdout: "pacific": [ 2024-09-19T04:26:28.290 INFO:teuthology.orchestra.run.smithi007.stdout: "balancer", 2024-09-19T04:26:28.290 INFO:teuthology.orchestra.run.smithi007.stdout: "crash", 2024-09-19T04:26:28.290 INFO:teuthology.orchestra.run.smithi007.stdout: "devicehealth", 2024-09-19T04:26:28.290 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator", 2024-09-19T04:26:28.290 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscaler", 2024-09-19T04:26:28.290 INFO:teuthology.orchestra.run.smithi007.stdout: "progress", 2024-09-19T04:26:28.291 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_support", 2024-09-19T04:26:28.291 INFO:teuthology.orchestra.run.smithi007.stdout: "status", 2024-09-19T04:26:28.291 INFO:teuthology.orchestra.run.smithi007.stdout: "telemetry", 2024-09-19T04:26:28.291 INFO:teuthology.orchestra.run.smithi007.stdout: "volumes" 2024-09-19T04:26:28.291 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.291 INFO:teuthology.orchestra.run.smithi007.stdout: "quincy": [ 2024-09-19T04:26:28.291 INFO:teuthology.orchestra.run.smithi007.stdout: "balancer", 2024-09-19T04:26:28.291 INFO:teuthology.orchestra.run.smithi007.stdout: "crash", 2024-09-19T04:26:28.291 INFO:teuthology.orchestra.run.smithi007.stdout: "devicehealth", 2024-09-19T04:26:28.291 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator", 2024-09-19T04:26:28.291 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscaler", 2024-09-19T04:26:28.291 INFO:teuthology.orchestra.run.smithi007.stdout: "progress", 2024-09-19T04:26:28.291 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_support", 2024-09-19T04:26:28.292 INFO:teuthology.orchestra.run.smithi007.stdout: "status", 2024-09-19T04:26:28.292 INFO:teuthology.orchestra.run.smithi007.stdout: "telemetry", 2024-09-19T04:26:28.292 INFO:teuthology.orchestra.run.smithi007.stdout: "volumes" 2024-09-19T04:26:28.292 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.292 INFO:teuthology.orchestra.run.smithi007.stdout: "reef": [ 2024-09-19T04:26:28.292 INFO:teuthology.orchestra.run.smithi007.stdout: "balancer", 2024-09-19T04:26:28.292 INFO:teuthology.orchestra.run.smithi007.stdout: "crash", 2024-09-19T04:26:28.292 INFO:teuthology.orchestra.run.smithi007.stdout: "devicehealth", 2024-09-19T04:26:28.292 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator", 2024-09-19T04:26:28.292 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscaler", 2024-09-19T04:26:28.292 INFO:teuthology.orchestra.run.smithi007.stdout: "progress", 2024-09-19T04:26:28.292 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_support", 2024-09-19T04:26:28.292 INFO:teuthology.orchestra.run.smithi007.stdout: "status", 2024-09-19T04:26:28.293 INFO:teuthology.orchestra.run.smithi007.stdout: "telemetry", 2024-09-19T04:26:28.293 INFO:teuthology.orchestra.run.smithi007.stdout: "volumes" 2024-09-19T04:26:28.293 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-19T04:26:28.293 INFO:teuthology.orchestra.run.smithi007.stdout: "squid": [ 2024-09-19T04:26:28.293 INFO:teuthology.orchestra.run.smithi007.stdout: "balancer", 2024-09-19T04:26:28.293 INFO:teuthology.orchestra.run.smithi007.stdout: "crash", 2024-09-19T04:26:28.293 INFO:teuthology.orchestra.run.smithi007.stdout: "devicehealth", 2024-09-19T04:26:28.293 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator", 2024-09-19T04:26:28.293 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscaler", 2024-09-19T04:26:28.293 INFO:teuthology.orchestra.run.smithi007.stdout: "progress", 2024-09-19T04:26:28.293 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_support", 2024-09-19T04:26:28.293 INFO:teuthology.orchestra.run.smithi007.stdout: "status", 2024-09-19T04:26:28.293 INFO:teuthology.orchestra.run.smithi007.stdout: "telemetry", 2024-09-19T04:26:28.293 INFO:teuthology.orchestra.run.smithi007.stdout: "volumes" 2024-09-19T04:26:28.294 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-19T04:26:28.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.294 INFO:teuthology.orchestra.run.smithi007.stdout: "last_failure_osd_epoch": 3, 2024-09-19T04:26:28.294 INFO:teuthology.orchestra.run.smithi007.stdout: "active_clients": [ 2024-09-19T04:26:28.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.294 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "devicehealth", 2024-09-19T04:26:28.294 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-19T04:26:28.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.294 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-19T04:26:28.294 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-09-19T04:26:28.294 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3801191595 2024-09-19T04:26:28.294 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.294 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-19T04:26:28.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.295 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "libcephsqlite", 2024-09-19T04:26:28.295 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-19T04:26:28.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.295 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-19T04:26:28.295 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-09-19T04:26:28.295 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3096790698 2024-09-19T04:26:28.295 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.295 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-19T04:26:28.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.295 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_support", 2024-09-19T04:26:28.295 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-19T04:26:28.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.296 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-19T04:26:28.296 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-09-19T04:26:28.296 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2466865693 2024-09-19T04:26:28.296 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.296 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-19T04:26:28.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:28.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.296 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volumes", 2024-09-19T04:26:28.296 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-19T04:26:28.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-19T04:26:28.296 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-19T04:26:28.297 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-09-19T04:26:28.297 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 628032641 2024-09-19T04:26:28.297 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.297 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-19T04:26:28.297 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:28.297 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-19T04:26:28.297 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:26:28.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:26 smithi092 ceph-mon[34940]: pgmap v640: 129 pgs: 129 active+clean; 29 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 939 KiB/s wr, 620 op/s 2024-09-19T04:26:28.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:26 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/356868974' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T04:26:28.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:26 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3011837710' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T04:26:28.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:26 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/131522657' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-19T04:26:28.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:26 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/433176832' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T04:26:28.299 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:26 smithi102 ceph-mon[35446]: pgmap v640: 129 pgs: 129 active+clean; 29 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 939 KiB/s wr, 620 op/s 2024-09-19T04:26:28.299 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:26 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/356868974' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T04:26:28.299 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:26 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3011837710' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T04:26:28.299 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:26 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/131522657' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-19T04:26:28.299 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:26 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/433176832' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T04:26:28.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.859+0000 7f05b6578640 1 -- 172.21.15.7:0/433176832 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f05980a3250 msgr2=0x7f05980a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:28.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.859+0000 7f05b6578640 1 --2- 172.21.15.7:0/433176832 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f05980a3250 0x7f05980a5710 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f05b01993b0 tx=0x7f05a4005f90 comp rx=0 tx=0).stop 2024-09-19T04:26:28.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.859+0000 7f05b6578640 1 -- 172.21.15.7:0/433176832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b0100a50 msgr2=0x7f05b0197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:28.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.859+0000 7f05b6578640 1 --2- 172.21.15.7:0/433176832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b0100a50 0x7f05b0197ea0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f05a0031610 tx=0x7f05a0004270 comp rx=0 tx=0).stop 2024-09-19T04:26:28.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.859+0000 7f05b6578640 1 -- 172.21.15.7:0/433176832 shutdown_connections 2024-09-19T04:26:28.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.859+0000 7f05b6578640 1 --2- 172.21.15.7:0/433176832 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f05980a3250 0x7f05980a5710 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:28.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.859+0000 7f05b6578640 1 --2- 172.21.15.7:0/433176832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f05b0102600 0x7f05b019f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:28.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.859+0000 7f05b6578640 1 --2- 172.21.15.7:0/433176832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05b0101c40 0x7f05b01983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:28.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.859+0000 7f05b6578640 1 --2- 172.21.15.7:0/433176832 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05b0100a50 0x7f05b0197ea0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:28.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.859+0000 7f05b6578640 1 -- 172.21.15.7:0/433176832 >> 172.21.15.7:0/433176832 conn(0x7f05b00fc190 msgr2=0x7f05b0105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:28.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.859+0000 7f05b6578640 1 -- 172.21.15.7:0/433176832 shutdown_connections 2024-09-19T04:26:28.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:26.859+0000 7f05b6578640 1 -- 172.21.15.7:0/433176832 wait complete. 2024-09-19T04:26:28.358 DEBUG:tasks.check_counter:Getting stats from a 2024-09-19T04:26:28.359 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-19T04:26:28.359 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:26 smithi007 ceph-mon[31360]: pgmap v640: 129 pgs: 129 active+clean; 29 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 939 KiB/s wr, 620 op/s 2024-09-19T04:26:28.359 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:26 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/356868974' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T04:26:28.359 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:26 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3011837710' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T04:26:28.359 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:26 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/131522657' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-19T04:26:28.359 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:26 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/433176832' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T04:26:28.631 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:26:29.042 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:28 smithi007 ceph-mon[31360]: pgmap v641: 129 pgs: 129 active+clean; 29 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 609 KiB/s wr, 462 op/s 2024-09-19T04:26:29.151 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:26:29.151 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T04:26:29.151 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 1295, 2024-09-19T04:26:29.151 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 1295, 2024-09-19T04:26:29.151 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 4599027, 2024-09-19T04:26:29.151 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 410987, 2024-09-19T04:26:29.151 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 6, 2024-09-19T04:26:29.151 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 2, 2024-09-19T04:26:29.152 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.132853543, 2024-09-19T04:26:29.152 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.037345216, 2024-09-19T04:26:29.152 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.039219786, 2024-09-19T04:26:29.152 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.045520112, 2024-09-19T04:26:29.152 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:29.152 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 1294, 2024-09-19T04:26:29.152 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.086210728, 2024-09-19T04:26:29.152 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000066623 2024-09-19T04:26:29.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.152 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:29.152 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.152 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.152 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.153 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-19T04:26:29.153 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T04:26:29.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.153 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T04:26:29.153 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 573, 2024-09-19T04:26:29.153 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 721, 2024-09-19T04:26:29.153 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 1546886, 2024-09-19T04:26:29.153 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 512540, 2024-09-19T04:26:29.153 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 5, 2024-09-19T04:26:29.153 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 4, 2024-09-19T04:26:29.153 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.070305052, 2024-09-19T04:26:29.153 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.026655614, 2024-09-19T04:26:29.154 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.015134864, 2024-09-19T04:26:29.154 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.022826098, 2024-09-19T04:26:29.154 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:29.154 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 719, 2024-09-19T04:26:29.154 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.046468387, 2024-09-19T04:26:29.154 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000064629 2024-09-19T04:26:29.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.154 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:29.154 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.154 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.154 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.154 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T04:26:29.154 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 330576 2024-09-19T04:26:29.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.155 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T04:26:29.155 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 367, 2024-09-19T04:26:29.155 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 346, 2024-09-19T04:26:29.155 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 912526, 2024-09-19T04:26:29.155 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 166920, 2024-09-19T04:26:29.155 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 4, 2024-09-19T04:26:29.155 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 3, 2024-09-19T04:26:29.155 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.043295109, 2024-09-19T04:26:29.155 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.016966549, 2024-09-19T04:26:29.155 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.028166855, 2024-09-19T04:26:29.155 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.004115277, 2024-09-19T04:26:29.155 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:29.156 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 345, 2024-09-19T04:26:29.156 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.021145008, 2024-09-19T04:26:29.156 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000061289 2024-09-19T04:26:29.156 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.156 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:29.156 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.156 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.156 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.156 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.156 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 878064, 2024-09-19T04:26:29.156 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 122400 2024-09-19T04:26:29.157 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.157 INFO:teuthology.orchestra.run.smithi007.stdout: "cct": { 2024-09-19T04:26:29.157 INFO:teuthology.orchestra.run.smithi007.stdout: "total_workers": 1, 2024-09-19T04:26:29.157 INFO:teuthology.orchestra.run.smithi007.stdout: "unhealthy_workers": 0 2024-09-19T04:26:29.157 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.157 INFO:teuthology.orchestra.run.smithi007.stdout: "finisher-MDSRank": { 2024-09-19T04:26:29.157 INFO:teuthology.orchestra.run.smithi007.stdout: "queue_len": 0, 2024-09-19T04:26:29.157 INFO:teuthology.orchestra.run.smithi007.stdout: "complete_latency": { 2024-09-19T04:26:29.157 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 3356, 2024-09-19T04:26:29.157 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.089616444, 2024-09-19T04:26:29.157 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000026703 2024-09-19T04:26:29.157 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:29.157 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.158 INFO:teuthology.orchestra.run.smithi007.stdout: "finisher-PurgeQueue": { 2024-09-19T04:26:29.158 INFO:teuthology.orchestra.run.smithi007.stdout: "queue_len": 0, 2024-09-19T04:26:29.158 INFO:teuthology.orchestra.run.smithi007.stdout: "complete_latency": { 2024-09-19T04:26:29.158 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.158 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.158 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.158 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:29.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.158 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": { 2024-09-19T04:26:29.158 INFO:teuthology.orchestra.run.smithi007.stdout: "request": 0, 2024-09-19T04:26:29.158 INFO:teuthology.orchestra.run.smithi007.stdout: "reply": 0, 2024-09-19T04:26:29.159 INFO:teuthology.orchestra.run.smithi007.stdout: "reply_latency": { 2024-09-19T04:26:29.159 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.159 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.159 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.159 INFO:teuthology.orchestra.run.smithi007.stdout: "slow_reply": 0, 2024-09-19T04:26:29.159 INFO:teuthology.orchestra.run.smithi007.stdout: "forward": 0, 2024-09-19T04:26:29.159 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_fetch_complete": 0, 2024-09-19T04:26:29.159 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_fetch_keys": 0, 2024-09-19T04:26:29.159 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_commit": 0, 2024-09-19T04:26:29.159 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_split": 0, 2024-09-19T04:26:29.159 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_merge": 0, 2024-09-19T04:26:29.159 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes": 701, 2024-09-19T04:26:29.160 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_top": 0, 2024-09-19T04:26:29.160 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_bottom": 701, 2024-09-19T04:26:29.160 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_pin_tail": 0, 2024-09-19T04:26:29.160 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_pinned": 701, 2024-09-19T04:26:29.160 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_expired": 0, 2024-09-19T04:26:29.160 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_with_caps": 0, 2024-09-19T04:26:29.160 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": 0, 2024-09-19T04:26:29.160 INFO:teuthology.orchestra.run.smithi007.stdout: "subtrees": 1, 2024-09-19T04:26:29.160 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse": 0, 2024-09-19T04:26:29.160 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_hit": 0, 2024-09-19T04:26:29.160 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_forward": 0, 2024-09-19T04:26:29.160 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_discover": 0, 2024-09-19T04:26:29.161 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_dir_fetch": 0, 2024-09-19T04:26:29.161 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_remote_ino": 0, 2024-09-19T04:26:29.161 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_lock": 0, 2024-09-19T04:26:29.161 INFO:teuthology.orchestra.run.smithi007.stdout: "load_cent": 0, 2024-09-19T04:26:29.161 INFO:teuthology.orchestra.run.smithi007.stdout: "q": 0, 2024-09-19T04:26:29.161 INFO:teuthology.orchestra.run.smithi007.stdout: "exported": 0, 2024-09-19T04:26:29.161 INFO:teuthology.orchestra.run.smithi007.stdout: "exported_inodes": 0, 2024-09-19T04:26:29.161 INFO:teuthology.orchestra.run.smithi007.stdout: "imported": 0, 2024-09-19T04:26:29.161 INFO:teuthology.orchestra.run.smithi007.stdout: "imported_inodes": 0, 2024-09-19T04:26:29.161 INFO:teuthology.orchestra.run.smithi007.stdout: "openino_dir_fetch": 0, 2024-09-19T04:26:29.161 INFO:teuthology.orchestra.run.smithi007.stdout: "openino_backtrace_fetch": 0, 2024-09-19T04:26:29.161 INFO:teuthology.orchestra.run.smithi007.stdout: "openino_peer_discover": 0, 2024-09-19T04:26:29.162 INFO:teuthology.orchestra.run.smithi007.stdout: "root_rfiles": 0, 2024-09-19T04:26:29.162 INFO:teuthology.orchestra.run.smithi007.stdout: "root_rbytes": 0, 2024-09-19T04:26:29.162 INFO:teuthology.orchestra.run.smithi007.stdout: "root_rsnaps": 0, 2024-09-19T04:26:29.162 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T04:26:29.162 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_set_tag": 0, 2024-09-19T04:26:29.162 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T04:26:29.162 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_inotable_repaired": 0, 2024-09-19T04:26:29.162 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_dir_inodes": 0, 2024-09-19T04:26:29.162 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T04:26:29.163 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T04:26:29.163 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_file_inodes": 0, 2024-09-19T04:26:29.163 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_inode_file_caps": 0, 2024-09-19T04:26:29.163 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T04:26:29.163 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_grant": 0, 2024-09-19T04:26:29.163 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T04:26:29.163 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T04:26:29.163 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T04:26:29.163 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_caps": 0, 2024-09-19T04:26:29.163 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_caps_dirty": 0, 2024-09-19T04:26:29.163 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_cap_release": 0, 2024-09-19T04:26:29.163 INFO:teuthology.orchestra.run.smithi007.stdout: "process_request_cap_release": 0 2024-09-19T04:26:29.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.163 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache": { 2024-09-19T04:26:29.164 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_update": 0, 2024-09-19T04:26:29.164 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_update_receipt": 0, 2024-09-19T04:26:29.164 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_try_discover": 0, 2024-09-19T04:26:29.164 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_send_discover": 0, 2024-09-19T04:26:29.164 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_handle_discover": 0, 2024-09-19T04:26:29.164 INFO:teuthology.orchestra.run.smithi007.stdout: "num_strays": 0, 2024-09-19T04:26:29.164 INFO:teuthology.orchestra.run.smithi007.stdout: "num_strays_delayed": 0, 2024-09-19T04:26:29.164 INFO:teuthology.orchestra.run.smithi007.stdout: "num_strays_enqueuing": 0, 2024-09-19T04:26:29.164 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_created": 0, 2024-09-19T04:26:29.164 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_enqueued": 0, 2024-09-19T04:26:29.164 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_reintegrated": 0, 2024-09-19T04:26:29.164 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_migrated": 0, 2024-09-19T04:26:29.164 INFO:teuthology.orchestra.run.smithi007.stdout: "num_recovering_processing": 0, 2024-09-19T04:26:29.164 INFO:teuthology.orchestra.run.smithi007.stdout: "num_recovering_enqueued": 0, 2024-09-19T04:26:29.165 INFO:teuthology.orchestra.run.smithi007.stdout: "num_recovering_prioritized": 0, 2024-09-19T04:26:29.165 INFO:teuthology.orchestra.run.smithi007.stdout: "recovery_started": 0, 2024-09-19T04:26:29.165 INFO:teuthology.orchestra.run.smithi007.stdout: "recovery_completed": 0, 2024-09-19T04:26:29.165 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_quiesce_path": 0, 2024-09-19T04:26:29.165 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_quiesce_inode": 0, 2024-09-19T04:26:29.165 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T04:26:29.165 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_exportdir": 0, 2024-09-19T04:26:29.165 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_flush": 0, 2024-09-19T04:26:29.165 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_fragmentdir": 0, 2024-09-19T04:26:29.165 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_fragstats": 0, 2024-09-19T04:26:29.165 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_inodestats": 0 2024-09-19T04:26:29.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.165 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log": { 2024-09-19T04:26:29.166 INFO:teuthology.orchestra.run.smithi007.stdout: "evlrg": 0, 2024-09-19T04:26:29.166 INFO:teuthology.orchestra.run.smithi007.stdout: "evadd": 0, 2024-09-19T04:26:29.166 INFO:teuthology.orchestra.run.smithi007.stdout: "evex": 0, 2024-09-19T04:26:29.166 INFO:teuthology.orchestra.run.smithi007.stdout: "evtrm": 0, 2024-09-19T04:26:29.166 INFO:teuthology.orchestra.run.smithi007.stdout: "ev": 3870, 2024-09-19T04:26:29.166 INFO:teuthology.orchestra.run.smithi007.stdout: "evexg": 0, 2024-09-19T04:26:29.166 INFO:teuthology.orchestra.run.smithi007.stdout: "evexd": 0, 2024-09-19T04:26:29.166 INFO:teuthology.orchestra.run.smithi007.stdout: "segadd": 0, 2024-09-19T04:26:29.166 INFO:teuthology.orchestra.run.smithi007.stdout: "segex": 0, 2024-09-19T04:26:29.166 INFO:teuthology.orchestra.run.smithi007.stdout: "segtrm": 0, 2024-09-19T04:26:29.166 INFO:teuthology.orchestra.run.smithi007.stdout: "seg": 5, 2024-09-19T04:26:29.166 INFO:teuthology.orchestra.run.smithi007.stdout: "segmjr": 2, 2024-09-19T04:26:29.166 INFO:teuthology.orchestra.run.smithi007.stdout: "segexg": 0, 2024-09-19T04:26:29.167 INFO:teuthology.orchestra.run.smithi007.stdout: "segexd": 0, 2024-09-19T04:26:29.167 INFO:teuthology.orchestra.run.smithi007.stdout: "expos": 4194304, 2024-09-19T04:26:29.167 INFO:teuthology.orchestra.run.smithi007.stdout: "wrpos": 9791506, 2024-09-19T04:26:29.167 INFO:teuthology.orchestra.run.smithi007.stdout: "rdpos": 9790368, 2024-09-19T04:26:29.167 INFO:teuthology.orchestra.run.smithi007.stdout: "jlat": { 2024-09-19T04:26:29.167 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.167 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.167 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.168 INFO:teuthology.orchestra.run.smithi007.stdout: "replayed": 3870 2024-09-19T04:26:29.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.168 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_mem": { 2024-09-19T04:26:29.168 INFO:teuthology.orchestra.run.smithi007.stdout: "ino": 7, 2024-09-19T04:26:29.168 INFO:teuthology.orchestra.run.smithi007.stdout: "ino+": 719, 2024-09-19T04:26:29.168 INFO:teuthology.orchestra.run.smithi007.stdout: "ino-": 712, 2024-09-19T04:26:29.168 INFO:teuthology.orchestra.run.smithi007.stdout: "dir": 5, 2024-09-19T04:26:29.168 INFO:teuthology.orchestra.run.smithi007.stdout: "dir+": 36, 2024-09-19T04:26:29.168 INFO:teuthology.orchestra.run.smithi007.stdout: "dir-": 31, 2024-09-19T04:26:29.168 INFO:teuthology.orchestra.run.smithi007.stdout: "dn": 701, 2024-09-19T04:26:29.168 INFO:teuthology.orchestra.run.smithi007.stdout: "dn+": 1497, 2024-09-19T04:26:29.168 INFO:teuthology.orchestra.run.smithi007.stdout: "dn-": 796, 2024-09-19T04:26:29.169 INFO:teuthology.orchestra.run.smithi007.stdout: "cap": 0, 2024-09-19T04:26:29.169 INFO:teuthology.orchestra.run.smithi007.stdout: "cap+": 0, 2024-09-19T04:26:29.169 INFO:teuthology.orchestra.run.smithi007.stdout: "cap-": 0, 2024-09-19T04:26:29.169 INFO:teuthology.orchestra.run.smithi007.stdout: "rss": 51332, 2024-09-19T04:26:29.169 INFO:teuthology.orchestra.run.smithi007.stdout: "heap": 215328 2024-09-19T04:26:29.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.169 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_server": { 2024-09-19T04:26:29.169 INFO:teuthology.orchestra.run.smithi007.stdout: "dispatch_client_request": 0, 2024-09-19T04:26:29.169 INFO:teuthology.orchestra.run.smithi007.stdout: "dispatch_server_request": 0, 2024-09-19T04:26:29.169 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_request": 0, 2024-09-19T04:26:29.169 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_session": 0, 2024-09-19T04:26:29.169 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_peer_request": 0, 2024-09-19T04:26:29.170 INFO:teuthology.orchestra.run.smithi007.stdout: "req_create_latency": { 2024-09-19T04:26:29.170 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.170 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.170 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.170 INFO:teuthology.orchestra.run.smithi007.stdout: "req_getattr_latency": { 2024-09-19T04:26:29.170 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.170 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.170 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.170 INFO:teuthology.orchestra.run.smithi007.stdout: "req_getfilelock_latency": { 2024-09-19T04:26:29.170 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.170 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.171 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.171 INFO:teuthology.orchestra.run.smithi007.stdout: "req_link_latency": { 2024-09-19T04:26:29.171 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.171 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.171 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.171 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookup_latency": { 2024-09-19T04:26:29.171 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.171 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.171 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.171 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookuphash_latency": { 2024-09-19T04:26:29.172 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.172 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.172 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.172 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupino_latency": { 2024-09-19T04:26:29.172 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.172 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.172 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.172 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupname_latency": { 2024-09-19T04:26:29.172 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.172 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.172 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.173 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupparent_latency": { 2024-09-19T04:26:29.173 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.173 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.173 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.173 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupsnap_latency": { 2024-09-19T04:26:29.173 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.173 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.173 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.173 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lssnap_latency": { 2024-09-19T04:26:29.174 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.174 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.174 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.174 INFO:teuthology.orchestra.run.smithi007.stdout: "req_mkdir_latency": { 2024-09-19T04:26:29.175 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:28 smithi102 ceph-mon[35446]: pgmap v641: 129 pgs: 129 active+clean; 29 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 609 KiB/s wr, 462 op/s 2024-09-19T04:26:29.175 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.175 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.175 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.175 INFO:teuthology.orchestra.run.smithi007.stdout: "req_mknod_latency": { 2024-09-19T04:26:29.175 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.175 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.175 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.175 INFO:teuthology.orchestra.run.smithi007.stdout: "req_mksnap_latency": { 2024-09-19T04:26:29.176 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.176 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.176 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.176 INFO:teuthology.orchestra.run.smithi007.stdout: "req_open_latency": { 2024-09-19T04:26:29.176 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.176 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.176 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.176 INFO:teuthology.orchestra.run.smithi007.stdout: "req_readdir_latency": { 2024-09-19T04:26:29.176 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.176 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.176 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.177 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rename_latency": { 2024-09-19T04:26:29.177 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.177 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.177 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.177 INFO:teuthology.orchestra.run.smithi007.stdout: "req_renamesnap_latency": { 2024-09-19T04:26:29.177 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.177 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.177 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.177 INFO:teuthology.orchestra.run.smithi007.stdout: "req_snapdiff_latency": { 2024-09-19T04:26:29.177 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.178 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.178 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.178 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rmdir_latency": { 2024-09-19T04:26:29.178 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.178 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.178 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.178 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rmsnap_latency": { 2024-09-19T04:26:29.178 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.178 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.178 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.179 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rmxattr_latency": { 2024-09-19T04:26:29.179 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.179 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.179 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.179 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setattr_latency": { 2024-09-19T04:26:29.179 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.179 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.179 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.179 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setdirlayout_latency": { 2024-09-19T04:26:29.179 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.180 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.180 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.180 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setfilelock_latency": { 2024-09-19T04:26:29.180 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.180 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.180 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.180 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setlayout_latency": { 2024-09-19T04:26:29.180 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.180 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.180 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.181 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setxattr_latency": { 2024-09-19T04:26:29.181 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.181 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.181 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.181 INFO:teuthology.orchestra.run.smithi007.stdout: "req_symlink_latency": { 2024-09-19T04:26:29.181 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.181 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.181 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.181 INFO:teuthology.orchestra.run.smithi007.stdout: "req_unlink_latency": { 2024-09-19T04:26:29.182 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.182 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.182 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.182 INFO:teuthology.orchestra.run.smithi007.stdout: "cap_revoke_eviction": 0, 2024-09-19T04:26:29.182 INFO:teuthology.orchestra.run.smithi007.stdout: "cap_acquisition_throttle": 0, 2024-09-19T04:26:29.182 INFO:teuthology.orchestra.run.smithi007.stdout: "req_getvxattr_latency": { 2024-09-19T04:26:29.182 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.182 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.182 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.182 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:29.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.182 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_sessions": { 2024-09-19T04:26:29.183 INFO:teuthology.orchestra.run.smithi007.stdout: "session_count": 1, 2024-09-19T04:26:29.183 INFO:teuthology.orchestra.run.smithi007.stdout: "session_add": 1, 2024-09-19T04:26:29.183 INFO:teuthology.orchestra.run.smithi007.stdout: "session_remove": 0, 2024-09-19T04:26:29.183 INFO:teuthology.orchestra.run.smithi007.stdout: "sessions_open": 1, 2024-09-19T04:26:29.183 INFO:teuthology.orchestra.run.smithi007.stdout: "sessions_stale": 0, 2024-09-19T04:26:29.183 INFO:teuthology.orchestra.run.smithi007.stdout: "total_load": 0, 2024-09-19T04:26:29.183 INFO:teuthology.orchestra.run.smithi007.stdout: "average_load": 0, 2024-09-19T04:26:29.183 INFO:teuthology.orchestra.run.smithi007.stdout: "avg_session_uptime": 1640, 2024-09-19T04:26:29.183 INFO:teuthology.orchestra.run.smithi007.stdout: "mdthresh_evicted": 0 2024-09-19T04:26:29.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.183 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool": { 2024-09-19T04:26:29.183 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_bytes": 0, 2024-09-19T04:26:29.183 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_items": 0, 2024-09-19T04:26:29.184 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T04:26:29.184 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_items": 0, 2024-09-19T04:26:29.184 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T04:26:29.184 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_items": 0, 2024-09-19T04:26:29.184 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T04:26:29.184 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T04:26:29.184 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T04:26:29.184 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T04:26:29.184 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T04:26:29.184 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_items": 0, 2024-09-19T04:26:29.184 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T04:26:29.185 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T04:26:29.185 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_bytes": 0, 2024-09-19T04:26:29.185 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_items": 0, 2024-09-19T04:26:29.185 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_bytes": 0, 2024-09-19T04:26:29.185 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_items": 0, 2024-09-19T04:26:29.185 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T04:26:29.185 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T04:26:29.185 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T04:26:29.185 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T04:26:29.185 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T04:26:29.185 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_items": 0, 2024-09-19T04:26:29.185 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_bytes": 0, 2024-09-19T04:26:29.186 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_items": 0, 2024-09-19T04:26:29.186 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T04:26:29.186 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T04:26:29.186 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_bytes": 0, 2024-09-19T04:26:29.186 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_items": 0, 2024-09-19T04:26:29.186 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_bytes": 0, 2024-09-19T04:26:29.186 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_items": 0, 2024-09-19T04:26:29.186 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T04:26:29.186 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_items": 0, 2024-09-19T04:26:29.186 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T04:26:29.186 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_items": 0, 2024-09-19T04:26:29.186 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_bytes": 198287, 2024-09-19T04:26:29.186 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_items": 57, 2024-09-19T04:26:29.186 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_bytes": 0, 2024-09-19T04:26:29.187 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_items": 0, 2024-09-19T04:26:29.187 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bytes": 0, 2024-09-19T04:26:29.187 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_items": 0, 2024-09-19T04:26:29.187 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_bytes": 0, 2024-09-19T04:26:29.187 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_items": 0, 2024-09-19T04:26:29.187 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_bytes": 0, 2024-09-19T04:26:29.187 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_items": 0, 2024-09-19T04:26:29.187 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_bytes": 9056, 2024-09-19T04:26:29.187 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_items": 171, 2024-09-19T04:26:29.187 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T04:26:29.187 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_items": 0, 2024-09-19T04:26:29.187 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_bytes": 0, 2024-09-19T04:26:29.187 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_items": 0, 2024-09-19T04:26:29.188 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_bytes": 516072, 2024-09-19T04:26:29.188 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_items": 2866, 2024-09-19T04:26:29.188 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_bytes": 0, 2024-09-19T04:26:29.188 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_items": 0, 2024-09-19T04:26:29.188 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_bytes": 0, 2024-09-19T04:26:29.188 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_items": 0 2024-09-19T04:26:29.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.188 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter": { 2024-09-19T04:26:29.188 INFO:teuthology.orchestra.run.smithi007.stdout: "op_active": 0, 2024-09-19T04:26:29.188 INFO:teuthology.orchestra.run.smithi007.stdout: "op_laggy": 0, 2024-09-19T04:26:29.188 INFO:teuthology.orchestra.run.smithi007.stdout: "op_send": 2003, 2024-09-19T04:26:29.188 INFO:teuthology.orchestra.run.smithi007.stdout: "op_send_bytes": 21, 2024-09-19T04:26:29.188 INFO:teuthology.orchestra.run.smithi007.stdout: "op_resend": 3, 2024-09-19T04:26:29.188 INFO:teuthology.orchestra.run.smithi007.stdout: "op_reply": 2003, 2024-09-19T04:26:29.189 INFO:teuthology.orchestra.run.smithi007.stdout: "op_latency": { 2024-09-19T04:26:29.189 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 2003, 2024-09-19T04:26:29.189 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 4.189936923, 2024-09-19T04:26:29.189 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.002091830 2024-09-19T04:26:29.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.189 INFO:teuthology.orchestra.run.smithi007.stdout: "op_inflight": 0, 2024-09-19T04:26:29.189 INFO:teuthology.orchestra.run.smithi007.stdout: "oplen_avg": { 2024-09-19T04:26:29.189 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 2003, 2024-09-19T04:26:29.189 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 2004 2024-09-19T04:26:29.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.189 INFO:teuthology.orchestra.run.smithi007.stdout: "op": 2003, 2024-09-19T04:26:29.189 INFO:teuthology.orchestra.run.smithi007.stdout: "op_r": 2003, 2024-09-19T04:26:29.190 INFO:teuthology.orchestra.run.smithi007.stdout: "op_w": 0, 2024-09-19T04:26:29.190 INFO:teuthology.orchestra.run.smithi007.stdout: "op_rmw": 0, 2024-09-19T04:26:29.190 INFO:teuthology.orchestra.run.smithi007.stdout: "op_pg": 0, 2024-09-19T04:26:29.190 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_stat": 1223, 2024-09-19T04:26:29.190 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_create": 0, 2024-09-19T04:26:29.190 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_read": 778, 2024-09-19T04:26:29.190 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_write": 0, 2024-09-19T04:26:29.190 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_writefull": 0, 2024-09-19T04:26:29.190 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_writesame": 0, 2024-09-19T04:26:29.190 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_append": 0, 2024-09-19T04:26:29.190 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_zero": 0, 2024-09-19T04:26:29.190 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_truncate": 0, 2024-09-19T04:26:29.190 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_delete": 0, 2024-09-19T04:26:29.190 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_mapext": 0, 2024-09-19T04:26:29.190 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_sparse_read": 0, 2024-09-19T04:26:29.191 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_clonerange": 0, 2024-09-19T04:26:29.191 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_getxattr": 1, 2024-09-19T04:26:29.191 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_setxattr": 0, 2024-09-19T04:26:29.191 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_cmpxattr": 0, 2024-09-19T04:26:29.191 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_rmxattr": 0, 2024-09-19T04:26:29.191 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_resetxattrs": 0, 2024-09-19T04:26:29.191 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_call": 0, 2024-09-19T04:26:29.191 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_watch": 0, 2024-09-19T04:26:29.191 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_notify": 0, 2024-09-19T04:26:29.191 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T04:26:29.191 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_pgls": 0, 2024-09-19T04:26:29.191 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_pgls_filter": 0, 2024-09-19T04:26:29.191 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_other": 0, 2024-09-19T04:26:29.191 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_active": 0, 2024-09-19T04:26:29.191 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_send": 0, 2024-09-19T04:26:29.192 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_resend": 0, 2024-09-19T04:26:29.192 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_ping": 0, 2024-09-19T04:26:29.192 INFO:teuthology.orchestra.run.smithi007.stdout: "poolop_active": 0, 2024-09-19T04:26:29.192 INFO:teuthology.orchestra.run.smithi007.stdout: "poolop_send": 0, 2024-09-19T04:26:29.192 INFO:teuthology.orchestra.run.smithi007.stdout: "poolop_resend": 0, 2024-09-19T04:26:29.192 INFO:teuthology.orchestra.run.smithi007.stdout: "poolstat_active": 0, 2024-09-19T04:26:29.192 INFO:teuthology.orchestra.run.smithi007.stdout: "poolstat_send": 0, 2024-09-19T04:26:29.192 INFO:teuthology.orchestra.run.smithi007.stdout: "poolstat_resend": 0, 2024-09-19T04:26:29.192 INFO:teuthology.orchestra.run.smithi007.stdout: "statfs_active": 0, 2024-09-19T04:26:29.192 INFO:teuthology.orchestra.run.smithi007.stdout: "statfs_send": 0, 2024-09-19T04:26:29.192 INFO:teuthology.orchestra.run.smithi007.stdout: "statfs_resend": 0, 2024-09-19T04:26:29.192 INFO:teuthology.orchestra.run.smithi007.stdout: "command_active": 0, 2024-09-19T04:26:29.192 INFO:teuthology.orchestra.run.smithi007.stdout: "command_send": 0, 2024-09-19T04:26:29.192 INFO:teuthology.orchestra.run.smithi007.stdout: "command_resend": 0, 2024-09-19T04:26:29.193 INFO:teuthology.orchestra.run.smithi007.stdout: "map_epoch": 90, 2024-09-19T04:26:29.193 INFO:teuthology.orchestra.run.smithi007.stdout: "map_full": 0, 2024-09-19T04:26:29.193 INFO:teuthology.orchestra.run.smithi007.stdout: "map_inc": 4, 2024-09-19T04:26:29.193 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_sessions": 6, 2024-09-19T04:26:29.193 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_session_open": 6, 2024-09-19T04:26:29.193 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_session_close": 0, 2024-09-19T04:26:29.193 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_laggy": 0, 2024-09-19T04:26:29.193 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_wr": 0, 2024-09-19T04:26:29.193 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_rd": 2, 2024-09-19T04:26:29.193 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_del": 0 2024-09-19T04:26:29.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.193 INFO:teuthology.orchestra.run.smithi007.stdout: "oft": { 2024-09-19T04:26:29.193 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_objs": 0, 2024-09-19T04:26:29.193 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_kv_pairs": 0, 2024-09-19T04:26:29.194 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_updates": 0, 2024-09-19T04:26:29.194 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_removes": 0 2024-09-19T04:26:29.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.194 INFO:teuthology.orchestra.run.smithi007.stdout: "osd-slow-ops": { 2024-09-19T04:26:29.194 INFO:teuthology.orchestra.run.smithi007.stdout: "slow_ops_count": 0 2024-09-19T04:26:29.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.194 INFO:teuthology.orchestra.run.smithi007.stdout: "purge_queue": { 2024-09-19T04:26:29.194 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing_ops": 0, 2024-09-19T04:26:29.194 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T04:26:29.194 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing": 0, 2024-09-19T04:26:29.194 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing_high_water": 0, 2024-09-19T04:26:29.194 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executed_ops": 0, 2024-09-19T04:26:29.194 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executed": 0, 2024-09-19T04:26:29.194 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_item_in_journal": 0 2024-09-19T04:26:29.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.195 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T04:26:29.195 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-19T04:26:29.195 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-09-19T04:26:29.195 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-19T04:26:29.195 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 2231, 2024-09-19T04:26:29.195 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 6843033, 2024-09-19T04:26:29.195 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:29.195 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 2231, 2024-09-19T04:26:29.195 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-19T04:26:29.195 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-19T04:26:29.195 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 2231, 2024-09-19T04:26:29.195 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 6843033, 2024-09-19T04:26:29.196 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-19T04:26:29.196 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.196 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.196 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.196 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:29.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.196 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-objecter_bytes": { 2024-09-19T04:26:29.196 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-19T04:26:29.196 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-09-19T04:26:29.196 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-19T04:26:29.196 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-09-19T04:26:29.196 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-09-19T04:26:29.196 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:29.197 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:29.197 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 2003, 2024-09-19T04:26:29.197 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 5612807, 2024-09-19T04:26:29.197 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 2003, 2024-09-19T04:26:29.197 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 5612807, 2024-09-19T04:26:29.197 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-19T04:26:29.197 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.197 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.197 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.197 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:29.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.197 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-objecter_ops": { 2024-09-19T04:26:29.197 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-19T04:26:29.198 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 1024, 2024-09-19T04:26:29.198 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-19T04:26:29.198 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-09-19T04:26:29.198 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-09-19T04:26:29.198 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:29.198 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:29.198 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 2003, 2024-09-19T04:26:29.198 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 2003, 2024-09-19T04:26:29.198 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 2003, 2024-09-19T04:26:29.198 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 2003, 2024-09-19T04:26:29.198 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-19T04:26:29.198 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.198 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.198 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.199 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:29.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.199 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-write_buf_throttle": { 2024-09-19T04:26:29.199 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-19T04:26:29.199 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 3758096384, 2024-09-19T04:26:29.199 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-19T04:26:29.199 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-09-19T04:26:29.199 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-09-19T04:26:29.199 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:29.199 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:29.199 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-19T04:26:29.199 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-19T04:26:29.199 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 0, 2024-09-19T04:26:29.199 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 0, 2024-09-19T04:26:29.199 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-19T04:26:29.200 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.200 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.200 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.200 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:29.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:29.200 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-write_buf_throttle-0x5618e805e6e0": { 2024-09-19T04:26:29.200 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-19T04:26:29.200 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 3758096384, 2024-09-19T04:26:29.200 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-19T04:26:29.200 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-09-19T04:26:29.200 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-09-19T04:26:29.200 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:29.200 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:29.200 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-19T04:26:29.201 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-19T04:26:29.201 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 0, 2024-09-19T04:26:29.201 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 0, 2024-09-19T04:26:29.201 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-19T04:26:29.201 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:29.201 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:29.201 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:29.201 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:29.201 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:29.201 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:26:29.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:28 smithi092 ceph-mon[34940]: pgmap v641: 129 pgs: 129 active+clean; 29 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 609 KiB/s wr, 462 op/s 2024-09-19T04:26:30.029 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-19T04:26:30.029 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-19T04:26:30.030 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=0 2024-09-19T04:26:30.030 DEBUG:tasks.check_counter:Getting stats from d 2024-09-19T04:26:30.030 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-19T04:26:30.288 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:26:30.805 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:26:30.805 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T04:26:30.805 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 330, 2024-09-19T04:26:30.805 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 324, 2024-09-19T04:26:30.805 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 21782950, 2024-09-19T04:26:30.805 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 161948, 2024-09-19T04:26:30.806 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 6, 2024-09-19T04:26:30.806 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 2, 2024-09-19T04:26:30.806 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.056093189, 2024-09-19T04:26:30.806 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.016479575, 2024-09-19T04:26:30.806 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.042012178, 2024-09-19T04:26:30.806 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.003351922, 2024-09-19T04:26:30.806 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:30.806 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 323, 2024-09-19T04:26:30.806 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.025170245, 2024-09-19T04:26:30.806 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000077926 2024-09-19T04:26:30.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.806 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 776528, 2024-09-19T04:26:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 125056 2024-09-19T04:26:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T04:26:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 90, 2024-09-19T04:26:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 240, 2024-09-19T04:26:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 22042094, 2024-09-19T04:26:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 161663, 2024-09-19T04:26:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 6, 2024-09-19T04:26:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 5, 2024-09-19T04:26:30.808 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.032581290, 2024-09-19T04:26:30.808 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.011461951, 2024-09-19T04:26:30.808 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.016922987, 2024-09-19T04:26:30.808 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.002028443, 2024-09-19T04:26:30.808 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:30.808 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 239, 2024-09-19T04:26:30.808 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.019872513, 2024-09-19T04:26:30.808 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000083148 2024-09-19T04:26:30.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.808 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:30.808 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.808 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.809 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.809 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-09-19T04:26:30.809 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 134576 2024-09-19T04:26:30.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.809 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T04:26:30.809 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 108, 2024-09-19T04:26:30.809 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 110, 2024-09-19T04:26:30.809 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 23168124, 2024-09-19T04:26:30.809 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 34360, 2024-09-19T04:26:30.809 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 6, 2024-09-19T04:26:30.809 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 5, 2024-09-19T04:26:30.810 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.021306113, 2024-09-19T04:26:30.810 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.002133559, 2024-09-19T04:26:30.810 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.015783111, 2024-09-19T04:26:30.810 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.002574492, 2024-09-19T04:26:30.810 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:30.810 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 108, 2024-09-19T04:26:30.810 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.020037681, 2024-09-19T04:26:30.810 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000185534 2024-09-19T04:26:30.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.810 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:30.810 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.810 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.810 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.811 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T04:26:30.811 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T04:26:30.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.811 INFO:teuthology.orchestra.run.smithi007.stdout: "cct": { 2024-09-19T04:26:30.811 INFO:teuthology.orchestra.run.smithi007.stdout: "total_workers": 1, 2024-09-19T04:26:30.811 INFO:teuthology.orchestra.run.smithi007.stdout: "unhealthy_workers": 0 2024-09-19T04:26:30.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.811 INFO:teuthology.orchestra.run.smithi007.stdout: "finisher-MDSRank": { 2024-09-19T04:26:30.811 INFO:teuthology.orchestra.run.smithi007.stdout: "queue_len": 0, 2024-09-19T04:26:30.811 INFO:teuthology.orchestra.run.smithi007.stdout: "complete_latency": { 2024-09-19T04:26:30.811 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 464, 2024-09-19T04:26:30.811 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.054826377, 2024-09-19T04:26:30.812 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000118160 2024-09-19T04:26:30.812 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:30.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.812 INFO:teuthology.orchestra.run.smithi007.stdout: "finisher-PurgeQueue": { 2024-09-19T04:26:30.812 INFO:teuthology.orchestra.run.smithi007.stdout: "queue_len": 0, 2024-09-19T04:26:30.812 INFO:teuthology.orchestra.run.smithi007.stdout: "complete_latency": { 2024-09-19T04:26:30.812 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.812 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.812 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.812 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:30.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.812 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": { 2024-09-19T04:26:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: "request": 0, 2024-09-19T04:26:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: "reply": 0, 2024-09-19T04:26:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: "reply_latency": { 2024-09-19T04:26:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: "slow_reply": 0, 2024-09-19T04:26:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: "forward": 0, 2024-09-19T04:26:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_fetch_complete": 0, 2024-09-19T04:26:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_fetch_keys": 0, 2024-09-19T04:26:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_commit": 0, 2024-09-19T04:26:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_split": 0, 2024-09-19T04:26:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_merge": 0, 2024-09-19T04:26:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes": 16930, 2024-09-19T04:26:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_top": 11683, 2024-09-19T04:26:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_bottom": 5247, 2024-09-19T04:26:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_pin_tail": 0, 2024-09-19T04:26:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_pinned": 21, 2024-09-19T04:26:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_expired": 0, 2024-09-19T04:26:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_with_caps": 0, 2024-09-19T04:26:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": 0, 2024-09-19T04:26:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: "subtrees": 2, 2024-09-19T04:26:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse": 0, 2024-09-19T04:26:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_hit": 0, 2024-09-19T04:26:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_forward": 0, 2024-09-19T04:26:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_discover": 0, 2024-09-19T04:26:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_dir_fetch": 0, 2024-09-19T04:26:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_remote_ino": 0, 2024-09-19T04:26:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_lock": 0, 2024-09-19T04:26:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: "load_cent": 0, 2024-09-19T04:26:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: "q": 0, 2024-09-19T04:26:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: "exported": 0, 2024-09-19T04:26:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: "exported_inodes": 0, 2024-09-19T04:26:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: "imported": 0, 2024-09-19T04:26:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: "imported_inodes": 0, 2024-09-19T04:26:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: "openino_dir_fetch": 0, 2024-09-19T04:26:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: "openino_backtrace_fetch": 0, 2024-09-19T04:26:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: "openino_peer_discover": 0, 2024-09-19T04:26:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: "root_rfiles": 36, 2024-09-19T04:26:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: "root_rbytes": 793018, 2024-09-19T04:26:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: "root_rsnaps": 0, 2024-09-19T04:26:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T04:26:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_set_tag": 0, 2024-09-19T04:26:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T04:26:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_inotable_repaired": 0, 2024-09-19T04:26:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_dir_inodes": 0, 2024-09-19T04:26:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T04:26:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T04:26:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_file_inodes": 0, 2024-09-19T04:26:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_inode_file_caps": 0, 2024-09-19T04:26:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T04:26:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_grant": 0, 2024-09-19T04:26:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T04:26:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T04:26:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T04:26:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_caps": 0, 2024-09-19T04:26:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_caps_dirty": 0, 2024-09-19T04:26:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_cap_release": 0, 2024-09-19T04:26:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: "process_request_cap_release": 0 2024-09-19T04:26:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache": { 2024-09-19T04:26:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_update": 0, 2024-09-19T04:26:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_update_receipt": 0, 2024-09-19T04:26:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_try_discover": 0, 2024-09-19T04:26:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_send_discover": 0, 2024-09-19T04:26:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_handle_discover": 0, 2024-09-19T04:26:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: "num_strays": 0, 2024-09-19T04:26:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: "num_strays_delayed": 0, 2024-09-19T04:26:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: "num_strays_enqueuing": 0, 2024-09-19T04:26:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_created": 0, 2024-09-19T04:26:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_enqueued": 0, 2024-09-19T04:26:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_reintegrated": 0, 2024-09-19T04:26:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_migrated": 0, 2024-09-19T04:26:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: "num_recovering_processing": 0, 2024-09-19T04:26:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: "num_recovering_enqueued": 0, 2024-09-19T04:26:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: "num_recovering_prioritized": 0, 2024-09-19T04:26:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: "recovery_started": 0, 2024-09-19T04:26:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: "recovery_completed": 0, 2024-09-19T04:26:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_quiesce_path": 0, 2024-09-19T04:26:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_quiesce_inode": 0, 2024-09-19T04:26:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T04:26:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_exportdir": 0, 2024-09-19T04:26:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_flush": 0, 2024-09-19T04:26:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_fragmentdir": 0, 2024-09-19T04:26:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_fragstats": 0, 2024-09-19T04:26:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_inodestats": 0 2024-09-19T04:26:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log": { 2024-09-19T04:26:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: "evlrg": 0, 2024-09-19T04:26:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: "evadd": 0, 2024-09-19T04:26:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: "evex": 0, 2024-09-19T04:26:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: "evtrm": 0, 2024-09-19T04:26:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: "ev": 33093, 2024-09-19T04:26:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: "evexg": 0, 2024-09-19T04:26:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: "evexd": 0, 2024-09-19T04:26:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: "segadd": 0, 2024-09-19T04:26:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: "segex": 0, 2024-09-19T04:26:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: "segtrm": 0, 2024-09-19T04:26:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: "seg": 2, 2024-09-19T04:26:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: "segmjr": 5, 2024-09-19T04:26:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: "segexg": 0, 2024-09-19T04:26:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: "segexd": 0, 2024-09-19T04:26:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: "expos": 572503669, 2024-09-19T04:26:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: "wrpos": 572593632, 2024-09-19T04:26:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: "rdpos": 572590795, 2024-09-19T04:26:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: "jlat": { 2024-09-19T04:26:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: "replayed": 33093 2024-09-19T04:26:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_mem": { 2024-09-19T04:26:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: "ino": 17, 2024-09-19T04:26:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: "ino+": 16208, 2024-09-19T04:26:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: "ino-": 16191, 2024-09-19T04:26:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: "dir": 16, 2024-09-19T04:26:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: "dir+": 759, 2024-09-19T04:26:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: "dir-": 743, 2024-09-19T04:26:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: "dn": 16615, 2024-09-19T04:26:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: "dn+": 32816, 2024-09-19T04:26:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: "dn-": 16201, 2024-09-19T04:26:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: "cap": 0, 2024-09-19T04:26:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: "cap+": 0, 2024-09-19T04:26:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: "cap-": 0, 2024-09-19T04:26:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: "rss": 70484, 2024-09-19T04:26:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: "heap": 215328 2024-09-19T04:26:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_server": { 2024-09-19T04:26:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: "dispatch_client_request": 0, 2024-09-19T04:26:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: "dispatch_server_request": 0, 2024-09-19T04:26:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_request": 0, 2024-09-19T04:26:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_session": 0, 2024-09-19T04:26:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_peer_request": 0, 2024-09-19T04:26:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: "req_create_latency": { 2024-09-19T04:26:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: "req_getattr_latency": { 2024-09-19T04:26:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: "req_getfilelock_latency": { 2024-09-19T04:26:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: "req_link_latency": { 2024-09-19T04:26:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.825 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookup_latency": { 2024-09-19T04:26:30.825 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.825 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.825 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.825 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookuphash_latency": { 2024-09-19T04:26:30.825 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.825 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.825 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.825 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupino_latency": { 2024-09-19T04:26:30.825 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.826 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.826 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.826 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupname_latency": { 2024-09-19T04:26:30.826 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.826 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.826 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.826 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupparent_latency": { 2024-09-19T04:26:30.826 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.826 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.826 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.826 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupsnap_latency": { 2024-09-19T04:26:30.827 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.827 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.827 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.827 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lssnap_latency": { 2024-09-19T04:26:30.827 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.827 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.827 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.827 INFO:teuthology.orchestra.run.smithi007.stdout: "req_mkdir_latency": { 2024-09-19T04:26:30.827 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.827 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.827 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.828 INFO:teuthology.orchestra.run.smithi007.stdout: "req_mknod_latency": { 2024-09-19T04:26:30.828 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.828 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.828 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.828 INFO:teuthology.orchestra.run.smithi007.stdout: "req_mksnap_latency": { 2024-09-19T04:26:30.828 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.828 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.828 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.828 INFO:teuthology.orchestra.run.smithi007.stdout: "req_open_latency": { 2024-09-19T04:26:30.828 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.829 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.829 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.829 INFO:teuthology.orchestra.run.smithi007.stdout: "req_readdir_latency": { 2024-09-19T04:26:30.829 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.829 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.829 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.829 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rename_latency": { 2024-09-19T04:26:30.829 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.829 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.829 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.830 INFO:teuthology.orchestra.run.smithi007.stdout: "req_renamesnap_latency": { 2024-09-19T04:26:30.830 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.830 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.830 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.830 INFO:teuthology.orchestra.run.smithi007.stdout: "req_snapdiff_latency": { 2024-09-19T04:26:30.830 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.830 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.830 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.830 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rmdir_latency": { 2024-09-19T04:26:30.830 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.830 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.831 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.831 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rmsnap_latency": { 2024-09-19T04:26:30.831 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.831 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.831 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.831 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rmxattr_latency": { 2024-09-19T04:26:30.831 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.831 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.831 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.831 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setattr_latency": { 2024-09-19T04:26:30.831 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.832 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.832 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.832 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setdirlayout_latency": { 2024-09-19T04:26:30.832 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.832 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.832 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.832 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setfilelock_latency": { 2024-09-19T04:26:30.832 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.832 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.832 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.833 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setlayout_latency": { 2024-09-19T04:26:30.833 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.833 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.833 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.833 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setxattr_latency": { 2024-09-19T04:26:30.833 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.833 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.833 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.833 INFO:teuthology.orchestra.run.smithi007.stdout: "req_symlink_latency": { 2024-09-19T04:26:30.833 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.833 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.833 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.834 INFO:teuthology.orchestra.run.smithi007.stdout: "req_unlink_latency": { 2024-09-19T04:26:30.834 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.834 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.834 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.834 INFO:teuthology.orchestra.run.smithi007.stdout: "cap_revoke_eviction": 0, 2024-09-19T04:26:30.834 INFO:teuthology.orchestra.run.smithi007.stdout: "cap_acquisition_throttle": 0, 2024-09-19T04:26:30.834 INFO:teuthology.orchestra.run.smithi007.stdout: "req_getvxattr_latency": { 2024-09-19T04:26:30.834 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.834 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.834 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.834 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:30.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.835 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_sessions": { 2024-09-19T04:26:30.835 INFO:teuthology.orchestra.run.smithi007.stdout: "session_count": 1, 2024-09-19T04:26:30.835 INFO:teuthology.orchestra.run.smithi007.stdout: "session_add": 1, 2024-09-19T04:26:30.835 INFO:teuthology.orchestra.run.smithi007.stdout: "session_remove": 0, 2024-09-19T04:26:30.835 INFO:teuthology.orchestra.run.smithi007.stdout: "sessions_open": 0, 2024-09-19T04:26:30.835 INFO:teuthology.orchestra.run.smithi007.stdout: "sessions_stale": 0, 2024-09-19T04:26:30.835 INFO:teuthology.orchestra.run.smithi007.stdout: "total_load": 0, 2024-09-19T04:26:30.835 INFO:teuthology.orchestra.run.smithi007.stdout: "average_load": 0, 2024-09-19T04:26:30.835 INFO:teuthology.orchestra.run.smithi007.stdout: "avg_session_uptime": 1641, 2024-09-19T04:26:30.835 INFO:teuthology.orchestra.run.smithi007.stdout: "mdthresh_evicted": 0 2024-09-19T04:26:30.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.835 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool": { 2024-09-19T04:26:30.835 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_bytes": 0, 2024-09-19T04:26:30.836 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_items": 0, 2024-09-19T04:26:30.836 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T04:26:30.836 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_items": 0, 2024-09-19T04:26:30.836 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T04:26:30.836 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_items": 0, 2024-09-19T04:26:30.836 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T04:26:30.836 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T04:26:30.836 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T04:26:30.836 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T04:26:30.836 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T04:26:30.836 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_items": 0, 2024-09-19T04:26:30.836 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T04:26:30.836 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T04:26:30.837 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_bytes": 0, 2024-09-19T04:26:30.837 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_items": 0, 2024-09-19T04:26:30.837 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_bytes": 0, 2024-09-19T04:26:30.837 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_items": 0, 2024-09-19T04:26:30.837 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T04:26:30.837 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T04:26:30.837 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T04:26:30.837 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T04:26:30.837 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T04:26:30.837 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_items": 0, 2024-09-19T04:26:30.837 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_bytes": 0, 2024-09-19T04:26:30.837 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_items": 0, 2024-09-19T04:26:30.837 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T04:26:30.837 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T04:26:30.838 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_bytes": 0, 2024-09-19T04:26:30.838 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_items": 0, 2024-09-19T04:26:30.838 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_bytes": 0, 2024-09-19T04:26:30.838 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_items": 0, 2024-09-19T04:26:30.838 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T04:26:30.838 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_items": 0, 2024-09-19T04:26:30.838 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T04:26:30.838 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_items": 0, 2024-09-19T04:26:30.838 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_bytes": 226817, 2024-09-19T04:26:30.838 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_items": 185, 2024-09-19T04:26:30.838 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_bytes": 0, 2024-09-19T04:26:30.838 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_items": 0, 2024-09-19T04:26:30.838 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bytes": 0, 2024-09-19T04:26:30.838 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_items": 0, 2024-09-19T04:26:30.839 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_bytes": 0, 2024-09-19T04:26:30.839 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_items": 0, 2024-09-19T04:26:30.839 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_bytes": 0, 2024-09-19T04:26:30.839 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_items": 0, 2024-09-19T04:26:30.839 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_bytes": 9056, 2024-09-19T04:26:30.839 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_items": 171, 2024-09-19T04:26:30.839 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T04:26:30.839 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_items": 0, 2024-09-19T04:26:30.839 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_bytes": 0, 2024-09-19T04:26:30.839 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_items": 0, 2024-09-19T04:26:30.840 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_bytes": 12281154, 2024-09-19T04:26:30.840 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_items": 83205, 2024-09-19T04:26:30.840 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_bytes": 0, 2024-09-19T04:26:30.840 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_items": 0, 2024-09-19T04:26:30.840 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_bytes": 0, 2024-09-19T04:26:30.840 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_items": 0 2024-09-19T04:26:30.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.840 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter": { 2024-09-19T04:26:30.840 INFO:teuthology.orchestra.run.smithi007.stdout: "op_active": 0, 2024-09-19T04:26:30.840 INFO:teuthology.orchestra.run.smithi007.stdout: "op_laggy": 0, 2024-09-19T04:26:30.840 INFO:teuthology.orchestra.run.smithi007.stdout: "op_send": 309, 2024-09-19T04:26:30.840 INFO:teuthology.orchestra.run.smithi007.stdout: "op_send_bytes": 26, 2024-09-19T04:26:30.840 INFO:teuthology.orchestra.run.smithi007.stdout: "op_resend": 4, 2024-09-19T04:26:30.841 INFO:teuthology.orchestra.run.smithi007.stdout: "op_reply": 309, 2024-09-19T04:26:30.841 INFO:teuthology.orchestra.run.smithi007.stdout: "op_latency": { 2024-09-19T04:26:30.841 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 309, 2024-09-19T04:26:30.841 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.396994228, 2024-09-19T04:26:30.842 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.001284770 2024-09-19T04:26:30.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.842 INFO:teuthology.orchestra.run.smithi007.stdout: "op_inflight": 0, 2024-09-19T04:26:30.842 INFO:teuthology.orchestra.run.smithi007.stdout: "oplen_avg": { 2024-09-19T04:26:30.842 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 309, 2024-09-19T04:26:30.842 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 310 2024-09-19T04:26:30.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.842 INFO:teuthology.orchestra.run.smithi007.stdout: "op": 309, 2024-09-19T04:26:30.842 INFO:teuthology.orchestra.run.smithi007.stdout: "op_r": 309, 2024-09-19T04:26:30.842 INFO:teuthology.orchestra.run.smithi007.stdout: "op_w": 0, 2024-09-19T04:26:30.843 INFO:teuthology.orchestra.run.smithi007.stdout: "op_rmw": 0, 2024-09-19T04:26:30.843 INFO:teuthology.orchestra.run.smithi007.stdout: "op_pg": 0, 2024-09-19T04:26:30.843 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_stat": 175, 2024-09-19T04:26:30.843 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_create": 0, 2024-09-19T04:26:30.843 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_read": 131, 2024-09-19T04:26:30.843 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_write": 0, 2024-09-19T04:26:30.843 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_writefull": 0, 2024-09-19T04:26:30.843 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_writesame": 0, 2024-09-19T04:26:30.843 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_append": 0, 2024-09-19T04:26:30.843 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_zero": 0, 2024-09-19T04:26:30.843 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_truncate": 0, 2024-09-19T04:26:30.843 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_delete": 0, 2024-09-19T04:26:30.843 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_mapext": 0, 2024-09-19T04:26:30.843 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_sparse_read": 0, 2024-09-19T04:26:30.844 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_clonerange": 0, 2024-09-19T04:26:30.844 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_getxattr": 2, 2024-09-19T04:26:30.844 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_setxattr": 0, 2024-09-19T04:26:30.844 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_cmpxattr": 0, 2024-09-19T04:26:30.844 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_rmxattr": 0, 2024-09-19T04:26:30.844 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_resetxattrs": 0, 2024-09-19T04:26:30.844 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_call": 0, 2024-09-19T04:26:30.844 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_watch": 0, 2024-09-19T04:26:30.844 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_notify": 0, 2024-09-19T04:26:30.844 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T04:26:30.844 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_pgls": 0, 2024-09-19T04:26:30.844 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_pgls_filter": 0, 2024-09-19T04:26:30.844 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_other": 0, 2024-09-19T04:26:30.844 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_active": 0, 2024-09-19T04:26:30.845 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_send": 0, 2024-09-19T04:26:30.845 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_resend": 0, 2024-09-19T04:26:30.845 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_ping": 0, 2024-09-19T04:26:30.845 INFO:teuthology.orchestra.run.smithi007.stdout: "poolop_active": 0, 2024-09-19T04:26:30.845 INFO:teuthology.orchestra.run.smithi007.stdout: "poolop_send": 0, 2024-09-19T04:26:30.845 INFO:teuthology.orchestra.run.smithi007.stdout: "poolop_resend": 0, 2024-09-19T04:26:30.845 INFO:teuthology.orchestra.run.smithi007.stdout: "poolstat_active": 0, 2024-09-19T04:26:30.845 INFO:teuthology.orchestra.run.smithi007.stdout: "poolstat_send": 0, 2024-09-19T04:26:30.845 INFO:teuthology.orchestra.run.smithi007.stdout: "poolstat_resend": 0, 2024-09-19T04:26:30.845 INFO:teuthology.orchestra.run.smithi007.stdout: "statfs_active": 0, 2024-09-19T04:26:30.846 INFO:teuthology.orchestra.run.smithi007.stdout: "statfs_send": 0, 2024-09-19T04:26:30.846 INFO:teuthology.orchestra.run.smithi007.stdout: "statfs_resend": 0, 2024-09-19T04:26:30.846 INFO:teuthology.orchestra.run.smithi007.stdout: "command_active": 0, 2024-09-19T04:26:30.846 INFO:teuthology.orchestra.run.smithi007.stdout: "command_send": 0, 2024-09-19T04:26:30.846 INFO:teuthology.orchestra.run.smithi007.stdout: "command_resend": 0, 2024-09-19T04:26:30.846 INFO:teuthology.orchestra.run.smithi007.stdout: "map_epoch": 0, 2024-09-19T04:26:30.846 INFO:teuthology.orchestra.run.smithi007.stdout: "map_full": 0, 2024-09-19T04:26:30.846 INFO:teuthology.orchestra.run.smithi007.stdout: "map_inc": 0, 2024-09-19T04:26:30.846 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_sessions": 9, 2024-09-19T04:26:30.846 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_session_open": 9, 2024-09-19T04:26:30.846 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_session_close": 0, 2024-09-19T04:26:30.846 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_laggy": 0, 2024-09-19T04:26:30.846 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_wr": 0, 2024-09-19T04:26:30.846 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_rd": 2, 2024-09-19T04:26:30.847 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_del": 0 2024-09-19T04:26:30.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.847 INFO:teuthology.orchestra.run.smithi007.stdout: "oft": { 2024-09-19T04:26:30.847 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_objs": 0, 2024-09-19T04:26:30.847 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_kv_pairs": 0, 2024-09-19T04:26:30.847 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_updates": 0, 2024-09-19T04:26:30.847 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_removes": 0 2024-09-19T04:26:30.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.847 INFO:teuthology.orchestra.run.smithi007.stdout: "osd-slow-ops": { 2024-09-19T04:26:30.847 INFO:teuthology.orchestra.run.smithi007.stdout: "slow_ops_count": 0 2024-09-19T04:26:30.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.847 INFO:teuthology.orchestra.run.smithi007.stdout: "purge_queue": { 2024-09-19T04:26:30.847 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing_ops": 0, 2024-09-19T04:26:30.847 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T04:26:30.848 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing": 0, 2024-09-19T04:26:30.848 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing_high_water": 0, 2024-09-19T04:26:30.848 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executed_ops": 0, 2024-09-19T04:26:30.848 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executed": 0, 2024-09-19T04:26:30.848 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_item_in_journal": 0 2024-09-19T04:26:30.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.848 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T04:26:30.848 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-19T04:26:30.848 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-09-19T04:26:30.848 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-19T04:26:30.848 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 524, 2024-09-19T04:26:30.848 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 66931977, 2024-09-19T04:26:30.848 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:30.849 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 524, 2024-09-19T04:26:30.849 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-19T04:26:30.849 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-19T04:26:30.849 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 524, 2024-09-19T04:26:30.849 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 66931977, 2024-09-19T04:26:30.849 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-19T04:26:30.849 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.849 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.849 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.849 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:30.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.849 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-objecter_bytes": { 2024-09-19T04:26:30.849 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-19T04:26:30.850 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-09-19T04:26:30.850 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-19T04:26:30.850 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-09-19T04:26:30.850 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-09-19T04:26:30.850 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:30.850 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:30.850 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 309, 2024-09-19T04:26:30.850 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 66122422, 2024-09-19T04:26:30.850 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 309, 2024-09-19T04:26:30.850 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 66122422, 2024-09-19T04:26:30.850 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-19T04:26:30.850 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.850 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.851 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.851 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:30.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.851 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-objecter_ops": { 2024-09-19T04:26:30.851 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-19T04:26:30.851 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 1024, 2024-09-19T04:26:30.851 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-19T04:26:30.851 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-09-19T04:26:30.851 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-09-19T04:26:30.852 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:30.852 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:30.852 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 309, 2024-09-19T04:26:30.852 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 309, 2024-09-19T04:26:30.852 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 309, 2024-09-19T04:26:30.852 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 309, 2024-09-19T04:26:30.852 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-19T04:26:30.852 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.852 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.852 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.852 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:30.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.852 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-write_buf_throttle": { 2024-09-19T04:26:30.853 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-19T04:26:30.853 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 3758096384, 2024-09-19T04:26:30.853 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-19T04:26:30.853 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-09-19T04:26:30.853 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-09-19T04:26:30.853 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:30.853 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:30.853 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-19T04:26:30.853 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-19T04:26:30.853 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 0, 2024-09-19T04:26:30.853 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 0, 2024-09-19T04:26:30.853 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-19T04:26:30.853 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.854 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.854 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.854 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:30.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:30.854 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-write_buf_throttle-0x557bf30806e0": { 2024-09-19T04:26:30.854 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-19T04:26:30.854 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 3758096384, 2024-09-19T04:26:30.854 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-19T04:26:30.854 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-09-19T04:26:30.854 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-09-19T04:26:30.854 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:30.854 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:30.854 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-19T04:26:30.854 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-19T04:26:30.855 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 0, 2024-09-19T04:26:30.855 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 0, 2024-09-19T04:26:30.855 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-19T04:26:30.855 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:30.855 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:30.855 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:30.855 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:30.855 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:30.855 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:26:31.109 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:30 smithi007 ceph-mon[31360]: pgmap v642: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 624 KiB/s wr, 465 op/s 2024-09-19T04:26:31.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:30 smithi102 ceph-mon[35446]: pgmap v642: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 624 KiB/s wr, 465 op/s 2024-09-19T04:26:31.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:30 smithi092 ceph-mon[34940]: pgmap v642: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 624 KiB/s wr, 465 op/s 2024-09-19T04:26:31.640 INFO:tasks.check_counter:Daemon mds.d mds.exported=0 2024-09-19T04:26:31.640 INFO:tasks.check_counter:Daemon mds.d mds.imported=0 2024-09-19T04:26:31.640 INFO:tasks.check_counter:Daemon mds.d mds.dir_split=0 2024-09-19T04:26:31.640 DEBUG:tasks.check_counter:Getting stats from g 2024-09-19T04:26:31.641 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-19T04:26:31.898 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:26:32.401 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:26:32.401 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T04:26:32.401 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 661, 2024-09-19T04:26:32.401 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 663, 2024-09-19T04:26:32.401 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 222041, 2024-09-19T04:26:32.401 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 210199, 2024-09-19T04:26:32.402 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 6, 2024-09-19T04:26:32.402 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 2, 2024-09-19T04:26:32.402 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.076289518, 2024-09-19T04:26:32.402 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.029494153, 2024-09-19T04:26:32.402 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.017688386, 2024-09-19T04:26:32.402 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.021361955, 2024-09-19T04:26:32.403 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:32.403 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 661, 2024-09-19T04:26:32.403 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.051385398, 2024-09-19T04:26:32.403 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000077738 2024-09-19T04:26:32.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.404 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:32.404 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.404 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.404 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.405 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T04:26:32.405 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T04:26:32.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.405 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T04:26:32.405 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 1321, 2024-09-19T04:26:32.405 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 1468, 2024-09-19T04:26:32.405 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 5893721, 2024-09-19T04:26:32.405 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 751361, 2024-09-19T04:26:32.405 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 5, 2024-09-19T04:26:32.405 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 4, 2024-09-19T04:26:32.405 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.110156146, 2024-09-19T04:26:32.406 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.032038914, 2024-09-19T04:26:32.406 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.031957117, 2024-09-19T04:26:32.406 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.038800953, 2024-09-19T04:26:32.406 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:32.406 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 1467, 2024-09-19T04:26:32.406 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.090469150, 2024-09-19T04:26:32.406 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000061669 2024-09-19T04:26:32.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.406 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:32.406 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.406 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.406 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.407 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-09-19T04:26:32.407 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 332816 2024-09-19T04:26:32.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.407 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T04:26:32.407 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 231, 2024-09-19T04:26:32.407 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 210, 2024-09-19T04:26:32.407 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 879684, 2024-09-19T04:26:32.407 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 124005, 2024-09-19T04:26:32.407 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 4, 2024-09-19T04:26:32.407 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 3, 2024-09-19T04:26:32.407 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.038117467, 2024-09-19T04:26:32.408 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.014361927, 2024-09-19T04:26:32.408 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.031206744, 2024-09-19T04:26:32.408 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000071705, 2024-09-19T04:26:32.408 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:32.408 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 209, 2024-09-19T04:26:32.408 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.015365323, 2024-09-19T04:26:32.408 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000073518 2024-09-19T04:26:32.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.408 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:32.408 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.408 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.408 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.409 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 878336, 2024-09-19T04:26:32.409 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 123040 2024-09-19T04:26:32.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.409 INFO:teuthology.orchestra.run.smithi007.stdout: "cct": { 2024-09-19T04:26:32.409 INFO:teuthology.orchestra.run.smithi007.stdout: "total_workers": 1, 2024-09-19T04:26:32.409 INFO:teuthology.orchestra.run.smithi007.stdout: "unhealthy_workers": 0 2024-09-19T04:26:32.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.409 INFO:teuthology.orchestra.run.smithi007.stdout: "finisher-MDSRank": { 2024-09-19T04:26:32.410 INFO:teuthology.orchestra.run.smithi007.stdout: "queue_len": 0, 2024-09-19T04:26:32.410 INFO:teuthology.orchestra.run.smithi007.stdout: "complete_latency": { 2024-09-19T04:26:32.410 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 3311, 2024-09-19T04:26:32.410 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.082971100, 2024-09-19T04:26:32.410 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000025059 2024-09-19T04:26:32.410 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:32.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.410 INFO:teuthology.orchestra.run.smithi007.stdout: "finisher-PurgeQueue": { 2024-09-19T04:26:32.410 INFO:teuthology.orchestra.run.smithi007.stdout: "queue_len": 0, 2024-09-19T04:26:32.410 INFO:teuthology.orchestra.run.smithi007.stdout: "complete_latency": { 2024-09-19T04:26:32.410 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.410 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.411 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.411 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:32.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.411 INFO:teuthology.orchestra.run.smithi007.stdout: "mds": { 2024-09-19T04:26:32.411 INFO:teuthology.orchestra.run.smithi007.stdout: "request": 0, 2024-09-19T04:26:32.411 INFO:teuthology.orchestra.run.smithi007.stdout: "reply": 0, 2024-09-19T04:26:32.411 INFO:teuthology.orchestra.run.smithi007.stdout: "reply_latency": { 2024-09-19T04:26:32.411 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.411 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.411 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.411 INFO:teuthology.orchestra.run.smithi007.stdout: "slow_reply": 0, 2024-09-19T04:26:32.411 INFO:teuthology.orchestra.run.smithi007.stdout: "forward": 0, 2024-09-19T04:26:32.412 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_fetch_complete": 0, 2024-09-19T04:26:32.412 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_fetch_keys": 0, 2024-09-19T04:26:32.412 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_commit": 0, 2024-09-19T04:26:32.412 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_split": 0, 2024-09-19T04:26:32.412 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_merge": 0, 2024-09-19T04:26:32.412 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes": 721, 2024-09-19T04:26:32.412 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_top": 0, 2024-09-19T04:26:32.412 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_bottom": 721, 2024-09-19T04:26:32.412 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_pin_tail": 0, 2024-09-19T04:26:32.412 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_pinned": 721, 2024-09-19T04:26:32.412 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_expired": 0, 2024-09-19T04:26:32.412 INFO:teuthology.orchestra.run.smithi007.stdout: "inodes_with_caps": 0, 2024-09-19T04:26:32.413 INFO:teuthology.orchestra.run.smithi007.stdout: "caps": 0, 2024-09-19T04:26:32.413 INFO:teuthology.orchestra.run.smithi007.stdout: "subtrees": 1, 2024-09-19T04:26:32.413 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse": 0, 2024-09-19T04:26:32.413 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_hit": 0, 2024-09-19T04:26:32.413 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_forward": 0, 2024-09-19T04:26:32.413 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_discover": 0, 2024-09-19T04:26:32.413 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_dir_fetch": 0, 2024-09-19T04:26:32.413 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_remote_ino": 0, 2024-09-19T04:26:32.413 INFO:teuthology.orchestra.run.smithi007.stdout: "traverse_lock": 0, 2024-09-19T04:26:32.413 INFO:teuthology.orchestra.run.smithi007.stdout: "load_cent": 0, 2024-09-19T04:26:32.413 INFO:teuthology.orchestra.run.smithi007.stdout: "q": 0, 2024-09-19T04:26:32.413 INFO:teuthology.orchestra.run.smithi007.stdout: "exported": 0, 2024-09-19T04:26:32.414 INFO:teuthology.orchestra.run.smithi007.stdout: "exported_inodes": 0, 2024-09-19T04:26:32.414 INFO:teuthology.orchestra.run.smithi007.stdout: "imported": 0, 2024-09-19T04:26:32.414 INFO:teuthology.orchestra.run.smithi007.stdout: "imported_inodes": 0, 2024-09-19T04:26:32.414 INFO:teuthology.orchestra.run.smithi007.stdout: "openino_dir_fetch": 0, 2024-09-19T04:26:32.414 INFO:teuthology.orchestra.run.smithi007.stdout: "openino_backtrace_fetch": 0, 2024-09-19T04:26:32.414 INFO:teuthology.orchestra.run.smithi007.stdout: "openino_peer_discover": 0, 2024-09-19T04:26:32.414 INFO:teuthology.orchestra.run.smithi007.stdout: "root_rfiles": 0, 2024-09-19T04:26:32.414 INFO:teuthology.orchestra.run.smithi007.stdout: "root_rbytes": 0, 2024-09-19T04:26:32.414 INFO:teuthology.orchestra.run.smithi007.stdout: "root_rsnaps": 0, 2024-09-19T04:26:32.414 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T04:26:32.414 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_set_tag": 0, 2024-09-19T04:26:32.414 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T04:26:32.414 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_inotable_repaired": 0, 2024-09-19T04:26:32.415 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_dir_inodes": 0, 2024-09-19T04:26:32.415 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T04:26:32.415 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T04:26:32.415 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_file_inodes": 0, 2024-09-19T04:26:32.415 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_inode_file_caps": 0, 2024-09-19T04:26:32.415 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T04:26:32.415 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_grant": 0, 2024-09-19T04:26:32.415 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T04:26:32.415 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T04:26:32.415 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T04:26:32.415 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_caps": 0, 2024-09-19T04:26:32.415 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_caps_dirty": 0, 2024-09-19T04:26:32.415 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_cap_release": 0, 2024-09-19T04:26:32.416 INFO:teuthology.orchestra.run.smithi007.stdout: "process_request_cap_release": 0 2024-09-19T04:26:32.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.416 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache": { 2024-09-19T04:26:32.416 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_update": 0, 2024-09-19T04:26:32.416 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_update_receipt": 0, 2024-09-19T04:26:32.416 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_try_discover": 0, 2024-09-19T04:26:32.416 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_send_discover": 0, 2024-09-19T04:26:32.416 INFO:teuthology.orchestra.run.smithi007.stdout: "dir_handle_discover": 0, 2024-09-19T04:26:32.416 INFO:teuthology.orchestra.run.smithi007.stdout: "num_strays": 0, 2024-09-19T04:26:32.416 INFO:teuthology.orchestra.run.smithi007.stdout: "num_strays_delayed": 0, 2024-09-19T04:26:32.416 INFO:teuthology.orchestra.run.smithi007.stdout: "num_strays_enqueuing": 0, 2024-09-19T04:26:32.416 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_created": 0, 2024-09-19T04:26:32.417 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_enqueued": 0, 2024-09-19T04:26:32.417 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_reintegrated": 0, 2024-09-19T04:26:32.417 INFO:teuthology.orchestra.run.smithi007.stdout: "strays_migrated": 0, 2024-09-19T04:26:32.417 INFO:teuthology.orchestra.run.smithi007.stdout: "num_recovering_processing": 0, 2024-09-19T04:26:32.417 INFO:teuthology.orchestra.run.smithi007.stdout: "num_recovering_enqueued": 0, 2024-09-19T04:26:32.417 INFO:teuthology.orchestra.run.smithi007.stdout: "num_recovering_prioritized": 0, 2024-09-19T04:26:32.417 INFO:teuthology.orchestra.run.smithi007.stdout: "recovery_started": 0, 2024-09-19T04:26:32.417 INFO:teuthology.orchestra.run.smithi007.stdout: "recovery_completed": 0, 2024-09-19T04:26:32.417 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_quiesce_path": 0, 2024-09-19T04:26:32.417 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_quiesce_inode": 0, 2024-09-19T04:26:32.418 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T04:26:32.418 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_exportdir": 0, 2024-09-19T04:26:32.418 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_flush": 0, 2024-09-19T04:26:32.418 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_fragmentdir": 0, 2024-09-19T04:26:32.418 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_fragstats": 0, 2024-09-19T04:26:32.418 INFO:teuthology.orchestra.run.smithi007.stdout: "ireq_inodestats": 0 2024-09-19T04:26:32.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.418 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log": { 2024-09-19T04:26:32.418 INFO:teuthology.orchestra.run.smithi007.stdout: "evlrg": 0, 2024-09-19T04:26:32.419 INFO:teuthology.orchestra.run.smithi007.stdout: "evadd": 0, 2024-09-19T04:26:32.419 INFO:teuthology.orchestra.run.smithi007.stdout: "evex": 0, 2024-09-19T04:26:32.419 INFO:teuthology.orchestra.run.smithi007.stdout: "evtrm": 0, 2024-09-19T04:26:32.419 INFO:teuthology.orchestra.run.smithi007.stdout: "ev": 3772, 2024-09-19T04:26:32.419 INFO:teuthology.orchestra.run.smithi007.stdout: "evexg": 0, 2024-09-19T04:26:32.419 INFO:teuthology.orchestra.run.smithi007.stdout: "evexd": 0, 2024-09-19T04:26:32.419 INFO:teuthology.orchestra.run.smithi007.stdout: "segadd": 0, 2024-09-19T04:26:32.419 INFO:teuthology.orchestra.run.smithi007.stdout: "segex": 0, 2024-09-19T04:26:32.419 INFO:teuthology.orchestra.run.smithi007.stdout: "segtrm": 0, 2024-09-19T04:26:32.419 INFO:teuthology.orchestra.run.smithi007.stdout: "seg": 5, 2024-09-19T04:26:32.419 INFO:teuthology.orchestra.run.smithi007.stdout: "segmjr": 2, 2024-09-19T04:26:32.419 INFO:teuthology.orchestra.run.smithi007.stdout: "segexg": 0, 2024-09-19T04:26:32.420 INFO:teuthology.orchestra.run.smithi007.stdout: "segexd": 0, 2024-09-19T04:26:32.420 INFO:teuthology.orchestra.run.smithi007.stdout: "expos": 4194304, 2024-09-19T04:26:32.420 INFO:teuthology.orchestra.run.smithi007.stdout: "wrpos": 9750241, 2024-09-19T04:26:32.420 INFO:teuthology.orchestra.run.smithi007.stdout: "rdpos": 9749103, 2024-09-19T04:26:32.420 INFO:teuthology.orchestra.run.smithi007.stdout: "jlat": { 2024-09-19T04:26:32.420 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.420 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.420 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.420 INFO:teuthology.orchestra.run.smithi007.stdout: "replayed": 3772 2024-09-19T04:26:32.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.420 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_mem": { 2024-09-19T04:26:32.420 INFO:teuthology.orchestra.run.smithi007.stdout: "ino": 7, 2024-09-19T04:26:32.421 INFO:teuthology.orchestra.run.smithi007.stdout: "ino+": 742, 2024-09-19T04:26:32.421 INFO:teuthology.orchestra.run.smithi007.stdout: "ino-": 735, 2024-09-19T04:26:32.421 INFO:teuthology.orchestra.run.smithi007.stdout: "dir": 5, 2024-09-19T04:26:32.421 INFO:teuthology.orchestra.run.smithi007.stdout: "dir+": 58, 2024-09-19T04:26:32.421 INFO:teuthology.orchestra.run.smithi007.stdout: "dir-": 53, 2024-09-19T04:26:32.421 INFO:teuthology.orchestra.run.smithi007.stdout: "dn": 721, 2024-09-19T04:26:32.421 INFO:teuthology.orchestra.run.smithi007.stdout: "dn+": 1701, 2024-09-19T04:26:32.421 INFO:teuthology.orchestra.run.smithi007.stdout: "dn-": 980, 2024-09-19T04:26:32.421 INFO:teuthology.orchestra.run.smithi007.stdout: "cap": 0, 2024-09-19T04:26:32.421 INFO:teuthology.orchestra.run.smithi007.stdout: "cap+": 0, 2024-09-19T04:26:32.421 INFO:teuthology.orchestra.run.smithi007.stdout: "cap-": 0, 2024-09-19T04:26:32.422 INFO:teuthology.orchestra.run.smithi007.stdout: "rss": 51528, 2024-09-19T04:26:32.422 INFO:teuthology.orchestra.run.smithi007.stdout: "heap": 215328 2024-09-19T04:26:32.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.422 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_server": { 2024-09-19T04:26:32.422 INFO:teuthology.orchestra.run.smithi007.stdout: "dispatch_client_request": 0, 2024-09-19T04:26:32.422 INFO:teuthology.orchestra.run.smithi007.stdout: "dispatch_server_request": 0, 2024-09-19T04:26:32.422 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_request": 0, 2024-09-19T04:26:32.423 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_client_session": 0, 2024-09-19T04:26:32.423 INFO:teuthology.orchestra.run.smithi007.stdout: "handle_peer_request": 0, 2024-09-19T04:26:32.423 INFO:teuthology.orchestra.run.smithi007.stdout: "req_create_latency": { 2024-09-19T04:26:32.423 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.423 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.423 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.424 INFO:teuthology.orchestra.run.smithi007.stdout: "req_getattr_latency": { 2024-09-19T04:26:32.424 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.424 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.424 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.424 INFO:teuthology.orchestra.run.smithi007.stdout: "req_getfilelock_latency": { 2024-09-19T04:26:32.425 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.425 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.425 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.425 INFO:teuthology.orchestra.run.smithi007.stdout: "req_link_latency": { 2024-09-19T04:26:32.425 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.425 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.425 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.426 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookup_latency": { 2024-09-19T04:26:32.426 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.426 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.426 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.426 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookuphash_latency": { 2024-09-19T04:26:32.426 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.426 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.426 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.426 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupino_latency": { 2024-09-19T04:26:32.426 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.427 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.427 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.427 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupname_latency": { 2024-09-19T04:26:32.427 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.427 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.427 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.427 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupparent_latency": { 2024-09-19T04:26:32.428 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.428 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.428 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.428 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lookupsnap_latency": { 2024-09-19T04:26:32.428 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.428 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.428 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.428 INFO:teuthology.orchestra.run.smithi007.stdout: "req_lssnap_latency": { 2024-09-19T04:26:32.428 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.429 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.429 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.429 INFO:teuthology.orchestra.run.smithi007.stdout: "req_mkdir_latency": { 2024-09-19T04:26:32.430 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.430 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.430 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.430 INFO:teuthology.orchestra.run.smithi007.stdout: "req_mknod_latency": { 2024-09-19T04:26:32.430 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.430 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.430 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.431 INFO:teuthology.orchestra.run.smithi007.stdout: "req_mksnap_latency": { 2024-09-19T04:26:32.431 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.431 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.431 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.431 INFO:teuthology.orchestra.run.smithi007.stdout: "req_open_latency": { 2024-09-19T04:26:32.432 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.432 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.432 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.432 INFO:teuthology.orchestra.run.smithi007.stdout: "req_readdir_latency": { 2024-09-19T04:26:32.432 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.433 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.433 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.433 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.433 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rename_latency": { 2024-09-19T04:26:32.433 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.433 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.434 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.434 INFO:teuthology.orchestra.run.smithi007.stdout: "req_renamesnap_latency": { 2024-09-19T04:26:32.434 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.434 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.434 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.435 INFO:teuthology.orchestra.run.smithi007.stdout: "req_snapdiff_latency": { 2024-09-19T04:26:32.435 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.435 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.435 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.436 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rmdir_latency": { 2024-09-19T04:26:32.436 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.436 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.436 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.437 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rmsnap_latency": { 2024-09-19T04:26:32.437 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.437 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.437 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.437 INFO:teuthology.orchestra.run.smithi007.stdout: "req_rmxattr_latency": { 2024-09-19T04:26:32.437 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.438 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.438 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.438 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setattr_latency": { 2024-09-19T04:26:32.438 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.438 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.438 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.438 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setdirlayout_latency": { 2024-09-19T04:26:32.438 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.438 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.438 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.439 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setfilelock_latency": { 2024-09-19T04:26:32.439 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.439 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.439 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.439 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setlayout_latency": { 2024-09-19T04:26:32.439 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.439 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.439 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.439 INFO:teuthology.orchestra.run.smithi007.stdout: "req_setxattr_latency": { 2024-09-19T04:26:32.439 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.439 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.440 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.440 INFO:teuthology.orchestra.run.smithi007.stdout: "req_symlink_latency": { 2024-09-19T04:26:32.440 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.440 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.440 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.440 INFO:teuthology.orchestra.run.smithi007.stdout: "req_unlink_latency": { 2024-09-19T04:26:32.440 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.440 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.441 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.441 INFO:teuthology.orchestra.run.smithi007.stdout: "cap_revoke_eviction": 0, 2024-09-19T04:26:32.441 INFO:teuthology.orchestra.run.smithi007.stdout: "cap_acquisition_throttle": 0, 2024-09-19T04:26:32.441 INFO:teuthology.orchestra.run.smithi007.stdout: "req_getvxattr_latency": { 2024-09-19T04:26:32.441 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.441 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.441 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.441 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:32.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.441 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_sessions": { 2024-09-19T04:26:32.441 INFO:teuthology.orchestra.run.smithi007.stdout: "session_count": 1, 2024-09-19T04:26:32.442 INFO:teuthology.orchestra.run.smithi007.stdout: "session_add": 3, 2024-09-19T04:26:32.442 INFO:teuthology.orchestra.run.smithi007.stdout: "session_remove": 2, 2024-09-19T04:26:32.442 INFO:teuthology.orchestra.run.smithi007.stdout: "sessions_open": 2, 2024-09-19T04:26:32.442 INFO:teuthology.orchestra.run.smithi007.stdout: "sessions_stale": 0, 2024-09-19T04:26:32.442 INFO:teuthology.orchestra.run.smithi007.stdout: "total_load": 0, 2024-09-19T04:26:32.442 INFO:teuthology.orchestra.run.smithi007.stdout: "average_load": 0, 2024-09-19T04:26:32.442 INFO:teuthology.orchestra.run.smithi007.stdout: "avg_session_uptime": 2720, 2024-09-19T04:26:32.442 INFO:teuthology.orchestra.run.smithi007.stdout: "mdthresh_evicted": 0 2024-09-19T04:26:32.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.442 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool": { 2024-09-19T04:26:32.442 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_bytes": 0, 2024-09-19T04:26:32.442 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_items": 0, 2024-09-19T04:26:32.442 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T04:26:32.443 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_items": 0, 2024-09-19T04:26:32.443 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T04:26:32.443 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_items": 0, 2024-09-19T04:26:32.443 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T04:26:32.443 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T04:26:32.443 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T04:26:32.443 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T04:26:32.443 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T04:26:32.443 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_items": 0, 2024-09-19T04:26:32.443 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T04:26:32.443 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T04:26:32.443 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_bytes": 0, 2024-09-19T04:26:32.443 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_items": 0, 2024-09-19T04:26:32.443 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_bytes": 0, 2024-09-19T04:26:32.444 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_items": 0, 2024-09-19T04:26:32.444 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T04:26:32.444 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T04:26:32.444 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T04:26:32.444 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T04:26:32.444 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T04:26:32.444 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_items": 0, 2024-09-19T04:26:32.444 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_bytes": 0, 2024-09-19T04:26:32.444 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_items": 0, 2024-09-19T04:26:32.444 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T04:26:32.444 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T04:26:32.444 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_bytes": 0, 2024-09-19T04:26:32.445 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_items": 0, 2024-09-19T04:26:32.445 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_bytes": 0, 2024-09-19T04:26:32.445 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_items": 0, 2024-09-19T04:26:32.445 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T04:26:32.445 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_items": 0, 2024-09-19T04:26:32.445 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T04:26:32.445 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_items": 0, 2024-09-19T04:26:32.445 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_bytes": 197543, 2024-09-19T04:26:32.445 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_items": 56, 2024-09-19T04:26:32.445 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_bytes": 0, 2024-09-19T04:26:32.446 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_items": 0, 2024-09-19T04:26:32.446 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bytes": 0, 2024-09-19T04:26:32.446 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_items": 0, 2024-09-19T04:26:32.446 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_bytes": 0, 2024-09-19T04:26:32.446 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_items": 0, 2024-09-19T04:26:32.446 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_bytes": 0, 2024-09-19T04:26:32.446 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_items": 0, 2024-09-19T04:26:32.446 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_bytes": 9056, 2024-09-19T04:26:32.446 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_items": 171, 2024-09-19T04:26:32.446 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T04:26:32.446 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_items": 0, 2024-09-19T04:26:32.446 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_bytes": 0, 2024-09-19T04:26:32.446 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_items": 0, 2024-09-19T04:26:32.447 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_bytes": 530152, 2024-09-19T04:26:32.447 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_items": 2946, 2024-09-19T04:26:32.447 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_bytes": 0, 2024-09-19T04:26:32.447 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_items": 0, 2024-09-19T04:26:32.447 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_bytes": 0, 2024-09-19T04:26:32.447 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_items": 0 2024-09-19T04:26:32.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.447 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter": { 2024-09-19T04:26:32.447 INFO:teuthology.orchestra.run.smithi007.stdout: "op_active": 0, 2024-09-19T04:26:32.447 INFO:teuthology.orchestra.run.smithi007.stdout: "op_laggy": 0, 2024-09-19T04:26:32.447 INFO:teuthology.orchestra.run.smithi007.stdout: "op_send": 1980, 2024-09-19T04:26:32.447 INFO:teuthology.orchestra.run.smithi007.stdout: "op_send_bytes": 21, 2024-09-19T04:26:32.448 INFO:teuthology.orchestra.run.smithi007.stdout: "op_resend": 3, 2024-09-19T04:26:32.448 INFO:teuthology.orchestra.run.smithi007.stdout: "op_reply": 1980, 2024-09-19T04:26:32.448 INFO:teuthology.orchestra.run.smithi007.stdout: "op_latency": { 2024-09-19T04:26:32.448 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 1980, 2024-09-19T04:26:32.448 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 15.870762850, 2024-09-19T04:26:32.448 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.008015536 2024-09-19T04:26:32.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.448 INFO:teuthology.orchestra.run.smithi007.stdout: "op_inflight": 0, 2024-09-19T04:26:32.448 INFO:teuthology.orchestra.run.smithi007.stdout: "oplen_avg": { 2024-09-19T04:26:32.448 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 1980, 2024-09-19T04:26:32.448 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 1981 2024-09-19T04:26:32.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.449 INFO:teuthology.orchestra.run.smithi007.stdout: "op": 1980, 2024-09-19T04:26:32.449 INFO:teuthology.orchestra.run.smithi007.stdout: "op_r": 1980, 2024-09-19T04:26:32.449 INFO:teuthology.orchestra.run.smithi007.stdout: "op_w": 0, 2024-09-19T04:26:32.449 INFO:teuthology.orchestra.run.smithi007.stdout: "op_rmw": 0, 2024-09-19T04:26:32.449 INFO:teuthology.orchestra.run.smithi007.stdout: "op_pg": 0, 2024-09-19T04:26:32.449 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_stat": 1232, 2024-09-19T04:26:32.449 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_create": 0, 2024-09-19T04:26:32.449 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_read": 746, 2024-09-19T04:26:32.449 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_write": 0, 2024-09-19T04:26:32.449 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_writefull": 0, 2024-09-19T04:26:32.449 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_writesame": 0, 2024-09-19T04:26:32.449 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_append": 0, 2024-09-19T04:26:32.449 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_zero": 0, 2024-09-19T04:26:32.450 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_truncate": 0, 2024-09-19T04:26:32.450 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_delete": 0, 2024-09-19T04:26:32.450 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_mapext": 0, 2024-09-19T04:26:32.450 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_sparse_read": 0, 2024-09-19T04:26:32.450 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_clonerange": 0, 2024-09-19T04:26:32.450 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_getxattr": 1, 2024-09-19T04:26:32.450 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_setxattr": 0, 2024-09-19T04:26:32.450 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_cmpxattr": 0, 2024-09-19T04:26:32.450 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_rmxattr": 0, 2024-09-19T04:26:32.450 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_resetxattrs": 0, 2024-09-19T04:26:32.450 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_call": 0, 2024-09-19T04:26:32.450 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_watch": 0, 2024-09-19T04:26:32.451 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_notify": 0, 2024-09-19T04:26:32.451 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T04:26:32.451 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_pgls": 0, 2024-09-19T04:26:32.451 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_pgls_filter": 0, 2024-09-19T04:26:32.451 INFO:teuthology.orchestra.run.smithi007.stdout: "osdop_other": 0, 2024-09-19T04:26:32.451 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_active": 0, 2024-09-19T04:26:32.451 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_send": 0, 2024-09-19T04:26:32.451 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_resend": 0, 2024-09-19T04:26:32.451 INFO:teuthology.orchestra.run.smithi007.stdout: "linger_ping": 0, 2024-09-19T04:26:32.451 INFO:teuthology.orchestra.run.smithi007.stdout: "poolop_active": 0, 2024-09-19T04:26:32.451 INFO:teuthology.orchestra.run.smithi007.stdout: "poolop_send": 0, 2024-09-19T04:26:32.451 INFO:teuthology.orchestra.run.smithi007.stdout: "poolop_resend": 0, 2024-09-19T04:26:32.452 INFO:teuthology.orchestra.run.smithi007.stdout: "poolstat_active": 0, 2024-09-19T04:26:32.452 INFO:teuthology.orchestra.run.smithi007.stdout: "poolstat_send": 0, 2024-09-19T04:26:32.452 INFO:teuthology.orchestra.run.smithi007.stdout: "poolstat_resend": 0, 2024-09-19T04:26:32.452 INFO:teuthology.orchestra.run.smithi007.stdout: "statfs_active": 0, 2024-09-19T04:26:32.452 INFO:teuthology.orchestra.run.smithi007.stdout: "statfs_send": 0, 2024-09-19T04:26:32.452 INFO:teuthology.orchestra.run.smithi007.stdout: "statfs_resend": 0, 2024-09-19T04:26:32.452 INFO:teuthology.orchestra.run.smithi007.stdout: "command_active": 0, 2024-09-19T04:26:32.452 INFO:teuthology.orchestra.run.smithi007.stdout: "command_send": 0, 2024-09-19T04:26:32.452 INFO:teuthology.orchestra.run.smithi007.stdout: "command_resend": 0, 2024-09-19T04:26:32.452 INFO:teuthology.orchestra.run.smithi007.stdout: "map_epoch": 90, 2024-09-19T04:26:32.452 INFO:teuthology.orchestra.run.smithi007.stdout: "map_full": 0, 2024-09-19T04:26:32.452 INFO:teuthology.orchestra.run.smithi007.stdout: "map_inc": 4, 2024-09-19T04:26:32.453 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_sessions": 6, 2024-09-19T04:26:32.453 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_session_open": 6, 2024-09-19T04:26:32.453 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_session_close": 0, 2024-09-19T04:26:32.453 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_laggy": 0, 2024-09-19T04:26:32.453 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_wr": 0, 2024-09-19T04:26:32.453 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_rd": 2, 2024-09-19T04:26:32.453 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_del": 0 2024-09-19T04:26:32.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.453 INFO:teuthology.orchestra.run.smithi007.stdout: "oft": { 2024-09-19T04:26:32.454 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_objs": 0, 2024-09-19T04:26:32.454 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_kv_pairs": 0, 2024-09-19T04:26:32.454 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_updates": 0, 2024-09-19T04:26:32.454 INFO:teuthology.orchestra.run.smithi007.stdout: "omap_total_removes": 0 2024-09-19T04:26:32.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.454 INFO:teuthology.orchestra.run.smithi007.stdout: "osd-slow-ops": { 2024-09-19T04:26:32.454 INFO:teuthology.orchestra.run.smithi007.stdout: "slow_ops_count": 0 2024-09-19T04:26:32.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.454 INFO:teuthology.orchestra.run.smithi007.stdout: "purge_queue": { 2024-09-19T04:26:32.454 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing_ops": 0, 2024-09-19T04:26:32.454 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T04:26:32.454 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing": 0, 2024-09-19T04:26:32.455 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executing_high_water": 0, 2024-09-19T04:26:32.455 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executed_ops": 0, 2024-09-19T04:26:32.455 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_executed": 0, 2024-09-19T04:26:32.455 INFO:teuthology.orchestra.run.smithi007.stdout: "pq_item_in_journal": 0 2024-09-19T04:26:32.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.455 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T04:26:32.456 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-19T04:26:32.456 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-09-19T04:26:32.456 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-19T04:26:32.456 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 2209, 2024-09-19T04:26:32.456 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 6781968, 2024-09-19T04:26:32.456 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:32.457 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 2209, 2024-09-19T04:26:32.457 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-19T04:26:32.457 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-19T04:26:32.457 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 2209, 2024-09-19T04:26:32.457 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 6781968, 2024-09-19T04:26:32.457 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-19T04:26:32.457 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.458 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.458 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.458 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:32.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.458 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-objecter_bytes": { 2024-09-19T04:26:32.458 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-19T04:26:32.458 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-09-19T04:26:32.458 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-19T04:26:32.458 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-09-19T04:26:32.458 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-09-19T04:26:32.458 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:32.458 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:32.459 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 1980, 2024-09-19T04:26:32.459 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 5555942, 2024-09-19T04:26:32.459 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 1980, 2024-09-19T04:26:32.459 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 5555942, 2024-09-19T04:26:32.459 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-19T04:26:32.459 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.459 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.459 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.460 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:32.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.460 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-objecter_ops": { 2024-09-19T04:26:32.460 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-19T04:26:32.460 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 1024, 2024-09-19T04:26:32.460 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-19T04:26:32.461 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-09-19T04:26:32.461 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-09-19T04:26:32.461 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:32.461 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:32.461 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 1980, 2024-09-19T04:26:32.461 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 1980, 2024-09-19T04:26:32.461 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 1980, 2024-09-19T04:26:32.461 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 1980, 2024-09-19T04:26:32.461 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-19T04:26:32.461 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.461 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.461 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.461 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:32.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.462 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-write_buf_throttle": { 2024-09-19T04:26:32.462 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-19T04:26:32.462 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 3758096384, 2024-09-19T04:26:32.462 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-19T04:26:32.462 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-09-19T04:26:32.462 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-09-19T04:26:32.462 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:32.462 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:32.462 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-19T04:26:32.462 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-19T04:26:32.462 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 0, 2024-09-19T04:26:32.462 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 0, 2024-09-19T04:26:32.462 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-19T04:26:32.463 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.463 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.463 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.463 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:32.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:32.463 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-write_buf_throttle-0x562ed1cba6e0": { 2024-09-19T04:26:32.463 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-19T04:26:32.463 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 3758096384, 2024-09-19T04:26:32.463 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-19T04:26:32.463 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 0, 2024-09-19T04:26:32.463 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 0, 2024-09-19T04:26:32.463 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:32.463 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:32.463 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-19T04:26:32.464 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-19T04:26:32.464 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 0, 2024-09-19T04:26:32.464 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 0, 2024-09-19T04:26:32.464 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-19T04:26:32.464 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:32.464 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:32.464 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:32.464 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:32.464 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:32.464 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:26:33.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:32 smithi007 ceph-mon[31360]: pgmap v643: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 330 KiB/s wr, 245 op/s 2024-09-19T04:26:33.159 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:32 smithi102 ceph-mon[35446]: pgmap v643: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 330 KiB/s wr, 245 op/s 2024-09-19T04:26:33.254 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-19T04:26:33.255 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-19T04:26:33.255 INFO:tasks.check_counter:Daemon mds.g mds.dir_split=0 2024-09-19T04:26:33.255 DEBUG:tasks.check_counter:Getting stats from j 2024-09-19T04:26:33.255 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-19T04:26:33.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:32 smithi092 ceph-mon[34940]: pgmap v643: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 330 KiB/s wr, 245 op/s 2024-09-19T04:26:33.514 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:26:34.038 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-19T04:26:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T04:26:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 209, 2024-09-19T04:26:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 204, 2024-09-19T04:26:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 753568, 2024-09-19T04:26:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 125344, 2024-09-19T04:26:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 4, 2024-09-19T04:26:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 0, 2024-09-19T04:26:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.035542765, 2024-09-19T04:26:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.013461696, 2024-09-19T04:26:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.027777525, 2024-09-19T04:26:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T04:26:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 203, 2024-09-19T04:26:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.012506937, 2024-09-19T04:26:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000061610 2024-09-19T04:26:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 753568, 2024-09-19T04:26:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 125344 2024-09-19T04:26:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T04:26:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 1, 2024-09-19T04:26:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 155, 2024-09-19T04:26:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 160, 2024-09-19T04:26:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 105808, 2024-09-19T04:26:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 3, 2024-09-19T04:26:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 2, 2024-09-19T04:26:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.012585479, 2024-09-19T04:26:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.009553691, 2024-09-19T04:26:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.001319267, 2024-09-19T04:26:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T04:26:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 153, 2024-09-19T04:26:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.007245938, 2024-09-19T04:26:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000047359 2024-09-19T04:26:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T04:26:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 105808 2024-09-19T04:26:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T04:26:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 4, 2024-09-19T04:26:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 4, 2024-09-19T04:26:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 3024, 2024-09-19T04:26:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 448, 2024-09-19T04:26:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 2, 2024-09-19T04:26:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 1, 2024-09-19T04:26:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.002304814, 2024-09-19T04:26:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.000042291, 2024-09-19T04:26:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.002244830, 2024-09-19T04:26:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T04:26:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 3, 2024-09-19T04:26:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.004080634, 2024-09-19T04:26:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.001360211 2024-09-19T04:26:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-19T04:26:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T04:26:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "cct": { 2024-09-19T04:26:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "total_workers": 0, 2024-09-19T04:26:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "unhealthy_workers": 0 2024-09-19T04:26:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool": { 2024-09-19T04:26:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_bytes": 0, 2024-09-19T04:26:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_items": 0, 2024-09-19T04:26:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T04:26:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_items": 0, 2024-09-19T04:26:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T04:26:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_items": 0, 2024-09-19T04:26:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T04:26:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T04:26:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T04:26:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T04:26:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T04:26:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_items": 0, 2024-09-19T04:26:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T04:26:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T04:26:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_bytes": 0, 2024-09-19T04:26:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_items": 0, 2024-09-19T04:26:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_bytes": 0, 2024-09-19T04:26:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_items": 0, 2024-09-19T04:26:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T04:26:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T04:26:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T04:26:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T04:26:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T04:26:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_items": 0, 2024-09-19T04:26:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_bytes": 0, 2024-09-19T04:26:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_items": 0, 2024-09-19T04:26:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T04:26:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T04:26:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_bytes": 0, 2024-09-19T04:26:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_items": 0, 2024-09-19T04:26:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_bytes": 0, 2024-09-19T04:26:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_items": 0, 2024-09-19T04:26:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T04:26:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_items": 0, 2024-09-19T04:26:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T04:26:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_items": 0, 2024-09-19T04:26:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_bytes": 148967, 2024-09-19T04:26:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_items": 29, 2024-09-19T04:26:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_bytes": 0, 2024-09-19T04:26:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_items": 0, 2024-09-19T04:26:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bytes": 0, 2024-09-19T04:26:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_items": 0, 2024-09-19T04:26:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_bytes": 0, 2024-09-19T04:26:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_items": 0, 2024-09-19T04:26:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_bytes": 0, 2024-09-19T04:26:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_items": 0, 2024-09-19T04:26:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_bytes": 0, 2024-09-19T04:26:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_items": 0, 2024-09-19T04:26:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T04:26:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_items": 0, 2024-09-19T04:26:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_bytes": 0, 2024-09-19T04:26:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_items": 0, 2024-09-19T04:26:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_bytes": 928, 2024-09-19T04:26:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_items": 2, 2024-09-19T04:26:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_bytes": 0, 2024-09-19T04:26:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_items": 0, 2024-09-19T04:26:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_bytes": 0, 2024-09-19T04:26:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_items": 0 2024-09-19T04:26:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-19T04:26:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T04:26:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-19T04:26:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-09-19T04:26:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-19T04:26:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 210, 2024-09-19T04:26:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 724033, 2024-09-19T04:26:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 210, 2024-09-19T04:26:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-19T04:26:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-19T04:26:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 210, 2024-09-19T04:26:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 724033, 2024-09-19T04:26:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-19T04:26:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-19T04:26:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-19T04:26:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-19T04:26:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:34.052 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-19T04:26:34.052 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-19T04:26:34.759 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-19T04:26:34.760 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-19T04:26:34.760 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-09-19T04:26:34.760 DEBUG:tasks.check_counter:Getting stats from b 2024-09-19T04:26:34.760 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-19T04:26:35.097 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:26:35.219 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:34 smithi092 ceph-mon[34940]: pgmap v644: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 316 KiB/s wr, 223 op/s 2024-09-19T04:26:35.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:34 smithi007 ceph-mon[31360]: pgmap v644: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 316 KiB/s wr, 223 op/s 2024-09-19T04:26:35.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:34 smithi102 ceph-mon[35446]: pgmap v644: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 316 KiB/s wr, 223 op/s 2024-09-19T04:26:35.623 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T04:26:35.623 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T04:26:35.623 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 486553, 2024-09-19T04:26:35.623 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 709030, 2024-09-19T04:26:35.623 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 156643663, 2024-09-19T04:26:35.624 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 521445245, 2024-09-19T04:26:35.624 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 46, 2024-09-19T04:26:35.624 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 3, 2024-09-19T04:26:35.624 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 24.779344223, 2024-09-19T04:26:35.624 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 9.805020628, 2024-09-19T04:26:35.624 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 24.585022982, 2024-09-19T04:26:35.624 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 3.399609319, 2024-09-19T04:26:35.624 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:35.624 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 709026, 2024-09-19T04:26:35.624 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 97.356885051, 2024-09-19T04:26:35.624 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000137310 2024-09-19T04:26:35.624 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.625 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:35.625 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 913542, 2024-09-19T04:26:35.625 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.149571928, 2024-09-19T04:26:35.625 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000163 2024-09-19T04:26:35.625 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.625 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 972816, 2024-09-19T04:26:35.625 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 160864 2024-09-19T04:26:35.625 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.625 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T04:26:35.625 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 82878, 2024-09-19T04:26:35.625 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 82801, 2024-09-19T04:26:35.625 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 27693290, 2024-09-19T04:26:35.626 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 300050080, 2024-09-19T04:26:35.626 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 11, 2024-09-19T04:26:35.626 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 6, 2024-09-19T04:26:35.626 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 7.537275072, 2024-09-19T04:26:35.626 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 2.260715905, 2024-09-19T04:26:35.626 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 1.309492717, 2024-09-19T04:26:35.626 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 3.650280151, 2024-09-19T04:26:35.626 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:35.626 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 82803, 2024-09-19T04:26:35.626 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 80.376019702, 2024-09-19T04:26:35.626 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000970689 2024-09-19T04:26:35.626 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.626 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:35.626 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 8614, 2024-09-19T04:26:35.627 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.001302177, 2024-09-19T04:26:35.627 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000151 2024-09-19T04:26:35.627 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.627 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-09-19T04:26:35.627 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 349680 2024-09-19T04:26:35.627 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.627 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T04:26:35.627 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 87001, 2024-09-19T04:26:35.627 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 84180, 2024-09-19T04:26:35.627 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 25417635, 2024-09-19T04:26:35.627 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 281906234, 2024-09-19T04:26:35.627 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 90, 2024-09-19T04:26:35.628 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 9, 2024-09-19T04:26:35.628 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 7.834025322, 2024-09-19T04:26:35.628 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 2.988280115, 2024-09-19T04:26:35.628 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 1.637919883, 2024-09-19T04:26:35.628 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 3.041253512, 2024-09-19T04:26:35.628 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:35.628 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 84178, 2024-09-19T04:26:35.628 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 59.513277148, 2024-09-19T04:26:35.628 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000706993 2024-09-19T04:26:35.628 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.628 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:35.628 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 36450, 2024-09-19T04:26:35.628 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.006696516, 2024-09-19T04:26:35.629 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000183 2024-09-19T04:26:35.629 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.629 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 37392, 2024-09-19T04:26:35.629 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 1856 2024-09-19T04:26:35.629 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.629 INFO:teuthology.orchestra.run.smithi092.stdout: "cct": { 2024-09-19T04:26:35.629 INFO:teuthology.orchestra.run.smithi092.stdout: "total_workers": 1, 2024-09-19T04:26:35.629 INFO:teuthology.orchestra.run.smithi092.stdout: "unhealthy_workers": 0 2024-09-19T04:26:35.629 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.629 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-MDSRank": { 2024-09-19T04:26:35.629 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2024-09-19T04:26:35.629 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2024-09-19T04:26:35.630 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 21051, 2024-09-19T04:26:35.630 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 238.749514535, 2024-09-19T04:26:35.630 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.011341480 2024-09-19T04:26:35.630 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T04:26:35.630 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.630 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-PurgeQueue": { 2024-09-19T04:26:35.630 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2024-09-19T04:26:35.630 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2024-09-19T04:26:35.630 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 79762, 2024-09-19T04:26:35.630 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 33.168120204, 2024-09-19T04:26:35.630 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000415838 2024-09-19T04:26:35.630 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T04:26:35.630 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.631 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": { 2024-09-19T04:26:35.631 INFO:teuthology.orchestra.run.smithi092.stdout: "request": 257276, 2024-09-19T04:26:35.631 INFO:teuthology.orchestra.run.smithi092.stdout: "reply": 255967, 2024-09-19T04:26:35.631 INFO:teuthology.orchestra.run.smithi092.stdout: "reply_latency": { 2024-09-19T04:26:35.631 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 255967, 2024-09-19T04:26:35.631 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 10788.332258408, 2024-09-19T04:26:35.631 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.042147355 2024-09-19T04:26:35.631 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.631 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_reply": 0, 2024-09-19T04:26:35.631 INFO:teuthology.orchestra.run.smithi092.stdout: "forward": 1309, 2024-09-19T04:26:35.631 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_complete": 1, 2024-09-19T04:26:35.631 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_keys": 0, 2024-09-19T04:26:35.632 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_commit": 9537, 2024-09-19T04:26:35.632 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_split": 148, 2024-09-19T04:26:35.632 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_merge": 8, 2024-09-19T04:26:35.632 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes": 513, 2024-09-19T04:26:35.632 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_top": 267, 2024-09-19T04:26:35.632 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_bottom": 232, 2024-09-19T04:26:35.632 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pin_tail": 14, 2024-09-19T04:26:35.632 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pinned": 131, 2024-09-19T04:26:35.632 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_expired": 2487, 2024-09-19T04:26:35.632 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_with_caps": 2, 2024-09-19T04:26:35.632 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": 2, 2024-09-19T04:26:35.632 INFO:teuthology.orchestra.run.smithi092.stdout: "subtrees": 6, 2024-09-19T04:26:35.632 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse": 427197, 2024-09-19T04:26:35.633 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_hit": 378131, 2024-09-19T04:26:35.633 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_forward": 1296, 2024-09-19T04:26:35.633 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_discover": 83, 2024-09-19T04:26:35.633 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_dir_fetch": 0, 2024-09-19T04:26:35.633 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_remote_ino": 0, 2024-09-19T04:26:35.633 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_lock": 510, 2024-09-19T04:26:35.633 INFO:teuthology.orchestra.run.smithi092.stdout: "load_cent": 0, 2024-09-19T04:26:35.633 INFO:teuthology.orchestra.run.smithi092.stdout: "q": 0, 2024-09-19T04:26:35.633 INFO:teuthology.orchestra.run.smithi092.stdout: "exported": 15, 2024-09-19T04:26:35.633 INFO:teuthology.orchestra.run.smithi092.stdout: "exported_inodes": 1416, 2024-09-19T04:26:35.633 INFO:teuthology.orchestra.run.smithi092.stdout: "imported": 64, 2024-09-19T04:26:35.633 INFO:teuthology.orchestra.run.smithi092.stdout: "imported_inodes": 98, 2024-09-19T04:26:35.633 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_dir_fetch": 0, 2024-09-19T04:26:35.634 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_backtrace_fetch": 0, 2024-09-19T04:26:35.634 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_peer_discover": 0, 2024-09-19T04:26:35.634 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rfiles": 36, 2024-09-19T04:26:35.634 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rbytes": 793018, 2024-09-19T04:26:35.634 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rsnaps": 0, 2024-09-19T04:26:35.634 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T04:26:35.634 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_set_tag": 0, 2024-09-19T04:26:35.634 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T04:26:35.634 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_inotable_repaired": 0, 2024-09-19T04:26:35.634 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_inodes": 0, 2024-09-19T04:26:35.634 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T04:26:35.634 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T04:26:35.634 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_file_inodes": 0, 2024-09-19T04:26:35.634 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_inode_file_caps": 20, 2024-09-19T04:26:35.635 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_revoke": 106253, 2024-09-19T04:26:35.635 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_grant": 123009, 2024-09-19T04:26:35.635 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_trunc": 7, 2024-09-19T04:26:35.635 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T04:26:35.635 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T04:26:35.635 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps": 156825, 2024-09-19T04:26:35.635 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps_dirty": 44284, 2024-09-19T04:26:35.635 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_cap_release": 7993, 2024-09-19T04:26:35.635 INFO:teuthology.orchestra.run.smithi092.stdout: "process_request_cap_release": 89023 2024-09-19T04:26:35.635 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.635 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_cache": { 2024-09-19T04:26:35.635 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update": 0, 2024-09-19T04:26:35.635 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update_receipt": 0, 2024-09-19T04:26:35.635 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_try_discover": 0, 2024-09-19T04:26:35.636 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_send_discover": 83, 2024-09-19T04:26:35.636 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_handle_discover": 16, 2024-09-19T04:26:35.636 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays": 0, 2024-09-19T04:26:35.636 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_delayed": 0, 2024-09-19T04:26:35.636 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_enqueuing": 0, 2024-09-19T04:26:35.636 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_created": 43142, 2024-09-19T04:26:35.636 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_enqueued": 43142, 2024-09-19T04:26:35.636 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_reintegrated": 0, 2024-09-19T04:26:35.636 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_migrated": 0, 2024-09-19T04:26:35.636 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_processing": 0, 2024-09-19T04:26:35.636 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_enqueued": 0, 2024-09-19T04:26:35.636 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_prioritized": 0, 2024-09-19T04:26:35.636 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_started": 0, 2024-09-19T04:26:35.637 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_completed": 0, 2024-09-19T04:26:35.637 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_quiesce_path": 8, 2024-09-19T04:26:35.637 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_quiesce_inode": 89092, 2024-09-19T04:26:35.637 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T04:26:35.637 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_exportdir": 17, 2024-09-19T04:26:35.637 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_flush": 0, 2024-09-19T04:26:35.637 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragmentdir": 159, 2024-09-19T04:26:35.637 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragstats": 0, 2024-09-19T04:26:35.637 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_inodestats": 0 2024-09-19T04:26:35.637 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.637 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_log": { 2024-09-19T04:26:35.637 INFO:teuthology.orchestra.run.smithi092.stdout: "evlrg": 0, 2024-09-19T04:26:35.638 INFO:teuthology.orchestra.run.smithi092.stdout: "evadd": 253809, 2024-09-19T04:26:35.638 INFO:teuthology.orchestra.run.smithi092.stdout: "evex": 253682, 2024-09-19T04:26:35.638 INFO:teuthology.orchestra.run.smithi092.stdout: "evtrm": 253682, 2024-09-19T04:26:35.638 INFO:teuthology.orchestra.run.smithi092.stdout: "ev": 127, 2024-09-19T04:26:35.638 INFO:teuthology.orchestra.run.smithi092.stdout: "evexg": 0, 2024-09-19T04:26:35.638 INFO:teuthology.orchestra.run.smithi092.stdout: "evexd": 6714, 2024-09-19T04:26:35.638 INFO:teuthology.orchestra.run.smithi092.stdout: "segadd": 334, 2024-09-19T04:26:35.638 INFO:teuthology.orchestra.run.smithi092.stdout: "segex": 333, 2024-09-19T04:26:35.638 INFO:teuthology.orchestra.run.smithi092.stdout: "segtrm": 333, 2024-09-19T04:26:35.638 INFO:teuthology.orchestra.run.smithi092.stdout: "seg": 1, 2024-09-19T04:26:35.638 INFO:teuthology.orchestra.run.smithi092.stdout: "segmjr": 1, 2024-09-19T04:26:35.639 INFO:teuthology.orchestra.run.smithi092.stdout: "segexg": 0, 2024-09-19T04:26:35.639 INFO:teuthology.orchestra.run.smithi092.stdout: "segexd": 9, 2024-09-19T04:26:35.639 INFO:teuthology.orchestra.run.smithi092.stdout: "expos": 572503669, 2024-09-19T04:26:35.639 INFO:teuthology.orchestra.run.smithi092.stdout: "wrpos": 572593632, 2024-09-19T04:26:35.639 INFO:teuthology.orchestra.run.smithi092.stdout: "rdpos": 0, 2024-09-19T04:26:35.639 INFO:teuthology.orchestra.run.smithi092.stdout: "jlat": { 2024-09-19T04:26:35.639 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 19414, 2024-09-19T04:26:35.639 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 2809.731252239, 2024-09-19T04:26:35.639 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.144727065 2024-09-19T04:26:35.639 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.639 INFO:teuthology.orchestra.run.smithi092.stdout: "replayed": 0 2024-09-19T04:26:35.639 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.639 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_mem": { 2024-09-19T04:26:35.640 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 31, 2024-09-19T04:26:35.640 INFO:teuthology.orchestra.run.smithi092.stdout: "ino+": 43878, 2024-09-19T04:26:35.640 INFO:teuthology.orchestra.run.smithi092.stdout: "ino-": 43847, 2024-09-19T04:26:35.640 INFO:teuthology.orchestra.run.smithi092.stdout: "dir": 30, 2024-09-19T04:26:35.640 INFO:teuthology.orchestra.run.smithi092.stdout: "dir+": 1467, 2024-09-19T04:26:35.640 INFO:teuthology.orchestra.run.smithi092.stdout: "dir-": 1437, 2024-09-19T04:26:35.640 INFO:teuthology.orchestra.run.smithi092.stdout: "dn": 513, 2024-09-19T04:26:35.640 INFO:teuthology.orchestra.run.smithi092.stdout: "dn+": 101209, 2024-09-19T04:26:35.640 INFO:teuthology.orchestra.run.smithi092.stdout: "dn-": 100696, 2024-09-19T04:26:35.640 INFO:teuthology.orchestra.run.smithi092.stdout: "cap": 2, 2024-09-19T04:26:35.640 INFO:teuthology.orchestra.run.smithi092.stdout: "cap+": 74313, 2024-09-19T04:26:35.640 INFO:teuthology.orchestra.run.smithi092.stdout: "cap-": 74311, 2024-09-19T04:26:35.640 INFO:teuthology.orchestra.run.smithi092.stdout: "rss": 193056, 2024-09-19T04:26:35.641 INFO:teuthology.orchestra.run.smithi092.stdout: "heap": 231712 2024-09-19T04:26:35.641 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.641 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_server": { 2024-09-19T04:26:35.641 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_client_request": 268515, 2024-09-19T04:26:35.641 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_server_request": 4589, 2024-09-19T04:26:35.641 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_request": 257276, 2024-09-19T04:26:35.641 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_session": 37, 2024-09-19T04:26:35.641 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_peer_request": 11176, 2024-09-19T04:26:35.641 INFO:teuthology.orchestra.run.smithi092.stdout: "req_create_latency": { 2024-09-19T04:26:35.641 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 43572, 2024-09-19T04:26:35.641 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 1118.270950563, 2024-09-19T04:26:35.641 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.025664898 2024-09-19T04:26:35.641 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.641 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getattr_latency": { 2024-09-19T04:26:35.642 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 9421, 2024-09-19T04:26:35.642 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 1155.056627414, 2024-09-19T04:26:35.642 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.122604461 2024-09-19T04:26:35.642 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.642 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getfilelock_latency": { 2024-09-19T04:26:35.642 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:35.642 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:35.642 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:35.642 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.642 INFO:teuthology.orchestra.run.smithi092.stdout: "req_link_latency": { 2024-09-19T04:26:35.642 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:35.642 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:35.642 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:35.643 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.643 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookup_latency": { 2024-09-19T04:26:35.643 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 117837, 2024-09-19T04:26:35.643 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 6956.396496919, 2024-09-19T04:26:35.643 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.059034059 2024-09-19T04:26:35.643 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.643 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookuphash_latency": { 2024-09-19T04:26:35.643 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:35.643 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:35.643 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:35.643 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.643 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupino_latency": { 2024-09-19T04:26:35.643 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 1, 2024-09-19T04:26:35.644 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000171479, 2024-09-19T04:26:35.644 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000171479 2024-09-19T04:26:35.644 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.644 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupname_latency": { 2024-09-19T04:26:35.644 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:35.644 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:35.644 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:35.644 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.644 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupparent_latency": { 2024-09-19T04:26:35.644 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:35.644 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:35.644 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupsnap_latency": { 2024-09-19T04:26:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lssnap_latency": { 2024-09-19T04:26:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.645 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mkdir_latency": { 2024-09-19T04:26:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 193, 2024-09-19T04:26:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 10.124406627, 2024-09-19T04:26:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.052458065 2024-09-19T04:26:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mknod_latency": { 2024-09-19T04:26:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mksnap_latency": { 2024-09-19T04:26:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:35.646 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: "req_open_latency": { 2024-09-19T04:26:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 13144, 2024-09-19T04:26:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 387.345724997, 2024-09-19T04:26:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.029469394 2024-09-19T04:26:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: "req_readdir_latency": { 2024-09-19T04:26:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 1235, 2024-09-19T04:26:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 2.526549300, 2024-09-19T04:26:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.002045788 2024-09-19T04:26:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.647 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rename_latency": { 2024-09-19T04:26:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 43192, 2024-09-19T04:26:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 1043.030510586, 2024-09-19T04:26:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.024148696 2024-09-19T04:26:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: "req_renamesnap_latency": { 2024-09-19T04:26:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: "req_snapdiff_latency": { 2024-09-19T04:26:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:35.648 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmdir_latency": { 2024-09-19T04:26:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 187, 2024-09-19T04:26:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 50.188109076, 2024-09-19T04:26:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.268385610 2024-09-19T04:26:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmsnap_latency": { 2024-09-19T04:26:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmxattr_latency": { 2024-09-19T04:26:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:35.649 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setattr_latency": { 2024-09-19T04:26:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 9, 2024-09-19T04:26:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.209297718, 2024-09-19T04:26:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.023255302 2024-09-19T04:26:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setdirlayout_latency": { 2024-09-19T04:26:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setfilelock_latency": { 2024-09-19T04:26:35.650 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setlayout_latency": { 2024-09-19T04:26:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setxattr_latency": { 2024-09-19T04:26:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 9, 2024-09-19T04:26:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.023320217, 2024-09-19T04:26:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.002591135 2024-09-19T04:26:35.651 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: "req_symlink_latency": { 2024-09-19T04:26:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 3, 2024-09-19T04:26:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.001865286, 2024-09-19T04:26:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000621762 2024-09-19T04:26:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: "req_unlink_latency": { 2024-09-19T04:26:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 27164, 2024-09-19T04:26:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 65.158228226, 2024-09-19T04:26:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.002398697 2024-09-19T04:26:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_revoke_eviction": 0, 2024-09-19T04:26:35.652 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_acquisition_throttle": 0, 2024-09-19T04:26:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getvxattr_latency": { 2024-09-19T04:26:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T04:26:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_sessions": { 2024-09-19T04:26:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: "session_count": 1, 2024-09-19T04:26:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: "session_add": 4, 2024-09-19T04:26:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: "session_remove": 3, 2024-09-19T04:26:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_open": 1, 2024-09-19T04:26:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_stale": 0, 2024-09-19T04:26:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: "total_load": 37568, 2024-09-19T04:26:35.653 INFO:teuthology.orchestra.run.smithi092.stdout: "average_load": 37568, 2024-09-19T04:26:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: "avg_session_uptime": 577, 2024-09-19T04:26:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: "mdthresh_evicted": 0 2024-09-19T04:26:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: "mempool": { 2024-09-19T04:26:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_bytes": 360, 2024-09-19T04:26:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_items": 360, 2024-09-19T04:26:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T04:26:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_items": 0, 2024-09-19T04:26:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T04:26:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_items": 0, 2024-09-19T04:26:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T04:26:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T04:26:35.654 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T04:26:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T04:26:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T04:26:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_items": 0, 2024-09-19T04:26:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T04:26:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T04:26:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_bytes": 0, 2024-09-19T04:26:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_items": 0, 2024-09-19T04:26:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_bytes": 0, 2024-09-19T04:26:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_items": 0, 2024-09-19T04:26:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T04:26:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T04:26:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T04:26:35.655 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T04:26:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T04:26:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_items": 0, 2024-09-19T04:26:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_bytes": 0, 2024-09-19T04:26:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_items": 0, 2024-09-19T04:26:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T04:26:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T04:26:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_bytes": 0, 2024-09-19T04:26:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_items": 0, 2024-09-19T04:26:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_bytes": 0, 2024-09-19T04:26:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_items": 0, 2024-09-19T04:26:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T04:26:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_items": 0, 2024-09-19T04:26:35.656 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T04:26:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_items": 0, 2024-09-19T04:26:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_bytes": 303866, 2024-09-19T04:26:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_items": 114, 2024-09-19T04:26:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_bytes": 264, 2024-09-19T04:26:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_items": 3, 2024-09-19T04:26:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_bytes": 0, 2024-09-19T04:26:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_items": 0, 2024-09-19T04:26:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_bytes": 0, 2024-09-19T04:26:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_items": 0, 2024-09-19T04:26:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_bytes": 0, 2024-09-19T04:26:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_items": 0, 2024-09-19T04:26:35.657 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_bytes": 9056, 2024-09-19T04:26:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_items": 171, 2024-09-19T04:26:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T04:26:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_items": 0, 2024-09-19T04:26:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_bytes": 0, 2024-09-19T04:26:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_items": 0, 2024-09-19T04:26:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_bytes": 498773, 2024-09-19T04:26:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_items": 5744, 2024-09-19T04:26:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_bytes": 0, 2024-09-19T04:26:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_items": 0, 2024-09-19T04:26:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_bytes": 0, 2024-09-19T04:26:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_items": 0 2024-09-19T04:26:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: "objecter": { 2024-09-19T04:26:35.658 INFO:teuthology.orchestra.run.smithi092.stdout: "op_active": 0, 2024-09-19T04:26:35.659 INFO:teuthology.orchestra.run.smithi092.stdout: "op_laggy": 0, 2024-09-19T04:26:35.659 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send": 202747, 2024-09-19T04:26:35.659 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send_bytes": 688619617, 2024-09-19T04:26:35.659 INFO:teuthology.orchestra.run.smithi092.stdout: "op_resend": 36, 2024-09-19T04:26:35.659 INFO:teuthology.orchestra.run.smithi092.stdout: "op_reply": 202747, 2024-09-19T04:26:35.659 INFO:teuthology.orchestra.run.smithi092.stdout: "op_latency": { 2024-09-19T04:26:35.659 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 202747, 2024-09-19T04:26:35.659 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 106546.393951118, 2024-09-19T04:26:35.659 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.525514034 2024-09-19T04:26:35.659 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.659 INFO:teuthology.orchestra.run.smithi092.stdout: "op_inflight": 0, 2024-09-19T04:26:35.659 INFO:teuthology.orchestra.run.smithi092.stdout: "oplen_avg": { 2024-09-19T04:26:35.659 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 202747, 2024-09-19T04:26:35.659 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 351007 2024-09-19T04:26:35.659 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.659 INFO:teuthology.orchestra.run.smithi092.stdout: "op": 202747, 2024-09-19T04:26:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: "op_r": 677, 2024-09-19T04:26:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: "op_w": 202070, 2024-09-19T04:26:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: "op_rmw": 0, 2024-09-19T04:26:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: "op_pg": 0, 2024-09-19T04:26:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_stat": 8150, 2024-09-19T04:26:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_create": 83269, 2024-09-19T04:26:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_read": 676, 2024-09-19T04:26:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_write": 20091, 2024-09-19T04:26:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writefull": 427, 2024-09-19T04:26:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writesame": 0, 2024-09-19T04:26:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_append": 0, 2024-09-19T04:26:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_zero": 0, 2024-09-19T04:26:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_truncate": 148, 2024-09-19T04:26:35.660 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_delete": 88121, 2024-09-19T04:26:35.661 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_mapext": 0, 2024-09-19T04:26:35.661 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_sparse_read": 0, 2024-09-19T04:26:35.661 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_clonerange": 0, 2024-09-19T04:26:35.661 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_getxattr": 1, 2024-09-19T04:26:35.661 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_setxattr": 126242, 2024-09-19T04:26:35.661 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_cmpxattr": 0, 2024-09-19T04:26:35.661 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_rmxattr": 0, 2024-09-19T04:26:35.661 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_resetxattrs": 0, 2024-09-19T04:26:35.661 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_call": 0, 2024-09-19T04:26:35.661 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_watch": 0, 2024-09-19T04:26:35.661 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_notify": 0, 2024-09-19T04:26:35.661 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T04:26:35.661 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls": 0, 2024-09-19T04:26:35.662 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls_filter": 0, 2024-09-19T04:26:35.662 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_other": 7, 2024-09-19T04:26:35.662 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_active": 0, 2024-09-19T04:26:35.662 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_send": 0, 2024-09-19T04:26:35.662 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_resend": 0, 2024-09-19T04:26:35.662 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_ping": 0, 2024-09-19T04:26:35.662 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_active": 0, 2024-09-19T04:26:35.662 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_send": 0, 2024-09-19T04:26:35.662 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_resend": 0, 2024-09-19T04:26:35.662 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_active": 0, 2024-09-19T04:26:35.662 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_send": 0, 2024-09-19T04:26:35.662 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_resend": 0, 2024-09-19T04:26:35.662 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_active": 0, 2024-09-19T04:26:35.662 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_send": 0, 2024-09-19T04:26:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_resend": 0, 2024-09-19T04:26:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: "command_active": 0, 2024-09-19T04:26:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: "command_send": 0, 2024-09-19T04:26:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: "command_resend": 0, 2024-09-19T04:26:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: "map_epoch": 90, 2024-09-19T04:26:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: "map_full": 0, 2024-09-19T04:26:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: "map_inc": 10, 2024-09-19T04:26:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_sessions": 12, 2024-09-19T04:26:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_open": 12, 2024-09-19T04:26:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_close": 0, 2024-09-19T04:26:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_laggy": 0, 2024-09-19T04:26:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_wr": 19284, 2024-09-19T04:26:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_rd": 2, 2024-09-19T04:26:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_del": 4589 2024-09-19T04:26:35.663 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.664 INFO:teuthology.orchestra.run.smithi092.stdout: "oft": { 2024-09-19T04:26:35.664 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_objs": 1, 2024-09-19T04:26:35.664 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_kv_pairs": 0, 2024-09-19T04:26:35.664 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_updates": 0, 2024-09-19T04:26:35.664 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_removes": 0 2024-09-19T04:26:35.664 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.664 INFO:teuthology.orchestra.run.smithi092.stdout: "osd-slow-ops": { 2024-09-19T04:26:35.664 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_ops_count": 89126 2024-09-19T04:26:35.664 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.664 INFO:teuthology.orchestra.run.smithi092.stdout: "purge_queue": { 2024-09-19T04:26:35.664 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops": 0, 2024-09-19T04:26:35.664 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops_high_water": 17, 2024-09-19T04:26:35.664 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing": 0, 2024-09-19T04:26:35.664 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_high_water": 6, 2024-09-19T04:26:35.665 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executed_ops": 87290, 2024-09-19T04:26:35.665 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executed": 43142, 2024-09-19T04:26:35.665 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_item_in_journal": 0 2024-09-19T04:26:35.665 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.665 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T04:26:35.665 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-19T04:26:35.665 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2024-09-19T04:26:35.665 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-19T04:26:35.665 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 656428, 2024-09-19T04:26:35.665 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 150649079, 2024-09-19T04:26:35.665 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:35.665 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 656428, 2024-09-19T04:26:35.666 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-09-19T04:26:35.666 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-09-19T04:26:35.666 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 656428, 2024-09-19T04:26:35.666 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 150649079, 2024-09-19T04:26:35.666 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-19T04:26:35.666 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:35.666 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:35.666 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:35.666 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T04:26:35.666 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.666 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_bytes": { 2024-09-19T04:26:35.667 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-19T04:26:35.667 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2024-09-19T04:26:35.667 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-19T04:26:35.667 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-09-19T04:26:35.667 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-09-19T04:26:35.667 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:35.667 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:35.667 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 202747, 2024-09-19T04:26:35.667 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 693321775, 2024-09-19T04:26:35.667 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 202747, 2024-09-19T04:26:35.667 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 693321775, 2024-09-19T04:26:35.668 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-19T04:26:35.668 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:35.668 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:35.668 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:35.668 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T04:26:35.668 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.668 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_ops": { 2024-09-19T04:26:35.668 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-19T04:26:35.668 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 1024, 2024-09-19T04:26:35.668 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-19T04:26:35.668 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-09-19T04:26:35.668 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-09-19T04:26:35.668 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:35.669 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:35.669 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 202747, 2024-09-19T04:26:35.669 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 202747, 2024-09-19T04:26:35.669 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 202747, 2024-09-19T04:26:35.669 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 202747, 2024-09-19T04:26:35.669 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-19T04:26:35.669 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:35.669 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:35.669 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:35.669 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T04:26:35.669 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.669 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle": { 2024-09-19T04:26:35.670 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-19T04:26:35.670 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2024-09-19T04:26:35.670 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-19T04:26:35.670 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 43142, 2024-09-19T04:26:35.670 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 4702174, 2024-09-19T04:26:35.670 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:35.670 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 43142, 2024-09-19T04:26:35.670 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-09-19T04:26:35.670 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-09-19T04:26:35.670 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 677, 2024-09-19T04:26:35.670 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 4702174, 2024-09-19T04:26:35.670 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-19T04:26:35.670 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:35.671 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:35.671 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:35.671 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T04:26:35.671 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:35.671 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle-0x55f6056a4500": { 2024-09-19T04:26:35.671 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-19T04:26:35.671 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2024-09-19T04:26:35.671 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-19T04:26:35.671 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 253809, 2024-09-19T04:26:35.671 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 568399328, 2024-09-19T04:26:35.671 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:35.671 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 253809, 2024-09-19T04:26:35.671 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-09-19T04:26:35.671 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-09-19T04:26:35.672 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 19414, 2024-09-19T04:26:35.672 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 568399328, 2024-09-19T04:26:35.672 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-19T04:26:35.672 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:35.672 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:35.672 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:35.672 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T04:26:35.672 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T04:26:35.672 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T04:26:37.072 INFO:tasks.check_counter:Daemon mds.b mds.exported=15 2024-09-19T04:26:37.073 INFO:tasks.check_counter:Daemon mds.b mds.imported=64 2024-09-19T04:26:37.073 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=148 2024-09-19T04:26:37.073 DEBUG:tasks.check_counter:Getting stats from e 2024-09-19T04:26:37.073 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-19T04:26:37.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:36 smithi092 ceph-mon[34940]: pgmap v645: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 169 KiB/s wr, 115 op/s 2024-09-19T04:26:37.333 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:26:37.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:36 smithi007 ceph-mon[31360]: pgmap v645: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 169 KiB/s wr, 115 op/s 2024-09-19T04:26:37.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:36 smithi102 ceph-mon[35446]: pgmap v645: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 169 KiB/s wr, 115 op/s 2024-09-19T04:26:37.941 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T04:26:37.941 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T04:26:37.941 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 0, 2024-09-19T04:26:37.941 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 2, 2024-09-19T04:26:37.941 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 0, 2024-09-19T04:26:37.942 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 0, 2024-09-19T04:26:37.942 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 4, 2024-09-19T04:26:37.942 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 0, 2024-09-19T04:26:37.942 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.001287271, 2024-09-19T04:26:37.942 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T04:26:37.942 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.000349310, 2024-09-19T04:26:37.942 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T04:26:37.942 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:37.942 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:37.942 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:37.942 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:37.942 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:37.943 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:37.943 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:37.943 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:37.943 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:37.943 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:37.943 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T04:26:37.943 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T04:26:37.943 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:37.943 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T04:26:37.943 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 28, 2024-09-19T04:26:37.943 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 25, 2024-09-19T04:26:37.943 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 150496, 2024-09-19T04:26:37.943 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 12944, 2024-09-19T04:26:37.944 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 2, 2024-09-19T04:26:37.944 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 1, 2024-09-19T04:26:37.944 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.005473231, 2024-09-19T04:26:37.944 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.000888557, 2024-09-19T04:26:37.944 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.005702584, 2024-09-19T04:26:37.944 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T04:26:37.944 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:37.944 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 25, 2024-09-19T04:26:37.944 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.006727096, 2024-09-19T04:26:37.944 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000269083 2024-09-19T04:26:37.944 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:37.944 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:37.944 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:37.945 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:37.945 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:37.945 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:37.945 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 150496, 2024-09-19T04:26:37.945 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 12944 2024-09-19T04:26:37.945 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:37.945 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T04:26:37.945 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 1, 2024-09-19T04:26:37.945 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 17, 2024-09-19T04:26:37.945 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 160, 2024-09-19T04:26:37.945 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 81520, 2024-09-19T04:26:37.946 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 3, 2024-09-19T04:26:37.946 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 2, 2024-09-19T04:26:37.946 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.001934033, 2024-09-19T04:26:37.946 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.000640908, 2024-09-19T04:26:37.946 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.001093663, 2024-09-19T04:26:37.946 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T04:26:37.946 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:37.946 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 15, 2024-09-19T04:26:37.946 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000557139, 2024-09-19T04:26:37.946 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000037142 2024-09-19T04:26:37.946 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:37.946 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:37.946 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:37.947 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:37.947 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:37.947 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:37.947 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T04:26:37.947 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 81520 2024-09-19T04:26:37.947 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:37.947 INFO:teuthology.orchestra.run.smithi092.stdout: "cct": { 2024-09-19T04:26:37.947 INFO:teuthology.orchestra.run.smithi092.stdout: "total_workers": 0, 2024-09-19T04:26:37.947 INFO:teuthology.orchestra.run.smithi092.stdout: "unhealthy_workers": 0 2024-09-19T04:26:37.947 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:37.947 INFO:teuthology.orchestra.run.smithi092.stdout: "mempool": { 2024-09-19T04:26:37.947 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_bytes": 0, 2024-09-19T04:26:37.947 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_items": 0, 2024-09-19T04:26:37.947 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T04:26:37.948 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_items": 0, 2024-09-19T04:26:37.948 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T04:26:37.948 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_items": 0, 2024-09-19T04:26:37.948 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T04:26:37.948 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T04:26:37.948 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T04:26:37.948 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T04:26:37.948 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T04:26:37.948 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_items": 0, 2024-09-19T04:26:37.948 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T04:26:37.948 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T04:26:37.948 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_bytes": 0, 2024-09-19T04:26:37.948 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_items": 0, 2024-09-19T04:26:37.949 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_bytes": 0, 2024-09-19T04:26:37.949 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_items": 0, 2024-09-19T04:26:37.949 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T04:26:37.949 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T04:26:37.949 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T04:26:37.949 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T04:26:37.949 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T04:26:37.949 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_items": 0, 2024-09-19T04:26:37.949 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_bytes": 0, 2024-09-19T04:26:37.949 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_items": 0, 2024-09-19T04:26:37.949 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T04:26:37.949 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T04:26:37.950 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_bytes": 0, 2024-09-19T04:26:37.950 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_items": 0, 2024-09-19T04:26:37.950 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_bytes": 0, 2024-09-19T04:26:37.950 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_items": 0, 2024-09-19T04:26:37.950 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T04:26:37.950 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_items": 0, 2024-09-19T04:26:37.950 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T04:26:37.950 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_items": 0, 2024-09-19T04:26:37.950 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_bytes": 149087, 2024-09-19T04:26:37.950 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_items": 27, 2024-09-19T04:26:37.950 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_bytes": 0, 2024-09-19T04:26:37.950 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_items": 0, 2024-09-19T04:26:37.950 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_bytes": 0, 2024-09-19T04:26:37.951 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_items": 0, 2024-09-19T04:26:37.951 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_bytes": 0, 2024-09-19T04:26:37.951 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_items": 0, 2024-09-19T04:26:37.951 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_bytes": 0, 2024-09-19T04:26:37.951 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_items": 0, 2024-09-19T04:26:37.951 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_bytes": 0, 2024-09-19T04:26:37.951 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_items": 0, 2024-09-19T04:26:37.951 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T04:26:37.951 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_items": 0, 2024-09-19T04:26:37.951 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_bytes": 0, 2024-09-19T04:26:37.951 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_items": 0, 2024-09-19T04:26:37.951 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_bytes": 928, 2024-09-19T04:26:37.951 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_items": 2, 2024-09-19T04:26:37.951 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_bytes": 0, 2024-09-19T04:26:37.952 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_items": 0, 2024-09-19T04:26:37.952 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_bytes": 0, 2024-09-19T04:26:37.952 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_items": 0 2024-09-19T04:26:37.952 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:37.952 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T04:26:37.952 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-19T04:26:37.952 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2024-09-19T04:26:37.952 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-19T04:26:37.952 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 25, 2024-09-19T04:26:37.952 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 144142, 2024-09-19T04:26:37.952 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:37.952 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 25, 2024-09-19T04:26:37.952 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-09-19T04:26:37.952 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-09-19T04:26:37.953 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 25, 2024-09-19T04:26:37.953 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 144142, 2024-09-19T04:26:37.953 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-19T04:26:37.953 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:37.953 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:37.953 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:37.953 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T04:26:37.953 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T04:26:37.953 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T04:26:38.953 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.e 2024-09-19T04:26:38.953 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.e 2024-09-19T04:26:38.953 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.e 2024-09-19T04:26:38.953 DEBUG:tasks.check_counter:Getting stats from h 2024-09-19T04:26:38.953 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-19T04:26:39.220 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:26:39.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:38 smithi092 ceph-mon[34940]: pgmap v646: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 KiB/s wr, 40 op/s 2024-09-19T04:26:39.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:38 smithi007 ceph-mon[31360]: pgmap v646: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 KiB/s wr, 40 op/s 2024-09-19T04:26:39.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:38 smithi102 ceph-mon[35446]: pgmap v646: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 KiB/s wr, 40 op/s 2024-09-19T04:26:39.761 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T04:26:39.761 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T04:26:39.761 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 5816, 2024-09-19T04:26:39.761 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 7667, 2024-09-19T04:26:39.761 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 2005377, 2024-09-19T04:26:39.761 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 6166196, 2024-09-19T04:26:39.761 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 13, 2024-09-19T04:26:39.761 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 3, 2024-09-19T04:26:39.761 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.301039739, 2024-09-19T04:26:39.761 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.123678709, 2024-09-19T04:26:39.761 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.226491917, 2024-09-19T04:26:39.762 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.018782509, 2024-09-19T04:26:39.762 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:39.762 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 7665, 2024-09-19T04:26:39.762 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.763954719, 2024-09-19T04:26:39.762 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000099667 2024-09-19T04:26:39.762 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.762 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:39.762 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 9946, 2024-09-19T04:26:39.762 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.003539280, 2024-09-19T04:26:39.762 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000355 2024-09-19T04:26:39.762 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.762 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 928, 2024-09-19T04:26:39.762 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 736 2024-09-19T04:26:39.763 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.763 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T04:26:39.763 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 476, 2024-09-19T04:26:39.763 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 628, 2024-09-19T04:26:39.763 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 125346, 2024-09-19T04:26:39.763 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 723235, 2024-09-19T04:26:39.763 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 12, 2024-09-19T04:26:39.763 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 6, 2024-09-19T04:26:39.763 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.043303280, 2024-09-19T04:26:39.763 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.014947059, 2024-09-19T04:26:39.763 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.011920180, 2024-09-19T04:26:39.763 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.012055154, 2024-09-19T04:26:39.763 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:39.764 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 626, 2024-09-19T04:26:39.764 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.058378055, 2024-09-19T04:26:39.764 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000093255 2024-09-19T04:26:39.764 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.764 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:39.764 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 4, 2024-09-19T04:26:39.764 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000265, 2024-09-19T04:26:39.764 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000066 2024-09-19T04:26:39.764 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.764 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T04:26:39.764 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 336128 2024-09-19T04:26:39.764 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.764 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T04:26:39.765 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 4802, 2024-09-19T04:26:39.765 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 4995, 2024-09-19T04:26:39.765 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 2294625, 2024-09-19T04:26:39.765 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 1658086, 2024-09-19T04:26:39.765 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 6, 2024-09-19T04:26:39.765 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 5, 2024-09-19T04:26:39.765 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.333122755, 2024-09-19T04:26:39.765 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.152755757, 2024-09-19T04:26:39.765 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.219146767, 2024-09-19T04:26:39.765 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.008493308, 2024-09-19T04:26:39.765 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:39.765 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 4995, 2024-09-19T04:26:39.765 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.244795009, 2024-09-19T04:26:39.766 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000049008 2024-09-19T04:26:39.766 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.766 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:39.766 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 8595, 2024-09-19T04:26:39.766 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.001464553, 2024-09-19T04:26:39.766 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000170 2024-09-19T04:26:39.766 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.766 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 906560, 2024-09-19T04:26:39.766 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 131024 2024-09-19T04:26:39.766 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.766 INFO:teuthology.orchestra.run.smithi092.stdout: "cct": { 2024-09-19T04:26:39.766 INFO:teuthology.orchestra.run.smithi092.stdout: "total_workers": 1, 2024-09-19T04:26:39.767 INFO:teuthology.orchestra.run.smithi092.stdout: "unhealthy_workers": 0 2024-09-19T04:26:39.767 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.767 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-MDSRank": { 2024-09-19T04:26:39.767 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2024-09-19T04:26:39.767 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2024-09-19T04:26:39.767 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 608, 2024-09-19T04:26:39.767 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.829170469, 2024-09-19T04:26:39.767 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.001363767 2024-09-19T04:26:39.767 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T04:26:39.767 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.767 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-PurgeQueue": { 2024-09-19T04:26:39.767 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2024-09-19T04:26:39.767 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2024-09-19T04:26:39.768 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 815, 2024-09-19T04:26:39.768 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.058518219, 2024-09-19T04:26:39.768 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000071801 2024-09-19T04:26:39.768 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T04:26:39.768 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.768 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": { 2024-09-19T04:26:39.768 INFO:teuthology.orchestra.run.smithi092.stdout: "request": 1682, 2024-09-19T04:26:39.768 INFO:teuthology.orchestra.run.smithi092.stdout: "reply": 1657, 2024-09-19T04:26:39.768 INFO:teuthology.orchestra.run.smithi092.stdout: "reply_latency": { 2024-09-19T04:26:39.768 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 1657, 2024-09-19T04:26:39.768 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 6.621932498, 2024-09-19T04:26:39.768 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.003996338 2024-09-19T04:26:39.768 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.769 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_reply": 0, 2024-09-19T04:26:39.769 INFO:teuthology.orchestra.run.smithi092.stdout: "forward": 25, 2024-09-19T04:26:39.769 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_complete": 0, 2024-09-19T04:26:39.769 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_keys": 0, 2024-09-19T04:26:39.769 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_commit": 28, 2024-09-19T04:26:39.769 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_split": 2, 2024-09-19T04:26:39.769 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_merge": 0, 2024-09-19T04:26:39.769 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes": 16, 2024-09-19T04:26:39.769 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_top": 2, 2024-09-19T04:26:39.769 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_bottom": 1, 2024-09-19T04:26:39.769 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pin_tail": 13, 2024-09-19T04:26:39.769 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pinned": 13, 2024-09-19T04:26:39.769 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_expired": 14, 2024-09-19T04:26:39.770 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_with_caps": 0, 2024-09-19T04:26:39.770 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": 0, 2024-09-19T04:26:39.770 INFO:teuthology.orchestra.run.smithi092.stdout: "subtrees": 3, 2024-09-19T04:26:39.770 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse": 3935, 2024-09-19T04:26:39.770 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_hit": 2756, 2024-09-19T04:26:39.770 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_forward": 24, 2024-09-19T04:26:39.770 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_discover": 2, 2024-09-19T04:26:39.770 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_dir_fetch": 0, 2024-09-19T04:26:39.770 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_remote_ino": 0, 2024-09-19T04:26:39.770 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_lock": 68, 2024-09-19T04:26:39.770 INFO:teuthology.orchestra.run.smithi092.stdout: "load_cent": 0, 2024-09-19T04:26:39.770 INFO:teuthology.orchestra.run.smithi092.stdout: "q": 0, 2024-09-19T04:26:39.771 INFO:teuthology.orchestra.run.smithi092.stdout: "exported": 16, 2024-09-19T04:26:39.771 INFO:teuthology.orchestra.run.smithi092.stdout: "exported_inodes": 2, 2024-09-19T04:26:39.771 INFO:teuthology.orchestra.run.smithi092.stdout: "imported": 2, 2024-09-19T04:26:39.771 INFO:teuthology.orchestra.run.smithi092.stdout: "imported_inodes": 194, 2024-09-19T04:26:39.771 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_dir_fetch": 0, 2024-09-19T04:26:39.771 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_backtrace_fetch": 0, 2024-09-19T04:26:39.771 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_peer_discover": 1, 2024-09-19T04:26:39.771 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rfiles": 36, 2024-09-19T04:26:39.771 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rbytes": 793018, 2024-09-19T04:26:39.771 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rsnaps": 0, 2024-09-19T04:26:39.771 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T04:26:39.771 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_set_tag": 0, 2024-09-19T04:26:39.771 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T04:26:39.771 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_inotable_repaired": 0, 2024-09-19T04:26:39.772 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_inodes": 0, 2024-09-19T04:26:39.772 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T04:26:39.772 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T04:26:39.772 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_file_inodes": 0, 2024-09-19T04:26:39.772 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_inode_file_caps": 9, 2024-09-19T04:26:39.772 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_revoke": 1111, 2024-09-19T04:26:39.772 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_grant": 1355, 2024-09-19T04:26:39.772 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T04:26:39.772 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T04:26:39.772 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T04:26:39.772 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps": 1758, 2024-09-19T04:26:39.772 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps_dirty": 333, 2024-09-19T04:26:39.772 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_cap_release": 88, 2024-09-19T04:26:39.773 INFO:teuthology.orchestra.run.smithi092.stdout: "process_request_cap_release": 1473 2024-09-19T04:26:39.773 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.773 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_cache": { 2024-09-19T04:26:39.773 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update": 0, 2024-09-19T04:26:39.773 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update_receipt": 0, 2024-09-19T04:26:39.773 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_try_discover": 0, 2024-09-19T04:26:39.773 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_send_discover": 3, 2024-09-19T04:26:39.773 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_handle_discover": 7, 2024-09-19T04:26:39.773 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays": 0, 2024-09-19T04:26:39.773 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_delayed": 0, 2024-09-19T04:26:39.773 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_enqueuing": 0, 2024-09-19T04:26:39.773 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_created": 360, 2024-09-19T04:26:39.773 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_enqueued": 360, 2024-09-19T04:26:39.774 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_reintegrated": 0, 2024-09-19T04:26:39.774 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_migrated": 0, 2024-09-19T04:26:39.774 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_processing": 0, 2024-09-19T04:26:39.774 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_enqueued": 0, 2024-09-19T04:26:39.774 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_prioritized": 0, 2024-09-19T04:26:39.774 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_started": 0, 2024-09-19T04:26:39.775 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_completed": 0, 2024-09-19T04:26:39.775 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_quiesce_path": 8, 2024-09-19T04:26:39.775 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_quiesce_inode": 1007, 2024-09-19T04:26:39.775 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T04:26:39.775 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_exportdir": 16, 2024-09-19T04:26:39.775 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_flush": 0, 2024-09-19T04:26:39.775 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragmentdir": 2, 2024-09-19T04:26:39.775 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragstats": 0, 2024-09-19T04:26:39.775 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_inodestats": 0 2024-09-19T04:26:39.775 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.776 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_log": { 2024-09-19T04:26:39.776 INFO:teuthology.orchestra.run.smithi092.stdout: "evlrg": 0, 2024-09-19T04:26:39.776 INFO:teuthology.orchestra.run.smithi092.stdout: "evadd": 2209, 2024-09-19T04:26:39.776 INFO:teuthology.orchestra.run.smithi092.stdout: "evex": 0, 2024-09-19T04:26:39.776 INFO:teuthology.orchestra.run.smithi092.stdout: "evtrm": 0, 2024-09-19T04:26:39.776 INFO:teuthology.orchestra.run.smithi092.stdout: "ev": 2209, 2024-09-19T04:26:39.776 INFO:teuthology.orchestra.run.smithi092.stdout: "evexg": 0, 2024-09-19T04:26:39.776 INFO:teuthology.orchestra.run.smithi092.stdout: "evexd": 0, 2024-09-19T04:26:39.776 INFO:teuthology.orchestra.run.smithi092.stdout: "segadd": 4, 2024-09-19T04:26:39.776 INFO:teuthology.orchestra.run.smithi092.stdout: "segex": 0, 2024-09-19T04:26:39.776 INFO:teuthology.orchestra.run.smithi092.stdout: "segtrm": 0, 2024-09-19T04:26:39.776 INFO:teuthology.orchestra.run.smithi092.stdout: "seg": 4, 2024-09-19T04:26:39.776 INFO:teuthology.orchestra.run.smithi092.stdout: "segmjr": 2, 2024-09-19T04:26:39.777 INFO:teuthology.orchestra.run.smithi092.stdout: "segexg": 0, 2024-09-19T04:26:39.777 INFO:teuthology.orchestra.run.smithi092.stdout: "segexd": 0, 2024-09-19T04:26:39.777 INFO:teuthology.orchestra.run.smithi092.stdout: "expos": 4194304, 2024-09-19T04:26:39.777 INFO:teuthology.orchestra.run.smithi092.stdout: "wrpos": 7168265, 2024-09-19T04:26:39.777 INFO:teuthology.orchestra.run.smithi092.stdout: "rdpos": 0, 2024-09-19T04:26:39.777 INFO:teuthology.orchestra.run.smithi092.stdout: "jlat": { 2024-09-19T04:26:39.777 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 229, 2024-09-19T04:26:39.777 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 3.272418704, 2024-09-19T04:26:39.777 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.014290038 2024-09-19T04:26:39.777 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.777 INFO:teuthology.orchestra.run.smithi092.stdout: "replayed": 0 2024-09-19T04:26:39.777 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.778 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_mem": { 2024-09-19T04:26:39.778 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 20, 2024-09-19T04:26:39.778 INFO:teuthology.orchestra.run.smithi092.stdout: "ino+": 387, 2024-09-19T04:26:39.778 INFO:teuthology.orchestra.run.smithi092.stdout: "ino-": 367, 2024-09-19T04:26:39.778 INFO:teuthology.orchestra.run.smithi092.stdout: "dir": 19, 2024-09-19T04:26:39.778 INFO:teuthology.orchestra.run.smithi092.stdout: "dir+": 53, 2024-09-19T04:26:39.778 INFO:teuthology.orchestra.run.smithi092.stdout: "dir-": 34, 2024-09-19T04:26:39.778 INFO:teuthology.orchestra.run.smithi092.stdout: "dn": 16, 2024-09-19T04:26:39.778 INFO:teuthology.orchestra.run.smithi092.stdout: "dn+": 906, 2024-09-19T04:26:39.778 INFO:teuthology.orchestra.run.smithi092.stdout: "dn-": 890, 2024-09-19T04:26:39.778 INFO:teuthology.orchestra.run.smithi092.stdout: "cap": 0, 2024-09-19T04:26:39.778 INFO:teuthology.orchestra.run.smithi092.stdout: "cap+": 630, 2024-09-19T04:26:39.778 INFO:teuthology.orchestra.run.smithi092.stdout: "cap-": 630, 2024-09-19T04:26:39.779 INFO:teuthology.orchestra.run.smithi092.stdout: "rss": 59180, 2024-09-19T04:26:39.779 INFO:teuthology.orchestra.run.smithi092.stdout: "heap": 223520 2024-09-19T04:26:39.779 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.779 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_server": { 2024-09-19T04:26:39.779 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_client_request": 2709, 2024-09-19T04:26:39.779 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_server_request": 250, 2024-09-19T04:26:39.779 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_request": 1682, 2024-09-19T04:26:39.779 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_session": 12, 2024-09-19T04:26:39.779 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_peer_request": 1351, 2024-09-19T04:26:39.779 INFO:teuthology.orchestra.run.smithi092.stdout: "req_create_latency": { 2024-09-19T04:26:39.779 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 280, 2024-09-19T04:26:39.779 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 2.275802248, 2024-09-19T04:26:39.779 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.008127865 2024-09-19T04:26:39.779 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.780 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getattr_latency": { 2024-09-19T04:26:39.780 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:39.780 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:39.780 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:39.780 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.780 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getfilelock_latency": { 2024-09-19T04:26:39.780 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:39.780 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:39.780 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:39.780 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.780 INFO:teuthology.orchestra.run.smithi092.stdout: "req_link_latency": { 2024-09-19T04:26:39.780 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:39.780 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:39.781 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:39.781 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.781 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookup_latency": { 2024-09-19T04:26:39.781 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 681, 2024-09-19T04:26:39.781 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 1.253863068, 2024-09-19T04:26:39.781 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.001841208 2024-09-19T04:26:39.781 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.781 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookuphash_latency": { 2024-09-19T04:26:39.781 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:39.781 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:39.781 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:39.781 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.781 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupino_latency": { 2024-09-19T04:26:39.782 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:39.782 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:39.782 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:39.782 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.782 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupname_latency": { 2024-09-19T04:26:39.782 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:39.782 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:39.782 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:39.782 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.782 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupparent_latency": { 2024-09-19T04:26:39.782 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:39.782 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:39.782 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:39.783 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.783 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupsnap_latency": { 2024-09-19T04:26:39.783 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:39.783 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:39.783 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:39.783 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.783 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lssnap_latency": { 2024-09-19T04:26:39.783 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:39.783 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:39.783 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:39.783 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.783 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mkdir_latency": { 2024-09-19T04:26:39.783 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:39.784 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:39.784 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:39.784 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.784 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mknod_latency": { 2024-09-19T04:26:39.784 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:39.784 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:39.784 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:39.784 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.784 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mksnap_latency": { 2024-09-19T04:26:39.784 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:39.784 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:39.784 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:39.785 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.785 INFO:teuthology.orchestra.run.smithi092.stdout: "req_open_latency": { 2024-09-19T04:26:39.785 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 143, 2024-09-19T04:26:39.785 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.061491979, 2024-09-19T04:26:39.785 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000430013 2024-09-19T04:26:39.785 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.785 INFO:teuthology.orchestra.run.smithi092.stdout: "req_readdir_latency": { 2024-09-19T04:26:39.785 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 16, 2024-09-19T04:26:39.785 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.012912187, 2024-09-19T04:26:39.785 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000807011 2024-09-19T04:26:39.785 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.785 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rename_latency": { 2024-09-19T04:26:39.785 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 280, 2024-09-19T04:26:39.786 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 2.614569119, 2024-09-19T04:26:39.786 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.009337746 2024-09-19T04:26:39.786 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.786 INFO:teuthology.orchestra.run.smithi092.stdout: "req_renamesnap_latency": { 2024-09-19T04:26:39.786 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:39.786 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:39.786 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:39.786 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.786 INFO:teuthology.orchestra.run.smithi092.stdout: "req_snapdiff_latency": { 2024-09-19T04:26:39.786 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:39.786 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:39.786 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:39.786 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.787 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmdir_latency": { 2024-09-19T04:26:39.787 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:39.787 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:39.787 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:39.787 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.787 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmsnap_latency": { 2024-09-19T04:26:39.787 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:39.787 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:39.787 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:39.787 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.787 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmxattr_latency": { 2024-09-19T04:26:39.787 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:39.788 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:39.788 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:39.788 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.788 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setattr_latency": { 2024-09-19T04:26:39.788 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:39.788 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:39.788 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:39.788 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.788 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setdirlayout_latency": { 2024-09-19T04:26:39.788 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:39.788 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:39.788 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:39.788 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.789 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setfilelock_latency": { 2024-09-19T04:26:39.789 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:39.789 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:39.789 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:39.789 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.789 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setlayout_latency": { 2024-09-19T04:26:39.789 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:39.789 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:39.789 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:39.789 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.789 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setxattr_latency": { 2024-09-19T04:26:39.789 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:39.790 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:39.790 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:39.790 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.790 INFO:teuthology.orchestra.run.smithi092.stdout: "req_symlink_latency": { 2024-09-19T04:26:39.790 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:39.790 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:39.790 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:39.790 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.790 INFO:teuthology.orchestra.run.smithi092.stdout: "req_unlink_latency": { 2024-09-19T04:26:39.790 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 257, 2024-09-19T04:26:39.790 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.403293897, 2024-09-19T04:26:39.790 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.001569236 2024-09-19T04:26:39.790 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.790 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_revoke_eviction": 0, 2024-09-19T04:26:39.791 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_acquisition_throttle": 0, 2024-09-19T04:26:39.791 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getvxattr_latency": { 2024-09-19T04:26:39.791 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:39.791 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:39.791 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:39.791 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T04:26:39.791 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.791 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_sessions": { 2024-09-19T04:26:39.791 INFO:teuthology.orchestra.run.smithi092.stdout: "session_count": 1, 2024-09-19T04:26:39.791 INFO:teuthology.orchestra.run.smithi092.stdout: "session_add": 2, 2024-09-19T04:26:39.791 INFO:teuthology.orchestra.run.smithi092.stdout: "session_remove": 1, 2024-09-19T04:26:39.791 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_open": 1, 2024-09-19T04:26:39.791 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_stale": 0, 2024-09-19T04:26:39.792 INFO:teuthology.orchestra.run.smithi092.stdout: "total_load": 506, 2024-09-19T04:26:39.792 INFO:teuthology.orchestra.run.smithi092.stdout: "average_load": 506, 2024-09-19T04:26:39.792 INFO:teuthology.orchestra.run.smithi092.stdout: "avg_session_uptime": 568, 2024-09-19T04:26:39.792 INFO:teuthology.orchestra.run.smithi092.stdout: "mdthresh_evicted": 0 2024-09-19T04:26:39.792 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.792 INFO:teuthology.orchestra.run.smithi092.stdout: "mempool": { 2024-09-19T04:26:39.792 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_bytes": 0, 2024-09-19T04:26:39.792 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_items": 0, 2024-09-19T04:26:39.792 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T04:26:39.792 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_items": 0, 2024-09-19T04:26:39.792 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T04:26:39.792 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_items": 0, 2024-09-19T04:26:39.793 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T04:26:39.793 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T04:26:39.793 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T04:26:39.793 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T04:26:39.793 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T04:26:39.793 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_items": 0, 2024-09-19T04:26:39.793 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T04:26:39.793 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T04:26:39.793 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_bytes": 0, 2024-09-19T04:26:39.793 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_items": 0, 2024-09-19T04:26:39.793 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_bytes": 0, 2024-09-19T04:26:39.793 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_items": 0, 2024-09-19T04:26:39.793 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T04:26:39.794 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T04:26:39.794 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T04:26:39.794 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T04:26:39.794 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T04:26:39.794 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_items": 0, 2024-09-19T04:26:39.794 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_bytes": 0, 2024-09-19T04:26:39.794 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_items": 0, 2024-09-19T04:26:39.794 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T04:26:39.794 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T04:26:39.794 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_bytes": 0, 2024-09-19T04:26:39.794 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_items": 0, 2024-09-19T04:26:39.794 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_bytes": 0, 2024-09-19T04:26:39.794 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_items": 0, 2024-09-19T04:26:39.795 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T04:26:39.795 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_items": 0, 2024-09-19T04:26:39.795 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T04:26:39.795 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_items": 0, 2024-09-19T04:26:39.795 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_bytes": 287767, 2024-09-19T04:26:39.795 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_items": 96, 2024-09-19T04:26:39.795 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_bytes": 0, 2024-09-19T04:26:39.795 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_items": 0, 2024-09-19T04:26:39.795 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_bytes": 0, 2024-09-19T04:26:39.795 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_items": 0, 2024-09-19T04:26:39.795 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_bytes": 0, 2024-09-19T04:26:39.795 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_items": 0, 2024-09-19T04:26:39.795 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_bytes": 0, 2024-09-19T04:26:39.796 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_items": 0, 2024-09-19T04:26:39.796 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_bytes": 9056, 2024-09-19T04:26:39.796 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_items": 171, 2024-09-19T04:26:39.796 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T04:26:39.796 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_items": 0, 2024-09-19T04:26:39.796 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_bytes": 0, 2024-09-19T04:26:39.796 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_items": 0, 2024-09-19T04:26:39.796 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_bytes": 81437, 2024-09-19T04:26:39.796 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_items": 354, 2024-09-19T04:26:39.796 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_bytes": 0, 2024-09-19T04:26:39.796 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_items": 0, 2024-09-19T04:26:39.796 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_bytes": 0, 2024-09-19T04:26:39.796 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_items": 0 2024-09-19T04:26:39.797 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.797 INFO:teuthology.orchestra.run.smithi092.stdout: "objecter": { 2024-09-19T04:26:39.797 INFO:teuthology.orchestra.run.smithi092.stdout: "op_active": 0, 2024-09-19T04:26:39.797 INFO:teuthology.orchestra.run.smithi092.stdout: "op_laggy": 0, 2024-09-19T04:26:39.797 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send": 1238, 2024-09-19T04:26:39.797 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send_bytes": 3305773, 2024-09-19T04:26:39.797 INFO:teuthology.orchestra.run.smithi092.stdout: "op_resend": 33, 2024-09-19T04:26:39.797 INFO:teuthology.orchestra.run.smithi092.stdout: "op_reply": 1238, 2024-09-19T04:26:39.797 INFO:teuthology.orchestra.run.smithi092.stdout: "op_latency": { 2024-09-19T04:26:39.797 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 1238, 2024-09-19T04:26:39.797 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 12.376645884, 2024-09-19T04:26:39.797 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.009997290 2024-09-19T04:26:39.797 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.797 INFO:teuthology.orchestra.run.smithi092.stdout: "op_inflight": 0, 2024-09-19T04:26:39.798 INFO:teuthology.orchestra.run.smithi092.stdout: "oplen_avg": { 2024-09-19T04:26:39.798 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 1238, 2024-09-19T04:26:39.798 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 1400 2024-09-19T04:26:39.798 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.798 INFO:teuthology.orchestra.run.smithi092.stdout: "op": 1238, 2024-09-19T04:26:39.798 INFO:teuthology.orchestra.run.smithi092.stdout: "op_r": 36, 2024-09-19T04:26:39.798 INFO:teuthology.orchestra.run.smithi092.stdout: "op_w": 1202, 2024-09-19T04:26:39.798 INFO:teuthology.orchestra.run.smithi092.stdout: "op_rmw": 0, 2024-09-19T04:26:39.798 INFO:teuthology.orchestra.run.smithi092.stdout: "op_pg": 0, 2024-09-19T04:26:39.798 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_stat": 0, 2024-09-19T04:26:39.798 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_create": 10, 2024-09-19T04:26:39.798 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_read": 36, 2024-09-19T04:26:39.798 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_write": 265, 2024-09-19T04:26:39.799 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writefull": 55, 2024-09-19T04:26:39.799 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writesame": 0, 2024-09-19T04:26:39.799 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_append": 0, 2024-09-19T04:26:39.799 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_zero": 0, 2024-09-19T04:26:39.799 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_truncate": 2, 2024-09-19T04:26:39.799 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_delete": 732, 2024-09-19T04:26:39.799 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_mapext": 0, 2024-09-19T04:26:39.799 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_sparse_read": 0, 2024-09-19T04:26:39.799 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_clonerange": 0, 2024-09-19T04:26:39.799 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_getxattr": 0, 2024-09-19T04:26:39.799 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_setxattr": 20, 2024-09-19T04:26:39.799 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_cmpxattr": 0, 2024-09-19T04:26:39.799 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_rmxattr": 0, 2024-09-19T04:26:39.800 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_resetxattrs": 0, 2024-09-19T04:26:39.800 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_call": 0, 2024-09-19T04:26:39.800 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_watch": 0, 2024-09-19T04:26:39.800 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_notify": 0, 2024-09-19T04:26:39.800 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T04:26:39.800 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls": 0, 2024-09-19T04:26:39.800 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls_filter": 0, 2024-09-19T04:26:39.800 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_other": 0, 2024-09-19T04:26:39.800 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_active": 0, 2024-09-19T04:26:39.800 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_send": 0, 2024-09-19T04:26:39.800 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_resend": 0, 2024-09-19T04:26:39.800 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_ping": 0, 2024-09-19T04:26:39.800 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_active": 0, 2024-09-19T04:26:39.801 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_send": 0, 2024-09-19T04:26:39.801 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_resend": 0, 2024-09-19T04:26:39.801 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_active": 0, 2024-09-19T04:26:39.801 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_send": 0, 2024-09-19T04:26:39.801 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_resend": 0, 2024-09-19T04:26:39.801 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_active": 0, 2024-09-19T04:26:39.801 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_send": 0, 2024-09-19T04:26:39.801 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_resend": 0, 2024-09-19T04:26:39.801 INFO:teuthology.orchestra.run.smithi092.stdout: "command_active": 0, 2024-09-19T04:26:39.801 INFO:teuthology.orchestra.run.smithi092.stdout: "command_send": 0, 2024-09-19T04:26:39.801 INFO:teuthology.orchestra.run.smithi092.stdout: "command_resend": 0, 2024-09-19T04:26:39.801 INFO:teuthology.orchestra.run.smithi092.stdout: "map_epoch": 90, 2024-09-19T04:26:39.802 INFO:teuthology.orchestra.run.smithi092.stdout: "map_full": 0, 2024-09-19T04:26:39.802 INFO:teuthology.orchestra.run.smithi092.stdout: "map_inc": 4, 2024-09-19T04:26:39.802 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_sessions": 12, 2024-09-19T04:26:39.802 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_open": 12, 2024-09-19T04:26:39.802 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_close": 0, 2024-09-19T04:26:39.802 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_laggy": 0, 2024-09-19T04:26:39.802 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_wr": 233, 2024-09-19T04:26:39.802 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_rd": 0, 2024-09-19T04:26:39.802 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_del": 47 2024-09-19T04:26:39.802 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.802 INFO:teuthology.orchestra.run.smithi092.stdout: "oft": { 2024-09-19T04:26:39.802 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_objs": 1, 2024-09-19T04:26:39.802 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_kv_pairs": 0, 2024-09-19T04:26:39.803 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_updates": 0, 2024-09-19T04:26:39.803 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_removes": 0 2024-09-19T04:26:39.803 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.803 INFO:teuthology.orchestra.run.smithi092.stdout: "osd-slow-ops": { 2024-09-19T04:26:39.803 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_ops_count": 1013 2024-09-19T04:26:39.803 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.803 INFO:teuthology.orchestra.run.smithi092.stdout: "purge_queue": { 2024-09-19T04:26:39.803 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops": 0, 2024-09-19T04:26:39.803 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops_high_water": 10, 2024-09-19T04:26:39.803 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing": 0, 2024-09-19T04:26:39.803 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_high_water": 5, 2024-09-19T04:26:39.803 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executed_ops": 720, 2024-09-19T04:26:39.803 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executed": 360, 2024-09-19T04:26:39.803 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_item_in_journal": 0 2024-09-19T04:26:39.804 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.804 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T04:26:39.804 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-19T04:26:39.804 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2024-09-19T04:26:39.804 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-19T04:26:39.804 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 11090, 2024-09-19T04:26:39.804 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 3410548, 2024-09-19T04:26:39.804 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:39.804 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 11090, 2024-09-19T04:26:39.804 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-09-19T04:26:39.804 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-09-19T04:26:39.804 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 11090, 2024-09-19T04:26:39.804 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 3410548, 2024-09-19T04:26:39.805 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-19T04:26:39.805 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:39.805 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:39.805 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:39.805 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T04:26:39.805 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.805 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_bytes": { 2024-09-19T04:26:39.805 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-19T04:26:39.805 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2024-09-19T04:26:39.805 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-19T04:26:39.805 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-09-19T04:26:39.805 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-09-19T04:26:39.806 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:39.806 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:39.806 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 1238, 2024-09-19T04:26:39.806 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 3345013, 2024-09-19T04:26:39.806 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 1238, 2024-09-19T04:26:39.806 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 3345013, 2024-09-19T04:26:39.806 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-19T04:26:39.806 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:39.806 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:39.806 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:39.806 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T04:26:39.806 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.806 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_ops": { 2024-09-19T04:26:39.807 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-19T04:26:39.807 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 1024, 2024-09-19T04:26:39.807 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-19T04:26:39.807 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-09-19T04:26:39.807 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-09-19T04:26:39.807 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:39.807 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:39.807 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 1238, 2024-09-19T04:26:39.807 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 1238, 2024-09-19T04:26:39.807 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 1238, 2024-09-19T04:26:39.807 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 1238, 2024-09-19T04:26:39.808 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-19T04:26:39.808 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:39.808 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:39.808 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:39.808 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T04:26:39.808 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.808 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle": { 2024-09-19T04:26:39.808 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-19T04:26:39.808 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2024-09-19T04:26:39.809 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-19T04:26:39.809 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 360, 2024-09-19T04:26:39.809 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 39240, 2024-09-19T04:26:39.809 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:39.809 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 360, 2024-09-19T04:26:39.809 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-09-19T04:26:39.809 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-09-19T04:26:39.809 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 36, 2024-09-19T04:26:39.809 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 39240, 2024-09-19T04:26:39.809 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-19T04:26:39.809 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:39.809 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:39.809 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:39.810 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T04:26:39.810 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:39.810 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle-0x565232058500": { 2024-09-19T04:26:39.810 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-19T04:26:39.810 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2024-09-19T04:26:39.810 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-19T04:26:39.810 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 2209, 2024-09-19T04:26:39.810 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 2973961, 2024-09-19T04:26:39.810 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:39.810 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 2209, 2024-09-19T04:26:39.810 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-09-19T04:26:39.810 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-09-19T04:26:39.810 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 229, 2024-09-19T04:26:39.811 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 2973961, 2024-09-19T04:26:39.811 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-19T04:26:39.811 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:39.811 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:39.811 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:39.811 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T04:26:39.811 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T04:26:39.811 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T04:26:40.644 INFO:tasks.check_counter:Daemon mds.h mds.exported=16 2024-09-19T04:26:40.644 INFO:tasks.check_counter:Daemon mds.h mds.imported=2 2024-09-19T04:26:40.644 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=2 2024-09-19T04:26:40.644 DEBUG:tasks.check_counter:Getting stats from k 2024-09-19T04:26:40.645 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-19T04:26:40.893 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:26:41.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:40 smithi092 ceph-mon[34940]: pgmap v647: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 39 op/s 2024-09-19T04:26:41.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:40 smithi007 ceph-mon[31360]: pgmap v647: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 39 op/s 2024-09-19T04:26:41.408 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-09-19T04:26:41.408 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T04:26:41.408 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 2019, 2024-09-19T04:26:41.408 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 2018, 2024-09-19T04:26:41.408 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 3530953, 2024-09-19T04:26:41.408 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 640907, 2024-09-19T04:26:41.408 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 6, 2024-09-19T04:26:41.409 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 2, 2024-09-19T04:26:41.409 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.138085674, 2024-09-19T04:26:41.409 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.040725595, 2024-09-19T04:26:41.409 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.038368403, 2024-09-19T04:26:41.409 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.049349203, 2024-09-19T04:26:41.409 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:41.409 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 2017, 2024-09-19T04:26:41.409 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.065091684, 2024-09-19T04:26:41.409 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000032271 2024-09-19T04:26:41.409 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.409 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:41.409 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.410 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.410 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.410 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.410 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-19T04:26:41.410 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T04:26:41.410 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.410 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T04:26:41.410 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 238, 2024-09-19T04:26:41.410 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 217, 2024-09-19T04:26:41.410 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 881068, 2024-09-19T04:26:41.410 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 128858, 2024-09-19T04:26:41.411 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 3, 2024-09-19T04:26:41.411 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 2, 2024-09-19T04:26:41.411 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.031343108, 2024-09-19T04:26:41.411 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.012255793, 2024-09-19T04:26:41.411 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.027404443, 2024-09-19T04:26:41.411 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000090036, 2024-09-19T04:26:41.411 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:41.411 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 216, 2024-09-19T04:26:41.411 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.011255949, 2024-09-19T04:26:41.411 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000052110 2024-09-19T04:26:41.411 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.411 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:41.412 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.412 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.412 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.412 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.412 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 880512, 2024-09-19T04:26:41.412 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 128160 2024-09-19T04:26:41.412 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.412 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T04:26:41.412 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 2, 2024-09-19T04:26:41.412 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 158, 2024-09-19T04:26:41.412 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 428, 2024-09-19T04:26:41.412 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 337150, 2024-09-19T04:26:41.412 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 4, 2024-09-19T04:26:41.412 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 3, 2024-09-19T04:26:41.413 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.008741185, 2024-09-19T04:26:41.413 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.006009662, 2024-09-19T04:26:41.413 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.001325782, 2024-09-19T04:26:41.413 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.000038698, 2024-09-19T04:26:41.413 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:41.413 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 156, 2024-09-19T04:26:41.413 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.008117674, 2024-09-19T04:26:41.413 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000052036 2024-09-19T04:26:41.413 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.413 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:41.413 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.413 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.414 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.414 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.414 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T04:26:41.414 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 336832 2024-09-19T04:26:41.414 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.414 INFO:teuthology.orchestra.run.smithi092.stdout: "cct": { 2024-09-19T04:26:41.414 INFO:teuthology.orchestra.run.smithi092.stdout: "total_workers": 1, 2024-09-19T04:26:41.414 INFO:teuthology.orchestra.run.smithi092.stdout: "unhealthy_workers": 0 2024-09-19T04:26:41.414 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.414 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-MDSRank": { 2024-09-19T04:26:41.415 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2024-09-19T04:26:41.415 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2024-09-19T04:26:41.415 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 3435, 2024-09-19T04:26:41.415 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.072756514, 2024-09-19T04:26:41.415 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000021180 2024-09-19T04:26:41.415 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T04:26:41.415 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.415 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-PurgeQueue": { 2024-09-19T04:26:41.415 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2024-09-19T04:26:41.415 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2024-09-19T04:26:41.415 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.416 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.416 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.416 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T04:26:41.416 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.416 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": { 2024-09-19T04:26:41.416 INFO:teuthology.orchestra.run.smithi092.stdout: "request": 0, 2024-09-19T04:26:41.416 INFO:teuthology.orchestra.run.smithi092.stdout: "reply": 0, 2024-09-19T04:26:41.416 INFO:teuthology.orchestra.run.smithi092.stdout: "reply_latency": { 2024-09-19T04:26:41.416 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.416 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.416 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.416 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.417 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_reply": 0, 2024-09-19T04:26:41.417 INFO:teuthology.orchestra.run.smithi092.stdout: "forward": 0, 2024-09-19T04:26:41.417 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_complete": 0, 2024-09-19T04:26:41.417 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_keys": 0, 2024-09-19T04:26:41.417 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_commit": 0, 2024-09-19T04:26:41.417 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_split": 0, 2024-09-19T04:26:41.417 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_merge": 0, 2024-09-19T04:26:41.417 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes": 355, 2024-09-19T04:26:41.417 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_top": 0, 2024-09-19T04:26:41.417 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_bottom": 355, 2024-09-19T04:26:41.417 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pin_tail": 0, 2024-09-19T04:26:41.417 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pinned": 355, 2024-09-19T04:26:41.418 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_expired": 0, 2024-09-19T04:26:41.418 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_with_caps": 0, 2024-09-19T04:26:41.418 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": 0, 2024-09-19T04:26:41.418 INFO:teuthology.orchestra.run.smithi092.stdout: "subtrees": 1, 2024-09-19T04:26:41.418 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse": 0, 2024-09-19T04:26:41.418 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_hit": 0, 2024-09-19T04:26:41.418 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_forward": 0, 2024-09-19T04:26:41.418 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_discover": 0, 2024-09-19T04:26:41.418 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_dir_fetch": 0, 2024-09-19T04:26:41.418 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_remote_ino": 0, 2024-09-19T04:26:41.418 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_lock": 0, 2024-09-19T04:26:41.418 INFO:teuthology.orchestra.run.smithi092.stdout: "load_cent": 0, 2024-09-19T04:26:41.418 INFO:teuthology.orchestra.run.smithi092.stdout: "q": 0, 2024-09-19T04:26:41.419 INFO:teuthology.orchestra.run.smithi092.stdout: "exported": 0, 2024-09-19T04:26:41.419 INFO:teuthology.orchestra.run.smithi092.stdout: "exported_inodes": 0, 2024-09-19T04:26:41.419 INFO:teuthology.orchestra.run.smithi092.stdout: "imported": 0, 2024-09-19T04:26:41.419 INFO:teuthology.orchestra.run.smithi092.stdout: "imported_inodes": 0, 2024-09-19T04:26:41.419 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_dir_fetch": 0, 2024-09-19T04:26:41.419 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_backtrace_fetch": 0, 2024-09-19T04:26:41.419 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_peer_discover": 0, 2024-09-19T04:26:41.419 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rfiles": 0, 2024-09-19T04:26:41.419 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rbytes": 0, 2024-09-19T04:26:41.419 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rsnaps": 0, 2024-09-19T04:26:41.419 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T04:26:41.420 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_set_tag": 0, 2024-09-19T04:26:41.420 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T04:26:41.420 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_inotable_repaired": 0, 2024-09-19T04:26:41.420 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_inodes": 0, 2024-09-19T04:26:41.420 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T04:26:41.420 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T04:26:41.420 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_file_inodes": 0, 2024-09-19T04:26:41.420 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_inode_file_caps": 0, 2024-09-19T04:26:41.420 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T04:26:41.420 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_grant": 0, 2024-09-19T04:26:41.420 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T04:26:41.421 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T04:26:41.421 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T04:26:41.421 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps": 0, 2024-09-19T04:26:41.421 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps_dirty": 0, 2024-09-19T04:26:41.421 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_cap_release": 0, 2024-09-19T04:26:41.421 INFO:teuthology.orchestra.run.smithi092.stdout: "process_request_cap_release": 0 2024-09-19T04:26:41.421 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.421 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_cache": { 2024-09-19T04:26:41.421 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update": 0, 2024-09-19T04:26:41.421 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update_receipt": 0, 2024-09-19T04:26:41.421 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_try_discover": 0, 2024-09-19T04:26:41.421 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_send_discover": 0, 2024-09-19T04:26:41.422 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_handle_discover": 0, 2024-09-19T04:26:41.422 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays": 0, 2024-09-19T04:26:41.422 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_delayed": 0, 2024-09-19T04:26:41.422 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_enqueuing": 0, 2024-09-19T04:26:41.422 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_created": 0, 2024-09-19T04:26:41.422 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_enqueued": 0, 2024-09-19T04:26:41.422 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_reintegrated": 0, 2024-09-19T04:26:41.422 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_migrated": 0, 2024-09-19T04:26:41.422 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_processing": 0, 2024-09-19T04:26:41.422 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_enqueued": 0, 2024-09-19T04:26:41.422 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_prioritized": 0, 2024-09-19T04:26:41.422 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_started": 0, 2024-09-19T04:26:41.422 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_completed": 0, 2024-09-19T04:26:41.423 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_quiesce_path": 0, 2024-09-19T04:26:41.423 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_quiesce_inode": 0, 2024-09-19T04:26:41.423 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T04:26:41.423 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_exportdir": 0, 2024-09-19T04:26:41.423 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_flush": 0, 2024-09-19T04:26:41.423 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragmentdir": 0, 2024-09-19T04:26:41.423 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragstats": 0, 2024-09-19T04:26:41.423 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_inodestats": 0 2024-09-19T04:26:41.423 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.423 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_log": { 2024-09-19T04:26:41.423 INFO:teuthology.orchestra.run.smithi092.stdout: "evlrg": 0, 2024-09-19T04:26:41.423 INFO:teuthology.orchestra.run.smithi092.stdout: "evadd": 0, 2024-09-19T04:26:41.423 INFO:teuthology.orchestra.run.smithi092.stdout: "evex": 0, 2024-09-19T04:26:41.424 INFO:teuthology.orchestra.run.smithi092.stdout: "evtrm": 0, 2024-09-19T04:26:41.424 INFO:teuthology.orchestra.run.smithi092.stdout: "ev": 2157, 2024-09-19T04:26:41.424 INFO:teuthology.orchestra.run.smithi092.stdout: "evexg": 0, 2024-09-19T04:26:41.424 INFO:teuthology.orchestra.run.smithi092.stdout: "evexd": 0, 2024-09-19T04:26:41.424 INFO:teuthology.orchestra.run.smithi092.stdout: "segadd": 0, 2024-09-19T04:26:41.424 INFO:teuthology.orchestra.run.smithi092.stdout: "segex": 0, 2024-09-19T04:26:41.424 INFO:teuthology.orchestra.run.smithi092.stdout: "segtrm": 0, 2024-09-19T04:26:41.424 INFO:teuthology.orchestra.run.smithi092.stdout: "seg": 4, 2024-09-19T04:26:41.424 INFO:teuthology.orchestra.run.smithi092.stdout: "segmjr": 2, 2024-09-19T04:26:41.424 INFO:teuthology.orchestra.run.smithi092.stdout: "segexg": 0, 2024-09-19T04:26:41.424 INFO:teuthology.orchestra.run.smithi092.stdout: "segexd": 0, 2024-09-19T04:26:41.424 INFO:teuthology.orchestra.run.smithi092.stdout: "expos": 4194304, 2024-09-19T04:26:41.424 INFO:teuthology.orchestra.run.smithi092.stdout: "wrpos": 7153782, 2024-09-19T04:26:41.425 INFO:teuthology.orchestra.run.smithi092.stdout: "rdpos": 7152644, 2024-09-19T04:26:41.425 INFO:teuthology.orchestra.run.smithi092.stdout: "jlat": { 2024-09-19T04:26:41.425 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.425 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.425 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.425 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.425 INFO:teuthology.orchestra.run.smithi092.stdout: "replayed": 2157 2024-09-19T04:26:41.425 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.425 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_mem": { 2024-09-19T04:26:41.425 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 5, 2024-09-19T04:26:41.425 INFO:teuthology.orchestra.run.smithi092.stdout: "ino+": 370, 2024-09-19T04:26:41.425 INFO:teuthology.orchestra.run.smithi092.stdout: "ino-": 365, 2024-09-19T04:26:41.426 INFO:teuthology.orchestra.run.smithi092.stdout: "dir": 3, 2024-09-19T04:26:41.426 INFO:teuthology.orchestra.run.smithi092.stdout: "dir+": 24, 2024-09-19T04:26:41.426 INFO:teuthology.orchestra.run.smithi092.stdout: "dir-": 21, 2024-09-19T04:26:41.426 INFO:teuthology.orchestra.run.smithi092.stdout: "dn": 355, 2024-09-19T04:26:41.426 INFO:teuthology.orchestra.run.smithi092.stdout: "dn+": 821, 2024-09-19T04:26:41.426 INFO:teuthology.orchestra.run.smithi092.stdout: "dn-": 466, 2024-09-19T04:26:41.426 INFO:teuthology.orchestra.run.smithi092.stdout: "cap": 0, 2024-09-19T04:26:41.426 INFO:teuthology.orchestra.run.smithi092.stdout: "cap+": 0, 2024-09-19T04:26:41.426 INFO:teuthology.orchestra.run.smithi092.stdout: "cap-": 0, 2024-09-19T04:26:41.426 INFO:teuthology.orchestra.run.smithi092.stdout: "rss": 54680, 2024-09-19T04:26:41.426 INFO:teuthology.orchestra.run.smithi092.stdout: "heap": 215328 2024-09-19T04:26:41.426 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.427 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_server": { 2024-09-19T04:26:41.427 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_client_request": 0, 2024-09-19T04:26:41.427 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_server_request": 0, 2024-09-19T04:26:41.427 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_request": 0, 2024-09-19T04:26:41.427 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_session": 0, 2024-09-19T04:26:41.427 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_peer_request": 0, 2024-09-19T04:26:41.427 INFO:teuthology.orchestra.run.smithi092.stdout: "req_create_latency": { 2024-09-19T04:26:41.427 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.427 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.427 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.427 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.427 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getattr_latency": { 2024-09-19T04:26:41.428 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.428 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.428 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.428 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.428 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getfilelock_latency": { 2024-09-19T04:26:41.428 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.428 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.428 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.428 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.428 INFO:teuthology.orchestra.run.smithi092.stdout: "req_link_latency": { 2024-09-19T04:26:41.428 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.428 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.429 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.429 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.429 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookup_latency": { 2024-09-19T04:26:41.429 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.429 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.429 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.429 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.429 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookuphash_latency": { 2024-09-19T04:26:41.429 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.429 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.429 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.429 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.429 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupino_latency": { 2024-09-19T04:26:41.430 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.430 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.430 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.430 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.430 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupname_latency": { 2024-09-19T04:26:41.430 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.430 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.430 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.430 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.430 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupparent_latency": { 2024-09-19T04:26:41.430 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.430 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.431 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.431 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.431 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupsnap_latency": { 2024-09-19T04:26:41.431 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.431 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.431 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.431 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.431 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lssnap_latency": { 2024-09-19T04:26:41.431 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.431 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.431 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.431 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.431 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mkdir_latency": { 2024-09-19T04:26:41.432 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:40 smithi102 ceph-mon[35446]: pgmap v647: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 39 op/s 2024-09-19T04:26:41.432 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.433 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.433 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.433 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.433 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mknod_latency": { 2024-09-19T04:26:41.433 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.433 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.433 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.433 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.433 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mksnap_latency": { 2024-09-19T04:26:41.433 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.433 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.433 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.434 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.434 INFO:teuthology.orchestra.run.smithi092.stdout: "req_open_latency": { 2024-09-19T04:26:41.434 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.434 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.434 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.434 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.434 INFO:teuthology.orchestra.run.smithi092.stdout: "req_readdir_latency": { 2024-09-19T04:26:41.434 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.434 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.434 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.434 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.435 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rename_latency": { 2024-09-19T04:26:41.435 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.435 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.435 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.435 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.435 INFO:teuthology.orchestra.run.smithi092.stdout: "req_renamesnap_latency": { 2024-09-19T04:26:41.435 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.435 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.435 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.435 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.435 INFO:teuthology.orchestra.run.smithi092.stdout: "req_snapdiff_latency": { 2024-09-19T04:26:41.435 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.435 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.436 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.436 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.436 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmdir_latency": { 2024-09-19T04:26:41.436 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.436 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.436 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.436 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.436 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmsnap_latency": { 2024-09-19T04:26:41.436 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.436 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.436 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.436 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.437 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmxattr_latency": { 2024-09-19T04:26:41.437 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.437 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.437 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.437 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.437 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setattr_latency": { 2024-09-19T04:26:41.437 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.437 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.437 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.437 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.437 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setdirlayout_latency": { 2024-09-19T04:26:41.437 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.438 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.438 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.438 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.438 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setfilelock_latency": { 2024-09-19T04:26:41.438 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.438 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.438 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.438 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.438 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setlayout_latency": { 2024-09-19T04:26:41.438 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.438 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.438 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.438 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.439 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setxattr_latency": { 2024-09-19T04:26:41.439 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.439 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.439 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.439 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.439 INFO:teuthology.orchestra.run.smithi092.stdout: "req_symlink_latency": { 2024-09-19T04:26:41.439 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.439 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.439 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.439 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.439 INFO:teuthology.orchestra.run.smithi092.stdout: "req_unlink_latency": { 2024-09-19T04:26:41.439 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.440 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.440 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.440 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.440 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_revoke_eviction": 0, 2024-09-19T04:26:41.440 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_acquisition_throttle": 0, 2024-09-19T04:26:41.440 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getvxattr_latency": { 2024-09-19T04:26:41.440 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.440 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.440 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.440 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T04:26:41.440 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.440 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_sessions": { 2024-09-19T04:26:41.440 INFO:teuthology.orchestra.run.smithi092.stdout: "session_count": 1, 2024-09-19T04:26:41.441 INFO:teuthology.orchestra.run.smithi092.stdout: "session_add": 2, 2024-09-19T04:26:41.441 INFO:teuthology.orchestra.run.smithi092.stdout: "session_remove": 1, 2024-09-19T04:26:41.441 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_open": 1, 2024-09-19T04:26:41.441 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_stale": 0, 2024-09-19T04:26:41.441 INFO:teuthology.orchestra.run.smithi092.stdout: "total_load": 0, 2024-09-19T04:26:41.441 INFO:teuthology.orchestra.run.smithi092.stdout: "average_load": 0, 2024-09-19T04:26:41.441 INFO:teuthology.orchestra.run.smithi092.stdout: "avg_session_uptime": 1874, 2024-09-19T04:26:41.441 INFO:teuthology.orchestra.run.smithi092.stdout: "mdthresh_evicted": 0 2024-09-19T04:26:41.441 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.441 INFO:teuthology.orchestra.run.smithi092.stdout: "mempool": { 2024-09-19T04:26:41.441 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_bytes": 0, 2024-09-19T04:26:41.441 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_items": 0, 2024-09-19T04:26:41.442 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T04:26:41.442 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_items": 0, 2024-09-19T04:26:41.442 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T04:26:41.442 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_items": 0, 2024-09-19T04:26:41.442 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T04:26:41.442 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T04:26:41.442 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T04:26:41.442 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T04:26:41.444 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T04:26:41.444 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_items": 0, 2024-09-19T04:26:41.444 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T04:26:41.444 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T04:26:41.444 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_bytes": 0, 2024-09-19T04:26:41.444 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_items": 0, 2024-09-19T04:26:41.444 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_bytes": 0, 2024-09-19T04:26:41.444 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_items": 0, 2024-09-19T04:26:41.444 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T04:26:41.444 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T04:26:41.445 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T04:26:41.445 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T04:26:41.445 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T04:26:41.445 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_items": 0, 2024-09-19T04:26:41.445 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_bytes": 0, 2024-09-19T04:26:41.445 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_items": 0, 2024-09-19T04:26:41.445 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T04:26:41.445 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T04:26:41.445 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_bytes": 0, 2024-09-19T04:26:41.445 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_items": 0, 2024-09-19T04:26:41.445 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_bytes": 0, 2024-09-19T04:26:41.445 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_items": 0, 2024-09-19T04:26:41.446 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T04:26:41.446 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_items": 0, 2024-09-19T04:26:41.446 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T04:26:41.446 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_items": 0, 2024-09-19T04:26:41.446 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_bytes": 181320, 2024-09-19T04:26:41.446 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_items": 47, 2024-09-19T04:26:41.446 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_bytes": 0, 2024-09-19T04:26:41.446 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_items": 0, 2024-09-19T04:26:41.446 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_bytes": 0, 2024-09-19T04:26:41.446 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_items": 0, 2024-09-19T04:26:41.446 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_bytes": 0, 2024-09-19T04:26:41.446 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_items": 0, 2024-09-19T04:26:41.446 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_bytes": 0, 2024-09-19T04:26:41.447 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_items": 0, 2024-09-19T04:26:41.447 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_bytes": 9056, 2024-09-19T04:26:41.447 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_items": 171, 2024-09-19T04:26:41.447 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T04:26:41.447 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_items": 0, 2024-09-19T04:26:41.447 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_bytes": 0, 2024-09-19T04:26:41.447 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_items": 0, 2024-09-19T04:26:41.447 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_bytes": 265480, 2024-09-19T04:26:41.447 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_items": 1460, 2024-09-19T04:26:41.447 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_bytes": 0, 2024-09-19T04:26:41.447 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_items": 0, 2024-09-19T04:26:41.447 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_bytes": 0, 2024-09-19T04:26:41.448 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_items": 0 2024-09-19T04:26:41.448 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.448 INFO:teuthology.orchestra.run.smithi092.stdout: "objecter": { 2024-09-19T04:26:41.448 INFO:teuthology.orchestra.run.smithi092.stdout: "op_active": 0, 2024-09-19T04:26:41.448 INFO:teuthology.orchestra.run.smithi092.stdout: "op_laggy": 0, 2024-09-19T04:26:41.448 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send": 2017, 2024-09-19T04:26:41.448 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send_bytes": 21, 2024-09-19T04:26:41.448 INFO:teuthology.orchestra.run.smithi092.stdout: "op_resend": 3, 2024-09-19T04:26:41.448 INFO:teuthology.orchestra.run.smithi092.stdout: "op_reply": 2017, 2024-09-19T04:26:41.448 INFO:teuthology.orchestra.run.smithi092.stdout: "op_latency": { 2024-09-19T04:26:41.448 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 2017, 2024-09-19T04:26:41.448 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 7.031798510, 2024-09-19T04:26:41.449 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.003486265 2024-09-19T04:26:41.449 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.449 INFO:teuthology.orchestra.run.smithi092.stdout: "op_inflight": 0, 2024-09-19T04:26:41.449 INFO:teuthology.orchestra.run.smithi092.stdout: "oplen_avg": { 2024-09-19T04:26:41.449 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 2017, 2024-09-19T04:26:41.449 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 2018 2024-09-19T04:26:41.449 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.449 INFO:teuthology.orchestra.run.smithi092.stdout: "op": 2017, 2024-09-19T04:26:41.449 INFO:teuthology.orchestra.run.smithi092.stdout: "op_r": 2017, 2024-09-19T04:26:41.449 INFO:teuthology.orchestra.run.smithi092.stdout: "op_w": 0, 2024-09-19T04:26:41.449 INFO:teuthology.orchestra.run.smithi092.stdout: "op_rmw": 0, 2024-09-19T04:26:41.449 INFO:teuthology.orchestra.run.smithi092.stdout: "op_pg": 0, 2024-09-19T04:26:41.450 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_stat": 1258, 2024-09-19T04:26:41.450 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_create": 0, 2024-09-19T04:26:41.450 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_read": 757, 2024-09-19T04:26:41.450 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_write": 0, 2024-09-19T04:26:41.450 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writefull": 0, 2024-09-19T04:26:41.450 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writesame": 0, 2024-09-19T04:26:41.450 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_append": 0, 2024-09-19T04:26:41.450 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_zero": 0, 2024-09-19T04:26:41.450 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_truncate": 0, 2024-09-19T04:26:41.450 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_delete": 0, 2024-09-19T04:26:41.450 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_mapext": 0, 2024-09-19T04:26:41.450 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_sparse_read": 0, 2024-09-19T04:26:41.450 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_clonerange": 0, 2024-09-19T04:26:41.451 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_getxattr": 1, 2024-09-19T04:26:41.451 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_setxattr": 0, 2024-09-19T04:26:41.451 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_cmpxattr": 0, 2024-09-19T04:26:41.451 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_rmxattr": 0, 2024-09-19T04:26:41.451 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_resetxattrs": 0, 2024-09-19T04:26:41.451 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_call": 0, 2024-09-19T04:26:41.451 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_watch": 0, 2024-09-19T04:26:41.451 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_notify": 0, 2024-09-19T04:26:41.451 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T04:26:41.451 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls": 0, 2024-09-19T04:26:41.451 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls_filter": 0, 2024-09-19T04:26:41.451 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_other": 0, 2024-09-19T04:26:41.451 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_active": 0, 2024-09-19T04:26:41.452 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_send": 0, 2024-09-19T04:26:41.452 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_resend": 0, 2024-09-19T04:26:41.452 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_ping": 0, 2024-09-19T04:26:41.452 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_active": 0, 2024-09-19T04:26:41.452 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_send": 0, 2024-09-19T04:26:41.452 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_resend": 0, 2024-09-19T04:26:41.452 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_active": 0, 2024-09-19T04:26:41.452 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_send": 0, 2024-09-19T04:26:41.452 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_resend": 0, 2024-09-19T04:26:41.452 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_active": 0, 2024-09-19T04:26:41.452 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_send": 0, 2024-09-19T04:26:41.452 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_resend": 0, 2024-09-19T04:26:41.453 INFO:teuthology.orchestra.run.smithi092.stdout: "command_active": 0, 2024-09-19T04:26:41.453 INFO:teuthology.orchestra.run.smithi092.stdout: "command_send": 0, 2024-09-19T04:26:41.453 INFO:teuthology.orchestra.run.smithi092.stdout: "command_resend": 0, 2024-09-19T04:26:41.453 INFO:teuthology.orchestra.run.smithi092.stdout: "map_epoch": 90, 2024-09-19T04:26:41.453 INFO:teuthology.orchestra.run.smithi092.stdout: "map_full": 0, 2024-09-19T04:26:41.453 INFO:teuthology.orchestra.run.smithi092.stdout: "map_inc": 4, 2024-09-19T04:26:41.453 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_sessions": 4, 2024-09-19T04:26:41.453 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_open": 4, 2024-09-19T04:26:41.453 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_close": 0, 2024-09-19T04:26:41.453 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_laggy": 0, 2024-09-19T04:26:41.453 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_wr": 0, 2024-09-19T04:26:41.453 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_rd": 2, 2024-09-19T04:26:41.454 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_del": 0 2024-09-19T04:26:41.454 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.454 INFO:teuthology.orchestra.run.smithi092.stdout: "oft": { 2024-09-19T04:26:41.454 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_objs": 0, 2024-09-19T04:26:41.454 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_kv_pairs": 0, 2024-09-19T04:26:41.454 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_updates": 0, 2024-09-19T04:26:41.454 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_removes": 0 2024-09-19T04:26:41.454 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.454 INFO:teuthology.orchestra.run.smithi092.stdout: "osd-slow-ops": { 2024-09-19T04:26:41.454 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_ops_count": 0 2024-09-19T04:26:41.454 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.454 INFO:teuthology.orchestra.run.smithi092.stdout: "purge_queue": { 2024-09-19T04:26:41.455 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops": 0, 2024-09-19T04:26:41.455 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T04:26:41.455 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing": 0, 2024-09-19T04:26:41.455 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_high_water": 0, 2024-09-19T04:26:41.455 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executed_ops": 0, 2024-09-19T04:26:41.455 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executed": 0, 2024-09-19T04:26:41.455 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_item_in_journal": 0 2024-09-19T04:26:41.455 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.455 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T04:26:41.455 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-19T04:26:41.455 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2024-09-19T04:26:41.455 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-19T04:26:41.455 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 2255, 2024-09-19T04:26:41.456 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 4194415, 2024-09-19T04:26:41.456 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:41.456 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 2255, 2024-09-19T04:26:41.456 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-09-19T04:26:41.456 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-09-19T04:26:41.456 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 2255, 2024-09-19T04:26:41.456 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 4194415, 2024-09-19T04:26:41.456 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-19T04:26:41.456 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.456 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.456 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.456 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T04:26:41.457 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.457 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_bytes": { 2024-09-19T04:26:41.457 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-19T04:26:41.457 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2024-09-19T04:26:41.457 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-19T04:26:41.457 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-09-19T04:26:41.457 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-09-19T04:26:41.457 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:41.457 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:41.457 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 2017, 2024-09-19T04:26:41.457 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 2959483, 2024-09-19T04:26:41.458 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 2017, 2024-09-19T04:26:41.458 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 2959483, 2024-09-19T04:26:41.458 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-19T04:26:41.458 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.458 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.458 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.458 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T04:26:41.458 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.458 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_ops": { 2024-09-19T04:26:41.458 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-19T04:26:41.458 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 1024, 2024-09-19T04:26:41.458 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-19T04:26:41.459 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-09-19T04:26:41.459 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-09-19T04:26:41.459 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:41.459 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:41.459 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 2017, 2024-09-19T04:26:41.459 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 2017, 2024-09-19T04:26:41.459 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 2017, 2024-09-19T04:26:41.459 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 2017, 2024-09-19T04:26:41.459 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-19T04:26:41.459 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.459 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.459 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.459 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T04:26:41.460 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.460 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle": { 2024-09-19T04:26:41.460 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-19T04:26:41.460 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2024-09-19T04:26:41.460 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-19T04:26:41.460 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-09-19T04:26:41.460 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-09-19T04:26:41.460 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:41.460 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:41.460 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-09-19T04:26:41.460 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-09-19T04:26:41.460 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 0, 2024-09-19T04:26:41.461 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 0, 2024-09-19T04:26:41.461 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-19T04:26:41.461 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.461 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.461 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.461 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T04:26:41.461 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-09-19T04:26:41.461 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle-0x55a180d926e0": { 2024-09-19T04:26:41.461 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-09-19T04:26:41.461 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2024-09-19T04:26:41.461 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-09-19T04:26:41.461 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-09-19T04:26:41.461 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-09-19T04:26:41.461 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:41.462 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:41.462 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-09-19T04:26:41.462 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-09-19T04:26:41.462 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 0, 2024-09-19T04:26:41.462 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 0, 2024-09-19T04:26:41.462 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-09-19T04:26:41.462 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-09-19T04:26:41.462 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-09-19T04:26:41.462 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-09-19T04:26:41.462 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T04:26:41.462 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-09-19T04:26:41.462 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-09-19T04:26:42.265 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-19T04:26:42.266 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-19T04:26:42.266 INFO:tasks.check_counter:Daemon mds.k mds.dir_split=0 2024-09-19T04:26:42.266 DEBUG:tasks.check_counter:Getting stats from c 2024-09-19T04:26:42.266 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-19T04:26:42.526 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:26:43.029 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-19T04:26:43.029 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T04:26:43.030 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 7787, 2024-09-19T04:26:43.030 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 8720, 2024-09-19T04:26:43.030 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 3122386, 2024-09-19T04:26:43.030 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 6884605, 2024-09-19T04:26:43.030 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 8, 2024-09-19T04:26:43.030 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 3, 2024-09-19T04:26:43.030 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.546714864, 2024-09-19T04:26:43.030 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.210455747, 2024-09-19T04:26:43.030 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.384583028, 2024-09-19T04:26:43.030 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.031220583, 2024-09-19T04:26:43.030 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:43.030 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 8721, 2024-09-19T04:26:43.031 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.349958614, 2024-09-19T04:26:43.031 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000040128 2024-09-19T04:26:43.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.031 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:43.031 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 14186, 2024-09-19T04:26:43.031 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.002404483, 2024-09-19T04:26:43.031 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000169 2024-09-19T04:26:43.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.031 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 898432, 2024-09-19T04:26:43.031 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 131056 2024-09-19T04:26:43.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.031 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T04:26:43.032 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 865, 2024-09-19T04:26:43.032 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 1018, 2024-09-19T04:26:43.032 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 224047, 2024-09-19T04:26:43.032 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 2176548, 2024-09-19T04:26:43.032 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 10, 2024-09-19T04:26:43.032 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 8, 2024-09-19T04:26:43.032 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.079169848, 2024-09-19T04:26:43.032 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.030081936, 2024-09-19T04:26:43.032 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.019269438, 2024-09-19T04:26:43.032 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.023212509, 2024-09-19T04:26:43.032 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:43.032 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 1016, 2024-09-19T04:26:43.032 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.091720237, 2024-09-19T04:26:43.033 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000090275 2024-09-19T04:26:43.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.033 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:43.033 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2, 2024-09-19T04:26:43.033 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000142, 2024-09-19T04:26:43.033 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000071 2024-09-19T04:26:43.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.033 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T04:26:43.033 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 336304 2024-09-19T04:26:43.034 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.034 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T04:26:43.034 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 12508, 2024-09-19T04:26:43.034 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 16223, 2024-09-19T04:26:43.034 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 4418280, 2024-09-19T04:26:43.034 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 6595072, 2024-09-19T04:26:43.034 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 12, 2024-09-19T04:26:43.034 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 8, 2024-09-19T04:26:43.034 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.554612627, 2024-09-19T04:26:43.035 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.232096821, 2024-09-19T04:26:43.035 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.589451047, 2024-09-19T04:26:43.035 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.015477580, 2024-09-19T04:26:43.035 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:43.035 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 16220, 2024-09-19T04:26:43.036 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 1.453215977, 2024-09-19T04:26:43.036 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000089594 2024-09-19T04:26:43.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.036 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:43.036 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 22204, 2024-09-19T04:26:43.036 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.004025536, 2024-09-19T04:26:43.036 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000181 2024-09-19T04:26:43.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.036 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-19T04:26:43.036 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T04:26:43.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.036 INFO:teuthology.orchestra.run.smithi102.stdout: "cct": { 2024-09-19T04:26:43.036 INFO:teuthology.orchestra.run.smithi102.stdout: "total_workers": 1, 2024-09-19T04:26:43.037 INFO:teuthology.orchestra.run.smithi102.stdout: "unhealthy_workers": 0 2024-09-19T04:26:43.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.037 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-MDSRank": { 2024-09-19T04:26:43.037 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2024-09-19T04:26:43.037 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2024-09-19T04:26:43.037 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 790, 2024-09-19T04:26:43.037 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 1.424687672, 2024-09-19T04:26:43.037 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.001803402 2024-09-19T04:26:43.037 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:43.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.037 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-PurgeQueue": { 2024-09-19T04:26:43.037 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2024-09-19T04:26:43.037 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2024-09-19T04:26:43.038 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 1578, 2024-09-19T04:26:43.038 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.105120634, 2024-09-19T04:26:43.038 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000066616 2024-09-19T04:26:43.038 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:43.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.038 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": { 2024-09-19T04:26:43.038 INFO:teuthology.orchestra.run.smithi102.stdout: "request": 3526, 2024-09-19T04:26:43.038 INFO:teuthology.orchestra.run.smithi102.stdout: "reply": 3509, 2024-09-19T04:26:43.038 INFO:teuthology.orchestra.run.smithi102.stdout: "reply_latency": { 2024-09-19T04:26:43.038 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 3509, 2024-09-19T04:26:43.038 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 20.648717077, 2024-09-19T04:26:43.038 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.005884501 2024-09-19T04:26:43.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.038 INFO:teuthology.orchestra.run.smithi102.stdout: "slow_reply": 0, 2024-09-19T04:26:43.039 INFO:teuthology.orchestra.run.smithi102.stdout: "forward": 17, 2024-09-19T04:26:43.039 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_fetch_complete": 0, 2024-09-19T04:26:43.039 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_fetch_keys": 0, 2024-09-19T04:26:43.039 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_commit": 20, 2024-09-19T04:26:43.039 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_split": 1, 2024-09-19T04:26:43.039 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_merge": 0, 2024-09-19T04:26:43.039 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes": 14, 2024-09-19T04:26:43.039 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_top": 1, 2024-09-19T04:26:43.039 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_bottom": 2, 2024-09-19T04:26:43.039 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_pin_tail": 11, 2024-09-19T04:26:43.039 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_pinned": 11, 2024-09-19T04:26:43.039 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_expired": 26, 2024-09-19T04:26:43.039 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_with_caps": 1, 2024-09-19T04:26:43.040 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": 1, 2024-09-19T04:26:43.040 INFO:teuthology.orchestra.run.smithi102.stdout: "subtrees": 3, 2024-09-19T04:26:43.040 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse": 8045, 2024-09-19T04:26:43.040 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_hit": 5618, 2024-09-19T04:26:43.040 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_forward": 17, 2024-09-19T04:26:43.040 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_discover": 2, 2024-09-19T04:26:43.040 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_dir_fetch": 0, 2024-09-19T04:26:43.040 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_remote_ino": 0, 2024-09-19T04:26:43.040 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_lock": 157, 2024-09-19T04:26:43.040 INFO:teuthology.orchestra.run.smithi102.stdout: "load_cent": 0, 2024-09-19T04:26:43.040 INFO:teuthology.orchestra.run.smithi102.stdout: "q": 0, 2024-09-19T04:26:43.040 INFO:teuthology.orchestra.run.smithi102.stdout: "exported": 16, 2024-09-19T04:26:43.041 INFO:teuthology.orchestra.run.smithi102.stdout: "exported_inodes": 11, 2024-09-19T04:26:43.041 INFO:teuthology.orchestra.run.smithi102.stdout: "imported": 9, 2024-09-19T04:26:43.041 INFO:teuthology.orchestra.run.smithi102.stdout: "imported_inodes": 420, 2024-09-19T04:26:43.041 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_dir_fetch": 0, 2024-09-19T04:26:43.041 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_backtrace_fetch": 0, 2024-09-19T04:26:43.041 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_peer_discover": 0, 2024-09-19T04:26:43.041 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rfiles": 4, 2024-09-19T04:26:43.041 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rbytes": 234, 2024-09-19T04:26:43.041 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rsnaps": 0, 2024-09-19T04:26:43.041 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T04:26:43.042 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_set_tag": 0, 2024-09-19T04:26:43.042 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T04:26:43.042 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_inotable_repaired": 0, 2024-09-19T04:26:43.042 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dir_inodes": 0, 2024-09-19T04:26:43.042 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T04:26:43.042 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T04:26:43.042 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_file_inodes": 0, 2024-09-19T04:26:43.042 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_inode_file_caps": 48, 2024-09-19T04:26:43.042 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_revoke": 2430, 2024-09-19T04:26:43.042 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_grant": 2881, 2024-09-19T04:26:43.043 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T04:26:43.043 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T04:26:43.043 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T04:26:43.043 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_caps": 3683, 2024-09-19T04:26:43.043 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_caps_dirty": 596, 2024-09-19T04:26:43.043 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_cap_release": 102, 2024-09-19T04:26:43.043 INFO:teuthology.orchestra.run.smithi102.stdout: "process_request_cap_release": 2683 2024-09-19T04:26:43.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.043 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache": { 2024-09-19T04:26:43.043 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_update": 0, 2024-09-19T04:26:43.043 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_update_receipt": 0, 2024-09-19T04:26:43.043 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_try_discover": 0, 2024-09-19T04:26:43.044 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_send_discover": 3, 2024-09-19T04:26:43.044 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_handle_discover": 15, 2024-09-19T04:26:43.044 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays": 0, 2024-09-19T04:26:43.044 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays_delayed": 0, 2024-09-19T04:26:43.044 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays_enqueuing": 0, 2024-09-19T04:26:43.044 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_created": 697, 2024-09-19T04:26:43.044 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_enqueued": 697, 2024-09-19T04:26:43.044 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_reintegrated": 0, 2024-09-19T04:26:43.044 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_migrated": 0, 2024-09-19T04:26:43.044 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_processing": 0, 2024-09-19T04:26:43.044 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_enqueued": 0, 2024-09-19T04:26:43.044 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_prioritized": 0, 2024-09-19T04:26:43.045 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_started": 0, 2024-09-19T04:26:43.045 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_completed": 0, 2024-09-19T04:26:43.045 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_quiesce_path": 8, 2024-09-19T04:26:43.045 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_quiesce_inode": 1179, 2024-09-19T04:26:43.045 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T04:26:43.045 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_exportdir": 16, 2024-09-19T04:26:43.045 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_flush": 0, 2024-09-19T04:26:43.045 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_fragmentdir": 1, 2024-09-19T04:26:43.045 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_fragstats": 0, 2024-09-19T04:26:43.045 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_inodestats": 0 2024-09-19T04:26:43.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.046 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log": { 2024-09-19T04:26:43.046 INFO:teuthology.orchestra.run.smithi102.stdout: "evlrg": 0, 2024-09-19T04:26:43.046 INFO:teuthology.orchestra.run.smithi102.stdout: "evadd": 3870, 2024-09-19T04:26:43.046 INFO:teuthology.orchestra.run.smithi102.stdout: "evex": 0, 2024-09-19T04:26:43.046 INFO:teuthology.orchestra.run.smithi102.stdout: "evtrm": 0, 2024-09-19T04:26:43.046 INFO:teuthology.orchestra.run.smithi102.stdout: "ev": 3870, 2024-09-19T04:26:43.047 INFO:teuthology.orchestra.run.smithi102.stdout: "evexg": 0, 2024-09-19T04:26:43.047 INFO:teuthology.orchestra.run.smithi102.stdout: "evexd": 0, 2024-09-19T04:26:43.047 INFO:teuthology.orchestra.run.smithi102.stdout: "segadd": 5, 2024-09-19T04:26:43.047 INFO:teuthology.orchestra.run.smithi102.stdout: "segex": 0, 2024-09-19T04:26:43.047 INFO:teuthology.orchestra.run.smithi102.stdout: "segtrm": 0, 2024-09-19T04:26:43.047 INFO:teuthology.orchestra.run.smithi102.stdout: "seg": 5, 2024-09-19T04:26:43.047 INFO:teuthology.orchestra.run.smithi102.stdout: "segmjr": 2, 2024-09-19T04:26:43.047 INFO:teuthology.orchestra.run.smithi102.stdout: "segexg": 0, 2024-09-19T04:26:43.047 INFO:teuthology.orchestra.run.smithi102.stdout: "segexd": 0, 2024-09-19T04:26:43.047 INFO:teuthology.orchestra.run.smithi102.stdout: "expos": 4194304, 2024-09-19T04:26:43.047 INFO:teuthology.orchestra.run.smithi102.stdout: "wrpos": 9791506, 2024-09-19T04:26:43.048 INFO:teuthology.orchestra.run.smithi102.stdout: "rdpos": 0, 2024-09-19T04:26:43.048 INFO:teuthology.orchestra.run.smithi102.stdout: "jlat": { 2024-09-19T04:26:43.048 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 385, 2024-09-19T04:26:43.048 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 4.376287132, 2024-09-19T04:26:43.048 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.011366979 2024-09-19T04:26:43.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.048 INFO:teuthology.orchestra.run.smithi102.stdout: "replayed": 0 2024-09-19T04:26:43.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.048 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_mem": { 2024-09-19T04:26:43.048 INFO:teuthology.orchestra.run.smithi102.stdout: "ino": 18, 2024-09-19T04:26:43.049 INFO:teuthology.orchestra.run.smithi102.stdout: "ino+": 724, 2024-09-19T04:26:43.049 INFO:teuthology.orchestra.run.smithi102.stdout: "ino-": 706, 2024-09-19T04:26:43.049 INFO:teuthology.orchestra.run.smithi102.stdout: "dir": 17, 2024-09-19T04:26:43.049 INFO:teuthology.orchestra.run.smithi102.stdout: "dir+": 52, 2024-09-19T04:26:43.049 INFO:teuthology.orchestra.run.smithi102.stdout: "dir-": 35, 2024-09-19T04:26:43.049 INFO:teuthology.orchestra.run.smithi102.stdout: "dn": 14, 2024-09-19T04:26:43.049 INFO:teuthology.orchestra.run.smithi102.stdout: "dn+": 1506, 2024-09-19T04:26:43.049 INFO:teuthology.orchestra.run.smithi102.stdout: "dn-": 1492, 2024-09-19T04:26:43.049 INFO:teuthology.orchestra.run.smithi102.stdout: "cap": 1, 2024-09-19T04:26:43.049 INFO:teuthology.orchestra.run.smithi102.stdout: "cap+": 903, 2024-09-19T04:26:43.049 INFO:teuthology.orchestra.run.smithi102.stdout: "cap-": 902, 2024-09-19T04:26:43.049 INFO:teuthology.orchestra.run.smithi102.stdout: "rss": 62744, 2024-09-19T04:26:43.050 INFO:teuthology.orchestra.run.smithi102.stdout: "heap": 223520 2024-09-19T04:26:43.050 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.050 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_server": { 2024-09-19T04:26:43.050 INFO:teuthology.orchestra.run.smithi102.stdout: "dispatch_client_request": 5425, 2024-09-19T04:26:43.050 INFO:teuthology.orchestra.run.smithi102.stdout: "dispatch_server_request": 586, 2024-09-19T04:26:43.050 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_request": 3526, 2024-09-19T04:26:43.050 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_session": 8, 2024-09-19T04:26:43.050 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_peer_request": 2647, 2024-09-19T04:26:43.050 INFO:teuthology.orchestra.run.smithi102.stdout: "req_create_latency": { 2024-09-19T04:26:43.050 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 538, 2024-09-19T04:26:43.051 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 3.450250507, 2024-09-19T04:26:43.051 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.006413105 2024-09-19T04:26:43.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.051 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getattr_latency": { 2024-09-19T04:26:43.051 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:43.051 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:43.051 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:43.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.051 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getfilelock_latency": { 2024-09-19T04:26:43.051 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:43.051 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:43.051 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:43.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.052 INFO:teuthology.orchestra.run.smithi102.stdout: "req_link_latency": { 2024-09-19T04:26:43.052 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:43.052 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:43.052 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:43.052 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.052 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookup_latency": { 2024-09-19T04:26:43.052 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 1656, 2024-09-19T04:26:43.052 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 12.042548204, 2024-09-19T04:26:43.052 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.007272070 2024-09-19T04:26:43.052 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.052 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookuphash_latency": { 2024-09-19T04:26:43.052 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:43.053 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:43.053 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:43.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.053 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupino_latency": { 2024-09-19T04:26:43.053 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 1, 2024-09-19T04:26:43.053 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000128427, 2024-09-19T04:26:43.053 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000128427 2024-09-19T04:26:43.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.053 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupname_latency": { 2024-09-19T04:26:43.053 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:43.053 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:43.053 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:43.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.054 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupparent_latency": { 2024-09-19T04:26:43.054 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:43.054 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:43.054 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:43.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.055 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupsnap_latency": { 2024-09-19T04:26:43.055 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:43.055 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:43.055 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:43.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.056 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lssnap_latency": { 2024-09-19T04:26:43.056 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:43.056 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:43.056 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:43.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.057 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mkdir_latency": { 2024-09-19T04:26:43.057 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:43.057 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:43.057 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:43.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.057 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mknod_latency": { 2024-09-19T04:26:43.057 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:43.057 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:43.057 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:43.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.058 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mksnap_latency": { 2024-09-19T04:26:43.058 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:43.058 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:43.058 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:43.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.058 INFO:teuthology.orchestra.run.smithi102.stdout: "req_open_latency": { 2024-09-19T04:26:43.058 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 404, 2024-09-19T04:26:43.058 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.155991380, 2024-09-19T04:26:43.058 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000386117 2024-09-19T04:26:43.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.058 INFO:teuthology.orchestra.run.smithi102.stdout: "req_readdir_latency": { 2024-09-19T04:26:43.058 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 16, 2024-09-19T04:26:43.059 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.014284883, 2024-09-19T04:26:43.059 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000892805 2024-09-19T04:26:43.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.059 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rename_latency": { 2024-09-19T04:26:43.059 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 538, 2024-09-19T04:26:43.059 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 4.377340092, 2024-09-19T04:26:43.059 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.008136319 2024-09-19T04:26:43.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.059 INFO:teuthology.orchestra.run.smithi102.stdout: "req_renamesnap_latency": { 2024-09-19T04:26:43.059 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:43.059 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:43.059 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:43.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.060 INFO:teuthology.orchestra.run.smithi102.stdout: "req_snapdiff_latency": { 2024-09-19T04:26:43.060 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:43.060 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:43.060 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:43.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.060 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmdir_latency": { 2024-09-19T04:26:43.060 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:43.060 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:43.060 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:43.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.060 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmsnap_latency": { 2024-09-19T04:26:43.061 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:43.061 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:43.061 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:43.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.061 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmxattr_latency": { 2024-09-19T04:26:43.061 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:43.061 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:43.061 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:43.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.061 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setattr_latency": { 2024-09-19T04:26:43.061 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:43.061 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:43.061 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:43.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.062 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setdirlayout_latency": { 2024-09-19T04:26:43.062 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:43.062 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:43.062 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:43.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.062 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setfilelock_latency": { 2024-09-19T04:26:43.062 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:43.062 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:43.062 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:43.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.062 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setlayout_latency": { 2024-09-19T04:26:43.063 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:43.063 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:43.063 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:43.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.063 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setxattr_latency": { 2024-09-19T04:26:43.063 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:43.063 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:43.063 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:43.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.063 INFO:teuthology.orchestra.run.smithi102.stdout: "req_symlink_latency": { 2024-09-19T04:26:43.063 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:43.063 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:43.063 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:43.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.064 INFO:teuthology.orchestra.run.smithi102.stdout: "req_unlink_latency": { 2024-09-19T04:26:43.064 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 356, 2024-09-19T04:26:43.064 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.608173584, 2024-09-19T04:26:43.064 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.001708352 2024-09-19T04:26:43.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.064 INFO:teuthology.orchestra.run.smithi102.stdout: "cap_revoke_eviction": 0, 2024-09-19T04:26:43.064 INFO:teuthology.orchestra.run.smithi102.stdout: "cap_acquisition_throttle": 0, 2024-09-19T04:26:43.064 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getvxattr_latency": { 2024-09-19T04:26:43.064 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:43.064 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:43.064 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:43.065 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:43.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.065 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_sessions": { 2024-09-19T04:26:43.065 INFO:teuthology.orchestra.run.smithi102.stdout: "session_count": 1, 2024-09-19T04:26:43.065 INFO:teuthology.orchestra.run.smithi102.stdout: "session_add": 1, 2024-09-19T04:26:43.065 INFO:teuthology.orchestra.run.smithi102.stdout: "session_remove": 0, 2024-09-19T04:26:43.065 INFO:teuthology.orchestra.run.smithi102.stdout: "sessions_open": 1, 2024-09-19T04:26:43.065 INFO:teuthology.orchestra.run.smithi102.stdout: "sessions_stale": 0, 2024-09-19T04:26:43.065 INFO:teuthology.orchestra.run.smithi102.stdout: "total_load": 645, 2024-09-19T04:26:43.065 INFO:teuthology.orchestra.run.smithi102.stdout: "average_load": 645, 2024-09-19T04:26:43.065 INFO:teuthology.orchestra.run.smithi102.stdout: "avg_session_uptime": 570, 2024-09-19T04:26:43.065 INFO:teuthology.orchestra.run.smithi102.stdout: "mdthresh_evicted": 0 2024-09-19T04:26:43.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.066 INFO:teuthology.orchestra.run.smithi102.stdout: "mempool": { 2024-09-19T04:26:43.066 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_bytes": 0, 2024-09-19T04:26:43.066 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_items": 0, 2024-09-19T04:26:43.066 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T04:26:43.066 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_items": 0, 2024-09-19T04:26:43.066 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T04:26:43.066 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_items": 0, 2024-09-19T04:26:43.066 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T04:26:43.066 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T04:26:43.066 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T04:26:43.066 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T04:26:43.066 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T04:26:43.067 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_items": 0, 2024-09-19T04:26:43.067 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T04:26:43.067 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T04:26:43.067 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_bytes": 0, 2024-09-19T04:26:43.067 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_items": 0, 2024-09-19T04:26:43.067 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_bytes": 0, 2024-09-19T04:26:43.067 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_items": 0, 2024-09-19T04:26:43.067 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T04:26:43.067 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T04:26:43.067 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T04:26:43.067 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T04:26:43.067 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T04:26:43.067 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_items": 0, 2024-09-19T04:26:43.067 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_bytes": 0, 2024-09-19T04:26:43.068 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_items": 0, 2024-09-19T04:26:43.068 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T04:26:43.068 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T04:26:43.068 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_bytes": 0, 2024-09-19T04:26:43.068 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_items": 0, 2024-09-19T04:26:43.068 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_bytes": 0, 2024-09-19T04:26:43.068 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_items": 0, 2024-09-19T04:26:43.068 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T04:26:43.068 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_items": 0, 2024-09-19T04:26:43.068 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T04:26:43.068 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_items": 0, 2024-09-19T04:26:43.069 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_bytes": 271479, 2024-09-19T04:26:43.069 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_items": 96, 2024-09-19T04:26:43.069 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_bytes": 0, 2024-09-19T04:26:43.069 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_items": 0, 2024-09-19T04:26:43.069 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_bytes": 0, 2024-09-19T04:26:43.069 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_items": 0, 2024-09-19T04:26:43.069 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_bytes": 0, 2024-09-19T04:26:43.069 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_items": 0, 2024-09-19T04:26:43.069 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_bytes": 0, 2024-09-19T04:26:43.069 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_items": 0, 2024-09-19T04:26:43.069 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_bytes": 9056, 2024-09-19T04:26:43.069 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_items": 171, 2024-09-19T04:26:43.069 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T04:26:43.070 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_items": 0, 2024-09-19T04:26:43.070 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_bytes": 0, 2024-09-19T04:26:43.070 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_items": 0, 2024-09-19T04:26:43.070 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_bytes": 73776, 2024-09-19T04:26:43.070 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_items": 318, 2024-09-19T04:26:43.070 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_bytes": 0, 2024-09-19T04:26:43.070 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_items": 0, 2024-09-19T04:26:43.070 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_bytes": 0, 2024-09-19T04:26:43.070 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_items": 0 2024-09-19T04:26:43.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.070 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter": { 2024-09-19T04:26:43.070 INFO:teuthology.orchestra.run.smithi102.stdout: "op_active": 0, 2024-09-19T04:26:43.070 INFO:teuthology.orchestra.run.smithi102.stdout: "op_laggy": 0, 2024-09-19T04:26:43.071 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send": 2138, 2024-09-19T04:26:43.071 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send_bytes": 5950202, 2024-09-19T04:26:43.071 INFO:teuthology.orchestra.run.smithi102.stdout: "op_resend": 32, 2024-09-19T04:26:43.071 INFO:teuthology.orchestra.run.smithi102.stdout: "op_reply": 2138, 2024-09-19T04:26:43.071 INFO:teuthology.orchestra.run.smithi102.stdout: "op_latency": { 2024-09-19T04:26:43.071 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2138, 2024-09-19T04:26:43.071 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 86.434292833, 2024-09-19T04:26:43.071 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.040427639 2024-09-19T04:26:43.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.071 INFO:teuthology.orchestra.run.smithi102.stdout: "op_inflight": 0, 2024-09-19T04:26:43.071 INFO:teuthology.orchestra.run.smithi102.stdout: "oplen_avg": { 2024-09-19T04:26:43.071 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2138, 2024-09-19T04:26:43.071 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 2306 2024-09-19T04:26:43.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.072 INFO:teuthology.orchestra.run.smithi102.stdout: "op": 2138, 2024-09-19T04:26:43.072 INFO:teuthology.orchestra.run.smithi102.stdout: "op_r": 65, 2024-09-19T04:26:43.072 INFO:teuthology.orchestra.run.smithi102.stdout: "op_w": 2073, 2024-09-19T04:26:43.072 INFO:teuthology.orchestra.run.smithi102.stdout: "op_rmw": 0, 2024-09-19T04:26:43.072 INFO:teuthology.orchestra.run.smithi102.stdout: "op_pg": 0, 2024-09-19T04:26:43.072 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_stat": 0, 2024-09-19T04:26:43.072 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_create": 10, 2024-09-19T04:26:43.072 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_read": 65, 2024-09-19T04:26:43.072 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_write": 450, 2024-09-19T04:26:43.072 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writefull": 68, 2024-09-19T04:26:43.072 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writesame": 0, 2024-09-19T04:26:43.072 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_append": 0, 2024-09-19T04:26:43.072 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_zero": 0, 2024-09-19T04:26:43.073 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_truncate": 1, 2024-09-19T04:26:43.073 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_delete": 1407, 2024-09-19T04:26:43.073 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_mapext": 0, 2024-09-19T04:26:43.073 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_sparse_read": 0, 2024-09-19T04:26:43.073 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_clonerange": 0, 2024-09-19T04:26:43.073 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_getxattr": 0, 2024-09-19T04:26:43.073 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_setxattr": 20, 2024-09-19T04:26:43.073 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_cmpxattr": 0, 2024-09-19T04:26:43.073 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_rmxattr": 0, 2024-09-19T04:26:43.073 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_resetxattrs": 0, 2024-09-19T04:26:43.073 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_call": 0, 2024-09-19T04:26:43.073 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_watch": 0, 2024-09-19T04:26:43.073 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_notify": 0, 2024-09-19T04:26:43.073 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T04:26:43.074 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls": 0, 2024-09-19T04:26:43.074 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls_filter": 0, 2024-09-19T04:26:43.074 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_other": 0, 2024-09-19T04:26:43.074 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_active": 0, 2024-09-19T04:26:43.074 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_send": 0, 2024-09-19T04:26:43.074 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_resend": 0, 2024-09-19T04:26:43.074 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_ping": 0, 2024-09-19T04:26:43.074 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_active": 0, 2024-09-19T04:26:43.074 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_send": 0, 2024-09-19T04:26:43.074 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_resend": 0, 2024-09-19T04:26:43.074 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_active": 0, 2024-09-19T04:26:43.074 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_send": 0, 2024-09-19T04:26:43.074 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_resend": 0, 2024-09-19T04:26:43.074 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_active": 0, 2024-09-19T04:26:43.075 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_send": 0, 2024-09-19T04:26:43.075 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_resend": 0, 2024-09-19T04:26:43.075 INFO:teuthology.orchestra.run.smithi102.stdout: "command_active": 0, 2024-09-19T04:26:43.075 INFO:teuthology.orchestra.run.smithi102.stdout: "command_send": 0, 2024-09-19T04:26:43.075 INFO:teuthology.orchestra.run.smithi102.stdout: "command_resend": 0, 2024-09-19T04:26:43.075 INFO:teuthology.orchestra.run.smithi102.stdout: "map_epoch": 90, 2024-09-19T04:26:43.075 INFO:teuthology.orchestra.run.smithi102.stdout: "map_full": 0, 2024-09-19T04:26:43.075 INFO:teuthology.orchestra.run.smithi102.stdout: "map_inc": 4, 2024-09-19T04:26:43.075 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_sessions": 12, 2024-09-19T04:26:43.075 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_open": 12, 2024-09-19T04:26:43.075 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_close": 0, 2024-09-19T04:26:43.075 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_laggy": 0, 2024-09-19T04:26:43.075 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_wr": 222, 2024-09-19T04:26:43.076 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_rd": 0, 2024-09-19T04:26:43.076 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_del": 63 2024-09-19T04:26:43.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.076 INFO:teuthology.orchestra.run.smithi102.stdout: "oft": { 2024-09-19T04:26:43.076 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_objs": 1, 2024-09-19T04:26:43.076 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_kv_pairs": 0, 2024-09-19T04:26:43.076 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_updates": 0, 2024-09-19T04:26:43.076 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_removes": 0 2024-09-19T04:26:43.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.076 INFO:teuthology.orchestra.run.smithi102.stdout: "osd-slow-ops": { 2024-09-19T04:26:43.076 INFO:teuthology.orchestra.run.smithi102.stdout: "slow_ops_count": 1185 2024-09-19T04:26:43.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.076 INFO:teuthology.orchestra.run.smithi102.stdout: "purge_queue": { 2024-09-19T04:26:43.076 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_ops": 0, 2024-09-19T04:26:43.077 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_ops_high_water": 10, 2024-09-19T04:26:43.077 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing": 0, 2024-09-19T04:26:43.077 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_high_water": 5, 2024-09-19T04:26:43.077 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executed_ops": 1394, 2024-09-19T04:26:43.077 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executed": 697, 2024-09-19T04:26:43.077 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_item_in_journal": 0 2024-09-19T04:26:43.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.077 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T04:26:43.077 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-19T04:26:43.077 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-09-19T04:26:43.077 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-19T04:26:43.077 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 21156, 2024-09-19T04:26:43.078 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 5844233, 2024-09-19T04:26:43.078 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:43.078 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 21156, 2024-09-19T04:26:43.078 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-19T04:26:43.078 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-19T04:26:43.078 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 21156, 2024-09-19T04:26:43.078 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 5844233, 2024-09-19T04:26:43.078 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-19T04:26:43.078 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:43.078 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:43.078 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:43.078 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:43.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.079 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_bytes": { 2024-09-19T04:26:43.079 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-19T04:26:43.079 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-09-19T04:26:43.079 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-19T04:26:43.079 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-09-19T04:26:43.079 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-09-19T04:26:43.079 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:43.079 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:43.079 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 2138, 2024-09-19T04:26:43.079 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 6026175, 2024-09-19T04:26:43.079 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 2138, 2024-09-19T04:26:43.079 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 6026175, 2024-09-19T04:26:43.079 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-19T04:26:43.080 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:43.080 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:43.080 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:43.080 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:43.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.080 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_ops": { 2024-09-19T04:26:43.080 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-19T04:26:43.080 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 1024, 2024-09-19T04:26:43.080 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-19T04:26:43.080 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-09-19T04:26:43.080 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-09-19T04:26:43.080 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:43.080 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:43.081 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 2138, 2024-09-19T04:26:43.081 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 2138, 2024-09-19T04:26:43.081 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 2138, 2024-09-19T04:26:43.081 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 2138, 2024-09-19T04:26:43.081 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-19T04:26:43.081 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:43.081 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:43.081 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:43.081 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:43.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.081 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-write_buf_throttle": { 2024-09-19T04:26:43.081 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-19T04:26:43.081 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 3758096384, 2024-09-19T04:26:43.082 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-19T04:26:43.082 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 697, 2024-09-19T04:26:43.082 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 75973, 2024-09-19T04:26:43.082 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:43.082 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 697, 2024-09-19T04:26:43.082 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-19T04:26:43.082 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-19T04:26:43.082 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 65, 2024-09-19T04:26:43.082 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 75973, 2024-09-19T04:26:43.082 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-19T04:26:43.082 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:43.082 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:43.082 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:43.082 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:43.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:43.083 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-write_buf_throttle-0x55a5c8b1e500": { 2024-09-19T04:26:43.083 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-19T04:26:43.083 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 3758096384, 2024-09-19T04:26:43.083 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-19T04:26:43.083 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 3870, 2024-09-19T04:26:43.083 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 5597202, 2024-09-19T04:26:43.083 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:43.083 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 3870, 2024-09-19T04:26:43.083 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-19T04:26:43.083 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-19T04:26:43.083 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 385, 2024-09-19T04:26:43.083 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 5597202, 2024-09-19T04:26:43.083 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-19T04:26:43.084 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:43.084 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:43.084 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:43.084 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:43.084 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:43.084 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-19T04:26:43.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:42 smithi092 ceph-mon[34940]: pgmap v648: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-19T04:26:43.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:42 smithi007 ceph-mon[31360]: pgmap v648: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-19T04:26:43.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:42 smithi102 ceph-mon[35446]: pgmap v648: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-19T04:26:43.975 INFO:tasks.check_counter:Daemon mds.c mds.exported=16 2024-09-19T04:26:43.975 INFO:tasks.check_counter:Daemon mds.c mds.imported=9 2024-09-19T04:26:43.975 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=1 2024-09-19T04:26:43.975 DEBUG:tasks.check_counter:Getting stats from f 2024-09-19T04:26:43.976 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-19T04:26:44.220 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:26:44.737 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-19T04:26:44.737 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T04:26:44.737 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 11931, 2024-09-19T04:26:44.737 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 15005, 2024-09-19T04:26:44.738 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 3916883, 2024-09-19T04:26:44.738 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 12934320, 2024-09-19T04:26:44.738 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 15, 2024-09-19T04:26:44.738 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 5, 2024-09-19T04:26:44.738 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.577044826, 2024-09-19T04:26:44.738 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.236840967, 2024-09-19T04:26:44.738 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.440825854, 2024-09-19T04:26:44.738 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.025673538, 2024-09-19T04:26:44.738 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:44.738 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 15001, 2024-09-19T04:26:44.738 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 2.003106832, 2024-09-19T04:26:44.738 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000133531 2024-09-19T04:26:44.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.739 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:44.739 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 21101, 2024-09-19T04:26:44.739 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.004002447, 2024-09-19T04:26:44.739 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000189 2024-09-19T04:26:44.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.739 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 1584, 2024-09-19T04:26:44.739 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 1440 2024-09-19T04:26:44.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.739 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T04:26:44.739 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 4421, 2024-09-19T04:26:44.739 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 5090, 2024-09-19T04:26:44.739 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 1645520, 2024-09-19T04:26:44.739 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 1943447, 2024-09-19T04:26:44.740 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 8, 2024-09-19T04:26:44.740 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 5, 2024-09-19T04:26:44.740 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.300470427, 2024-09-19T04:26:44.740 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.115156808, 2024-09-19T04:26:44.740 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.202619455, 2024-09-19T04:26:44.740 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.020103360, 2024-09-19T04:26:44.740 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:44.740 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 5090, 2024-09-19T04:26:44.740 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.317770439, 2024-09-19T04:26:44.740 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000062430 2024-09-19T04:26:44.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.740 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:44.741 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 7961, 2024-09-19T04:26:44.741 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.001665582, 2024-09-19T04:26:44.741 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000209 2024-09-19T04:26:44.741 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.741 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T04:26:44.741 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 338096 2024-09-19T04:26:44.741 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.741 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T04:26:44.741 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 957, 2024-09-19T04:26:44.741 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 933, 2024-09-19T04:26:44.741 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 1074821, 2024-09-19T04:26:44.741 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 2104912, 2024-09-19T04:26:44.742 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 9, 2024-09-19T04:26:44.742 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 6, 2024-09-19T04:26:44.742 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.092421408, 2024-09-19T04:26:44.742 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.033106633, 2024-09-19T04:26:44.742 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.044795493, 2024-09-19T04:26:44.742 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.019506198, 2024-09-19T04:26:44.742 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:44.742 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 933, 2024-09-19T04:26:44.742 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.059686299, 2024-09-19T04:26:44.742 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000063972 2024-09-19T04:26:44.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.742 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:44.743 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 9, 2024-09-19T04:26:44.743 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000001615, 2024-09-19T04:26:44.743 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000179 2024-09-19T04:26:44.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.743 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 896384, 2024-09-19T04:26:44.743 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 133040 2024-09-19T04:26:44.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.743 INFO:teuthology.orchestra.run.smithi102.stdout: "cct": { 2024-09-19T04:26:44.743 INFO:teuthology.orchestra.run.smithi102.stdout: "total_workers": 1, 2024-09-19T04:26:44.743 INFO:teuthology.orchestra.run.smithi102.stdout: "unhealthy_workers": 0 2024-09-19T04:26:44.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.743 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-MDSRank": { 2024-09-19T04:26:44.743 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2024-09-19T04:26:44.744 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2024-09-19T04:26:44.744 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 847, 2024-09-19T04:26:44.744 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 1.443517429, 2024-09-19T04:26:44.744 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.001704270 2024-09-19T04:26:44.744 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:44.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.744 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-PurgeQueue": { 2024-09-19T04:26:44.744 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2024-09-19T04:26:44.744 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2024-09-19T04:26:44.744 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 1516, 2024-09-19T04:26:44.744 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.121299764, 2024-09-19T04:26:44.744 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000080013 2024-09-19T04:26:44.744 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:44.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.745 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": { 2024-09-19T04:26:44.745 INFO:teuthology.orchestra.run.smithi102.stdout: "request": 6645, 2024-09-19T04:26:44.745 INFO:teuthology.orchestra.run.smithi102.stdout: "reply": 6627, 2024-09-19T04:26:44.745 INFO:teuthology.orchestra.run.smithi102.stdout: "reply_latency": { 2024-09-19T04:26:44.745 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 6627, 2024-09-19T04:26:44.745 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 82.028082866, 2024-09-19T04:26:44.745 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.012377860 2024-09-19T04:26:44.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.745 INFO:teuthology.orchestra.run.smithi102.stdout: "slow_reply": 0, 2024-09-19T04:26:44.745 INFO:teuthology.orchestra.run.smithi102.stdout: "forward": 18, 2024-09-19T04:26:44.745 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_fetch_complete": 0, 2024-09-19T04:26:44.746 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_fetch_keys": 0, 2024-09-19T04:26:44.746 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_commit": 38, 2024-09-19T04:26:44.746 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_split": 3, 2024-09-19T04:26:44.746 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_merge": 0, 2024-09-19T04:26:44.746 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes": 17, 2024-09-19T04:26:44.746 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_top": 1, 2024-09-19T04:26:44.746 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_bottom": 2, 2024-09-19T04:26:44.746 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_pin_tail": 14, 2024-09-19T04:26:44.746 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_pinned": 14, 2024-09-19T04:26:44.746 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_expired": 22, 2024-09-19T04:26:44.746 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_with_caps": 1, 2024-09-19T04:26:44.746 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": 1, 2024-09-19T04:26:44.746 INFO:teuthology.orchestra.run.smithi102.stdout: "subtrees": 3, 2024-09-19T04:26:44.747 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse": 13976, 2024-09-19T04:26:44.747 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_hit": 12213, 2024-09-19T04:26:44.747 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_forward": 16, 2024-09-19T04:26:44.747 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_discover": 5, 2024-09-19T04:26:44.747 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_dir_fetch": 0, 2024-09-19T04:26:44.747 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_remote_ino": 0, 2024-09-19T04:26:44.747 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_lock": 103, 2024-09-19T04:26:44.747 INFO:teuthology.orchestra.run.smithi102.stdout: "load_cent": 0, 2024-09-19T04:26:44.747 INFO:teuthology.orchestra.run.smithi102.stdout: "q": 0, 2024-09-19T04:26:44.747 INFO:teuthology.orchestra.run.smithi102.stdout: "exported": 24, 2024-09-19T04:26:44.747 INFO:teuthology.orchestra.run.smithi102.stdout: "exported_inodes": 4, 2024-09-19T04:26:44.747 INFO:teuthology.orchestra.run.smithi102.stdout: "imported": 3, 2024-09-19T04:26:44.747 INFO:teuthology.orchestra.run.smithi102.stdout: "imported_inodes": 596, 2024-09-19T04:26:44.748 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_dir_fetch": 0, 2024-09-19T04:26:44.748 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_backtrace_fetch": 0, 2024-09-19T04:26:44.748 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_peer_discover": 0, 2024-09-19T04:26:44.748 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rfiles": 4, 2024-09-19T04:26:44.748 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rbytes": 234, 2024-09-19T04:26:44.748 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rsnaps": 0, 2024-09-19T04:26:44.748 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T04:26:44.748 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_set_tag": 0, 2024-09-19T04:26:44.748 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T04:26:44.748 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_inotable_repaired": 0, 2024-09-19T04:26:44.748 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dir_inodes": 0, 2024-09-19T04:26:44.748 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T04:26:44.748 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T04:26:44.749 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_file_inodes": 0, 2024-09-19T04:26:44.749 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_inode_file_caps": 9, 2024-09-19T04:26:44.749 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_revoke": 1466, 2024-09-19T04:26:44.749 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_grant": 1750, 2024-09-19T04:26:44.749 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T04:26:44.749 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T04:26:44.749 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T04:26:44.749 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_caps": 2330, 2024-09-19T04:26:44.749 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_caps_dirty": 717, 2024-09-19T04:26:44.749 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_cap_release": 150, 2024-09-19T04:26:44.749 INFO:teuthology.orchestra.run.smithi102.stdout: "process_request_cap_release": 2494 2024-09-19T04:26:44.749 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.749 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache": { 2024-09-19T04:26:44.749 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_update": 0, 2024-09-19T04:26:44.750 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_update_receipt": 0, 2024-09-19T04:26:44.750 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_try_discover": 0, 2024-09-19T04:26:44.750 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_send_discover": 6, 2024-09-19T04:26:44.750 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_handle_discover": 0, 2024-09-19T04:26:44.750 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays": 0, 2024-09-19T04:26:44.750 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays_delayed": 0, 2024-09-19T04:26:44.750 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays_enqueuing": 0, 2024-09-19T04:26:44.750 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_created": 717, 2024-09-19T04:26:44.750 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_enqueued": 717, 2024-09-19T04:26:44.750 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_reintegrated": 0, 2024-09-19T04:26:44.750 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_migrated": 0, 2024-09-19T04:26:44.750 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_processing": 0, 2024-09-19T04:26:44.750 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_enqueued": 0, 2024-09-19T04:26:44.751 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_prioritized": 0, 2024-09-19T04:26:44.751 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_started": 0, 2024-09-19T04:26:44.751 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_completed": 0, 2024-09-19T04:26:44.751 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_quiesce_path": 8, 2024-09-19T04:26:44.751 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_quiesce_inode": 1615, 2024-09-19T04:26:44.751 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T04:26:44.751 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_exportdir": 24, 2024-09-19T04:26:44.751 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_flush": 0, 2024-09-19T04:26:44.751 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_fragmentdir": 3, 2024-09-19T04:26:44.751 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_fragstats": 0, 2024-09-19T04:26:44.751 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_inodestats": 0 2024-09-19T04:26:44.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.751 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log": { 2024-09-19T04:26:44.752 INFO:teuthology.orchestra.run.smithi102.stdout: "evlrg": 0, 2024-09-19T04:26:44.752 INFO:teuthology.orchestra.run.smithi102.stdout: "evadd": 3772, 2024-09-19T04:26:44.752 INFO:teuthology.orchestra.run.smithi102.stdout: "evex": 0, 2024-09-19T04:26:44.752 INFO:teuthology.orchestra.run.smithi102.stdout: "evtrm": 0, 2024-09-19T04:26:44.752 INFO:teuthology.orchestra.run.smithi102.stdout: "ev": 3772, 2024-09-19T04:26:44.752 INFO:teuthology.orchestra.run.smithi102.stdout: "evexg": 0, 2024-09-19T04:26:44.752 INFO:teuthology.orchestra.run.smithi102.stdout: "evexd": 0, 2024-09-19T04:26:44.752 INFO:teuthology.orchestra.run.smithi102.stdout: "segadd": 5, 2024-09-19T04:26:44.752 INFO:teuthology.orchestra.run.smithi102.stdout: "segex": 0, 2024-09-19T04:26:44.752 INFO:teuthology.orchestra.run.smithi102.stdout: "segtrm": 0, 2024-09-19T04:26:44.752 INFO:teuthology.orchestra.run.smithi102.stdout: "seg": 5, 2024-09-19T04:26:44.752 INFO:teuthology.orchestra.run.smithi102.stdout: "segmjr": 2, 2024-09-19T04:26:44.753 INFO:teuthology.orchestra.run.smithi102.stdout: "segexg": 0, 2024-09-19T04:26:44.753 INFO:teuthology.orchestra.run.smithi102.stdout: "segexd": 0, 2024-09-19T04:26:44.753 INFO:teuthology.orchestra.run.smithi102.stdout: "expos": 4194304, 2024-09-19T04:26:44.753 INFO:teuthology.orchestra.run.smithi102.stdout: "wrpos": 9750241, 2024-09-19T04:26:44.753 INFO:teuthology.orchestra.run.smithi102.stdout: "rdpos": 0, 2024-09-19T04:26:44.753 INFO:teuthology.orchestra.run.smithi102.stdout: "jlat": { 2024-09-19T04:26:44.753 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 408, 2024-09-19T04:26:44.753 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 10.189671413, 2024-09-19T04:26:44.753 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.024974684 2024-09-19T04:26:44.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.753 INFO:teuthology.orchestra.run.smithi102.stdout: "replayed": 0 2024-09-19T04:26:44.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.753 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_mem": { 2024-09-19T04:26:44.754 INFO:teuthology.orchestra.run.smithi102.stdout: "ino": 21, 2024-09-19T04:26:44.754 INFO:teuthology.orchestra.run.smithi102.stdout: "ino+": 746, 2024-09-19T04:26:44.754 INFO:teuthology.orchestra.run.smithi102.stdout: "ino-": 725, 2024-09-19T04:26:44.754 INFO:teuthology.orchestra.run.smithi102.stdout: "dir": 20, 2024-09-19T04:26:44.754 INFO:teuthology.orchestra.run.smithi102.stdout: "dir+": 64, 2024-09-19T04:26:44.754 INFO:teuthology.orchestra.run.smithi102.stdout: "dir-": 44, 2024-09-19T04:26:44.754 INFO:teuthology.orchestra.run.smithi102.stdout: "dn": 17, 2024-09-19T04:26:44.754 INFO:teuthology.orchestra.run.smithi102.stdout: "dn+": 1713, 2024-09-19T04:26:44.754 INFO:teuthology.orchestra.run.smithi102.stdout: "dn-": 1696, 2024-09-19T04:26:44.754 INFO:teuthology.orchestra.run.smithi102.stdout: "cap": 1, 2024-09-19T04:26:44.754 INFO:teuthology.orchestra.run.smithi102.stdout: "cap+": 1211, 2024-09-19T04:26:44.754 INFO:teuthology.orchestra.run.smithi102.stdout: "cap-": 1210, 2024-09-19T04:26:44.754 INFO:teuthology.orchestra.run.smithi102.stdout: "rss": 65936, 2024-09-19T04:26:44.755 INFO:teuthology.orchestra.run.smithi102.stdout: "heap": 223520 2024-09-19T04:26:44.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.755 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_server": { 2024-09-19T04:26:44.755 INFO:teuthology.orchestra.run.smithi102.stdout: "dispatch_client_request": 8222, 2024-09-19T04:26:44.755 INFO:teuthology.orchestra.run.smithi102.stdout: "dispatch_server_request": 38, 2024-09-19T04:26:44.755 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_request": 6645, 2024-09-19T04:26:44.755 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_session": 16, 2024-09-19T04:26:44.755 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_peer_request": 1428, 2024-09-19T04:26:44.755 INFO:teuthology.orchestra.run.smithi102.stdout: "req_create_latency": { 2024-09-19T04:26:44.755 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 422, 2024-09-19T04:26:44.755 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 3.117967003, 2024-09-19T04:26:44.755 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.007388547 2024-09-19T04:26:44.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.755 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getattr_latency": { 2024-09-19T04:26:44.756 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2, 2024-09-19T04:26:44.756 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000995918, 2024-09-19T04:26:44.756 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000497959 2024-09-19T04:26:44.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.756 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getfilelock_latency": { 2024-09-19T04:26:44.756 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:44.756 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:44.756 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:44.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.757 INFO:teuthology.orchestra.run.smithi102.stdout: "req_link_latency": { 2024-09-19T04:26:44.757 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:44.757 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:44.757 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:44.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.757 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookup_latency": { 2024-09-19T04:26:44.757 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 4961, 2024-09-19T04:26:44.757 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 75.306647026, 2024-09-19T04:26:44.757 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.015179731 2024-09-19T04:26:44.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.757 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookuphash_latency": { 2024-09-19T04:26:44.757 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:44.758 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:44.758 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:44.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.758 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupino_latency": { 2024-09-19T04:26:44.758 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:44.758 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:44.758 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:44.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.758 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupname_latency": { 2024-09-19T04:26:44.758 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:44.758 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:44.758 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:44.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.759 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupparent_latency": { 2024-09-19T04:26:44.759 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:44.759 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:44.759 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:44.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.759 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupsnap_latency": { 2024-09-19T04:26:44.759 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:44.759 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:44.759 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:44.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.760 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lssnap_latency": { 2024-09-19T04:26:44.760 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:44.760 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:44.760 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:44.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.760 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mkdir_latency": { 2024-09-19T04:26:44.760 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:44.760 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:44.760 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:44.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.760 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mknod_latency": { 2024-09-19T04:26:44.760 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:44.760 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:44.761 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:44.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.761 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mksnap_latency": { 2024-09-19T04:26:44.761 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:44.761 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:44.761 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:44.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.761 INFO:teuthology.orchestra.run.smithi102.stdout: "req_open_latency": { 2024-09-19T04:26:44.761 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 317, 2024-09-19T04:26:44.761 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.112154436, 2024-09-19T04:26:44.761 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000353799 2024-09-19T04:26:44.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.761 INFO:teuthology.orchestra.run.smithi102.stdout: "req_readdir_latency": { 2024-09-19T04:26:44.762 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 24, 2024-09-19T04:26:44.762 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.022164243, 2024-09-19T04:26:44.762 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000923510 2024-09-19T04:26:44.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.762 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rename_latency": { 2024-09-19T04:26:44.762 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 422, 2024-09-19T04:26:44.762 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 2.512997395, 2024-09-19T04:26:44.762 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.005954970 2024-09-19T04:26:44.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.763 INFO:teuthology.orchestra.run.smithi102.stdout: "req_renamesnap_latency": { 2024-09-19T04:26:44.763 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:44.763 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:44.763 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:44.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.763 INFO:teuthology.orchestra.run.smithi102.stdout: "req_snapdiff_latency": { 2024-09-19T04:26:44.763 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:44.763 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:44.763 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:44.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.763 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmdir_latency": { 2024-09-19T04:26:44.763 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:44.764 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:44.764 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:44.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.764 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmsnap_latency": { 2024-09-19T04:26:44.764 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:44.764 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:44.764 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:44.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.764 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmxattr_latency": { 2024-09-19T04:26:44.764 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:44.764 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:44.766 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:44.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.766 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setattr_latency": { 2024-09-19T04:26:44.766 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:44.766 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:44.766 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:44.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.766 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setdirlayout_latency": { 2024-09-19T04:26:44.766 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:44.766 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:44.767 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:44.767 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.767 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setfilelock_latency": { 2024-09-19T04:26:44.767 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:44.767 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:44.767 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:44.767 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.767 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setlayout_latency": { 2024-09-19T04:26:44.767 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:44.767 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:44.767 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:44.767 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.767 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setxattr_latency": { 2024-09-19T04:26:44.768 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:44.768 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:44.768 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:44.768 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.768 INFO:teuthology.orchestra.run.smithi102.stdout: "req_symlink_latency": { 2024-09-19T04:26:44.768 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:44.768 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:44.768 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:44.768 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.768 INFO:teuthology.orchestra.run.smithi102.stdout: "req_unlink_latency": { 2024-09-19T04:26:44.768 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 479, 2024-09-19T04:26:44.768 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.955156845, 2024-09-19T04:26:44.769 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.001994064 2024-09-19T04:26:44.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.769 INFO:teuthology.orchestra.run.smithi102.stdout: "cap_revoke_eviction": 0, 2024-09-19T04:26:44.769 INFO:teuthology.orchestra.run.smithi102.stdout: "cap_acquisition_throttle": 0, 2024-09-19T04:26:44.769 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getvxattr_latency": { 2024-09-19T04:26:44.769 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:44.769 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:44.769 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:44.769 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:44.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.769 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_sessions": { 2024-09-19T04:26:44.769 INFO:teuthology.orchestra.run.smithi102.stdout: "session_count": 1, 2024-09-19T04:26:44.769 INFO:teuthology.orchestra.run.smithi102.stdout: "session_add": 3, 2024-09-19T04:26:44.770 INFO:teuthology.orchestra.run.smithi102.stdout: "session_remove": 2, 2024-09-19T04:26:44.770 INFO:teuthology.orchestra.run.smithi102.stdout: "sessions_open": 1, 2024-09-19T04:26:44.770 INFO:teuthology.orchestra.run.smithi102.stdout: "sessions_stale": 0, 2024-09-19T04:26:44.770 INFO:teuthology.orchestra.run.smithi102.stdout: "total_load": 1415, 2024-09-19T04:26:44.770 INFO:teuthology.orchestra.run.smithi102.stdout: "average_load": 1415, 2024-09-19T04:26:44.770 INFO:teuthology.orchestra.run.smithi102.stdout: "avg_session_uptime": 586, 2024-09-19T04:26:44.770 INFO:teuthology.orchestra.run.smithi102.stdout: "mdthresh_evicted": 0 2024-09-19T04:26:44.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.770 INFO:teuthology.orchestra.run.smithi102.stdout: "mempool": { 2024-09-19T04:26:44.770 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_bytes": 0, 2024-09-19T04:26:44.770 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_items": 0, 2024-09-19T04:26:44.770 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T04:26:44.770 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_items": 0, 2024-09-19T04:26:44.771 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T04:26:44.771 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_items": 0, 2024-09-19T04:26:44.771 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T04:26:44.771 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T04:26:44.771 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T04:26:44.771 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T04:26:44.771 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T04:26:44.771 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_items": 0, 2024-09-19T04:26:44.771 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T04:26:44.771 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T04:26:44.771 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_bytes": 0, 2024-09-19T04:26:44.771 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_items": 0, 2024-09-19T04:26:44.771 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_bytes": 0, 2024-09-19T04:26:44.772 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_items": 0, 2024-09-19T04:26:44.772 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T04:26:44.772 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T04:26:44.772 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T04:26:44.772 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T04:26:44.772 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T04:26:44.772 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_items": 0, 2024-09-19T04:26:44.772 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_bytes": 0, 2024-09-19T04:26:44.772 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_items": 0, 2024-09-19T04:26:44.772 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T04:26:44.772 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T04:26:44.772 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_bytes": 0, 2024-09-19T04:26:44.772 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_items": 0, 2024-09-19T04:26:44.773 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_bytes": 0, 2024-09-19T04:26:44.773 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_items": 0, 2024-09-19T04:26:44.773 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T04:26:44.773 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_items": 0, 2024-09-19T04:26:44.773 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T04:26:44.773 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_items": 0, 2024-09-19T04:26:44.773 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_bytes": 279127, 2024-09-19T04:26:44.773 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_items": 92, 2024-09-19T04:26:44.773 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_bytes": 0, 2024-09-19T04:26:44.773 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_items": 0, 2024-09-19T04:26:44.773 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_bytes": 0, 2024-09-19T04:26:44.773 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_items": 0, 2024-09-19T04:26:44.773 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_bytes": 0, 2024-09-19T04:26:44.773 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_items": 0, 2024-09-19T04:26:44.774 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_bytes": 0, 2024-09-19T04:26:44.774 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_items": 0, 2024-09-19T04:26:44.774 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_bytes": 9056, 2024-09-19T04:26:44.774 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_items": 171, 2024-09-19T04:26:44.774 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T04:26:44.774 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_items": 0, 2024-09-19T04:26:44.774 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_bytes": 0, 2024-09-19T04:26:44.774 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_items": 0, 2024-09-19T04:26:44.774 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_bytes": 86093, 2024-09-19T04:26:44.774 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_items": 381, 2024-09-19T04:26:44.774 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_bytes": 0, 2024-09-19T04:26:44.774 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_items": 0, 2024-09-19T04:26:44.774 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_bytes": 0, 2024-09-19T04:26:44.775 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_items": 0 2024-09-19T04:26:44.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.775 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter": { 2024-09-19T04:26:44.775 INFO:teuthology.orchestra.run.smithi102.stdout: "op_active": 0, 2024-09-19T04:26:44.775 INFO:teuthology.orchestra.run.smithi102.stdout: "op_laggy": 0, 2024-09-19T04:26:44.775 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send": 2165, 2024-09-19T04:26:44.775 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send_bytes": 6222181, 2024-09-19T04:26:44.775 INFO:teuthology.orchestra.run.smithi102.stdout: "op_resend": 33, 2024-09-19T04:26:44.775 INFO:teuthology.orchestra.run.smithi102.stdout: "op_reply": 2165, 2024-09-19T04:26:44.775 INFO:teuthology.orchestra.run.smithi102.stdout: "op_latency": { 2024-09-19T04:26:44.775 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2165, 2024-09-19T04:26:44.775 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 35.379299997, 2024-09-19T04:26:44.775 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.016341478 2024-09-19T04:26:44.776 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.776 INFO:teuthology.orchestra.run.smithi102.stdout: "op_inflight": 0, 2024-09-19T04:26:44.776 INFO:teuthology.orchestra.run.smithi102.stdout: "oplen_avg": { 2024-09-19T04:26:44.776 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2165, 2024-09-19T04:26:44.776 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 2342 2024-09-19T04:26:44.776 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.776 INFO:teuthology.orchestra.run.smithi102.stdout: "op": 2165, 2024-09-19T04:26:44.776 INFO:teuthology.orchestra.run.smithi102.stdout: "op_r": 44, 2024-09-19T04:26:44.776 INFO:teuthology.orchestra.run.smithi102.stdout: "op_w": 2121, 2024-09-19T04:26:44.776 INFO:teuthology.orchestra.run.smithi102.stdout: "op_rmw": 0, 2024-09-19T04:26:44.776 INFO:teuthology.orchestra.run.smithi102.stdout: "op_pg": 0, 2024-09-19T04:26:44.776 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_stat": 0, 2024-09-19T04:26:44.776 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_create": 10, 2024-09-19T04:26:44.776 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_read": 44, 2024-09-19T04:26:44.777 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_write": 452, 2024-09-19T04:26:44.777 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writefull": 58, 2024-09-19T04:26:44.777 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writesame": 0, 2024-09-19T04:26:44.777 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_append": 0, 2024-09-19T04:26:44.777 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_zero": 0, 2024-09-19T04:26:44.777 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_truncate": 3, 2024-09-19T04:26:44.777 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_delete": 1447, 2024-09-19T04:26:44.777 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_mapext": 0, 2024-09-19T04:26:44.777 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_sparse_read": 0, 2024-09-19T04:26:44.777 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_clonerange": 0, 2024-09-19T04:26:44.777 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_getxattr": 0, 2024-09-19T04:26:44.777 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_setxattr": 20, 2024-09-19T04:26:44.777 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_cmpxattr": 0, 2024-09-19T04:26:44.778 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_rmxattr": 0, 2024-09-19T04:26:44.778 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_resetxattrs": 0, 2024-09-19T04:26:44.778 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_call": 0, 2024-09-19T04:26:44.778 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_watch": 0, 2024-09-19T04:26:44.778 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_notify": 0, 2024-09-19T04:26:44.778 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T04:26:44.778 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls": 0, 2024-09-19T04:26:44.778 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls_filter": 0, 2024-09-19T04:26:44.778 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_other": 0, 2024-09-19T04:26:44.778 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_active": 0, 2024-09-19T04:26:44.778 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_send": 0, 2024-09-19T04:26:44.778 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_resend": 0, 2024-09-19T04:26:44.778 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_ping": 0, 2024-09-19T04:26:44.779 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_active": 0, 2024-09-19T04:26:44.779 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_send": 0, 2024-09-19T04:26:44.779 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_resend": 0, 2024-09-19T04:26:44.779 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_active": 0, 2024-09-19T04:26:44.779 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_send": 0, 2024-09-19T04:26:44.779 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_resend": 0, 2024-09-19T04:26:44.779 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_active": 0, 2024-09-19T04:26:44.779 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_send": 0, 2024-09-19T04:26:44.779 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_resend": 0, 2024-09-19T04:26:44.779 INFO:teuthology.orchestra.run.smithi102.stdout: "command_active": 0, 2024-09-19T04:26:44.779 INFO:teuthology.orchestra.run.smithi102.stdout: "command_send": 0, 2024-09-19T04:26:44.779 INFO:teuthology.orchestra.run.smithi102.stdout: "command_resend": 0, 2024-09-19T04:26:44.779 INFO:teuthology.orchestra.run.smithi102.stdout: "map_epoch": 90, 2024-09-19T04:26:44.779 INFO:teuthology.orchestra.run.smithi102.stdout: "map_full": 0, 2024-09-19T04:26:44.780 INFO:teuthology.orchestra.run.smithi102.stdout: "map_inc": 4, 2024-09-19T04:26:44.780 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_sessions": 12, 2024-09-19T04:26:44.780 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_open": 12, 2024-09-19T04:26:44.780 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_close": 0, 2024-09-19T04:26:44.780 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_laggy": 0, 2024-09-19T04:26:44.780 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_wr": 255, 2024-09-19T04:26:44.780 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_rd": 0, 2024-09-19T04:26:44.780 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_del": 53 2024-09-19T04:26:44.780 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.780 INFO:teuthology.orchestra.run.smithi102.stdout: "oft": { 2024-09-19T04:26:44.780 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_objs": 1, 2024-09-19T04:26:44.780 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_kv_pairs": 0, 2024-09-19T04:26:44.780 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_updates": 0, 2024-09-19T04:26:44.781 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_removes": 0 2024-09-19T04:26:44.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.781 INFO:teuthology.orchestra.run.smithi102.stdout: "osd-slow-ops": { 2024-09-19T04:26:44.781 INFO:teuthology.orchestra.run.smithi102.stdout: "slow_ops_count": 1617 2024-09-19T04:26:44.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.781 INFO:teuthology.orchestra.run.smithi102.stdout: "purge_queue": { 2024-09-19T04:26:44.781 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_ops": 0, 2024-09-19T04:26:44.781 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_ops_high_water": 10, 2024-09-19T04:26:44.781 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing": 0, 2024-09-19T04:26:44.781 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_high_water": 5, 2024-09-19T04:26:44.781 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executed_ops": 1434, 2024-09-19T04:26:44.781 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executed": 717, 2024-09-19T04:26:44.781 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_item_in_journal": 0 2024-09-19T04:26:44.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.782 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T04:26:44.782 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-19T04:26:44.782 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-09-19T04:26:44.782 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-19T04:26:44.782 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 17305, 2024-09-19T04:26:44.782 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 5062893, 2024-09-19T04:26:44.782 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:44.782 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 17305, 2024-09-19T04:26:44.782 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-19T04:26:44.782 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-19T04:26:44.782 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 17305, 2024-09-19T04:26:44.782 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 5062893, 2024-09-19T04:26:44.782 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-19T04:26:44.783 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:44.783 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:44.783 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:44.783 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:44.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.783 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_bytes": { 2024-09-19T04:26:44.783 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-19T04:26:44.783 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-09-19T04:26:44.783 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-19T04:26:44.783 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-09-19T04:26:44.783 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-09-19T04:26:44.783 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:44.783 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:44.784 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 2165, 2024-09-19T04:26:44.784 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 6300334, 2024-09-19T04:26:44.784 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 2165, 2024-09-19T04:26:44.784 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 6300334, 2024-09-19T04:26:44.784 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-19T04:26:44.784 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:44.784 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:44.784 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:44.784 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:44.784 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.784 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_ops": { 2024-09-19T04:26:44.784 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-19T04:26:44.784 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 1024, 2024-09-19T04:26:44.785 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-19T04:26:44.785 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-09-19T04:26:44.785 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-09-19T04:26:44.785 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:44.785 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:44.785 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 2165, 2024-09-19T04:26:44.785 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 2165, 2024-09-19T04:26:44.785 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 2165, 2024-09-19T04:26:44.785 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 2165, 2024-09-19T04:26:44.785 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-19T04:26:44.785 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:44.785 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:44.785 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:44.785 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:44.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.786 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-write_buf_throttle": { 2024-09-19T04:26:44.786 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-19T04:26:44.786 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 3758096384, 2024-09-19T04:26:44.786 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-19T04:26:44.786 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 717, 2024-09-19T04:26:44.786 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 78153, 2024-09-19T04:26:44.786 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:44.786 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 717, 2024-09-19T04:26:44.786 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-19T04:26:44.786 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-19T04:26:44.786 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 44, 2024-09-19T04:26:44.786 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 78153, 2024-09-19T04:26:44.787 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-19T04:26:44.787 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:44.787 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:44.787 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:44.787 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:44.787 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:44.787 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-write_buf_throttle-0x559accf54500": { 2024-09-19T04:26:44.787 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-19T04:26:44.787 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 3758096384, 2024-09-19T04:26:44.787 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-19T04:26:44.787 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 3772, 2024-09-19T04:26:44.787 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 5555937, 2024-09-19T04:26:44.787 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:44.788 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 3772, 2024-09-19T04:26:44.788 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-19T04:26:44.788 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-19T04:26:44.788 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 408, 2024-09-19T04:26:44.788 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 5555937, 2024-09-19T04:26:44.788 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-19T04:26:44.788 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:44.788 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:44.788 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:44.788 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:44.788 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:44.788 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-19T04:26:45.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:45 smithi092 ceph-mon[34940]: pgmap v649: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-19T04:26:45.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:45 smithi007 ceph-mon[31360]: pgmap v649: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-19T04:26:45.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:45 smithi102 ceph-mon[35446]: pgmap v649: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-19T04:26:45.444 INFO:tasks.check_counter:Daemon mds.f mds.exported=24 2024-09-19T04:26:45.444 INFO:tasks.check_counter:Daemon mds.f mds.imported=3 2024-09-19T04:26:45.444 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=3 2024-09-19T04:26:45.444 DEBUG:tasks.check_counter:Getting stats from i 2024-09-19T04:26:45.445 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-19T04:26:45.687 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:26:46.209 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-19T04:26:46.209 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T04:26:46.209 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 10206, 2024-09-19T04:26:46.209 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 12423, 2024-09-19T04:26:46.209 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 3508966, 2024-09-19T04:26:46.209 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 8450518, 2024-09-19T04:26:46.209 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 17, 2024-09-19T04:26:46.210 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 5, 2024-09-19T04:26:46.210 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.465531805, 2024-09-19T04:26:46.210 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.198281417, 2024-09-19T04:26:46.210 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.372578119, 2024-09-19T04:26:46.210 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.018523150, 2024-09-19T04:26:46.210 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:46.210 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 12419, 2024-09-19T04:26:46.210 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 1.368236408, 2024-09-19T04:26:46.210 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000110172 2024-09-19T04:26:46.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.210 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:46.210 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 17081, 2024-09-19T04:26:46.210 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.003540711, 2024-09-19T04:26:46.211 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000207 2024-09-19T04:26:46.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.211 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 3376, 2024-09-19T04:26:46.211 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 4528 2024-09-19T04:26:46.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.211 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T04:26:46.211 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 11152, 2024-09-19T04:26:46.211 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 12910, 2024-09-19T04:26:46.211 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 3495109, 2024-09-19T04:26:46.211 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 3871309, 2024-09-19T04:26:46.211 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 7, 2024-09-19T04:26:46.211 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 5, 2024-09-19T04:26:46.212 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.619474261, 2024-09-19T04:26:46.212 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.243496653, 2024-09-19T04:26:46.212 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.463076217, 2024-09-19T04:26:46.212 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.010040846, 2024-09-19T04:26:46.212 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:46.212 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 12911, 2024-09-19T04:26:46.212 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.709097677, 2024-09-19T04:26:46.212 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000054921 2024-09-19T04:26:46.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.212 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:46.212 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 22064, 2024-09-19T04:26:46.212 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.003983517, 2024-09-19T04:26:46.212 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000180 2024-09-19T04:26:46.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.213 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 907792, 2024-09-19T04:26:46.213 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 131216 2024-09-19T04:26:46.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.213 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T04:26:46.213 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 425, 2024-09-19T04:26:46.213 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 576, 2024-09-19T04:26:46.213 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 150854, 2024-09-19T04:26:46.213 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 581341, 2024-09-19T04:26:46.213 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 7, 2024-09-19T04:26:46.213 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 5, 2024-09-19T04:26:46.213 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.043198536, 2024-09-19T04:26:46.213 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.016208974, 2024-09-19T04:26:46.214 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.011755287, 2024-09-19T04:26:46.214 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.011223494, 2024-09-19T04:26:46.214 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:46.214 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 575, 2024-09-19T04:26:46.214 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.037689019, 2024-09-19T04:26:46.214 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000065546 2024-09-19T04:26:46.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.214 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:46.214 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:46.214 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:46.214 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:46.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.214 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-09-19T04:26:46.215 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 339984 2024-09-19T04:26:46.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.215 INFO:teuthology.orchestra.run.smithi102.stdout: "cct": { 2024-09-19T04:26:46.215 INFO:teuthology.orchestra.run.smithi102.stdout: "total_workers": 1, 2024-09-19T04:26:46.215 INFO:teuthology.orchestra.run.smithi102.stdout: "unhealthy_workers": 0 2024-09-19T04:26:46.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.215 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-MDSRank": { 2024-09-19T04:26:46.215 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2024-09-19T04:26:46.215 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2024-09-19T04:26:46.215 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 698, 2024-09-19T04:26:46.215 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.715620767, 2024-09-19T04:26:46.215 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.001025244 2024-09-19T04:26:46.215 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:46.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.216 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-PurgeQueue": { 2024-09-19T04:26:46.216 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2024-09-19T04:26:46.216 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2024-09-19T04:26:46.216 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 804, 2024-09-19T04:26:46.216 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.060379963, 2024-09-19T04:26:46.216 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000075099 2024-09-19T04:26:46.216 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:46.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.216 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": { 2024-09-19T04:26:46.216 INFO:teuthology.orchestra.run.smithi102.stdout: "request": 2571, 2024-09-19T04:26:46.216 INFO:teuthology.orchestra.run.smithi102.stdout: "reply": 2535, 2024-09-19T04:26:46.216 INFO:teuthology.orchestra.run.smithi102.stdout: "reply_latency": { 2024-09-19T04:26:46.217 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2535, 2024-09-19T04:26:46.217 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 20.171993139, 2024-09-19T04:26:46.217 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.007957393 2024-09-19T04:26:46.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.217 INFO:teuthology.orchestra.run.smithi102.stdout: "slow_reply": 0, 2024-09-19T04:26:46.217 INFO:teuthology.orchestra.run.smithi102.stdout: "forward": 36, 2024-09-19T04:26:46.217 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_fetch_complete": 0, 2024-09-19T04:26:46.217 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_fetch_keys": 0, 2024-09-19T04:26:46.217 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_commit": 20, 2024-09-19T04:26:46.217 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_split": 1, 2024-09-19T04:26:46.217 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_merge": 0, 2024-09-19T04:26:46.217 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes": 11, 2024-09-19T04:26:46.218 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_top": 0, 2024-09-19T04:26:46.218 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_bottom": 1, 2024-09-19T04:26:46.218 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_pin_tail": 10, 2024-09-19T04:26:46.218 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_pinned": 10, 2024-09-19T04:26:46.218 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_expired": 92, 2024-09-19T04:26:46.218 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_with_caps": 0, 2024-09-19T04:26:46.218 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": 0, 2024-09-19T04:26:46.218 INFO:teuthology.orchestra.run.smithi102.stdout: "subtrees": 2, 2024-09-19T04:26:46.220 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse": 5979, 2024-09-19T04:26:46.220 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_hit": 4775, 2024-09-19T04:26:46.220 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_forward": 35, 2024-09-19T04:26:46.220 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_discover": 3, 2024-09-19T04:26:46.220 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_dir_fetch": 0, 2024-09-19T04:26:46.220 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_remote_ino": 0, 2024-09-19T04:26:46.220 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_lock": 222, 2024-09-19T04:26:46.220 INFO:teuthology.orchestra.run.smithi102.stdout: "load_cent": 0, 2024-09-19T04:26:46.221 INFO:teuthology.orchestra.run.smithi102.stdout: "q": 0, 2024-09-19T04:26:46.221 INFO:teuthology.orchestra.run.smithi102.stdout: "exported": 8, 2024-09-19T04:26:46.221 INFO:teuthology.orchestra.run.smithi102.stdout: "exported_inodes": 81, 2024-09-19T04:26:46.221 INFO:teuthology.orchestra.run.smithi102.stdout: "imported": 1, 2024-09-19T04:26:46.221 INFO:teuthology.orchestra.run.smithi102.stdout: "imported_inodes": 206, 2024-09-19T04:26:46.221 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_dir_fetch": 0, 2024-09-19T04:26:46.221 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_backtrace_fetch": 0, 2024-09-19T04:26:46.221 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_peer_discover": 0, 2024-09-19T04:26:46.221 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rfiles": 4, 2024-09-19T04:26:46.221 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rbytes": 234, 2024-09-19T04:26:46.221 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rsnaps": 0, 2024-09-19T04:26:46.221 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T04:26:46.221 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_set_tag": 0, 2024-09-19T04:26:46.222 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T04:26:46.222 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_inotable_repaired": 0, 2024-09-19T04:26:46.222 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dir_inodes": 0, 2024-09-19T04:26:46.222 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T04:26:46.222 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T04:26:46.222 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_file_inodes": 0, 2024-09-19T04:26:46.222 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_inode_file_caps": 95, 2024-09-19T04:26:46.222 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_revoke": 2942, 2024-09-19T04:26:46.222 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_grant": 2819, 2024-09-19T04:26:46.222 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T04:26:46.222 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T04:26:46.222 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T04:26:46.222 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_caps": 4727, 2024-09-19T04:26:46.223 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_caps_dirty": 353, 2024-09-19T04:26:46.223 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_cap_release": 27, 2024-09-19T04:26:46.223 INFO:teuthology.orchestra.run.smithi102.stdout: "process_request_cap_release": 1366 2024-09-19T04:26:46.223 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.223 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache": { 2024-09-19T04:26:46.223 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_update": 0, 2024-09-19T04:26:46.223 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_update_receipt": 0, 2024-09-19T04:26:46.223 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_try_discover": 0, 2024-09-19T04:26:46.223 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_send_discover": 4, 2024-09-19T04:26:46.223 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_handle_discover": 61, 2024-09-19T04:26:46.223 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays": 0, 2024-09-19T04:26:46.223 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays_delayed": 0, 2024-09-19T04:26:46.223 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays_enqueuing": 0, 2024-09-19T04:26:46.224 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_created": 353, 2024-09-19T04:26:46.224 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_enqueued": 353, 2024-09-19T04:26:46.224 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_reintegrated": 0, 2024-09-19T04:26:46.224 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_migrated": 0, 2024-09-19T04:26:46.224 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_processing": 0, 2024-09-19T04:26:46.224 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_enqueued": 0, 2024-09-19T04:26:46.224 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_prioritized": 0, 2024-09-19T04:26:46.224 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_started": 0, 2024-09-19T04:26:46.224 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_completed": 0, 2024-09-19T04:26:46.224 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_quiesce_path": 8, 2024-09-19T04:26:46.224 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_quiesce_inode": 1192, 2024-09-19T04:26:46.224 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T04:26:46.224 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_exportdir": 8, 2024-09-19T04:26:46.225 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_flush": 0, 2024-09-19T04:26:46.225 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_fragmentdir": 1, 2024-09-19T04:26:46.225 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_fragstats": 0, 2024-09-19T04:26:46.225 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_inodestats": 0 2024-09-19T04:26:46.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.225 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log": { 2024-09-19T04:26:46.225 INFO:teuthology.orchestra.run.smithi102.stdout: "evlrg": 0, 2024-09-19T04:26:46.225 INFO:teuthology.orchestra.run.smithi102.stdout: "evadd": 2157, 2024-09-19T04:26:46.225 INFO:teuthology.orchestra.run.smithi102.stdout: "evex": 0, 2024-09-19T04:26:46.225 INFO:teuthology.orchestra.run.smithi102.stdout: "evtrm": 0, 2024-09-19T04:26:46.225 INFO:teuthology.orchestra.run.smithi102.stdout: "ev": 2157, 2024-09-19T04:26:46.225 INFO:teuthology.orchestra.run.smithi102.stdout: "evexg": 0, 2024-09-19T04:26:46.225 INFO:teuthology.orchestra.run.smithi102.stdout: "evexd": 0, 2024-09-19T04:26:46.226 INFO:teuthology.orchestra.run.smithi102.stdout: "segadd": 4, 2024-09-19T04:26:46.226 INFO:teuthology.orchestra.run.smithi102.stdout: "segex": 0, 2024-09-19T04:26:46.226 INFO:teuthology.orchestra.run.smithi102.stdout: "segtrm": 0, 2024-09-19T04:26:46.226 INFO:teuthology.orchestra.run.smithi102.stdout: "seg": 4, 2024-09-19T04:26:46.226 INFO:teuthology.orchestra.run.smithi102.stdout: "segmjr": 2, 2024-09-19T04:26:46.226 INFO:teuthology.orchestra.run.smithi102.stdout: "segexg": 0, 2024-09-19T04:26:46.226 INFO:teuthology.orchestra.run.smithi102.stdout: "segexd": 0, 2024-09-19T04:26:46.226 INFO:teuthology.orchestra.run.smithi102.stdout: "expos": 4194304, 2024-09-19T04:26:46.226 INFO:teuthology.orchestra.run.smithi102.stdout: "wrpos": 7153782, 2024-09-19T04:26:46.226 INFO:teuthology.orchestra.run.smithi102.stdout: "rdpos": 0, 2024-09-19T04:26:46.226 INFO:teuthology.orchestra.run.smithi102.stdout: "jlat": { 2024-09-19T04:26:46.226 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 280, 2024-09-19T04:26:46.226 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 19.127802896, 2024-09-19T04:26:46.226 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.068313581 2024-09-19T04:26:46.227 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.227 INFO:teuthology.orchestra.run.smithi102.stdout: "replayed": 0 2024-09-19T04:26:46.227 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.227 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_mem": { 2024-09-19T04:26:46.227 INFO:teuthology.orchestra.run.smithi102.stdout: "ino": 15, 2024-09-19T04:26:46.227 INFO:teuthology.orchestra.run.smithi102.stdout: "ino+": 378, 2024-09-19T04:26:46.227 INFO:teuthology.orchestra.run.smithi102.stdout: "ino-": 363, 2024-09-19T04:26:46.227 INFO:teuthology.orchestra.run.smithi102.stdout: "dir": 13, 2024-09-19T04:26:46.227 INFO:teuthology.orchestra.run.smithi102.stdout: "dir+": 41, 2024-09-19T04:26:46.227 INFO:teuthology.orchestra.run.smithi102.stdout: "dir-": 28, 2024-09-19T04:26:46.227 INFO:teuthology.orchestra.run.smithi102.stdout: "dn": 11, 2024-09-19T04:26:46.227 INFO:teuthology.orchestra.run.smithi102.stdout: "dn+": 831, 2024-09-19T04:26:46.227 INFO:teuthology.orchestra.run.smithi102.stdout: "dn-": 820, 2024-09-19T04:26:46.228 INFO:teuthology.orchestra.run.smithi102.stdout: "cap": 0, 2024-09-19T04:26:46.228 INFO:teuthology.orchestra.run.smithi102.stdout: "cap+": 588, 2024-09-19T04:26:46.228 INFO:teuthology.orchestra.run.smithi102.stdout: "cap-": 588, 2024-09-19T04:26:46.228 INFO:teuthology.orchestra.run.smithi102.stdout: "rss": 61432, 2024-09-19T04:26:46.228 INFO:teuthology.orchestra.run.smithi102.stdout: "heap": 223520 2024-09-19T04:26:46.228 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.228 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_server": { 2024-09-19T04:26:46.228 INFO:teuthology.orchestra.run.smithi102.stdout: "dispatch_client_request": 4152, 2024-09-19T04:26:46.228 INFO:teuthology.orchestra.run.smithi102.stdout: "dispatch_server_request": 1376, 2024-09-19T04:26:46.228 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_request": 2571, 2024-09-19T04:26:46.228 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_session": 10, 2024-09-19T04:26:46.228 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_peer_request": 3621, 2024-09-19T04:26:46.228 INFO:teuthology.orchestra.run.smithi102.stdout: "req_create_latency": { 2024-09-19T04:26:46.228 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 272, 2024-09-19T04:26:46.229 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 1.795241937, 2024-09-19T04:26:46.229 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.006600154 2024-09-19T04:26:46.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.229 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getattr_latency": { 2024-09-19T04:26:46.229 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2, 2024-09-19T04:26:46.229 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.001878208, 2024-09-19T04:26:46.229 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000939104 2024-09-19T04:26:46.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.229 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getfilelock_latency": { 2024-09-19T04:26:46.229 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:46.229 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:46.229 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:46.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.230 INFO:teuthology.orchestra.run.smithi102.stdout: "req_link_latency": { 2024-09-19T04:26:46.230 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:46.230 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:46.230 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:46.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.230 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookup_latency": { 2024-09-19T04:26:46.230 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 1559, 2024-09-19T04:26:46.230 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 14.275293131, 2024-09-19T04:26:46.230 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.009156698 2024-09-19T04:26:46.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.230 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookuphash_latency": { 2024-09-19T04:26:46.230 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:46.230 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:46.230 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:46.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.231 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupino_latency": { 2024-09-19T04:26:46.231 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:46.231 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:46.231 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:46.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.231 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupname_latency": { 2024-09-19T04:26:46.231 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:46.231 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:46.231 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:46.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.231 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupparent_latency": { 2024-09-19T04:26:46.231 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:46.231 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:46.232 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:46.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.232 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupsnap_latency": { 2024-09-19T04:26:46.232 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:46.232 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:46.232 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:46.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.232 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lssnap_latency": { 2024-09-19T04:26:46.232 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:46.232 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:46.233 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:46.233 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.233 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mkdir_latency": { 2024-09-19T04:26:46.233 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:46.233 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:46.233 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:46.233 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.233 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mknod_latency": { 2024-09-19T04:26:46.234 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:46.234 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:46.234 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:46.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.234 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mksnap_latency": { 2024-09-19T04:26:46.234 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:46.234 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:46.234 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:46.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.234 INFO:teuthology.orchestra.run.smithi102.stdout: "req_open_latency": { 2024-09-19T04:26:46.234 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 194, 2024-09-19T04:26:46.234 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.146956573, 2024-09-19T04:26:46.234 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000757508 2024-09-19T04:26:46.235 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.235 INFO:teuthology.orchestra.run.smithi102.stdout: "req_readdir_latency": { 2024-09-19T04:26:46.235 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 8, 2024-09-19T04:26:46.235 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.007783568, 2024-09-19T04:26:46.235 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000972946 2024-09-19T04:26:46.235 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.235 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rename_latency": { 2024-09-19T04:26:46.235 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 273, 2024-09-19T04:26:46.235 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 3.484678348, 2024-09-19T04:26:46.235 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.012764389 2024-09-19T04:26:46.235 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.235 INFO:teuthology.orchestra.run.smithi102.stdout: "req_renamesnap_latency": { 2024-09-19T04:26:46.235 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:46.236 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:46.236 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:46.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.236 INFO:teuthology.orchestra.run.smithi102.stdout: "req_snapdiff_latency": { 2024-09-19T04:26:46.236 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:46.236 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:46.236 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:46.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.236 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmdir_latency": { 2024-09-19T04:26:46.236 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:46.236 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:46.236 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:46.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.237 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmsnap_latency": { 2024-09-19T04:26:46.237 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:46.237 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:46.237 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:46.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.237 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmxattr_latency": { 2024-09-19T04:26:46.237 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:46.237 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:46.237 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:46.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.237 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setattr_latency": { 2024-09-19T04:26:46.237 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:46.238 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:46.238 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:46.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.238 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setdirlayout_latency": { 2024-09-19T04:26:46.238 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:46.238 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:46.238 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:46.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.238 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setfilelock_latency": { 2024-09-19T04:26:46.238 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:46.238 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:46.238 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:46.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.239 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setlayout_latency": { 2024-09-19T04:26:46.239 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:46.239 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:46.239 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:46.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.239 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setxattr_latency": { 2024-09-19T04:26:46.239 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:46.239 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:46.239 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:46.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.239 INFO:teuthology.orchestra.run.smithi102.stdout: "req_symlink_latency": { 2024-09-19T04:26:46.239 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:46.240 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:46.240 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:46.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.240 INFO:teuthology.orchestra.run.smithi102.stdout: "req_unlink_latency": { 2024-09-19T04:26:46.240 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 227, 2024-09-19T04:26:46.240 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.460161374, 2024-09-19T04:26:46.240 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.002027142 2024-09-19T04:26:46.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.240 INFO:teuthology.orchestra.run.smithi102.stdout: "cap_revoke_eviction": 0, 2024-09-19T04:26:46.240 INFO:teuthology.orchestra.run.smithi102.stdout: "cap_acquisition_throttle": 0, 2024-09-19T04:26:46.240 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getvxattr_latency": { 2024-09-19T04:26:46.240 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:46.240 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:46.241 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:46.241 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:46.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.241 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_sessions": { 2024-09-19T04:26:46.241 INFO:teuthology.orchestra.run.smithi102.stdout: "session_count": 1, 2024-09-19T04:26:46.241 INFO:teuthology.orchestra.run.smithi102.stdout: "session_add": 2, 2024-09-19T04:26:46.241 INFO:teuthology.orchestra.run.smithi102.stdout: "session_remove": 1, 2024-09-19T04:26:46.241 INFO:teuthology.orchestra.run.smithi102.stdout: "sessions_open": 1, 2024-09-19T04:26:46.241 INFO:teuthology.orchestra.run.smithi102.stdout: "sessions_stale": 0, 2024-09-19T04:26:46.241 INFO:teuthology.orchestra.run.smithi102.stdout: "total_load": 546, 2024-09-19T04:26:46.241 INFO:teuthology.orchestra.run.smithi102.stdout: "average_load": 546, 2024-09-19T04:26:46.241 INFO:teuthology.orchestra.run.smithi102.stdout: "avg_session_uptime": 1887, 2024-09-19T04:26:46.241 INFO:teuthology.orchestra.run.smithi102.stdout: "mdthresh_evicted": 0 2024-09-19T04:26:46.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.242 INFO:teuthology.orchestra.run.smithi102.stdout: "mempool": { 2024-09-19T04:26:46.242 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_bytes": 0, 2024-09-19T04:26:46.242 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_items": 0, 2024-09-19T04:26:46.242 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T04:26:46.242 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_items": 0, 2024-09-19T04:26:46.242 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T04:26:46.242 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_items": 0, 2024-09-19T04:26:46.242 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T04:26:46.242 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T04:26:46.242 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T04:26:46.242 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T04:26:46.242 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T04:26:46.242 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_items": 0, 2024-09-19T04:26:46.243 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T04:26:46.243 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T04:26:46.243 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_bytes": 0, 2024-09-19T04:26:46.243 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_items": 0, 2024-09-19T04:26:46.243 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_bytes": 0, 2024-09-19T04:26:46.243 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_items": 0, 2024-09-19T04:26:46.243 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T04:26:46.243 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T04:26:46.243 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T04:26:46.243 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T04:26:46.243 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T04:26:46.243 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_items": 0, 2024-09-19T04:26:46.244 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_bytes": 0, 2024-09-19T04:26:46.244 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_items": 0, 2024-09-19T04:26:46.244 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T04:26:46.244 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T04:26:46.244 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_bytes": 0, 2024-09-19T04:26:46.244 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_items": 0, 2024-09-19T04:26:46.244 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_bytes": 0, 2024-09-19T04:26:46.244 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_items": 0, 2024-09-19T04:26:46.244 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T04:26:46.244 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_items": 0, 2024-09-19T04:26:46.244 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T04:26:46.244 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_items": 0, 2024-09-19T04:26:46.244 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_bytes": 270903, 2024-09-19T04:26:46.244 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_items": 88, 2024-09-19T04:26:46.245 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_bytes": 0, 2024-09-19T04:26:46.245 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_items": 0, 2024-09-19T04:26:46.245 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_bytes": 0, 2024-09-19T04:26:46.245 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_items": 0, 2024-09-19T04:26:46.245 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_bytes": 0, 2024-09-19T04:26:46.245 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_items": 0, 2024-09-19T04:26:46.245 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_bytes": 0, 2024-09-19T04:26:46.245 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_items": 0, 2024-09-19T04:26:46.245 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_bytes": 9056, 2024-09-19T04:26:46.245 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_items": 171, 2024-09-19T04:26:46.245 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T04:26:46.245 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_items": 0, 2024-09-19T04:26:46.245 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_bytes": 0, 2024-09-19T04:26:46.246 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_items": 0, 2024-09-19T04:26:46.246 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_bytes": 59144, 2024-09-19T04:26:46.246 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_items": 262, 2024-09-19T04:26:46.246 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_bytes": 0, 2024-09-19T04:26:46.246 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_items": 0, 2024-09-19T04:26:46.246 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_bytes": 0, 2024-09-19T04:26:46.246 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_items": 0 2024-09-19T04:26:46.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.246 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter": { 2024-09-19T04:26:46.246 INFO:teuthology.orchestra.run.smithi102.stdout: "op_active": 0, 2024-09-19T04:26:46.246 INFO:teuthology.orchestra.run.smithi102.stdout: "op_laggy": 0, 2024-09-19T04:26:46.246 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send": 1214, 2024-09-19T04:26:46.246 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send_bytes": 3249911, 2024-09-19T04:26:46.247 INFO:teuthology.orchestra.run.smithi102.stdout: "op_resend": 33, 2024-09-19T04:26:46.247 INFO:teuthology.orchestra.run.smithi102.stdout: "op_reply": 1214, 2024-09-19T04:26:46.247 INFO:teuthology.orchestra.run.smithi102.stdout: "op_latency": { 2024-09-19T04:26:46.247 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 1214, 2024-09-19T04:26:46.247 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 28.963426402, 2024-09-19T04:26:46.247 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.023857847 2024-09-19T04:26:46.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.247 INFO:teuthology.orchestra.run.smithi102.stdout: "op_inflight": 0, 2024-09-19T04:26:46.247 INFO:teuthology.orchestra.run.smithi102.stdout: "oplen_avg": { 2024-09-19T04:26:46.247 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 1214, 2024-09-19T04:26:46.247 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 1320 2024-09-19T04:26:46.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.248 INFO:teuthology.orchestra.run.smithi102.stdout: "op": 1214, 2024-09-19T04:26:46.248 INFO:teuthology.orchestra.run.smithi102.stdout: "op_r": 34, 2024-09-19T04:26:46.248 INFO:teuthology.orchestra.run.smithi102.stdout: "op_w": 1180, 2024-09-19T04:26:46.248 INFO:teuthology.orchestra.run.smithi102.stdout: "op_rmw": 0, 2024-09-19T04:26:46.248 INFO:teuthology.orchestra.run.smithi102.stdout: "op_pg": 0, 2024-09-19T04:26:46.248 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_stat": 0, 2024-09-19T04:26:46.248 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_create": 10, 2024-09-19T04:26:46.248 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_read": 34, 2024-09-19T04:26:46.248 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_write": 314, 2024-09-19T04:26:46.249 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writefull": 51, 2024-09-19T04:26:46.249 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writesame": 0, 2024-09-19T04:26:46.249 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_append": 0, 2024-09-19T04:26:46.249 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_zero": 0, 2024-09-19T04:26:46.249 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_truncate": 1, 2024-09-19T04:26:46.249 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_delete": 718, 2024-09-19T04:26:46.249 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_mapext": 0, 2024-09-19T04:26:46.249 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_sparse_read": 0, 2024-09-19T04:26:46.249 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_clonerange": 0, 2024-09-19T04:26:46.249 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_getxattr": 0, 2024-09-19T04:26:46.249 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_setxattr": 20, 2024-09-19T04:26:46.249 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_cmpxattr": 0, 2024-09-19T04:26:46.249 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_rmxattr": 0, 2024-09-19T04:26:46.249 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_resetxattrs": 0, 2024-09-19T04:26:46.250 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_call": 0, 2024-09-19T04:26:46.250 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_watch": 0, 2024-09-19T04:26:46.250 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_notify": 0, 2024-09-19T04:26:46.250 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T04:26:46.250 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls": 0, 2024-09-19T04:26:46.250 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls_filter": 0, 2024-09-19T04:26:46.250 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_other": 0, 2024-09-19T04:26:46.250 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_active": 0, 2024-09-19T04:26:46.250 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_send": 0, 2024-09-19T04:26:46.250 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_resend": 0, 2024-09-19T04:26:46.250 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_ping": 0, 2024-09-19T04:26:46.250 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_active": 0, 2024-09-19T04:26:46.250 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_send": 0, 2024-09-19T04:26:46.251 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_resend": 0, 2024-09-19T04:26:46.251 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_active": 0, 2024-09-19T04:26:46.251 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_send": 0, 2024-09-19T04:26:46.251 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_resend": 0, 2024-09-19T04:26:46.251 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_active": 0, 2024-09-19T04:26:46.251 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_send": 0, 2024-09-19T04:26:46.251 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_resend": 0, 2024-09-19T04:26:46.251 INFO:teuthology.orchestra.run.smithi102.stdout: "command_active": 0, 2024-09-19T04:26:46.251 INFO:teuthology.orchestra.run.smithi102.stdout: "command_send": 0, 2024-09-19T04:26:46.251 INFO:teuthology.orchestra.run.smithi102.stdout: "command_resend": 0, 2024-09-19T04:26:46.251 INFO:teuthology.orchestra.run.smithi102.stdout: "map_epoch": 90, 2024-09-19T04:26:46.251 INFO:teuthology.orchestra.run.smithi102.stdout: "map_full": 0, 2024-09-19T04:26:46.251 INFO:teuthology.orchestra.run.smithi102.stdout: "map_inc": 4, 2024-09-19T04:26:46.252 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_sessions": 12, 2024-09-19T04:26:46.252 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_open": 12, 2024-09-19T04:26:46.252 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_close": 0, 2024-09-19T04:26:46.252 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_laggy": 0, 2024-09-19T04:26:46.252 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_wr": 138, 2024-09-19T04:26:46.252 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_rd": 0, 2024-09-19T04:26:46.252 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_del": 34 2024-09-19T04:26:46.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.252 INFO:teuthology.orchestra.run.smithi102.stdout: "oft": { 2024-09-19T04:26:46.252 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_objs": 1, 2024-09-19T04:26:46.252 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_kv_pairs": 0, 2024-09-19T04:26:46.252 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_updates": 0, 2024-09-19T04:26:46.253 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_removes": 0 2024-09-19T04:26:46.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.253 INFO:teuthology.orchestra.run.smithi102.stdout: "osd-slow-ops": { 2024-09-19T04:26:46.253 INFO:teuthology.orchestra.run.smithi102.stdout: "slow_ops_count": 1196 2024-09-19T04:26:46.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.253 INFO:teuthology.orchestra.run.smithi102.stdout: "purge_queue": { 2024-09-19T04:26:46.253 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_ops": 0, 2024-09-19T04:26:46.253 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_ops_high_water": 10, 2024-09-19T04:26:46.253 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing": 0, 2024-09-19T04:26:46.253 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_high_water": 5, 2024-09-19T04:26:46.253 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executed_ops": 706, 2024-09-19T04:26:46.253 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executed": 353, 2024-09-19T04:26:46.253 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_item_in_journal": 0 2024-09-19T04:26:46.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.254 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T04:26:46.254 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-19T04:26:46.254 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-09-19T04:26:46.254 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-19T04:26:46.254 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 21779, 2024-09-19T04:26:46.254 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 5177642, 2024-09-19T04:26:46.254 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:46.254 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 21779, 2024-09-19T04:26:46.254 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-19T04:26:46.254 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-19T04:26:46.254 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 21779, 2024-09-19T04:26:46.254 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 5177642, 2024-09-19T04:26:46.254 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-19T04:26:46.255 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:46.255 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:46.255 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:46.255 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:46.255 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.255 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_bytes": { 2024-09-19T04:26:46.255 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-19T04:26:46.255 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-09-19T04:26:46.255 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-19T04:26:46.255 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-09-19T04:26:46.255 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-09-19T04:26:46.255 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:46.255 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:46.256 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 1214, 2024-09-19T04:26:46.256 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 3288388, 2024-09-19T04:26:46.256 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 1214, 2024-09-19T04:26:46.256 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 3288388, 2024-09-19T04:26:46.256 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-19T04:26:46.256 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:46.256 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:46.256 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:46.256 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:46.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.256 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_ops": { 2024-09-19T04:26:46.256 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-19T04:26:46.257 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 1024, 2024-09-19T04:26:46.257 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-19T04:26:46.257 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-09-19T04:26:46.257 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-09-19T04:26:46.257 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:46.257 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:46.257 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 1214, 2024-09-19T04:26:46.257 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 1214, 2024-09-19T04:26:46.257 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 1214, 2024-09-19T04:26:46.257 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 1214, 2024-09-19T04:26:46.257 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-19T04:26:46.257 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:46.257 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:46.258 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:46.258 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:46.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.258 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-write_buf_throttle": { 2024-09-19T04:26:46.258 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-19T04:26:46.258 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 3758096384, 2024-09-19T04:26:46.258 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-19T04:26:46.258 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 353, 2024-09-19T04:26:46.258 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 38477, 2024-09-19T04:26:46.258 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:46.258 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 353, 2024-09-19T04:26:46.258 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-19T04:26:46.258 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-19T04:26:46.258 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 34, 2024-09-19T04:26:46.259 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 38477, 2024-09-19T04:26:46.259 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-19T04:26:46.259 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:46.259 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:46.259 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:46.259 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:46.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:46.259 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-write_buf_throttle-0x562b140fc500": { 2024-09-19T04:26:46.259 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-19T04:26:46.259 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 3758096384, 2024-09-19T04:26:46.259 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-19T04:26:46.259 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 2157, 2024-09-19T04:26:46.259 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 2959478, 2024-09-19T04:26:46.260 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:46.260 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 2157, 2024-09-19T04:26:46.260 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-19T04:26:46.260 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-19T04:26:46.260 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 280, 2024-09-19T04:26:46.260 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 2959478, 2024-09-19T04:26:46.260 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-19T04:26:46.260 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:46.260 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:46.260 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:46.260 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:46.260 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:46.260 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-19T04:26:47.040 INFO:tasks.check_counter:Daemon mds.i mds.exported=8 2024-09-19T04:26:47.040 INFO:tasks.check_counter:Daemon mds.i mds.imported=1 2024-09-19T04:26:47.040 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=1 2024-09-19T04:26:47.040 DEBUG:tasks.check_counter:Getting stats from l 2024-09-19T04:26:47.041 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-19T04:26:47.285 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:26:47.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:47 smithi092 ceph-mon[34940]: pgmap v650: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-19T04:26:47.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:47 smithi007 ceph-mon[31360]: pgmap v650: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-19T04:26:47.404 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:47 smithi102 ceph-mon[35446]: pgmap v650: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-19T04:26:48.226 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-19T04:26:48.226 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T04:26:48.226 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 767, 2024-09-19T04:26:48.226 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 767, 2024-09-19T04:26:48.226 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 3176138, 2024-09-19T04:26:48.226 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 243146, 2024-09-19T04:26:48.226 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 6, 2024-09-19T04:26:48.226 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 2, 2024-09-19T04:26:48.226 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.068439587, 2024-09-19T04:26:48.227 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.019073535, 2024-09-19T04:26:48.227 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.022678528, 2024-09-19T04:26:48.227 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.020166882, 2024-09-19T04:26:48.227 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:48.227 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 766, 2024-09-19T04:26:48.227 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.034027616, 2024-09-19T04:26:48.227 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000044422 2024-09-19T04:26:48.227 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.227 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:48.227 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.227 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.227 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.227 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.228 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-19T04:26:48.228 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T04:26:48.228 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.228 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T04:26:48.228 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 825, 2024-09-19T04:26:48.228 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 804, 2024-09-19T04:26:48.228 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 1025480, 2024-09-19T04:26:48.228 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 316111, 2024-09-19T04:26:48.228 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 4, 2024-09-19T04:26:48.228 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 3, 2024-09-19T04:26:48.228 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.084693999, 2024-09-19T04:26:48.228 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.026769660, 2024-09-19T04:26:48.228 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.039590770, 2024-09-19T04:26:48.229 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.021296474, 2024-09-19T04:26:48.229 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:48.229 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 803, 2024-09-19T04:26:48.229 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.035050206, 2024-09-19T04:26:48.229 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000043649 2024-09-19T04:26:48.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.229 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:48.229 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.229 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.229 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.229 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 881056, 2024-09-19T04:26:48.230 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 129440 2024-09-19T04:26:48.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.230 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T04:26:48.230 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 674, 2024-09-19T04:26:48.230 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 832, 2024-09-19T04:26:48.230 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 226288, 2024-09-19T04:26:48.230 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 552814, 2024-09-19T04:26:48.230 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 4, 2024-09-19T04:26:48.230 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 3, 2024-09-19T04:26:48.230 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.080378749, 2024-09-19T04:26:48.230 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.028269722, 2024-09-19T04:26:48.230 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.020208828, 2024-09-19T04:26:48.230 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.023631138, 2024-09-19T04:26:48.231 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:26:48.231 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 830, 2024-09-19T04:26:48.231 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.043493153, 2024-09-19T04:26:48.231 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000052401 2024-09-19T04:26:48.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.231 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:26:48.231 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.231 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.231 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.231 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T04:26:48.231 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 338800 2024-09-19T04:26:48.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.231 INFO:teuthology.orchestra.run.smithi102.stdout: "cct": { 2024-09-19T04:26:48.232 INFO:teuthology.orchestra.run.smithi102.stdout: "total_workers": 1, 2024-09-19T04:26:48.232 INFO:teuthology.orchestra.run.smithi102.stdout: "unhealthy_workers": 0 2024-09-19T04:26:48.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.232 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-MDSRank": { 2024-09-19T04:26:48.232 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2024-09-19T04:26:48.232 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2024-09-19T04:26:48.232 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 3393, 2024-09-19T04:26:48.232 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.090466125, 2024-09-19T04:26:48.232 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000026662 2024-09-19T04:26:48.232 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:48.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.232 INFO:teuthology.orchestra.run.smithi102.stdout: "finisher-PurgeQueue": { 2024-09-19T04:26:48.232 INFO:teuthology.orchestra.run.smithi102.stdout: "queue_len": 0, 2024-09-19T04:26:48.233 INFO:teuthology.orchestra.run.smithi102.stdout: "complete_latency": { 2024-09-19T04:26:48.233 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.233 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.233 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.233 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:48.233 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.233 INFO:teuthology.orchestra.run.smithi102.stdout: "mds": { 2024-09-19T04:26:48.233 INFO:teuthology.orchestra.run.smithi102.stdout: "request": 0, 2024-09-19T04:26:48.233 INFO:teuthology.orchestra.run.smithi102.stdout: "reply": 0, 2024-09-19T04:26:48.233 INFO:teuthology.orchestra.run.smithi102.stdout: "reply_latency": { 2024-09-19T04:26:48.233 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.233 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.234 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.234 INFO:teuthology.orchestra.run.smithi102.stdout: "slow_reply": 0, 2024-09-19T04:26:48.234 INFO:teuthology.orchestra.run.smithi102.stdout: "forward": 0, 2024-09-19T04:26:48.234 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_fetch_complete": 0, 2024-09-19T04:26:48.234 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_fetch_keys": 0, 2024-09-19T04:26:48.234 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_commit": 0, 2024-09-19T04:26:48.234 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_split": 0, 2024-09-19T04:26:48.234 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_merge": 0, 2024-09-19T04:26:48.234 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes": 362, 2024-09-19T04:26:48.234 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_top": 0, 2024-09-19T04:26:48.234 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_bottom": 362, 2024-09-19T04:26:48.235 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_pin_tail": 0, 2024-09-19T04:26:48.235 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_pinned": 362, 2024-09-19T04:26:48.235 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_expired": 0, 2024-09-19T04:26:48.235 INFO:teuthology.orchestra.run.smithi102.stdout: "inodes_with_caps": 0, 2024-09-19T04:26:48.235 INFO:teuthology.orchestra.run.smithi102.stdout: "caps": 0, 2024-09-19T04:26:48.235 INFO:teuthology.orchestra.run.smithi102.stdout: "subtrees": 1, 2024-09-19T04:26:48.235 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse": 0, 2024-09-19T04:26:48.235 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_hit": 0, 2024-09-19T04:26:48.235 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_forward": 0, 2024-09-19T04:26:48.235 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_discover": 0, 2024-09-19T04:26:48.235 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_dir_fetch": 0, 2024-09-19T04:26:48.235 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_remote_ino": 0, 2024-09-19T04:26:48.236 INFO:teuthology.orchestra.run.smithi102.stdout: "traverse_lock": 0, 2024-09-19T04:26:48.236 INFO:teuthology.orchestra.run.smithi102.stdout: "load_cent": 0, 2024-09-19T04:26:48.236 INFO:teuthology.orchestra.run.smithi102.stdout: "q": 0, 2024-09-19T04:26:48.236 INFO:teuthology.orchestra.run.smithi102.stdout: "exported": 0, 2024-09-19T04:26:48.236 INFO:teuthology.orchestra.run.smithi102.stdout: "exported_inodes": 0, 2024-09-19T04:26:48.236 INFO:teuthology.orchestra.run.smithi102.stdout: "imported": 0, 2024-09-19T04:26:48.236 INFO:teuthology.orchestra.run.smithi102.stdout: "imported_inodes": 0, 2024-09-19T04:26:48.236 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_dir_fetch": 0, 2024-09-19T04:26:48.236 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_backtrace_fetch": 0, 2024-09-19T04:26:48.236 INFO:teuthology.orchestra.run.smithi102.stdout: "openino_peer_discover": 0, 2024-09-19T04:26:48.236 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rfiles": 0, 2024-09-19T04:26:48.236 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rbytes": 0, 2024-09-19T04:26:48.236 INFO:teuthology.orchestra.run.smithi102.stdout: "root_rsnaps": 0, 2024-09-19T04:26:48.236 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T04:26:48.237 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_set_tag": 0, 2024-09-19T04:26:48.237 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T04:26:48.237 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_inotable_repaired": 0, 2024-09-19T04:26:48.237 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dir_inodes": 0, 2024-09-19T04:26:48.237 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T04:26:48.237 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T04:26:48.237 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_file_inodes": 0, 2024-09-19T04:26:48.237 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_inode_file_caps": 0, 2024-09-19T04:26:48.237 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T04:26:48.237 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_grant": 0, 2024-09-19T04:26:48.237 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T04:26:48.237 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T04:26:48.238 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T04:26:48.238 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_caps": 0, 2024-09-19T04:26:48.238 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_caps_dirty": 0, 2024-09-19T04:26:48.238 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_cap_release": 0, 2024-09-19T04:26:48.238 INFO:teuthology.orchestra.run.smithi102.stdout: "process_request_cap_release": 0 2024-09-19T04:26:48.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.238 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_cache": { 2024-09-19T04:26:48.238 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_update": 0, 2024-09-19T04:26:48.238 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_update_receipt": 0, 2024-09-19T04:26:48.238 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_try_discover": 0, 2024-09-19T04:26:48.238 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_send_discover": 0, 2024-09-19T04:26:48.238 INFO:teuthology.orchestra.run.smithi102.stdout: "dir_handle_discover": 0, 2024-09-19T04:26:48.239 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays": 0, 2024-09-19T04:26:48.239 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays_delayed": 0, 2024-09-19T04:26:48.239 INFO:teuthology.orchestra.run.smithi102.stdout: "num_strays_enqueuing": 0, 2024-09-19T04:26:48.239 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_created": 0, 2024-09-19T04:26:48.239 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_enqueued": 0, 2024-09-19T04:26:48.239 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_reintegrated": 0, 2024-09-19T04:26:48.239 INFO:teuthology.orchestra.run.smithi102.stdout: "strays_migrated": 0, 2024-09-19T04:26:48.239 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_processing": 0, 2024-09-19T04:26:48.239 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_enqueued": 0, 2024-09-19T04:26:48.239 INFO:teuthology.orchestra.run.smithi102.stdout: "num_recovering_prioritized": 0, 2024-09-19T04:26:48.239 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_started": 0, 2024-09-19T04:26:48.239 INFO:teuthology.orchestra.run.smithi102.stdout: "recovery_completed": 0, 2024-09-19T04:26:48.239 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_quiesce_path": 0, 2024-09-19T04:26:48.240 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_quiesce_inode": 0, 2024-09-19T04:26:48.240 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T04:26:48.240 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_exportdir": 0, 2024-09-19T04:26:48.240 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_flush": 0, 2024-09-19T04:26:48.240 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_fragmentdir": 0, 2024-09-19T04:26:48.240 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_fragstats": 0, 2024-09-19T04:26:48.240 INFO:teuthology.orchestra.run.smithi102.stdout: "ireq_inodestats": 0 2024-09-19T04:26:48.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.240 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_log": { 2024-09-19T04:26:48.240 INFO:teuthology.orchestra.run.smithi102.stdout: "evlrg": 0, 2024-09-19T04:26:48.240 INFO:teuthology.orchestra.run.smithi102.stdout: "evadd": 0, 2024-09-19T04:26:48.240 INFO:teuthology.orchestra.run.smithi102.stdout: "evex": 0, 2024-09-19T04:26:48.240 INFO:teuthology.orchestra.run.smithi102.stdout: "evtrm": 0, 2024-09-19T04:26:48.240 INFO:teuthology.orchestra.run.smithi102.stdout: "ev": 2209, 2024-09-19T04:26:48.240 INFO:teuthology.orchestra.run.smithi102.stdout: "evexg": 0, 2024-09-19T04:26:48.241 INFO:teuthology.orchestra.run.smithi102.stdout: "evexd": 0, 2024-09-19T04:26:48.241 INFO:teuthology.orchestra.run.smithi102.stdout: "segadd": 0, 2024-09-19T04:26:48.241 INFO:teuthology.orchestra.run.smithi102.stdout: "segex": 0, 2024-09-19T04:26:48.241 INFO:teuthology.orchestra.run.smithi102.stdout: "segtrm": 0, 2024-09-19T04:26:48.241 INFO:teuthology.orchestra.run.smithi102.stdout: "seg": 4, 2024-09-19T04:26:48.241 INFO:teuthology.orchestra.run.smithi102.stdout: "segmjr": 2, 2024-09-19T04:26:48.241 INFO:teuthology.orchestra.run.smithi102.stdout: "segexg": 0, 2024-09-19T04:26:48.241 INFO:teuthology.orchestra.run.smithi102.stdout: "segexd": 0, 2024-09-19T04:26:48.241 INFO:teuthology.orchestra.run.smithi102.stdout: "expos": 4194304, 2024-09-19T04:26:48.241 INFO:teuthology.orchestra.run.smithi102.stdout: "wrpos": 7168265, 2024-09-19T04:26:48.241 INFO:teuthology.orchestra.run.smithi102.stdout: "rdpos": 7167127, 2024-09-19T04:26:48.241 INFO:teuthology.orchestra.run.smithi102.stdout: "jlat": { 2024-09-19T04:26:48.241 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.241 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.241 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.242 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.242 INFO:teuthology.orchestra.run.smithi102.stdout: "replayed": 2209 2024-09-19T04:26:48.242 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.242 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_mem": { 2024-09-19T04:26:48.242 INFO:teuthology.orchestra.run.smithi102.stdout: "ino": 5, 2024-09-19T04:26:48.242 INFO:teuthology.orchestra.run.smithi102.stdout: "ino+": 380, 2024-09-19T04:26:48.242 INFO:teuthology.orchestra.run.smithi102.stdout: "ino-": 375, 2024-09-19T04:26:48.242 INFO:teuthology.orchestra.run.smithi102.stdout: "dir": 3, 2024-09-19T04:26:48.242 INFO:teuthology.orchestra.run.smithi102.stdout: "dir+": 35, 2024-09-19T04:26:48.242 INFO:teuthology.orchestra.run.smithi102.stdout: "dir-": 32, 2024-09-19T04:26:48.242 INFO:teuthology.orchestra.run.smithi102.stdout: "dn": 362, 2024-09-19T04:26:48.242 INFO:teuthology.orchestra.run.smithi102.stdout: "dn+": 892, 2024-09-19T04:26:48.242 INFO:teuthology.orchestra.run.smithi102.stdout: "dn-": 530, 2024-09-19T04:26:48.243 INFO:teuthology.orchestra.run.smithi102.stdout: "cap": 0, 2024-09-19T04:26:48.243 INFO:teuthology.orchestra.run.smithi102.stdout: "cap+": 0, 2024-09-19T04:26:48.243 INFO:teuthology.orchestra.run.smithi102.stdout: "cap-": 0, 2024-09-19T04:26:48.243 INFO:teuthology.orchestra.run.smithi102.stdout: "rss": 50684, 2024-09-19T04:26:48.243 INFO:teuthology.orchestra.run.smithi102.stdout: "heap": 215328 2024-09-19T04:26:48.243 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.243 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_server": { 2024-09-19T04:26:48.243 INFO:teuthology.orchestra.run.smithi102.stdout: "dispatch_client_request": 0, 2024-09-19T04:26:48.243 INFO:teuthology.orchestra.run.smithi102.stdout: "dispatch_server_request": 0, 2024-09-19T04:26:48.243 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_request": 0, 2024-09-19T04:26:48.243 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_client_session": 0, 2024-09-19T04:26:48.243 INFO:teuthology.orchestra.run.smithi102.stdout: "handle_peer_request": 0, 2024-09-19T04:26:48.243 INFO:teuthology.orchestra.run.smithi102.stdout: "req_create_latency": { 2024-09-19T04:26:48.243 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.244 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.244 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.244 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getattr_latency": { 2024-09-19T04:26:48.244 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.244 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.244 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.244 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getfilelock_latency": { 2024-09-19T04:26:48.244 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.244 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.244 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.245 INFO:teuthology.orchestra.run.smithi102.stdout: "req_link_latency": { 2024-09-19T04:26:48.245 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.245 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.245 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.245 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookup_latency": { 2024-09-19T04:26:48.245 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.245 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.245 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.245 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookuphash_latency": { 2024-09-19T04:26:48.245 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.246 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.246 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.246 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupino_latency": { 2024-09-19T04:26:48.246 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.246 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.246 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.246 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupname_latency": { 2024-09-19T04:26:48.246 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.246 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.246 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.246 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupparent_latency": { 2024-09-19T04:26:48.247 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.247 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.247 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.247 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lookupsnap_latency": { 2024-09-19T04:26:48.247 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.247 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.247 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.247 INFO:teuthology.orchestra.run.smithi102.stdout: "req_lssnap_latency": { 2024-09-19T04:26:48.247 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.247 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.247 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.247 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mkdir_latency": { 2024-09-19T04:26:48.248 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.248 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.248 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.248 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mknod_latency": { 2024-09-19T04:26:48.248 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.248 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.248 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.248 INFO:teuthology.orchestra.run.smithi102.stdout: "req_mksnap_latency": { 2024-09-19T04:26:48.248 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.248 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.249 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.249 INFO:teuthology.orchestra.run.smithi102.stdout: "req_open_latency": { 2024-09-19T04:26:48.249 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.249 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.249 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.249 INFO:teuthology.orchestra.run.smithi102.stdout: "req_readdir_latency": { 2024-09-19T04:26:48.249 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.249 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.249 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.249 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rename_latency": { 2024-09-19T04:26:48.250 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.250 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.250 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.250 INFO:teuthology.orchestra.run.smithi102.stdout: "req_renamesnap_latency": { 2024-09-19T04:26:48.250 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.250 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.250 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.250 INFO:teuthology.orchestra.run.smithi102.stdout: "req_snapdiff_latency": { 2024-09-19T04:26:48.250 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.250 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.250 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.251 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmdir_latency": { 2024-09-19T04:26:48.251 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.251 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.251 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.251 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmsnap_latency": { 2024-09-19T04:26:48.251 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.251 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.251 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.251 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.251 INFO:teuthology.orchestra.run.smithi102.stdout: "req_rmxattr_latency": { 2024-09-19T04:26:48.251 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.251 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.252 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.252 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setattr_latency": { 2024-09-19T04:26:48.252 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.252 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.252 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.252 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setdirlayout_latency": { 2024-09-19T04:26:48.252 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.252 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.252 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.252 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setfilelock_latency": { 2024-09-19T04:26:48.253 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.253 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.253 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.253 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setlayout_latency": { 2024-09-19T04:26:48.253 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.253 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.253 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.253 INFO:teuthology.orchestra.run.smithi102.stdout: "req_setxattr_latency": { 2024-09-19T04:26:48.253 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.253 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.254 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.254 INFO:teuthology.orchestra.run.smithi102.stdout: "req_symlink_latency": { 2024-09-19T04:26:48.254 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.254 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.254 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.254 INFO:teuthology.orchestra.run.smithi102.stdout: "req_unlink_latency": { 2024-09-19T04:26:48.254 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.254 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.254 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.254 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.255 INFO:teuthology.orchestra.run.smithi102.stdout: "cap_revoke_eviction": 0, 2024-09-19T04:26:48.255 INFO:teuthology.orchestra.run.smithi102.stdout: "cap_acquisition_throttle": 0, 2024-09-19T04:26:48.255 INFO:teuthology.orchestra.run.smithi102.stdout: "req_getvxattr_latency": { 2024-09-19T04:26:48.255 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.255 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.255 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.255 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:48.255 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.255 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_sessions": { 2024-09-19T04:26:48.255 INFO:teuthology.orchestra.run.smithi102.stdout: "session_count": 1, 2024-09-19T04:26:48.256 INFO:teuthology.orchestra.run.smithi102.stdout: "session_add": 2, 2024-09-19T04:26:48.256 INFO:teuthology.orchestra.run.smithi102.stdout: "session_remove": 1, 2024-09-19T04:26:48.256 INFO:teuthology.orchestra.run.smithi102.stdout: "sessions_open": 1, 2024-09-19T04:26:48.256 INFO:teuthology.orchestra.run.smithi102.stdout: "sessions_stale": 0, 2024-09-19T04:26:48.256 INFO:teuthology.orchestra.run.smithi102.stdout: "total_load": 0, 2024-09-19T04:26:48.256 INFO:teuthology.orchestra.run.smithi102.stdout: "average_load": 0, 2024-09-19T04:26:48.256 INFO:teuthology.orchestra.run.smithi102.stdout: "avg_session_uptime": 1889, 2024-09-19T04:26:48.256 INFO:teuthology.orchestra.run.smithi102.stdout: "mdthresh_evicted": 0 2024-09-19T04:26:48.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.256 INFO:teuthology.orchestra.run.smithi102.stdout: "mempool": { 2024-09-19T04:26:48.256 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_bytes": 0, 2024-09-19T04:26:48.256 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_items": 0, 2024-09-19T04:26:48.256 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T04:26:48.257 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_items": 0, 2024-09-19T04:26:48.257 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T04:26:48.257 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_items": 0, 2024-09-19T04:26:48.257 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T04:26:48.257 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T04:26:48.257 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T04:26:48.257 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T04:26:48.257 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T04:26:48.257 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_items": 0, 2024-09-19T04:26:48.257 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T04:26:48.257 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T04:26:48.257 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_bytes": 0, 2024-09-19T04:26:48.257 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_items": 0, 2024-09-19T04:26:48.258 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_bytes": 0, 2024-09-19T04:26:48.258 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_items": 0, 2024-09-19T04:26:48.258 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T04:26:48.258 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T04:26:48.258 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T04:26:48.258 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T04:26:48.258 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T04:26:48.258 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_items": 0, 2024-09-19T04:26:48.258 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_bytes": 0, 2024-09-19T04:26:48.258 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_items": 0, 2024-09-19T04:26:48.258 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T04:26:48.258 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T04:26:48.259 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_bytes": 0, 2024-09-19T04:26:48.259 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_items": 0, 2024-09-19T04:26:48.259 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_bytes": 0, 2024-09-19T04:26:48.259 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_items": 0, 2024-09-19T04:26:48.259 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T04:26:48.259 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_items": 0, 2024-09-19T04:26:48.259 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T04:26:48.259 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_items": 0, 2024-09-19T04:26:48.259 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_bytes": 189417, 2024-09-19T04:26:48.259 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_items": 52, 2024-09-19T04:26:48.259 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_bytes": 0, 2024-09-19T04:26:48.259 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_items": 0, 2024-09-19T04:26:48.259 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_bytes": 0, 2024-09-19T04:26:48.259 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_items": 0, 2024-09-19T04:26:48.259 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_bytes": 0, 2024-09-19T04:26:48.260 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_items": 0, 2024-09-19T04:26:48.260 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_bytes": 0, 2024-09-19T04:26:48.260 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_items": 0, 2024-09-19T04:26:48.260 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_bytes": 9056, 2024-09-19T04:26:48.260 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_items": 171, 2024-09-19T04:26:48.260 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T04:26:48.260 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_items": 0, 2024-09-19T04:26:48.260 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_bytes": 0, 2024-09-19T04:26:48.260 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_items": 0, 2024-09-19T04:26:48.260 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_bytes": 270408, 2024-09-19T04:26:48.260 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_items": 1488, 2024-09-19T04:26:48.260 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_bytes": 0, 2024-09-19T04:26:48.260 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_items": 0, 2024-09-19T04:26:48.260 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_bytes": 0, 2024-09-19T04:26:48.261 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_items": 0 2024-09-19T04:26:48.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.261 INFO:teuthology.orchestra.run.smithi102.stdout: "objecter": { 2024-09-19T04:26:48.261 INFO:teuthology.orchestra.run.smithi102.stdout: "op_active": 0, 2024-09-19T04:26:48.261 INFO:teuthology.orchestra.run.smithi102.stdout: "op_laggy": 0, 2024-09-19T04:26:48.261 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send": 2023, 2024-09-19T04:26:48.261 INFO:teuthology.orchestra.run.smithi102.stdout: "op_send_bytes": 21, 2024-09-19T04:26:48.261 INFO:teuthology.orchestra.run.smithi102.stdout: "op_resend": 3, 2024-09-19T04:26:48.261 INFO:teuthology.orchestra.run.smithi102.stdout: "op_reply": 2023, 2024-09-19T04:26:48.261 INFO:teuthology.orchestra.run.smithi102.stdout: "op_latency": { 2024-09-19T04:26:48.261 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2023, 2024-09-19T04:26:48.261 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 21.630572403, 2024-09-19T04:26:48.261 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.010692324 2024-09-19T04:26:48.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.262 INFO:teuthology.orchestra.run.smithi102.stdout: "op_inflight": 0, 2024-09-19T04:26:48.262 INFO:teuthology.orchestra.run.smithi102.stdout: "oplen_avg": { 2024-09-19T04:26:48.262 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 2023, 2024-09-19T04:26:48.262 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 2024 2024-09-19T04:26:48.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.262 INFO:teuthology.orchestra.run.smithi102.stdout: "op": 2023, 2024-09-19T04:26:48.262 INFO:teuthology.orchestra.run.smithi102.stdout: "op_r": 2023, 2024-09-19T04:26:48.262 INFO:teuthology.orchestra.run.smithi102.stdout: "op_w": 0, 2024-09-19T04:26:48.262 INFO:teuthology.orchestra.run.smithi102.stdout: "op_rmw": 0, 2024-09-19T04:26:48.262 INFO:teuthology.orchestra.run.smithi102.stdout: "op_pg": 0, 2024-09-19T04:26:48.262 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_stat": 1258, 2024-09-19T04:26:48.262 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_create": 0, 2024-09-19T04:26:48.262 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_read": 763, 2024-09-19T04:26:48.262 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_write": 0, 2024-09-19T04:26:48.262 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writefull": 0, 2024-09-19T04:26:48.263 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_writesame": 0, 2024-09-19T04:26:48.263 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_append": 0, 2024-09-19T04:26:48.263 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_zero": 0, 2024-09-19T04:26:48.263 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_truncate": 0, 2024-09-19T04:26:48.263 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_delete": 0, 2024-09-19T04:26:48.263 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_mapext": 0, 2024-09-19T04:26:48.263 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_sparse_read": 0, 2024-09-19T04:26:48.263 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_clonerange": 0, 2024-09-19T04:26:48.263 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_getxattr": 1, 2024-09-19T04:26:48.263 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_setxattr": 0, 2024-09-19T04:26:48.263 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_cmpxattr": 0, 2024-09-19T04:26:48.263 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_rmxattr": 0, 2024-09-19T04:26:48.263 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_resetxattrs": 0, 2024-09-19T04:26:48.263 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_call": 0, 2024-09-19T04:26:48.264 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_watch": 0, 2024-09-19T04:26:48.264 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_notify": 0, 2024-09-19T04:26:48.264 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T04:26:48.264 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls": 0, 2024-09-19T04:26:48.264 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_pgls_filter": 0, 2024-09-19T04:26:48.264 INFO:teuthology.orchestra.run.smithi102.stdout: "osdop_other": 0, 2024-09-19T04:26:48.264 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_active": 0, 2024-09-19T04:26:48.264 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_send": 0, 2024-09-19T04:26:48.264 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_resend": 0, 2024-09-19T04:26:48.264 INFO:teuthology.orchestra.run.smithi102.stdout: "linger_ping": 0, 2024-09-19T04:26:48.264 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_active": 0, 2024-09-19T04:26:48.264 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_send": 0, 2024-09-19T04:26:48.264 INFO:teuthology.orchestra.run.smithi102.stdout: "poolop_resend": 0, 2024-09-19T04:26:48.264 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_active": 0, 2024-09-19T04:26:48.265 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_send": 0, 2024-09-19T04:26:48.265 INFO:teuthology.orchestra.run.smithi102.stdout: "poolstat_resend": 0, 2024-09-19T04:26:48.265 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_active": 0, 2024-09-19T04:26:48.265 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_send": 0, 2024-09-19T04:26:48.265 INFO:teuthology.orchestra.run.smithi102.stdout: "statfs_resend": 0, 2024-09-19T04:26:48.265 INFO:teuthology.orchestra.run.smithi102.stdout: "command_active": 0, 2024-09-19T04:26:48.265 INFO:teuthology.orchestra.run.smithi102.stdout: "command_send": 0, 2024-09-19T04:26:48.265 INFO:teuthology.orchestra.run.smithi102.stdout: "command_resend": 0, 2024-09-19T04:26:48.265 INFO:teuthology.orchestra.run.smithi102.stdout: "map_epoch": 90, 2024-09-19T04:26:48.265 INFO:teuthology.orchestra.run.smithi102.stdout: "map_full": 0, 2024-09-19T04:26:48.265 INFO:teuthology.orchestra.run.smithi102.stdout: "map_inc": 4, 2024-09-19T04:26:48.265 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_sessions": 5, 2024-09-19T04:26:48.266 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_open": 5, 2024-09-19T04:26:48.266 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_session_close": 0, 2024-09-19T04:26:48.266 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_laggy": 0, 2024-09-19T04:26:48.266 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_wr": 0, 2024-09-19T04:26:48.266 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_rd": 2, 2024-09-19T04:26:48.266 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_del": 0 2024-09-19T04:26:48.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.266 INFO:teuthology.orchestra.run.smithi102.stdout: "oft": { 2024-09-19T04:26:48.266 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_objs": 0, 2024-09-19T04:26:48.266 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_kv_pairs": 0, 2024-09-19T04:26:48.266 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_updates": 0, 2024-09-19T04:26:48.266 INFO:teuthology.orchestra.run.smithi102.stdout: "omap_total_removes": 0 2024-09-19T04:26:48.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.266 INFO:teuthology.orchestra.run.smithi102.stdout: "osd-slow-ops": { 2024-09-19T04:26:48.267 INFO:teuthology.orchestra.run.smithi102.stdout: "slow_ops_count": 0 2024-09-19T04:26:48.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.267 INFO:teuthology.orchestra.run.smithi102.stdout: "purge_queue": { 2024-09-19T04:26:48.267 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_ops": 0, 2024-09-19T04:26:48.267 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T04:26:48.267 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing": 0, 2024-09-19T04:26:48.267 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executing_high_water": 0, 2024-09-19T04:26:48.267 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executed_ops": 0, 2024-09-19T04:26:48.267 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_executed": 0, 2024-09-19T04:26:48.267 INFO:teuthology.orchestra.run.smithi102.stdout: "pq_item_in_journal": 0 2024-09-19T04:26:48.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.267 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T04:26:48.267 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-19T04:26:48.268 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-09-19T04:26:48.268 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-19T04:26:48.268 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 2262, 2024-09-19T04:26:48.268 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 4209138, 2024-09-19T04:26:48.268 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:48.268 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 2262, 2024-09-19T04:26:48.268 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-19T04:26:48.268 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-19T04:26:48.268 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 2262, 2024-09-19T04:26:48.268 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 4209138, 2024-09-19T04:26:48.268 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-19T04:26:48.268 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.269 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.269 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.269 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:48.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.269 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_bytes": { 2024-09-19T04:26:48.269 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-19T04:26:48.269 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-09-19T04:26:48.269 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-19T04:26:48.269 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-09-19T04:26:48.269 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-09-19T04:26:48.269 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:48.269 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:48.270 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 2023, 2024-09-19T04:26:48.270 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 2973966, 2024-09-19T04:26:48.270 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 2023, 2024-09-19T04:26:48.270 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 2973966, 2024-09-19T04:26:48.270 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-19T04:26:48.270 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.270 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.270 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.270 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:48.270 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.270 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-objecter_ops": { 2024-09-19T04:26:48.270 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-19T04:26:48.270 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 1024, 2024-09-19T04:26:48.271 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-19T04:26:48.271 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-09-19T04:26:48.271 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-09-19T04:26:48.271 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:48.271 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:48.271 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 2023, 2024-09-19T04:26:48.271 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 2023, 2024-09-19T04:26:48.271 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 2023, 2024-09-19T04:26:48.271 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 2023, 2024-09-19T04:26:48.271 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-19T04:26:48.271 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.271 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.271 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.271 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:48.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.272 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-write_buf_throttle": { 2024-09-19T04:26:48.272 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-19T04:26:48.272 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 3758096384, 2024-09-19T04:26:48.272 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-19T04:26:48.272 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-09-19T04:26:48.272 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-09-19T04:26:48.272 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:48.272 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:48.272 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-19T04:26:48.272 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-19T04:26:48.272 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 0, 2024-09-19T04:26:48.273 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 0, 2024-09-19T04:26:48.273 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-19T04:26:48.273 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.273 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.273 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.273 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:48.274 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-19T04:26:48.274 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-write_buf_throttle-0x55de7ced46e0": { 2024-09-19T04:26:48.274 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-19T04:26:48.274 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 3758096384, 2024-09-19T04:26:48.274 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-19T04:26:48.274 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 0, 2024-09-19T04:26:48.274 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 0, 2024-09-19T04:26:48.274 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-19T04:26:48.274 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 0, 2024-09-19T04:26:48.274 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-19T04:26:48.274 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-19T04:26:48.274 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 0, 2024-09-19T04:26:48.274 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 0, 2024-09-19T04:26:48.275 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-19T04:26:48.275 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-19T04:26:48.275 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-19T04:26:48.275 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-19T04:26:48.275 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:48.275 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-19T04:26:48.275 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-19T04:26:49.012 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-19T04:26:49.013 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-19T04:26:49.013 INFO:tasks.check_counter:Daemon mds.l mds.dir_split=0 2024-09-19T04:26:49.013 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-19T04:26:49.023 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-19T04:26:49.024 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T04:26:49.024 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T04:26:49.045 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-19T04:26:49.045 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T04:26:49.105 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T04:26:49.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:49 smithi102 ceph-mon[35446]: pgmap v651: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-19T04:26:49.264 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:49 smithi092 ceph-mon[34940]: pgmap v651: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-19T04:26:49.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:49 smithi007 ceph-mon[31360]: pgmap v651: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-19T04:26:49.412 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:26:49.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.875+0000 7f148b075640 1 -- 172.21.15.7:0/1442014083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484101de0 msgr2=0x7f14841021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:49.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.875+0000 7f148b075640 1 --2- 172.21.15.7:0/1442014083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484101de0 0x7f14841021c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f1478009900 tx=0x7f147802a410 comp rx=0 tx=0).stop 2024-09-19T04:26:49.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.875+0000 7f148b075640 1 -- 172.21.15.7:0/1442014083 shutdown_connections 2024-09-19T04:26:49.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.875+0000 7f148b075640 1 --2- 172.21.15.7:0/1442014083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1484106f10 0x7f148410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:49.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.875+0000 7f148b075640 1 --2- 172.21.15.7:0/1442014083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1484102790 0x7f14841067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:49.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.875+0000 7f148b075640 1 --2- 172.21.15.7:0/1442014083 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484101de0 0x7f14841021c0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:49.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.875+0000 7f148b075640 1 -- 172.21.15.7:0/1442014083 >> 172.21.15.7:0/1442014083 conn(0x7f14840fd8c0 msgr2=0x7f14840ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:49.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.875+0000 7f148b075640 1 -- 172.21.15.7:0/1442014083 shutdown_connections 2024-09-19T04:26:49.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.875+0000 7f148b075640 1 -- 172.21.15.7:0/1442014083 wait complete. 2024-09-19T04:26:49.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.876+0000 7f148b075640 1 Processor -- start 2024-09-19T04:26:49.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.876+0000 7f148b075640 1 -- start start 2024-09-19T04:26:49.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.876+0000 7f148b075640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1484101de0 0x7f148419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:49.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.876+0000 7f148b075640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484102790 0x7f148419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:49.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.876+0000 7f148b075640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1484106f10 0x7f148419ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:49.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.876+0000 7f148b075640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1484111f70 con 0x7f1484102790 2024-09-19T04:26:49.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.876+0000 7f148b075640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1484111df0 con 0x7f1484101de0 2024-09-19T04:26:49.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.876+0000 7f148b075640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f14841120f0 con 0x7f1484106f10 2024-09-19T04:26:49.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.876+0000 7f1483fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484102790 0x7f148419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:49.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.876+0000 7f1483fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484102790 0x7f148419abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47046/0 (socket says 172.21.15.7:47046) 2024-09-19T04:26:49.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.876+0000 7f1483fff640 1 -- 172.21.15.7:0/2087614382 learned_addr learned my addr 172.21.15.7:0/2087614382 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:26:49.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.876+0000 7f1489612640 1 --2- 172.21.15.7:0/2087614382 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1484106f10 0x7f148419ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:49.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.877+0000 7f1488e11640 1 --2- 172.21.15.7:0/2087614382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1484101de0 0x7f148419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:49.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.877+0000 7f1483fff640 1 -- 172.21.15.7:0/2087614382 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1484106f10 msgr2=0x7f148419ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:49.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.877+0000 7f1483fff640 1 --2- 172.21.15.7:0/2087614382 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1484106f10 0x7f148419ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:49.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.877+0000 7f1483fff640 1 -- 172.21.15.7:0/2087614382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1484101de0 msgr2=0x7f148419a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:49.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.877+0000 7f1483fff640 1 --2- 172.21.15.7:0/2087614382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1484101de0 0x7f148419a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:49.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.877+0000 7f1483fff640 1 -- 172.21.15.7:0/2087614382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148419f660 con 0x7f1484102790 2024-09-19T04:26:49.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.877+0000 7f1488e11640 1 --2- 172.21.15.7:0/2087614382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1484101de0 0x7f148419a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:26:49.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.877+0000 7f1483fff640 1 --2- 172.21.15.7:0/2087614382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484102790 0x7f148419abf0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f147000d950 tx=0x7f147000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:49.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.877+0000 7f1481ffb640 1 -- 172.21.15.7:0/2087614382 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1470017070 con 0x7f1484102790 2024-09-19T04:26:49.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.877+0000 7f1481ffb640 1 -- 172.21.15.7:0/2087614382 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1470009c30 con 0x7f1484102790 2024-09-19T04:26:49.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.877+0000 7f148b075640 1 -- 172.21.15.7:0/2087614382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f148419f950 con 0x7f1484102790 2024-09-19T04:26:49.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.877+0000 7f1481ffb640 1 -- 172.21.15.7:0/2087614382 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147000f6b0 con 0x7f1484102790 2024-09-19T04:26:49.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.877+0000 7f148b075640 1 -- 172.21.15.7:0/2087614382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14841a7230 con 0x7f1484102790 2024-09-19T04:26:49.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.878+0000 7f148b075640 1 -- 172.21.15.7:0/2087614382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14841021c0 con 0x7f1484102790 2024-09-19T04:26:49.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.879+0000 7f1481ffb640 1 -- 172.21.15.7:0/2087614382 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f14700109d0 con 0x7f1484102790 2024-09-19T04:26:49.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.880+0000 7f1481ffb640 1 --2- 172.21.15.7:0/2087614382 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f14740a3240 0x7f14740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:49.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.881+0000 7f1488e11640 1 --2- 172.21.15.7:0/2087614382 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f14740a3240 0x7f14740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:49.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.881+0000 7f1481ffb640 1 -- 172.21.15.7:0/2087614382 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7f14700cf970 con 0x7f1484102790 2024-09-19T04:26:49.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.881+0000 7f1488e11640 1 --2- 172.21.15.7:0/2087614382 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f14740a3240 0x7f14740a5700 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1478000c00 tx=0x7f1478032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:49.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:49.885+0000 7f1481ffb640 1 -- 172.21.15.7:0/2087614382 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1470009de0 con 0x7f1484102790 2024-09-19T04:26:50.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:50.072+0000 7f148b075640 1 -- 172.21.15.7:0/2087614382 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f14841a7490 con 0x7f1484102790 2024-09-19T04:26:50.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:50.072+0000 7f1481ffb640 1 -- 172.21.15.7:0/2087614382 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) ==== 81+0+578 (secure 0 0 0) 0x7f147009c2c0 con 0x7f1484102790 2024-09-19T04:26:50.074 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/2883028938 2024-09-20T04:07:45.039922+0000 2024-09-19T04:26:50.074 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/1186412739 2024-09-20T04:07:45.039922+0000 2024-09-19T04:26:50.074 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6800/751091002 2024-09-20T04:07:45.039922+0000 2024-09-19T04:26:50.074 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6801/751091002 2024-09-20T04:07:45.039922+0000 2024-09-19T04:26:50.075 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6801/940106179 2024-09-20T04:07:20.364033+0000 2024-09-19T04:26:50.075 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6800/940106179 2024-09-20T04:07:20.364033+0000 2024-09-19T04:26:50.075 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/1450115700 2024-09-20T04:07:20.364033+0000 2024-09-19T04:26:50.075 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/2954294373 2024-09-20T04:07:20.364033+0000 2024-09-19T04:26:50.075 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/1996930242 2024-09-20T04:07:45.039922+0000 2024-09-19T04:26:50.075 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/3562231347 2024-09-20T04:07:20.364033+0000 2024-09-19T04:26:50.075 INFO:teuthology.orchestra.run.smithi007.stderr:listed 10 entries 2024-09-19T04:26:50.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:50.074+0000 7f148b075640 1 -- 172.21.15.7:0/2087614382 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f14740a3240 msgr2=0x7f14740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:50.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:50.074+0000 7f148b075640 1 --2- 172.21.15.7:0/2087614382 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f14740a3240 0x7f14740a5700 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1478000c00 tx=0x7f1478032c70 comp rx=0 tx=0).stop 2024-09-19T04:26:50.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:50.074+0000 7f148b075640 1 -- 172.21.15.7:0/2087614382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484102790 msgr2=0x7f148419abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:50.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:50.074+0000 7f148b075640 1 --2- 172.21.15.7:0/2087614382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484102790 0x7f148419abf0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f147000d950 tx=0x7f147000de10 comp rx=0 tx=0).stop 2024-09-19T04:26:50.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:50.075+0000 7f148b075640 1 -- 172.21.15.7:0/2087614382 shutdown_connections 2024-09-19T04:26:50.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:50.075+0000 7f148b075640 1 --2- 172.21.15.7:0/2087614382 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f14740a3240 0x7f14740a5700 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:50.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:50.075+0000 7f148b075640 1 --2- 172.21.15.7:0/2087614382 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1484106f10 0x7f148419ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:50.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:50.075+0000 7f148b075640 1 --2- 172.21.15.7:0/2087614382 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1484102790 0x7f148419abf0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:50.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:50.075+0000 7f148b075640 1 --2- 172.21.15.7:0/2087614382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1484101de0 0x7f148419a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:50.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:50.075+0000 7f148b075640 1 -- 172.21.15.7:0/2087614382 >> 172.21.15.7:0/2087614382 conn(0x7f14840fd8c0 msgr2=0x7f14840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:50.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:50.075+0000 7f148b075640 1 -- 172.21.15.7:0/2087614382 shutdown_connections 2024-09-19T04:26:50.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:50.075+0000 7f148b075640 1 -- 172.21.15.7:0/2087614382 wait complete. 2024-09-19T04:26:50.889 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T04:26:50.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:26:50.890 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T04:26:51.034 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-09-19T04:26:51.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:26:51.034 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T04:26:51.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:26:51.071 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-09-19T04:26:51.126 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:51 smithi007 ceph-mon[31360]: pgmap v652: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2024-09-19T04:26:51.127 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:51 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2087614382' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T04:26:51.156 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T04:26:51.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:26:51.157 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T04:26:51.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:26:51.254 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2024-09-19T04:26:51.296 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:51 smithi092 ceph-mon[34940]: pgmap v652: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2024-09-19T04:26:51.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:51 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2087614382' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T04:26:51.322 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T04:26:51.333 INFO:tasks.cephadm:Teardown begin 2024-09-19T04:26:51.333 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T04:26:51.333 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:26:51.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:51 smithi102 ceph-mon[35446]: pgmap v652: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 170 B/s wr, 12 op/s 2024-09-19T04:26:51.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:51 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2087614382' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T04:26:51.594 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:26:52.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.220+0000 7fd84304a640 1 -- 172.21.15.7:0/139711433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd83c101420 msgr2=0x7fd83c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:52.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.220+0000 7fd84304a640 1 --2- 172.21.15.7:0/139711433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd83c101420 0x7fd83c10d950 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd834009cd0 tx=0x7fd83402a8e0 comp rx=0 tx=0).stop 2024-09-19T04:26:52.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.220+0000 7fd84304a640 1 -- 172.21.15.7:0/139711433 shutdown_connections 2024-09-19T04:26:52.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.220+0000 7fd84304a640 1 --2- 172.21.15.7:0/139711433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd83c101420 0x7fd83c10d950 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:52.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.220+0000 7fd84304a640 1 --2- 172.21.15.7:0/139711433 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd83c100a80 0x7fd83c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:52.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.220+0000 7fd84304a640 1 --2- 172.21.15.7:0/139711433 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd83c106a80 0x7fd83c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:52.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.220+0000 7fd84304a640 1 -- 172.21.15.7:0/139711433 >> 172.21.15.7:0/139711433 conn(0x7fd83c0fc7a0 msgr2=0x7fd83c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:52.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.220+0000 7fd84304a640 1 -- 172.21.15.7:0/139711433 shutdown_connections 2024-09-19T04:26:52.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.220+0000 7fd84304a640 1 -- 172.21.15.7:0/139711433 wait complete. 2024-09-19T04:26:52.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.221+0000 7fd84304a640 1 Processor -- start 2024-09-19T04:26:52.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.221+0000 7fd84304a640 1 -- start start 2024-09-19T04:26:52.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.221+0000 7fd84304a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd83c100a80 0x7fd83c198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:52.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.221+0000 7fd84304a640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd83c101420 0x7fd83c198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:52.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.221+0000 7fd84304a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd83c106a80 0x7fd83c19ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:52.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.221+0000 7fd84304a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c110f20 con 0x7fd83c106a80 2024-09-19T04:26:52.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.221+0000 7fd84304a640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c110da0 con 0x7fd83c101420 2024-09-19T04:26:52.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.221+0000 7fd84304a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd83c1110a0 con 0x7fd83c100a80 2024-09-19T04:26:52.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.221+0000 7fd8415e7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd83c106a80 0x7fd83c19ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:52.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.221+0000 7fd8415e7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd83c106a80 0x7fd83c19ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47064/0 (socket says 172.21.15.7:47064) 2024-09-19T04:26:52.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.221+0000 7fd8415e7640 1 -- 172.21.15.7:0/1745180226 learned_addr learned my addr 172.21.15.7:0/1745180226 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:26:52.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.221+0000 7fd833fff640 1 --2- 172.21.15.7:0/1745180226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd83c101420 0x7fd83c198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:52.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.221+0000 7fd840de6640 1 --2- 172.21.15.7:0/1745180226 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd83c100a80 0x7fd83c198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:52.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.221+0000 7fd8415e7640 1 -- 172.21.15.7:0/1745180226 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd83c100a80 msgr2=0x7fd83c198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:52.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.221+0000 7fd8415e7640 1 --2- 172.21.15.7:0/1745180226 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd83c100a80 0x7fd83c198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:52.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.221+0000 7fd8415e7640 1 -- 172.21.15.7:0/1745180226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd83c101420 msgr2=0x7fd83c198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:52.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.221+0000 7fd8415e7640 1 --2- 172.21.15.7:0/1745180226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd83c101420 0x7fd83c198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:52.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.221+0000 7fd8415e7640 1 -- 172.21.15.7:0/1745180226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd83c19d510 con 0x7fd83c106a80 2024-09-19T04:26:52.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.222+0000 7fd8415e7640 1 --2- 172.21.15.7:0/1745180226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd83c106a80 0x7fd83c19ce30 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fd834006010 tx=0x7fd834003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:52.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.222+0000 7fd831ffb640 1 -- 172.21.15.7:0/1745180226 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd834004450 con 0x7fd83c106a80 2024-09-19T04:26:52.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.222+0000 7fd831ffb640 1 -- 172.21.15.7:0/1745180226 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd834003e10 con 0x7fd83c106a80 2024-09-19T04:26:52.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.222+0000 7fd831ffb640 1 -- 172.21.15.7:0/1745180226 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8340466e0 con 0x7fd83c106a80 2024-09-19T04:26:52.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.222+0000 7fd84304a640 1 -- 172.21.15.7:0/1745180226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd83c19d7a0 con 0x7fd83c106a80 2024-09-19T04:26:52.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.222+0000 7fd84304a640 1 -- 172.21.15.7:0/1745180226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd83c1a50e0 con 0x7fd83c106a80 2024-09-19T04:26:52.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.223+0000 7fd84304a640 1 -- 172.21.15.7:0/1745180226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd83c100f60 con 0x7fd83c106a80 2024-09-19T04:26:52.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.224+0000 7fd831ffb640 1 -- 172.21.15.7:0/1745180226 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fd8340305a0 con 0x7fd83c106a80 2024-09-19T04:26:52.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.225+0000 7fd831ffb640 1 --2- 172.21.15.7:0/1745180226 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd8240a32c0 0x7fd8240a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:52.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.225+0000 7fd840de6640 1 --2- 172.21.15.7:0/1745180226 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd8240a32c0 0x7fd8240a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:52.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.225+0000 7fd831ffb640 1 -- 172.21.15.7:0/1745180226 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fd83402e030 con 0x7fd83c106a80 2024-09-19T04:26:52.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.226+0000 7fd840de6640 1 --2- 172.21.15.7:0/1745180226 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd8240a32c0 0x7fd8240a5780 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd838009890 tx=0x7fd838008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:52.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.229+0000 7fd831ffb640 1 -- 172.21.15.7:0/1745180226 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd83404b060 con 0x7fd83c106a80 2024-09-19T04:26:52.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.443+0000 7fd84304a640 1 -- 172.21.15.7:0/1745180226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd83c10a020 con 0x7fd83c106a80 2024-09-19T04:26:52.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.444+0000 7fd831ffb640 1 -- 172.21.15.7:0/1745180226 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+11967 (secure 0 0 0) 0x7fd8340be020 con 0x7fd83c106a80 2024-09-19T04:26:52.446 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:26:52.446 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":44,"btime":"2024-09-19T04:26:18:827298+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":25972,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3968218417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3968218417},{"type":"v1","addr":"172.21.15.92:6835","nonce":3968218417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":44,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:26:18.414223+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24496,"mds_2":24482,"mds_3":24478,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14541":{"gid":14541,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24472,24478,24482,24496,24506]},"id":1}]} 2024-09-19T04:26:52.446 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 44 2024-09-19T04:26:52.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.446+0000 7fd84304a640 1 -- 172.21.15.7:0/1745180226 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd8240a32c0 msgr2=0x7fd8240a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:52.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.446+0000 7fd84304a640 1 --2- 172.21.15.7:0/1745180226 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd8240a32c0 0x7fd8240a5780 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd838009890 tx=0x7fd838008040 comp rx=0 tx=0).stop 2024-09-19T04:26:52.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.446+0000 7fd84304a640 1 -- 172.21.15.7:0/1745180226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd83c106a80 msgr2=0x7fd83c19ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:52.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.446+0000 7fd84304a640 1 --2- 172.21.15.7:0/1745180226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd83c106a80 0x7fd83c19ce30 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fd834006010 tx=0x7fd834003c20 comp rx=0 tx=0).stop 2024-09-19T04:26:52.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.446+0000 7fd84304a640 1 -- 172.21.15.7:0/1745180226 shutdown_connections 2024-09-19T04:26:52.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.446+0000 7fd84304a640 1 --2- 172.21.15.7:0/1745180226 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fd8240a32c0 0x7fd8240a5780 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:52.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.446+0000 7fd84304a640 1 --2- 172.21.15.7:0/1745180226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd83c106a80 0x7fd83c19ce30 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:52.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.446+0000 7fd84304a640 1 --2- 172.21.15.7:0/1745180226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd83c101420 0x7fd83c198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:52.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.446+0000 7fd84304a640 1 --2- 172.21.15.7:0/1745180226 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd83c100a80 0x7fd83c198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:52.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.446+0000 7fd84304a640 1 -- 172.21.15.7:0/1745180226 >> 172.21.15.7:0/1745180226 conn(0x7fd83c0fc7a0 msgr2=0x7fd83c06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:52.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.447+0000 7fd84304a640 1 -- 172.21.15.7:0/1745180226 shutdown_connections 2024-09-19T04:26:52.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:52.447+0000 7fd84304a640 1 -- 172.21.15.7:0/1745180226 wait complete. 2024-09-19T04:26:53.092 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:26:53.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:53 smithi092 ceph-mon[34940]: pgmap v653: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-19T04:26:53.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:53 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1745180226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:26:53.357 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:26:53.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:53 smithi007 ceph-mon[31360]: pgmap v653: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-19T04:26:53.376 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:53 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1745180226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:26:53.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:53 smithi102 ceph-mon[35446]: pgmap v653: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-19T04:26:53.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:53 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1745180226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:26:53.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.841+0000 7effe667c640 1 -- 172.21.15.7:0/3407418447 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe0102d30 msgr2=0x7effe0103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:53.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.841+0000 7effe667c640 1 --2- 172.21.15.7:0/3407418447 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe0102d30 0x7effe0103110 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7effd0009930 tx=0x7effd002a420 comp rx=0 tx=0).stop 2024-09-19T04:26:53.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.841+0000 7effe667c640 1 -- 172.21.15.7:0/3407418447 shutdown_connections 2024-09-19T04:26:53.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.841+0000 7effe667c640 1 --2- 172.21.15.7:0/3407418447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effe01082a0 0x7effe010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:53.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.841+0000 7effe667c640 1 --2- 172.21.15.7:0/3407418447 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effe01036e0 0x7effe0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:53.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.841+0000 7effe667c640 1 --2- 172.21.15.7:0/3407418447 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe0102d30 0x7effe0103110 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:53.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.841+0000 7effe667c640 1 -- 172.21.15.7:0/3407418447 >> 172.21.15.7:0/3407418447 conn(0x7effe00fc7d0 msgr2=0x7effe00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:53.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.841+0000 7effe667c640 1 -- 172.21.15.7:0/3407418447 shutdown_connections 2024-09-19T04:26:53.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.841+0000 7effe667c640 1 -- 172.21.15.7:0/3407418447 wait complete. 2024-09-19T04:26:53.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.842+0000 7effe667c640 1 Processor -- start 2024-09-19T04:26:53.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.842+0000 7effe667c640 1 -- start start 2024-09-19T04:26:53.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.842+0000 7effe667c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effe0102d30 0x7effe0100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:53.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.842+0000 7effe667c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe01036e0 0x7effe0100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:53.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.842+0000 7effe667c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effe01082a0 0x7effe0101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:53.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.842+0000 7effe667c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7effe01120a0 con 0x7effe01036e0 2024-09-19T04:26:53.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.842+0000 7effe667c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7effe0111f20 con 0x7effe0102d30 2024-09-19T04:26:53.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.842+0000 7effe667c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7effe0112220 con 0x7effe01082a0 2024-09-19T04:26:53.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.842+0000 7effd7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe01036e0 0x7effe0100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:53.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.842+0000 7effd7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe01036e0 0x7effe0100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47076/0 (socket says 172.21.15.7:47076) 2024-09-19T04:26:53.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.842+0000 7effd7fff640 1 -- 172.21.15.7:0/401743108 learned_addr learned my addr 172.21.15.7:0/401743108 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:26:53.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.842+0000 7effdffff640 1 --2- 172.21.15.7:0/401743108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effe0102d30 0x7effe0100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:53.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.842+0000 7effe4c19640 1 --2- 172.21.15.7:0/401743108 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effe01082a0 0x7effe0101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:53.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.842+0000 7effd7fff640 1 -- 172.21.15.7:0/401743108 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effe01082a0 msgr2=0x7effe0101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:53.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.842+0000 7effd7fff640 1 --2- 172.21.15.7:0/401743108 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effe01082a0 0x7effe0101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:53.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.842+0000 7effd7fff640 1 -- 172.21.15.7:0/401743108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effe0102d30 msgr2=0x7effe0100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:53.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.842+0000 7effd7fff640 1 --2- 172.21.15.7:0/401743108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effe0102d30 0x7effe0100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:53.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.842+0000 7effd7fff640 1 -- 172.21.15.7:0/401743108 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe01a6aa0 con 0x7effe01036e0 2024-09-19T04:26:53.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.842+0000 7effd7fff640 1 --2- 172.21.15.7:0/401743108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe01036e0 0x7effe0100ed0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7effc800e9c0 tx=0x7effc800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:53.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.843+0000 7effddffb640 1 -- 172.21.15.7:0/401743108 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc800ccc0 con 0x7effe01036e0 2024-09-19T04:26:53.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.843+0000 7effddffb640 1 -- 172.21.15.7:0/401743108 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effc8005500 con 0x7effe01036e0 2024-09-19T04:26:53.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.843+0000 7effe667c640 1 -- 172.21.15.7:0/401743108 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effe01a6d90 con 0x7effe01036e0 2024-09-19T04:26:53.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.843+0000 7effddffb640 1 -- 172.21.15.7:0/401743108 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc8010690 con 0x7effe01036e0 2024-09-19T04:26:53.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.843+0000 7effe667c640 1 -- 172.21.15.7:0/401743108 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effe01a7270 con 0x7effe01036e0 2024-09-19T04:26:53.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.844+0000 7effe667c640 1 -- 172.21.15.7:0/401743108 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effe006a850 con 0x7effe01036e0 2024-09-19T04:26:53.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.846+0000 7effddffb640 1 -- 172.21.15.7:0/401743108 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7effc8004e80 con 0x7effe01036e0 2024-09-19T04:26:53.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.847+0000 7effddffb640 1 --2- 172.21.15.7:0/401743108 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7effcc0a32c0 0x7effcc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:53.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.847+0000 7effdffff640 1 --2- 172.21.15.7:0/401743108 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7effcc0a32c0 0x7effcc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:53.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.847+0000 7effddffb640 1 -- 172.21.15.7:0/401743108 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7effc80d02f0 con 0x7effe01036e0 2024-09-19T04:26:53.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.847+0000 7effdffff640 1 --2- 172.21.15.7:0/401743108 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7effcc0a32c0 0x7effcc0a5780 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7effd0009900 tx=0x7effd00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:53.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:53.849+0000 7effddffb640 1 -- 172.21.15.7:0/401743108 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7effc8054210 con 0x7effe01036e0 2024-09-19T04:26:54.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:54.063+0000 7effe667c640 1 -- 172.21.15.7:0/401743108 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7effe0103110 con 0x7effe01036e0 2024-09-19T04:26:54.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:54.063+0000 7effddffb640 1 -- 172.21.15.7:0/401743108 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+11967 (secure 0 0 0) 0x7effe0103110 con 0x7effe01036e0 2024-09-19T04:26:54.065 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:26:54.065 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":44,"btime":"2024-09-19T04:26:18:827298+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2094187873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2094187873},{"type":"v1","addr":"172.21.15.7:6835","nonce":2094187873}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":25972,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/3968218417","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":3968218417},{"type":"v1","addr":"172.21.15.92:6835","nonce":3968218417}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":44,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:14:34.007803+0000","modified":"2024-09-19T04:26:18.414223+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24496,"mds_2":24482,"mds_3":24478,"mds_4":24472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14541":{"gid":14541,"name":"d","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6837/1197784412","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":1197784412},{"type":"v1","addr":"172.21.15.7:6837","nonce":1197784412}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14583":{"gid":14583,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6839/2492396165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":2492396165},{"type":"v1","addr":"172.21.15.7:6839","nonce":2492396165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14595":{"gid":14595,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.7:6841/4142126419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":4142126419},{"type":"v1","addr":"172.21.15.7:6841","nonce":4142126419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.102:6833/3063042931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3063042931},{"type":"v1","addr":"172.21.15.102:6833","nonce":3063042931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.92:6833/4006669352","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":4006669352},{"type":"v1","addr":"172.21.15.92:6833","nonce":4006669352}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24472":{"gid":24472,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":19,"addr":"172.21.15.102:6835/1756454579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1756454579},{"type":"v1","addr":"172.21.15.102:6835","nonce":1756454579}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":18,"addr":"172.21.15.102:6837/618291553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":618291553},{"type":"v1","addr":"172.21.15.102:6837","nonce":618291553}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":17,"addr":"172.21.15.92:6837/319779585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":319779585},{"type":"v1","addr":"172.21.15.92:6837","nonce":319779585}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24496":{"gid":24496,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":16,"addr":"172.21.15.102:6839/2728093829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":2728093829},{"type":"v1","addr":"172.21.15.102:6839","nonce":2728093829}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.92:6839/3805481296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":3805481296},{"type":"v1","addr":"172.21.15.92:6839","nonce":3805481296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24472,24478,24482,24496,24506]},"id":1}]} 2024-09-19T04:26:54.066 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 44 2024-09-19T04:26:54.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:54.066+0000 7effe667c640 1 -- 172.21.15.7:0/401743108 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7effcc0a32c0 msgr2=0x7effcc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:54.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:54.066+0000 7effe667c640 1 --2- 172.21.15.7:0/401743108 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7effcc0a32c0 0x7effcc0a5780 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7effd0009900 tx=0x7effd00058d0 comp rx=0 tx=0).stop 2024-09-19T04:26:54.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:54.066+0000 7effe667c640 1 -- 172.21.15.7:0/401743108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe01036e0 msgr2=0x7effe0100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:54.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:54.066+0000 7effe667c640 1 --2- 172.21.15.7:0/401743108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe01036e0 0x7effe0100ed0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7effc800e9c0 tx=0x7effc800ee80 comp rx=0 tx=0).stop 2024-09-19T04:26:54.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:54.066+0000 7effe667c640 1 -- 172.21.15.7:0/401743108 shutdown_connections 2024-09-19T04:26:54.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:54.066+0000 7effe667c640 1 --2- 172.21.15.7:0/401743108 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7effcc0a32c0 0x7effcc0a5780 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:54.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:54.066+0000 7effe667c640 1 --2- 172.21.15.7:0/401743108 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effe01082a0 0x7effe0101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:54.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:54.066+0000 7effe667c640 1 --2- 172.21.15.7:0/401743108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe01036e0 0x7effe0100ed0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:54.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:54.066+0000 7effe667c640 1 --2- 172.21.15.7:0/401743108 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effe0102d30 0x7effe0100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:54.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:54.066+0000 7effe667c640 1 -- 172.21.15.7:0/401743108 >> 172.21.15.7:0/401743108 conn(0x7effe00fc7d0 msgr2=0x7effe0105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:54.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:54.066+0000 7effe667c640 1 -- 172.21.15.7:0/401743108 shutdown_connections 2024-09-19T04:26:54.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:54.066+0000 7effe667c640 1 -- 172.21.15.7:0/401743108 wait complete. 2024-09-19T04:26:55.129 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:26:55.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:55 smithi092 ceph-mon[34940]: pgmap v654: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-19T04:26:55.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:55 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/401743108' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:26:55.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:55 smithi007 ceph-mon[31360]: pgmap v654: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-19T04:26:55.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:55 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/401743108' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:26:55.395 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:26:55.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:55 smithi102 ceph-mon[35446]: pgmap v654: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-19T04:26:55.408 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:55 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/401743108' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:26:55.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.891+0000 7ffb7a5f3640 1 -- 172.21.15.7:0/3353433543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb741000d0 msgr2=0x7ffb74100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:55.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.891+0000 7ffb7a5f3640 1 --2- 172.21.15.7:0/3353433543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb741000d0 0x7ffb74100530 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c009900 tx=0x7ffb5c02a410 comp rx=0 tx=0).stop 2024-09-19T04:26:55.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.891+0000 7ffb7a5f3640 1 -- 172.21.15.7:0/3353433543 shutdown_connections 2024-09-19T04:26:55.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.891+0000 7ffb7a5f3640 1 --2- 172.21.15.7:0/3353433543 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb74100a70 0x7ffb7410ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:55.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.891+0000 7ffb7a5f3640 1 --2- 172.21.15.7:0/3353433543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb741000d0 0x7ffb74100530 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:55.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.891+0000 7ffb7a5f3640 1 --2- 172.21.15.7:0/3353433543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb74106ba0 0x7ffb74106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:55.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.891+0000 7ffb7a5f3640 1 -- 172.21.15.7:0/3353433543 >> 172.21.15.7:0/3353433543 conn(0x7ffb74077210 msgr2=0x7ffb740fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:55.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.892+0000 7ffb7a5f3640 1 -- 172.21.15.7:0/3353433543 shutdown_connections 2024-09-19T04:26:55.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.892+0000 7ffb7a5f3640 1 -- 172.21.15.7:0/3353433543 wait complete. 2024-09-19T04:26:55.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.892+0000 7ffb7a5f3640 1 Processor -- start 2024-09-19T04:26:55.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.892+0000 7ffb7a5f3640 1 -- start start 2024-09-19T04:26:55.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.892+0000 7ffb7a5f3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb741000d0 0x7ffb74198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:55.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.892+0000 7ffb7a5f3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb74100a70 0x7ffb74198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:55.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.892+0000 7ffb7a5f3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb74106ba0 0x7ffb7419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:55.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.892+0000 7ffb7a5f3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffb74112100 con 0x7ffb741000d0 2024-09-19T04:26:55.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.892+0000 7ffb7a5f3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffb74111f80 con 0x7ffb74100a70 2024-09-19T04:26:55.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.892+0000 7ffb7a5f3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffb74112280 con 0x7ffb74106ba0 2024-09-19T04:26:55.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.892+0000 7ffb73fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb741000d0 0x7ffb74198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:55.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.893+0000 7ffb73fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb741000d0 0x7ffb74198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47090/0 (socket says 172.21.15.7:47090) 2024-09-19T04:26:55.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.893+0000 7ffb73fff640 1 -- 172.21.15.7:0/2447427632 learned_addr learned my addr 172.21.15.7:0/2447427632 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:26:55.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.893+0000 7ffb6bfff640 1 --2- 172.21.15.7:0/2447427632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb74100a70 0x7ffb74198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:55.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.893+0000 7ffb78b90640 1 --2- 172.21.15.7:0/2447427632 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb74106ba0 0x7ffb7419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:55.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.893+0000 7ffb73fff640 1 -- 172.21.15.7:0/2447427632 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb74106ba0 msgr2=0x7ffb7419ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:55.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.893+0000 7ffb73fff640 1 --2- 172.21.15.7:0/2447427632 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb74106ba0 0x7ffb7419ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:55.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.893+0000 7ffb73fff640 1 -- 172.21.15.7:0/2447427632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb74100a70 msgr2=0x7ffb74198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:55.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.893+0000 7ffb73fff640 1 --2- 172.21.15.7:0/2447427632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb74100a70 0x7ffb74198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:55.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.893+0000 7ffb73fff640 1 -- 172.21.15.7:0/2447427632 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb7419d4f0 con 0x7ffb741000d0 2024-09-19T04:26:55.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.893+0000 7ffb73fff640 1 --2- 172.21.15.7:0/2447427632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb741000d0 0x7ffb74198540 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400b4a0 tx=0x7ffb6400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:55.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.893+0000 7ffb71ffb640 1 -- 172.21.15.7:0/2447427632 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb64014070 con 0x7ffb741000d0 2024-09-19T04:26:55.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.893+0000 7ffb7a5f3640 1 -- 172.21.15.7:0/2447427632 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb7419d7e0 con 0x7ffb741000d0 2024-09-19T04:26:55.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.893+0000 7ffb71ffb640 1 -- 172.21.15.7:0/2447427632 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb64010af0 con 0x7ffb741000d0 2024-09-19T04:26:55.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.893+0000 7ffb71ffb640 1 -- 172.21.15.7:0/2447427632 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb64017d10 con 0x7ffb741000d0 2024-09-19T04:26:55.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.893+0000 7ffb7a5f3640 1 -- 172.21.15.7:0/2447427632 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb741a50c0 con 0x7ffb741000d0 2024-09-19T04:26:55.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.894+0000 7ffb7a5f3640 1 -- 172.21.15.7:0/2447427632 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb74100530 con 0x7ffb741000d0 2024-09-19T04:26:55.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.896+0000 7ffb71ffb640 1 -- 172.21.15.7:0/2447427632 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7ffb64017070 con 0x7ffb741000d0 2024-09-19T04:26:55.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.896+0000 7ffb71ffb640 1 --2- 172.21.15.7:0/2447427632 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffb600a3240 0x7ffb600a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:55.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.896+0000 7ffb71ffb640 1 -- 172.21.15.7:0/2447427632 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7ffb640cf040 con 0x7ffb741000d0 2024-09-19T04:26:55.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.896+0000 7ffb6bfff640 1 --2- 172.21.15.7:0/2447427632 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffb600a3240 0x7ffb600a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:55.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.897+0000 7ffb6bfff640 1 --2- 172.21.15.7:0/2447427632 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffb600a3240 0x7ffb600a5700 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c000c00 tx=0x7ffb5c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:55.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:55.901+0000 7ffb71ffb640 1 -- 172.21.15.7:0/2447427632 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffb6409b300 con 0x7ffb741000d0 2024-09-19T04:26:56.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:56.078+0000 7ffb7a5f3640 1 -- 172.21.15.7:0/2447427632 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffb741a5290 con 0x7ffb741000d0 2024-09-19T04:26:56.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:56.080+0000 7ffb71ffb640 1 -- 172.21.15.7:0/2447427632 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24861 (secure 0 0 0) 0x7ffb6409f600 con 0x7ffb741000d0 2024-09-19T04:26:56.082 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-19T04:26:56.082 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":90,"fsid":"77957c0a-763c-11ef-bceb-c7b262605968","created":"2024-09-19T04:06:58.337394+0000","modified":"2024-09-19T04:16:47.053920+0000","last_up_change":"2024-09-19T04:13:42.312137+0000","last_in_change":"2024-09-19T04:13:18.757925+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:09:59.544984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:14:30.225637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:14:32.252497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-19T04:14:38.781821+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d9b93bd5-ee22-4fb0-ba29-bfa208430a86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6803","nonce":240599233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6805","nonce":240599233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6809","nonce":240599233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":240599233},{"type":"v1","addr":"172.21.15.7:6807","nonce":240599233}]},"public_addr":"172.21.15.7:6803/240599233","cluster_addr":"172.21.15.7:6805/240599233","heartbeat_back_addr":"172.21.15.7:6809/240599233","heartbeat_front_addr":"172.21.15.7:6807/240599233","state":["exists","up"]},{"osd":1,"uuid":"db5793e6-f3ad-4075-a02b-206bf7f1e59a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6801","nonce":902403333}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6803","nonce":902403333}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6807","nonce":902403333}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":902403333},{"type":"v1","addr":"172.21.15.92:6805","nonce":902403333}]},"public_addr":"172.21.15.92:6801/902403333","cluster_addr":"172.21.15.92:6803/902403333","heartbeat_back_addr":"172.21.15.92:6807/902403333","heartbeat_front_addr":"172.21.15.92:6805/902403333","state":["exists","up"]},{"osd":2,"uuid":"1eb83a1b-82d8-4983-bae3-b161adb3a33a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6801","nonce":2078441772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6803","nonce":2078441772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6807","nonce":2078441772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":2078441772},{"type":"v1","addr":"172.21.15.102:6805","nonce":2078441772}]},"public_addr":"172.21.15.102:6801/2078441772","cluster_addr":"172.21.15.102:6803/2078441772","heartbeat_back_addr":"172.21.15.102:6807/2078441772","heartbeat_front_addr":"172.21.15.102:6805/2078441772","state":["exists","up"]},{"osd":3,"uuid":"68ba79e5-bcf0-4349-9e14-42f2fa9c11b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6811","nonce":2729561132}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6813","nonce":2729561132}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6817","nonce":2729561132}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":2729561132},{"type":"v1","addr":"172.21.15.7:6815","nonce":2729561132}]},"public_addr":"172.21.15.7:6811/2729561132","cluster_addr":"172.21.15.7:6813/2729561132","heartbeat_back_addr":"172.21.15.7:6817/2729561132","heartbeat_front_addr":"172.21.15.7:6815/2729561132","state":["exists","up"]},{"osd":4,"uuid":"f20d4a51-121f-4ac8-afeb-5962d83bd697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6809","nonce":2799734294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6811","nonce":2799734294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6815","nonce":2799734294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2799734294},{"type":"v1","addr":"172.21.15.92:6813","nonce":2799734294}]},"public_addr":"172.21.15.92:6809/2799734294","cluster_addr":"172.21.15.92:6811/2799734294","heartbeat_back_addr":"172.21.15.92:6815/2799734294","heartbeat_front_addr":"172.21.15.92:6813/2799734294","state":["exists","up"]},{"osd":5,"uuid":"aac02b0a-99dc-4457-8898-c68dc196517a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6809","nonce":3099678146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6811","nonce":3099678146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6815","nonce":3099678146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":3099678146},{"type":"v1","addr":"172.21.15.102:6813","nonce":3099678146}]},"public_addr":"172.21.15.102:6809/3099678146","cluster_addr":"172.21.15.102:6811/3099678146","heartbeat_back_addr":"172.21.15.102:6815/3099678146","heartbeat_front_addr":"172.21.15.102:6813/3099678146","state":["exists","up"]},{"osd":6,"uuid":"7e5a8b30-8406-486c-ace5-79158a3757a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6819","nonce":1569704304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6821","nonce":1569704304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6825","nonce":1569704304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1569704304},{"type":"v1","addr":"172.21.15.7:6823","nonce":1569704304}]},"public_addr":"172.21.15.7:6819/1569704304","cluster_addr":"172.21.15.7:6821/1569704304","heartbeat_back_addr":"172.21.15.7:6825/1569704304","heartbeat_front_addr":"172.21.15.7:6823/1569704304","state":["exists","up"]},{"osd":7,"uuid":"e6a7049a-17a1-43b2-8ecd-5f4ca7c337be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6817","nonce":3411102480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6819","nonce":3411102480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6823","nonce":3411102480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":3411102480},{"type":"v1","addr":"172.21.15.92:6821","nonce":3411102480}]},"public_addr":"172.21.15.92:6817/3411102480","cluster_addr":"172.21.15.92:6819/3411102480","heartbeat_back_addr":"172.21.15.92:6823/3411102480","heartbeat_front_addr":"172.21.15.92:6821/3411102480","state":["exists","up"]},{"osd":8,"uuid":"31879baa-861d-4322-990f-0b9a42b8b610","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6817","nonce":2990859925}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6819","nonce":2990859925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6823","nonce":2990859925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":2990859925},{"type":"v1","addr":"172.21.15.102:6821","nonce":2990859925}]},"public_addr":"172.21.15.102:6817/2990859925","cluster_addr":"172.21.15.102:6819/2990859925","heartbeat_back_addr":"172.21.15.102:6823/2990859925","heartbeat_front_addr":"172.21.15.102:6821/2990859925","state":["exists","up"]},{"osd":9,"uuid":"6d65db33-926c-4a6e-a072-707e9c9de92a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6827","nonce":1710319475}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6829","nonce":1710319475}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6833","nonce":1710319475}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":1710319475},{"type":"v1","addr":"172.21.15.7:6831","nonce":1710319475}]},"public_addr":"172.21.15.7:6827/1710319475","cluster_addr":"172.21.15.7:6829/1710319475","heartbeat_back_addr":"172.21.15.7:6833/1710319475","heartbeat_front_addr":"172.21.15.7:6831/1710319475","state":["exists","up"]},{"osd":10,"uuid":"9ab681ee-0bef-47bd-bf3d-20b17c6b870c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6825","nonce":1063265541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6827","nonce":1063265541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6831","nonce":1063265541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":1063265541},{"type":"v1","addr":"172.21.15.92:6829","nonce":1063265541}]},"public_addr":"172.21.15.92:6825/1063265541","cluster_addr":"172.21.15.92:6827/1063265541","heartbeat_back_addr":"172.21.15.92:6831/1063265541","heartbeat_front_addr":"172.21.15.92:6829/1063265541","state":["exists","up"]},{"osd":11,"uuid":"dc398e14-5f9e-4f0a-b158-35cbc1f73a83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6825","nonce":1175425599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6827","nonce":1175425599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6831","nonce":1175425599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":1175425599},{"type":"v1","addr":"172.21.15.102:6829","nonce":1175425599}]},"public_addr":"172.21.15.102:6825/1175425599","cluster_addr":"172.21.15.102:6827/1175425599","heartbeat_back_addr":"172.21.15.102:6831/1175425599","heartbeat_front_addr":"172.21.15.102:6829/1175425599","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:07.857319+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:31.430120+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:09:56.892301+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:10:22.011884+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:10:46.326025+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:11:10.339084+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:11:35.365906+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:01.104309+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:25.717295+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:12:51.387644+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:13:15.076355+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:13:40.253150+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9},{"from":5,"to":8}]},{"pgid":"3.c","mappings":[{"from":5,"to":6}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.18","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1d","mappings":[{"from":5,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/2883028938":"2024-09-20T04:07:45.039922+0000","172.21.15.7:0/1186412739":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6800/751091002":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6801/751091002":"2024-09-20T04:07:45.039922+0000","172.21.15.7:6801/940106179":"2024-09-20T04:07:20.364033+0000","172.21.15.7:6800/940106179":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/1450115700":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/2954294373":"2024-09-20T04:07:20.364033+0000","172.21.15.7:0/1996930242":"2024-09-20T04:07:45.039922+0000","172.21.15.7:0/3562231347":"2024-09-20T04:07:20.364033+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:26:56.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:56.082+0000 7ffb7a5f3640 1 -- 172.21.15.7:0/2447427632 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffb600a3240 msgr2=0x7ffb600a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:56.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:56.082+0000 7ffb7a5f3640 1 --2- 172.21.15.7:0/2447427632 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffb600a3240 0x7ffb600a5700 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c000c00 tx=0x7ffb5c005b50 comp rx=0 tx=0).stop 2024-09-19T04:26:56.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:56.082+0000 7ffb7a5f3640 1 -- 172.21.15.7:0/2447427632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb741000d0 msgr2=0x7ffb74198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:56.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:56.082+0000 7ffb7a5f3640 1 --2- 172.21.15.7:0/2447427632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb741000d0 0x7ffb74198540 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400b4a0 tx=0x7ffb6400b960 comp rx=0 tx=0).stop 2024-09-19T04:26:56.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:56.082+0000 7ffb7a5f3640 1 -- 172.21.15.7:0/2447427632 shutdown_connections 2024-09-19T04:26:56.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:56.082+0000 7ffb7a5f3640 1 --2- 172.21.15.7:0/2447427632 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7ffb600a3240 0x7ffb600a5700 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:56.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:56.082+0000 7ffb7a5f3640 1 --2- 172.21.15.7:0/2447427632 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb74106ba0 0x7ffb7419ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:56.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:56.082+0000 7ffb7a5f3640 1 --2- 172.21.15.7:0/2447427632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb74100a70 0x7ffb74198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:56.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:56.082+0000 7ffb7a5f3640 1 --2- 172.21.15.7:0/2447427632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb741000d0 0x7ffb74198540 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:56.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:56.082+0000 7ffb7a5f3640 1 -- 172.21.15.7:0/2447427632 >> 172.21.15.7:0/2447427632 conn(0x7ffb74077210 msgr2=0x7ffb74104b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:56.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:56.082+0000 7ffb7a5f3640 1 -- 172.21.15.7:0/2447427632 shutdown_connections 2024-09-19T04:26:56.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:56.082+0000 7ffb7a5f3640 1 -- 172.21.15.7:0/2447427632 wait complete. 2024-09-19T04:26:56.961 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-19T04:26:57.224 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:26:57.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:57 smithi092 ceph-mon[34940]: pgmap v655: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T04:26:57.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:57 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2447427632' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:26:57.345 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:57 smithi007 ceph-mon[31360]: pgmap v655: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T04:26:57.345 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:57 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2447427632' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:26:57.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:57 smithi102 ceph-mon[35446]: pgmap v655: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T04:26:57.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:57 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2447427632' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:26:57.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.727+0000 7fedcd5c7640 1 -- 172.21.15.7:0/1964603405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fedc8102790 msgr2=0x7fedc81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:57.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.727+0000 7fedcd5c7640 1 --2- 172.21.15.7:0/1964603405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fedc8102790 0x7fedc81067e0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fedb0009900 tx=0x7fedb002a410 comp rx=0 tx=0).stop 2024-09-19T04:26:57.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.727+0000 7fedcd5c7640 1 -- 172.21.15.7:0/1964603405 shutdown_connections 2024-09-19T04:26:57.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.727+0000 7fedcd5c7640 1 --2- 172.21.15.7:0/1964603405 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fedc8106f10 0x7fedc810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:57.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.727+0000 7fedcd5c7640 1 --2- 172.21.15.7:0/1964603405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fedc8102790 0x7fedc81067e0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:57.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.727+0000 7fedcd5c7640 1 --2- 172.21.15.7:0/1964603405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fedc8101de0 0x7fedc81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:57.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.727+0000 7fedcd5c7640 1 -- 172.21.15.7:0/1964603405 >> 172.21.15.7:0/1964603405 conn(0x7fedc80fd8c0 msgr2=0x7fedc80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:57.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.727+0000 7fedcd5c7640 1 -- 172.21.15.7:0/1964603405 shutdown_connections 2024-09-19T04:26:57.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.727+0000 7fedcd5c7640 1 -- 172.21.15.7:0/1964603405 wait complete. 2024-09-19T04:26:57.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.728+0000 7fedcd5c7640 1 Processor -- start 2024-09-19T04:26:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.728+0000 7fedcd5c7640 1 -- start start 2024-09-19T04:26:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.728+0000 7fedcd5c7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fedc8101de0 0x7fedc8198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.728+0000 7fedcd5c7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fedc8102790 0x7fedc81989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.728+0000 7fedcd5c7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fedc8106f10 0x7fedc819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.728+0000 7fedcd5c7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fedc8111f70 con 0x7fedc8102790 2024-09-19T04:26:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.728+0000 7fedcd5c7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fedc8111df0 con 0x7fedc8101de0 2024-09-19T04:26:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.728+0000 7fedcd5c7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fedc81120f0 con 0x7fedc8106f10 2024-09-19T04:26:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.728+0000 7fedbe7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fedc8102790 0x7fedc81989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.728+0000 7fedbe7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fedc8102790 0x7fedc81989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49198/0 (socket says 172.21.15.7:49198) 2024-09-19T04:26:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.728+0000 7fedbe7fc640 1 -- 172.21.15.7:0/519712190 learned_addr learned my addr 172.21.15.7:0/519712190 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:26:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.728+0000 7fedc6ffd640 1 --2- 172.21.15.7:0/519712190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fedc8101de0 0x7fedc8198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.728+0000 7fedc77fe640 1 --2- 172.21.15.7:0/519712190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fedc8106f10 0x7fedc819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.728+0000 7fedbe7fc640 1 -- 172.21.15.7:0/519712190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fedc8106f10 msgr2=0x7fedc819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.728+0000 7fedbe7fc640 1 --2- 172.21.15.7:0/519712190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fedc8106f10 0x7fedc819cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.729+0000 7fedbe7fc640 1 -- 172.21.15.7:0/519712190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fedc8101de0 msgr2=0x7fedc8198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.729+0000 7fedbe7fc640 1 --2- 172.21.15.7:0/519712190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fedc8101de0 0x7fedc8198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.729+0000 7fedbe7fc640 1 -- 172.21.15.7:0/519712190 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc819d420 con 0x7fedc8102790 2024-09-19T04:26:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.729+0000 7fedbe7fc640 1 --2- 172.21.15.7:0/519712190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fedc8102790 0x7fedc81989b0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fedb0006010 tx=0x7fedb00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.729+0000 7fedc4ff9640 1 -- 172.21.15.7:0/519712190 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb003f030 con 0x7fedc8102790 2024-09-19T04:26:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.729+0000 7fedc4ff9640 1 -- 172.21.15.7:0/519712190 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fedb0003ce0 con 0x7fedc8102790 2024-09-19T04:26:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.729+0000 7fedcd5c7640 1 -- 172.21.15.7:0/519712190 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedc819d6b0 con 0x7fedc8102790 2024-09-19T04:26:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.729+0000 7fedc4ff9640 1 -- 172.21.15.7:0/519712190 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb0035070 con 0x7fedc8102790 2024-09-19T04:26:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.729+0000 7fedcd5c7640 1 -- 172.21.15.7:0/519712190 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedc81a4ff0 con 0x7fedc8102790 2024-09-19T04:26:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.730+0000 7fedcd5c7640 1 -- 172.21.15.7:0/519712190 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedc81032c0 con 0x7fedc8102790 2024-09-19T04:26:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.731+0000 7fedc4ff9640 1 -- 172.21.15.7:0/519712190 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fedb0042030 con 0x7fedc8102790 2024-09-19T04:26:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.732+0000 7fedc4ff9640 1 --2- 172.21.15.7:0/519712190 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fedb40a3240 0x7fedb40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.732+0000 7fedc6ffd640 1 --2- 172.21.15.7:0/519712190 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fedb40a3240 0x7fedb40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:57.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.732+0000 7fedc4ff9640 1 -- 172.21.15.7:0/519712190 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9216+0+0 (secure 0 0 0) 0x7fedb00f0680 con 0x7fedc8102790 2024-09-19T04:26:57.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.732+0000 7fedc6ffd640 1 --2- 172.21.15.7:0/519712190 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fedb40a3240 0x7fedb40a5700 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fedb800bbe0 tx=0x7fedb800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:57.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.735+0000 7fedc4ff9640 1 -- 172.21.15.7:0/519712190 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fedb00bd050 con 0x7fedc8102790 2024-09-19T04:26:57.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.945+0000 7fedcd5c7640 1 -- 172.21.15.7:0/519712190 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fedc810a150 con 0x7fedc8102790 2024-09-19T04:26:57.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.948+0000 7fedc4ff9640 1 -- 172.21.15.7:0/519712190 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v45) ==== 161+0+0 (secure 0 0 0) 0x7fedb00bc950 con 0x7fedc8102790 2024-09-19T04:26:57.950 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T04:26:57.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.952+0000 7fedcd5c7640 1 -- 172.21.15.7:0/519712190 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fedb40a3240 msgr2=0x7fedb40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:57.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.952+0000 7fedcd5c7640 1 --2- 172.21.15.7:0/519712190 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fedb40a3240 0x7fedb40a5700 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fedb800bbe0 tx=0x7fedb800b390 comp rx=0 tx=0).stop 2024-09-19T04:26:57.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.952+0000 7fedcd5c7640 1 -- 172.21.15.7:0/519712190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fedc8102790 msgr2=0x7fedc81989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:57.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.952+0000 7fedcd5c7640 1 --2- 172.21.15.7:0/519712190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fedc8102790 0x7fedc81989b0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fedb0006010 tx=0x7fedb00042f0 comp rx=0 tx=0).stop 2024-09-19T04:26:57.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.952+0000 7fedcd5c7640 1 -- 172.21.15.7:0/519712190 shutdown_connections 2024-09-19T04:26:57.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.952+0000 7fedcd5c7640 1 --2- 172.21.15.7:0/519712190 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fedb40a3240 0x7fedb40a5700 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:57.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.952+0000 7fedcd5c7640 1 --2- 172.21.15.7:0/519712190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fedc8106f10 0x7fedc819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:57.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.952+0000 7fedcd5c7640 1 --2- 172.21.15.7:0/519712190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fedc8102790 0x7fedc81989b0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:57.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.952+0000 7fedcd5c7640 1 --2- 172.21.15.7:0/519712190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fedc8101de0 0x7fedc8198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:57.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.952+0000 7fedcd5c7640 1 -- 172.21.15.7:0/519712190 >> 172.21.15.7:0/519712190 conn(0x7fedc80fd8c0 msgr2=0x7fedc80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:57.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.954+0000 7fedcd5c7640 1 -- 172.21.15.7:0/519712190 shutdown_connections 2024-09-19T04:26:57.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:57.955+0000 7fedcd5c7640 1 -- 172.21.15.7:0/519712190 wait complete. 2024-09-19T04:26:58.275 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:57 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-a[31356]: 2024-09-19T04:26:57.946+0000 7f721cfd0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T04:26:58.275 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:58 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/519712190' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T04:26:58.275 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:58 smithi007 ceph-mon[31360]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T04:26:58.275 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:58 smithi007 ceph-mon[31360]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T04:26:58.275 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:58 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/519712190' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T04:26:58.275 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:58 smithi007 ceph-mon[31360]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T04:26:58.275 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:58 smithi007 ceph-mon[31360]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-19T04:26:58.276 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 04:26:57 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-a[71722]: ignoring --setuser ceph since I am not root 2024-09-19T04:26:58.276 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 04:26:57 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-a[71722]: ignoring --setgroup ceph since I am not root 2024-09-19T04:26:58.276 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 04:26:58 smithi007 ceph-mds[71726]: -- 172.21.15.7:0/1206014844 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5634a5f73860 con 0x5634a5f51000 2024-09-19T04:26:58.276 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 04:26:58 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-a[71722]: starting mds.a at 2024-09-19T04:26:58.276 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 04:26:57 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-g[71337]: ignoring --setuser ceph since I am not root 2024-09-19T04:26:58.276 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 04:26:57 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-g[71337]: ignoring --setgroup ceph since I am not root 2024-09-19T04:26:58.276 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 04:26:58 smithi007 ceph-mds[71353]: -- 172.21.15.7:0/4169705700 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d634511860 con 0x55d6344ef000 2024-09-19T04:26:58.276 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 04:26:58 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-g[71337]: starting mds.g at 2024-09-19T04:26:58.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:58 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/519712190' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T04:26:58.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:58 smithi092 ceph-mon[34940]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T04:26:58.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:58 smithi092 ceph-mon[34940]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T04:26:58.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:58 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/519712190' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T04:26:58.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:58 smithi092 ceph-mon[34940]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T04:26:58.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:58 smithi092 ceph-mon[34940]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-19T04:26:58.298 INFO:journalctl@ceph.mds.b.smithi092.stdout:Sep 19 04:26:58 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-b[65433]: ignoring --setuser ceph since I am not root 2024-09-19T04:26:58.298 INFO:journalctl@ceph.mds.b.smithi092.stdout:Sep 19 04:26:58 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-b[65433]: ignoring --setgroup ceph since I am not root 2024-09-19T04:26:58.298 INFO:journalctl@ceph.mds.b.smithi092.stdout:Sep 19 04:26:58 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-b[65433]: starting mds.b at 2024-09-19T04:26:58.298 INFO:journalctl@ceph.mds.h.smithi092.stdout:Sep 19 04:26:57 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-h[65132]: ignoring --setuser ceph since I am not root 2024-09-19T04:26:58.298 INFO:journalctl@ceph.mds.h.smithi092.stdout:Sep 19 04:26:57 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-h[65132]: ignoring --setgroup ceph since I am not root 2024-09-19T04:26:58.298 INFO:journalctl@ceph.mds.h.smithi092.stdout:Sep 19 04:26:57 smithi092 ceph-mds[65136]: -- 172.21.15.92:0/636440550 <== mon.2 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e8b2ba9c20 con 0x55e8b2b87400 2024-09-19T04:26:58.298 INFO:journalctl@ceph.mds.h.smithi092.stdout:Sep 19 04:26:57 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-h[65132]: starting mds.h at 2024-09-19T04:26:58.299 INFO:journalctl@ceph.mds.k.smithi092.stdout:Sep 19 04:26:57 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-k[64517]: ignoring --setuser ceph since I am not root 2024-09-19T04:26:58.299 INFO:journalctl@ceph.mds.k.smithi092.stdout:Sep 19 04:26:57 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-k[64517]: ignoring --setgroup ceph since I am not root 2024-09-19T04:26:58.299 INFO:journalctl@ceph.mds.k.smithi092.stdout:Sep 19 04:26:57 smithi092 ceph-mds[64521]: -- 172.21.15.92:0/1477539214 <== mon.2 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f262f37860 con 0x55f262f15000 2024-09-19T04:26:58.299 INFO:journalctl@ceph.mds.k.smithi092.stdout:Sep 19 04:26:57 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-k[64517]: starting mds.k at 2024-09-19T04:26:58.409 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 19 04:26:57 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-c[65467]: ignoring --setuser ceph since I am not root 2024-09-19T04:26:58.409 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 19 04:26:57 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-c[65467]: ignoring --setgroup ceph since I am not root 2024-09-19T04:26:58.409 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 19 04:26:57 smithi102 ceph-mds[65471]: -- 172.21.15.102:0/2601236408 <== mon.1 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561413c65860 con 0x561413c42800 2024-09-19T04:26:58.409 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 19 04:26:57 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-c[65467]: starting mds.c at 2024-09-19T04:26:58.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:58 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/519712190' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T04:26:58.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:58 smithi102 ceph-mon[35446]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T04:26:58.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:58 smithi102 ceph-mon[35446]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T04:26:58.410 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:58 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/519712190' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T04:26:58.410 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:58 smithi102 ceph-mon[35446]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T04:26:58.410 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:58 smithi102 ceph-mon[35446]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-19T04:26:58.410 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 19 04:26:57 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-l[64861]: ignoring --setuser ceph since I am not root 2024-09-19T04:26:58.410 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 19 04:26:57 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-l[64861]: ignoring --setgroup ceph since I am not root 2024-09-19T04:26:58.410 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 19 04:26:57 smithi102 ceph-mds[64865]: -- 172.21.15.102:0/4014320538 <== mon.2 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561b3b789860 con 0x561b3b767000 2024-09-19T04:26:58.410 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 19 04:26:57 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-l[64861]: starting mds.l at 2024-09-19T04:26:58.411 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 19 04:26:57 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-f[65168]: ignoring --setuser ceph since I am not root 2024-09-19T04:26:58.411 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 19 04:26:57 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-f[65168]: ignoring --setgroup ceph since I am not root 2024-09-19T04:26:58.411 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 19 04:26:57 smithi102 ceph-mds[65172]: -- 172.21.15.102:0/2873608576 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55bdf2e0ad00 con 0x55bdf2ddf400 2024-09-19T04:26:58.411 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 19 04:26:57 smithi102 ceph-mds[65172]: -- 172.21.15.102:0/2873608576 <== mon.1 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bdf2e01860 con 0x55bdf2ddf400 2024-09-19T04:26:58.411 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 19 04:26:57 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-f[65168]: starting mds.f at 2024-09-19T04:26:58.411 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 19 04:26:57 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-i[65772]: ignoring --setuser ceph since I am not root 2024-09-19T04:26:58.411 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 19 04:26:57 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-i[65772]: ignoring --setgroup ceph since I am not root 2024-09-19T04:26:58.411 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 19 04:26:57 smithi102 ceph-mds[65776]: -- 172.21.15.102:0/2084854330 <== mon.1 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558491ee7860 con 0x558491ec4800 2024-09-19T04:26:58.412 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 19 04:26:57 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-i[65772]: starting mds.i at 2024-09-19T04:26:58.640 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T04:26:58.900 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:26:59.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:59 smithi092 ceph-mon[34940]: pgmap v656: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-19T04:26:59.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:59 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:26:59.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:59 smithi092 ceph-mon[34940]: mds.? [v2:172.21.15.102:6832/2882261659,v1:172.21.15.102:6837/2882261659] up:boot 2024-09-19T04:26:59.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:59 smithi092 ceph-mon[34940]: mds.? [v2:172.21.15.102:6834/425138599,v1:172.21.15.102:6836/425138599] up:boot 2024-09-19T04:26:59.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:59 smithi092 ceph-mon[34940]: mds.? [v2:172.21.15.102:6833/1965294839,v1:172.21.15.102:6838/1965294839] up:boot 2024-09-19T04:26:59.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:59 smithi092 ceph-mon[34940]: mds.? [v2:172.21.15.102:6835/1419659061,v1:172.21.15.102:6839/1419659061] up:boot 2024-09-19T04:26:59.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:59 smithi092 ceph-mon[34940]: mds.? [v2:172.21.15.92:6832/1149004870,v1:172.21.15.92:6836/1149004870] up:boot 2024-09-19T04:26:59.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:59 smithi092 ceph-mon[34940]: mds.? [v2:172.21.15.92:6833/2827450455,v1:172.21.15.92:6837/2827450455] up:boot 2024-09-19T04:26:59.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:59 smithi092 ceph-mon[34940]: mds.? [v2:172.21.15.7:6837/3425897878,v1:172.21.15.7:6838/3425897878] up:boot 2024-09-19T04:26:59.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:59 smithi092 ceph-mon[34940]: mds.? [v2:172.21.15.7:6836/2708840373,v1:172.21.15.7:6839/2708840373] up:boot 2024-09-19T04:26:59.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:59 smithi092 ceph-mon[34940]: mds.? [v2:172.21.15.7:6840/1300118862,v1:172.21.15.7:6841/1300118862] up:boot 2024-09-19T04:26:59.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:59 smithi092 ceph-mon[34940]: mds.? [v2:172.21.15.92:6838/2550391003,v1:172.21.15.92:6839/2550391003] up:boot 2024-09-19T04:26:59.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:59 smithi092 ceph-mon[34940]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-19T04:26:59.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:59 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T04:26:59.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:59 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T04:26:59.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:59 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T04:26:59.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:59 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T04:26:59.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:59 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T04:26:59.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:59 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T04:26:59.299 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:59 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T04:26:59.300 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:59 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T04:26:59.300 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:59 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T04:26:59.300 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:26:59 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T04:26:59.347 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:59 smithi007 ceph-mon[31360]: pgmap v656: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-19T04:26:59.348 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:59 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:26:59.348 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:59 smithi007 ceph-mon[31360]: mds.? [v2:172.21.15.102:6832/2882261659,v1:172.21.15.102:6837/2882261659] up:boot 2024-09-19T04:26:59.348 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:59 smithi007 ceph-mon[31360]: mds.? [v2:172.21.15.102:6834/425138599,v1:172.21.15.102:6836/425138599] up:boot 2024-09-19T04:26:59.348 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:59 smithi007 ceph-mon[31360]: mds.? [v2:172.21.15.102:6833/1965294839,v1:172.21.15.102:6838/1965294839] up:boot 2024-09-19T04:26:59.348 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:59 smithi007 ceph-mon[31360]: mds.? [v2:172.21.15.102:6835/1419659061,v1:172.21.15.102:6839/1419659061] up:boot 2024-09-19T04:26:59.348 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:59 smithi007 ceph-mon[31360]: mds.? [v2:172.21.15.92:6832/1149004870,v1:172.21.15.92:6836/1149004870] up:boot 2024-09-19T04:26:59.348 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:59 smithi007 ceph-mon[31360]: mds.? [v2:172.21.15.92:6833/2827450455,v1:172.21.15.92:6837/2827450455] up:boot 2024-09-19T04:26:59.348 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:59 smithi007 ceph-mon[31360]: mds.? [v2:172.21.15.7:6837/3425897878,v1:172.21.15.7:6838/3425897878] up:boot 2024-09-19T04:26:59.348 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:59 smithi007 ceph-mon[31360]: mds.? [v2:172.21.15.7:6836/2708840373,v1:172.21.15.7:6839/2708840373] up:boot 2024-09-19T04:26:59.348 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:59 smithi007 ceph-mon[31360]: mds.? [v2:172.21.15.7:6840/1300118862,v1:172.21.15.7:6841/1300118862] up:boot 2024-09-19T04:26:59.348 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:59 smithi007 ceph-mon[31360]: mds.? [v2:172.21.15.92:6838/2550391003,v1:172.21.15.92:6839/2550391003] up:boot 2024-09-19T04:26:59.348 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:59 smithi007 ceph-mon[31360]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-19T04:26:59.349 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:59 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T04:26:59.349 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:59 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T04:26:59.349 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:59 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T04:26:59.349 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:59 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T04:26:59.349 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:59 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T04:26:59.349 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:59 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T04:26:59.349 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:59 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T04:26:59.349 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:59 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T04:26:59.349 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:59 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T04:26:59.349 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:26:59 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T04:26:59.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:59 smithi102 ceph-mon[35446]: pgmap v656: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-19T04:26:59.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:59 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:26:59.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:59 smithi102 ceph-mon[35446]: mds.? [v2:172.21.15.102:6832/2882261659,v1:172.21.15.102:6837/2882261659] up:boot 2024-09-19T04:26:59.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:59 smithi102 ceph-mon[35446]: mds.? [v2:172.21.15.102:6834/425138599,v1:172.21.15.102:6836/425138599] up:boot 2024-09-19T04:26:59.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:59 smithi102 ceph-mon[35446]: mds.? [v2:172.21.15.102:6833/1965294839,v1:172.21.15.102:6838/1965294839] up:boot 2024-09-19T04:26:59.410 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:59 smithi102 ceph-mon[35446]: mds.? [v2:172.21.15.102:6835/1419659061,v1:172.21.15.102:6839/1419659061] up:boot 2024-09-19T04:26:59.410 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:59 smithi102 ceph-mon[35446]: mds.? [v2:172.21.15.92:6832/1149004870,v1:172.21.15.92:6836/1149004870] up:boot 2024-09-19T04:26:59.410 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:59 smithi102 ceph-mon[35446]: mds.? [v2:172.21.15.92:6833/2827450455,v1:172.21.15.92:6837/2827450455] up:boot 2024-09-19T04:26:59.410 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:59 smithi102 ceph-mon[35446]: mds.? [v2:172.21.15.7:6837/3425897878,v1:172.21.15.7:6838/3425897878] up:boot 2024-09-19T04:26:59.410 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:59 smithi102 ceph-mon[35446]: mds.? [v2:172.21.15.7:6836/2708840373,v1:172.21.15.7:6839/2708840373] up:boot 2024-09-19T04:26:59.410 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:59 smithi102 ceph-mon[35446]: mds.? [v2:172.21.15.7:6840/1300118862,v1:172.21.15.7:6841/1300118862] up:boot 2024-09-19T04:26:59.410 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:59 smithi102 ceph-mon[35446]: mds.? [v2:172.21.15.92:6838/2550391003,v1:172.21.15.92:6839/2550391003] up:boot 2024-09-19T04:26:59.410 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:59 smithi102 ceph-mon[35446]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-19T04:26:59.410 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:59 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T04:26:59.410 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:59 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T04:26:59.410 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:59 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T04:26:59.410 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:59 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T04:26:59.410 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:59 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T04:26:59.411 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:59 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T04:26:59.411 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:59 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T04:26:59.411 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:59 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T04:26:59.411 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:59 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T04:26:59.411 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:26:59 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T04:26:59.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.429+0000 7f11f2b44640 1 -- 172.21.15.7:0/2624152360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11ec102d40 msgr2=0x7f11ec103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:59.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.429+0000 7f11f2b44640 1 --2- 172.21.15.7:0/2624152360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11ec102d40 0x7f11ec103120 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f11e8009900 tx=0x7f11e802a480 comp rx=0 tx=0).stop 2024-09-19T04:26:59.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.429+0000 7f11f2b44640 1 -- 172.21.15.7:0/2624152360 shutdown_connections 2024-09-19T04:26:59.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.429+0000 7f11f2b44640 1 --2- 172.21.15.7:0/2624152360 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11ec10c170 0x7f11ec10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:59.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.429+0000 7f11f2b44640 1 --2- 172.21.15.7:0/2624152360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11ec103660 0x7f11ec10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:59.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.429+0000 7f11f2b44640 1 --2- 172.21.15.7:0/2624152360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11ec102d40 0x7f11ec103120 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:59.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.429+0000 7f11f2b44640 1 -- 172.21.15.7:0/2624152360 >> 172.21.15.7:0/2624152360 conn(0x7f11ec0fc7a0 msgr2=0x7f11ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:59.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.429+0000 7f11f2b44640 1 -- 172.21.15.7:0/2624152360 shutdown_connections 2024-09-19T04:26:59.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.429+0000 7f11f2b44640 1 -- 172.21.15.7:0/2624152360 wait complete. 2024-09-19T04:26:59.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.430+0000 7f11f2b44640 1 Processor -- start 2024-09-19T04:26:59.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.430+0000 7f11f2b44640 1 -- start start 2024-09-19T04:26:59.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.430+0000 7f11f2b44640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11ec102d40 0x7f11ec1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:59.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.430+0000 7f11f2b44640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11ec103660 0x7f11ec100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:59.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.430+0000 7f11f2b44640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11ec10c170 0x7f11ec101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:59.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.430+0000 7f11f2b44640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f11ec111f70 con 0x7f11ec102d40 2024-09-19T04:26:59.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.430+0000 7f11f2b44640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f11ec111df0 con 0x7f11ec103660 2024-09-19T04:26:59.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.430+0000 7f11f2b44640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f11ec1120f0 con 0x7f11ec10c170 2024-09-19T04:26:59.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.431+0000 7f11f08e0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11ec102d40 0x7f11ec1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:59.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.431+0000 7f11f08e0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11ec102d40 0x7f11ec1009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49272/0 (socket says 172.21.15.7:49272) 2024-09-19T04:26:59.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.431+0000 7f11f08e0640 1 -- 172.21.15.7:0/381005635 learned_addr learned my addr 172.21.15.7:0/381005635 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:26:59.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.431+0000 7f11e3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11ec103660 0x7f11ec100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:59.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.431+0000 7f11f10e1640 1 --2- 172.21.15.7:0/381005635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11ec10c170 0x7f11ec101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:59.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.431+0000 7f11f08e0640 1 -- 172.21.15.7:0/381005635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11ec10c170 msgr2=0x7f11ec101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:59.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.431+0000 7f11f08e0640 1 --2- 172.21.15.7:0/381005635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11ec10c170 0x7f11ec101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:59.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.431+0000 7f11f08e0640 1 -- 172.21.15.7:0/381005635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11ec103660 msgr2=0x7f11ec100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:59.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.431+0000 7f11f08e0640 1 --2- 172.21.15.7:0/381005635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11ec103660 0x7f11ec100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:59.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.431+0000 7f11f08e0640 1 -- 172.21.15.7:0/381005635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11ec1a68b0 con 0x7f11ec102d40 2024-09-19T04:26:59.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.431+0000 7f11f08e0640 1 --2- 172.21.15.7:0/381005635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11ec102d40 0x7f11ec1009a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f11e8006010 tx=0x7f11e80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:59.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.431+0000 7f11e1ffb640 1 -- 172.21.15.7:0/381005635 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e803f030 con 0x7f11ec102d40 2024-09-19T04:26:59.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.431+0000 7f11e1ffb640 1 -- 172.21.15.7:0/381005635 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11e8003ce0 con 0x7f11ec102d40 2024-09-19T04:26:59.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.431+0000 7f11e1ffb640 1 -- 172.21.15.7:0/381005635 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e8035070 con 0x7f11ec102d40 2024-09-19T04:26:59.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.431+0000 7f11f2b44640 1 -- 172.21.15.7:0/381005635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11ec1a6b40 con 0x7f11ec102d40 2024-09-19T04:26:59.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.432+0000 7f11f2b44640 1 -- 172.21.15.7:0/381005635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11ec1a7070 con 0x7f11ec102d40 2024-09-19T04:26:59.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.433+0000 7f11f2b44640 1 -- 172.21.15.7:0/381005635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11ec103120 con 0x7f11ec102d40 2024-09-19T04:26:59.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.434+0000 7f11e1ffb640 1 -- 172.21.15.7:0/381005635 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f11e8042030 con 0x7f11ec102d40 2024-09-19T04:26:59.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.434+0000 7f11e1ffb640 1 --2- 172.21.15.7:0/381005635 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f11d40a32c0 0x7f11d40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:59.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.435+0000 7f11e3fff640 1 --2- 172.21.15.7:0/381005635 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f11d40a32c0 0x7f11d40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:59.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.435+0000 7f11e1ffb640 1 -- 172.21.15.7:0/381005635 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9646+0+0 (secure 0 0 0) 0x7f11e80f0320 con 0x7f11ec102d40 2024-09-19T04:26:59.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.435+0000 7f11e3fff640 1 --2- 172.21.15.7:0/381005635 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f11d40a32c0 0x7f11d40a5780 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f11ec102430 tx=0x7f11dc00a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:59.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.440+0000 7f11e1ffb640 1 -- 172.21.15.7:0/381005635 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f11e80bc530 con 0x7f11ec102d40 2024-09-19T04:26:59.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:26:59.665+0000 7f11f2b44640 1 -- 172.21.15.7:0/381005635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f11ec106c80 con 0x7f11ec102d40 2024-09-19T04:27:00.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:00.032+0000 7f11e1ffb640 1 -- 172.21.15.7:0/381005635 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v47) ==== 104+0+0 (secure 0 0 0) 0x7f11e80c0830 con 0x7f11ec102d40 2024-09-19T04:27:00.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:00.034+0000 7f11f2b44640 1 -- 172.21.15.7:0/381005635 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f11d40a32c0 msgr2=0x7f11d40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:27:00.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:00.034+0000 7f11f2b44640 1 --2- 172.21.15.7:0/381005635 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f11d40a32c0 0x7f11d40a5780 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f11ec102430 tx=0x7f11dc00a250 comp rx=0 tx=0).stop 2024-09-19T04:27:00.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:00.034+0000 7f11f2b44640 1 -- 172.21.15.7:0/381005635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11ec102d40 msgr2=0x7f11ec1009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:27:00.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:00.034+0000 7f11f2b44640 1 --2- 172.21.15.7:0/381005635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11ec102d40 0x7f11ec1009a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f11e8006010 tx=0x7f11e80042f0 comp rx=0 tx=0).stop 2024-09-19T04:27:00.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:00.034+0000 7f11f2b44640 1 -- 172.21.15.7:0/381005635 shutdown_connections 2024-09-19T04:27:00.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:00.034+0000 7f11f2b44640 1 --2- 172.21.15.7:0/381005635 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f11d40a32c0 0x7f11d40a5780 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:00.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:00.034+0000 7f11f2b44640 1 --2- 172.21.15.7:0/381005635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11ec10c170 0x7f11ec101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:00.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:00.034+0000 7f11f2b44640 1 --2- 172.21.15.7:0/381005635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11ec103660 0x7f11ec100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:00.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:00.034+0000 7f11f2b44640 1 --2- 172.21.15.7:0/381005635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11ec102d40 0x7f11ec1009a0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:00.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:00.035+0000 7f11f2b44640 1 -- 172.21.15.7:0/381005635 >> 172.21.15.7:0/381005635 conn(0x7f11ec0fc7a0 msgr2=0x7f11ec0fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:27:00.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:00.035+0000 7f11f2b44640 1 -- 172.21.15.7:0/381005635 shutdown_connections 2024-09-19T04:27:00.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:00.035+0000 7f11f2b44640 1 -- 172.21.15.7:0/381005635 wait complete. 2024-09-19T04:27:00.158 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:00 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/381005635' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T04:27:00.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:00 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/381005635' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T04:27:00.375 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:00 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/381005635' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T04:27:01.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:01 smithi092 ceph-mon[34940]: pgmap v658: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-19T04:27:01.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:01 smithi092 ceph-mon[34940]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T04:27:01.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:01 smithi092 ceph-mon[34940]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T04:27:01.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:01 smithi092 ceph-mon[34940]: Cluster is now healthy 2024-09-19T04:27:01.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:01 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/381005635' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T04:27:01.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:01 smithi092 ceph-mon[34940]: fsmap 12 up:standby 2024-09-19T04:27:01.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:01 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:27:01.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:01 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:27:01.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:01 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:27:01.298 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:01 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:27:01.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:01 smithi007 ceph-mon[31360]: pgmap v658: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-19T04:27:01.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:01 smithi007 ceph-mon[31360]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T04:27:01.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:01 smithi007 ceph-mon[31360]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T04:27:01.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:01 smithi007 ceph-mon[31360]: Cluster is now healthy 2024-09-19T04:27:01.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:01 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/381005635' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T04:27:01.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:01 smithi007 ceph-mon[31360]: fsmap 12 up:standby 2024-09-19T04:27:01.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:01 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:27:01.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:01 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:27:01.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:01 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:27:01.334 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:01 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:27:01.361 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T04:27:01.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:01 smithi102 ceph-mon[35446]: pgmap v658: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-19T04:27:01.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:01 smithi102 ceph-mon[35446]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T04:27:01.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:01 smithi102 ceph-mon[35446]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T04:27:01.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:01 smithi102 ceph-mon[35446]: Cluster is now healthy 2024-09-19T04:27:01.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:01 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/381005635' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T04:27:01.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:01 smithi102 ceph-mon[35446]: fsmap 12 up:standby 2024-09-19T04:27:01.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:01 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:27:01.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:01 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:27:01.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:01 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:27:01.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:01 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:27:01.640 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:27:02.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.246+0000 7fabfd0b8640 1 -- 172.21.15.7:0/1058029415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf8102da0 msgr2=0x7fabf8103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:27:02.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.246+0000 7fabfd0b8640 1 --2- 172.21.15.7:0/1058029415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf8102da0 0x7fabf8103180 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fabe8009900 tx=0x7fabe802a480 comp rx=0 tx=0).stop 2024-09-19T04:27:02.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.246+0000 7fabfd0b8640 1 -- 172.21.15.7:0/1058029415 shutdown_connections 2024-09-19T04:27:02.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.246+0000 7fabfd0b8640 1 --2- 172.21.15.7:0/1058029415 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabf810c180 0x7fabf810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:02.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.246+0000 7fabfd0b8640 1 --2- 172.21.15.7:0/1058029415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabf81036c0 0x7fabf810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:02.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.246+0000 7fabfd0b8640 1 --2- 172.21.15.7:0/1058029415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf8102da0 0x7fabf8103180 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:02.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.246+0000 7fabfd0b8640 1 -- 172.21.15.7:0/1058029415 >> 172.21.15.7:0/1058029415 conn(0x7fabf80fc7a0 msgr2=0x7fabf80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:27:02.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.246+0000 7fabfd0b8640 1 -- 172.21.15.7:0/1058029415 shutdown_connections 2024-09-19T04:27:02.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.246+0000 7fabfd0b8640 1 -- 172.21.15.7:0/1058029415 wait complete. 2024-09-19T04:27:02.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.247+0000 7fabfd0b8640 1 Processor -- start 2024-09-19T04:27:02.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.247+0000 7fabfd0b8640 1 -- start start 2024-09-19T04:27:02.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.247+0000 7fabfd0b8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabf8102da0 0x7fabf8198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:27:02.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.247+0000 7fabfd0b8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf81036c0 0x7fabf8198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:27:02.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.247+0000 7fabfd0b8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabf810c180 0x7fabf819ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:27:02.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.247+0000 7fabfd0b8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fabf8111fa0 con 0x7fabf81036c0 2024-09-19T04:27:02.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.247+0000 7fabfd0b8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fabf8111e20 con 0x7fabf8102da0 2024-09-19T04:27:02.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.247+0000 7fabfd0b8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fabf8112120 con 0x7fabf810c180 2024-09-19T04:27:02.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.247+0000 7fabf6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabf8102da0 0x7fabf8198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:27:02.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.247+0000 7fabf659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf81036c0 0x7fabf8198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:27:02.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.247+0000 7fabf6d9d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabf8102da0 0x7fabf8198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.7:51320/0 (socket says 172.21.15.7:51320) 2024-09-19T04:27:02.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.247+0000 7fabf659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf81036c0 0x7fabf8198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49284/0 (socket says 172.21.15.7:49284) 2024-09-19T04:27:02.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.247+0000 7fabf6d9d640 1 -- 172.21.15.7:0/1077364367 learned_addr learned my addr 172.21.15.7:0/1077364367 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:27:02.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.247+0000 7fabf759e640 1 --2- 172.21.15.7:0/1077364367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabf810c180 0x7fabf819ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:27:02.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.248+0000 7fabf6d9d640 1 -- 172.21.15.7:0/1077364367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabf810c180 msgr2=0x7fabf819ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:27:02.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.248+0000 7fabf6d9d640 1 --2- 172.21.15.7:0/1077364367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabf810c180 0x7fabf819ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:02.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.248+0000 7fabf6d9d640 1 -- 172.21.15.7:0/1077364367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf81036c0 msgr2=0x7fabf8198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:27:02.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.248+0000 7fabf6d9d640 1 --2- 172.21.15.7:0/1077364367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf81036c0 0x7fabf8198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:02.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.248+0000 7fabf6d9d640 1 -- 172.21.15.7:0/1077364367 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf819d4f0 con 0x7fabf8102da0 2024-09-19T04:27:02.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.248+0000 7fabf759e640 1 --2- 172.21.15.7:0/1077364367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabf810c180 0x7fabf819ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:27:02.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.248+0000 7fabf659c640 1 --2- 172.21.15.7:0/1077364367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf81036c0 0x7fabf8198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:27:02.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.248+0000 7fabf6d9d640 1 --2- 172.21.15.7:0/1077364367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabf8102da0 0x7fabf8198540 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fabe8006010 tx=0x7fabe80042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:27:02.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.248+0000 7fabdffff640 1 -- 172.21.15.7:0/1077364367 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe803f030 con 0x7fabf8102da0 2024-09-19T04:27:02.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.248+0000 7fabdffff640 1 -- 172.21.15.7:0/1077364367 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabe8003ce0 con 0x7fabf8102da0 2024-09-19T04:27:02.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.248+0000 7fabdffff640 1 -- 172.21.15.7:0/1077364367 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe8035070 con 0x7fabf8102da0 2024-09-19T04:27:02.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.248+0000 7fabfd0b8640 1 -- 172.21.15.7:0/1077364367 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabf819d780 con 0x7fabf8102da0 2024-09-19T04:27:02.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.248+0000 7fabfd0b8640 1 -- 172.21.15.7:0/1077364367 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabf81a50c0 con 0x7fabf8102da0 2024-09-19T04:27:02.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.249+0000 7fabfd0b8640 1 -- 172.21.15.7:0/1077364367 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabf806b010 con 0x7fabf8102da0 2024-09-19T04:27:02.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.250+0000 7fabdffff640 1 -- 172.21.15.7:0/1077364367 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fabe8042030 con 0x7fabf8102da0 2024-09-19T04:27:02.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.251+0000 7fabdffff640 1 --2- 172.21.15.7:0/1077364367 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fabe00a3240 0x7fabe00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:27:02.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.251+0000 7fabf659c640 1 --2- 172.21.15.7:0/1077364367 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fabe00a3240 0x7fabe00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:27:02.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.251+0000 7fabdffff640 1 -- 172.21.15.7:0/1077364367 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9646+0+0 (secure 0 0 0) 0x7fabe80f0870 con 0x7fabf8102da0 2024-09-19T04:27:02.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.252+0000 7fabf659c640 1 --2- 172.21.15.7:0/1077364367 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fabe00a3240 0x7fabe00a5700 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fabf80fee70 tx=0x7fabec009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:27:02.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.254+0000 7fabdffff640 1 -- 172.21.15.7:0/1077364367 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fabe80bcfb0 con 0x7fabf8102da0 2024-09-19T04:27:02.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:02.434+0000 7fabfd0b8640 1 -- 172.21.15.7:0/1077364367 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fabf8107200 con 0x7fabf8102da0 2024-09-19T04:27:03.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:03 smithi092 ceph-mon[34940]: pgmap v659: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-19T04:27:03.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:03 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:27:03.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:03 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:27:03.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:03 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/1077364367' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T04:27:03.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:03 smithi092 ceph-mon[34940]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T04:27:03.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:03 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:03.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:03 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:27:03.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:03 smithi092 ceph-mon[34940]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:27:03.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:03 smithi007 ceph-mon[31360]: pgmap v659: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-19T04:27:03.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:03 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:27:03.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:03 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:27:03.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:03 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/1077364367' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T04:27:03.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:03 smithi007 ceph-mon[31360]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T04:27:03.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:03 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:03.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:03 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:27:03.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:03 smithi007 ceph-mon[31360]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:27:03.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:03 smithi102 ceph-mon[35446]: pgmap v659: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-19T04:27:03.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:03 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:27:03.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:03 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:27:03.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:03 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/1077364367' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T04:27:03.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:03 smithi102 ceph-mon[35446]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T04:27:03.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:03 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:03.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:03 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:27:03.409 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:03 smithi102 ceph-mon[35446]: from='mgr.14150 172.21.15.7:0/1590122051' entity='mgr.x' 2024-09-19T04:27:03.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:03.423+0000 7fabdffff640 1 -- 172.21.15.7:0/1077364367 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v92) ==== 181+0+0 (secure 0 0 0) 0x7fabe80bc8b0 con 0x7fabf8102da0 2024-09-19T04:27:03.425 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2024-09-19T04:27:03.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:03.426+0000 7fabfd0b8640 1 -- 172.21.15.7:0/1077364367 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fabe00a3240 msgr2=0x7fabe00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:27:03.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:03.426+0000 7fabfd0b8640 1 --2- 172.21.15.7:0/1077364367 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fabe00a3240 0x7fabe00a5700 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fabf80fee70 tx=0x7fabec009110 comp rx=0 tx=0).stop 2024-09-19T04:27:03.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:03.426+0000 7fabfd0b8640 1 -- 172.21.15.7:0/1077364367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabf8102da0 msgr2=0x7fabf8198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:27:03.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:03.426+0000 7fabfd0b8640 1 --2- 172.21.15.7:0/1077364367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabf8102da0 0x7fabf8198540 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fabe8006010 tx=0x7fabe80042f0 comp rx=0 tx=0).stop 2024-09-19T04:27:03.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:03.426+0000 7fabfd0b8640 1 -- 172.21.15.7:0/1077364367 shutdown_connections 2024-09-19T04:27:03.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:03.426+0000 7fabfd0b8640 1 --2- 172.21.15.7:0/1077364367 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fabe00a3240 0x7fabe00a5700 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:03.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:03.426+0000 7fabfd0b8640 1 --2- 172.21.15.7:0/1077364367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabf810c180 0x7fabf819ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:03.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:03.426+0000 7fabfd0b8640 1 --2- 172.21.15.7:0/1077364367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fabf81036c0 0x7fabf8198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:03.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:03.426+0000 7fabfd0b8640 1 --2- 172.21.15.7:0/1077364367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabf8102da0 0x7fabf8198540 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:03.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:03.426+0000 7fabfd0b8640 1 -- 172.21.15.7:0/1077364367 >> 172.21.15.7:0/1077364367 conn(0x7fabf80fc7a0 msgr2=0x7fabf80fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:27:03.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:03.426+0000 7fabfd0b8640 1 -- 172.21.15.7:0/1077364367 shutdown_connections 2024-09-19T04:27:03.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:03.426+0000 7fabfd0b8640 1 -- 172.21.15.7:0/1077364367 wait complete. 2024-09-19T04:27:04.246 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T04:27:04.514 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:27:04.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:04 smithi007 ceph-mon[31360]: pgmap v660: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-19T04:27:04.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:04 smithi007 ceph-mon[31360]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T04:27:04.627 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:04 smithi007 ceph-mon[31360]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T04:27:04.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:04 smithi092 ceph-mon[34940]: pgmap v660: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-19T04:27:04.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:04 smithi092 ceph-mon[34940]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T04:27:04.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:04 smithi092 ceph-mon[34940]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T04:27:04.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:04 smithi102 ceph-mon[35446]: pgmap v660: 129 pgs: 129 active+clean; 20 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-19T04:27:04.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:04 smithi102 ceph-mon[35446]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T04:27:04.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:04 smithi102 ceph-mon[35446]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T04:27:04.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.989+0000 7fbb0206e640 1 -- 172.21.15.7:0/3368250229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbafc106f50 msgr2=0x7fbafc10eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:27:04.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.989+0000 7fbb0206e640 1 --2- 172.21.15.7:0/3368250229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbafc106f50 0x7fbafc10eaf0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4009cd0 tx=0x7fbaf402a8e0 comp rx=0 tx=0).stop 2024-09-19T04:27:04.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.989+0000 7fbb0206e640 1 -- 172.21.15.7:0/3368250229 shutdown_connections 2024-09-19T04:27:04.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.990+0000 7fbb0206e640 1 --2- 172.21.15.7:0/3368250229 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbafc106f50 0x7fbafc10eaf0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:04.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.990+0000 7fbb0206e640 1 --2- 172.21.15.7:0/3368250229 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbafc100ca0 0x7fbafc106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:04.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.990+0000 7fbb0206e640 1 --2- 172.21.15.7:0/3368250229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbafc1002f0 0x7fbafc1006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:04.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.990+0000 7fbb0206e640 1 -- 172.21.15.7:0/3368250229 >> 172.21.15.7:0/3368250229 conn(0x7fbafc077210 msgr2=0x7fbafc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:27:04.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.990+0000 7fbb0206e640 1 -- 172.21.15.7:0/3368250229 shutdown_connections 2024-09-19T04:27:04.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.990+0000 7fbb0206e640 1 -- 172.21.15.7:0/3368250229 wait complete. 2024-09-19T04:27:04.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.990+0000 7fbb0206e640 1 Processor -- start 2024-09-19T04:27:04.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.990+0000 7fbb0206e640 1 -- start start 2024-09-19T04:27:04.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.991+0000 7fbb0206e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbafc1002f0 0x7fbafc101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:27:04.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.991+0000 7fbb0206e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbafc100ca0 0x7fbafc1017b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:27:04.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.991+0000 7fbb0206e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbafc106f50 0x7fbafc101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:27:04.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.991+0000 7fbb0206e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc111fa0 con 0x7fbafc106f50 2024-09-19T04:27:04.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.991+0000 7fbb0206e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc111e20 con 0x7fbafc100ca0 2024-09-19T04:27:04.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.991+0000 7fbb0206e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbafc112120 con 0x7fbafc1002f0 2024-09-19T04:27:04.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.991+0000 7fbafbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbafc106f50 0x7fbafc101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:27:04.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.991+0000 7fbafbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbafc106f50 0x7fbafc101cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49290/0 (socket says 172.21.15.7:49290) 2024-09-19T04:27:04.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.991+0000 7fbafbfff640 1 -- 172.21.15.7:0/3161518712 learned_addr learned my addr 172.21.15.7:0/3161518712 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:27:04.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.991+0000 7fbafb7fe640 1 --2- 172.21.15.7:0/3161518712 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbafc1002f0 0x7fbafc101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:27:04.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.991+0000 7fbafaffd640 1 --2- 172.21.15.7:0/3161518712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbafc100ca0 0x7fbafc1017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:27:04.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.991+0000 7fbafbfff640 1 -- 172.21.15.7:0/3161518712 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbafc1002f0 msgr2=0x7fbafc101270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:27:04.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.991+0000 7fbafbfff640 1 --2- 172.21.15.7:0/3161518712 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbafc1002f0 0x7fbafc101270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:04.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.991+0000 7fbafbfff640 1 -- 172.21.15.7:0/3161518712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbafc100ca0 msgr2=0x7fbafc1017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:27:04.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.991+0000 7fbafbfff640 1 --2- 172.21.15.7:0/3161518712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbafc100ca0 0x7fbafc1017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:04.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.991+0000 7fbafbfff640 1 -- 172.21.15.7:0/3161518712 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbafc1a6920 con 0x7fbafc106f50 2024-09-19T04:27:04.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.991+0000 7fbafaffd640 1 --2- 172.21.15.7:0/3161518712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbafc100ca0 0x7fbafc1017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:27:04.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.991+0000 7fbafbfff640 1 --2- 172.21.15.7:0/3161518712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbafc106f50 0x7fbafc101cf0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4005cc0 tx=0x7fbaf4003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:27:04.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.991+0000 7fbaf8ff9640 1 -- 172.21.15.7:0/3161518712 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4004040 con 0x7fbafc106f50 2024-09-19T04:27:04.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.991+0000 7fbaf8ff9640 1 -- 172.21.15.7:0/3161518712 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbaf40046c0 con 0x7fbafc106f50 2024-09-19T04:27:04.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.991+0000 7fbaf8ff9640 1 -- 172.21.15.7:0/3161518712 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4046480 con 0x7fbafc106f50 2024-09-19T04:27:04.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.991+0000 7fbb0206e640 1 -- 172.21.15.7:0/3161518712 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbafc1a6bb0 con 0x7fbafc106f50 2024-09-19T04:27:04.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.992+0000 7fbb0206e640 1 -- 172.21.15.7:0/3161518712 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbafc1a70f0 con 0x7fbafc106f50 2024-09-19T04:27:04.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.993+0000 7fbb0206e640 1 -- 172.21.15.7:0/3161518712 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbafc1006d0 con 0x7fbafc106f50 2024-09-19T04:27:04.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.994+0000 7fbaf8ff9640 1 -- 172.21.15.7:0/3161518712 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7fbaf40305a0 con 0x7fbafc106f50 2024-09-19T04:27:04.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.994+0000 7fbaf8ff9640 1 --2- 172.21.15.7:0/3161518712 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fbae40a3240 0x7fbae40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:27:05.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.994+0000 7fbafb7fe640 1 --2- 172.21.15.7:0/3161518712 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fbae40a3240 0x7fbae40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:27:05.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.994+0000 7fbaf8ff9640 1 -- 172.21.15.7:0/3161518712 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9121+0+0 (secure 0 0 0) 0x7fbaf402e030 con 0x7fbafc106f50 2024-09-19T04:27:05.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.995+0000 7fbafb7fe640 1 --2- 172.21.15.7:0/3161518712 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fbae40a3240 0x7fbae40a5700 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fbaec00bbe0 tx=0x7fbaec00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:27:05.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:04.999+0000 7fbaf8ff9640 1 -- 172.21.15.7:0/3161518712 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbaf404b060 con 0x7fbafc106f50 2024-09-19T04:27:05.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:05.175+0000 7fbb0206e640 1 -- 172.21.15.7:0/3161518712 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbafc10a120 con 0x7fbafc106f50 2024-09-19T04:27:05.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:05.421+0000 7fbaf8ff9640 1 -- 172.21.15.7:0/3161518712 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v93) ==== 169+0+0 (secure 0 0 0) 0x7fbaf40bdcc0 con 0x7fbafc106f50 2024-09-19T04:27:05.423 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2024-09-19T04:27:05.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:05.425+0000 7fbb0206e640 1 -- 172.21.15.7:0/3161518712 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fbae40a3240 msgr2=0x7fbae40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:27:05.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:05.425+0000 7fbb0206e640 1 --2- 172.21.15.7:0/3161518712 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fbae40a3240 0x7fbae40a5700 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fbaec00bbe0 tx=0x7fbaec00b390 comp rx=0 tx=0).stop 2024-09-19T04:27:05.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:05.425+0000 7fbb0206e640 1 -- 172.21.15.7:0/3161518712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbafc106f50 msgr2=0x7fbafc101cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:27:05.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:05.425+0000 7fbb0206e640 1 --2- 172.21.15.7:0/3161518712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbafc106f50 0x7fbafc101cf0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4005cc0 tx=0x7fbaf4003970 comp rx=0 tx=0).stop 2024-09-19T04:27:05.427 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:05 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3161518712' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T04:27:05.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:05.426+0000 7fbb0206e640 1 -- 172.21.15.7:0/3161518712 shutdown_connections 2024-09-19T04:27:05.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:05.426+0000 7fbb0206e640 1 --2- 172.21.15.7:0/3161518712 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7fbae40a3240 0x7fbae40a5700 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:05.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:05.426+0000 7fbb0206e640 1 --2- 172.21.15.7:0/3161518712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbafc106f50 0x7fbafc101cf0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:05.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:05.426+0000 7fbb0206e640 1 --2- 172.21.15.7:0/3161518712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbafc100ca0 0x7fbafc1017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:05.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:05.426+0000 7fbb0206e640 1 --2- 172.21.15.7:0/3161518712 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbafc1002f0 0x7fbafc101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:05.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:05.426+0000 7fbb0206e640 1 -- 172.21.15.7:0/3161518712 >> 172.21.15.7:0/3161518712 conn(0x7fbafc077210 msgr2=0x7fbafc105810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:27:05.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:05.427+0000 7fbb0206e640 1 -- 172.21.15.7:0/3161518712 shutdown_connections 2024-09-19T04:27:05.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:05.427+0000 7fbb0206e640 1 -- 172.21.15.7:0/3161518712 wait complete. 2024-09-19T04:27:05.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:05 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3161518712' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T04:27:05.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:05 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3161518712' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T04:27:06.207 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 77957c0a-763c-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-19T04:27:06.473 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:27:06.738 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:06 smithi007 ceph-mon[31360]: pgmap v662: 97 pgs: 97 active+clean; 577 KiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:27:06.739 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:06 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/3161518712' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T04:27:06.739 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:06 smithi007 ceph-mon[31360]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T04:27:06.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:06 smithi092 ceph-mon[34940]: pgmap v662: 97 pgs: 97 active+clean; 577 KiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:27:06.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:06 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/3161518712' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T04:27:06.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:06 smithi092 ceph-mon[34940]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T04:27:06.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:06 smithi102 ceph-mon[35446]: pgmap v662: 97 pgs: 97 active+clean; 577 KiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:27:06.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:06 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/3161518712' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T04:27:06.909 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:06 smithi102 ceph-mon[35446]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T04:27:06.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.974+0000 7f25b7546640 1 -- 172.21.15.7:0/3355569265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25b0105120 msgr2=0x7f25b010cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:27:06.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.974+0000 7f25b7546640 1 --2- 172.21.15.7:0/3355569265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25b0105120 0x7f25b010cca0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f25a800c840 tx=0x7f25a802ae10 comp rx=0 tx=0).stop 2024-09-19T04:27:06.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.974+0000 7f25b7546640 1 -- 172.21.15.7:0/3355569265 shutdown_connections 2024-09-19T04:27:06.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.974+0000 7f25b7546640 1 --2- 172.21.15.7:0/3355569265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25b0105120 0x7f25b010cca0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:06.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.974+0000 7f25b7546640 1 --2- 172.21.15.7:0/3355569265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25b01009a0 0x7f25b01049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:06.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.974+0000 7f25b7546640 1 --2- 172.21.15.7:0/3355569265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25b00ffff0 0x7f25b01003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:06.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.974+0000 7f25b7546640 1 -- 172.21.15.7:0/3355569265 >> 172.21.15.7:0/3355569265 conn(0x7f25b00fba90 msgr2=0x7f25b00fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:27:06.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.974+0000 7f25b7546640 1 -- 172.21.15.7:0/3355569265 shutdown_connections 2024-09-19T04:27:06.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.974+0000 7f25b7546640 1 -- 172.21.15.7:0/3355569265 wait complete. 2024-09-19T04:27:06.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.975+0000 7f25b7546640 1 Processor -- start 2024-09-19T04:27:06.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.975+0000 7f25b7546640 1 -- start start 2024-09-19T04:27:06.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.975+0000 7f25b7546640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25b00ffff0 0x7f25b0101a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:27:06.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.975+0000 7f25b7546640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25b01009a0 0x7f25b0101fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:27:06.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.975+0000 7f25b7546640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25b0105120 0x7f25b0102510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:27:06.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.975+0000 7f25b7546640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f25b010fd30 con 0x7f25b01009a0 2024-09-19T04:27:06.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.975+0000 7f25b7546640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f25b010fbb0 con 0x7f25b0105120 2024-09-19T04:27:06.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.975+0000 7f25b7546640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f25b010feb0 con 0x7f25b00ffff0 2024-09-19T04:27:06.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.975+0000 7f25b4ae1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25b01009a0 0x7f25b0101fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:27:06.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.975+0000 7f25b4ae1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25b01009a0 0x7f25b0101fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49312/0 (socket says 172.21.15.7:49312) 2024-09-19T04:27:06.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.975+0000 7f25b4ae1640 1 -- 172.21.15.7:0/2398449734 learned_addr learned my addr 172.21.15.7:0/2398449734 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-19T04:27:06.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.976+0000 7f25b52e2640 1 --2- 172.21.15.7:0/2398449734 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25b00ffff0 0x7f25b0101a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:27:06.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.976+0000 7f25b5ae3640 1 --2- 172.21.15.7:0/2398449734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25b0105120 0x7f25b0102510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:27:06.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.976+0000 7f25b4ae1640 1 -- 172.21.15.7:0/2398449734 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25b00ffff0 msgr2=0x7f25b0101a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:27:06.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.976+0000 7f25b4ae1640 1 --2- 172.21.15.7:0/2398449734 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25b00ffff0 0x7f25b0101a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:06.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.976+0000 7f25b4ae1640 1 -- 172.21.15.7:0/2398449734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25b0105120 msgr2=0x7f25b0102510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:27:06.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.976+0000 7f25b4ae1640 1 --2- 172.21.15.7:0/2398449734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25b0105120 0x7f25b0102510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:06.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.976+0000 7f25b4ae1640 1 -- 172.21.15.7:0/2398449734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25b01a67d0 con 0x7f25b01009a0 2024-09-19T04:27:06.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.976+0000 7f25b52e2640 1 --2- 172.21.15.7:0/2398449734 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25b00ffff0 0x7f25b0101a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:27:06.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.976+0000 7f25b4ae1640 1 --2- 172.21.15.7:0/2398449734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25b01009a0 0x7f25b0101fd0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f25a000c890 tx=0x7f25a000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:27:06.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.976+0000 7f25a67fc640 1 -- 172.21.15.7:0/2398449734 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a0004220 con 0x7f25b01009a0 2024-09-19T04:27:06.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.976+0000 7f25a67fc640 1 -- 172.21.15.7:0/2398449734 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25a00043c0 con 0x7f25b01009a0 2024-09-19T04:27:06.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.976+0000 7f25b7546640 1 -- 172.21.15.7:0/2398449734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25b01a6ac0 con 0x7f25b01009a0 2024-09-19T04:27:06.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.976+0000 7f25a67fc640 1 -- 172.21.15.7:0/2398449734 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25a00049e0 con 0x7f25b01009a0 2024-09-19T04:27:06.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.976+0000 7f25b7546640 1 -- 172.21.15.7:0/2398449734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25b01a7050 con 0x7f25b01009a0 2024-09-19T04:27:06.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.977+0000 7f25b7546640 1 -- 172.21.15.7:0/2398449734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25b01003d0 con 0x7f25b01009a0 2024-09-19T04:27:06.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.978+0000 7f25a67fc640 1 -- 172.21.15.7:0/2398449734 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 138354+0+0 (secure 0 0 0) 0x7f25a00079b0 con 0x7f25b01009a0 2024-09-19T04:27:06.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.979+0000 7f25a67fc640 1 --2- 172.21.15.7:0/2398449734 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f259c0a32c0 0x7f259c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:27:06.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.979+0000 7f25b52e2640 1 --2- 172.21.15.7:0/2398449734 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f259c0a32c0 0x7f259c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:27:06.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.979+0000 7f25a67fc640 1 -- 172.21.15.7:0/2398449734 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8496+0+0 (secure 0 0 0) 0x7f25a00cfa60 con 0x7f25b01009a0 2024-09-19T04:27:06.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.980+0000 7f25b52e2640 1 --2- 172.21.15.7:0/2398449734 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f259c0a32c0 0x7f259c0a5780 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f25ac00baa0 tx=0x7f25ac005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:27:06.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:06.983+0000 7f25a67fc640 1 -- 172.21.15.7:0/2398449734 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f25a0014030 con 0x7f25b01009a0 2024-09-19T04:27:07.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:07.160+0000 7f25b7546640 1 -- 172.21.15.7:0/2398449734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f25b0102fc0 con 0x7f25b01009a0 2024-09-19T04:27:07.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:07.429+0000 7f25a67fc640 1 -- 172.21.15.7:0/2398449734 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v94) ==== 178+0+0 (secure 0 0 0) 0x7f25a009c640 con 0x7f25b01009a0 2024-09-19T04:27:07.431 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data_ec' removed 2024-09-19T04:27:07.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:07.433+0000 7f25b7546640 1 -- 172.21.15.7:0/2398449734 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f259c0a32c0 msgr2=0x7f259c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:27:07.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:07.433+0000 7f25b7546640 1 --2- 172.21.15.7:0/2398449734 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f259c0a32c0 0x7f259c0a5780 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f25ac00baa0 tx=0x7f25ac005d90 comp rx=0 tx=0).stop 2024-09-19T04:27:07.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:07.433+0000 7f25b7546640 1 -- 172.21.15.7:0/2398449734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25b01009a0 msgr2=0x7f25b0101fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:27:07.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:07.433+0000 7f25b7546640 1 --2- 172.21.15.7:0/2398449734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25b01009a0 0x7f25b0101fd0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f25a000c890 tx=0x7f25a000cd50 comp rx=0 tx=0).stop 2024-09-19T04:27:07.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:07.433+0000 7f25b7546640 1 -- 172.21.15.7:0/2398449734 shutdown_connections 2024-09-19T04:27:07.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:07.433+0000 7f25b7546640 1 --2- 172.21.15.7:0/2398449734 >> [v2:172.21.15.7:6800/1262394163,v1:172.21.15.7:6801/1262394163] conn(0x7f259c0a32c0 0x7f259c0a5780 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:07.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:07.433+0000 7f25b7546640 1 --2- 172.21.15.7:0/2398449734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25b0105120 0x7f25b0102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:07.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:07.433+0000 7f25b7546640 1 --2- 172.21.15.7:0/2398449734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25b01009a0 0x7f25b0101fd0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:07.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:07.433+0000 7f25b7546640 1 --2- 172.21.15.7:0/2398449734 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25b00ffff0 0x7f25b0101a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:07.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:07.433+0000 7f25b7546640 1 -- 172.21.15.7:0/2398449734 >> 172.21.15.7:0/2398449734 conn(0x7f25b00fba90 msgr2=0x7f25b0103f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:27:07.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:07.433+0000 7f25b7546640 1 -- 172.21.15.7:0/2398449734 shutdown_connections 2024-09-19T04:27:07.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-19T04:27:07.433+0000 7f25b7546640 1 -- 172.21.15.7:0/2398449734 wait complete. 2024-09-19T04:27:07.761 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:07 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2398449734' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T04:27:07.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:07 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2398449734' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T04:27:07.908 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:07 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2398449734' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T04:27:08.090 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T04:27:08.118 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T04:27:08.160 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T04:27:08.193 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T04:27:08.193 DEBUG:teuthology.orchestra.run.smithi007:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T04:27:08.210 DEBUG:teuthology.orchestra.run.smithi092:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T04:27:08.226 DEBUG:teuthology.orchestra.run.smithi102:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T04:27:08.251 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T04:27:08.251 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-19T04:27:08.251 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@mon.a 2024-09-19T04:27:08.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:08 smithi007 systemd[1]: Stopping Ceph mon.a for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:27:08.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:08 smithi102 ceph-mon[35446]: pgmap v664: 33 pgs: 33 active+clean; 577 KiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:27:08.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:08 smithi102 ceph-mon[35446]: from='client.? 172.21.15.7:0/2398449734' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T04:27:08.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:08 smithi102 ceph-mon[35446]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T04:27:08.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:08 smithi092 ceph-mon[34940]: pgmap v664: 33 pgs: 33 active+clean; 577 KiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:27:08.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:08 smithi092 ceph-mon[34940]: from='client.? 172.21.15.7:0/2398449734' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T04:27:08.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:08 smithi092 ceph-mon[34940]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T04:27:08.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:08 smithi007 ceph-mon[31360]: pgmap v664: 33 pgs: 33 active+clean; 577 KiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:27:08.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:08 smithi007 ceph-mon[31360]: from='client.? 172.21.15.7:0/2398449734' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T04:27:08.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:08 smithi007 ceph-mon[31360]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T04:27:08.877 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:08 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-a[31356]: 2024-09-19T04:27:08.564+0000 7f72227db640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:27:08.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:08 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-a[31356]: 2024-09-19T04:27:08.564+0000 7f72227db640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T04:27:08.878 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:08 smithi007 podman[99994]: 2024-09-19 04:27:08.606070708 +0000 UTC m=+0.156382279 container died 7c492ee8493a3815058048f22dd6ea099cbefb8bf622ffb97a5812803b7f57d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T04:27:09.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:08 smithi007 podman[99994]: 2024-09-19 04:27:08.990273714 +0000 UTC m=+0.540585239 container cleanup 7c492ee8493a3815058048f22dd6ea099cbefb8bf622ffb97a5812803b7f57d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-19T04:27:09.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 19 04:27:08 smithi007 bash[99994]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-a 2024-09-19T04:27:09.446 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mon.a.service' 2024-09-19T04:27:09.494 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:27:09.495 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-19T04:27:09.495 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-19T04:27:09.495 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@mon.b 2024-09-19T04:27:09.797 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:09 smithi092 systemd[1]: Stopping Ceph mon.b for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:27:10.297 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:09 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-b[34936]: 2024-09-19T04:27:09.832+0000 7fd688462640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:27:10.530 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:09 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-b[34936]: 2024-09-19T04:27:09.832+0000 7fd688462640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-19T04:27:10.530 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:10 smithi092 podman[70030]: 2024-09-19 04:27:10.016323232 +0000 UTC m=+0.303384013 container died 26442b8e039cca94cf244a3e7462461c7295801f895feae68bde8bc9c5b5597c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T04:27:10.685 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:10 smithi092 podman[70030]: 2024-09-19 04:27:10.432458464 +0000 UTC m=+0.719519241 container cleanup 26442b8e039cca94cf244a3e7462461c7295801f895feae68bde8bc9c5b5597c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-b, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-19T04:27:10.686 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:10 smithi092 bash[70030]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-b 2024-09-19T04:27:10.915 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mon.b.service' 2024-09-19T04:27:10.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:10 smithi092 podman[70044]: 2024-09-19 04:27:10.685033947 +0000 UTC m=+0.671779400 container remove 26442b8e039cca94cf244a3e7462461c7295801f895feae68bde8bc9c5b5597c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True) 2024-09-19T04:27:10.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:10 smithi092 systemd[1]: ceph-77957c0a-763c-11ef-bceb-c7b262605968@mon.b.service: Deactivated successfully. 2024-09-19T04:27:10.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:10 smithi092 systemd[1]: Stopped Ceph mon.b for 77957c0a-763c-11ef-bceb-c7b262605968. 2024-09-19T04:27:10.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:Sep 19 04:27:10 smithi092 systemd[1]: ceph-77957c0a-763c-11ef-bceb-c7b262605968@mon.b.service: Consumed 11.211s CPU time. 2024-09-19T04:27:10.961 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:27:10.961 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-19T04:27:10.961 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-19T04:27:10.961 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@mon.c 2024-09-19T04:27:11.300 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:11 smithi102 systemd[1]: Stopping Ceph mon.c for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:27:11.658 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:11 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-c[35442]: 2024-09-19T04:27:11.298+0000 7fdf7a2ff640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:27:11.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:11 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-c[35442]: 2024-09-19T04:27:11.298+0000 7fdf7a2ff640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-19T04:27:11.659 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:11 smithi102 podman[70019]: 2024-09-19 04:27:11.421467702 +0000 UTC m=+0.255646016 container died 2d79ec02c4c4742191001c81ea7f205750efc057a29d01ce858c067cb74faf88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-c, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True) 2024-09-19T04:27:12.077 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:11 smithi102 podman[70019]: 2024-09-19 04:27:11.807194001 +0000 UTC m=+0.641372312 container cleanup 2d79ec02c4c4742191001c81ea7f205750efc057a29d01ce858c067cb74faf88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-c, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T04:27:12.077 INFO:journalctl@ceph.mon.c.smithi102.stdout:Sep 19 04:27:11 smithi102 bash[70019]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-mon-c 2024-09-19T04:27:12.239 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mon.c.service' 2024-09-19T04:27:12.285 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:27:12.285 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-19T04:27:12.286 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-19T04:27:12.286 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@mgr.x 2024-09-19T04:27:12.627 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:27:12 smithi007 systemd[1]: Stopping Ceph mgr.x for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:27:12.964 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:27:12 smithi007 podman[100116]: 2024-09-19 04:27:12.634486457 +0000 UTC m=+0.142352599 container died e39a8610116a561ca553f4e6b238a2c33c97c0f96d45747d10fac8aa99153b4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-19T04:27:13.290 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:27:13 smithi007 podman[100116]: 2024-09-19 04:27:13.062806755 +0000 UTC m=+0.570672895 container cleanup e39a8610116a561ca553f4e6b238a2c33c97c0f96d45747d10fac8aa99153b4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T04:27:13.290 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:27:13 smithi007 bash[100116]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x 2024-09-19T04:27:13.547 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 19 04:27:13 smithi007 podman[100130]: 2024-09-19 04:27:13.289808169 +0000 UTC m=+0.647208607 container remove e39a8610116a561ca553f4e6b238a2c33c97c0f96d45747d10fac8aa99153b4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-x, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T04:27:13.552 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-19T04:27:13.587 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:27:13.587 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-19T04:27:13.588 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-19T04:27:13.588 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@mgr.y 2024-09-19T04:27:13.902 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:27:13 smithi092 systemd[1]: Stopping Ceph mgr.y for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:27:14.198 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:27:13 smithi092 podman[70150]: 2024-09-19 04:27:13.901771054 +0000 UTC m=+0.121122957 container died e1a350fd85363b4dd661af9e10186ee5dc23fb69a59fa2725185ecb37487e401 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-19T04:27:14.547 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:27:14 smithi092 podman[70150]: 2024-09-19 04:27:14.289441078 +0000 UTC m=+0.508792973 container cleanup e1a350fd85363b4dd661af9e10186ee5dc23fb69a59fa2725185ecb37487e401 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T04:27:14.547 INFO:journalctl@ceph.mgr.y.smithi092.stdout:Sep 19 04:27:14 smithi092 bash[70150]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-y 2024-09-19T04:27:14.689 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-19T04:27:14.724 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:27:14.724 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-19T04:27:14.725 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-19T04:27:14.725 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@mgr.z 2024-09-19T04:27:15.052 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:27:14 smithi102 systemd[1]: Stopping Ceph mgr.z for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:27:15.340 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:27:15 smithi102 podman[70144]: 2024-09-19 04:27:15.050285014 +0000 UTC m=+0.133539763 container died 812f1a59d7088987c7c2b2785fda14050c53cb1162dc542eb729729c187fd946 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T04:27:15.658 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:27:15 smithi102 podman[70144]: 2024-09-19 04:27:15.438315452 +0000 UTC m=+0.521570189 container cleanup 812f1a59d7088987c7c2b2785fda14050c53cb1162dc542eb729729c187fd946 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-19T04:27:15.659 INFO:journalctl@ceph.mgr.z.smithi102.stdout:Sep 19 04:27:15 smithi102 bash[70144]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-mgr-z 2024-09-19T04:27:15.864 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-19T04:27:15.899 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:27:15.899 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-19T04:27:15.899 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T04:27:15.899 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.0 2024-09-19T04:27:16.227 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 04:27:15 smithi007 systemd[1]: Stopping Ceph osd.0 for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:27:16.627 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 04:27:16 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-0[45116]: 2024-09-19T04:27:16.225+0000 7f12e5b7c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:27:16.627 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 04:27:16 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-0[45116]: 2024-09-19T04:27:16.225+0000 7f12e5b7c640 -1 osd.0 94 *** Got signal Terminated *** 2024-09-19T04:27:16.627 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 04:27:16 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-0[45116]: 2024-09-19T04:27:16.225+0000 7f12e5b7c640 -1 osd.0 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T04:27:22.127 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 04:27:21 smithi007 podman[100238]: 2024-09-19 04:27:21.837680009 +0000 UTC m=+5.737054100 container died 29d048d721b2e7bff37fbf96823a9507296d7eeb94a9116c18fa9c0b7abbc11b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS) 2024-09-19T04:27:22.580 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 04:27:22 smithi007 podman[100238]: 2024-09-19 04:27:22.301847677 +0000 UTC m=+6.201221754 container cleanup 29d048d721b2e7bff37fbf96823a9507296d7eeb94a9116c18fa9c0b7abbc11b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T04:27:22.580 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 04:27:22 smithi007 bash[100238]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-0 2024-09-19T04:27:22.877 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 04:27:22 smithi007 podman[100257]: 2024-09-19 04:27:22.57866576 +0000 UTC m=+0.737603864 container remove 29d048d721b2e7bff37fbf96823a9507296d7eeb94a9116c18fa9c0b7abbc11b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T04:27:23.242 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 04:27:23 smithi007 podman[100343]: 2024-09-19 04:27:22.989735397 +0000 UTC m=+0.016492803 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:27:23.242 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 04:27:23 smithi007 podman[100343]: 2024-09-19 04:27:23.121250454 +0000 UTC m=+0.148007850 container create 0fa0fdd807268377dd23318750992b87011f41c4b7709a62b41637af1bbcc92a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T04:27:23.559 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 04:27:23 smithi007 podman[100343]: 2024-09-19 04:27:23.365812829 +0000 UTC m=+0.392570226 container init 0fa0fdd807268377dd23318750992b87011f41c4b7709a62b41637af1bbcc92a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T04:27:23.559 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 04:27:23 smithi007 podman[100343]: 2024-09-19 04:27:23.369368963 +0000 UTC m=+0.396126368 container start 0fa0fdd807268377dd23318750992b87011f41c4b7709a62b41637af1bbcc92a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-19T04:27:23.559 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 04:27:23 smithi007 podman[100343]: 2024-09-19 04:27:23.440822098 +0000 UTC m=+0.467579516 container attach 0fa0fdd807268377dd23318750992b87011f41c4b7709a62b41637af1bbcc92a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-19T04:27:23.877 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 19 04:27:23 smithi007 podman[100343]: 2024-09-19 04:27:23.558663516 +0000 UTC m=+0.585420919 container died 0fa0fdd807268377dd23318750992b87011f41c4b7709a62b41637af1bbcc92a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-19T04:27:24.207 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T04:27:24.255 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:27:24.256 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T04:27:24.256 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T04:27:24.256 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.1 2024-09-19T04:27:24.547 INFO:journalctl@ceph.osd.1.smithi092.stdout:Sep 19 04:27:24 smithi092 systemd[1]: Stopping Ceph osd.1 for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:27:25.047 INFO:journalctl@ceph.osd.1.smithi092.stdout:Sep 19 04:27:24 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-1[39397]: 2024-09-19T04:27:24.559+0000 7f4a9c861640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:27:25.047 INFO:journalctl@ceph.osd.1.smithi092.stdout:Sep 19 04:27:24 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-1[39397]: 2024-09-19T04:27:24.559+0000 7f4a9c861640 -1 osd.1 94 *** Got signal Terminated *** 2024-09-19T04:27:25.047 INFO:journalctl@ceph.osd.1.smithi092.stdout:Sep 19 04:27:24 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-1[39397]: 2024-09-19T04:27:24.559+0000 7f4a9c861640 -1 osd.1 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T04:27:30.337 INFO:journalctl@ceph.osd.1.smithi092.stdout:Sep 19 04:27:30 smithi092 podman[70272]: 2024-09-19 04:27:30.079084899 +0000 UTC m=+5.630111605 container died a093b8f545c85ea1bf3bfd181abde56fc86f8d92d8bddb56e118ac8c26f9eab8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2) 2024-09-19T04:27:30.746 INFO:journalctl@ceph.osd.1.smithi092.stdout:Sep 19 04:27:30 smithi092 podman[70272]: 2024-09-19 04:27:30.435415213 +0000 UTC m=+5.986441918 container cleanup a093b8f545c85ea1bf3bfd181abde56fc86f8d92d8bddb56e118ac8c26f9eab8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2) 2024-09-19T04:27:30.746 INFO:journalctl@ceph.osd.1.smithi092.stdout:Sep 19 04:27:30 smithi092 bash[70272]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-1 2024-09-19T04:27:31.047 INFO:journalctl@ceph.osd.1.smithi092.stdout:Sep 19 04:27:30 smithi092 podman[70287]: 2024-09-19 04:27:30.74535232 +0000 UTC m=+0.665599799 container remove a093b8f545c85ea1bf3bfd181abde56fc86f8d92d8bddb56e118ac8c26f9eab8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-1, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-19T04:27:31.316 INFO:journalctl@ceph.osd.1.smithi092.stdout:Sep 19 04:27:31 smithi092 podman[70375]: 2024-09-19 04:27:30.95853062 +0000 UTC m=+0.016017264 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:27:31.316 INFO:journalctl@ceph.osd.1.smithi092.stdout:Sep 19 04:27:31 smithi092 podman[70375]: 2024-09-19 04:27:31.088104408 +0000 UTC m=+0.145591048 container create 792febfcb770192ac080d442b90d7e8ef1c6f46e0a76c6d3322f3cf799a70249 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True) 2024-09-19T04:27:31.317 INFO:journalctl@ceph.osd.1.smithi092.stdout:Sep 19 04:27:31 smithi092 podman[70375]: 2024-09-19 04:27:31.315742475 +0000 UTC m=+0.373229109 container init 792febfcb770192ac080d442b90d7e8ef1c6f46e0a76c6d3322f3cf799a70249 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T04:27:31.797 INFO:journalctl@ceph.osd.1.smithi092.stdout:Sep 19 04:27:31 smithi092 podman[70375]: 2024-09-19 04:27:31.319101402 +0000 UTC m=+0.376588043 container start 792febfcb770192ac080d442b90d7e8ef1c6f46e0a76c6d3322f3cf799a70249 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T04:27:31.797 INFO:journalctl@ceph.osd.1.smithi092.stdout:Sep 19 04:27:31 smithi092 podman[70375]: 2024-09-19 04:27:31.41627498 +0000 UTC m=+0.473761616 container attach 792febfcb770192ac080d442b90d7e8ef1c6f46e0a76c6d3322f3cf799a70249 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T04:27:31.797 INFO:journalctl@ceph.osd.1.smithi092.stdout:Sep 19 04:27:31 smithi092 podman[70375]: 2024-09-19 04:27:31.552172595 +0000 UTC m=+0.609659231 container died 792febfcb770192ac080d442b90d7e8ef1c6f46e0a76c6d3322f3cf799a70249 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T04:27:32.152 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T04:27:32.195 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:27:32.195 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T04:27:32.195 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T04:27:32.195 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.2 2024-09-19T04:27:32.494 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 19 04:27:32 smithi102 systemd[1]: Stopping Ceph osd.2 for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:27:32.909 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 19 04:27:32 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-2[40411]: 2024-09-19T04:27:32.492+0000 7f0d6108b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:27:32.909 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 19 04:27:32 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-2[40411]: 2024-09-19T04:27:32.492+0000 7f0d6108b640 -1 osd.2 94 *** Got signal Terminated *** 2024-09-19T04:27:32.909 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 19 04:27:32 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-2[40411]: 2024-09-19T04:27:32.492+0000 7f0d6108b640 -1 osd.2 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T04:27:38.305 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 19 04:27:37 smithi102 podman[70272]: 2024-09-19 04:27:37.992157445 +0000 UTC m=+5.606876160 container died a768de96a2bc9449b61ef41e1e5fc403b31286fa530cdb1bc34c4eb32a96b7e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-19T04:27:38.646 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 19 04:27:38 smithi102 podman[70272]: 2024-09-19 04:27:38.393929329 +0000 UTC m=+6.008648044 container cleanup a768de96a2bc9449b61ef41e1e5fc403b31286fa530cdb1bc34c4eb32a96b7e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True) 2024-09-19T04:27:38.646 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 19 04:27:38 smithi102 bash[70272]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-2 2024-09-19T04:27:38.909 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 19 04:27:38 smithi102 podman[70288]: 2024-09-19 04:27:38.64534197 +0000 UTC m=+0.650566047 container remove a768de96a2bc9449b61ef41e1e5fc403b31286fa530cdb1bc34c4eb32a96b7e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T04:27:39.283 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 19 04:27:39 smithi102 podman[70379]: 2024-09-19 04:27:38.908428502 +0000 UTC m=+0.015611644 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:27:39.284 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 19 04:27:39 smithi102 podman[70379]: 2024-09-19 04:27:39.046521076 +0000 UTC m=+0.153704233 container create ccd75690ab9fe7969a8bac985f2de67000e58c0e51a9c69cbc49ccda77b208c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-19T04:27:39.284 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 19 04:27:39 smithi102 podman[70379]: 2024-09-19 04:27:39.282590757 +0000 UTC m=+0.389773872 container init ccd75690ab9fe7969a8bac985f2de67000e58c0e51a9c69cbc49ccda77b208c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T04:27:39.659 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 19 04:27:39 smithi102 podman[70379]: 2024-09-19 04:27:39.286138184 +0000 UTC m=+0.393321307 container start ccd75690ab9fe7969a8bac985f2de67000e58c0e51a9c69cbc49ccda77b208c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-19T04:27:39.659 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 19 04:27:39 smithi102 podman[70379]: 2024-09-19 04:27:39.382617336 +0000 UTC m=+0.489800474 container attach ccd75690ab9fe7969a8bac985f2de67000e58c0e51a9c69cbc49ccda77b208c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T04:27:39.659 INFO:journalctl@ceph.osd.2.smithi102.stdout:Sep 19 04:27:39 smithi102 podman[70379]: 2024-09-19 04:27:39.473220902 +0000 UTC m=+0.580404018 container died ccd75690ab9fe7969a8bac985f2de67000e58c0e51a9c69cbc49ccda77b208c0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-19T04:27:40.174 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T04:27:40.213 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:27:40.214 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T04:27:40.214 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T04:27:40.214 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.3 2024-09-19T04:27:40.524 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 04:27:40 smithi007 systemd[1]: Stopping Ceph osd.3 for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:27:40.877 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 04:27:40 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-3[51461]: 2024-09-19T04:27:40.522+0000 7f15b0ebb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:27:40.877 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 04:27:40 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-3[51461]: 2024-09-19T04:27:40.522+0000 7f15b0ebb640 -1 osd.3 94 *** Got signal Terminated *** 2024-09-19T04:27:40.877 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 04:27:40 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-3[51461]: 2024-09-19T04:27:40.522+0000 7f15b0ebb640 -1 osd.3 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T04:27:43.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:27:43 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:27:43.492+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:27:43.877 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 04:27:43 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-3[51461]: 2024-09-19T04:27:43.423+0000 7f15ad4d1640 -1 osd.3 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:18.983172+0000 front 2024-09-19T04:27:18.983199+0000 (oldest deadline 2024-09-19T04:27:42.483340+0000) 2024-09-19T04:27:43.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:27:43 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:27:43.501+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:27:44.627 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 04:27:44 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-3[51461]: 2024-09-19T04:27:44.374+0000 7f15ad4d1640 -1 osd.3 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:18.983172+0000 front 2024-09-19T04:27:18.983199+0000 (oldest deadline 2024-09-19T04:27:42.483340+0000) 2024-09-19T04:27:44.627 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:27:44 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:27:44.529+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:27:44.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:27:44 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:27:44.521+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:27:45.627 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 04:27:45 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-3[51461]: 2024-09-19T04:27:45.351+0000 7f15ad4d1640 -1 osd.3 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:18.983172+0000 front 2024-09-19T04:27:18.983199+0000 (oldest deadline 2024-09-19T04:27:42.483340+0000) 2024-09-19T04:27:45.627 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:27:45 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:27:45.495+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:27:45.659 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:45 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:27:45.403+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:17.613459+0000 front 2024-09-19T04:27:17.613488+0000 (oldest deadline 2024-09-19T04:27:45.214066+0000) 2024-09-19T04:27:45.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:27:45 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:27:45.493+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:27:46.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:27:45 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:27:45.690+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:27:46.357 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 04:27:46 smithi007 podman[100460]: 2024-09-19 04:27:46.067934679 +0000 UTC m=+5.650333376 container died 66f7c9c91ecc65859b2cc53f78f70936ec0b60dba901bfcaffb7c07a346e6c11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-3, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-19T04:27:46.627 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 04:27:46 smithi007 podman[100460]: 2024-09-19 04:27:46.447811017 +0000 UTC m=+6.030209748 container cleanup 66f7c9c91ecc65859b2cc53f78f70936ec0b60dba901bfcaffb7c07a346e6c11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-19T04:27:46.627 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 04:27:46 smithi007 bash[100460]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-3 2024-09-19T04:27:46.627 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:27:46 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:27:46.520+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:27:46.658 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:46 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:27:46.380+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:17.613459+0000 front 2024-09-19T04:27:17.613488+0000 (oldest deadline 2024-09-19T04:27:45.214066+0000) 2024-09-19T04:27:46.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:27:46 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:27:46.537+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:27:47.080 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 04:27:46 smithi007 podman[100476]: 2024-09-19 04:27:46.716051632 +0000 UTC m=+0.650130885 container remove 66f7c9c91ecc65859b2cc53f78f70936ec0b60dba901bfcaffb7c07a346e6c11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-19T04:27:47.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:27:46 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:27:46.721+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:27:47.377 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 04:27:47 smithi007 podman[100566]: 2024-09-19 04:27:46.982810648 +0000 UTC m=+0.016722150 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:27:47.377 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 04:27:47 smithi007 podman[100566]: 2024-09-19 04:27:47.125278984 +0000 UTC m=+0.159190519 container create 36a0f7e65bd0a171433e01219b0a139363a3542ff744efdedfda5c141fccd0b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T04:27:47.659 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:47 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:27:47.372+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:17.613459+0000 front 2024-09-19T04:27:17.613488+0000 (oldest deadline 2024-09-19T04:27:45.214066+0000) 2024-09-19T04:27:47.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:27:47 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:27:47.490+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:27:47.877 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 04:27:47 smithi007 podman[100566]: 2024-09-19 04:27:47.386198681 +0000 UTC m=+0.420110197 container init 36a0f7e65bd0a171433e01219b0a139363a3542ff744efdedfda5c141fccd0b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-19T04:27:47.878 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 04:27:47 smithi007 podman[100566]: 2024-09-19 04:27:47.389575992 +0000 UTC m=+0.423487485 container start 36a0f7e65bd0a171433e01219b0a139363a3542ff744efdedfda5c141fccd0b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-19T04:27:47.878 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 04:27:47 smithi007 podman[100566]: 2024-09-19 04:27:47.486508852 +0000 UTC m=+0.520420357 container attach 36a0f7e65bd0a171433e01219b0a139363a3542ff744efdedfda5c141fccd0b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-19T04:27:47.878 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 19 04:27:47 smithi007 podman[100566]: 2024-09-19 04:27:47.582391394 +0000 UTC m=+0.616302886 container died 36a0f7e65bd0a171433e01219b0a139363a3542ff744efdedfda5c141fccd0b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-19T04:27:48.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:27:47 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:27:47.584+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:27:48.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:27:47 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:27:47.763+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:27:48.221 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T04:27:48.262 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:27:48.262 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T04:27:48.262 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T04:27:48.262 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.4 2024-09-19T04:27:48.547 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 19 04:27:48 smithi092 systemd[1]: Stopping Ceph osd.4 for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:27:48.659 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:48 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:27:48.353+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:17.613459+0000 front 2024-09-19T04:27:17.613488+0000 (oldest deadline 2024-09-19T04:27:45.214066+0000) 2024-09-19T04:27:48.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:27:48 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:27:48.452+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:27:49.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:27:48 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:27:48.632+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:27:49.048 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 19 04:27:48 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-4[46309]: 2024-09-19T04:27:48.580+0000 7fcaaebad640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:27:49.048 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 19 04:27:48 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-4[46309]: 2024-09-19T04:27:48.580+0000 7fcaaebad640 -1 osd.4 94 *** Got signal Terminated *** 2024-09-19T04:27:49.048 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 19 04:27:48 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-4[46309]: 2024-09-19T04:27:48.580+0000 7fcaaebad640 -1 osd.4 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T04:27:49.158 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:27:48 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:27:48.801+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:27:49.659 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:49 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:27:49.304+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:17.613459+0000 front 2024-09-19T04:27:17.613488+0000 (oldest deadline 2024-09-19T04:27:45.214066+0000) 2024-09-19T04:27:49.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:27:49 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:27:49.491+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:27:50.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:27:49 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:27:49.610+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:27:50.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:27:49 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:27:49.815+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:27:50.659 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:50 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:27:50.291+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:17.613459+0000 front 2024-09-19T04:27:17.613488+0000 (oldest deadline 2024-09-19T04:27:45.214066+0000) 2024-09-19T04:27:50.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:27:50 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:27:50.506+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:27:51.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:27:50 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:27:50.585+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:27:51.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:27:50 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:27:50.770+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:27:51.159 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:27:50 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:27:50.774+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:27:51.658 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:51 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:27:51.341+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:17.613459+0000 front 2024-09-19T04:27:17.613488+0000 (oldest deadline 2024-09-19T04:27:45.214066+0000) 2024-09-19T04:27:51.659 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:51 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:27:51.341+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:27.515314+0000 front 2024-09-19T04:27:27.515444+0000 (oldest deadline 2024-09-19T04:27:50.415224+0000) 2024-09-19T04:27:51.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:27:51 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:27:51.483+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:27:51.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:27:51 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:27:51.483+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:27:52.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:27:51 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:27:51.604+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:27:52.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:27:51 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:27:51.604+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:27:52.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:27:51 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:27:51.722+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:27:52.159 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:27:51 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:27:51.733+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:27:52.627 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:27:52 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:27:52.503+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:27:52.627 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:27:52 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:27:52.503+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:27:52.627 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:27:52 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:27:52.366+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.992790+0000 front 2024-09-19T04:27:28.992942+0000 (oldest deadline 2024-09-19T04:27:51.892622+0000) 2024-09-19T04:27:52.658 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:52 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:27:52.355+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:17.613459+0000 front 2024-09-19T04:27:17.613488+0000 (oldest deadline 2024-09-19T04:27:45.214066+0000) 2024-09-19T04:27:52.659 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:52 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:27:52.355+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:27.515314+0000 front 2024-09-19T04:27:27.515444+0000 (oldest deadline 2024-09-19T04:27:50.415224+0000) 2024-09-19T04:27:53.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:27:52 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:27:52.646+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:27:53.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:27:52 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:27:52.646+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:27:53.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:27:52 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:27:52.720+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:27:53.159 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:27:52 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:27:52.697+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:27:53.547 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 19 04:27:53 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-4[46309]: 2024-09-19T04:27:53.240+0000 7fcaab1c3640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.372089+0000 front 2024-09-19T04:27:28.372136+0000 (oldest deadline 2024-09-19T04:27:52.472238+0000) 2024-09-19T04:27:53.659 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:53 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:27:53.370+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:17.613459+0000 front 2024-09-19T04:27:17.613488+0000 (oldest deadline 2024-09-19T04:27:45.214066+0000) 2024-09-19T04:27:53.659 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:53 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:27:53.370+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:27.515314+0000 front 2024-09-19T04:27:27.515444+0000 (oldest deadline 2024-09-19T04:27:50.415224+0000) 2024-09-19T04:27:53.877 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:27:53 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:27:53.411+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.992790+0000 front 2024-09-19T04:27:28.992942+0000 (oldest deadline 2024-09-19T04:27:51.892622+0000) 2024-09-19T04:27:53.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:27:53 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:27:53.520+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:27:53.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:27:53 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:27:53.520+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:27:54.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:27:53 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:27:53.682+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:27:54.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:27:53 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:27:53.682+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:27:54.160 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:27:53 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:27:53.703+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:27:54.160 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:27:53 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:27:53.724+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:27:54.381 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 19 04:27:54 smithi092 podman[70491]: 2024-09-19 04:27:54.050690075 +0000 UTC m=+5.598666560 container died 65c14a0e9775d688a70a22e7ea6f81deda69b8f568e69cab3a3645e374eb69d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-19T04:27:54.381 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 19 04:27:54 smithi092 podman[70491]: 2024-09-19 04:27:54.380097152 +0000 UTC m=+5.928073635 container cleanup 65c14a0e9775d688a70a22e7ea6f81deda69b8f568e69cab3a3645e374eb69d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T04:27:54.658 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:54 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:27:54.329+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:17.613459+0000 front 2024-09-19T04:27:17.613488+0000 (oldest deadline 2024-09-19T04:27:45.214066+0000) 2024-09-19T04:27:54.659 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:54 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:27:54.329+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:27.515314+0000 front 2024-09-19T04:27:27.515444+0000 (oldest deadline 2024-09-19T04:27:50.415224+0000) 2024-09-19T04:27:54.661 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 19 04:27:54 smithi092 bash[70491]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-4 2024-09-19T04:27:54.661 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 19 04:27:54 smithi092 podman[70508]: 2024-09-19 04:27:54.573337422 +0000 UTC m=+0.525407831 container remove 65c14a0e9775d688a70a22e7ea6f81deda69b8f568e69cab3a3645e374eb69d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-19T04:27:54.877 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:27:54 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:27:54.418+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.992790+0000 front 2024-09-19T04:27:28.992942+0000 (oldest deadline 2024-09-19T04:27:51.892622+0000) 2024-09-19T04:27:54.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:27:54 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:27:54.550+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:27:54.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:27:54 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:27:54.550+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:27:54.989 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:27:54 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:27:54.659+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:27:54.989 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:27:54 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:27:54.659+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:27:55.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:27:54 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:27:54.672+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:27:55.159 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:27:54 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:27:54.749+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:27:55.244 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:27:55 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:27:55.085+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:29.026975+0000 front 2024-09-19T04:27:29.026958+0000 (oldest deadline 2024-09-19T04:27:54.327146+0000) 2024-09-19T04:27:55.244 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 19 04:27:54 smithi092 podman[70593]: 2024-09-19 04:27:54.891653489 +0000 UTC m=+0.015948597 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:27:55.244 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 19 04:27:55 smithi092 podman[70593]: 2024-09-19 04:27:55.015879841 +0000 UTC m=+0.140174943 container create 5b49e726ba6664f20b36d7283c9d2df255529135410ddd36cecd35e9af19166d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True) 2024-09-19T04:27:55.547 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 19 04:27:55 smithi092 podman[70593]: 2024-09-19 04:27:55.243318154 +0000 UTC m=+0.367613257 container init 5b49e726ba6664f20b36d7283c9d2df255529135410ddd36cecd35e9af19166d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:27:55.547 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 19 04:27:55 smithi092 podman[70593]: 2024-09-19 04:27:55.246618663 +0000 UTC m=+0.370913763 container start 5b49e726ba6664f20b36d7283c9d2df255529135410ddd36cecd35e9af19166d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T04:27:55.547 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 19 04:27:55 smithi092 podman[70593]: 2024-09-19 04:27:55.343516555 +0000 UTC m=+0.467811655 container attach 5b49e726ba6664f20b36d7283c9d2df255529135410ddd36cecd35e9af19166d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2) 2024-09-19T04:27:55.547 INFO:journalctl@ceph.osd.4.smithi092.stdout:Sep 19 04:27:55 smithi092 podman[70593]: 2024-09-19 04:27:55.42878014 +0000 UTC m=+0.553075242 container died 5b49e726ba6664f20b36d7283c9d2df255529135410ddd36cecd35e9af19166d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T04:27:55.658 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:55 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:27:55.305+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:17.613459+0000 front 2024-09-19T04:27:17.613488+0000 (oldest deadline 2024-09-19T04:27:45.214066+0000) 2024-09-19T04:27:55.659 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:55 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:27:55.305+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:27.515314+0000 front 2024-09-19T04:27:27.515444+0000 (oldest deadline 2024-09-19T04:27:50.415224+0000) 2024-09-19T04:27:55.877 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:27:55 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:27:55.412+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.992790+0000 front 2024-09-19T04:27:28.992942+0000 (oldest deadline 2024-09-19T04:27:51.892622+0000) 2024-09-19T04:27:55.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:27:55 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:27:55.583+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:27:55.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:27:55 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:27:55.583+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:27:56.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:27:55 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:27:55.633+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:27:56.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:27:55 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:27:55.633+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:27:56.127 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T04:27:56.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:27:55 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:27:55.658+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:27:56.159 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:27:55 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:27:55.792+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:27:56.169 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:27:56.169 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T04:27:56.169 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T04:27:56.170 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.5 2024-09-19T04:27:56.474 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:56 smithi102 systemd[1]: Stopping Ceph osd.5 for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:27:56.475 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:56 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:27:56.292+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:17.613459+0000 front 2024-09-19T04:27:17.613488+0000 (oldest deadline 2024-09-19T04:27:45.214066+0000) 2024-09-19T04:27:56.475 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:56 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:27:56.292+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:27.515314+0000 front 2024-09-19T04:27:27.515444+0000 (oldest deadline 2024-09-19T04:27:50.415224+0000) 2024-09-19T04:27:56.547 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:27:56 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:27:56.119+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:29.026975+0000 front 2024-09-19T04:27:29.026958+0000 (oldest deadline 2024-09-19T04:27:54.327146+0000) 2024-09-19T04:27:56.817 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:27:56 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:27:56.668+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:27:56.817 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:56 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:27:56.472+0000 7ff6b9fdb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:27:56.817 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:56 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:27:56.472+0000 7ff6b9fdb640 -1 osd.5 94 *** Got signal Terminated *** 2024-09-19T04:27:56.817 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:56 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:27:56.472+0000 7ff6b9fdb640 -1 osd.5 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T04:27:56.877 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:27:56 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:27:56.446+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.992790+0000 front 2024-09-19T04:27:28.992942+0000 (oldest deadline 2024-09-19T04:27:51.892622+0000) 2024-09-19T04:27:56.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:27:56 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:27:56.598+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:27:56.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:27:56 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:27:56.598+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:27:57.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:27:56 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:27:56.595+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:27:57.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:27:56 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:27:56.595+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:27:57.159 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:27:56 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:27:56.816+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:27:57.547 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:27:57 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:27:57.129+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:29.026975+0000 front 2024-09-19T04:27:29.026958+0000 (oldest deadline 2024-09-19T04:27:54.327146+0000) 2024-09-19T04:27:57.659 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:57 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:27:57.302+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:17.613459+0000 front 2024-09-19T04:27:17.613488+0000 (oldest deadline 2024-09-19T04:27:45.214066+0000) 2024-09-19T04:27:57.659 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:57 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:27:57.302+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:27.515314+0000 front 2024-09-19T04:27:27.515444+0000 (oldest deadline 2024-09-19T04:27:50.415224+0000) 2024-09-19T04:27:57.877 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:27:57 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:27:57.398+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.992790+0000 front 2024-09-19T04:27:28.992942+0000 (oldest deadline 2024-09-19T04:27:51.892622+0000) 2024-09-19T04:27:57.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:27:57 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:27:57.591+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:27:57.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:27:57 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:27:57.591+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:27:58.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:27:57 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:27:57.624+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:27:58.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:27:57 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:27:57.624+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:27:58.159 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:27:57 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:27:57.861+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:27:58.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:27:57 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:27:57.696+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:27:58.547 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:27:58 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:27:58.130+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:29.026975+0000 front 2024-09-19T04:27:29.026958+0000 (oldest deadline 2024-09-19T04:27:54.327146+0000) 2024-09-19T04:27:58.611 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:27:58 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:27:58.349+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.992790+0000 front 2024-09-19T04:27:28.992942+0000 (oldest deadline 2024-09-19T04:27:51.892622+0000) 2024-09-19T04:27:58.612 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:27:58 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:27:58.349+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:34.193842+0000 front 2024-09-19T04:27:34.193816+0000 (oldest deadline 2024-09-19T04:27:58.293800+0000) 2024-09-19T04:27:58.659 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:58 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:27:58.284+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:17.613459+0000 front 2024-09-19T04:27:17.613488+0000 (oldest deadline 2024-09-19T04:27:45.214066+0000) 2024-09-19T04:27:58.659 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:58 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:27:58.284+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:27.515314+0000 front 2024-09-19T04:27:27.515444+0000 (oldest deadline 2024-09-19T04:27:50.415224+0000) 2024-09-19T04:27:58.659 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:58 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:27:58.284+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:33.916308+0000 front 2024-09-19T04:27:33.916334+0000 (oldest deadline 2024-09-19T04:27:58.016455+0000) 2024-09-19T04:27:58.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:27:58 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:27:58.610+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:27:58.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:27:58 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:27:58.610+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:27:59.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:27:58 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:27:58.616+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:27:59.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:27:58 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:27:58.616+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:27:59.158 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:27:58 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:27:58.857+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:27:59.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:27:58 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:27:58.715+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:27:59.547 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:27:59 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:27:59.114+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:29.026975+0000 front 2024-09-19T04:27:29.026958+0000 (oldest deadline 2024-09-19T04:27:54.327146+0000) 2024-09-19T04:27:59.586 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:27:59 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:27:59.305+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.992790+0000 front 2024-09-19T04:27:28.992942+0000 (oldest deadline 2024-09-19T04:27:51.892622+0000) 2024-09-19T04:27:59.586 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:27:59 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:27:59.305+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:34.193842+0000 front 2024-09-19T04:27:34.193816+0000 (oldest deadline 2024-09-19T04:27:58.293800+0000) 2024-09-19T04:27:59.659 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:59 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:27:59.296+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:17.613459+0000 front 2024-09-19T04:27:17.613488+0000 (oldest deadline 2024-09-19T04:27:45.214066+0000) 2024-09-19T04:27:59.659 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:59 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:27:59.296+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:27.515314+0000 front 2024-09-19T04:27:27.515444+0000 (oldest deadline 2024-09-19T04:27:50.415224+0000) 2024-09-19T04:27:59.659 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:27:59 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:27:59.296+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:33.916308+0000 front 2024-09-19T04:27:33.916334+0000 (oldest deadline 2024-09-19T04:27:58.016455+0000) 2024-09-19T04:27:59.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:27:59 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:27:59.585+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:27:59.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:27:59 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:27:59.585+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:27:59.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:27:59 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:27:59.585+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:00.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:27:59 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:27:59.574+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:00.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:27:59 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:27:59.574+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:00.158 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:27:59 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:27:59.877+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:28:00.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:27:59 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:27:59.672+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:00.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:27:59 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:27:59.672+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:00.547 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:00 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:00.147+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:29.026975+0000 front 2024-09-19T04:27:29.026958+0000 (oldest deadline 2024-09-19T04:27:54.327146+0000) 2024-09-19T04:28:00.563 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:00 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:28:00.284+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.992790+0000 front 2024-09-19T04:27:28.992942+0000 (oldest deadline 2024-09-19T04:27:51.892622+0000) 2024-09-19T04:28:00.564 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:00 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:28:00.284+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:34.193842+0000 front 2024-09-19T04:27:34.193816+0000 (oldest deadline 2024-09-19T04:27:58.293800+0000) 2024-09-19T04:28:00.655 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:28:00 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:28:00.306+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:17.613459+0000 front 2024-09-19T04:27:17.613488+0000 (oldest deadline 2024-09-19T04:27:45.214066+0000) 2024-09-19T04:28:00.655 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:28:00 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:28:00.306+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:27.515314+0000 front 2024-09-19T04:27:27.515444+0000 (oldest deadline 2024-09-19T04:27:50.415224+0000) 2024-09-19T04:28:00.655 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:28:00 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:28:00.306+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:33.916308+0000 front 2024-09-19T04:27:33.916334+0000 (oldest deadline 2024-09-19T04:27:58.016455+0000) 2024-09-19T04:28:00.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:00 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:00.562+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:00.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:00 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:00.562+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:00.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:00 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:00.562+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:00.909 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:00 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:00.876+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:28:00.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:00 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:00.654+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:00.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:00 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:00.654+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:01.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:00 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:00.591+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:01.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:00 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:00.591+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:01.323 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:01 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:01.144+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:29.026975+0000 front 2024-09-19T04:27:29.026958+0000 (oldest deadline 2024-09-19T04:27:54.327146+0000) 2024-09-19T04:28:01.551 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:01 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:28:01.237+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.992790+0000 front 2024-09-19T04:27:28.992942+0000 (oldest deadline 2024-09-19T04:27:51.892622+0000) 2024-09-19T04:28:01.551 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:01 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:28:01.237+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:34.193842+0000 front 2024-09-19T04:27:34.193816+0000 (oldest deadline 2024-09-19T04:27:58.293800+0000) 2024-09-19T04:28:01.659 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:28:01 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:28:01.325+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:17.613459+0000 front 2024-09-19T04:27:17.613488+0000 (oldest deadline 2024-09-19T04:27:45.214066+0000) 2024-09-19T04:28:01.659 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:28:01 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:28:01.325+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:27.515314+0000 front 2024-09-19T04:27:27.515444+0000 (oldest deadline 2024-09-19T04:27:50.415224+0000) 2024-09-19T04:28:01.659 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:28:01 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5[46877]: 2024-09-19T04:28:01.325+0000 7ff6b65f1640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:33.916308+0000 front 2024-09-19T04:27:33.916334+0000 (oldest deadline 2024-09-19T04:27:58.016455+0000) 2024-09-19T04:28:01.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:01 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:01.549+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:01.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:01 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:01.549+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:01.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:01 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:01.549+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:01.921 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:01 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:01.666+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:01.921 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:01 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:01.666+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:02.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:01 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:01.620+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:02.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:01 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:01.620+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:02.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:01 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:01.620+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:02.333 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:01 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:01.920+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:28:02.333 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:28:02 smithi102 podman[70494]: 2024-09-19 04:28:02.020987907 +0000 UTC m=+5.657485731 container died 53754f1f9c90a7ae01e2067b689d5a4b548a0208051e88f93b060bc6ad226888 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-19T04:28:02.547 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:02 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:02.095+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:29.026975+0000 front 2024-09-19T04:27:29.026958+0000 (oldest deadline 2024-09-19T04:27:54.327146+0000) 2024-09-19T04:28:02.570 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:02 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:28:02.260+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.992790+0000 front 2024-09-19T04:27:28.992942+0000 (oldest deadline 2024-09-19T04:27:51.892622+0000) 2024-09-19T04:28:02.570 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:02 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:28:02.260+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:34.193842+0000 front 2024-09-19T04:27:34.193816+0000 (oldest deadline 2024-09-19T04:27:58.293800+0000) 2024-09-19T04:28:02.633 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:28:02 smithi102 podman[70494]: 2024-09-19 04:28:02.431977007 +0000 UTC m=+6.068474831 container cleanup 53754f1f9c90a7ae01e2067b689d5a4b548a0208051e88f93b060bc6ad226888 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T04:28:02.633 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:28:02 smithi102 bash[70494]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5 2024-09-19T04:28:02.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:02 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:02.569+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:02.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:02 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:02.569+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:02.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:02 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:02.569+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:02.908 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:02 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:02.873+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:28:02.909 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:28:02 smithi102 podman[70509]: 2024-09-19 04:28:02.667060334 +0000 UTC m=+0.645394853 container remove 53754f1f9c90a7ae01e2067b689d5a4b548a0208051e88f93b060bc6ad226888 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-2f599a4) 2024-09-19T04:28:02.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:02 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:02.631+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:02.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:02 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:02.631+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:03.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:02 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:02.627+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:03.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:02 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:02.627+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:03.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:02 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:02.627+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:03.346 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:28:03 smithi102 podman[70598]: 2024-09-19 04:28:02.994676784 +0000 UTC m=+0.015282906 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:28:03.346 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:28:03 smithi102 podman[70598]: 2024-09-19 04:28:03.101116422 +0000 UTC m=+0.121722547 container create 92b8354425e088bae7d46a15c47e9004ec4cb82d69b4fa6a16524f3a49812661 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-19T04:28:03.346 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:28:03 smithi102 podman[70598]: 2024-09-19 04:28:03.345560836 +0000 UTC m=+0.366166958 container init 92b8354425e088bae7d46a15c47e9004ec4cb82d69b4fa6a16524f3a49812661 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:28:03.547 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:03 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:03.066+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:29.026975+0000 front 2024-09-19T04:27:29.026958+0000 (oldest deadline 2024-09-19T04:27:54.327146+0000) 2024-09-19T04:28:03.547 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:03 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:03.066+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:34.828334+0000 front 2024-09-19T04:27:34.828515+0000 (oldest deadline 2024-09-19T04:28:03.028890+0000) 2024-09-19T04:28:03.577 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:03 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:28:03.272+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.992790+0000 front 2024-09-19T04:27:28.992942+0000 (oldest deadline 2024-09-19T04:27:51.892622+0000) 2024-09-19T04:28:03.577 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:03 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:28:03.272+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:34.193842+0000 front 2024-09-19T04:27:34.193816+0000 (oldest deadline 2024-09-19T04:27:58.293800+0000) 2024-09-19T04:28:03.597 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:28:03 smithi102 podman[70598]: 2024-09-19 04:28:03.348849172 +0000 UTC m=+0.369455294 container start 92b8354425e088bae7d46a15c47e9004ec4cb82d69b4fa6a16524f3a49812661 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True) 2024-09-19T04:28:03.598 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:28:03 smithi102 podman[70598]: 2024-09-19 04:28:03.437109119 +0000 UTC m=+0.457715259 container attach 92b8354425e088bae7d46a15c47e9004ec4cb82d69b4fa6a16524f3a49812661 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:28:03.598 INFO:journalctl@ceph.osd.5.smithi102.stdout:Sep 19 04:28:03 smithi102 podman[70598]: 2024-09-19 04:28:03.536690638 +0000 UTC m=+0.557296760 container died 92b8354425e088bae7d46a15c47e9004ec4cb82d69b4fa6a16524f3a49812661 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T04:28:03.860 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:03 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:03.595+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:03.860 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:03 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:03.596+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:03.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:03 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:03.575+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:03.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:03 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:03.575+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:03.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:03 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:03.575+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:04.038 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:03 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:03.644+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:04.038 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:03 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:03.644+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:04.039 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:03 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:03.644+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:04.158 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:03 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:03.859+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:28:04.159 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:03 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:03.859+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.214554+0000 front 2024-09-19T04:27:37.214575+0000 (oldest deadline 2024-09-19T04:28:03.114647+0000) 2024-09-19T04:28:04.234 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T04:28:04.273 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:28:04.273 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T04:28:04.273 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-19T04:28:04.273 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.6 2024-09-19T04:28:04.296 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:04 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:04.036+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:29.026975+0000 front 2024-09-19T04:27:29.026958+0000 (oldest deadline 2024-09-19T04:27:54.327146+0000) 2024-09-19T04:28:04.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:04 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:04.036+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:34.828334+0000 front 2024-09-19T04:27:34.828515+0000 (oldest deadline 2024-09-19T04:28:03.028890+0000) 2024-09-19T04:28:04.593 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:04 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:28:04.268+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.992790+0000 front 2024-09-19T04:27:28.992942+0000 (oldest deadline 2024-09-19T04:27:51.892622+0000) 2024-09-19T04:28:04.594 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:04 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:28:04.268+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:34.193842+0000 front 2024-09-19T04:27:34.193816+0000 (oldest deadline 2024-09-19T04:27:58.293800+0000) 2024-09-19T04:28:04.594 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:04 smithi007 systemd[1]: Stopping Ceph osd.6 for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:28:04.873 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:04 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:04.550+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:04.873 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:04 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:04.550+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:04.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:04 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:04.600+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:04.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:04 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:04.600+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:04.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:04 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:04.600+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:04.877 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:04 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:28:04.592+0000 7f44c9e53640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:28:04.877 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:04 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:28:04.592+0000 7f44c9e53640 -1 osd.6 94 *** Got signal Terminated *** 2024-09-19T04:28:04.877 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:04 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:28:04.592+0000 7f44c9e53640 -1 osd.6 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T04:28:05.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:04 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:04.630+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:05.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:04 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:04.630+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:05.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:04 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:04.630+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:05.064 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:05 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:05.061+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:29.026975+0000 front 2024-09-19T04:27:29.026958+0000 (oldest deadline 2024-09-19T04:27:54.327146+0000) 2024-09-19T04:28:05.065 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:05 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:05.061+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:34.828334+0000 front 2024-09-19T04:27:34.828515+0000 (oldest deadline 2024-09-19T04:28:03.028890+0000) 2024-09-19T04:28:05.159 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:04 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:04.872+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:28:05.159 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:04 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:04.872+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.214554+0000 front 2024-09-19T04:27:37.214575+0000 (oldest deadline 2024-09-19T04:28:03.114647+0000) 2024-09-19T04:28:05.600 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:05 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:28:05.241+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.992790+0000 front 2024-09-19T04:27:28.992942+0000 (oldest deadline 2024-09-19T04:27:51.892622+0000) 2024-09-19T04:28:05.600 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:05 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:28:05.241+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:34.193842+0000 front 2024-09-19T04:27:34.193816+0000 (oldest deadline 2024-09-19T04:27:58.293800+0000) 2024-09-19T04:28:05.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:05 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:05.599+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:05.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:05 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:05.599+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:05.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:05 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:05.599+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:05.908 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:05 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:05.502+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:05.908 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:05 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:05.502+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:06.032 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:05 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:05.608+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:06.033 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:05 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:05.608+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:06.033 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:05 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:05.608+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:06.158 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:05 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:05.907+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:28:06.159 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:05 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:05.907+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.214554+0000 front 2024-09-19T04:27:37.214575+0000 (oldest deadline 2024-09-19T04:28:03.114647+0000) 2024-09-19T04:28:06.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:06 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:06.030+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:29.026975+0000 front 2024-09-19T04:27:29.026958+0000 (oldest deadline 2024-09-19T04:27:54.327146+0000) 2024-09-19T04:28:06.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:06 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:06.030+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:34.828334+0000 front 2024-09-19T04:27:34.828515+0000 (oldest deadline 2024-09-19T04:28:03.028890+0000) 2024-09-19T04:28:06.627 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:06 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:28:06.247+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.992790+0000 front 2024-09-19T04:27:28.992942+0000 (oldest deadline 2024-09-19T04:27:51.892622+0000) 2024-09-19T04:28:06.683 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:06 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:28:06.247+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:34.193842+0000 front 2024-09-19T04:27:34.193816+0000 (oldest deadline 2024-09-19T04:27:58.293800+0000) 2024-09-19T04:28:06.862 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:06 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:06.521+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:06.863 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:06 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:06.521+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:06.898 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:06 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:06.641+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:06.898 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:06 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:06.641+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:06.898 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:06 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:06.641+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:07.001 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:06 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:06.631+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:07.002 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:06 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:06.631+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:07.002 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:06 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:06.631+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:07.002 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:06 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:06.631+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:07.159 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:06 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:06.861+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:28:07.159 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:06 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:06.861+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.214554+0000 front 2024-09-19T04:27:37.214575+0000 (oldest deadline 2024-09-19T04:28:03.114647+0000) 2024-09-19T04:28:07.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:07 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:07.000+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:29.026975+0000 front 2024-09-19T04:27:29.026958+0000 (oldest deadline 2024-09-19T04:27:54.327146+0000) 2024-09-19T04:28:07.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:07 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:07.000+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:34.828334+0000 front 2024-09-19T04:27:34.828515+0000 (oldest deadline 2024-09-19T04:28:03.028890+0000) 2024-09-19T04:28:07.627 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:07 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:28:07.267+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.992790+0000 front 2024-09-19T04:27:28.992942+0000 (oldest deadline 2024-09-19T04:27:51.892622+0000) 2024-09-19T04:28:07.627 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:07 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:28:07.267+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:34.193842+0000 front 2024-09-19T04:27:34.193816+0000 (oldest deadline 2024-09-19T04:27:58.293800+0000) 2024-09-19T04:28:07.907 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:07 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:07.507+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:07.907 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:07 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:07.507+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:08.040 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:07 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:07.623+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:08.041 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:07 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:07.623+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:08.041 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:07 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:07.623+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:08.041 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:07 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:07.623+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:08.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:07 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:07.662+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:08.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:07 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:07.662+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:08.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:07 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:07.662+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:08.158 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:07 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:07.905+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:28:08.159 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:07 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:07.905+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.214554+0000 front 2024-09-19T04:27:37.214575+0000 (oldest deadline 2024-09-19T04:28:03.114647+0000) 2024-09-19T04:28:08.159 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:07 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:07.905+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:44.215640+0000 front 2024-09-19T04:27:44.215727+0000 (oldest deadline 2024-09-19T04:28:07.715644+0000) 2024-09-19T04:28:08.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:08 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:08.039+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:29.026975+0000 front 2024-09-19T04:27:29.026958+0000 (oldest deadline 2024-09-19T04:27:54.327146+0000) 2024-09-19T04:28:08.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:08 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:08.039+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:34.828334+0000 front 2024-09-19T04:27:34.828515+0000 (oldest deadline 2024-09-19T04:28:03.028890+0000) 2024-09-19T04:28:08.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:08 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:08.039+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.029423+0000 front 2024-09-19T04:27:43.029306+0000 (oldest deadline 2024-09-19T04:28:07.029873+0000) 2024-09-19T04:28:08.627 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:08 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:28:08.223+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.992790+0000 front 2024-09-19T04:27:28.992942+0000 (oldest deadline 2024-09-19T04:27:51.892622+0000) 2024-09-19T04:28:08.627 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:08 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:28:08.223+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:34.193842+0000 front 2024-09-19T04:27:34.193816+0000 (oldest deadline 2024-09-19T04:27:58.293800+0000) 2024-09-19T04:28:08.859 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:08 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:08.477+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:08.859 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:08 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:08.477+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:08.859 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:08 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:08.477+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:08.998 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:08 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:08.636+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:08.998 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:08 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:08.636+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:08.998 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:08 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:08.636+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:08.998 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:08 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:08.636+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:09.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:08 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:08.640+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:09.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:08 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:08.640+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:09.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:08 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:08.640+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:09.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:08 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:08.640+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:45.061521+0000 front 2024-09-19T04:27:45.061546+0000 (oldest deadline 2024-09-19T04:28:08.561707+0000) 2024-09-19T04:28:09.158 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:08 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:08.858+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:28:09.158 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:08 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:08.858+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.214554+0000 front 2024-09-19T04:27:37.214575+0000 (oldest deadline 2024-09-19T04:28:03.114647+0000) 2024-09-19T04:28:09.159 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:08 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:08.858+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:44.215640+0000 front 2024-09-19T04:27:44.215727+0000 (oldest deadline 2024-09-19T04:28:07.715644+0000) 2024-09-19T04:28:09.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:08 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:08.996+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:29.026975+0000 front 2024-09-19T04:27:29.026958+0000 (oldest deadline 2024-09-19T04:27:54.327146+0000) 2024-09-19T04:28:09.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:08 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:08.996+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:34.828334+0000 front 2024-09-19T04:27:34.828515+0000 (oldest deadline 2024-09-19T04:28:03.028890+0000) 2024-09-19T04:28:09.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:08 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:08.996+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.029423+0000 front 2024-09-19T04:27:43.029306+0000 (oldest deadline 2024-09-19T04:28:07.029873+0000) 2024-09-19T04:28:09.615 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:09 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:28:09.241+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.992790+0000 front 2024-09-19T04:27:28.992942+0000 (oldest deadline 2024-09-19T04:27:51.892622+0000) 2024-09-19T04:28:09.615 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:09 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6[58116]: 2024-09-19T04:28:09.241+0000 7f44c6469640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:34.193842+0000 front 2024-09-19T04:27:34.193816+0000 (oldest deadline 2024-09-19T04:27:58.293800+0000) 2024-09-19T04:28:09.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:09 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:09.613+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:09.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:09 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:09.613+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:09.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:09 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:09.613+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:09.877 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:09 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:09.613+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:45.061521+0000 front 2024-09-19T04:27:45.061546+0000 (oldest deadline 2024-09-19T04:28:08.561707+0000) 2024-09-19T04:28:09.895 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:09 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:09.447+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:09.896 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:09 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:09.447+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:09.896 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:09 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:09.447+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:09.963 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:09 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:09.619+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:09.963 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:09 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:09.619+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:09.963 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:09 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:09.619+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:09.963 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:09 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:09.619+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:10.159 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:09 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:09.894+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:28:10.159 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:09 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:09.894+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.214554+0000 front 2024-09-19T04:27:37.214575+0000 (oldest deadline 2024-09-19T04:28:03.114647+0000) 2024-09-19T04:28:10.159 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:09 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:09.894+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:44.215640+0000 front 2024-09-19T04:27:44.215727+0000 (oldest deadline 2024-09-19T04:28:07.715644+0000) 2024-09-19T04:28:10.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:09 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:09.962+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:29.026975+0000 front 2024-09-19T04:27:29.026958+0000 (oldest deadline 2024-09-19T04:27:54.327146+0000) 2024-09-19T04:28:10.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:09 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:09.962+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:34.828334+0000 front 2024-09-19T04:27:34.828515+0000 (oldest deadline 2024-09-19T04:28:03.028890+0000) 2024-09-19T04:28:10.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:09 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:09.962+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.029423+0000 front 2024-09-19T04:27:43.029306+0000 (oldest deadline 2024-09-19T04:28:07.029873+0000) 2024-09-19T04:28:10.353 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:10 smithi007 podman[100668]: 2024-09-19 04:28:10.075024532 +0000 UTC m=+5.595415989 container died d37d7afe6fd1a1b7dead5151a4458323bd362a52a2216536f1e652837d2dd0ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T04:28:10.627 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:10 smithi007 podman[100668]: 2024-09-19 04:28:10.442481638 +0000 UTC m=+5.962873086 container cleanup d37d7afe6fd1a1b7dead5151a4458323bd362a52a2216536f1e652837d2dd0ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-19T04:28:10.627 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:10 smithi007 bash[100668]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6 2024-09-19T04:28:10.897 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:10 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:10.408+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:10.897 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:10 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:10.408+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:10.897 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:10 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:10.408+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:10.917 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:10 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:10.605+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:10.918 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:10 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:10.605+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:10.918 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:10 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:10.605+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:10.918 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:10 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:10.605+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:11.078 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:10 smithi007 podman[100695]: 2024-09-19 04:28:10.71859264 +0000 UTC m=+0.638953174 container remove d37d7afe6fd1a1b7dead5151a4458323bd362a52a2216536f1e652837d2dd0ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T04:28:11.078 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:10 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:10.650+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:11.078 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:10 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:10.650+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:11.079 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:10 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:10.650+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:11.079 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:10 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:10.650+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:45.061521+0000 front 2024-09-19T04:27:45.061546+0000 (oldest deadline 2024-09-19T04:28:08.561707+0000) 2024-09-19T04:28:11.159 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:10 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:10.895+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:28:11.159 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:10 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:10.895+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.214554+0000 front 2024-09-19T04:27:37.214575+0000 (oldest deadline 2024-09-19T04:28:03.114647+0000) 2024-09-19T04:28:11.159 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:10 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:10.895+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:44.215640+0000 front 2024-09-19T04:27:44.215727+0000 (oldest deadline 2024-09-19T04:28:07.715644+0000) 2024-09-19T04:28:11.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:10 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:10.916+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:29.026975+0000 front 2024-09-19T04:27:29.026958+0000 (oldest deadline 2024-09-19T04:27:54.327146+0000) 2024-09-19T04:28:11.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:10 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:10.916+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:34.828334+0000 front 2024-09-19T04:27:34.828515+0000 (oldest deadline 2024-09-19T04:28:03.028890+0000) 2024-09-19T04:28:11.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:10 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:10.916+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.029423+0000 front 2024-09-19T04:27:43.029306+0000 (oldest deadline 2024-09-19T04:28:07.029873+0000) 2024-09-19T04:28:11.372 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:11 smithi007 podman[100786]: 2024-09-19 04:28:10.980585733 +0000 UTC m=+0.017048165 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:28:11.372 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:11 smithi007 podman[100786]: 2024-09-19 04:28:11.139048873 +0000 UTC m=+0.175511292 container create de9620a71da373504a7d62b515575d32e98d1a6f8c53f3975d3eb698c7cfd56b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T04:28:11.627 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:11 smithi007 podman[100786]: 2024-09-19 04:28:11.371935536 +0000 UTC m=+0.408397965 container init de9620a71da373504a7d62b515575d32e98d1a6f8c53f3975d3eb698c7cfd56b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:28:11.627 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:11 smithi007 podman[100786]: 2024-09-19 04:28:11.375380913 +0000 UTC m=+0.411843335 container start de9620a71da373504a7d62b515575d32e98d1a6f8c53f3975d3eb698c7cfd56b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T04:28:11.627 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:11 smithi007 podman[100786]: 2024-09-19 04:28:11.472166954 +0000 UTC m=+0.508629392 container attach de9620a71da373504a7d62b515575d32e98d1a6f8c53f3975d3eb698c7cfd56b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T04:28:11.627 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 19 04:28:11 smithi007 podman[100786]: 2024-09-19 04:28:11.570653079 +0000 UTC m=+0.607115507 container died de9620a71da373504a7d62b515575d32e98d1a6f8c53f3975d3eb698c7cfd56b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T04:28:11.902 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:11 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:11.587+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:11.902 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:11 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:11.587+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:11.902 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:11 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:11.587+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:11.902 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:11 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:11.587+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:11.908 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:11 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:11.436+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:11.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:11 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:11.436+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:11.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:11 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:11.436+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:12.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:11 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:11.679+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:12.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:11 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:11.679+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:12.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:11 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:11.679+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:12.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:11 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:11.679+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:45.061521+0000 front 2024-09-19T04:27:45.061546+0000 (oldest deadline 2024-09-19T04:28:08.561707+0000) 2024-09-19T04:28:12.173 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.6.service' 2024-09-19T04:28:12.217 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:28:12.217 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-19T04:28:12.217 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-19T04:28:12.217 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.7 2024-09-19T04:28:12.245 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:11 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:11.900+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:29.026975+0000 front 2024-09-19T04:27:29.026958+0000 (oldest deadline 2024-09-19T04:27:54.327146+0000) 2024-09-19T04:28:12.245 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:11 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:11.900+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:34.828334+0000 front 2024-09-19T04:27:34.828515+0000 (oldest deadline 2024-09-19T04:28:03.028890+0000) 2024-09-19T04:28:12.245 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:11 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:11.900+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.029423+0000 front 2024-09-19T04:27:43.029306+0000 (oldest deadline 2024-09-19T04:28:07.029873+0000) 2024-09-19T04:28:12.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:11 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:11.939+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:28:12.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:11 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:11.939+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.214554+0000 front 2024-09-19T04:27:37.214575+0000 (oldest deadline 2024-09-19T04:28:03.114647+0000) 2024-09-19T04:28:12.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:11 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:11.939+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:44.215640+0000 front 2024-09-19T04:27:44.215727+0000 (oldest deadline 2024-09-19T04:28:07.715644+0000) 2024-09-19T04:28:12.547 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:12 smithi092 systemd[1]: Stopping Ceph osd.7 for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:28:12.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:12 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:12.425+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:12.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:12 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:12.425+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:12.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:12 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:12.425+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:12.934 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:12 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:12.549+0000 7efdde6e0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:28:12.934 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:12 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:12.549+0000 7efdde6e0640 -1 osd.7 94 *** Got signal Terminated *** 2024-09-19T04:28:12.934 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:12 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:12.549+0000 7efdde6e0640 -1 osd.7 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T04:28:12.934 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:12 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:12.562+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:12.934 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:12 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:12.562+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:12.935 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:12 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:12.562+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:12.935 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:12 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:12.562+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:13.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:12 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:12.645+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:13.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:12 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:12.645+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:13.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:12 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:12.645+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:13.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:12 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:12.645+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:45.061521+0000 front 2024-09-19T04:27:45.061546+0000 (oldest deadline 2024-09-19T04:28:08.561707+0000) 2024-09-19T04:28:13.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:12 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:12.932+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:29.026975+0000 front 2024-09-19T04:27:29.026958+0000 (oldest deadline 2024-09-19T04:27:54.327146+0000) 2024-09-19T04:28:13.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:12 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:12.932+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:34.828334+0000 front 2024-09-19T04:27:34.828515+0000 (oldest deadline 2024-09-19T04:28:03.028890+0000) 2024-09-19T04:28:13.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:12 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:12.932+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.029423+0000 front 2024-09-19T04:27:43.029306+0000 (oldest deadline 2024-09-19T04:28:07.029873+0000) 2024-09-19T04:28:13.408 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:12 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:12.985+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:28:13.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:12 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:12.985+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.214554+0000 front 2024-09-19T04:27:37.214575+0000 (oldest deadline 2024-09-19T04:28:03.114647+0000) 2024-09-19T04:28:13.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:12 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:12.985+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:44.215640+0000 front 2024-09-19T04:27:44.215727+0000 (oldest deadline 2024-09-19T04:28:07.715644+0000) 2024-09-19T04:28:13.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:13 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:13.536+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:13.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:13 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:13.536+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:13.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:13 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:13.536+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:13.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:13 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:13.536+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:13.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:13 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:13.450+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:13.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:13 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:13.450+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:13.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:13 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:13.450+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:14.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:13 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:13.639+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:14.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:13 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:13.639+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:14.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:13 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:13.639+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:14.128 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:13 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:13.639+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:45.061521+0000 front 2024-09-19T04:27:45.061546+0000 (oldest deadline 2024-09-19T04:28:08.561707+0000) 2024-09-19T04:28:14.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:13 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:13.933+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:29.026975+0000 front 2024-09-19T04:27:29.026958+0000 (oldest deadline 2024-09-19T04:27:54.327146+0000) 2024-09-19T04:28:14.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:13 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:13.933+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:34.828334+0000 front 2024-09-19T04:27:34.828515+0000 (oldest deadline 2024-09-19T04:28:03.028890+0000) 2024-09-19T04:28:14.298 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:13 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:13.933+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.029423+0000 front 2024-09-19T04:27:43.029306+0000 (oldest deadline 2024-09-19T04:28:07.029873+0000) 2024-09-19T04:28:14.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:14 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:14.004+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:28:14.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:14 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:14.004+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.214554+0000 front 2024-09-19T04:27:37.214575+0000 (oldest deadline 2024-09-19T04:28:03.114647+0000) 2024-09-19T04:28:14.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:14 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:14.004+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:44.215640+0000 front 2024-09-19T04:27:44.215727+0000 (oldest deadline 2024-09-19T04:28:07.715644+0000) 2024-09-19T04:28:14.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:14 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:14.538+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:14.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:14 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:14.538+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:14.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:14 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:14.538+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:14.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:14 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:14.538+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:14.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:14 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:14.493+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:14.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:14 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:14.493+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:14.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:14 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:14.493+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:15.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:14 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:14.656+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:15.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:14 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:14.656+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:15.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:14 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:14.656+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:15.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:14 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:14.656+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:45.061521+0000 front 2024-09-19T04:27:45.061546+0000 (oldest deadline 2024-09-19T04:28:08.561707+0000) 2024-09-19T04:28:15.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:14 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:14.656+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:49.662723+0000 front 2024-09-19T04:27:49.662814+0000 (oldest deadline 2024-09-19T04:28:14.362799+0000) 2024-09-19T04:28:15.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:14 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:14.922+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:29.026975+0000 front 2024-09-19T04:27:29.026958+0000 (oldest deadline 2024-09-19T04:27:54.327146+0000) 2024-09-19T04:28:15.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:14 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:14.922+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:34.828334+0000 front 2024-09-19T04:27:34.828515+0000 (oldest deadline 2024-09-19T04:28:03.028890+0000) 2024-09-19T04:28:15.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:14 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:14.922+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.029423+0000 front 2024-09-19T04:27:43.029306+0000 (oldest deadline 2024-09-19T04:28:07.029873+0000) 2024-09-19T04:28:15.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:15 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:15.048+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:28:15.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:15 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:15.048+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.214554+0000 front 2024-09-19T04:27:37.214575+0000 (oldest deadline 2024-09-19T04:28:03.114647+0000) 2024-09-19T04:28:15.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:15 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:15.048+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:44.215640+0000 front 2024-09-19T04:27:44.215727+0000 (oldest deadline 2024-09-19T04:28:07.715644+0000) 2024-09-19T04:28:15.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:15 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:15.536+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:15.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:15 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:15.536+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:15.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:15 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:15.536+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:15.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:15 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:15.536+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:15.908 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:15 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:15.457+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:15.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:15 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:15.457+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:15.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:15 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:15.457+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:15.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:15 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:15.457+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:16.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:15 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:15.706+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:16.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:15 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:15.706+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:16.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:15 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:15.706+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:16.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:15 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:15.706+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:45.061521+0000 front 2024-09-19T04:27:45.061546+0000 (oldest deadline 2024-09-19T04:28:08.561707+0000) 2024-09-19T04:28:16.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:15 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:15.706+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:49.662723+0000 front 2024-09-19T04:27:49.662814+0000 (oldest deadline 2024-09-19T04:28:14.362799+0000) 2024-09-19T04:28:16.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:15 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:15.885+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:29.026975+0000 front 2024-09-19T04:27:29.026958+0000 (oldest deadline 2024-09-19T04:27:54.327146+0000) 2024-09-19T04:28:16.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:15 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:15.885+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:34.828334+0000 front 2024-09-19T04:27:34.828515+0000 (oldest deadline 2024-09-19T04:28:03.028890+0000) 2024-09-19T04:28:16.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:15 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:15.885+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.029423+0000 front 2024-09-19T04:27:43.029306+0000 (oldest deadline 2024-09-19T04:28:07.029873+0000) 2024-09-19T04:28:16.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:16 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:16.014+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:28:16.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:16 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:16.014+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.214554+0000 front 2024-09-19T04:27:37.214575+0000 (oldest deadline 2024-09-19T04:28:03.114647+0000) 2024-09-19T04:28:16.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:16 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:16.014+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:44.215640+0000 front 2024-09-19T04:27:44.215727+0000 (oldest deadline 2024-09-19T04:28:07.715644+0000) 2024-09-19T04:28:16.891 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:16 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:16.577+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:16.891 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:16 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:16.577+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:16.891 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:16 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:16.577+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:16.892 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:16 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:16.577+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:16.892 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:16 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:16.577+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.397950+0000 front 2024-09-19T04:27:52.397993+0000 (oldest deadline 2024-09-19T04:28:15.898023+0000) 2024-09-19T04:28:16.908 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:16 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:16.461+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:16.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:16 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:16.461+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:16.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:16 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:16.461+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:16.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:16 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:16.461+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:17.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:16 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:16.742+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:17.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:16 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:16.742+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:17.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:16 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:16.742+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:17.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:16 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:16.742+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:45.061521+0000 front 2024-09-19T04:27:45.061546+0000 (oldest deadline 2024-09-19T04:28:08.561707+0000) 2024-09-19T04:28:17.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:16 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:16.742+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:49.662723+0000 front 2024-09-19T04:27:49.662814+0000 (oldest deadline 2024-09-19T04:28:14.362799+0000) 2024-09-19T04:28:17.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:16 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:16.890+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:29.026975+0000 front 2024-09-19T04:27:29.026958+0000 (oldest deadline 2024-09-19T04:27:54.327146+0000) 2024-09-19T04:28:17.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:16 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:16.890+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:34.828334+0000 front 2024-09-19T04:27:34.828515+0000 (oldest deadline 2024-09-19T04:28:03.028890+0000) 2024-09-19T04:28:17.297 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:16 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7[53253]: 2024-09-19T04:28:16.890+0000 7efdd6cee640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.029423+0000 front 2024-09-19T04:27:43.029306+0000 (oldest deadline 2024-09-19T04:28:07.029873+0000) 2024-09-19T04:28:17.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:17 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:17.024+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:28:17.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:17 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:17.024+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.214554+0000 front 2024-09-19T04:27:37.214575+0000 (oldest deadline 2024-09-19T04:28:03.114647+0000) 2024-09-19T04:28:17.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:17 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:17.024+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:44.215640+0000 front 2024-09-19T04:27:44.215727+0000 (oldest deadline 2024-09-19T04:28:07.715644+0000) 2024-09-19T04:28:17.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:17 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:17.496+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:17.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:17 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:17.496+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:17.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:17 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:17.496+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:17.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:17 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:17.496+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:18.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:17 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:17.550+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:18.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:17 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:17.550+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:18.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:17 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:17.550+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:18.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:17 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:17.550+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:18.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:17 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:17.550+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.397950+0000 front 2024-09-19T04:27:52.397993+0000 (oldest deadline 2024-09-19T04:28:15.898023+0000) 2024-09-19T04:28:18.128 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:17 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:17.742+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:18.128 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:17 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:17.742+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:18.129 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:17 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:17.742+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:18.129 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:17 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:17.742+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:45.061521+0000 front 2024-09-19T04:27:45.061546+0000 (oldest deadline 2024-09-19T04:28:08.561707+0000) 2024-09-19T04:28:18.129 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:17 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:17.742+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:49.662723+0000 front 2024-09-19T04:27:49.662814+0000 (oldest deadline 2024-09-19T04:28:14.362799+0000) 2024-09-19T04:28:18.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:18 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:18.005+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:28:18.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:18 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:18.005+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.214554+0000 front 2024-09-19T04:27:37.214575+0000 (oldest deadline 2024-09-19T04:28:03.114647+0000) 2024-09-19T04:28:18.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:18 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:18.005+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:44.215640+0000 front 2024-09-19T04:27:44.215727+0000 (oldest deadline 2024-09-19T04:28:07.715644+0000) 2024-09-19T04:28:18.435 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:18 smithi092 podman[70707]: 2024-09-19 04:28:18.126375731 +0000 UTC m=+5.705237301 container died ad0b486fdcc64dcf4a1226132604fcf0aaa1fc1a670bfe6081fc1c3e2ad79432 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T04:28:18.777 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:18 smithi092 podman[70707]: 2024-09-19 04:28:18.541297746 +0000 UTC m=+6.120159323 container cleanup ad0b486fdcc64dcf4a1226132604fcf0aaa1fc1a670bfe6081fc1c3e2ad79432 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-19T04:28:18.777 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:18 smithi092 bash[70707]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7 2024-09-19T04:28:18.777 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:18 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:18.508+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:18.777 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:18 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:18.508+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:18.777 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:18 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:18.508+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:18.777 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:18 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:18.508+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:18.778 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:18 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:18.508+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.397950+0000 front 2024-09-19T04:27:52.397993+0000 (oldest deadline 2024-09-19T04:28:15.898023+0000) 2024-09-19T04:28:18.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:18 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:18.536+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:18.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:18 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:18.536+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:18.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:18 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:18.536+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:18.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:18 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:18.536+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:19.046 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:18 smithi092 podman[70722]: 2024-09-19 04:28:18.776123069 +0000 UTC m=+0.639165333 container remove ad0b486fdcc64dcf4a1226132604fcf0aaa1fc1a670bfe6081fc1c3e2ad79432 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T04:28:19.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:18 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:18.767+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:19.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:18 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:18.767+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:19.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:18 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:18.767+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:19.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:18 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:18.767+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:45.061521+0000 front 2024-09-19T04:27:45.061546+0000 (oldest deadline 2024-09-19T04:28:08.561707+0000) 2024-09-19T04:28:19.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:18 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:18.767+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:49.662723+0000 front 2024-09-19T04:27:49.662814+0000 (oldest deadline 2024-09-19T04:28:14.362799+0000) 2024-09-19T04:28:19.339 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:19 smithi092 podman[70809]: 2024-09-19 04:28:18.988473919 +0000 UTC m=+0.016243985 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:28:19.339 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:19 smithi092 podman[70809]: 2024-09-19 04:28:19.102215479 +0000 UTC m=+0.129985540 container create 7bd38e59020b85d4141d91f9f83597e6158da6277432b2b9171105db7ebdb36d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T04:28:19.339 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:19 smithi092 podman[70809]: 2024-09-19 04:28:19.337986334 +0000 UTC m=+0.365756403 container init 7bd38e59020b85d4141d91f9f83597e6158da6277432b2b9171105db7ebdb36d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:28:19.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:18 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:18.980+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:28:19.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:18 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:18.980+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.214554+0000 front 2024-09-19T04:27:37.214575+0000 (oldest deadline 2024-09-19T04:28:03.114647+0000) 2024-09-19T04:28:19.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:18 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:18.980+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:44.215640+0000 front 2024-09-19T04:27:44.215727+0000 (oldest deadline 2024-09-19T04:28:07.715644+0000) 2024-09-19T04:28:19.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:18 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:18.980+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.416658+0000 front 2024-09-19T04:27:52.416671+0000 (oldest deadline 2024-09-19T04:28:18.316631+0000) 2024-09-19T04:28:19.797 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:19 smithi092 podman[70809]: 2024-09-19 04:28:19.341747977 +0000 UTC m=+0.369518043 container start 7bd38e59020b85d4141d91f9f83597e6158da6277432b2b9171105db7ebdb36d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T04:28:19.797 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:19 smithi092 podman[70809]: 2024-09-19 04:28:19.446363356 +0000 UTC m=+0.474133457 container attach 7bd38e59020b85d4141d91f9f83597e6158da6277432b2b9171105db7ebdb36d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7-deactivate, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-19T04:28:19.797 INFO:journalctl@ceph.osd.7.smithi092.stdout:Sep 19 04:28:19 smithi092 podman[70809]: 2024-09-19 04:28:19.530839213 +0000 UTC m=+0.558609273 container died 7bd38e59020b85d4141d91f9f83597e6158da6277432b2b9171105db7ebdb36d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T04:28:19.798 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:19 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:19.554+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:19.798 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:19 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:19.554+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:19.798 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:19 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:19.554+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:19.798 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:19 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:19.554+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:19.798 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:19 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:19.554+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.397950+0000 front 2024-09-19T04:27:52.397993+0000 (oldest deadline 2024-09-19T04:28:15.898023+0000) 2024-09-19T04:28:19.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:19 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:19.559+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:19.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:19 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:19.559+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:19.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:19 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:19.559+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:19.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:19 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:19.559+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:20.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:19 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:19.742+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:20.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:19 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:19.742+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:20.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:19 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:19.742+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:20.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:19 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:19.742+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:45.061521+0000 front 2024-09-19T04:27:45.061546+0000 (oldest deadline 2024-09-19T04:28:08.561707+0000) 2024-09-19T04:28:20.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:19 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:19.742+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:49.662723+0000 front 2024-09-19T04:27:49.662814+0000 (oldest deadline 2024-09-19T04:28:14.362799+0000) 2024-09-19T04:28:20.136 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.7.service' 2024-09-19T04:28:20.219 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:28:20.219 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-19T04:28:20.219 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-19T04:28:20.219 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.8 2024-09-19T04:28:20.245 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:19 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:19.950+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:28:20.245 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:19 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:19.950+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.214554+0000 front 2024-09-19T04:27:37.214575+0000 (oldest deadline 2024-09-19T04:28:03.114647+0000) 2024-09-19T04:28:20.245 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:19 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:19.950+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:44.215640+0000 front 2024-09-19T04:27:44.215727+0000 (oldest deadline 2024-09-19T04:28:07.715644+0000) 2024-09-19T04:28:20.245 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:19 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:19.950+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.416658+0000 front 2024-09-19T04:27:52.416671+0000 (oldest deadline 2024-09-19T04:28:18.316631+0000) 2024-09-19T04:28:20.520 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:20 smithi102 systemd[1]: Stopping Ceph osd.8 for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:28:20.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:20 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:20.527+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:20.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:20 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:20.527+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:20.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:20 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:20.527+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:20.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:20 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:20.527+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:20.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:20 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:20.527+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.397950+0000 front 2024-09-19T04:27:52.397993+0000 (oldest deadline 2024-09-19T04:28:15.898023+0000) 2024-09-19T04:28:20.909 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:20 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:20.518+0000 7fdd5cb45640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:28:20.909 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:20 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:20.518+0000 7fdd5cb45640 -1 osd.8 94 *** Got signal Terminated *** 2024-09-19T04:28:20.909 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:20 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:20.518+0000 7fdd5cb45640 -1 osd.8 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T04:28:20.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:20 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:20.542+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:20.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:20 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:20.542+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:20.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:20 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:20.542+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:20.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:20 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:20.542+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:21.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:20 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:20.698+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:21.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:20 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:20.698+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:21.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:20 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:20.698+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:21.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:20 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:20.698+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:45.061521+0000 front 2024-09-19T04:27:45.061546+0000 (oldest deadline 2024-09-19T04:28:08.561707+0000) 2024-09-19T04:28:21.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:20 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:20.698+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:49.662723+0000 front 2024-09-19T04:27:49.662814+0000 (oldest deadline 2024-09-19T04:28:14.362799+0000) 2024-09-19T04:28:21.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:20 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:20.991+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:28:21.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:20 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:20.991+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.214554+0000 front 2024-09-19T04:27:37.214575+0000 (oldest deadline 2024-09-19T04:28:03.114647+0000) 2024-09-19T04:28:21.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:20 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:20.991+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:44.215640+0000 front 2024-09-19T04:27:44.215727+0000 (oldest deadline 2024-09-19T04:28:07.715644+0000) 2024-09-19T04:28:21.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:20 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:20.991+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.416658+0000 front 2024-09-19T04:27:52.416671+0000 (oldest deadline 2024-09-19T04:28:18.316631+0000) 2024-09-19T04:28:21.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:21 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:21.557+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:21.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:21 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:21.557+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:21.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:21 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:21.557+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:21.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:21 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:21.557+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:21.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:21 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:21.557+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.397950+0000 front 2024-09-19T04:27:52.397993+0000 (oldest deadline 2024-09-19T04:28:15.898023+0000) 2024-09-19T04:28:21.908 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:21 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:21.540+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:21.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:21 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:21.540+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:21.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:21 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:21.540+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:21.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:21 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:21.540+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:22.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:21 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:21.686+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:22.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:21 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:21.686+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:22.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:21 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:21.686+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:22.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:21 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:21.686+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:45.061521+0000 front 2024-09-19T04:27:45.061546+0000 (oldest deadline 2024-09-19T04:28:08.561707+0000) 2024-09-19T04:28:22.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:21 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:21.686+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:49.662723+0000 front 2024-09-19T04:27:49.662814+0000 (oldest deadline 2024-09-19T04:28:14.362799+0000) 2024-09-19T04:28:22.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:22 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:22.039+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:28:22.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:22 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:22.039+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.214554+0000 front 2024-09-19T04:27:37.214575+0000 (oldest deadline 2024-09-19T04:28:03.114647+0000) 2024-09-19T04:28:22.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:22 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:22.039+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:44.215640+0000 front 2024-09-19T04:27:44.215727+0000 (oldest deadline 2024-09-19T04:28:07.715644+0000) 2024-09-19T04:28:22.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:22 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:22.039+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.416658+0000 front 2024-09-19T04:27:52.416671+0000 (oldest deadline 2024-09-19T04:28:18.316631+0000) 2024-09-19T04:28:22.908 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:22 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:22.499+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:22.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:22 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:22.499+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:22.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:22 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:22.499+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:22.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:22 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:22.499+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:23.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:22 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:22.561+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:23.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:22 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:22.561+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:23.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:22 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:22.561+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:23.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:22 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:22.561+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:23.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:22 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:22.561+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.397950+0000 front 2024-09-19T04:27:52.397993+0000 (oldest deadline 2024-09-19T04:28:15.898023+0000) 2024-09-19T04:28:23.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:22 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:22.701+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:23.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:22 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:22.701+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:23.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:22 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:22.701+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:23.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:22 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:22.701+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:45.061521+0000 front 2024-09-19T04:27:45.061546+0000 (oldest deadline 2024-09-19T04:28:08.561707+0000) 2024-09-19T04:28:23.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:22 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:22.701+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:49.662723+0000 front 2024-09-19T04:27:49.662814+0000 (oldest deadline 2024-09-19T04:28:14.362799+0000) 2024-09-19T04:28:23.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:22 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:22.701+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.465241+0000 front 2024-09-19T04:27:59.465108+0000 (oldest deadline 2024-09-19T04:28:22.365060+0000) 2024-09-19T04:28:23.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:23 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:23.032+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:28:23.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:23 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:23.032+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.214554+0000 front 2024-09-19T04:27:37.214575+0000 (oldest deadline 2024-09-19T04:28:03.114647+0000) 2024-09-19T04:28:23.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:23 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:23.032+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:44.215640+0000 front 2024-09-19T04:27:44.215727+0000 (oldest deadline 2024-09-19T04:28:07.715644+0000) 2024-09-19T04:28:23.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:23 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:23.032+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.416658+0000 front 2024-09-19T04:27:52.416671+0000 (oldest deadline 2024-09-19T04:28:18.316631+0000) 2024-09-19T04:28:23.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:23 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:23.032+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.417536+0000 front 2024-09-19T04:27:59.417594+0000 (oldest deadline 2024-09-19T04:28:22.317631+0000) 2024-09-19T04:28:23.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:23 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:23.533+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:23.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:23 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:23.533+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:23.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:23 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:23.533+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:23.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:23 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:23.533+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:24.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:23 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:23.548+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:24.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:23 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:23.548+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:24.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:23 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:23.548+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:24.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:23 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:23.548+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:24.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:23 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:23.548+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.397950+0000 front 2024-09-19T04:27:52.397993+0000 (oldest deadline 2024-09-19T04:28:15.898023+0000) 2024-09-19T04:28:24.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:23 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:23.548+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.399297+0000 front 2024-09-19T04:27:59.399330+0000 (oldest deadline 2024-09-19T04:28:22.898933+0000) 2024-09-19T04:28:24.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:23 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:23.727+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:24.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:23 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:23.727+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:24.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:23 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:23.727+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:24.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:23 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:23.727+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:45.061521+0000 front 2024-09-19T04:27:45.061546+0000 (oldest deadline 2024-09-19T04:28:08.561707+0000) 2024-09-19T04:28:24.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:23 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:23.727+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:49.662723+0000 front 2024-09-19T04:27:49.662814+0000 (oldest deadline 2024-09-19T04:28:14.362799+0000) 2024-09-19T04:28:24.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:23 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:23.727+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.465241+0000 front 2024-09-19T04:27:59.465108+0000 (oldest deadline 2024-09-19T04:28:22.365060+0000) 2024-09-19T04:28:24.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:24 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:24.072+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:28:24.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:24 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:24.072+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.214554+0000 front 2024-09-19T04:27:37.214575+0000 (oldest deadline 2024-09-19T04:28:03.114647+0000) 2024-09-19T04:28:24.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:24 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:24.072+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:44.215640+0000 front 2024-09-19T04:27:44.215727+0000 (oldest deadline 2024-09-19T04:28:07.715644+0000) 2024-09-19T04:28:24.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:24 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:24.072+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.416658+0000 front 2024-09-19T04:27:52.416671+0000 (oldest deadline 2024-09-19T04:28:18.316631+0000) 2024-09-19T04:28:24.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:24 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:24.072+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.417536+0000 front 2024-09-19T04:27:59.417594+0000 (oldest deadline 2024-09-19T04:28:22.317631+0000) 2024-09-19T04:28:24.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:24 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:24.516+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:24.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:24 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:24.516+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:24.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:24 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:24.516+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:24.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:24 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:24.516+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:24.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:24 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:24.516+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:57.995370+0000 front 2024-09-19T04:27:57.995399+0000 (oldest deadline 2024-09-19T04:28:23.895469+0000) 2024-09-19T04:28:25.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:24 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:24.572+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:25.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:24 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:24.572+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:25.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:24 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:24.572+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:25.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:24 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:24.572+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:25.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:24 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:24.572+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.397950+0000 front 2024-09-19T04:27:52.397993+0000 (oldest deadline 2024-09-19T04:28:15.898023+0000) 2024-09-19T04:28:25.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:24 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:24.572+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.399297+0000 front 2024-09-19T04:27:59.399330+0000 (oldest deadline 2024-09-19T04:28:22.898933+0000) 2024-09-19T04:28:25.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:24 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:24.738+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:25.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:24 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:24.738+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:25.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:24 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:24.738+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:25.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:24 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:24.738+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:45.061521+0000 front 2024-09-19T04:27:45.061546+0000 (oldest deadline 2024-09-19T04:28:08.561707+0000) 2024-09-19T04:28:25.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:24 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:24.738+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:49.662723+0000 front 2024-09-19T04:27:49.662814+0000 (oldest deadline 2024-09-19T04:28:14.362799+0000) 2024-09-19T04:28:25.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:24 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:24.738+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.465241+0000 front 2024-09-19T04:27:59.465108+0000 (oldest deadline 2024-09-19T04:28:22.365060+0000) 2024-09-19T04:28:25.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:25 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:25.088+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:24.511784+0000 front 2024-09-19T04:27:24.511678+0000 (oldest deadline 2024-09-19T04:27:50.312200+0000) 2024-09-19T04:28:25.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:25 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:25.088+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.214554+0000 front 2024-09-19T04:27:37.214575+0000 (oldest deadline 2024-09-19T04:28:03.114647+0000) 2024-09-19T04:28:25.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:25 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:25.088+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:44.215640+0000 front 2024-09-19T04:27:44.215727+0000 (oldest deadline 2024-09-19T04:28:07.715644+0000) 2024-09-19T04:28:25.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:25 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:25.088+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.416658+0000 front 2024-09-19T04:27:52.416671+0000 (oldest deadline 2024-09-19T04:28:18.316631+0000) 2024-09-19T04:28:25.409 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:25 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8[53637]: 2024-09-19T04:28:25.088+0000 7fdd55153640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.417536+0000 front 2024-09-19T04:27:59.417594+0000 (oldest deadline 2024-09-19T04:28:22.317631+0000) 2024-09-19T04:28:25.913 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:25 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:25.516+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:25.913 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:25 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:25.516+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:25.913 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:25 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:25.516+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:25.913 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:25 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:25.516+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:25.914 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:25 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:25.516+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:57.995370+0000 front 2024-09-19T04:27:57.995399+0000 (oldest deadline 2024-09-19T04:28:23.895469+0000) 2024-09-19T04:28:26.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:25 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:25.605+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:26.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:25 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:25.605+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:26.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:25 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:25.605+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:26.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:25 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:25.605+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:26.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:25 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:25.605+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.397950+0000 front 2024-09-19T04:27:52.397993+0000 (oldest deadline 2024-09-19T04:28:15.898023+0000) 2024-09-19T04:28:26.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:25 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:25.605+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.399297+0000 front 2024-09-19T04:27:59.399330+0000 (oldest deadline 2024-09-19T04:28:22.898933+0000) 2024-09-19T04:28:26.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:25 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:25.737+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:26.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:25 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:25.737+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:26.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:25 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:25.737+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:26.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:25 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:25.737+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:45.061521+0000 front 2024-09-19T04:27:45.061546+0000 (oldest deadline 2024-09-19T04:28:08.561707+0000) 2024-09-19T04:28:26.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:25 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:25.737+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:49.662723+0000 front 2024-09-19T04:27:49.662814+0000 (oldest deadline 2024-09-19T04:28:14.362799+0000) 2024-09-19T04:28:26.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:25 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:25.737+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.465241+0000 front 2024-09-19T04:27:59.465108+0000 (oldest deadline 2024-09-19T04:28:22.365060+0000) 2024-09-19T04:28:26.196 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:25 smithi102 podman[70701]: 2024-09-19 04:28:25.940107916 +0000 UTC m=+5.533401750 container died e0cbb65b89613ed4eb65bd5ac61c97eafbf84d67f641b77c375cf1b4e30db89e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T04:28:26.489 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:26 smithi102 podman[70701]: 2024-09-19 04:28:26.302681912 +0000 UTC m=+5.895975775 container cleanup e0cbb65b89613ed4eb65bd5ac61c97eafbf84d67f641b77c375cf1b4e30db89e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T04:28:26.489 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:26 smithi102 bash[70701]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8 2024-09-19T04:28:26.909 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:26 smithi102 podman[70717]: 2024-09-19 04:28:26.58753958 +0000 UTC m=+0.641168534 container remove e0cbb65b89613ed4eb65bd5ac61c97eafbf84d67f641b77c375cf1b4e30db89e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T04:28:26.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:26 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:26.487+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:26.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:26 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:26.487+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:26.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:26 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:26.487+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:26.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:26 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:26.487+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:26.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:26 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:26.487+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:57.995370+0000 front 2024-09-19T04:27:57.995399+0000 (oldest deadline 2024-09-19T04:28:23.895469+0000) 2024-09-19T04:28:27.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:26 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:26.583+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:27.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:26 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:26.583+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:27.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:26 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:26.583+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:27.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:26 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:26.583+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:27.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:26 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:26.583+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.397950+0000 front 2024-09-19T04:27:52.397993+0000 (oldest deadline 2024-09-19T04:28:15.898023+0000) 2024-09-19T04:28:27.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:26 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:26.583+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.399297+0000 front 2024-09-19T04:27:59.399330+0000 (oldest deadline 2024-09-19T04:28:22.898933+0000) 2024-09-19T04:28:27.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:26 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:26.767+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:27.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:26 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:26.767+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:27.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:26 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:26.767+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:27.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:26 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:26.767+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:45.061521+0000 front 2024-09-19T04:27:45.061546+0000 (oldest deadline 2024-09-19T04:28:08.561707+0000) 2024-09-19T04:28:27.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:26 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:26.767+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:49.662723+0000 front 2024-09-19T04:27:49.662814+0000 (oldest deadline 2024-09-19T04:28:14.362799+0000) 2024-09-19T04:28:27.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:26 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:26.767+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.465241+0000 front 2024-09-19T04:27:59.465108+0000 (oldest deadline 2024-09-19T04:28:22.365060+0000) 2024-09-19T04:28:27.183 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:26 smithi102 podman[70805]: 2024-09-19 04:28:26.921707324 +0000 UTC m=+0.111833800 container create 52c99ee21b3a24ad020f336fb96c901581a2c512c7c7052df714c04dfa13b408 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T04:28:27.183 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:26 smithi102 podman[70805]: 2024-09-19 04:28:26.825764141 +0000 UTC m=+0.015890578 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:28:27.183 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:27 smithi102 podman[70805]: 2024-09-19 04:28:27.182690351 +0000 UTC m=+0.372816794 container init 52c99ee21b3a24ad020f336fb96c901581a2c512c7c7052df714c04dfa13b408 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:28:27.507 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:27 smithi102 podman[70805]: 2024-09-19 04:28:27.186166139 +0000 UTC m=+0.376292574 container start 52c99ee21b3a24ad020f336fb96c901581a2c512c7c7052df714c04dfa13b408 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T04:28:27.507 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:27 smithi102 podman[70805]: 2024-09-19 04:28:27.27411973 +0000 UTC m=+0.464246164 container attach 52c99ee21b3a24ad020f336fb96c901581a2c512c7c7052df714c04dfa13b408 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T04:28:27.507 INFO:journalctl@ceph.osd.8.smithi102.stdout:Sep 19 04:28:27 smithi102 podman[70805]: 2024-09-19 04:28:27.38005708 +0000 UTC m=+0.570183518 container died 52c99ee21b3a24ad020f336fb96c901581a2c512c7c7052df714c04dfa13b408 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-19T04:28:27.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:27 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:27.504+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:27.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:27 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:27.504+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:27.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:27 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:27.504+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:27.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:27 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:27.504+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:27.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:27 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:27.504+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:57.995370+0000 front 2024-09-19T04:27:57.995399+0000 (oldest deadline 2024-09-19T04:28:23.895469+0000) 2024-09-19T04:28:28.038 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.8.service' 2024-09-19T04:28:28.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:27 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:27.614+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:28.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:27 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:27.614+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:28.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:27 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:27.614+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:28.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:27 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:27.614+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:28.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:27 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:27.614+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.397950+0000 front 2024-09-19T04:27:52.397993+0000 (oldest deadline 2024-09-19T04:28:15.898023+0000) 2024-09-19T04:28:28.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:27 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:27.614+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.399297+0000 front 2024-09-19T04:27:59.399330+0000 (oldest deadline 2024-09-19T04:28:22.898933+0000) 2024-09-19T04:28:28.117 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:28:28.117 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-19T04:28:28.117 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-19T04:28:28.117 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.9 2024-09-19T04:28:28.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:27 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:27.719+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:28.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:27 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:27.719+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:28.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:27 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:27.719+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:28.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:27 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:27.719+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:45.061521+0000 front 2024-09-19T04:27:45.061546+0000 (oldest deadline 2024-09-19T04:28:08.561707+0000) 2024-09-19T04:28:28.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:27 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:27.719+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:49.662723+0000 front 2024-09-19T04:27:49.662814+0000 (oldest deadline 2024-09-19T04:28:14.362799+0000) 2024-09-19T04:28:28.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:27 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:27.719+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.465241+0000 front 2024-09-19T04:27:59.465108+0000 (oldest deadline 2024-09-19T04:28:22.365060+0000) 2024-09-19T04:28:28.421 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:28 smithi007 systemd[1]: Stopping Ceph osd.9 for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:28:28.718 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:28 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:28.419+0000 7f2dd84b3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:28:28.718 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:28 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:28.419+0000 7f2dd84b3640 -1 osd.9 94 *** Got signal Terminated *** 2024-09-19T04:28:28.718 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:28 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:28.419+0000 7f2dd84b3640 -1 osd.9 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T04:28:28.718 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:28 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:28.716+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:28.718 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:28 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:28.716+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:28.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:28 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:28.520+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:28.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:28 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:28.520+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:28.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:28 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:28.520+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:28.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:28 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:28.520+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:28.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:28 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:28.520+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:57.995370+0000 front 2024-09-19T04:27:57.995399+0000 (oldest deadline 2024-09-19T04:28:23.895469+0000) 2024-09-19T04:28:29.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:28 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:28.588+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:29.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:28 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:28.588+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:29.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:28 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:28.588+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:29.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:28 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:28.588+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:29.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:28 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:28.588+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.397950+0000 front 2024-09-19T04:27:52.397993+0000 (oldest deadline 2024-09-19T04:28:15.898023+0000) 2024-09-19T04:28:29.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:28 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:28.588+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.399297+0000 front 2024-09-19T04:27:59.399330+0000 (oldest deadline 2024-09-19T04:28:22.898933+0000) 2024-09-19T04:28:29.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:28 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:28.716+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:29.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:28 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:28.716+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:45.061521+0000 front 2024-09-19T04:27:45.061546+0000 (oldest deadline 2024-09-19T04:28:08.561707+0000) 2024-09-19T04:28:29.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:28 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:28.716+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:49.662723+0000 front 2024-09-19T04:27:49.662814+0000 (oldest deadline 2024-09-19T04:28:14.362799+0000) 2024-09-19T04:28:29.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:28 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:28.716+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.465241+0000 front 2024-09-19T04:27:59.465108+0000 (oldest deadline 2024-09-19T04:28:22.365060+0000) 2024-09-19T04:28:29.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:29 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:29.534+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:29.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:29 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:29.534+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:29.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:29 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:29.534+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:29.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:29 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:29.534+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:29.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:29 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:29.534+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:57.995370+0000 front 2024-09-19T04:27:57.995399+0000 (oldest deadline 2024-09-19T04:28:23.895469+0000) 2024-09-19T04:28:30.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:29 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:29.589+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:30.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:29 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:29.589+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:30.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:29 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:29.589+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:30.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:29 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:29.589+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:30.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:29 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:29.589+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.397950+0000 front 2024-09-19T04:27:52.397993+0000 (oldest deadline 2024-09-19T04:28:15.898023+0000) 2024-09-19T04:28:30.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:29 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:29.589+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.399297+0000 front 2024-09-19T04:27:59.399330+0000 (oldest deadline 2024-09-19T04:28:22.898933+0000) 2024-09-19T04:28:30.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:29 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:29.750+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:30.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:29 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:29.750+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:30.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:29 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:29.750+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:30.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:29 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:29.750+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:45.061521+0000 front 2024-09-19T04:27:45.061546+0000 (oldest deadline 2024-09-19T04:28:08.561707+0000) 2024-09-19T04:28:30.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:29 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:29.750+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:49.662723+0000 front 2024-09-19T04:27:49.662814+0000 (oldest deadline 2024-09-19T04:28:14.362799+0000) 2024-09-19T04:28:30.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:29 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:29.750+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.465241+0000 front 2024-09-19T04:27:59.465108+0000 (oldest deadline 2024-09-19T04:28:22.365060+0000) 2024-09-19T04:28:30.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:30 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:30.568+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:30.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:30 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:30.568+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:30.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:30 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:30.568+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:30.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:30 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:30.568+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:30.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:30 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:30.568+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:57.995370+0000 front 2024-09-19T04:27:57.995399+0000 (oldest deadline 2024-09-19T04:28:23.895469+0000) 2024-09-19T04:28:31.048 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:30 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:30.606+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:31.048 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:30 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:30.606+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:31.048 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:30 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:30.606+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:31.048 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:30 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:30.606+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:31.048 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:30 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:30.606+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.397950+0000 front 2024-09-19T04:27:52.397993+0000 (oldest deadline 2024-09-19T04:28:15.898023+0000) 2024-09-19T04:28:31.048 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:30 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:30.606+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.399297+0000 front 2024-09-19T04:27:59.399330+0000 (oldest deadline 2024-09-19T04:28:22.898933+0000) 2024-09-19T04:28:31.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:30 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:30.722+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:31.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:30 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:30.722+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:31.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:30 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:30.722+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:31.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:30 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:30.722+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:45.061521+0000 front 2024-09-19T04:27:45.061546+0000 (oldest deadline 2024-09-19T04:28:08.561707+0000) 2024-09-19T04:28:31.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:30 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:30.722+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:49.662723+0000 front 2024-09-19T04:27:49.662814+0000 (oldest deadline 2024-09-19T04:28:14.362799+0000) 2024-09-19T04:28:31.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:30 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:30.722+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.465241+0000 front 2024-09-19T04:27:59.465108+0000 (oldest deadline 2024-09-19T04:28:22.365060+0000) 2024-09-19T04:28:31.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:31 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:31.629+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:31.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:31 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:31.629+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:31.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:31 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:31.629+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:31.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:31 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:31.629+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:31.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:31 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:31.629+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.397950+0000 front 2024-09-19T04:27:52.397993+0000 (oldest deadline 2024-09-19T04:28:15.898023+0000) 2024-09-19T04:28:31.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:31 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:31.629+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.399297+0000 front 2024-09-19T04:27:59.399330+0000 (oldest deadline 2024-09-19T04:28:22.898933+0000) 2024-09-19T04:28:31.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:31 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:31.585+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:31.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:31 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:31.585+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:31.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:31 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:31.585+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:31.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:31 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:31.585+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:31.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:31 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:31.585+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:57.995370+0000 front 2024-09-19T04:27:57.995399+0000 (oldest deadline 2024-09-19T04:28:23.895469+0000) 2024-09-19T04:28:32.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:31 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:31.686+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:32.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:31 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:31.686+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:32.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:31 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:31.686+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:32.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:31 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:31.686+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:45.061521+0000 front 2024-09-19T04:27:45.061546+0000 (oldest deadline 2024-09-19T04:28:08.561707+0000) 2024-09-19T04:28:32.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:31 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:31.686+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:49.662723+0000 front 2024-09-19T04:27:49.662814+0000 (oldest deadline 2024-09-19T04:28:14.362799+0000) 2024-09-19T04:28:32.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:31 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:31.686+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.465241+0000 front 2024-09-19T04:27:59.465108+0000 (oldest deadline 2024-09-19T04:28:22.365060+0000) 2024-09-19T04:28:32.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:32 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:32.574+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:32.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:32 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:32.574+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:32.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:32 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:32.574+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:32.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:32 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:32.574+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:32.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:32 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:32.574+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:57.995370+0000 front 2024-09-19T04:27:57.995399+0000 (oldest deadline 2024-09-19T04:28:23.895469+0000) 2024-09-19T04:28:33.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:32 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:32.623+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:33.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:32 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:32.623+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:33.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:32 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:32.623+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:33.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:32 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:32.623+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:33.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:32 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:32.623+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.397950+0000 front 2024-09-19T04:27:52.397993+0000 (oldest deadline 2024-09-19T04:28:15.898023+0000) 2024-09-19T04:28:33.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:32 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:32.623+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.399297+0000 front 2024-09-19T04:27:59.399330+0000 (oldest deadline 2024-09-19T04:28:22.898933+0000) 2024-09-19T04:28:33.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:32 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:32.658+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:20.255248+0000 front 2024-09-19T04:27:20.255363+0000 (oldest deadline 2024-09-19T04:27:43.155427+0000) 2024-09-19T04:28:33.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:32 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:32.658+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:28.957337+0000 front 2024-09-19T04:27:28.957372+0000 (oldest deadline 2024-09-19T04:27:50.657406+0000) 2024-09-19T04:28:33.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:32 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:32.658+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:36.359961+0000 front 2024-09-19T04:27:36.359755+0000 (oldest deadline 2024-09-19T04:27:58.659964+0000) 2024-09-19T04:28:33.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:32 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:32.658+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:45.061521+0000 front 2024-09-19T04:27:45.061546+0000 (oldest deadline 2024-09-19T04:28:08.561707+0000) 2024-09-19T04:28:33.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:32 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:32.658+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:49.662723+0000 front 2024-09-19T04:27:49.662814+0000 (oldest deadline 2024-09-19T04:28:14.362799+0000) 2024-09-19T04:28:33.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:32 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9[64941]: 2024-09-19T04:28:32.658+0000 7f2dd4ac9640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.465241+0000 front 2024-09-19T04:27:59.465108+0000 (oldest deadline 2024-09-19T04:28:22.365060+0000) 2024-09-19T04:28:33.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:33 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:33.595+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:33.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:33 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:33.595+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:33.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:33 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:33.595+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:33.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:33 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:33.595+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:33.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:33 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:33.595+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:57.995370+0000 front 2024-09-19T04:27:57.995399+0000 (oldest deadline 2024-09-19T04:28:23.895469+0000) 2024-09-19T04:28:33.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:33 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:33.595+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-19T04:28:08.497014+0000 front 2024-09-19T04:28:08.496909+0000 (oldest deadline 2024-09-19T04:28:32.596842+0000) 2024-09-19T04:28:34.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:33 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:33.619+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:34.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:33 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:33.619+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:34.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:33 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:33.619+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:34.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:33 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:33.619+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:34.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:33 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:33.619+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.397950+0000 front 2024-09-19T04:27:52.397993+0000 (oldest deadline 2024-09-19T04:28:15.898023+0000) 2024-09-19T04:28:34.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:33 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:33.619+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.399297+0000 front 2024-09-19T04:27:59.399330+0000 (oldest deadline 2024-09-19T04:28:22.898933+0000) 2024-09-19T04:28:34.219 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:33 smithi007 podman[100888]: 2024-09-19 04:28:33.897285288 +0000 UTC m=+5.579508912 container died 017c4f4e682763ffc423e26d51a22f51bede0ce80f86addab75aa7270bbef8da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T04:28:34.627 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:34 smithi007 podman[100888]: 2024-09-19 04:28:34.219174931 +0000 UTC m=+5.901398554 container cleanup 017c4f4e682763ffc423e26d51a22f51bede0ce80f86addab75aa7270bbef8da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4) 2024-09-19T04:28:34.627 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:34 smithi007 bash[100888]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9 2024-09-19T04:28:34.627 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:34 smithi007 podman[100904]: 2024-09-19 04:28:34.412282426 +0000 UTC m=+0.512474293 container remove 017c4f4e682763ffc423e26d51a22f51bede0ce80f86addab75aa7270bbef8da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T04:28:34.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:34 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:34.587+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:34.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:34 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:34.587+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:34.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:34 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:34.587+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:34.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:34 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:34.587+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:34.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:34 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:34.587+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:57.995370+0000 front 2024-09-19T04:27:57.995399+0000 (oldest deadline 2024-09-19T04:28:23.895469+0000) 2024-09-19T04:28:34.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:34 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:34.587+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-19T04:28:08.497014+0000 front 2024-09-19T04:28:08.496909+0000 (oldest deadline 2024-09-19T04:28:32.596842+0000) 2024-09-19T04:28:35.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:34 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:34.577+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:35.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:34 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:34.577+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:35.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:34 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:34.577+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:35.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:34 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:34.577+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:35.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:34 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:34.577+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.397950+0000 front 2024-09-19T04:27:52.397993+0000 (oldest deadline 2024-09-19T04:28:15.898023+0000) 2024-09-19T04:28:35.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:34 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:34.577+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.399297+0000 front 2024-09-19T04:27:59.399330+0000 (oldest deadline 2024-09-19T04:28:22.898933+0000) 2024-09-19T04:28:35.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:34 smithi007 podman[100992]: 2024-09-19 04:28:34.739784081 +0000 UTC m=+0.016260415 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:28:35.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:34 smithi007 podman[100992]: 2024-09-19 04:28:34.85481942 +0000 UTC m=+0.131295781 container create de881ea8359ef3ee960928c981202210983a0f5a727e228348ea90dc26d73632 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T04:28:35.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:35 smithi007 podman[100992]: 2024-09-19 04:28:35.057022828 +0000 UTC m=+0.333499157 container init de881ea8359ef3ee960928c981202210983a0f5a727e228348ea90dc26d73632 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T04:28:35.127 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:35 smithi007 podman[100992]: 2024-09-19 04:28:35.060647118 +0000 UTC m=+0.337123437 container start de881ea8359ef3ee960928c981202210983a0f5a727e228348ea90dc26d73632 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T04:28:35.627 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:35 smithi007 podman[100992]: 2024-09-19 04:28:35.143969512 +0000 UTC m=+0.420445858 container attach de881ea8359ef3ee960928c981202210983a0f5a727e228348ea90dc26d73632 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T04:28:35.627 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 19 04:28:35 smithi007 podman[100992]: 2024-09-19 04:28:35.257688887 +0000 UTC m=+0.534165216 container died de881ea8359ef3ee960928c981202210983a0f5a727e228348ea90dc26d73632 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-9-deactivate, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-19T04:28:35.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:35 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:35.571+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:35.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:35 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:35.571+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:35.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:35 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:35.571+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:35.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:35 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:35.571+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:35.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:35 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:35.571+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:57.995370+0000 front 2024-09-19T04:27:57.995399+0000 (oldest deadline 2024-09-19T04:28:23.895469+0000) 2024-09-19T04:28:35.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:35 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:35.571+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-19T04:28:08.497014+0000 front 2024-09-19T04:28:08.496909+0000 (oldest deadline 2024-09-19T04:28:32.596842+0000) 2024-09-19T04:28:36.020 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.9.service' 2024-09-19T04:28:36.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:35 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:35.547+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:36.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:35 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:35.547+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:36.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:35 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:35.547+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:36.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:35 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:35.547+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:36.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:35 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:35.547+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.397950+0000 front 2024-09-19T04:27:52.397993+0000 (oldest deadline 2024-09-19T04:28:15.898023+0000) 2024-09-19T04:28:36.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:35 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:35.547+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.399297+0000 front 2024-09-19T04:27:59.399330+0000 (oldest deadline 2024-09-19T04:28:22.898933+0000) 2024-09-19T04:28:36.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:35 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:35.547+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-19T04:28:08.700509+0000 front 2024-09-19T04:28:08.700581+0000 (oldest deadline 2024-09-19T04:28:34.600340+0000) 2024-09-19T04:28:36.104 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:28:36.104 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-19T04:28:36.104 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-19T04:28:36.104 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.10 2024-09-19T04:28:36.395 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:36 smithi092 systemd[1]: Stopping Ceph osd.10 for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:28:36.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:36 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:36.392+0000 7f56a6bc0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:28:36.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:36 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:36.392+0000 7f56a6bc0640 -1 osd.10 94 *** Got signal Terminated *** 2024-09-19T04:28:36.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:36 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:36.392+0000 7f56a6bc0640 -1 osd.10 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T04:28:36.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:36 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:36.559+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:36.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:36 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:36.559+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:36.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:36 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:36.559+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:36.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:36 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:36.559+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:36.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:36 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:36.559+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.397950+0000 front 2024-09-19T04:27:52.397993+0000 (oldest deadline 2024-09-19T04:28:15.898023+0000) 2024-09-19T04:28:36.797 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:36 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:36.559+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.399297+0000 front 2024-09-19T04:27:59.399330+0000 (oldest deadline 2024-09-19T04:28:22.898933+0000) 2024-09-19T04:28:36.798 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:36 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:36.559+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-19T04:28:08.700509+0000 front 2024-09-19T04:28:08.700581+0000 (oldest deadline 2024-09-19T04:28:34.600340+0000) 2024-09-19T04:28:36.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:36 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:36.595+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:36.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:36 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:36.595+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:36.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:36 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:36.595+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:36.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:36 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:36.595+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:36.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:36 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:36.595+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:57.995370+0000 front 2024-09-19T04:27:57.995399+0000 (oldest deadline 2024-09-19T04:28:23.895469+0000) 2024-09-19T04:28:36.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:36 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:36.595+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-19T04:28:08.497014+0000 front 2024-09-19T04:28:08.496909+0000 (oldest deadline 2024-09-19T04:28:32.596842+0000) 2024-09-19T04:28:37.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:37 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:37.563+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:37.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:37 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:37.563+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:37.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:37 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:37.563+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:37.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:37 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:37.563+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:37.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:37 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:37.563+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:57.995370+0000 front 2024-09-19T04:27:57.995399+0000 (oldest deadline 2024-09-19T04:28:23.895469+0000) 2024-09-19T04:28:37.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:37 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:37.563+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-19T04:28:08.497014+0000 front 2024-09-19T04:28:08.496909+0000 (oldest deadline 2024-09-19T04:28:32.596842+0000) 2024-09-19T04:28:38.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:37 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:37.604+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:38.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:37 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:37.604+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:38.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:37 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:37.604+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:38.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:37 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:37.604+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:38.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:37 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:37.604+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.397950+0000 front 2024-09-19T04:27:52.397993+0000 (oldest deadline 2024-09-19T04:28:15.898023+0000) 2024-09-19T04:28:38.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:37 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:37.604+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.399297+0000 front 2024-09-19T04:27:59.399330+0000 (oldest deadline 2024-09-19T04:28:22.898933+0000) 2024-09-19T04:28:38.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:37 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:37.604+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-19T04:28:08.700509+0000 front 2024-09-19T04:28:08.700581+0000 (oldest deadline 2024-09-19T04:28:34.600340+0000) 2024-09-19T04:28:38.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:38 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:38.611+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:38.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:38 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:38.611+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:38.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:38 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:38.611+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:38.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:38 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:38.611+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:38.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:38 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:38.611+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:57.995370+0000 front 2024-09-19T04:27:57.995399+0000 (oldest deadline 2024-09-19T04:28:23.895469+0000) 2024-09-19T04:28:38.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:38 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:38.611+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-19T04:28:08.497014+0000 front 2024-09-19T04:28:08.496909+0000 (oldest deadline 2024-09-19T04:28:32.596842+0000) 2024-09-19T04:28:39.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:38 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:38.610+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:39.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:38 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:38.610+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:39.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:38 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:38.610+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:39.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:38 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:38.610+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:39.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:38 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:38.610+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.397950+0000 front 2024-09-19T04:27:52.397993+0000 (oldest deadline 2024-09-19T04:28:15.898023+0000) 2024-09-19T04:28:39.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:38 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:38.610+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.399297+0000 front 2024-09-19T04:27:59.399330+0000 (oldest deadline 2024-09-19T04:28:22.898933+0000) 2024-09-19T04:28:39.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:38 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:38.610+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-19T04:28:08.700509+0000 front 2024-09-19T04:28:08.700581+0000 (oldest deadline 2024-09-19T04:28:34.600340+0000) 2024-09-19T04:28:39.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:39 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:39.630+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:39.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:39 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:39.630+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:39.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:39 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:39.630+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:39.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:39 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:39.630+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:39.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:39 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:39.630+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:57.995370+0000 front 2024-09-19T04:27:57.995399+0000 (oldest deadline 2024-09-19T04:28:23.895469+0000) 2024-09-19T04:28:39.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:39 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:39.630+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-19T04:28:08.497014+0000 front 2024-09-19T04:28:08.496909+0000 (oldest deadline 2024-09-19T04:28:32.596842+0000) 2024-09-19T04:28:39.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:39 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:39.630+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2024-09-19T04:28:13.097883+0000 front 2024-09-19T04:28:13.097924+0000 (oldest deadline 2024-09-19T04:28:39.498222+0000) 2024-09-19T04:28:40.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:39 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:39.646+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:40.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:39 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:39.646+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:40.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:39 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:39.646+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:40.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:39 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:39.646+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:40.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:39 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:39.646+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.397950+0000 front 2024-09-19T04:27:52.397993+0000 (oldest deadline 2024-09-19T04:28:15.898023+0000) 2024-09-19T04:28:40.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:39 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:39.646+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.399297+0000 front 2024-09-19T04:27:59.399330+0000 (oldest deadline 2024-09-19T04:28:22.898933+0000) 2024-09-19T04:28:40.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:39 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:39.646+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-19T04:28:08.700509+0000 front 2024-09-19T04:28:08.700581+0000 (oldest deadline 2024-09-19T04:28:34.600340+0000) 2024-09-19T04:28:41.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:40 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:40.620+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.992429+0000 front 2024-09-19T04:27:19.992419+0000 (oldest deadline 2024-09-19T04:27:43.492221+0000) 2024-09-19T04:28:41.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:40 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:40.620+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-09-19T04:27:25.693755+0000 front 2024-09-19T04:27:25.693677+0000 (oldest deadline 2024-09-19T04:27:51.593788+0000) 2024-09-19T04:28:41.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:40 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:40.620+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:31.594305+0000 front 2024-09-19T04:27:31.594225+0000 (oldest deadline 2024-09-19T04:28:01.594648+0000) 2024-09-19T04:28:41.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:40 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:40.620+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:43.796625+0000 front 2024-09-19T04:27:43.796334+0000 (oldest deadline 2024-09-19T04:28:06.096268+0000) 2024-09-19T04:28:41.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:40 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:40.620+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:52.397950+0000 front 2024-09-19T04:27:52.397993+0000 (oldest deadline 2024-09-19T04:28:15.898023+0000) 2024-09-19T04:28:41.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:40 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:40.620+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:59.399297+0000 front 2024-09-19T04:27:59.399330+0000 (oldest deadline 2024-09-19T04:28:22.898933+0000) 2024-09-19T04:28:41.047 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:40 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10[60258]: 2024-09-19T04:28:40.620+0000 7f56a31d6640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-19T04:28:08.700509+0000 front 2024-09-19T04:28:08.700581+0000 (oldest deadline 2024-09-19T04:28:34.600340+0000) 2024-09-19T04:28:41.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:40 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:40.678+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:41.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:40 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:40.678+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:41.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:40 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:40.678+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:41.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:40 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:40.678+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:41.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:40 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:40.678+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:57.995370+0000 front 2024-09-19T04:27:57.995399+0000 (oldest deadline 2024-09-19T04:28:23.895469+0000) 2024-09-19T04:28:41.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:40 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:40.678+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-19T04:28:08.497014+0000 front 2024-09-19T04:28:08.496909+0000 (oldest deadline 2024-09-19T04:28:32.596842+0000) 2024-09-19T04:28:41.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:40 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:40.678+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2024-09-19T04:28:13.097883+0000 front 2024-09-19T04:28:13.097924+0000 (oldest deadline 2024-09-19T04:28:39.498222+0000) 2024-09-19T04:28:41.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:41 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:41.632+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:41.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:41 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:41.632+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:41.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:41 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:41.632+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:41.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:41 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:41.632+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:41.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:41 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:41.632+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:57.995370+0000 front 2024-09-19T04:27:57.995399+0000 (oldest deadline 2024-09-19T04:28:23.895469+0000) 2024-09-19T04:28:41.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:41 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:41.632+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-19T04:28:08.497014+0000 front 2024-09-19T04:28:08.496909+0000 (oldest deadline 2024-09-19T04:28:32.596842+0000) 2024-09-19T04:28:41.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:41 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:41.632+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2024-09-19T04:28:13.097883+0000 front 2024-09-19T04:28:13.097924+0000 (oldest deadline 2024-09-19T04:28:39.498222+0000) 2024-09-19T04:28:42.045 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:41 smithi092 podman[70925]: 2024-09-19 04:28:41.748920579 +0000 UTC m=+5.448788574 container died 1c59aff5b8dea7881e15fe00ed17128617d6ec76d19d06c6e2c4d860d4037e67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-19T04:28:42.297 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:42 smithi092 podman[70925]: 2024-09-19 04:28:42.125620094 +0000 UTC m=+5.825488088 container cleanup 1c59aff5b8dea7881e15fe00ed17128617d6ec76d19d06c6e2c4d860d4037e67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T04:28:42.297 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:42 smithi092 bash[70925]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10 2024-09-19T04:28:42.678 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:42 smithi092 podman[70943]: 2024-09-19 04:28:42.377122706 +0000 UTC m=+0.619389351 container remove 1c59aff5b8dea7881e15fe00ed17128617d6ec76d19d06c6e2c4d860d4037e67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T04:28:42.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:42 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:42.643+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:42.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:42 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:42.643+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:42.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:42 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:42.643+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:42.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:42 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:42.643+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:42.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:42 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:42.643+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:57.995370+0000 front 2024-09-19T04:27:57.995399+0000 (oldest deadline 2024-09-19T04:28:23.895469+0000) 2024-09-19T04:28:42.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:42 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:42.643+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-19T04:28:08.497014+0000 front 2024-09-19T04:28:08.496909+0000 (oldest deadline 2024-09-19T04:28:32.596842+0000) 2024-09-19T04:28:42.910 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:42 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:42.643+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2024-09-19T04:28:13.097883+0000 front 2024-09-19T04:28:13.097924+0000 (oldest deadline 2024-09-19T04:28:39.498222+0000) 2024-09-19T04:28:42.948 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:42 smithi092 podman[71029]: 2024-09-19 04:28:42.678013454 +0000 UTC m=+0.105897992 container create abe41aa4a32e242b94250f1cb7e8b20745282d8a319c464988bcf5f6f5a4c51c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T04:28:42.948 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:42 smithi092 podman[71029]: 2024-09-19 04:28:42.58775111 +0000 UTC m=+0.015635658 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:28:42.948 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:42 smithi092 podman[71029]: 2024-09-19 04:28:42.863877784 +0000 UTC m=+0.291762324 container init abe41aa4a32e242b94250f1cb7e8b20745282d8a319c464988bcf5f6f5a4c51c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T04:28:42.948 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:42 smithi092 podman[71029]: 2024-09-19 04:28:42.867077059 +0000 UTC m=+0.294961605 container start abe41aa4a32e242b94250f1cb7e8b20745282d8a319c464988bcf5f6f5a4c51c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T04:28:43.297 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:42 smithi092 podman[71029]: 2024-09-19 04:28:42.946931375 +0000 UTC m=+0.374815923 container attach abe41aa4a32e242b94250f1cb7e8b20745282d8a319c464988bcf5f6f5a4c51c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T04:28:43.297 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:43 smithi092 podman[71029]: 2024-09-19 04:28:43.062357293 +0000 UTC m=+0.490241841 container died abe41aa4a32e242b94250f1cb7e8b20745282d8a319c464988bcf5f6f5a4c51c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10-deactivate, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T04:28:43.637 INFO:journalctl@ceph.osd.10.smithi092.stdout:Sep 19 04:28:43 smithi092 podman[71052]: 2024-09-19 04:28:43.616976614 +0000 UTC m=+0.547594575 container remove abe41aa4a32e242b94250f1cb7e8b20745282d8a319c464988bcf5f6f5a4c51c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-10-deactivate, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-19T04:28:43.642 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.10.service' 2024-09-19T04:28:43.680 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:28:43.681 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-19T04:28:43.681 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-19T04:28:43.681 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.11 2024-09-19T04:28:43.982 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:43 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:43.682+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:43.982 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:43 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:43.682+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:43.982 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:43 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:43.682+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:43.982 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:43 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:43.682+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:43.982 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:43 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:43.682+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:57.995370+0000 front 2024-09-19T04:27:57.995399+0000 (oldest deadline 2024-09-19T04:28:23.895469+0000) 2024-09-19T04:28:43.982 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:43 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:43.682+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-19T04:28:08.497014+0000 front 2024-09-19T04:28:08.496909+0000 (oldest deadline 2024-09-19T04:28:32.596842+0000) 2024-09-19T04:28:43.983 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:43 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:43.682+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2024-09-19T04:28:13.097883+0000 front 2024-09-19T04:28:13.097924+0000 (oldest deadline 2024-09-19T04:28:39.498222+0000) 2024-09-19T04:28:43.983 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:43 smithi102 systemd[1]: Stopping Ceph osd.11 for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:28:43.983 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:43 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:43.980+0000 7f725bb2a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:28:43.983 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:43 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:43.980+0000 7f725bb2a640 -1 osd.11 94 *** Got signal Terminated *** 2024-09-19T04:28:43.983 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:43 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:43.980+0000 7f725bb2a640 -1 osd.11 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T04:28:45.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:44 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:44.678+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:45.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:44 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:44.678+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:45.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:44 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:44.678+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:45.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:44 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:44.678+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:45.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:44 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:44.678+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:57.995370+0000 front 2024-09-19T04:27:57.995399+0000 (oldest deadline 2024-09-19T04:28:23.895469+0000) 2024-09-19T04:28:45.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:44 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:44.678+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-19T04:28:08.497014+0000 front 2024-09-19T04:28:08.496909+0000 (oldest deadline 2024-09-19T04:28:32.596842+0000) 2024-09-19T04:28:45.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:44 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:44.678+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2024-09-19T04:28:13.097883+0000 front 2024-09-19T04:28:13.097924+0000 (oldest deadline 2024-09-19T04:28:39.498222+0000) 2024-09-19T04:28:45.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:45 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:45.652+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:45.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:45 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:45.652+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:45.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:45 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:45.652+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:45.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:45 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:45.652+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:45.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:45 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:45.652+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:57.995370+0000 front 2024-09-19T04:27:57.995399+0000 (oldest deadline 2024-09-19T04:28:23.895469+0000) 2024-09-19T04:28:45.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:45 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:45.652+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-19T04:28:08.497014+0000 front 2024-09-19T04:28:08.496909+0000 (oldest deadline 2024-09-19T04:28:32.596842+0000) 2024-09-19T04:28:45.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:45 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:45.652+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2024-09-19T04:28:13.097883+0000 front 2024-09-19T04:28:13.097924+0000 (oldest deadline 2024-09-19T04:28:39.498222+0000) 2024-09-19T04:28:47.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:46 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:46.676+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:47.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:46 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:46.676+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:47.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:46 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:46.676+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:47.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:46 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:46.676+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:47.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:46 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:46.676+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:57.995370+0000 front 2024-09-19T04:27:57.995399+0000 (oldest deadline 2024-09-19T04:28:23.895469+0000) 2024-09-19T04:28:47.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:46 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:46.676+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-19T04:28:08.497014+0000 front 2024-09-19T04:28:08.496909+0000 (oldest deadline 2024-09-19T04:28:32.596842+0000) 2024-09-19T04:28:47.159 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:46 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:46.676+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2024-09-19T04:28:13.097883+0000 front 2024-09-19T04:28:13.097924+0000 (oldest deadline 2024-09-19T04:28:39.498222+0000) 2024-09-19T04:28:47.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:47 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:47.647+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:47.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:47 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:47.647+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:47.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:47 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:47.647+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:47.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:47 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:47.647+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:47.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:47 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:47.647+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:57.995370+0000 front 2024-09-19T04:27:57.995399+0000 (oldest deadline 2024-09-19T04:28:23.895469+0000) 2024-09-19T04:28:47.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:47 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:47.647+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-19T04:28:08.497014+0000 front 2024-09-19T04:28:08.496909+0000 (oldest deadline 2024-09-19T04:28:32.596842+0000) 2024-09-19T04:28:47.910 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:47 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:47.647+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2024-09-19T04:28:13.097883+0000 front 2024-09-19T04:28:13.097924+0000 (oldest deadline 2024-09-19T04:28:39.498222+0000) 2024-09-19T04:28:48.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:48 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:48.629+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-19T04:27:19.789014+0000 front 2024-09-19T04:27:19.788999+0000 (oldest deadline 2024-09-19T04:27:45.589105+0000) 2024-09-19T04:28:48.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:48 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:48.629+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6804 osd.2 since back 2024-09-19T04:27:37.092086+0000 front 2024-09-19T04:27:37.092127+0000 (oldest deadline 2024-09-19T04:27:59.392169+0000) 2024-09-19T04:28:48.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:48 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:48.629+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-19T04:27:42.893464+0000 front 2024-09-19T04:27:42.893340+0000 (oldest deadline 2024-09-19T04:28:08.193167+0000) 2024-09-19T04:28:48.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:48 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:48.629+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-09-19T04:27:53.394767+0000 front 2024-09-19T04:27:53.394780+0000 (oldest deadline 2024-09-19T04:28:14.494635+0000) 2024-09-19T04:28:48.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:48 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:48.629+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6812 osd.5 since back 2024-09-19T04:27:57.995370+0000 front 2024-09-19T04:27:57.995399+0000 (oldest deadline 2024-09-19T04:28:23.895469+0000) 2024-09-19T04:28:48.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:48 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:48.629+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-19T04:28:08.497014+0000 front 2024-09-19T04:28:08.496909+0000 (oldest deadline 2024-09-19T04:28:32.596842+0000) 2024-09-19T04:28:48.909 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:48 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11[60498]: 2024-09-19T04:28:48.629+0000 7f7254138640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2024-09-19T04:28:13.097883+0000 front 2024-09-19T04:28:13.097924+0000 (oldest deadline 2024-09-19T04:28:39.498222+0000) 2024-09-19T04:28:49.740 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:49 smithi102 podman[70920]: 2024-09-19 04:28:49.456853406 +0000 UTC m=+5.581563388 container died fbc37f393db96671ecf28a4a21d2fa7f844827279addbd48844b5e149491e0ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T04:28:50.057 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:49 smithi102 podman[70920]: 2024-09-19 04:28:49.847398572 +0000 UTC m=+5.972108552 container cleanup fbc37f393db96671ecf28a4a21d2fa7f844827279addbd48844b5e149491e0ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:28:50.058 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:49 smithi102 bash[70920]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11 2024-09-19T04:28:50.383 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:50 smithi102 podman[70938]: 2024-09-19 04:28:50.056858256 +0000 UTC m=+0.603478280 container remove fbc37f393db96671ecf28a4a21d2fa7f844827279addbd48844b5e149491e0ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:28:50.659 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:50 smithi102 podman[71026]: 2024-09-19 04:28:50.382657004 +0000 UTC m=+0.110107780 container create fe614b37b6df085970ecf5ef6658b11cbc6b2f3491d01fd1d81bc12f8f3fdf84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T04:28:50.659 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:50 smithi102 podman[71026]: 2024-09-19 04:28:50.288141885 +0000 UTC m=+0.015592676 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:28:50.659 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:50 smithi102 podman[71026]: 2024-09-19 04:28:50.610452802 +0000 UTC m=+0.337903578 container init fe614b37b6df085970ecf5ef6658b11cbc6b2f3491d01fd1d81bc12f8f3fdf84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T04:28:50.659 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:50 smithi102 podman[71026]: 2024-09-19 04:28:50.61376278 +0000 UTC m=+0.341213557 container start fe614b37b6df085970ecf5ef6658b11cbc6b2f3491d01fd1d81bc12f8f3fdf84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-19T04:28:51.081 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:50 smithi102 podman[71026]: 2024-09-19 04:28:50.693948756 +0000 UTC m=+0.421399561 container attach fe614b37b6df085970ecf5ef6658b11cbc6b2f3491d01fd1d81bc12f8f3fdf84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T04:28:51.081 INFO:journalctl@ceph.osd.11.smithi102.stdout:Sep 19 04:28:50 smithi102 podman[71026]: 2024-09-19 04:28:50.802524344 +0000 UTC m=+0.529975137 container died fe614b37b6df085970ecf5ef6658b11cbc6b2f3491d01fd1d81bc12f8f3fdf84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T04:28:51.433 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@osd.11.service' 2024-09-19T04:28:51.474 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:28:51.474 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-19T04:28:51.474 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-19T04:28:51.474 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.a 2024-09-19T04:28:51.780 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 04:28:51 smithi007 systemd[1]: Stopping Ceph mds.a for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:28:52.126 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 04:28:51 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-a[71722]: 2024-09-19T04:28:51.778+0000 7fdf3c3ab640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:28:52.127 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 04:28:51 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-a[71722]: 2024-09-19T04:28:51.778+0000 7fdf3c3ab640 -1 mds.a *** got signal Terminated *** 2024-09-19T04:28:54.279 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 04:28:54 smithi007 podman[101106]: 2024-09-19 04:28:54.0230766 +0000 UTC m=+2.345509037 container died ff8c6b10d2a298b8ad89e412f7c6d670ec3df4590b6cf9a2d4f7920636e4c6d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T04:28:54.627 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 04:28:54 smithi007 podman[101106]: 2024-09-19 04:28:54.378095197 +0000 UTC m=+2.700527632 container cleanup ff8c6b10d2a298b8ad89e412f7c6d670ec3df4590b6cf9a2d4f7920636e4c6d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-a, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T04:28:54.627 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 19 04:28:54 smithi007 bash[101106]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-a 2024-09-19T04:28:54.789 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.a.service' 2024-09-19T04:28:54.826 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:28:54.826 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-19T04:28:54.827 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-19T04:28:54.827 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.d 2024-09-19T04:28:55.183 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 19 04:28:54 smithi007 systemd[1]: Stopping Ceph mds.d for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:28:55.184 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 19 04:28:55 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-d[70528]: 2024-09-19T04:28:55.181+0000 7f0eb5876640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:28:55.184 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 19 04:28:55 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-d[70528]: 2024-09-19T04:28:55.181+0000 7f0eb5876640 -1 mds.d *** got signal Terminated *** 2024-09-19T04:28:58.292 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 19 04:28:58 smithi007 podman[101226]: 2024-09-19 04:28:58.025323128 +0000 UTC m=+2.969244390 container died e473d1a1fbc51e2b9a2b5b2e6d38452e268e3a2a078f0f347bba3e8ad586130c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-d, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-19T04:28:58.627 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 19 04:28:58 smithi007 podman[101226]: 2024-09-19 04:28:58.497995008 +0000 UTC m=+3.441916259 container cleanup e473d1a1fbc51e2b9a2b5b2e6d38452e268e3a2a078f0f347bba3e8ad586130c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-d, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T04:28:58.627 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 19 04:28:58 smithi007 bash[101226]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-d 2024-09-19T04:28:58.909 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.d.service' 2024-09-19T04:28:58.943 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:28:58.943 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-19T04:28:58.943 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-19T04:28:58.943 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.g 2024-09-19T04:28:59.377 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 04:28:59 smithi007 systemd[1]: Stopping Ceph mds.g for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:28:59.377 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 04:28:59 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-g[71337]: 2024-09-19T04:28:59.259+0000 7f7d47900640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:28:59.377 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 04:28:59 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-g[71337]: 2024-09-19T04:28:59.259+0000 7f7d47900640 -1 mds.g *** got signal Terminated *** 2024-09-19T04:29:02.281 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 04:29:02 smithi007 podman[101346]: 2024-09-19 04:29:02.020887398 +0000 UTC m=+2.854026274 container died ca9cf4cc67e492c98d2c763bd9da62aa28f561e9899c72b59e76b35f3ce88f71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-g, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T04:29:02.627 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 04:29:02 smithi007 podman[101346]: 2024-09-19 04:29:02.510384643 +0000 UTC m=+3.343523504 container cleanup ca9cf4cc67e492c98d2c763bd9da62aa28f561e9899c72b59e76b35f3ce88f71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-g, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T04:29:02.627 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 19 04:29:02 smithi007 bash[101346]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-g 2024-09-19T04:29:02.875 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.g.service' 2024-09-19T04:29:02.909 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:29:02.909 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-19T04:29:02.909 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-19T04:29:02.909 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.j 2024-09-19T04:29:03.377 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 04:29:02 smithi007 systemd[1]: Stopping Ceph mds.j for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:29:03.377 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 04:29:03 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-j[70129]: 2024-09-19T04:29:03.237+0000 7faf6fc56640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:29:03.377 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 04:29:03 smithi007 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-j[70129]: 2024-09-19T04:29:03.237+0000 7faf6fc56640 -1 mds.j *** got signal Terminated *** 2024-09-19T04:29:06.291 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 04:29:06 smithi007 podman[101467]: 2024-09-19 04:29:06.030903537 +0000 UTC m=+2.891013371 container died 2a0eb7a3a0489a9e6a592b17e295979c73441be24015039625987db353b01e66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-19T04:29:06.593 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 04:29:06 smithi007 podman[101467]: 2024-09-19 04:29:06.388807906 +0000 UTC m=+3.248917732 container cleanup 2a0eb7a3a0489a9e6a592b17e295979c73441be24015039625987db353b01e66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-j, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T04:29:06.593 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 04:29:06 smithi007 bash[101467]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-j 2024-09-19T04:29:06.818 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.j.service' 2024-09-19T04:29:06.841 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 04:29:06 smithi007 podman[101479]: 2024-09-19 04:29:06.656759698 +0000 UTC m=+0.623957123 container remove 2a0eb7a3a0489a9e6a592b17e295979c73441be24015039625987db353b01e66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-j, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:29:06.841 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 04:29:06 smithi007 systemd[1]: ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.j.service: Deactivated successfully. 2024-09-19T04:29:06.841 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 04:29:06 smithi007 systemd[1]: Stopped Ceph mds.j for 77957c0a-763c-11ef-bceb-c7b262605968. 2024-09-19T04:29:06.841 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 19 04:29:06 smithi007 systemd[1]: ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.j.service: Consumed 1.036s CPU time. 2024-09-19T04:29:06.853 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:29:06.853 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-19T04:29:06.853 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-19T04:29:06.854 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.b 2024-09-19T04:29:07.163 INFO:journalctl@ceph.mds.b.smithi092.stdout:Sep 19 04:29:06 smithi092 systemd[1]: Stopping Ceph mds.b for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:29:07.417 INFO:journalctl@ceph.mds.b.smithi092.stdout:Sep 19 04:29:07 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-b[65433]: 2024-09-19T04:29:07.161+0000 7ff35177a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:29:07.418 INFO:journalctl@ceph.mds.b.smithi092.stdout:Sep 19 04:29:07 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-b[65433]: 2024-09-19T04:29:07.161+0000 7ff35177a640 -1 mds.b *** got signal Terminated *** 2024-09-19T04:29:10.297 INFO:journalctl@ceph.mds.b.smithi092.stdout:Sep 19 04:29:10 smithi092 podman[71132]: 2024-09-19 04:29:10.029837212 +0000 UTC m=+2.974812499 container died b891cc6a0cf339630146174c9d5ca25195e159d1fc36cc13e187a159dbf5c8ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T04:29:10.651 INFO:journalctl@ceph.mds.b.smithi092.stdout:Sep 19 04:29:10 smithi092 podman[71132]: 2024-09-19 04:29:10.423991814 +0000 UTC m=+3.368967092 container cleanup b891cc6a0cf339630146174c9d5ca25195e159d1fc36cc13e187a159dbf5c8ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T04:29:10.651 INFO:journalctl@ceph.mds.b.smithi092.stdout:Sep 19 04:29:10 smithi092 bash[71132]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-b 2024-09-19T04:29:10.806 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.b.service' 2024-09-19T04:29:10.843 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:29:10.844 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-19T04:29:10.844 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-19T04:29:10.844 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.e 2024-09-19T04:29:11.163 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:29:10 smithi092 systemd[1]: Stopping Ceph mds.e for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:29:11.547 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:29:11 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-e[68854]: 2024-09-19T04:29:11.161+0000 7f4837c98640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:29:11.547 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:29:11 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-e[68854]: 2024-09-19T04:29:11.161+0000 7f4837c98640 -1 mds.e *** got signal Terminated *** 2024-09-19T04:29:15.446 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:29:15 smithi092 podman[71263]: 2024-09-19 04:29:15.168505399 +0000 UTC m=+4.098000413 container died 7e1d815fcaa0a43737b85753a03d3af0f00174b3357e6083ea66afcf934ea5ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-e, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-19T04:29:15.796 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:29:15 smithi092 podman[71263]: 2024-09-19 04:29:15.5532317 +0000 UTC m=+4.482726753 container cleanup 7e1d815fcaa0a43737b85753a03d3af0f00174b3357e6083ea66afcf934ea5ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T04:29:15.796 INFO:journalctl@ceph.mds.e.smithi092.stdout:Sep 19 04:29:15 smithi092 bash[71263]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-e 2024-09-19T04:29:15.925 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.e.service' 2024-09-19T04:29:15.959 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:29:15.959 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-19T04:29:15.959 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-19T04:29:15.959 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.h 2024-09-19T04:29:16.046 INFO:journalctl@ceph.mds.h.smithi092.stdout:Sep 19 04:29:16 smithi092 systemd[1]: Stopping Ceph mds.h for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:29:16.547 INFO:journalctl@ceph.mds.h.smithi092.stdout:Sep 19 04:29:16 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-h[65132]: 2024-09-19T04:29:16.280+0000 7f3028fdd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:29:16.547 INFO:journalctl@ceph.mds.h.smithi092.stdout:Sep 19 04:29:16 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-h[65132]: 2024-09-19T04:29:16.280+0000 7f3028fdd640 -1 mds.h *** got signal Terminated *** 2024-09-19T04:29:18.266 INFO:journalctl@ceph.mds.h.smithi092.stdout:Sep 19 04:29:18 smithi092 podman[71385]: 2024-09-19 04:29:18.012411727 +0000 UTC m=+1.841677328 container died 54eeb19aa70dde030bd72143343741270f6faf1f4b8781b3306c38b1311e0520 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-h, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:29:18.546 INFO:journalctl@ceph.mds.h.smithi092.stdout:Sep 19 04:29:18 smithi092 podman[71385]: 2024-09-19 04:29:18.364894097 +0000 UTC m=+2.194159695 container cleanup 54eeb19aa70dde030bd72143343741270f6faf1f4b8781b3306c38b1311e0520 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-h, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T04:29:18.547 INFO:journalctl@ceph.mds.h.smithi092.stdout:Sep 19 04:29:18 smithi092 bash[71385]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-h 2024-09-19T04:29:18.802 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.h.service' 2024-09-19T04:29:18.834 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:29:18.834 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-19T04:29:18.835 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-19T04:29:18.835 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.k 2024-09-19T04:29:19.046 INFO:journalctl@ceph.mds.k.smithi092.stdout:Sep 19 04:29:18 smithi092 systemd[1]: Stopping Ceph mds.k for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:29:19.547 INFO:journalctl@ceph.mds.k.smithi092.stdout:Sep 19 04:29:19 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-k[64517]: 2024-09-19T04:29:19.143+0000 7fb16ed27640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:29:19.547 INFO:journalctl@ceph.mds.k.smithi092.stdout:Sep 19 04:29:19 smithi092 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-k[64517]: 2024-09-19T04:29:19.143+0000 7fb16ed27640 -1 mds.k *** got signal Terminated *** 2024-09-19T04:29:22.297 INFO:journalctl@ceph.mds.k.smithi092.stdout:Sep 19 04:29:22 smithi092 podman[71504]: 2024-09-19 04:29:22.02248769 +0000 UTC m=+2.974962088 container died 7a2e05eebdacf95a45c25b9507e1f31077b2b2e029820b6d5aab21f1712f0953 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T04:29:22.553 INFO:journalctl@ceph.mds.k.smithi092.stdout:Sep 19 04:29:22 smithi092 podman[71504]: 2024-09-19 04:29:22.377063849 +0000 UTC m=+3.329538247 container cleanup 7a2e05eebdacf95a45c25b9507e1f31077b2b2e029820b6d5aab21f1712f0953 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-k, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:29:22.554 INFO:journalctl@ceph.mds.k.smithi092.stdout:Sep 19 04:29:22 smithi092 bash[71504]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-k 2024-09-19T04:29:22.752 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.k.service' 2024-09-19T04:29:22.784 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:29:22.784 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-19T04:29:22.785 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-19T04:29:22.785 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.c 2024-09-19T04:29:23.073 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 19 04:29:22 smithi102 systemd[1]: Stopping Ceph mds.c for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:29:23.330 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 19 04:29:23 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-c[65467]: 2024-09-19T04:29:23.071+0000 7ff5bf192640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:29:23.330 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 19 04:29:23 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-c[65467]: 2024-09-19T04:29:23.071+0000 7ff5bf192640 -1 mds.c *** got signal Terminated *** 2024-09-19T04:29:26.357 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 19 04:29:26 smithi102 podman[71129]: 2024-09-19 04:29:26.01800464 +0000 UTC m=+3.043325993 container died 48f4d11d16470694df7a7f7fa46c2991982408974d0d8a04ecd1f242d0968c45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-c, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T04:29:26.633 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 19 04:29:26 smithi102 podman[71129]: 2024-09-19 04:29:26.447247157 +0000 UTC m=+3.472568502 container cleanup 48f4d11d16470694df7a7f7fa46c2991982408974d0d8a04ecd1f242d0968c45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-c, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:29:26.633 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 19 04:29:26 smithi102 bash[71129]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-c 2024-09-19T04:29:26.880 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.c.service' 2024-09-19T04:29:26.902 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 19 04:29:26 smithi102 podman[71153]: 2024-09-19 04:29:26.631865786 +0000 UTC m=+0.614297961 container remove 48f4d11d16470694df7a7f7fa46c2991982408974d0d8a04ecd1f242d0968c45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-c, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T04:29:26.902 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 19 04:29:26 smithi102 systemd[1]: ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.c.service: Deactivated successfully. 2024-09-19T04:29:26.902 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 19 04:29:26 smithi102 systemd[1]: Stopped Ceph mds.c for 77957c0a-763c-11ef-bceb-c7b262605968. 2024-09-19T04:29:26.903 INFO:journalctl@ceph.mds.c.smithi102.stdout:Sep 19 04:29:26 smithi102 systemd[1]: ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.c.service: Consumed 13.392s CPU time. 2024-09-19T04:29:26.916 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:29:26.916 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-19T04:29:26.917 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-19T04:29:26.917 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.f 2024-09-19T04:29:27.158 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 19 04:29:27 smithi102 systemd[1]: Stopping Ceph mds.f for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:29:27.659 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 19 04:29:27 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-f[65168]: 2024-09-19T04:29:27.251+0000 7fa92eae6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:29:27.659 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 19 04:29:27 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-f[65168]: 2024-09-19T04:29:27.251+0000 7fa92eae6640 -1 mds.f *** got signal Terminated *** 2024-09-19T04:29:30.286 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 19 04:29:30 smithi102 podman[71263]: 2024-09-19 04:29:30.01621322 +0000 UTC m=+2.874022111 container died 4823c4ef13509da468c903755e28b8f933b4c9e21dad85b97ddee036e237b891 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-f, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:29:30.620 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 19 04:29:30 smithi102 podman[71263]: 2024-09-19 04:29:30.393024746 +0000 UTC m=+3.250833635 container cleanup 4823c4ef13509da468c903755e28b8f933b4c9e21dad85b97ddee036e237b891 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-19T04:29:30.620 INFO:journalctl@ceph.mds.f.smithi102.stdout:Sep 19 04:29:30 smithi102 bash[71263]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-f 2024-09-19T04:29:30.754 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.f.service' 2024-09-19T04:29:30.787 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:29:30.788 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-19T04:29:30.788 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-19T04:29:30.788 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.i 2024-09-19T04:29:30.908 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 19 04:29:30 smithi102 systemd[1]: Stopping Ceph mds.i for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:29:31.409 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 19 04:29:31 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-i[65772]: 2024-09-19T04:29:31.104+0000 7fd04dfd3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:29:31.409 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 19 04:29:31 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-i[65772]: 2024-09-19T04:29:31.104+0000 7fd04dfd3640 -1 mds.i *** got signal Terminated *** 2024-09-19T04:29:34.159 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 19 04:29:34 smithi102 podman[71386]: 2024-09-19 04:29:34.016180646 +0000 UTC m=+3.016515755 container died d51a3e24a498e08173d841d88ab017f9909cc91f4ef70ec26635d0fefa11043e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-i, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T04:29:34.648 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 19 04:29:34 smithi102 podman[71386]: 2024-09-19 04:29:34.40519052 +0000 UTC m=+3.405525627 container cleanup d51a3e24a498e08173d841d88ab017f9909cc91f4ef70ec26635d0fefa11043e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-i, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T04:29:34.649 INFO:journalctl@ceph.mds.i.smithi102.stdout:Sep 19 04:29:34 smithi102 bash[71386]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-i 2024-09-19T04:29:34.779 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.i.service' 2024-09-19T04:29:34.812 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:29:34.812 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-19T04:29:34.812 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-19T04:29:34.812 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.l 2024-09-19T04:29:34.908 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 19 04:29:34 smithi102 systemd[1]: Stopping Ceph mds.l for 77957c0a-763c-11ef-bceb-c7b262605968... 2024-09-19T04:29:35.659 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 19 04:29:35 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-l[64861]: 2024-09-19T04:29:35.158+0000 7fa0fb4aa640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:29:35.659 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 19 04:29:35 smithi102 ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-l[64861]: 2024-09-19T04:29:35.158+0000 7fa0fb4aa640 -1 mds.l *** got signal Terminated *** 2024-09-19T04:29:38.318 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 19 04:29:38 smithi102 podman[71507]: 2024-09-19 04:29:38.013682342 +0000 UTC m=+2.986907459 container died bbbdd03af4089ca5e669353559b6410339961c9ccd1a2cf33c729f3d29b2a0bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-l, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4) 2024-09-19T04:29:38.618 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 19 04:29:38 smithi102 podman[71507]: 2024-09-19 04:29:38.417065243 +0000 UTC m=+3.390290351 container cleanup bbbdd03af4089ca5e669353559b6410339961c9ccd1a2cf33c729f3d29b2a0bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-l, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-19T04:29:38.618 INFO:journalctl@ceph.mds.l.smithi102.stdout:Sep 19 04:29:38 smithi102 bash[71507]: ceph-77957c0a-763c-11ef-bceb-c7b262605968-mds-l 2024-09-19T04:29:38.754 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-77957c0a-763c-11ef-bceb-c7b262605968@mds.l.service' 2024-09-19T04:29:38.786 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:29:38.786 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-19T04:29:38.786 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 77957c0a-763c-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T04:29:38.998 INFO:teuthology.orchestra.run.smithi007.stdout:Deleting cluster with fsid: 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:29:41.622 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 77957c0a-763c-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T04:29:41.820 INFO:teuthology.orchestra.run.smithi092.stdout:Deleting cluster with fsid: 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:29:44.265 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 77957c0a-763c-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T04:29:44.468 INFO:teuthology.orchestra.run.smithi102.stdout:Deleting cluster with fsid: 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:29:46.810 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T04:29:46.845 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T04:29:46.877 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T04:29:46.904 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T04:29:46.905 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911625/remote/smithi007/crash 2024-09-19T04:29:46.906 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/crash -- . 2024-09-19T04:29:46.936 INFO:teuthology.orchestra.run.smithi007.stderr:tar: /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T04:29:46.936 INFO:teuthology.orchestra.run.smithi007.stderr:tar: Error is not recoverable: exiting now 2024-09-19T04:29:46.938 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911625/remote/smithi092/crash 2024-09-19T04:29:46.939 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/crash -- . 2024-09-19T04:29:46.979 INFO:teuthology.orchestra.run.smithi092.stderr:tar: /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T04:29:46.979 INFO:teuthology.orchestra.run.smithi092.stderr:tar: Error is not recoverable: exiting now 2024-09-19T04:29:46.981 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911625/remote/smithi102/crash 2024-09-19T04:29:46.982 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/crash -- . 2024-09-19T04:29:47.023 INFO:teuthology.orchestra.run.smithi102.stderr:tar: /var/lib/ceph/77957c0a-763c-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T04:29:47.023 INFO:teuthology.orchestra.run.smithi102.stderr:tar: Error is not recoverable: exiting now 2024-09-19T04:29:47.024 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T04:29:47.024 DEBUG:teuthology.orchestra.run.smithi007:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-19T04:29:47.063 INFO:tasks.cephadm:Compressing logs... 2024-09-19T04:29:47.064 DEBUG:teuthology.orchestra.run.smithi007:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T04:29:47.106 DEBUG:teuthology.orchestra.run.smithi092:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T04:29:47.109 DEBUG:teuthology.orchestra.run.smithi102:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T04:29:47.133 INFO:teuthology.orchestra.run.smithi007.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-19T04:29:47.133 INFO:teuthology.orchestra.run.smithi007.stderr:: No such file or directory 2024-09-19T04:29:47.133 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T04:29:47.133 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-19T04:29:47.137 INFO:teuthology.orchestra.run.smithi102.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T04:29:47.137 INFO:teuthology.orchestra.run.smithi102.stderr:: No such file or directory 2024-09-19T04:29:47.137 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T04:29:47.138 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-19T04:29:47.138 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-19T04:29:47.138 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T04:29:47.138 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-19T04:29:47.138 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T04:29:47.138 INFO:teuthology.orchestra.run.smithi102.stderr: 82.3% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T04:29:47.138 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.11.log: /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.2.log: 90.4% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T04:29:47.140 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T04:29:47.140 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T04:29:47.140 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-19T04:29:47.140 INFO:teuthology.orchestra.run.smithi007.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-19T04:29:47.140 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T04:29:47.140 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-19T04:29:47.141 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.a.log: /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-19T04:29:47.141 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mon.a.log: 82.5% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T04:29:47.141 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-19T04:29:47.141 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph.log 2024-09-19T04:29:47.141 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.6.log: /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.g.log: 90.2% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T04:29:47.142 INFO:teuthology.orchestra.run.smithi092.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-19T04:29:47.142 INFO:teuthology.orchestra.run.smithi102.stderr: 91.0% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T04:29:47.143 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-19T04:29:47.143 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T04:29:47.144 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-19T04:29:47.144 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.10.log: /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T04:29:47.144 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-19T04:29:47.144 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-19T04:29:47.147 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T04:29:47.147 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T04:29:47.147 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T04:29:47.147 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-19T04:29:47.147 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph.log 2024-09-19T04:29:47.148 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-19T04:29:47.148 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-19T04:29:47.148 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-19T04:29:47.148 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T04:29:47.149 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T04:29:47.150 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph.log 2024-09-19T04:29:47.150 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-19T04:29:47.150 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-19T04:29:47.150 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-19T04:29:47.151 INFO:teuthology.orchestra.run.smithi007.stderr: 90.9% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T04:29:47.151 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-19T04:29:47.151 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-19T04:29:47.152 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.8.log: 86.4% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T04:29:47.152 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-19T04:29:47.153 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.d.log: 86.4% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T04:29:47.154 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-19T04:29:47.158 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mgr.z.log: 92.9% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-19T04:29:47.161 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-19T04:29:47.166 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T04:29:47.174 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T04:29:47.174 INFO:teuthology.orchestra.run.smithi007.stderr: 94.6% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-19T04:29:47.177 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T04:29:47.198 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T04:29:47.209 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 93.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T04:29:47.339 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 92.7% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-19T04:29:47.364 INFO:teuthology.orchestra.run.smithi102.stderr: 94.6% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-19T04:29:47.482 INFO:teuthology.orchestra.run.smithi007.stderr: 94.9% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-19T04:29:47.506 INFO:teuthology.orchestra.run.smithi007.stderr: 90.3% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-19T04:29:47.571 INFO:teuthology.orchestra.run.smithi102.stderr: 91.7% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-19T04:29:47.632 INFO:teuthology.orchestra.run.smithi007.stderr: 95.0% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-19T04:29:47.815 INFO:teuthology.orchestra.run.smithi092.stderr: 82.3% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T04:29:47.815 INFO:teuthology.orchestra.run.smithi092.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T04:29:47.816 INFO:teuthology.orchestra.run.smithi092.stderr: 86.4% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T04:29:47.849 INFO:teuthology.orchestra.run.smithi092.stderr: 90.3% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T04:29:48.088 INFO:teuthology.orchestra.run.smithi092.stderr: 91.0% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T04:29:48.340 INFO:teuthology.orchestra.run.smithi007.stderr: 90.3% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-19T04:29:49.162 INFO:teuthology.orchestra.run.smithi092.stderr: 94.8% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-19T04:29:50.124 INFO:teuthology.orchestra.run.smithi007.stderr: 95.1% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-19T04:29:51.338 INFO:teuthology.orchestra.run.smithi102.stderr: 94.8% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-19T04:29:52.632 INFO:teuthology.orchestra.run.smithi102.stderr: 94.5% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-19T04:29:52.653 INFO:teuthology.orchestra.run.smithi092.stderr: 91.7% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-19T04:29:53.097 INFO:teuthology.orchestra.run.smithi102.stderr: 94.7% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-19T04:30:06.784 INFO:teuthology.orchestra.run.smithi102.stderr: 91.8% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-19T04:30:07.668 INFO:teuthology.orchestra.run.smithi102.stderr: 91.7% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-19T04:30:08.594 INFO:teuthology.orchestra.run.smithi007.stderr: 91.7% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T04:30:10.856 INFO:teuthology.orchestra.run.smithi007.stderr: 91.5% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T04:30:11.869 INFO:teuthology.orchestra.run.smithi007.stderr: 91.5% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-19T04:30:12.711 INFO:teuthology.orchestra.run.smithi102.stderr: 91.6% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T04:30:15.624 INFO:teuthology.orchestra.run.smithi007.stderr: 91.5% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-19T04:30:15.626 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-19T04:30:15.626 INFO:teuthology.orchestra.run.smithi007.stderr:real 0m28.506s 2024-09-19T04:30:15.627 INFO:teuthology.orchestra.run.smithi007.stderr:user 1m40.395s 2024-09-19T04:30:15.627 INFO:teuthology.orchestra.run.smithi007.stderr:sys 0m2.895s 2024-09-19T04:30:19.822 INFO:teuthology.orchestra.run.smithi102.stderr: 91.4% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T04:30:19.824 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-19T04:30:19.824 INFO:teuthology.orchestra.run.smithi102.stderr:real 0m32.701s 2024-09-19T04:30:19.825 INFO:teuthology.orchestra.run.smithi102.stderr:user 1m50.792s 2024-09-19T04:30:19.825 INFO:teuthology.orchestra.run.smithi102.stderr:sys 0m3.507s 2024-09-19T04:30:34.698 INFO:teuthology.orchestra.run.smithi092.stderr: 94.5% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-19T04:31:14.713 INFO:teuthology.orchestra.run.smithi092.stderr: 92.0% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-19T04:32:25.322 INFO:teuthology.orchestra.run.smithi092.stderr: 91.8% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-19T04:32:45.770 INFO:teuthology.orchestra.run.smithi092.stderr: 94.9% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-19T04:33:09.548 INFO:teuthology.orchestra.run.smithi092.stderr: 91.8% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T04:34:28.188 INFO:teuthology.orchestra.run.smithi092.stderr: 91.5% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T04:38:29.460 INFO:teuthology.orchestra.run.smithi092.stderr: 93.7% -- replaced with /var/log/ceph/77957c0a-763c-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-19T04:38:29.462 INFO:teuthology.orchestra.run.smithi092.stderr: 2024-09-19T04:38:29.462 INFO:teuthology.orchestra.run.smithi092.stderr:real 8m42.339s 2024-09-19T04:38:29.462 INFO:teuthology.orchestra.run.smithi092.stderr:user 5m41.545s 2024-09-19T04:38:29.462 INFO:teuthology.orchestra.run.smithi092.stderr:sys 0m14.016s 2024-09-19T04:38:29.463 INFO:tasks.cephadm:Archiving logs... 2024-09-19T04:38:29.464 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911625/remote/smithi007/log 2024-09-19T04:38:29.465 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T04:38:45.633 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911625/remote/smithi092/log 2024-09-19T04:38:45.634 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T04:39:40.419 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911625/remote/smithi102/log 2024-09-19T04:39:40.420 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T04:39:57.876 INFO:tasks.cephadm:Removing cluster... 2024-09-19T04:39:57.876 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 77957c0a-763c-11ef-bceb-c7b262605968 --force 2024-09-19T04:39:58.089 INFO:teuthology.orchestra.run.smithi007.stdout:Deleting cluster with fsid: 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:39:58.511 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 77957c0a-763c-11ef-bceb-c7b262605968 --force 2024-09-19T04:39:59.059 INFO:teuthology.orchestra.run.smithi092.stdout:Deleting cluster with fsid: 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:39:59.622 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 77957c0a-763c-11ef-bceb-c7b262605968 --force 2024-09-19T04:39:59.831 INFO:teuthology.orchestra.run.smithi102.stdout:Deleting cluster with fsid: 77957c0a-763c-11ef-bceb-c7b262605968 2024-09-19T04:40:00.322 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T04:40:00.323 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T04:40:00.342 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T04:40:00.360 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T04:40:00.376 INFO:tasks.cephadm:Teardown complete 2024-09-19T04:40:00.376 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T04:40:00.387 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T04:40:00.387 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T04:40:00.390 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T04:40:00.402 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T04:40:00.512 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T04:40:00.522 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T04:40:00.522 DEBUG:teuthology.orchestra.run.smithi007:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T04:40:00.525 DEBUG:teuthology.orchestra.run.smithi092:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T04:40:00.528 DEBUG:teuthology.orchestra.run.smithi102:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T04:40:00.540 INFO:teuthology.orchestra.run.smithi007.stderr:bash: line 1: ntpq: command not found 2024-09-19T04:40:00.541 INFO:teuthology.orchestra.run.smithi092.stderr:bash: line 1: ntpq: command not found 2024-09-19T04:40:00.542 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2024-09-19T04:40:00.545 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T04:40:00.545 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2024-09-19T04:40:00.545 INFO:teuthology.orchestra.run.smithi007.stdout:^* hv01.front.sepia.ceph.com 3 6 377 15 +23us[ +27us] +/- 43ms 2024-09-19T04:40:00.545 INFO:teuthology.orchestra.run.smithi007.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 15 +80us[ +84us] +/- 73ms 2024-09-19T04:40:00.545 INFO:teuthology.orchestra.run.smithi007.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 -120us[ -116us] +/- 82ms 2024-09-19T04:40:00.545 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:40:00.547 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T04:40:00.547 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2024-09-19T04:40:00.547 INFO:teuthology.orchestra.run.smithi102.stdout:^* hv01.front.sepia.ceph.com 3 6 377 15 +34us[ +45us] +/- 43ms 2024-09-19T04:40:00.547 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 15 +64us[ +74us] +/- 73ms 2024-09-19T04:40:00.547 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 -132us[ -132us] +/- 82ms 2024-09-19T04:40:00.547 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:40:00.569 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T04:40:00.569 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2024-09-19T04:40:00.569 INFO:teuthology.orchestra.run.smithi092.stdout:^* hv01.front.sepia.ceph.com 3 6 377 20 +17us[+5296ns] +/- 43ms 2024-09-19T04:40:00.569 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 17 +76us[ +76us] +/- 73ms 2024-09-19T04:40:00.569 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 13 -132us[ -132us] +/- 82ms 2024-09-19T04:40:00.569 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:40:00.569 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T04:40:00.579 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T04:40:00.580 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T04:40:00.592 DEBUG:teuthology.orchestra.run.smithi007:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T04:40:00.676 DEBUG:teuthology.orchestra.run.smithi092:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T04:40:00.774 DEBUG:teuthology.orchestra.run.smithi102:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T04:40:00.841 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T04:40:00.872 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T04:40:00.873 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T04:40:00.902 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T04:40:00.902 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T04:40:00.929 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T04:40:00.930 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T04:40:00.940 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T04:40:01.007 INFO:teuthology.task.internal:Duration was 2399.805614 seconds 2024-09-19T04:40:01.008 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T04:40:01.017 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T04:40:01.018 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T04:40:01.020 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T04:40:01.022 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T04:40:01.060 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T04:40:01.061 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T04:40:01.078 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T04:40:01.449 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T04:40:01.449 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi007.front.sepia.ceph.com 2024-09-19T04:40:01.450 DEBUG:teuthology.orchestra.run.smithi007:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T04:40:01.472 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi092.front.sepia.ceph.com 2024-09-19T04:40:01.473 DEBUG:teuthology.orchestra.run.smithi092:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T04:40:01.502 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi102.front.sepia.ceph.com 2024-09-19T04:40:01.503 DEBUG:teuthology.orchestra.run.smithi102:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T04:40:01.528 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T04:40:01.528 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T04:40:01.531 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T04:40:01.546 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T04:40:01.594 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T04:40:01.594 DEBUG:teuthology.orchestra.run.smithi007:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T04:40:01.600 DEBUG:teuthology.orchestra.run.smithi092:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T04:40:01.617 DEBUG:teuthology.orchestra.run.smithi102:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T04:40:02.348 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T04:40:02.359 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T04:40:02.359 DEBUG:teuthology.orchestra.run.smithi007:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T04:40:02.385 DEBUG:teuthology.orchestra.run.smithi092:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T04:40:02.422 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T04:40:02.447 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T04:40:02.458 DEBUG:teuthology.orchestra.run.smithi007:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T04:40:02.460 DEBUG:teuthology.orchestra.run.smithi092:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T04:40:02.465 DEBUG:teuthology.orchestra.run.smithi102:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T04:40:02.482 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = core 2024-09-19T04:40:02.492 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = core 2024-09-19T04:40:02.511 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = core 2024-09-19T04:40:02.525 DEBUG:teuthology.orchestra.run.smithi007:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T04:40:02.547 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T04:40:02.547 DEBUG:teuthology.orchestra.run.smithi092:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T04:40:02.566 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T04:40:02.567 DEBUG:teuthology.orchestra.run.smithi102:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T04:40:02.581 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T04:40:02.582 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T04:40:02.593 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T04:40:02.594 DEBUG:teuthology.misc:Transferring archived files from smithi007:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911625/remote/smithi007 2024-09-19T04:40:02.594 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T04:40:02.648 DEBUG:teuthology.misc:Transferring archived files from smithi092:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911625/remote/smithi092 2024-09-19T04:40:02.648 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T04:40:02.684 DEBUG:teuthology.misc:Transferring archived files from smithi102:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911625/remote/smithi102 2024-09-19T04:40:02.684 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T04:40:02.720 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T04:40:02.721 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T04:40:02.723 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T04:40:02.726 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T04:40:02.770 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T04:40:02.784 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T04:40:02.784 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T04:40:02.795 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T04:40:02.795 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T04:40:02.798 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T04:40:02.800 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T04:40:02.811 INFO:teuthology.orchestra.run.smithi007.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 04:40 /home/ubuntu/cephtest 2024-09-19T04:40:02.813 INFO:teuthology.orchestra.run.smithi092.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 04:40 /home/ubuntu/cephtest 2024-09-19T04:40:02.825 INFO:teuthology.orchestra.run.smithi102.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 04:40 /home/ubuntu/cephtest 2024-09-19T04:40:02.826 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T04:40:02.837 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T04:40:02.863 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/blogbench}} duration: 2399.80561375618 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-19T04:40:02.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T04:40:02.939 INFO:teuthology.run:pass